[2025-10-10T17:00:01.611416] [INFO ] [MAIN ] Using last completed trading day: 2025-10-10 [2025-10-10T17:00:01.830613] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-10T17:00:01.830884] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-10T17:00:02.154392] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-10T17:00:02.154872] [WARN ] [STATE ] State set to: RUNNING [2025-10-10T17:00:02.154953] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-10T17:00:02.155021] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-10T17:00:02.155125] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-10T17:00:02.155162] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-10T17:00:03.988228] [DEBUG] [SYMBOL ] Found 2425 valid NYSE symbols. [2025-10-10T17:00:03.988429] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-10T17:00:03.988723] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-10T17:00:03.989358] [INFO ] [LOCAL ] Symbols cache updated with 2373 symbols. [2025-10-10T17:00:03.989425] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-10T17:00:03.989465] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-10T17:00:03.989540] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-10T17:00:03.989579] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-10T17:00:03.989670] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-10T17:00:03.990052] [DEBUG] [LOCAL ] Found 2373 symbols in cached list. [2025-10-10T17:00:03.990089] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-10T17:00:03.990244] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-10T17:00:03.990278] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2373 valid symbols. [2025-10-10T17:00:03.990310] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-10T17:00:03.990341] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-10T17:00:04.010837] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-10T17:00:04.031289] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-10T17:00:04.031383] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-10T17:00:04.031421] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-10T17:00:04.031450] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-10T17:00:04.031524] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-10T17:00:04.031984] [DEBUG] [LOCAL ] Found 2373 symbols in cached list. [2025-10-10T17:00:04.032038] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-10T17:00:04.032114] [INFO ] [MAIN ] Starting incremental update for 2373 symbols. [2025-10-10T17:00:04.032163] [INFO ] [MAIN ] Running in parallel mode [2025-10-10T17:00:04.032476] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2373 symbols [2025-10-10T17:00:04.816883] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:04.824534] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:04.821968] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:04.845936] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:04.847531] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-10T17:00:04.848547] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-10T17:00:04.848719] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-10T17:00:04.849948] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-10T17:00:04.850164] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-10T17:00:04.850054] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-10T17:00:04.850558] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-10T17:00:04.850436] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-10T17:00:04.850774] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-10T17:00:04.851016] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-10T17:00:04.856588] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-10T17:00:04.856904] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-10T17:00:05.542947] [DEBUG] [LOCAL ] A: Loaded 51104 existing records from primary storage. [2025-10-10T17:00:05.594758] [INFO ] [MAIN ] A: Loaded 51104 existing records. [2025-10-10T17:00:05.607402] [DEBUG] [LOCAL ] AA: Loaded 54010 existing records from primary storage. [2025-10-10T17:00:05.756769] [INFO ] [MAIN ] AA: Loaded 54010 existing records. [2025-10-10T17:00:05.791868] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:05.889245] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-10T17:00:05.898025] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:05.943522] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-10T17:00:06.169568] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:00:06.178020] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:00:06.178671] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-10T17:00:06.178461] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-10T17:00:06.178840] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-10T17:00:06.178957] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-10T17:00:06.179512] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-10T17:00:06.179583] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-10T17:00:06.185314] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-10T17:00:06.198092] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-10T17:00:06.401591] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:00:06.486791] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-10T17:00:06.492978] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:00:06.498311] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-10T17:00:06.511036] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:00:06.559422] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-10T17:00:06.577916] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-10T17:00:06.601463] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-10T17:00:06.706954] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-10T17:00:06.754169] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-10T17:00:06.777901] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-10T17:00:06.811240] [INFO ] [MAIN ] Update Progress: 1/2373 symbols completed. AAMI took 2.7s. Estimated remaining: 1h 49m 52s. Rate: 21.6 symbols/min [2025-10-10T17:00:07.048299] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:07.090542] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-10T17:00:07.134507] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-10T17:00:07.190386] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:07.202589] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-10T17:00:07.209952] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-10T17:00:07.298485] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:07.365734] [DEBUG] [LOCAL ] AAP: Loaded 52268 existing records from primary storage. [2025-10-10T17:00:07.366130] [INFO ] [MAIN ] AAP: Loaded 52268 existing records. [2025-10-10T17:00:07.547088] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:00:07.547366] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-10T17:00:07.547415] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-10T17:00:07.547864] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-10T17:00:07.547921] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-10T17:00:07.660561] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-10T17:00:07.674718] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-10T17:00:08.010604] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:08.010998] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-10T17:00:08.134271] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-10T17:00:08.135498] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-10T17:00:08.533052] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-10T17:00:08.534219] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-10T17:00:08.773024] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-10T17:00:08.783211] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-10T17:00:08.789983] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-10T17:00:08.790947] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-10T17:00:08.824129] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T17:00:08.835320] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-10T17:00:09.228436] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-10T17:00:09.229542] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-10T17:00:09.388317] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T17:00:09.398850] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-10T17:00:09.621243] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-10T17:00:09.622382] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-10T17:00:10.124012] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-10T17:00:10.125108] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-10T17:00:10.453353] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-10T17:00:10.454278] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-10T17:00:10.503284] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T17:00:10.514244] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-10T17:00:10.757368] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T17:00:10.768116] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-10T17:00:10.854210] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T17:00:10.864430] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-10T17:00:10.914351] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-10T17:00:10.915254] [INFO ] [REMOTE ] AAM: Full fetch complete (940 records). [2025-10-10T17:00:10.915336] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-10T17:00:11.107898] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-10T17:00:11.108167] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:00:11.108243] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:00:11.108320] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-10T17:00:11.108394] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-10T17:00:11.108433] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-10T17:00:11.108473] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-10T17:00:11.108545] [INFO ] [MAIN ] Update Progress: 2/2373 symbols completed. AAM took 7.0s. Estimated remaining: 2h 19m 49s. Rate: 17.0 symbols/min [2025-10-10T17:00:11.294256] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:11.331732] [DEBUG] [LOCAL ] AAT: Loaded 30487 existing records from primary storage. [2025-10-10T17:00:11.332147] [INFO ] [MAIN ] AAT: Loaded 30487 existing records. [2025-10-10T17:00:11.571758] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:00:11.572050] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-10T17:00:11.572102] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-10T17:00:11.572386] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-10T17:00:11.572445] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-10T17:00:11.966789] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:11.967198] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-10T17:00:12.819723] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-10T17:00:12.829770] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-10T17:00:12.860257] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-10T17:00:12.870478] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-10T17:00:12.981280] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-10T17:00:12.991751] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-10T17:00:13.725389] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T17:00:13.731843] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-10T17:00:14.411884] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-10T17:00:14.422815] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-10T17:00:14.464898] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-10T17:00:14.476426] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-10T17:00:14.814056] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T17:00:14.825152] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-10T17:00:15.329760] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-10T17:00:15.335463] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-10T17:00:16.146023] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T17:00:16.157576] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-10T17:00:16.329245] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-10T17:00:16.335458] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-10T17:00:16.429821] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T17:00:16.442284] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-10T17:00:17.266096] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-10T17:00:17.277368] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-10T17:00:17.887994] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T17:00:17.894802] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-10T17:00:18.487950] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T17:00:18.516334] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-10T17:00:18.527172] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-10T17:00:18.528748] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-10T17:00:19.242798] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T17:00:19.250404] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-10T17:00:19.629572] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-10T17:00:19.641077] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-10T17:00:20.348947] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T17:00:20.359624] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-10T17:00:20.676900] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-10T17:00:20.688424] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-10T17:00:20.853283] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-10T17:00:20.859856] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-10T17:00:21.331859] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T17:00:21.342673] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-10T17:00:21.843792] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-10T17:00:21.855816] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-10T17:00:22.214188] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-10T17:00:22.221109] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-10T17:00:22.373277] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T17:00:22.386147] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-10T17:00:23.303058] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-10T17:00:23.314174] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-10T17:00:23.607779] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-10T17:00:23.620144] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-10T17:00:23.837427] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T17:00:23.844957] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-10T17:00:24.441950] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-10T17:00:24.453269] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-10T17:00:24.725730] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T17:00:24.737741] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-10T17:00:24.755931] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T17:00:24.764187] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-10T17:00:25.706234] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-10T17:00:25.717823] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-10T17:00:25.787775] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-10T17:00:25.794965] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-10T17:00:25.907123] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-10T17:00:25.919026] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-10T17:00:26.704054] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-10T17:00:26.710118] [INFO ] [REMOTE ] A: Full fetch complete (73137 records). [2025-10-10T17:00:26.710304] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-10T17:00:27.077434] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T17:00:27.094120] [INFO ] [REMOTE ] AAT: Full fetch complete (42659 records). [2025-10-10T17:00:27.115139] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-10T17:00:27.164488] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-10T17:00:27.178559] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-10T17:00:27.180142] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-10T17:00:27.205083] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-10T17:00:27.285785] [DEBUG] [LOCAL ] A: Trimmed 73137 records to 51489 (keeping 200 days of data) [2025-10-10T17:00:27.642282] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-10T17:00:27.693074] [INFO ] [REMOTE ] AAP: Full fetch complete (75023 records). [2025-10-10T17:00:27.708344] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-10T17:00:27.709353] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-10T17:00:27.715305] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-10T17:00:27.721592] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-10T17:00:27.731877] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-10T17:00:27.939139] [DEBUG] [LOCAL ] AAT: Trimmed 42659 records to 30722 (keeping 200 days of data) [2025-10-10T17:00:28.103204] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-10T17:00:28.320108] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-10T17:00:28.354469] [DEBUG] [LOCAL ] A: Primary data saved (51489 records). [2025-10-10T17:00:28.361517] [INFO ] [MAIN ] A: Full history saved. [2025-10-10T17:00:28.367441] [INFO ] [MAIN ] Update Progress: 3/2373 symbols completed. A took 24.3s. Estimated remaining: 5h 20m 25s. Rate: 7.4 symbols/min [2025-10-10T17:00:28.627151] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-10T17:00:28.632602] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-10T17:00:28.657240] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-10T17:00:28.714921] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:28.715590] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-10T17:00:28.715911] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-10T17:00:28.716705] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-10T17:00:28.721268] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-10T17:00:28.724576] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-10T17:00:28.726540] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-10T17:00:28.725597] [DEBUG] [LOCAL ] AAP: Trimmed 75023 records to 52653 (keeping 200 days of data) [2025-10-10T17:00:28.728371] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-10T17:00:29.194243] [DEBUG] [LOCAL ] AAT: Primary data saved (30722 records). [2025-10-10T17:00:29.204728] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-10T17:00:29.210690] [INFO ] [MAIN ] Update Progress: 4/2373 symbols completed. AAT took 18.1s. Estimated remaining: 4h 8m 32s. Rate: 9.5 symbols/min [2025-10-10T17:00:29.320925] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:29.340693] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-10T17:00:29.468369] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:29.497781] [DEBUG] [LOCAL ] AB: Loaded 26515 existing records from primary storage. [2025-10-10T17:00:29.500703] [INFO ] [MAIN ] AB: Loaded 26515 existing records. [2025-10-10T17:00:29.634240] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:00:29.700526] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-10T17:00:29.711410] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:00:29.717080] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-10T17:00:29.737729] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:00:29.780244] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-10T17:00:29.779839] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:00:29.781840] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-10T17:00:29.782318] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-10T17:00:29.782197] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-10T17:00:29.782755] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-10T17:00:29.783497] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-10T17:00:29.784196] [INFO ] [MAIN ] Update Progress: 5/2373 symbols completed. AAUC took 1.4s. Estimated remaining: 3h 23m 16s. Rate: 11.6 symbols/min [2025-10-10T17:00:29.796602] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-10T17:00:29.796981] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-10T17:00:30.231098] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:30.288314] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-10T17:00:30.295254] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-10T17:00:30.318680] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-10T17:00:30.330139] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-10T17:00:30.416492] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-10T17:00:30.424557] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-10T17:00:30.426021] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-10T17:00:30.548090] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:30.563845] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-10T17:00:30.592732] [INFO ] [REMOTE ] AA: Full fetch complete (77542 records). [2025-10-10T17:00:30.592991] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-10T17:00:30.972692] [DEBUG] [LOCAL ] AAP: Primary data saved (52653 records). [2025-10-10T17:00:30.994468] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-10T17:00:31.058839] [INFO ] [MAIN ] Update Progress: 6/2373 symbols completed. AAP took 24.2s. Estimated remaining: 2h 57m 42s. Rate: 13.3 symbols/min [2025-10-10T17:00:31.433371] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:31.444573] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-10T17:00:31.581490] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:31.618054] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-10T17:00:31.618149] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-10T17:00:31.619103] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-10T17:00:31.619273] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-10T17:00:31.621196] [DEBUG] [LOCAL ] AA: Trimmed 77542 records to 54400 (keeping 200 days of data) [2025-10-10T17:00:31.737187] [DEBUG] [LOCAL ] ABCB: Loaded 30682 existing records from primary storage. [2025-10-10T17:00:31.738195] [INFO ] [MAIN ] ABCB: Loaded 30682 existing records. [2025-10-10T17:00:31.928957] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:00:31.930399] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-10T17:00:31.931943] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-10T17:00:31.934329] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-10T17:00:31.934809] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-10T17:00:32.127503] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-10T17:00:32.214363] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-10T17:00:32.519718] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:32.521739] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-10T17:00:32.634974] [DEBUG] [LOCAL ] AA: Primary data saved (54400 records). [2025-10-10T17:00:32.635151] [INFO ] [MAIN ] AA: Full history saved. [2025-10-10T17:00:32.637203] [INFO ] [MAIN ] Update Progress: 7/2373 symbols completed. AA took 28.6s. Estimated remaining: 2h 41m 8s. Rate: 14.7 symbols/min [2025-10-10T17:00:32.806075] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:32.860633] [DEBUG] [LOCAL ] ABEV: Loaded 53667 existing records from primary storage. [2025-10-10T17:00:32.861015] [INFO ] [MAIN ] ABEV: Loaded 53667 existing records. [2025-10-10T17:00:33.047794] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:00:33.048040] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-10T17:00:33.048090] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-10T17:00:33.048376] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-10T17:00:33.048435] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-10T17:00:33.468405] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:33.468906] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-10T17:00:33.765625] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-10T17:00:33.776795] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-10T17:00:33.849445] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T17:00:33.857009] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-10T17:00:34.092607] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-10T17:00:34.098777] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-10T17:00:35.368432] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T17:00:35.379491] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-10T17:00:35.533213] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-10T17:00:35.544487] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-10T17:00:35.705910] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T17:00:35.714878] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-10T17:00:35.766818] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T17:00:35.773666] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-10T17:00:36.856893] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-10T17:00:36.863029] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-10T17:00:37.453323] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-10T17:00:37.464743] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-10T17:00:37.495696] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T17:00:37.505211] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-10T17:00:37.586358] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-10T17:00:37.596733] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-10T17:00:37.943048] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-10T17:00:37.950256] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-10T17:00:38.871114] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-10T17:00:38.884561] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-10T17:00:39.260737] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T17:00:39.287982] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-10T17:00:39.300142] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T17:00:39.310929] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-10T17:00:39.394008] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-10T17:00:39.402389] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-10T17:00:40.393635] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-10T17:00:40.405519] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-10T17:00:40.698775] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-10T17:00:40.705246] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-10T17:00:40.842122] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-10T17:00:40.848547] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-10T17:00:41.402352] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T17:00:41.414704] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-10T17:00:41.637631] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-10T17:00:41.642737] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-10T17:00:42.138754] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-10T17:00:42.144855] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-10T17:00:42.392188] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T17:00:42.404489] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-10T17:00:42.506189] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-10T17:00:42.512048] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-10T17:00:43.205107] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T17:00:43.216856] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-10T17:00:43.287057] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-10T17:00:43.292323] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-10T17:00:43.705968] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-10T17:00:43.713280] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-10T17:00:44.413808] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T17:00:44.425206] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-10T17:00:44.635107] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-10T17:00:44.641099] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-10T17:00:44.799419] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-10T17:00:44.806616] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-10T17:00:45.046279] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T17:00:45.057737] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-10T17:00:45.478842] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T17:00:45.481289] [INFO ] [REMOTE ] AB: Full fetch complete (44611 records). [2025-10-10T17:00:45.481415] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-10T17:00:45.482077] [FATAL] [VALIDATOR ] AB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:00:45.482182] [FATAL] [MAIN ] AB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:00:45.482254] [WARN ] [MAIN ] AB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:00:45.482340] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-10T17:00:45.482442] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-10T17:00:45.482497] [INFO ] [LOCAL ] AB: Starting deletion of derivative data. [2025-10-10T17:00:45.482720] [DEBUG] [LOCAL ] AB: Deleted derivative data file. [2025-10-10T17:00:45.482823] [INFO ] [MAIN ] Update Progress: 8/2373 symbols completed. AB took 16.3s. Estimated remaining: 3h 24m 14s. Rate: 11.6 symbols/min [2025-10-10T17:00:45.657129] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:45.676047] [DEBUG] [LOCAL ] ABG: Loaded 18588 existing records from primary storage. [2025-10-10T17:00:45.676372] [INFO ] [MAIN ] ABG: Loaded 18588 existing records. [2025-10-10T17:00:45.860813] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:00:45.861212] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-10T17:00:45.861274] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-10T17:00:45.861524] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-10T17:00:45.861584] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-10T17:00:46.245213] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:46.245572] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-10T17:00:46.401266] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-10T17:00:46.408458] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-10T17:00:46.521137] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-10T17:00:46.533445] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-10T17:00:47.010956] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-10T17:00:47.014559] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-10T17:00:47.364885] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-10T17:00:47.377633] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-10T17:00:47.790250] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-10T17:00:47.796637] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-10T17:00:47.859200] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T17:00:47.864202] [INFO ] [REMOTE ] ABCB: Full fetch complete (44677 records). [2025-10-10T17:00:47.864391] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-10T17:00:48.260276] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-10T17:00:48.260548] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-10T17:00:48.261284] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-10T17:00:48.261354] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-10T17:00:48.262919] [DEBUG] [LOCAL ] ABCB: Trimmed 44677 records to 30965 (keeping 200 days of data) [2025-10-10T17:00:48.469900] [DEBUG] [LOCAL ] ABCB: Primary data saved (30965 records). [2025-10-10T17:00:48.470210] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-10T17:00:48.470445] [INFO ] [MAIN ] Update Progress: 9/2373 symbols completed. ABCB took 17.4s. Estimated remaining: 3h 14m 32s. Rate: 12.2 symbols/min [2025-10-10T17:00:48.703506] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:48.721474] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-10T17:00:48.734223] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-10T17:00:48.739158] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-10T17:00:48.739488] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-10T17:00:48.772983] [DEBUG] [LOCAL ] ABM: Loaded 32168 existing records from primary storage. [2025-10-10T17:00:48.773344] [INFO ] [MAIN ] ABM: Loaded 32168 existing records. [2025-10-10T17:00:48.961366] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:00:48.961815] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-10T17:00:48.961878] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-10T17:00:48.962185] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-10T17:00:48.962248] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-10T17:00:49.362106] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:49.362602] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-10T17:00:49.598018] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-10T17:00:49.609786] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-10T17:00:50.038234] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T17:00:50.043397] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-10T17:00:50.151178] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T17:00:50.163997] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-10T17:00:50.495986] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T17:00:50.502029] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-10T17:00:50.965133] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-10T17:00:50.971325] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-10T17:00:51.888663] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-10T17:00:51.912746] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-10T17:00:51.914046] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T17:00:51.919806] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-10T17:00:51.986639] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T17:00:51.998288] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-10T17:00:52.051242] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-10T17:00:52.057172] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-10T17:00:52.785704] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T17:00:52.791190] [INFO ] [REMOTE ] ABBV: Full fetch complete (77721 records). [2025-10-10T17:00:52.791364] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-10T17:00:53.131569] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-10T17:00:53.136944] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-10T17:00:53.257764] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-10T17:00:53.257887] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-10T17:00:53.258771] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-10T17:00:53.258844] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-10T17:00:53.260931] [DEBUG] [LOCAL ] ABBV: Trimmed 77721 records to 54466 (keeping 200 days of data) [2025-10-10T17:00:53.383290] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T17:00:53.398273] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-10T17:00:53.661036] [DEBUG] [LOCAL ] ABBV: Primary data saved (54466 records). [2025-10-10T17:00:53.661251] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-10T17:00:53.661364] [INFO ] [MAIN ] Update Progress: 10/2373 symbols completed. ABBV took 23.9s. Estimated remaining: 3h 15m 27s. Rate: 12.1 symbols/min [2025-10-10T17:00:53.939064] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:53.957061] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-10T17:00:53.974307] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-10T17:00:53.976988] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-10T17:00:53.982985] [INFO ] [REMOTE ] ABEV: Full fetch complete (77216 records). [2025-10-10T17:00:53.983094] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-10T17:00:54.320301] [DEBUG] [LOCAL ] ABR: Loaded 52338 existing records from primary storage. [2025-10-10T17:00:54.340375] [INFO ] [MAIN ] ABR: Loaded 52338 existing records. [2025-10-10T17:00:54.608789] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-10T17:00:54.613291] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-10T17:00:54.619847] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-10T17:00:54.625142] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-10T17:00:54.692479] [DEBUG] [LOCAL ] ABEV: Trimmed 77216 records to 54056 (keeping 200 days of data) [2025-10-10T17:00:54.696730] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:00:54.698695] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-10T17:00:54.698841] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-10T17:00:54.699184] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-10T17:00:54.699244] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-10T17:00:55.090301] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T17:00:55.129197] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-10T17:00:55.284429] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:55.287265] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-10T17:00:55.396495] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-10T17:00:55.402445] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-10T17:00:55.509457] [DEBUG] [LOCAL ] ABEV: Primary data saved (54056 records). [2025-10-10T17:00:55.509624] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-10T17:00:55.509748] [INFO ] [MAIN ] Update Progress: 11/2373 symbols completed. ABEV took 22.9s. Estimated remaining: 3h 4m 14s. Rate: 12.8 symbols/min [2025-10-10T17:00:55.677751] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:55.730887] [DEBUG] [LOCAL ] ABT: Loaded 54012 existing records from primary storage. [2025-10-10T17:00:55.731271] [INFO ] [MAIN ] ABT: Loaded 54012 existing records. [2025-10-10T17:00:55.913280] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:00:55.913549] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-10T17:00:55.913664] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-10T17:00:55.914008] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-10T17:00:55.914082] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-10T17:00:56.264930] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:56.265279] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-10T17:00:56.489096] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-10T17:00:56.493102] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-10T17:00:56.628696] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-10T17:00:56.636335] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-10T17:00:57.442319] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-10T17:00:57.452800] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-10T17:00:57.705902] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-10T17:00:57.708119] [INFO ] [REMOTE ] ABG: Full fetch complete (26560 records). [2025-10-10T17:00:57.708206] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-10T17:00:58.055805] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-10T17:00:58.116805] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-10T17:00:58.129159] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-10T17:00:58.129403] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-10T17:00:58.130268] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-10T17:00:58.130450] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-10T17:00:58.131780] [DEBUG] [LOCAL ] ABG: Trimmed 26560 records to 18707 (keeping 200 days of data) [2025-10-10T17:00:58.255826] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-10T17:00:58.267515] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-10T17:00:58.285958] [DEBUG] [LOCAL ] ABG: Primary data saved (18707 records). [2025-10-10T17:00:58.286098] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-10T17:00:58.286202] [INFO ] [MAIN ] Update Progress: 12/2373 symbols completed. ABG took 12.8s. Estimated remaining: 2h 57m 54s. Rate: 13.3 symbols/min [2025-10-10T17:00:58.457206] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:00:58.479942] [DEBUG] [LOCAL ] ACA: Loaded 23314 existing records from primary storage. [2025-10-10T17:00:58.480271] [INFO ] [MAIN ] ACA: Loaded 23314 existing records. [2025-10-10T17:00:58.671737] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:00:58.672028] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-10T17:00:58.672091] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-10T17:00:58.672416] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-10T17:00:58.672473] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-10T17:00:59.040736] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:00:59.041103] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-10T17:00:59.344244] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T17:00:59.351700] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-10T17:00:59.480232] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T17:00:59.490858] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-10T17:00:59.780696] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T17:00:59.791419] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-10T17:01:00.390110] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T17:01:00.394824] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-10T17:01:01.161125] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T17:01:01.168606] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-10T17:01:01.189555] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-10T17:01:01.195039] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-10T17:01:01.437549] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T17:01:01.447961] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-10T17:01:02.045399] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-10T17:01:02.062167] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-10T17:01:02.142924] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-10T17:01:02.148705] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-10T17:01:02.765565] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T17:01:02.772621] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-10T17:01:03.549623] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-10T17:01:03.562475] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-10T17:01:03.696024] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T17:01:03.705944] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-10T17:01:04.117324] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-10T17:01:04.130112] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-10T17:01:04.154340] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T17:01:04.162464] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-10T17:01:05.211094] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-10T17:01:05.222234] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-10T17:01:05.557669] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-10T17:01:05.562519] [INFO ] [REMOTE ] ABM: Full fetch complete (44800 records). [2025-10-10T17:01:05.562805] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-10T17:01:05.973470] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-10T17:01:06.030913] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-10T17:01:06.175357] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-10T17:01:06.175807] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-10T17:01:06.176552] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-10T17:01:06.177164] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-10T17:01:06.179218] [DEBUG] [LOCAL ] ABM: Trimmed 44800 records to 32404 (keeping 200 days of data) [2025-10-10T17:01:06.325034] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-10T17:01:06.354497] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-10T17:01:06.444278] [DEBUG] [LOCAL ] ABM: Primary data saved (32404 records). [2025-10-10T17:01:06.446637] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-10T17:01:06.448944] [INFO ] [MAIN ] Update Progress: 13/2373 symbols completed. ABM took 18.0s. Estimated remaining: 3h 8m 51s. Rate: 12.5 symbols/min [2025-10-10T17:01:06.660391] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:01:06.660818] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-10-10T17:01:06.660893] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-10-10T17:01:06.667165] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-10T17:01:06.676857] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-10T17:01:06.678627] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-10T17:01:06.678498] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-10T17:01:06.678840] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-10T17:01:06.690478] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-10T17:01:07.118134] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:01:07.118504] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-10T17:01:07.590522] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T17:01:07.596501] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-10T17:01:07.952158] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T17:01:07.964245] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-10T17:01:08.121697] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T17:01:08.129105] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-10T17:01:08.476757] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-10T17:01:08.490475] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-10T17:01:08.938594] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-10T17:01:08.944075] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-10T17:01:09.196189] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-10T17:01:09.204071] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-10T17:01:09.945018] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-10T17:01:09.956927] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-10T17:01:10.216900] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-10T17:01:10.223196] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-10T17:01:10.334527] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-10T17:01:10.342746] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-10T17:01:10.434145] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T17:01:10.446036] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-10T17:01:11.504751] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T17:01:11.509457] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-10T17:01:12.130630] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T17:01:12.140123] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-10T17:01:12.219779] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T17:01:12.233456] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-10T17:01:12.246560] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-10T17:01:12.246913] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-10T17:01:12.385971] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T17:01:12.388761] [INFO ] [REMOTE ] ACA: Full fetch complete (34005 records). [2025-10-10T17:01:12.388853] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-10T17:01:12.389730] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:01:12.389819] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:01:12.389897] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:01:12.389976] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-10T17:01:12.390072] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-10T17:01:12.390151] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-10T17:01:12.390350] [DEBUG] [LOCAL ] ACA: Deleted derivative data file. [2025-10-10T17:01:12.390453] [INFO ] [MAIN ] Update Progress: 14/2373 symbols completed. ACA took 14.1s. Estimated remaining: 3h 11m 58s. Rate: 12.3 symbols/min [2025-10-10T17:01:12.567143] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:01:12.594079] [DEBUG] [LOCAL ] ACEL: Loaded 26864 existing records from primary storage. [2025-10-10T17:01:12.594358] [INFO ] [MAIN ] ACEL: Loaded 26864 existing records. [2025-10-10T17:01:12.799887] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:01:12.800190] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-10T17:01:12.800240] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-10T17:01:12.800501] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-10T17:01:12.800558] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-10T17:01:13.152926] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:01:13.153268] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-10T17:01:13.766584] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T17:01:13.778586] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-10T17:01:13.888238] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-10T17:01:13.917345] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-10T17:01:13.935892] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T17:01:14.065038] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-10T17:01:14.689399] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-10T17:01:14.964617] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-10T17:01:15.462324] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-10T17:01:15.489351] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-10T17:01:15.984495] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T17:01:16.289394] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-10T17:01:17.076853] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-10T17:01:17.082829] [INFO ] [REMOTE ] ABR: Full fetch complete (75234 records). [2025-10-10T17:01:17.083011] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-10T17:01:17.095961] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-10T17:01:17.534639] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-10T17:01:17.534785] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-10T17:01:17.535626] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-10T17:01:17.535725] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-10T17:01:17.537828] [DEBUG] [LOCAL ] ABR: Trimmed 75234 records to 52712 (keeping 200 days of data) [2025-10-10T17:01:17.891318] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-10T17:01:17.905326] [DEBUG] [LOCAL ] ABR: Primary data saved (52712 records). [2025-10-10T17:01:17.906135] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-10T17:01:17.908065] [INFO ] [MAIN ] Update Progress: 15/2373 symbols completed. ABR took 24.2s. Estimated remaining: 3h 13m 33s. Rate: 12.2 symbols/min [2025-10-10T17:01:18.104699] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:01:18.124415] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T17:01:18.203608] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-10-10T17:01:18.203997] [INFO ] [MAIN ] ACHR: Loaded 54208 existing records. [2025-10-10T17:01:18.380252] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:01:18.380528] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-10T17:01:18.380584] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-10T17:01:18.381146] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-10T17:01:18.381257] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-10T17:01:18.690195] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-10T17:01:18.790790] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:01:18.808526] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-10T17:01:19.307447] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T17:01:19.313608] [INFO ] [REMOTE ] ABT: Full fetch complete (77206 records). [2025-10-10T17:01:19.313811] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-10T17:01:19.314723] [FATAL] [VALIDATOR ] ABT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:01:19.314833] [FATAL] [MAIN ] ABT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:01:19.314893] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:01:19.314949] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-10T17:01:19.315022] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-10T17:01:19.315078] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-10-10T17:01:19.315355] [DEBUG] [LOCAL ] ABT: Deleted derivative data file. [2025-10-10T17:01:19.316136] [INFO ] [MAIN ] Update Progress: 16/2373 symbols completed. ABT took 23.8s. Estimated remaining: 3h 4m 50s. Rate: 12.8 symbols/min [2025-10-10T17:01:19.446352] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-10T17:01:19.502695] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-10T17:01:19.521448] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:01:19.576306] [DEBUG] [LOCAL ] ACI: Loaded 53644 existing records from primary storage. [2025-10-10T17:01:19.576720] [INFO ] [MAIN ] ACI: Loaded 53644 existing records. [2025-10-10T17:01:19.762750] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:01:19.763004] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-10T17:01:19.763053] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-10T17:01:19.763517] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-10T17:01:19.763556] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-10T17:01:20.117489] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:01:20.289446] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-10T17:01:20.684794] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-10T17:01:21.089381] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-10T17:01:21.764124] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-10T17:01:21.889436] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-10T17:01:22.204268] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-10T17:01:22.689365] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-10T17:01:23.473401] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T17:01:23.489329] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-10T17:01:24.213150] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T17:01:24.289400] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-10T17:01:24.405707] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-10T17:01:25.089390] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-10T17:01:25.889353] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-10T17:01:25.985605] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T17:01:26.689395] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-10T17:01:27.370578] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-10T17:01:27.374804] [INFO ] [REMOTE ] ACCO: Full fetch complete (53991 records). [2025-10-10T17:01:27.374949] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-10T17:01:27.494430] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-10T17:01:27.769050] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-10T17:01:27.769152] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-10T17:01:27.769708] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-10T17:01:27.769771] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-10T17:01:27.770815] [DEBUG] [LOCAL ] ACCO: Trimmed 53991 records to 37612 (keeping 200 days of data) [2025-10-10T17:01:27.987082] [DEBUG] [LOCAL ] ACCO: Primary data saved (37612 records). [2025-10-10T17:01:27.987251] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-10T17:01:27.987335] [INFO ] [MAIN ] Update Progress: 17/2373 symbols completed. ACCO took 21.5s. Estimated remaining: 3h 13m 55s. Rate: 12.1 symbols/min [2025-10-10T17:01:28.166227] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:01:28.195983] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (3.11 seconds). [2025-10-10T17:01:28.238006] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-10T17:01:28.277758] [DEBUG] [LOCAL ] ACM: Loaded 43290 existing records from primary storage. [2025-10-10T17:01:28.278085] [INFO ] [MAIN ] ACM: Loaded 43290 existing records. [2025-10-10T17:01:28.307047] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-10T17:01:28.460084] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:01:28.460514] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-10T17:01:28.460586] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-10T17:01:28.466195] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-10T17:01:28.473667] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-10T17:01:28.474601] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T17:01:28.831617] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:01:29.089373] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-10T17:01:29.889386] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-10T17:01:30.183365] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-10T17:01:30.689423] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-10T17:01:31.133677] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-10-10T17:01:31.489387] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-10T17:01:31.790800] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T17:01:32.035727] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T17:01:32.289443] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-10T17:01:32.417471] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T17:01:33.089408] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-10T17:01:33.632862] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T17:01:33.889397] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-10T17:01:34.334638] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T17:01:34.689424] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-10T17:01:35.489359] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-10T17:01:35.876979] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-10T17:01:36.191625] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T17:01:36.289346] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-10T17:01:36.838755] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T17:01:36.841500] [INFO ] [REMOTE ] ACEL: Full fetch complete (38723 records). [2025-10-10T17:01:36.841587] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-10T17:01:37.099332] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-10T17:01:37.212588] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-10T17:01:37.212704] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-10T17:01:37.213140] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-10T17:01:37.213184] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-10T17:01:37.214059] [DEBUG] [LOCAL ] ACEL: Trimmed 38723 records to 27037 (keeping 200 days of data) [2025-10-10T17:01:37.370344] [DEBUG] [LOCAL ] ACEL: Primary data saved (27037 records). [2025-10-10T17:01:37.370504] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-10T17:01:37.370602] [INFO ] [MAIN ] Update Progress: 18/2373 symbols completed. ACEL took 25.0s. Estimated remaining: 3h 23m 32s. Rate: 11.6 symbols/min [2025-10-10T17:01:37.546024] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:01:37.598083] [DEBUG] [LOCAL ] ACN: Loaded 53818 existing records from primary storage. [2025-10-10T17:01:37.598479] [INFO ] [MAIN ] ACN: Loaded 53818 existing records. [2025-10-10T17:01:37.780040] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:01:37.780318] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-10T17:01:37.780367] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-10T17:01:37.780688] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-10T17:01:37.780753] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-10T17:01:37.894607] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-10T17:01:38.145260] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:01:38.689416] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-10T17:01:38.918501] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T17:01:39.185046] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.90 seconds). [2025-10-10T17:01:39.489397] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-10T17:01:40.289395] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-10T17:01:40.361919] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-10T17:01:40.909198] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-10T17:01:41.089433] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-10T17:01:41.471008] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T17:01:41.889403] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-10T17:01:42.536294] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-10T17:01:42.581192] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-10T17:01:42.689385] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-10T17:01:43.489349] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-10T17:01:43.606392] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T17:01:44.289436] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-10T17:01:44.899271] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-10T17:01:45.089387] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-10T17:01:45.799072] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-10T17:01:45.889379] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-10T17:01:46.211277] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-10T17:01:46.689453] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-10T17:01:47.489415] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-10T17:01:47.960010] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-10T17:01:48.006996] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-10-10T17:01:48.289344] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-10T17:01:48.416289] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T17:01:48.992587] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T17:01:49.089382] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-10T17:01:49.889418] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-10T17:01:50.431874] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-10T17:01:50.689382] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-10T17:01:51.180590] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.89 seconds). [2025-10-10T17:01:51.441119] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T17:01:51.489397] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-10T17:01:52.289368] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-10T17:01:52.589386] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T17:01:53.089402] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-10T17:01:53.154189] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T17:01:53.889391] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-10T17:01:54.689321] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-10T17:01:54.990006] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T17:01:55.191984] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-10T17:01:55.489446] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-10T17:01:55.698765] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-10T17:01:56.289397] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-10T17:01:56.902470] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-10T17:01:57.089449] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-10T17:01:57.242394] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T17:01:57.254684] [INFO ] [REMOTE ] ACI: Full fetch complete (77044 records). [2025-10-10T17:01:57.254950] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-10T17:01:57.888836] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-10T17:01:57.889059] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-10T17:01:57.890133] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-10T17:01:57.890266] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-10T17:01:57.890516] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-10T17:01:57.894445] [DEBUG] [LOCAL ] ACI: Trimmed 77044 records to 54033 (keeping 200 days of data) [2025-10-10T17:01:58.030428] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-10T17:01:58.307995] [DEBUG] [LOCAL ] ACI: Primary data saved (54033 records). [2025-10-10T17:01:58.308183] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-10T17:01:58.308285] [INFO ] [MAIN ] Update Progress: 19/2373 symbols completed. ACI took 39.0s. Estimated remaining: 3h 55m 58s. Rate: 10.0 symbols/min [2025-10-10T17:01:58.494457] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:01:58.494723] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-10-10T17:01:58.494776] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-10-10T17:01:58.494903] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-10T17:01:58.494948] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-10T17:01:58.494991] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-10T17:01:58.495026] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-10T17:01:58.706620] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-10T17:01:58.865027] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:01:59.454354] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-10T17:01:59.489331] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-10T17:02:00.121679] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-10T17:02:00.289420] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-10T17:02:00.564698] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T17:02:00.570635] [INFO ] [REMOTE ] ACM: Full fetch complete (62751 records). [2025-10-10T17:02:00.570823] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-10T17:02:01.019587] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-10T17:02:01.019732] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-10T17:02:01.020504] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-10T17:02:01.020562] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-10T17:02:01.022960] [DEBUG] [LOCAL ] ACM: Trimmed 62751 records to 43640 (keeping 200 days of data) [2025-10-10T17:02:01.093488] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-10T17:02:01.329189] [DEBUG] [LOCAL ] ACM: Primary data saved (43640 records). [2025-10-10T17:02:01.329417] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-10T17:02:01.330932] [INFO ] [MAIN ] Update Progress: 20/2373 symbols completed. ACM took 33.3s. Estimated remaining: 3h 50m 0s. Rate: 10.2 symbols/min [2025-10-10T17:02:01.527547] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:02:01.538379] [DEBUG] [LOCAL ] ACR: Loaded 5643 existing records from primary storage. [2025-10-10T17:02:01.538684] [INFO ] [MAIN ] ACR: Loaded 5643 existing records. [2025-10-10T17:02:01.754791] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:02:01.755144] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-10T17:02:01.755222] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-10T17:02:01.755431] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-10T17:02:01.755489] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-10T17:02:02.159964] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:02:02.160459] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-10T17:02:02.576312] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (3.09 seconds). [2025-10-10T17:02:02.643057] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-10T17:02:02.689138] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T17:02:02.697167] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-10T17:02:03.176897] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T17:02:03.489411] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-10T17:02:04.289394] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-10T17:02:04.848580] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-10T17:02:05.047283] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-10T17:02:05.089387] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-10T17:02:05.830010] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-10T17:02:05.889348] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-10T17:02:05.932092] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-10T17:02:05.937601] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-10T17:02:05.937819] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-10T17:02:06.360378] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-10T17:02:06.360470] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-10T17:02:06.361283] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-10T17:02:06.361352] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-10T17:02:06.363014] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54598 (keeping 200 days of data) [2025-10-10T17:02:06.585756] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-10T17:02:06.690408] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-10T17:02:06.715022] [DEBUG] [LOCAL ] ACHR: Primary data saved (54598 records). [2025-10-10T17:02:06.715191] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-10T17:02:06.715298] [INFO ] [MAIN ] Update Progress: 21/2373 symbols completed. ACHR took 48.8s. Estimated remaining: 3h 49m 1s. Rate: 10.3 symbols/min [2025-10-10T17:02:06.881381] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:02:06.913031] [DEBUG] [LOCAL ] ACRE: Loaded 33893 existing records from primary storage. [2025-10-10T17:02:06.913314] [INFO ] [MAIN ] ACRE: Loaded 33893 existing records. [2025-10-10T17:02:07.085461] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:02:07.085675] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-10T17:02:07.085732] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-10T17:02:07.086160] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-10T17:02:07.086216] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-10T17:02:07.447767] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:02:07.489352] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-10T17:02:07.618934] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T17:02:08.289476] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-10T17:02:09.089357] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-10T17:02:09.196860] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T17:02:09.466835] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-10T17:02:09.501413] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-10T17:02:09.889376] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-10T17:02:10.689391] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-10T17:02:11.489366] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-10T17:02:11.544197] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T17:02:12.112372] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T17:02:12.289381] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-10T17:02:13.089405] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-10T17:02:13.415961] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-10T17:02:13.889347] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-10T17:02:13.996888] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-10T17:02:14.065967] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-10T17:02:14.689450] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-10T17:02:15.011717] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-10T17:02:15.489410] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-10T17:02:16.289437] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-10T17:02:16.935483] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-10T17:02:16.940720] [INFO ] [REMOTE ] ACN: Full fetch complete (77152 records). [2025-10-10T17:02:16.940896] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-10T17:02:17.100530] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-10T17:02:17.191748] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-10T17:02:17.259379] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T17:02:17.396975] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-10T17:02:17.397080] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-10T17:02:17.397817] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-10T17:02:17.397881] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-10T17:02:17.399468] [DEBUG] [LOCAL ] ACN: Trimmed 77152 records to 54208 (keeping 200 days of data) [2025-10-10T17:02:17.740536] [DEBUG] [LOCAL ] ACN: Primary data saved (54208 records). [2025-10-10T17:02:17.740916] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-10T17:02:17.742019] [INFO ] [MAIN ] Update Progress: 22/2373 symbols completed. ACN took 40.4s. Estimated remaining: 3h 58m 9s. Rate: 9.9 symbols/min [2025-10-10T17:02:17.895422] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-10T17:02:17.922527] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:02:17.935045] [DEBUG] [LOCAL ] ACV: Loaded 7732 existing records from primary storage. [2025-10-10T17:02:17.935289] [INFO ] [MAIN ] ACV: Loaded 7732 existing records. [2025-10-10T17:02:18.112183] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:02:18.112397] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-10T17:02:18.112445] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-10T17:02:18.112712] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-10T17:02:18.112769] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-10T17:02:18.457216] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:02:18.689375] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-10T17:02:18.827631] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T17:02:19.489374] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-10T17:02:19.661886] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T17:02:19.712327] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T17:02:20.289410] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-10T17:02:20.780392] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T17:02:20.980620] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-10T17:02:21.089402] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-10T17:02:21.824316] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-10T17:02:21.889379] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-10T17:02:22.689463] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-10T17:02:22.839021] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-10T17:02:23.489396] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-10T17:02:23.789402] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-10T17:02:24.289360] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-10T17:02:24.498713] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-10T17:02:25.089481] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-10T17:02:25.875700] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T17:02:25.889333] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-10T17:02:26.220440] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T17:02:26.689388] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-10T17:02:27.422823] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-10T17:02:27.435842] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T17:02:27.489366] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-10T17:02:28.289355] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-10T17:02:28.401450] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-10T17:02:29.089390] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-10T17:02:29.355619] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-10T17:02:29.889378] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-10T17:02:29.920453] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-10T17:02:30.689381] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-10T17:02:31.181163] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-10T17:02:31.489404] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-10T17:02:31.493785] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-10T17:02:32.254222] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T17:02:32.289354] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-10T17:02:33.089390] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-10T17:02:33.791030] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-10T17:02:33.889355] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-10T17:02:34.143170] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T17:02:34.147070] [INFO ] [REMOTE ] ACP: Full fetch complete (46657 records). [2025-10-10T17:02:34.147200] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-10T17:02:34.547400] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-10T17:02:34.547484] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-10T17:02:34.547968] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-10T17:02:34.548030] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-10T17:02:34.549155] [DEBUG] [LOCAL ] ACP: Trimmed 46657 records to 31455 (keeping 200 days of data) [2025-10-10T17:02:34.693722] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-10T17:02:34.729300] [DEBUG] [LOCAL ] ACP: Primary data saved (31455 records). [2025-10-10T17:02:34.729453] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-10T17:02:34.729532] [INFO ] [MAIN ] Update Progress: 23/2373 symbols completed. ACP took 36.4s. Estimated remaining: 4h 16m 37s. Rate: 9.2 symbols/min [2025-10-10T17:02:34.907929] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:02:34.927615] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-10T17:02:34.980322] [DEBUG] [LOCAL ] ACVA: Loaded 49581 existing records from primary storage. [2025-10-10T17:02:34.980728] [INFO ] [MAIN ] ACVA: Loaded 49581 existing records. [2025-10-10T17:02:35.187949] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:02:35.188208] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-10T17:02:35.188258] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-10T17:02:35.188858] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-10T17:02:35.188916] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-10T17:02:35.493119] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-10T17:02:35.596430] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:02:35.652581] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-10T17:02:36.289363] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-10T17:02:36.317733] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-10T17:02:36.989297] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-10T17:02:36.991135] [INFO ] [REMOTE ] ACV: Full fetch complete (10331 records). [2025-10-10T17:02:36.991205] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-10T17:02:37.090964] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-10T17:02:37.345113] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-10T17:02:37.345197] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-10T17:02:37.345378] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-10T17:02:37.345418] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-10T17:02:37.345863] [DEBUG] [LOCAL ] ACV: Trimmed 10331 records to 7819 (keeping 200 days of data) [2025-10-10T17:02:37.392678] [DEBUG] [LOCAL ] ACV: Primary data saved (7819 records). [2025-10-10T17:02:37.392836] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-10T17:02:37.392935] [INFO ] [MAIN ] Update Progress: 24/2373 symbols completed. ACV took 19.7s. Estimated remaining: 4h 10m 10s. Rate: 9.4 symbols/min [2025-10-10T17:02:37.559986] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:02:37.560157] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-10T17:02:37.560196] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-10T17:02:37.560310] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-10T17:02:37.560352] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-10T17:02:37.560394] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-10T17:02:37.560427] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-10T17:02:37.891462] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-10T17:02:37.915833] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:02:38.549069] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-10T17:02:38.689356] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-10T17:02:38.757319] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-10T17:02:38.760853] [INFO ] [REMOTE ] ACRE: Full fetch complete (50075 records). [2025-10-10T17:02:38.761003] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-10T17:02:38.884326] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:02:38.914307] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-10T17:02:38.963414] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:02:39.018070] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-10T17:02:39.039176] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:02:39.044388] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-10T17:02:39.067166] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-10T17:02:39.067231] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-10T17:02:39.067284] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-10T17:02:39.067361] [INFO ] [MAIN ] Update Progress: 25/2373 symbols completed. AD took 1.7s. Estimated remaining: 4h 2m 41s. Rate: 9.7 symbols/min [2025-10-10T17:02:39.284383] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-10T17:02:39.310886] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-10T17:02:39.335264] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-10T17:02:39.339008] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:02:39.339151] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-10T17:02:39.340247] [DEBUG] [LOCAL ] ACRE: Trimmed 50075 records to 34101 (keeping 200 days of data) [2025-10-10T17:02:39.468190] [DEBUG] [LOCAL ] ADC: Loaded 46495 existing records from primary storage. [2025-10-10T17:02:39.469248] [INFO ] [MAIN ] ADC: Loaded 46495 existing records. [2025-10-10T17:02:39.498497] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-10T17:02:39.663329] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:02:39.665002] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-10T17:02:39.665827] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-10T17:02:39.667528] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-10T17:02:39.667947] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-10T17:02:40.040330] [DEBUG] [LOCAL ] ACRE: Primary data saved (34101 records). [2025-10-10T17:02:40.046393] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-10T17:02:40.051755] [INFO ] [MAIN ] Update Progress: 26/2373 symbols completed. ACRE took 33.3s. Estimated remaining: 3h 54m 44s. Rate: 10.0 symbols/min [2025-10-10T17:02:40.251059] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:02:40.295747] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-10T17:02:40.332768] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:02:40.374848] [DEBUG] [LOCAL ] ADCT: Loaded 35427 existing records from primary storage. [2025-10-10T17:02:40.375305] [INFO ] [MAIN ] ADCT: Loaded 35427 existing records. [2025-10-10T17:02:40.581902] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:02:40.582182] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-10T17:02:40.582240] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-10T17:02:40.582634] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-10T17:02:40.582741] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-10T17:02:41.000344] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:02:41.006382] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T17:02:41.007503] [INFO ] [REMOTE ] ACR: Full fetch complete (8544 records). [2025-10-10T17:02:41.007574] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-10T17:02:41.098541] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-10T17:02:41.377329] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-10T17:02:41.377515] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-10T17:02:41.377922] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-10T17:02:41.378030] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-10T17:02:41.378824] [DEBUG] [LOCAL ] ACR: Trimmed 8544 records to 5659 (keeping 200 days of data) [2025-10-10T17:02:41.429238] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T17:02:41.447937] [DEBUG] [LOCAL ] ACR: Primary data saved (5659 records). [2025-10-10T17:02:41.448033] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-10T17:02:41.448109] [INFO ] [MAIN ] Update Progress: 27/2373 symbols completed. ACR took 40.1s. Estimated remaining: 3h 47m 58s. Rate: 10.3 symbols/min [2025-10-10T17:02:41.616860] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:02:41.668852] [DEBUG] [LOCAL ] ADM: Loaded 53778 existing records from primary storage. [2025-10-10T17:02:41.669202] [INFO ] [MAIN ] ADM: Loaded 53778 existing records. [2025-10-10T17:02:41.848680] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:02:41.848983] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-10T17:02:41.849036] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-10T17:02:41.849518] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-10T17:02:41.849583] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-10T17:02:41.894500] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-10T17:02:42.195722] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:02:42.689358] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-10T17:02:43.115425] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T17:02:43.489399] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-10T17:02:43.826052] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T17:02:44.289362] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-10T17:02:44.655095] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T17:02:44.875006] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-10T17:02:45.089386] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-10T17:02:45.570511] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T17:02:45.889383] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-10T17:02:46.689385] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-10T17:02:47.127885] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T17:02:47.489396] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-10T17:02:47.523000] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T17:02:47.935677] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T17:02:48.289378] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-10T17:02:49.089406] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-10T17:02:49.185889] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-10T17:02:49.658192] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-10T17:02:49.889424] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-10T17:02:50.689389] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-10T17:02:50.939687] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T17:02:51.286763] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-10T17:02:51.489400] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-10T17:02:52.289388] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-10T17:02:52.398814] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T17:02:52.669038] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-10T17:02:53.089480] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-10T17:02:53.889381] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-10T17:02:54.342512] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T17:02:54.689362] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-10T17:02:55.024578] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T17:02:55.231706] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-10T17:02:55.489376] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-10T17:02:56.048951] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T17:02:56.289480] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-10T17:02:57.089377] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-10T17:02:57.399541] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T17:02:57.802342] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-10T17:02:57.889348] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-10T17:02:58.277772] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-10T17:02:58.689378] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-10T17:02:59.489409] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-10T17:02:59.777772] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-10T17:03:00.289443] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-10T17:03:00.376194] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T17:03:00.988783] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T17:03:01.089397] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-10T17:03:01.608109] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-10T17:03:01.889402] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-10T17:03:02.420559] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T17:03:02.689389] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-10T17:03:03.240961] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T17:03:03.489388] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-10T17:03:03.811118] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-10T17:03:04.289378] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-10T17:03:05.089414] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-10T17:03:05.363207] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-10T17:03:05.759469] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-10T17:03:05.889386] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-10T17:03:06.426748] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-10T17:03:06.689383] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-10T17:03:07.489369] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-10T17:03:07.572635] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T17:03:08.289402] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-10T17:03:08.479370] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-10T17:03:08.484917] [INFO ] [REMOTE ] ACVA: Full fetch complete (70550 records). [2025-10-10T17:03:08.485195] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-10T17:03:08.943774] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-10T17:03:08.943904] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-10T17:03:08.944679] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-10T17:03:08.944747] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-10T17:03:08.946383] [DEBUG] [LOCAL ] ACVA: Trimmed 70550 records to 49962 (keeping 200 days of data) [2025-10-10T17:03:09.111360] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-10T17:03:09.210106] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T17:03:09.282772] [DEBUG] [LOCAL ] ACVA: Primary data saved (49962 records). [2025-10-10T17:03:09.283133] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-10T17:03:09.284208] [INFO ] [MAIN ] Update Progress: 28/2373 symbols completed. ACVA took 34.6s. Estimated remaining: 4h 18m 35s. Rate: 9.1 symbols/min [2025-10-10T17:03:09.477735] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:03:09.524204] [DEBUG] [LOCAL ] ADNT: Loaded 47491 existing records from primary storage. [2025-10-10T17:03:09.524582] [INFO ] [MAIN ] ADNT: Loaded 47491 existing records. [2025-10-10T17:03:09.705211] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:03:09.705475] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-10T17:03:09.705522] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-10T17:03:09.705883] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-10T17:03:09.705940] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-10T17:03:09.902815] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-10T17:03:10.074422] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:03:10.369468] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T17:03:10.452052] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T17:03:10.457148] [INFO ] [REMOTE ] ADCT: Full fetch complete (51412 records). [2025-10-10T17:03:10.457276] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-10T17:03:10.694788] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-10T17:03:10.884626] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-10T17:03:10.884744] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-10T17:03:10.885285] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-10T17:03:10.885325] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-10T17:03:10.886365] [DEBUG] [LOCAL ] ADCT: Trimmed 51412 records to 35703 (keeping 200 days of data) [2025-10-10T17:03:11.077709] [DEBUG] [LOCAL ] ADCT: Primary data saved (35703 records). [2025-10-10T17:03:11.077862] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-10T17:03:11.077946] [INFO ] [MAIN ] Update Progress: 29/2373 symbols completed. ADCT took 31.0s. Estimated remaining: 4h 11m 58s. Rate: 9.3 symbols/min [2025-10-10T17:03:11.247299] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:03:11.297625] [DEBUG] [LOCAL ] ADT: Loaded 53834 existing records from primary storage. [2025-10-10T17:03:11.298010] [INFO ] [MAIN ] ADT: Loaded 53834 existing records. [2025-10-10T17:03:11.476135] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:03:11.476441] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-10T17:03:11.476498] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-10T17:03:11.476791] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-10T17:03:11.476849] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-10T17:03:11.496993] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-10T17:03:11.846460] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:03:11.969426] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-10T17:03:12.289339] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-10T17:03:12.335222] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T17:03:12.951818] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-10T17:03:13.089376] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-10T17:03:13.889359] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-10T17:03:14.082722] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T17:03:14.372934] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T17:03:14.689465] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-10T17:03:15.368933] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T17:03:15.489404] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-10T17:03:16.289385] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-10T17:03:16.896749] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-10T17:03:17.089487] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-10T17:03:17.269607] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T17:03:17.889361] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-10T17:03:18.038155] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T17:03:18.042719] [INFO ] [REMOTE ] ADC: Full fetch complete (66198 records). [2025-10-10T17:03:18.042840] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-10T17:03:18.440415] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-10T17:03:18.440533] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-10T17:03:18.441336] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-10T17:03:18.441420] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-10T17:03:18.443182] [DEBUG] [LOCAL ] ADC: Trimmed 66198 records to 46856 (keeping 200 days of data) [2025-10-10T17:03:18.592533] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-10T17:03:18.703261] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-10T17:03:18.779296] [DEBUG] [LOCAL ] ADC: Primary data saved (46856 records). [2025-10-10T17:03:18.779459] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-10T17:03:18.779593] [INFO ] [MAIN ] Update Progress: 30/2373 symbols completed. ADC took 39.7s. Estimated remaining: 4h 13m 30s. Rate: 9.2 symbols/min [2025-10-10T17:03:18.948750] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:03:18.985306] [DEBUG] [LOCAL ] ADX: Loaded 27755 existing records from primary storage. [2025-10-10T17:03:18.985615] [INFO ] [MAIN ] ADX: Loaded 27755 existing records. [2025-10-10T17:03:19.160447] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:03:19.160723] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-10T17:03:19.160779] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-10T17:03:19.161065] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-10T17:03:19.161121] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-10T17:03:19.502808] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-10T17:03:19.527252] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:03:19.730063] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T17:03:20.289374] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-10T17:03:20.689379] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-10T17:03:20.695138] [INFO ] [REMOTE ] ADM: Full fetch complete (77262 records). [2025-10-10T17:03:20.695303] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-10T17:03:21.093883] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-10T17:03:21.154968] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-10T17:03:21.155082] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-10T17:03:21.155962] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-10T17:03:21.156103] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-10T17:03:21.190161] [DEBUG] [LOCAL ] ADM: Trimmed 77262 records to 54168 (keeping 200 days of data) [2025-10-10T17:03:21.191339] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T17:03:21.527990] [DEBUG] [LOCAL ] ADM: Primary data saved (54168 records). [2025-10-10T17:03:21.528150] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-10T17:03:21.529236] [INFO ] [MAIN ] Update Progress: 31/2373 symbols completed. ADM took 40.1s. Estimated remaining: 4h 8m 41s. Rate: 9.4 symbols/min [2025-10-10T17:03:21.701884] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:03:21.702120] [DEBUG] [LOCAL ] AEE: No existing data file found in primary storage. [2025-10-10T17:03:21.702166] [WARN ] [MAIN ] AEE: No existing data found, performing full refresh instead. [2025-10-10T17:03:21.702384] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-10T17:03:21.702428] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-10T17:03:21.702470] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-10T17:03:21.702509] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-10T17:03:21.916301] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-10T17:03:22.071475] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:03:22.162302] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T17:03:22.689385] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-10T17:03:22.777827] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T17:03:23.311728] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-10T17:03:23.489364] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-10T17:03:24.089579] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T17:03:24.289382] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-10T17:03:25.089420] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-10T17:03:25.475286] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T17:03:25.889353] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-10T17:03:26.162985] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-10T17:03:26.599912] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T17:03:26.689380] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-10T17:03:27.489389] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-10T17:03:28.101454] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-10T17:03:28.197174] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T17:03:28.289409] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-10T17:03:28.805346] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-10T17:03:29.089375] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-10T17:03:29.777125] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-10T17:03:29.889374] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-10T17:03:30.392162] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T17:03:30.689383] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-10T17:03:31.489461] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-10T17:03:31.829570] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T17:03:32.085957] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-10T17:03:32.289389] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-10T17:03:32.584931] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-10T17:03:33.089377] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-10T17:03:33.576462] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-10T17:03:33.889369] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-10T17:03:34.689355] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-10T17:03:34.822347] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T17:03:34.937290] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T17:03:35.489412] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-10T17:03:36.289423] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-10T17:03:36.410369] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T17:03:36.780638] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T17:03:37.089399] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-10T17:03:37.889347] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-10T17:03:38.063895] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T17:03:38.092742] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-10T17:03:38.689430] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-10T17:03:39.489360] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-10T17:03:39.591411] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-10T17:03:40.289368] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-10T17:03:40.391729] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-10T17:03:41.089403] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-10T17:03:41.429541] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T17:03:41.889427] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-10T17:03:42.029150] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T17:03:42.689409] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-10T17:03:42.924363] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T17:03:42.936735] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-10T17:03:43.489386] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-10T17:03:43.837207] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-10T17:03:44.289384] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-10T17:03:45.089355] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-10T17:03:45.321937] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T17:03:45.525600] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-10T17:03:45.530037] [INFO ] [REMOTE ] ADNT: Full fetch complete (67966 records). [2025-10-10T17:03:45.530174] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-10T17:03:45.894580] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-10T17:03:45.972539] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-10T17:03:45.972679] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-10T17:03:45.973427] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-10T17:03:45.973490] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-10T17:03:45.975243] [DEBUG] [LOCAL ] ADNT: Trimmed 67966 records to 47843 (keeping 200 days of data) [2025-10-10T17:03:46.270046] [DEBUG] [LOCAL ] ADNT: Primary data saved (47843 records). [2025-10-10T17:03:46.270240] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-10T17:03:46.270344] [INFO ] [MAIN ] Update Progress: 32/2373 symbols completed. ADNT took 37.0s. Estimated remaining: 4h 30m 58s. Rate: 8.6 symbols/min [2025-10-10T17:03:46.458235] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:03:46.469733] [DEBUG] [LOCAL ] AEFC: Loaded 8470 existing records from primary storage. [2025-10-10T17:03:46.470053] [INFO ] [MAIN ] AEFC: Loaded 8470 existing records. [2025-10-10T17:03:46.674994] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:03:46.675451] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-10T17:03:46.675536] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-10T17:03:46.676146] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-10T17:03:46.676238] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-10T17:03:46.707939] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-10T17:03:46.872579] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T17:03:47.134863] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:03:47.489343] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-10T17:03:47.737086] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T17:03:47.818099] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-10T17:03:48.289387] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-10T17:03:49.089412] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-10T17:03:49.889464] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-10T17:03:49.982390] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T17:03:49.994293] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-10T17:03:50.012171] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-10T17:03:50.017339] [INFO ] [REMOTE ] ADT: Full fetch complete (77184 records). [2025-10-10T17:03:50.017470] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-10T17:03:50.400169] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-10T17:03:50.400260] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-10T17:03:50.401034] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-10T17:03:50.401097] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-10T17:03:50.402496] [DEBUG] [LOCAL ] ADT: Trimmed 77184 records to 54223 (keeping 200 days of data) [2025-10-10T17:03:50.698716] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-10T17:03:50.722858] [DEBUG] [LOCAL ] ADT: Primary data saved (54223 records). [2025-10-10T17:03:50.722990] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-10T17:03:50.723089] [INFO ] [MAIN ] Update Progress: 33/2373 symbols completed. ADT took 39.6s. Estimated remaining: 4h 27m 54s. Rate: 8.7 symbols/min [2025-10-10T17:03:50.892482] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:03:50.900378] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-10T17:03:50.903838] [INFO ] [REMOTE ] ADX: Full fetch complete (41903 records). [2025-10-10T17:03:50.903962] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-10T17:03:51.241455] [DEBUG] [LOCAL ] AEG: Loaded 49927 existing records from primary storage. [2025-10-10T17:03:51.269117] [INFO ] [MAIN ] AEG: Loaded 49927 existing records. [2025-10-10T17:03:51.391593] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-10T17:03:51.404684] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-10T17:03:51.410327] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-10T17:03:51.413055] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-10T17:03:51.471156] [DEBUG] [LOCAL ] ADX: Trimmed 41903 records to 28006 (keeping 200 days of data) [2025-10-10T17:03:51.491383] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-10T17:03:51.491225] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:03:51.493463] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-10T17:03:51.493518] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-10T17:03:51.493804] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-10T17:03:51.493866] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-10T17:03:52.025592] [DEBUG] [LOCAL ] ADX: Primary data saved (28006 records). [2025-10-10T17:03:52.025514] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:03:52.025763] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-10T17:03:52.026098] [INFO ] [MAIN ] Update Progress: 34/2373 symbols completed. ADX took 33.2s. Estimated remaining: 4h 21m 25s. Rate: 8.9 symbols/min [2025-10-10T17:03:52.134120] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-10T17:03:52.208409] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:03:52.264702] [DEBUG] [LOCAL ] AEM: Loaded 53856 existing records from primary storage. [2025-10-10T17:03:52.265316] [INFO ] [MAIN ] AEM: Loaded 53856 existing records. [2025-10-10T17:03:52.294614] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-10T17:03:52.410145] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-10T17:03:52.454619] [INFO ] [REMOTE ] AEE: Full fetch complete (72690 records). [2025-10-10T17:03:52.474384] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-10T17:03:52.474232] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:03:52.474815] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-10T17:03:52.474959] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-10T17:03:52.480573] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-10T17:03:52.510333] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-10T17:03:53.061434] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-10T17:03:53.092869] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-10T17:03:53.249159] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-10T17:03:53.249896] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-10T17:03:53.250594] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-10T17:03:53.257163] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-10T17:03:53.269613] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:03:53.271006] [DEBUG] [LOCAL ] AEE: Trimmed 72690 records to 50867 (keeping 200 days of data) [2025-10-10T17:03:53.571003] [DEBUG] [LOCAL ] AEE: Primary data saved (50867 records). [2025-10-10T17:03:53.571152] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-10T17:03:53.571233] [INFO ] [MAIN ] Update Progress: 35/2373 symbols completed. AEE took 32.0s. Estimated remaining: 4h 15m 33s. Rate: 9.1 symbols/min [2025-10-10T17:03:53.737193] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:03:53.789329] [DEBUG] [LOCAL ] AEO: Loaded 53953 existing records from primary storage. [2025-10-10T17:03:53.789679] [INFO ] [MAIN ] AEO: Loaded 53953 existing records. [2025-10-10T17:03:53.892330] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-10T17:03:53.968787] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:03:53.968985] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-10T17:03:53.969030] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-10T17:03:53.969447] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-10T17:03:53.969502] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-10T17:03:54.318168] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:03:54.613134] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T17:03:54.689437] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-10T17:03:54.814685] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-10T17:03:55.489387] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-10T17:03:56.060487] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T17:03:56.289388] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-10T17:03:57.089675] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-10T17:03:57.093395] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T17:03:57.585923] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T17:03:57.889345] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-10T17:03:58.115407] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-10T17:03:58.689425] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-10T17:03:59.489360] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-10T17:03:59.822181] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T17:04:00.205843] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-10T17:04:00.289400] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-10T17:04:00.501183] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T17:04:00.907067] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-10T17:04:01.089378] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-10T17:04:01.889372] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-10T17:04:02.689404] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-10T17:04:03.019276] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-10T17:04:03.489400] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-10T17:04:03.554978] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T17:04:03.572275] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-10T17:04:04.289376] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-10T17:04:05.005619] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-10T17:04:05.089379] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-10T17:04:05.889397] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-10T17:04:06.162070] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T17:04:06.510169] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-10T17:04:06.689355] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-10T17:04:06.798227] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T17:04:07.489450] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-10T17:04:08.119307] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-10T17:04:08.289363] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-10T17:04:08.718728] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-10T17:04:09.012190] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-10T17:04:09.089369] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-10T17:04:09.889433] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-10T17:04:10.689441] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-10T17:04:10.941437] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T17:04:11.460119] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T17:04:11.461222] [INFO ] [REMOTE ] AEFC: Full fetch complete (11918 records). [2025-10-10T17:04:11.461296] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-10T17:04:11.494453] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-10T17:04:11.826490] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-10T17:04:11.826581] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-10T17:04:11.827079] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-10T17:04:11.827203] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-10T17:04:11.828087] [DEBUG] [LOCAL ] AEFC: Trimmed 11918 records to 8507 (keeping 200 days of data) [2025-10-10T17:04:11.882440] [DEBUG] [LOCAL ] AEFC: Primary data saved (8507 records). [2025-10-10T17:04:11.882605] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-10T17:04:11.882713] [INFO ] [MAIN ] Update Progress: 36/2373 symbols completed. AEFC took 25.6s. Estimated remaining: 4h 28m 10s. Rate: 8.7 symbols/min [2025-10-10T17:04:12.054742] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:04:12.107301] [DEBUG] [LOCAL ] AER: Loaded 48578 existing records from primary storage. [2025-10-10T17:04:12.107679] [INFO ] [MAIN ] AER: Loaded 48578 existing records. [2025-10-10T17:04:12.292384] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:04:12.293031] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-10T17:04:12.293266] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-10T17:04:12.292742] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-10T17:04:12.303744] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-10T17:04:12.325794] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-10T17:04:12.350060] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-10T17:04:12.706434] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:04:13.089353] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-10T17:04:13.502783] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-10T17:04:13.603523] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T17:04:13.889372] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-10T17:04:14.339766] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-10T17:04:14.689379] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-10T17:04:15.489354] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-10T17:04:16.102089] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-10T17:04:16.289347] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-10T17:04:16.577863] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-10T17:04:17.089366] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-10T17:04:17.478069] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-10T17:04:17.484881] [INFO ] [REMOTE ] AEG: Full fetch complete (70255 records). [2025-10-10T17:04:17.485098] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-10T17:04:17.891783] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-10T17:04:17.892105] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-10T17:04:17.892188] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-10T17:04:17.892946] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-10T17:04:17.893879] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-10T17:04:17.895732] [DEBUG] [LOCAL ] AEG: Trimmed 70255 records to 50280 (keeping 200 days of data) [2025-10-10T17:04:18.012171] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T17:04:18.220516] [DEBUG] [LOCAL ] AEG: Primary data saved (50280 records). [2025-10-10T17:04:18.220683] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-10T17:04:18.220781] [INFO ] [MAIN ] Update Progress: 37/2373 symbols completed. AEG took 27.5s. Estimated remaining: 4h 27m 28s. Rate: 8.7 symbols/min [2025-10-10T17:04:18.695259] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-10T17:04:18.708586] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T17:04:19.489397] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-10T17:04:20.012636] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-10T17:04:20.289376] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-10T17:04:20.923326] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-10T17:04:21.089376] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-10T17:04:21.555637] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T17:04:21.862447] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T17:04:21.889335] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-10T17:04:22.689405] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-10T17:04:22.841312] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-10T17:04:23.489367] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-10T17:04:23.926995] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T17:04:24.289536] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-10T17:04:25.142410] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-10T17:04:25.158737] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-10T17:04:25.339784] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T17:04:25.889352] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-10T17:04:26.193718] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T17:04:26.689353] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-10T17:04:26.732480] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T17:04:27.489435] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-10T17:04:27.970809] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T17:04:28.291435] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-10T17:04:28.297671] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-10T17:04:29.089356] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-10T17:04:29.747520] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-10T17:04:29.791707] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T17:04:29.889422] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-10T17:04:30.689396] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-10T17:04:30.884304] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-10T17:04:30.889454] [INFO ] [REMOTE ] AEO: Full fetch complete (77452 records). [2025-10-10T17:04:30.889585] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-10T17:04:31.294900] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-10T17:04:31.295009] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-10T17:04:31.295819] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-10T17:04:31.295885] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-10T17:04:31.297604] [DEBUG] [LOCAL ] AEO: Trimmed 77452 records to 54343 (keeping 200 days of data) [2025-10-10T17:04:31.631979] [DEBUG] [LOCAL ] AEO: Primary data saved (54343 records). [2025-10-10T17:04:31.632132] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-10T17:04:31.633144] [INFO ] [MAIN ] Update Progress: 38/2373 symbols completed. AEO took 38.1s. Estimated remaining: 4h 34m 3s. Rate: 8.5 symbols/min [2025-10-10T17:04:32.122730] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-10T17:04:32.135167] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-10T17:04:32.568766] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-10T17:04:32.580220] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-10T17:04:33.920182] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-10T17:04:33.932211] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-10T17:04:34.396997] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-10T17:04:34.409162] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-10T17:04:35.188370] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T17:04:35.193059] [INFO ] [REMOTE ] AER: Full fetch complete (69558 records). [2025-10-10T17:04:35.193207] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-10T17:04:35.624483] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-10T17:04:35.624591] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-10T17:04:35.625480] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-10T17:04:35.625582] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-10T17:04:35.627122] [DEBUG] [LOCAL ] AER: Trimmed 69558 records to 48916 (keeping 200 days of data) [2025-10-10T17:04:35.966163] [DEBUG] [LOCAL ] AER: Primary data saved (48916 records). [2025-10-10T17:04:35.966364] [INFO ] [MAIN ] AER: Full history saved. [2025-10-10T17:04:35.967406] [INFO ] [MAIN ] Update Progress: 39/2373 symbols completed. AER took 24.1s. Estimated remaining: 4h 31m 14s. Rate: 8.6 symbols/min [2025-10-10T17:04:36.759150] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-10T17:04:36.764903] [INFO ] [REMOTE ] AEM: Full fetch complete (77195 records). [2025-10-10T17:04:36.765058] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-10T17:04:37.175516] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-10T17:04:37.175621] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-10T17:04:37.176427] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-10T17:04:37.176492] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-10T17:04:37.178120] [DEBUG] [LOCAL ] AEM: Trimmed 77195 records to 54245 (keeping 200 days of data) [2025-10-10T17:04:37.508786] [DEBUG] [LOCAL ] AEM: Primary data saved (54245 records). [2025-10-10T17:04:37.508934] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-10T17:04:37.509014] [INFO ] [MAIN ] Update Progress: 40/2373 symbols completed. AEM took 45.5s. Estimated remaining: 4h 25m 51s. Rate: 8.8 symbols/min [2025-10-10T17:04:38.134590] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:04:38.148367] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:04:38.203081] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:04:38.196222] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-10T17:04:38.229511] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-10T17:04:38.230856] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-10T17:04:38.230919] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-10T17:04:38.230969] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-10T17:04:38.231003] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-10T17:04:38.230523] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:04:38.450044] [DEBUG] [LOCAL ] AFB: Loaded 11507 existing records from primary storage. [2025-10-10T17:04:38.491430] [INFO ] [MAIN ] AFB: Loaded 11507 existing records. [2025-10-10T17:04:38.718937] [DEBUG] [LOCAL ] AES: Loaded 54060 existing records from primary storage. [2025-10-10T17:04:38.717797] [DEBUG] [LOCAL ] AESI: Loaded 49944 existing records from primary storage. [2025-10-10T17:04:38.730009] [INFO ] [MAIN ] AES: Loaded 54060 existing records. [2025-10-10T17:04:38.750826] [INFO ] [MAIN ] AESI: Loaded 49944 existing records. [2025-10-10T17:04:38.939941] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:04:39.048321] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:04:39.067825] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-10T17:04:39.067746] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-10T17:04:39.079964] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-10T17:04:39.107420] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-10T17:04:39.132468] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-10T17:04:39.205947] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:04:39.240761] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-10T17:04:39.270211] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:04:39.307502] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-10T17:04:39.307619] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-10T17:04:39.307761] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-10T17:04:39.319035] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-10T17:04:39.329317] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-10T17:04:39.329268] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-10T17:04:39.373615] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-10T17:04:39.373934] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:04:39.389788] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-10T17:04:39.474421] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:04:39.515416] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-10T17:04:39.567200] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:04:39.605545] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-10T17:04:39.608821] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-10T17:04:39.644024] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-10T17:04:39.644496] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-10T17:04:39.649922] [INFO ] [MAIN ] Update Progress: 41/2373 symbols completed. AEXA took 2.1s. Estimated remaining: 4h 21m 17s. Rate: 8.9 symbols/min [2025-10-10T17:04:40.448225] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:04:40.445952] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:04:40.525456] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-10T17:04:40.531349] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:04:40.543302] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-10T17:04:40.580719] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:04:40.580990] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-10T17:04:40.611480] [DEBUG] [LOCAL ] AFG: Loaded 32429 existing records from primary storage. [2025-10-10T17:04:40.611813] [INFO ] [MAIN ] AFG: Loaded 32429 existing records. [2025-10-10T17:04:40.780687] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:04:40.780888] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-10T17:04:40.780935] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-10T17:04:40.781323] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-10T17:04:40.781380] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-10T17:04:41.119365] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:04:41.119776] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-10T17:04:41.310435] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-10T17:04:41.313812] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-10T17:04:41.905399] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-10T17:04:41.909052] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-10T17:04:42.073402] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-10T17:04:42.079451] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-10T17:04:42.301975] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T17:04:42.311094] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-10T17:04:42.841458] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-10T17:04:42.844352] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-10T17:04:42.949178] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-10T17:04:42.961605] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-10T17:04:43.061145] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-10T17:04:43.489416] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-10T17:04:44.021382] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-10T17:04:44.050231] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-10T17:04:44.289350] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-10T17:04:44.524482] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-10T17:04:44.648287] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T17:04:44.932820] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-10T17:04:45.089362] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-10T17:04:45.889347] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-10T17:04:46.689387] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-10T17:04:46.772148] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T17:04:47.046218] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T17:04:47.489417] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-10T17:04:48.289352] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-10T17:04:48.685452] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-10T17:04:49.089382] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-10T17:04:49.158373] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T17:04:49.172526] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-10T17:04:49.889433] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-10T17:04:50.689485] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-10T17:04:50.959991] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T17:04:51.001590] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-10T17:04:51.489373] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-10T17:04:51.604946] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-10T17:04:52.289395] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-10T17:04:52.947378] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-10T17:04:53.089394] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-10T17:04:53.889396] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-10T17:04:54.069124] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T17:04:54.613862] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-10T17:04:54.689377] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-10T17:04:55.489432] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-10T17:04:55.600058] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T17:04:55.653383] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T17:04:56.289435] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-10T17:04:57.089447] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-10T17:04:57.518885] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T17:04:57.889357] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-10T17:04:58.053837] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-10T17:04:58.139278] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T17:04:58.689392] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-10T17:04:59.489404] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-10T17:05:00.185496] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-10T17:05:00.289383] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-10T17:05:00.558900] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-10T17:05:00.730607] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T17:05:01.089423] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-10T17:05:01.889388] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-10T17:05:02.650035] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-10T17:05:02.689332] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-10T17:05:03.057463] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T17:05:03.099203] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-10T17:05:03.489378] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-10T17:05:04.289404] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-10T17:05:04.563136] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-10T17:05:05.089414] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-10T17:05:05.344758] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-10T17:05:05.889390] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-10T17:05:06.005707] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T17:05:06.007339] [INFO ] [REMOTE ] AFB: Full fetch complete (16503 records). [2025-10-10T17:05:06.007412] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-10T17:05:06.403118] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-10T17:05:06.403296] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-10T17:05:06.403812] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-10T17:05:06.404326] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-10T17:05:06.405674] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-10T17:05:06.417135] [DEBUG] [LOCAL ] AFB: Trimmed 16503 records to 11547 (keeping 200 days of data) [2025-10-10T17:05:06.486896] [DEBUG] [LOCAL ] AFB: Primary data saved (11547 records). [2025-10-10T17:05:06.487046] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-10T17:05:06.487142] [INFO ] [MAIN ] Update Progress: 42/2373 symbols completed. AFB took 29.0s. Estimated remaining: 4h 39m 46s. Rate: 8.3 symbols/min [2025-10-10T17:05:06.652462] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:05:06.657545] [DEBUG] [LOCAL ] AFGB: Loaded 2317 existing records from primary storage. [2025-10-10T17:05:06.657806] [INFO ] [MAIN ] AFGB: Loaded 2317 existing records. [2025-10-10T17:05:06.699505] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-10T17:05:06.836703] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:05:06.836981] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-10T17:05:06.837028] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-10T17:05:06.837184] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-10T17:05:06.837241] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-10T17:05:07.105906] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T17:05:07.218559] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:05:07.489379] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-10T17:05:08.289385] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-10T17:05:08.700261] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-10T17:05:08.705246] [INFO ] [REMOTE ] AESI: Full fetch complete (70824 records). [2025-10-10T17:05:08.705397] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-10T17:05:08.868257] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-10T17:05:09.015532] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-10T17:05:09.031879] [INFO ] [REMOTE ] AFG: Full fetch complete (46274 records). [2025-10-10T17:05:09.047305] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-10T17:05:09.097497] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-10T17:05:09.180794] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-10T17:05:09.180942] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-10T17:05:09.181716] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-10T17:05:09.193450] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-10T17:05:09.259684] [DEBUG] [LOCAL ] AESI: Trimmed 70824 records to 50320 (keeping 200 days of data) [2025-10-10T17:05:09.631584] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-10T17:05:09.632510] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-10T17:05:09.637883] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-10T17:05:09.640392] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-10T17:05:09.699163] [DEBUG] [LOCAL ] AFG: Trimmed 46274 records to 32729 (keeping 200 days of data) [2025-10-10T17:05:09.891337] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-10T17:05:10.026530] [DEBUG] [LOCAL ] AFG: Primary data saved (32729 records). [2025-10-10T17:05:10.027525] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-10T17:05:10.027937] [INFO ] [MAIN ] Update Progress: 43/2373 symbols completed. AFG took 30.3s. Estimated remaining: 4h 36m 21s. Rate: 8.4 symbols/min [2025-10-10T17:05:10.220670] [DEBUG] [LOCAL ] AESI: Primary data saved (50320 records). [2025-10-10T17:05:10.238744] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-10T17:05:10.238861] [INFO ] [MAIN ] Update Progress: 44/2373 symbols completed. AESI took 32.7s. Estimated remaining: 4h 30m 8s. Rate: 8.6 symbols/min [2025-10-10T17:05:10.238667] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:05:10.343016] [DEBUG] [LOCAL ] AFGC: Loaded 2560 existing records from primary storage. [2025-10-10T17:05:10.353714] [INFO ] [MAIN ] AFGC: Loaded 2560 existing records. [2025-10-10T17:05:10.511690] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:05:10.570700] [DEBUG] [LOCAL ] AFGD: Loaded 1815 existing records from primary storage. [2025-10-10T17:05:10.591676] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:05:10.588768] [INFO ] [MAIN ] AFGD: Loaded 1815 existing records. [2025-10-10T17:05:10.635179] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-10T17:05:10.667011] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-10T17:05:10.692975] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-10T17:05:10.693343] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-10T17:05:10.874751] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:05:10.900169] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-10T17:05:10.902051] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-10T17:05:10.901870] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-10T17:05:10.902235] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-10T17:05:10.907270] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-10T17:05:10.917895] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-10T17:05:11.350345] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-10T17:05:11.377421] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:05:11.498691] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-10T17:05:11.551204] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:05:11.575009] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-10T17:05:12.211593] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-10T17:05:12.289415] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-10T17:05:12.681622] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-10T17:05:13.089399] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-10T17:05:13.652017] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-10T17:05:13.889382] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-10T17:05:14.689392] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-10T17:05:15.263439] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-10T17:05:15.489463] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-10T17:05:16.258279] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-10T17:05:16.289351] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-10T17:05:16.390501] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-10T17:05:17.089422] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-10T17:05:17.622146] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-10T17:05:17.889359] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-10T17:05:18.288386] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-10T17:05:18.653917] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-10T17:05:18.658986] [INFO ] [REMOTE ] AES: Full fetch complete (77721 records). [2025-10-10T17:05:18.659139] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-10T17:05:18.694563] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-10T17:05:19.052798] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-10T17:05:19.052902] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-10T17:05:19.053620] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-10T17:05:19.053747] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-10T17:05:19.055318] [DEBUG] [LOCAL ] AES: Trimmed 77721 records to 54450 (keeping 200 days of data) [2025-10-10T17:05:19.382440] [DEBUG] [LOCAL ] AES: Primary data saved (54450 records). [2025-10-10T17:05:19.382559] [INFO ] [MAIN ] AES: Full history saved. [2025-10-10T17:05:19.382682] [INFO ] [MAIN ] Update Progress: 45/2373 symbols completed. AES took 41.9s. Estimated remaining: 4h 31m 54s. Rate: 8.6 symbols/min [2025-10-10T17:05:19.494435] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-10T17:05:19.552782] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:05:19.556792] [DEBUG] [LOCAL ] AFGE: Loaded 2436 existing records from primary storage. [2025-10-10T17:05:19.556935] [INFO ] [MAIN ] AFGE: Loaded 2436 existing records. [2025-10-10T17:05:19.629716] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-10T17:05:19.756347] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:05:19.756689] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-10T17:05:19.756749] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-10T17:05:19.756936] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-10T17:05:19.756995] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-10T17:05:20.052675] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-10T17:05:20.134701] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:05:20.289432] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-10T17:05:20.841763] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-10T17:05:21.089383] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-10T17:05:21.485877] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-10T17:05:21.889354] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-10T17:05:22.241014] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-10T17:05:22.689436] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-10T17:05:23.251613] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-10T17:05:23.489425] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-10T17:05:24.284235] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-10T17:05:24.289323] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-10T17:05:24.632588] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-10T17:05:25.089401] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-10T17:05:25.624129] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-10T17:05:25.889333] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-10T17:05:26.524053] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-10T17:05:26.689375] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-10T17:05:27.223668] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-10T17:05:27.489379] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-10T17:05:28.148008] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-10T17:05:28.289411] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-10T17:05:28.800690] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-10T17:05:29.089396] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-10T17:05:29.889389] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-10T17:05:30.059406] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-10T17:05:30.060186] [INFO ] [REMOTE ] AFGB: Full fetch complete (3607 records). [2025-10-10T17:05:30.060253] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-10T17:05:30.414065] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-10T17:05:30.414195] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-10T17:05:30.417067] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-10T17:05:30.417180] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-10T17:05:30.417317] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-10T17:05:30.418947] [DEBUG] [LOCAL ] AFGB: Trimmed 3607 records to 2330 (keeping 200 days of data) [2025-10-10T17:05:30.433100] [DEBUG] [LOCAL ] AFGB: Primary data saved (2330 records). [2025-10-10T17:05:30.433176] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-10T17:05:30.433285] [INFO ] [MAIN ] Update Progress: 46/2373 symbols completed. AFGB took 23.9s. Estimated remaining: 4h 35m 12s. Rate: 8.5 symbols/min [2025-10-10T17:05:30.597889] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:05:30.598101] [DEBUG] [LOCAL ] AFL: No existing data file found in primary storage. [2025-10-10T17:05:30.598138] [WARN ] [MAIN ] AFL: No existing data found, performing full refresh instead. [2025-10-10T17:05:30.598252] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-10T17:05:30.598292] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-10T17:05:30.598332] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-10-10T17:05:30.598365] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-10T17:05:30.695475] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-10T17:05:30.957630] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:05:31.489423] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-10T17:05:31.501339] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-10T17:05:32.289434] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-10T17:05:32.816907] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-10T17:05:33.089388] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-10T17:05:33.500584] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T17:05:33.656905] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-10T17:05:33.889385] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-10T17:05:34.266844] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-10T17:05:34.689376] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-10T17:05:35.274135] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-10T17:05:35.489384] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-10T17:05:36.174332] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-10T17:05:36.289395] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-10T17:05:36.948557] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-10T17:05:37.089372] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-10T17:05:37.608249] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-10T17:05:37.889369] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-10T17:05:38.438531] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-10T17:05:38.689447] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-10T17:05:39.489362] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-10T17:05:40.071090] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-10T17:05:40.289374] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-10T17:05:40.568506] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-10T17:05:40.799520] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-10T17:05:40.800297] [INFO ] [REMOTE ] AFGC: Full fetch complete (3676 records). [2025-10-10T17:05:40.800364] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-10T17:05:41.094520] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-10T17:05:41.150468] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-10T17:05:41.150783] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-10T17:05:41.151010] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-10T17:05:41.151068] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-10T17:05:41.151424] [DEBUG] [LOCAL ] AFGC: Trimmed 3676 records to 2568 (keeping 200 days of data) [2025-10-10T17:05:41.167109] [DEBUG] [LOCAL ] AFGC: Primary data saved (2568 records). [2025-10-10T17:05:41.167197] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-10T17:05:41.167271] [INFO ] [MAIN ] Update Progress: 47/2373 symbols completed. AFGC took 31.1s. Estimated remaining: 4h 38m 5s. Rate: 8.4 symbols/min [2025-10-10T17:05:41.333585] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:05:41.384631] [DEBUG] [LOCAL ] AG: Loaded 54032 existing records from primary storage. [2025-10-10T17:05:41.385041] [INFO ] [MAIN ] AG: Loaded 54032 existing records. [2025-10-10T17:05:41.560261] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:05:41.560546] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-10T17:05:41.560594] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-10T17:05:41.561201] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-10T17:05:41.561261] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-10T17:05:41.668220] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-10T17:05:41.902821] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-10T17:05:41.915757] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:05:42.269605] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-10T17:05:42.689384] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-10T17:05:43.396204] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-10T17:05:43.489394] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-10T17:05:44.016567] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-10T17:05:44.289379] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-10T17:05:44.886611] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-10T17:05:44.887832] [INFO ] [REMOTE ] AFGE: Full fetch complete (3446 records). [2025-10-10T17:05:44.887912] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-10T17:05:45.094568] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-10T17:05:45.250156] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-10T17:05:45.250242] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-10T17:05:45.250372] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-10T17:05:45.250414] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-10T17:05:45.250774] [DEBUG] [LOCAL ] AFGE: Trimmed 3446 records to 2444 (keeping 200 days of data) [2025-10-10T17:05:45.265505] [DEBUG] [LOCAL ] AFGE: Primary data saved (2444 records). [2025-10-10T17:05:45.265563] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-10T17:05:45.265627] [INFO ] [MAIN ] Update Progress: 48/2373 symbols completed. AFGE took 25.9s. Estimated remaining: 4h 35m 28s. Rate: 8.4 symbols/min [2025-10-10T17:05:45.443520] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:05:45.443786] [DEBUG] [LOCAL ] AGCO: No existing data file found in primary storage. [2025-10-10T17:05:45.443846] [WARN ] [MAIN ] AGCO: No existing data found, performing full refresh instead. [2025-10-10T17:05:45.443973] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-10T17:05:45.444041] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-10T17:05:45.444085] [DEBUG] [LOCAL ] AGCO: No primary data file found to delete. [2025-10-10T17:05:45.444120] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-10T17:05:45.597317] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-10T17:05:45.832920] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:05:45.889388] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-10T17:05:46.402472] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-10T17:05:46.689370] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-10T17:05:47.489414] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-10T17:05:48.289384] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-10T17:05:48.558089] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T17:05:48.695865] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-10T17:05:48.696565] [INFO ] [REMOTE ] AFGD: Full fetch complete (3053 records). [2025-10-10T17:05:48.696632] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-10T17:05:49.045612] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-10T17:05:49.045786] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-10T17:05:49.045922] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-10T17:05:49.045962] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-10T17:05:49.046357] [DEBUG] [LOCAL ] AFGD: Trimmed 3053 records to 1816 (keeping 200 days of data) [2025-10-10T17:05:49.057821] [DEBUG] [LOCAL ] AFGD: Primary data saved (1816 records). [2025-10-10T17:05:49.057926] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-10T17:05:49.058002] [INFO ] [MAIN ] Update Progress: 49/2373 symbols completed. AFGD took 38.8s. Estimated remaining: 4h 32m 44s. Rate: 8.5 symbols/min [2025-10-10T17:05:49.094622] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-10T17:05:49.230825] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:05:49.249967] [DEBUG] [LOCAL ] AGD: Loaded 18787 existing records from primary storage. [2025-10-10T17:05:49.250304] [INFO ] [MAIN ] AGD: Loaded 18787 existing records. [2025-10-10T17:05:49.432477] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:05:49.432872] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-10T17:05:49.432987] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-10T17:05:49.433515] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-10T17:05:49.433576] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-10T17:05:49.750623] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-10T17:05:49.838935] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:05:49.889356] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-10T17:05:50.641882] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T17:05:50.689408] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-10T17:05:50.965054] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-10T17:05:51.489381] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-10T17:05:52.289364] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-10T17:05:52.823929] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-10T17:05:52.930281] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T17:05:53.089376] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-10T17:05:53.889375] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-10T17:05:54.335019] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T17:05:54.689401] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-10T17:05:54.795255] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T17:05:55.489380] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-10T17:05:55.993842] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-10T17:05:56.080611] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-10T17:05:56.289376] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-10T17:05:57.089406] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-10T17:05:57.384469] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T17:05:57.889334] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-10T17:05:58.007308] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-10T17:05:58.423112] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-10T17:05:58.689386] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-10T17:05:59.489350] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-10T17:05:59.827342] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T17:06:00.097387] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-10T17:06:00.289373] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-10T17:06:01.089419] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-10T17:06:01.292548] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-10T17:06:01.889464] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-10T17:06:02.386453] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T17:06:02.667426] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-10T17:06:02.689338] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-10T17:06:03.489349] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-10T17:06:04.058823] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-10T17:06:04.289415] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-10T17:06:04.733383] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-10T17:06:05.043960] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-10T17:06:05.089360] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-10T17:06:05.309355] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T17:06:05.889392] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-10T17:06:06.060704] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-10T17:06:06.689450] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-10T17:06:07.489374] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-10T17:06:07.952443] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-10T17:06:08.289408] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-10T17:06:08.332823] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-10T17:06:09.089358] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-10T17:06:09.221309] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T17:06:09.442966] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-10T17:06:09.889364] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-10T17:06:10.694566] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-10T17:06:10.711761] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T17:06:11.148105] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-10T17:06:11.489418] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-10T17:06:12.289431] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-10T17:06:13.089358] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-10T17:06:13.203844] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-10T17:06:13.859484] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-10T17:06:13.889384] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-10T17:06:14.090430] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T17:06:14.332083] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-10T17:06:14.689387] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-10T17:06:15.504350] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-10T17:06:15.525827] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T17:06:16.289390] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-10T17:06:16.421292] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T17:06:16.825752] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-10T17:06:17.089386] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-10T17:06:17.744345] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T17:06:17.749456] [INFO ] [REMOTE ] AFL: Full fetch complete (76907 records). [2025-10-10T17:06:17.749603] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-10T17:06:17.898115] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-10T17:06:18.135340] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-10T17:06:18.135430] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-10T17:06:18.136281] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-10T17:06:18.136356] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-10T17:06:18.137898] [DEBUG] [LOCAL ] AFL: Trimmed 76907 records to 53938 (keeping 200 days of data) [2025-10-10T17:06:18.486835] [DEBUG] [LOCAL ] AFL: Primary data saved (53938 records). [2025-10-10T17:06:18.487039] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-10T17:06:18.487138] [INFO ] [MAIN ] Update Progress: 50/2373 symbols completed. AFL took 48.1s. Estimated remaining: 4h 49m 57s. Rate: 8.0 symbols/min [2025-10-10T17:06:18.663699] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:06:18.696457] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-10T17:06:18.721625] [DEBUG] [LOCAL ] AGI: Loaded 53810 existing records from primary storage. [2025-10-10T17:06:18.722068] [INFO ] [MAIN ] AGI: Loaded 53810 existing records. [2025-10-10T17:06:18.909814] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:06:18.910106] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-10T17:06:18.910157] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-10T17:06:18.910681] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-10T17:06:18.910742] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-10T17:06:19.291610] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:06:19.397729] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-10T17:06:19.460232] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-10T17:06:19.462793] [INFO ] [REMOTE ] AGD: Full fetch complete (25931 records). [2025-10-10T17:06:19.462871] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-10T17:06:19.463339] [FATAL] [VALIDATOR ] AGD: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:06:19.463422] [FATAL] [MAIN ] AGD: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:06:19.463465] [WARN ] [MAIN ] AGD: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:06:19.463530] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-10T17:06:19.463592] [DEBUG] [LOCAL ] AGD: No primary data file found to delete. [2025-10-10T17:06:19.463627] [INFO ] [LOCAL ] AGD: Starting deletion of derivative data. [2025-10-10T17:06:19.463857] [DEBUG] [LOCAL ] AGD: Deleted derivative data file. [2025-10-10T17:06:19.463943] [INFO ] [MAIN ] Update Progress: 51/2373 symbols completed. AGD took 30.4s. Estimated remaining: 4h 44m 53s. Rate: 8.2 symbols/min [2025-10-10T17:06:19.494432] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-10T17:06:19.640081] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:06:19.690773] [DEBUG] [LOCAL ] AGL: Loaded 52884 existing records from primary storage. [2025-10-10T17:06:19.691145] [INFO ] [MAIN ] AGL: Loaded 52884 existing records. [2025-10-10T17:06:19.869842] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:06:19.870106] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-10T17:06:19.870153] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-10T17:06:19.870542] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-10T17:06:19.870597] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-10T17:06:20.229029] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:06:20.289341] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-10T17:06:20.418542] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-10T17:06:20.423323] [INFO ] [REMOTE ] AGCO: Full fetch complete (61654 records). [2025-10-10T17:06:20.423526] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-10T17:06:20.838107] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-10T17:06:20.838218] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-10T17:06:20.838969] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-10T17:06:20.839047] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-10T17:06:20.840930] [DEBUG] [LOCAL ] AGCO: Trimmed 61654 records to 42959 (keeping 200 days of data) [2025-10-10T17:06:21.092785] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-10T17:06:21.132529] [DEBUG] [LOCAL ] AGCO: Primary data saved (42959 records). [2025-10-10T17:06:21.132801] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-10T17:06:21.132907] [INFO ] [MAIN ] Update Progress: 52/2373 symbols completed. AGCO took 35.9s. Estimated remaining: 4h 40m 32s. Rate: 8.3 symbols/min [2025-10-10T17:06:21.315197] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:06:21.331093] [DEBUG] [LOCAL ] AGM: Loaded 10514 existing records from primary storage. [2025-10-10T17:06:21.331455] [INFO ] [MAIN ] AGM: Loaded 10514 existing records. [2025-10-10T17:06:21.522898] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:06:21.523336] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-10T17:06:21.523427] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-10T17:06:21.523886] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-10T17:06:21.523993] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-10T17:06:21.911554] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-10T17:06:22.000121] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:06:22.001506] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-10T17:06:22.046583] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T17:06:22.634067] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T17:06:22.689346] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-10T17:06:23.489384] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-10T17:06:24.289346] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-10T17:06:24.487692] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T17:06:24.631129] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T17:06:24.756343] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-10T17:06:24.762039] [INFO ] [REMOTE ] AG: Full fetch complete (77615 records). [2025-10-10T17:06:24.762230] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-10T17:06:25.094548] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-10T17:06:25.198329] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-10T17:06:25.198430] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-10T17:06:25.199180] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-10T17:06:25.199255] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-10T17:06:25.201095] [DEBUG] [LOCAL ] AG: Trimmed 77615 records to 54422 (keeping 200 days of data) [2025-10-10T17:06:25.521102] [DEBUG] [LOCAL ] AG: Primary data saved (54422 records). [2025-10-10T17:06:25.521237] [INFO ] [MAIN ] AG: Full history saved. [2025-10-10T17:06:25.522019] [INFO ] [MAIN ] Update Progress: 53/2373 symbols completed. AG took 44.4s. Estimated remaining: 4h 38m 19s. Rate: 8.3 symbols/min [2025-10-10T17:06:25.694908] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:06:25.701434] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-10T17:06:25.735013] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-10T17:06:25.764250] [DEBUG] [LOCAL ] AGO: Loaded 28116 existing records from primary storage. [2025-10-10T17:06:25.764546] [INFO ] [MAIN ] AGO: Loaded 28116 existing records. [2025-10-10T17:06:25.898171] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-10T17:06:25.937431] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:06:25.937661] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-10T17:06:25.937723] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-10T17:06:25.938010] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-10T17:06:25.938065] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-10T17:06:26.284986] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:06:26.689383] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-10T17:06:27.154157] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-10T17:06:27.489417] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-10T17:06:27.853276] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-10T17:06:28.289373] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-10T17:06:29.089372] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-10T17:06:29.122740] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-10T17:06:29.394699] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-10T17:06:29.889428] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-10T17:06:30.689401] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-10T17:06:30.911595] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T17:06:31.415130] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-10T17:06:31.489446] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-10T17:06:31.660945] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-10T17:06:32.289391] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-10T17:06:33.089399] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-10T17:06:33.800794] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-10T17:06:33.889377] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-10T17:06:33.933690] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T17:06:34.520536] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-10T17:06:34.605081] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-10T17:06:34.689341] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-10T17:06:35.489690] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-10T17:06:35.492090] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-10T17:06:36.289379] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-10T17:06:37.089375] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-10T17:06:37.547815] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T17:06:37.618600] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-10T17:06:37.889376] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-10T17:06:38.514570] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-10T17:06:38.689357] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-10T17:06:38.966226] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-10T17:06:39.489373] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-10T17:06:40.064569] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T17:06:40.289354] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-10T17:06:40.827625] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T17:06:41.089372] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-10T17:06:41.889372] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-10T17:06:42.181834] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-10T17:06:42.689396] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-10T17:06:42.804085] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T17:06:43.489367] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-10T17:06:43.956134] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-10T17:06:44.090472] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-10T17:06:44.289379] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-10T17:06:44.581029] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T17:06:45.089428] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-10T17:06:45.350256] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-10T17:06:45.889381] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-10T17:06:46.243351] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-10T17:06:46.689448] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-10T17:06:47.258185] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T17:06:47.489410] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-10T17:06:48.289359] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-10T17:06:48.326361] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-10T17:06:48.622513] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T17:06:49.089444] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-10T17:06:49.206307] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T17:06:49.209037] [INFO ] [REMOTE ] AGM: Full fetch complete (13139 records). [2025-10-10T17:06:49.209130] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-10T17:06:49.628019] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-10T17:06:49.628117] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-10T17:06:49.628495] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-10T17:06:49.628561] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-10T17:06:49.629252] [DEBUG] [LOCAL ] AGM: Trimmed 13139 records to 10669 (keeping 200 days of data) [2025-10-10T17:06:49.712010] [DEBUG] [LOCAL ] AGM: Primary data saved (10669 records). [2025-10-10T17:06:49.712213] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-10T17:06:49.712317] [INFO ] [MAIN ] Update Progress: 54/2373 symbols completed. AGM took 28.6s. Estimated remaining: 4h 50m 22s. Rate: 8.0 symbols/min [2025-10-10T17:06:49.897490] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-10T17:06:49.926784] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:06:49.965854] [DEBUG] [LOCAL ] AGRO: Loaded 33620 existing records from primary storage. [2025-10-10T17:06:49.966239] [INFO ] [MAIN ] AGRO: Loaded 33620 existing records. [2025-10-10T17:06:50.149378] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:06:50.149711] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-10T17:06:50.149776] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-10T17:06:50.150102] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-10T17:06:50.150160] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-10T17:06:50.522915] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:06:50.689419] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-10T17:06:51.085328] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-10T17:06:51.415986] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T17:06:51.489427] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-10T17:06:52.018096] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T17:06:52.289392] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-10T17:06:52.571983] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T17:06:53.089457] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-10T17:06:53.361993] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-10T17:06:53.889350] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-10T17:06:54.689442] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-10T17:06:54.977919] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T17:06:55.489362] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-10T17:06:55.600418] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T17:06:55.922978] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-10T17:06:56.289396] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-10T17:06:57.055828] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T17:06:57.089381] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-10T17:06:57.889375] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-10T17:06:58.203934] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-10T17:06:58.479025] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-10T17:06:58.484139] [INFO ] [REMOTE ] AGL: Full fetch complete (75620 records). [2025-10-10T17:06:58.484260] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-10T17:06:58.694629] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-10T17:06:58.874418] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-10T17:06:58.874525] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-10T17:06:58.875353] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-10T17:06:58.875428] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-10T17:06:58.877144] [DEBUG] [LOCAL ] AGL: Trimmed 75620 records to 53272 (keeping 200 days of data) [2025-10-10T17:06:59.185487] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-10T17:06:59.192231] [INFO ] [REMOTE ] AGO: Full fetch complete (39475 records). [2025-10-10T17:06:59.195507] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-10T17:06:59.323587] [DEBUG] [LOCAL ] AGL: Primary data saved (53272 records). [2025-10-10T17:06:59.329051] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-10T17:06:59.335952] [INFO ] [MAIN ] Update Progress: 55/2373 symbols completed. AGL took 39.9s. Estimated remaining: 4h 51m 43s. Rate: 7.9 symbols/min [2025-10-10T17:06:59.501560] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-10T17:06:59.630211] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:06:59.802439] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-10T17:06:59.811515] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-10T17:06:59.813450] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-10T17:06:59.813617] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-10T17:06:59.814986] [DEBUG] [LOCAL ] AGX: Loaded 33340 existing records from primary storage. [2025-10-10T17:06:59.815622] [INFO ] [MAIN ] AGX: Loaded 33340 existing records. [2025-10-10T17:06:59.848176] [DEBUG] [LOCAL ] AGO: Trimmed 39475 records to 28322 (keeping 200 days of data) [2025-10-10T17:07:00.117102] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:07:00.118602] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-10T17:07:00.118991] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-10T17:07:00.119774] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-10T17:07:00.120116] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-10T17:07:00.528815] [DEBUG] [LOCAL ] AGO: Primary data saved (28322 records). [2025-10-10T17:07:00.553980] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-10T17:07:00.586352] [INFO ] [MAIN ] Update Progress: 56/2373 symbols completed. AGO took 35.1s. Estimated remaining: 4h 47m 15s. Rate: 8.1 symbols/min [2025-10-10T17:07:00.586007] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:07:00.586778] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-10T17:07:00.796175] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T17:07:00.799297] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:07:00.852206] [DEBUG] [LOCAL ] AHH: Loaded 41015 existing records from primary storage. [2025-10-10T17:07:00.852550] [INFO ] [MAIN ] AHH: Loaded 41015 existing records. [2025-10-10T17:07:01.035638] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:07:01.035966] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-10T17:07:01.036036] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-10T17:07:01.036409] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-10T17:07:01.036467] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-10T17:07:01.099357] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-10T17:07:01.310128] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-10T17:07:01.354966] [INFO ] [REMOTE ] AGI: Full fetch complete (76920 records). [2025-10-10T17:07:01.358333] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-10T17:07:01.532603] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:07:01.886920] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-10T17:07:01.887059] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-10T17:07:01.887966] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-10T17:07:01.888040] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-10T17:07:01.889536] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-10T17:07:01.890375] [DEBUG] [LOCAL ] AGI: Trimmed 76920 records to 54200 (keeping 200 days of data) [2025-10-10T17:07:02.241316] [DEBUG] [LOCAL ] AGI: Primary data saved (54200 records). [2025-10-10T17:07:02.241486] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-10T17:07:02.241578] [INFO ] [MAIN ] Update Progress: 57/2373 symbols completed. AGI took 43.8s. Estimated remaining: 4h 43m 13s. Rate: 8.2 symbols/min [2025-10-10T17:07:02.348253] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T17:07:02.443747] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:07:02.444137] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-10T17:07:02.444290] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-10T17:07:02.444497] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-10T17:07:02.444607] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-10T17:07:02.444715] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-10T17:07:02.444847] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-10T17:07:02.571637] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-10T17:07:02.689471] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-10T17:07:02.874072] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:07:03.489354] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-10T17:07:03.711271] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:07:03.711598] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-10T17:07:03.711708] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:07:03.711784] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-10T17:07:03.711851] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:07:03.711923] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-10T17:07:03.711989] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-10T17:07:03.712026] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-10T17:07:03.712066] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-10T17:07:03.712114] [INFO ] [MAIN ] Update Progress: 58/2373 symbols completed. AHL took 1.5s. Estimated remaining: 4h 39m 11s. Rate: 8.3 symbols/min [2025-10-10T17:07:03.914868] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:07:03.911403] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T17:07:03.972253] [DEBUG] [LOCAL ] AHR: Loaded 49469 existing records from primary storage. [2025-10-10T17:07:03.972593] [INFO ] [MAIN ] AHR: Loaded 49469 existing records. [2025-10-10T17:07:04.146165] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:07:04.146428] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-10T17:07:04.146478] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-10T17:07:04.146901] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-10T17:07:04.146958] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-10T17:07:04.291771] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-10T17:07:04.502077] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:07:04.728214] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T17:07:05.089365] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-10T17:07:05.889349] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-10T17:07:06.094757] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T17:07:06.689366] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-10T17:07:06.987754] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T17:07:07.084923] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-10T17:07:07.489389] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-10T17:07:07.838170] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-10T17:07:08.289405] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-10T17:07:09.089448] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-10T17:07:09.265232] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T17:07:09.572094] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T17:07:09.889387] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-10T17:07:10.408574] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T17:07:10.689399] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-10T17:07:11.489355] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-10T17:07:11.641131] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-10T17:07:11.749178] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T17:07:12.289432] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-10T17:07:12.941627] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-10T17:07:13.089407] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-10T17:07:13.491437] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-10T17:07:13.889399] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-10T17:07:14.689365] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-10T17:07:14.872210] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T17:07:15.489383] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-10T17:07:15.764946] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T17:07:16.254718] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-10T17:07:16.289375] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-10T17:07:17.089403] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-10T17:07:17.184882] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T17:07:17.792675] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-10T17:07:17.889407] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-10T17:07:18.689436] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-10T17:07:19.042787] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T17:07:19.167123] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T17:07:19.489435] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-10T17:07:20.084003] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T17:07:20.289396] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-10T17:07:21.089355] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-10T17:07:21.411267] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T17:07:21.511768] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T17:07:21.889389] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-10T17:07:22.079495] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T17:07:22.082767] [INFO ] [REMOTE ] AGRO: Full fetch complete (49287 records). [2025-10-10T17:07:22.083162] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-10T17:07:22.480487] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-10T17:07:22.480583] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-10T17:07:22.481190] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-10T17:07:22.481256] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-10T17:07:22.482582] [DEBUG] [LOCAL ] AGRO: Trimmed 49287 records to 33809 (keeping 200 days of data) [2025-10-10T17:07:22.684341] [DEBUG] [LOCAL ] AGRO: Primary data saved (33809 records). [2025-10-10T17:07:22.684523] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-10T17:07:22.684624] [INFO ] [MAIN ] Update Progress: 59/2373 symbols completed. AGRO took 33.0s. Estimated remaining: 4h 46m 44s. Rate: 8.1 symbols/min [2025-10-10T17:07:22.696362] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-10T17:07:22.870477] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:07:22.880998] [DEBUG] [LOCAL ] AHT: Loaded 6268 existing records from primary storage. [2025-10-10T17:07:22.881252] [INFO ] [MAIN ] AHT: Loaded 6268 existing records. [2025-10-10T17:07:23.068846] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:07:23.069178] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-10T17:07:23.069231] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-10T17:07:23.069403] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-10T17:07:23.069446] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-10T17:07:23.437314] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:07:23.494933] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-10T17:07:23.512077] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-10T17:07:24.269071] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-10T17:07:24.289369] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-10T17:07:24.536515] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T17:07:25.089385] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-10T17:07:25.558232] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-10T17:07:25.889417] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-10T17:07:26.401172] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T17:07:26.689396] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-10T17:07:27.456424] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-10T17:07:27.489339] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-10T17:07:27.758287] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T17:07:28.194698] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-10T17:07:28.289502] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-10T17:07:29.089414] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-10T17:07:29.469570] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T17:07:29.889415] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-10T17:07:30.613947] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-10T17:07:30.689354] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-10T17:07:31.159564] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T17:07:31.421865] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-10T17:07:31.489383] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-10T17:07:32.289409] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-10T17:07:32.380323] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-10T17:07:33.089377] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-10T17:07:33.678020] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-10T17:07:33.889394] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-10T17:07:33.980944] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-10T17:07:34.689388] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-10T17:07:35.301462] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-10T17:07:35.489388] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-10T17:07:35.746560] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T17:07:36.289382] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-10T17:07:36.815158] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-10T17:07:37.025412] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-10T17:07:37.029515] [INFO ] [REMOTE ] AHH: Full fetch complete (59798 records). [2025-10-10T17:07:37.029738] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-10T17:07:37.098986] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-10T17:07:37.438144] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-10T17:07:37.438229] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-10T17:07:37.438826] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-10T17:07:37.438888] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-10T17:07:37.440012] [DEBUG] [LOCAL ] AHH: Trimmed 59798 records to 41288 (keeping 200 days of data) [2025-10-10T17:07:37.673565] [DEBUG] [LOCAL ] AHH: Primary data saved (41288 records). [2025-10-10T17:07:37.673751] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-10T17:07:37.674332] [INFO ] [MAIN ] Update Progress: 60/2373 symbols completed. AHH took 37.1s. Estimated remaining: 4h 51m 28s. Rate: 7.9 symbols/min [2025-10-10T17:07:37.844690] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:07:37.880849] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T17:07:37.882413] [INFO ] [REMOTE ] AHT: Full fetch complete (9205 records). [2025-10-10T17:07:37.882492] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-10T17:07:37.894523] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-10T17:07:38.014234] [DEBUG] [LOCAL ] AI: Loaded 54145 existing records from primary storage. [2025-10-10T17:07:38.020637] [INFO ] [MAIN ] AI: Loaded 54145 existing records. [2025-10-10T17:07:38.420326] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:07:38.454332] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-10T17:07:38.473614] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-10T17:07:38.499081] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-10T17:07:38.499150] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-10T17:07:38.499441] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-10T17:07:38.499405] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-10T17:07:38.499550] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-10T17:07:38.499604] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-10T17:07:38.579030] [DEBUG] [LOCAL ] AHT: Trimmed 9205 records to 6364 (keeping 200 days of data) [2025-10-10T17:07:38.697726] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-10T17:07:38.763381] [DEBUG] [LOCAL ] AHT: Primary data saved (6364 records). [2025-10-10T17:07:38.787489] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-10T17:07:38.832235] [INFO ] [MAIN ] Update Progress: 61/2373 symbols completed. AHT took 16.1s. Estimated remaining: 4h 47m 18s. Rate: 8.0 symbols/min [2025-10-10T17:07:39.130153] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:07:39.158884] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:07:39.218786] [DEBUG] [LOCAL ] AIG: Loaded 53863 existing records from primary storage. [2025-10-10T17:07:39.219209] [INFO ] [MAIN ] AIG: Loaded 53863 existing records. [2025-10-10T17:07:39.410447] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:07:39.410770] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-10T17:07:39.410827] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-10T17:07:39.411307] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-10T17:07:39.411348] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-10T17:07:39.497799] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-10T17:07:39.851124] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:07:39.861416] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T17:07:40.289388] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-10T17:07:40.503084] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-10T17:07:40.507757] [INFO ] [REMOTE ] AHR: Full fetch complete (70716 records). [2025-10-10T17:07:40.507871] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-10T17:07:40.911430] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-10T17:07:40.911631] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-10T17:07:40.914335] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-10T17:07:40.914415] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-10T17:07:40.916561] [DEBUG] [LOCAL ] AHR: Trimmed 70716 records to 49812 (keeping 200 days of data) [2025-10-10T17:07:41.098152] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-10T17:07:41.242841] [DEBUG] [LOCAL ] AHR: Primary data saved (49812 records). [2025-10-10T17:07:41.243052] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-10T17:07:41.244115] [INFO ] [MAIN ] Update Progress: 62/2373 symbols completed. AHR took 37.5s. Estimated remaining: 4h 44m 2s. Rate: 8.1 symbols/min [2025-10-10T17:07:41.429075] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:07:41.429383] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-10T17:07:41.429432] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-10T17:07:41.429559] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-10T17:07:41.429602] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-10T17:07:41.429685] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-10T17:07:41.429743] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-10T17:07:41.821825] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-10T17:07:41.857359] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:07:41.894473] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-10T17:07:41.915306] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-10T17:07:42.559219] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-10T17:07:42.689376] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-10T17:07:43.331030] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T17:07:43.334145] [INFO ] [REMOTE ] AGX: Full fetch complete (48593 records). [2025-10-10T17:07:43.334236] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-10T17:07:43.498543] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-10T17:07:43.728848] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-10T17:07:43.728949] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-10T17:07:43.729563] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-10T17:07:43.729628] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-10T17:07:43.731226] [DEBUG] [LOCAL ] AGX: Trimmed 48593 records to 33549 (keeping 200 days of data) [2025-10-10T17:07:43.953084] [DEBUG] [LOCAL ] AGX: Primary data saved (33549 records). [2025-10-10T17:07:43.953278] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-10T17:07:43.953383] [INFO ] [MAIN ] Update Progress: 63/2373 symbols completed. AGX took 44.6s. Estimated remaining: 4h 41m 4s. Rate: 8.2 symbols/min [2025-10-10T17:07:44.134973] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:07:44.162209] [DEBUG] [LOCAL ] AIN: Loaded 24721 existing records from primary storage. [2025-10-10T17:07:44.162529] [INFO ] [MAIN ] AIN: Loaded 24721 existing records. [2025-10-10T17:07:44.294514] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-10T17:07:44.356527] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:07:44.357639] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-10T17:07:44.357732] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-10T17:07:44.358018] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-10T17:07:44.358076] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-10T17:07:44.613149] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:07:44.635596] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-10T17:07:44.652956] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:07:44.653418] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-10T17:07:44.674740] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:07:44.693838] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-10T17:07:44.735528] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:07:44.731817] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-10T17:07:44.735995] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-10T17:07:44.736478] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-10T17:07:44.736763] [INFO ] [MAIN ] Update Progress: 64/2373 symbols completed. AII took 3.5s. Estimated remaining: 4h 37m 1s. Rate: 8.3 symbols/min [2025-10-10T17:07:44.885282] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-10T17:07:44.973080] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:07:44.990831] [DEBUG] [LOCAL ] AIO: Loaded 13483 existing records from primary storage. [2025-10-10T17:07:44.991146] [INFO ] [MAIN ] AIO: Loaded 13483 existing records. [2025-10-10T17:07:45.096018] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-10T17:07:45.183265] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:07:45.183564] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-10T17:07:45.183679] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-10T17:07:45.183939] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-10T17:07:45.183997] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-10T17:07:45.573856] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:07:45.889431] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-10T17:07:46.288477] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-10-10T17:07:46.521679] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T17:07:46.689397] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-10T17:07:47.376564] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T17:07:47.489392] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-10T17:07:47.962714] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-10T17:07:48.289415] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-10T17:07:48.973834] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-10T17:07:49.089413] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-10T17:07:49.889419] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-10T17:07:49.927094] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-10T17:07:50.270020] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-10T17:07:50.689355] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-10T17:07:51.228553] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T17:07:51.489389] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-10T17:07:52.204305] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-10T17:07:52.289386] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-10T17:07:52.456178] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T17:07:53.089435] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-10T17:07:53.635616] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-10T17:07:53.754843] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-10T17:07:53.889432] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-10T17:07:54.689415] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-10T17:07:55.049591] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-10T17:07:55.489456] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-10T17:07:56.289410] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-10T17:07:56.697965] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T17:07:57.089439] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-10T17:07:57.132844] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-10T17:07:57.662872] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-10T17:07:57.875414] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-10T17:07:57.889338] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-10T17:07:58.689423] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-10T17:07:59.489413] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-10T17:08:00.279781] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-10T17:08:00.289327] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-10T17:08:00.416867] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-10T17:08:01.089369] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-10T17:08:01.664182] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T17:08:01.715193] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-10T17:08:01.889462] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-10T17:08:02.689389] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-10T17:08:03.116663] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T17:08:03.480371] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-10T17:08:03.491133] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-10T17:08:04.146704] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T17:08:04.257199] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-10T17:08:04.289428] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-10T17:08:05.089426] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-10T17:08:05.815839] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-10T17:08:05.889400] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-10T17:08:06.689464] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-10T17:08:06.813969] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-10T17:08:07.061819] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-10T17:08:07.469768] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-10T17:08:07.489339] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-10T17:08:08.289363] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-10T17:08:08.362098] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-10T17:08:08.422500] [DEBUG] [REMOTE ] AIO: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-10T17:08:08.422940] [WARN ] [REMOTE ] AIO: No data returned for month 2025-09 [2025-10-10T17:08:08.423060] [FATAL] [REMOTE ] AIO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:08:08.423158] [FATAL] [MAIN ] AIO: Failed to fetch primary data. [2025-10-10T17:08:08.423223] [WARN ] [MAIN ] AIO: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:08:08.423308] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-10T17:08:08.423379] [DEBUG] [LOCAL ] AIO: No primary data file found to delete. [2025-10-10T17:08:08.423466] [INFO ] [LOCAL ] AIO: Starting deletion of derivative data. [2025-10-10T17:08:08.423843] [DEBUG] [LOCAL ] AIO: Deleted derivative data file. [2025-10-10T17:08:08.423952] [INFO ] [MAIN ] Update Progress: 65/2373 symbols completed. AIO took 23.7s. Estimated remaining: 4h 46m 40s. Rate: 8.1 symbols/min [2025-10-10T17:08:08.603688] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:08:08.603974] [DEBUG] [LOCAL ] AIR: No existing data file found in primary storage. [2025-10-10T17:08:08.604036] [WARN ] [MAIN ] AIR: No existing data found, performing full refresh instead. [2025-10-10T17:08:08.604172] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-10T17:08:08.604217] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-10T17:08:08.604259] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-10T17:08:08.604293] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-10T17:08:08.966526] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:08:09.089442] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-10T17:08:09.889404] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-10T17:08:10.689388] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-10T17:08:11.418481] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-10T17:08:11.489407] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-10T17:08:11.998038] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-10T17:08:12.056095] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T17:08:12.289412] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-10T17:08:12.611341] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T17:08:13.089407] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-10T17:08:13.889359] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-10T17:08:14.248874] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T17:08:14.389319] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-10T17:08:14.392625] [INFO ] [REMOTE ] AIN: Full fetch complete (33504 records). [2025-10-10T17:08:14.392782] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-10T17:08:14.692790] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-10T17:08:14.823622] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-10T17:08:14.823783] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-10T17:08:14.824248] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-10T17:08:14.824405] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-10T17:08:14.844226] [DEBUG] [LOCAL ] AIN: Trimmed 33504 records to 24875 (keeping 200 days of data) [2025-10-10T17:08:14.844027] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-10T17:08:15.006085] [DEBUG] [LOCAL ] AIN: Primary data saved (24875 records). [2025-10-10T17:08:15.006265] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-10T17:08:15.006369] [INFO ] [MAIN ] Update Progress: 66/2373 symbols completed. AIN took 31.1s. Estimated remaining: 4h 46m 2s. Rate: 8.1 symbols/min [2025-10-10T17:08:15.184571] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:08:15.214358] [DEBUG] [LOCAL ] AIT: Loaded 27293 existing records from primary storage. [2025-10-10T17:08:15.214804] [INFO ] [MAIN ] AIT: Loaded 27293 existing records. [2025-10-10T17:08:15.406737] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:08:15.407014] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-10T17:08:15.407070] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-10T17:08:15.407432] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-10T17:08:15.407490] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-10T17:08:15.494502] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-10T17:08:15.781576] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:08:16.289401] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-10T17:08:16.690987] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-10T17:08:16.921982] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-10T17:08:17.089406] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-10T17:08:17.889397] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-10T17:08:18.323873] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T17:08:18.589625] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T17:08:18.689391] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-10T17:08:19.489431] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-10T17:08:20.289376] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-10T17:08:20.447501] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-10T17:08:20.454057] [INFO ] [REMOTE ] AI: Full fetch complete (77506 records). [2025-10-10T17:08:20.454191] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-10T17:08:20.454999] [FATAL] [VALIDATOR ] AI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:08:20.455092] [FATAL] [MAIN ] AI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:08:20.455134] [WARN ] [MAIN ] AI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:08:20.455173] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-10T17:08:20.455229] [DEBUG] [LOCAL ] AI: No primary data file found to delete. [2025-10-10T17:08:20.455265] [INFO ] [LOCAL ] AI: Starting deletion of derivative data. [2025-10-10T17:08:20.455485] [DEBUG] [LOCAL ] AI: Deleted derivative data file. [2025-10-10T17:08:20.456112] [INFO ] [MAIN ] Update Progress: 67/2373 symbols completed. AI took 42.8s. Estimated remaining: 4h 44m 46s. Rate: 8.1 symbols/min [2025-10-10T17:08:20.641127] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:08:20.685022] [DEBUG] [LOCAL ] AIV: Loaded 41248 existing records from primary storage. [2025-10-10T17:08:20.685386] [INFO ] [MAIN ] AIV: Loaded 41248 existing records. [2025-10-10T17:08:20.892046] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:08:20.893289] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-10T17:08:20.893784] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-10T17:08:20.899210] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-10T17:08:20.900319] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-10T17:08:20.900390] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-10T17:08:20.947545] [INFO ] [REMOTE ] AIG: Full fetch complete (77381 records). [2025-10-10T17:08:21.004032] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-10T17:08:21.431366] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T17:08:21.473022] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-10T17:08:21.606411] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:08:21.810839] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-10T17:08:21.810058] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-10T17:08:21.810973] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-10T17:08:21.819117] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-10T17:08:21.819578] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-10T17:08:21.821480] [DEBUG] [LOCAL ] AIG: Trimmed 77381 records to 54250 (keeping 200 days of data) [2025-10-10T17:08:21.913411] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-10T17:08:22.164893] [DEBUG] [LOCAL ] AIG: Primary data saved (54250 records). [2025-10-10T17:08:22.165062] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-10T17:08:22.165149] [INFO ] [MAIN ] Update Progress: 68/2373 symbols completed. AIG took 43.3s. Estimated remaining: 4h 41m 25s. Rate: 8.2 symbols/min [2025-10-10T17:08:22.338725] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:08:22.369458] [DEBUG] [LOCAL ] AIZ: Loaded 29831 existing records from primary storage. [2025-10-10T17:08:22.369767] [INFO ] [MAIN ] AIZ: Loaded 29831 existing records. [2025-10-10T17:08:22.546907] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:08:22.547155] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-10T17:08:22.547203] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-10T17:08:22.547607] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-10T17:08:22.547706] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-10T17:08:22.695994] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-10T17:08:22.904452] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:08:23.063268] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T17:08:23.364759] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-10T17:08:23.489372] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-10T17:08:23.990956] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T17:08:24.289413] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-10T17:08:25.032848] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T17:08:25.089405] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-10T17:08:25.889406] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-10T17:08:26.041316] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T17:08:26.394521] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T17:08:26.689395] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-10T17:08:27.204803] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-10T17:08:27.489378] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-10T17:08:28.151284] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T17:08:28.289377] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-10T17:08:28.687098] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-10T17:08:29.089368] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-10T17:08:29.824000] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-10T17:08:29.889389] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-10T17:08:30.671499] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T17:08:30.689332] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-10T17:08:30.886234] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-10T17:08:31.489397] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-10T17:08:32.289349] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-10T17:08:32.379482] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T17:08:33.094448] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-10T17:08:33.106103] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T17:08:33.351581] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-10T17:08:33.889407] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-10T17:08:34.372296] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-10T17:08:34.689433] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-10T17:08:35.257092] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T17:08:35.489396] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-10T17:08:36.289417] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-10T17:08:36.353289] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T17:08:37.078874] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-10T17:08:37.089326] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-10T17:08:37.531520] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-10T17:08:37.889408] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-10T17:08:38.066477] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T17:08:38.689383] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-10T17:08:39.489360] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-10T17:08:39.587373] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-10T17:08:40.195976] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-10T17:08:40.289439] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-10T17:08:40.523301] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-10T17:08:41.089398] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-10T17:08:41.804850] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T17:08:41.889376] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-10T17:08:42.365107] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T17:08:42.369203] [INFO ] [REMOTE ] AIR: Full fetch complete (39869 records). [2025-10-10T17:08:42.369341] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-10T17:08:42.695269] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-10T17:08:42.746612] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-10T17:08:42.746768] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-10T17:08:42.747331] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-10T17:08:42.747501] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-10T17:08:42.748732] [DEBUG] [LOCAL ] AIR: Trimmed 39869 records to 29366 (keeping 200 days of data) [2025-10-10T17:08:42.858830] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-10T17:08:42.950236] [DEBUG] [LOCAL ] AIR: Primary data saved (29366 records). [2025-10-10T17:08:42.950412] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-10T17:08:42.950494] [INFO ] [MAIN ] Update Progress: 69/2373 symbols completed. AIR took 34.5s. Estimated remaining: 4h 48m 47s. Rate: 8.0 symbols/min [2025-10-10T17:08:43.115630] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:08:43.121265] [DEBUG] [LOCAL ] AIZN: Loaded 4137 existing records from primary storage. [2025-10-10T17:08:43.121450] [INFO ] [MAIN ] AIZN: Loaded 4137 existing records. [2025-10-10T17:08:43.300214] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:08:43.300509] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-10T17:08:43.300568] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-10T17:08:43.301071] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-10T17:08:43.301313] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-10T17:08:43.495044] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-10T17:08:43.653208] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:08:44.174750] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-10T17:08:44.289436] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-10T17:08:44.971614] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T17:08:45.089334] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-10T17:08:45.871873] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-10T17:08:45.889341] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-10T17:08:46.164478] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T17:08:46.167212] [INFO ] [REMOTE ] AIZ: Full fetch complete (42818 records). [2025-10-10T17:08:46.167315] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-10T17:08:46.533859] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-10T17:08:46.533964] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-10T17:08:46.534427] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-10T17:08:46.534469] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-10T17:08:46.535290] [DEBUG] [LOCAL ] AIZ: Trimmed 42818 records to 30023 (keeping 200 days of data) [2025-10-10T17:08:46.689408] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-10T17:08:46.720729] [DEBUG] [LOCAL ] AIZ: Primary data saved (30023 records). [2025-10-10T17:08:46.720885] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-10T17:08:46.720967] [INFO ] [MAIN ] Update Progress: 70/2373 symbols completed. AIZ took 24.6s. Estimated remaining: 4h 46m 36s. Rate: 8.0 symbols/min [2025-10-10T17:08:46.887383] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:08:46.934596] [DEBUG] [LOCAL ] AJG: Loaded 46983 existing records from primary storage. [2025-10-10T17:08:46.934941] [INFO ] [MAIN ] AJG: Loaded 46983 existing records. [2025-10-10T17:08:47.112235] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:08:47.112495] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-10T17:08:47.112541] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-10T17:08:47.113029] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-10T17:08:47.113085] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-10T17:08:47.219697] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-10T17:08:47.493255] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-10T17:08:47.504809] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:08:47.517348] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T17:08:48.250387] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-10T17:08:48.289433] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-10T17:08:48.847881] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-10T17:08:49.089396] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-10T17:08:49.871527] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-10T17:08:49.889387] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-10T17:08:50.574487] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-10T17:08:50.689401] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-10T17:08:51.242991] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-10T17:08:51.489376] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-10T17:08:52.231527] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-10T17:08:52.289353] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-10T17:08:52.961068] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-10T17:08:53.089369] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-10T17:08:53.889415] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-10T17:08:54.240698] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-10T17:08:54.689375] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-10T17:08:55.035901] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-10T17:08:55.489380] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-10T17:08:55.945868] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T17:08:55.949749] [INFO ] [REMOTE ] AIT: Full fetch complete (39109 records). [2025-10-10T17:08:55.949861] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-10T17:08:56.228789] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-10T17:08:56.294475] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-10T17:08:56.359514] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-10T17:08:56.359614] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-10T17:08:56.360217] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-10T17:08:56.360290] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-10T17:08:56.361553] [DEBUG] [LOCAL ] AIT: Trimmed 39109 records to 27469 (keeping 200 days of data) [2025-10-10T17:08:56.538994] [DEBUG] [LOCAL ] AIT: Primary data saved (27469 records). [2025-10-10T17:08:56.539171] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-10T17:08:56.539287] [INFO ] [MAIN ] Update Progress: 71/2373 symbols completed. AIT took 41.5s. Estimated remaining: 4h 47m 45s. Rate: 8.0 symbols/min [2025-10-10T17:08:56.713535] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:08:56.713838] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-10T17:08:56.713891] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-10T17:08:56.714013] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-10T17:08:56.714055] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-10T17:08:56.714098] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-10T17:08:56.714132] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-10T17:08:56.899118] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-10T17:08:57.092330] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-10T17:08:57.092210] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:08:57.889431] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-10T17:08:58.689046] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-10T17:08:58.690314] [INFO ] [REMOTE ] AIZN: Full fetch complete (5949 records). [2025-10-10T17:08:58.690692] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-10T17:08:58.690480] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-10T17:08:59.083700] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-10T17:08:59.083947] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-10T17:08:59.084183] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-10T17:08:59.084264] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-10T17:08:59.114798] [DEBUG] [LOCAL ] AIZN: Trimmed 5949 records to 4172 (keeping 200 days of data) [2025-10-10T17:08:59.117430] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T17:08:59.158610] [DEBUG] [LOCAL ] AIZN: Primary data saved (4172 records). [2025-10-10T17:08:59.158864] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-10T17:08:59.158987] [INFO ] [MAIN ] Update Progress: 72/2373 symbols completed. AIZN took 16.2s. Estimated remaining: 4h 45m 2s. Rate: 8.1 symbols/min [2025-10-10T17:08:59.336665] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:08:59.372988] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-10T17:08:59.389438] [DEBUG] [LOCAL ] AKR: Loaded 46135 existing records from primary storage. [2025-10-10T17:08:59.389875] [INFO ] [MAIN ] AKR: Loaded 46135 existing records. [2025-10-10T17:08:59.490017] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-10T17:08:59.574093] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:08:59.574351] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-10T17:08:59.574401] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-10T17:08:59.574953] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-10T17:08:59.575011] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-10T17:08:59.928489] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:09:00.289383] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-10T17:09:01.089436] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-10T17:09:01.684936] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-10T17:09:01.894548] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-10T17:09:01.908793] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T17:09:02.689370] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-10T17:09:02.982105] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T17:09:03.489429] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-10T17:09:03.924621] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T17:09:04.021805] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T17:09:04.057121] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-10T17:09:04.289366] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-10T17:09:04.840960] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-10T17:09:05.089389] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-10T17:09:05.889399] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-10T17:09:06.689413] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-10T17:09:06.719851] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T17:09:07.489364] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-10T17:09:07.732539] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T17:09:08.289407] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-10T17:09:08.562226] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T17:09:08.567094] [INFO ] [REMOTE ] AIV: Full fetch complete (60089 records). [2025-10-10T17:09:08.567236] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-10T17:09:08.981172] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-10T17:09:08.981285] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-10T17:09:08.982068] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-10T17:09:08.982139] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-10T17:09:08.983904] [DEBUG] [LOCAL ] AIV: Trimmed 60089 records to 41565 (keeping 200 days of data) [2025-10-10T17:09:09.089876] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-10T17:09:09.258466] [DEBUG] [LOCAL ] AIV: Primary data saved (41565 records). [2025-10-10T17:09:09.259138] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-10T17:09:09.261162] [INFO ] [MAIN ] Update Progress: 73/2373 symbols completed. AIV took 48.8s. Estimated remaining: 4h 46m 18s. Rate: 8.0 symbols/min [2025-10-10T17:09:09.260115] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T17:09:09.449839] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:09:09.507250] [DEBUG] [LOCAL ] AL: Loaded 44819 existing records from primary storage. [2025-10-10T17:09:09.507728] [INFO ] [MAIN ] AL: Loaded 44819 existing records. [2025-10-10T17:09:09.639790] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-10T17:09:09.746305] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:09:09.746749] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-10T17:09:09.746871] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-10T17:09:09.747445] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-10T17:09:09.747515] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-10T17:09:09.894161] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-10T17:09:10.125277] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:09:10.155933] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T17:09:10.689412] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-10T17:09:11.489442] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-10T17:09:11.761953] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T17:09:12.289464] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-10T17:09:12.706134] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-10T17:09:12.754942] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T17:09:12.829741] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T17:09:13.089381] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-10T17:09:13.889426] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-10T17:09:14.279358] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-10T17:09:14.540910] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-10T17:09:14.689378] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-10T17:09:15.489412] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-10T17:09:16.289379] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-10T17:09:16.659353] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T17:09:17.089408] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-10T17:09:17.344813] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T17:09:17.869918] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T17:09:17.889340] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-10T17:09:18.395488] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T17:09:18.689424] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-10T17:09:19.206238] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-10T17:09:19.489400] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-10T17:09:19.562601] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-10T17:09:20.019249] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-10T17:09:20.289431] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-10T17:09:20.690328] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-10T17:09:21.089390] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-10T17:09:21.889391] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-10T17:09:22.689426] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-10T17:09:22.988607] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-10T17:09:22.992967] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T17:09:23.217119] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-10T17:09:23.489414] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-10T17:09:24.289395] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-10T17:09:25.089365] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-10T17:09:25.340321] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-10T17:09:25.889354] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-10T17:09:26.028918] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T17:09:26.689403] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-10T17:09:27.102825] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T17:09:27.357849] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-10T17:09:27.489393] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-10T17:09:28.130562] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-10T17:09:28.289445] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-10T17:09:29.089483] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-10T17:09:29.308813] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T17:09:29.858542] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T17:09:29.889396] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-10T17:09:30.689392] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-10T17:09:30.811075] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-10T17:09:30.816445] [INFO ] [REMOTE ] AKR: Full fetch complete (65219 records). [2025-10-10T17:09:30.816729] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-10T17:09:31.285529] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-10T17:09:31.286084] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-10T17:09:31.286847] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-10T17:09:31.286915] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-10T17:09:31.288313] [DEBUG] [LOCAL ] AKR: Trimmed 65219 records to 46485 (keeping 200 days of data) [2025-10-10T17:09:31.500190] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-10T17:09:31.583980] [DEBUG] [LOCAL ] AKR: Primary data saved (46485 records). [2025-10-10T17:09:31.584168] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-10T17:09:31.584266] [INFO ] [MAIN ] Update Progress: 74/2373 symbols completed. AKR took 32.4s. Estimated remaining: 4h 53m 52s. Rate: 7.8 symbols/min [2025-10-10T17:09:31.758470] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T17:09:31.785628] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:09:31.792313] [INFO ] [REMOTE ] AJG: Full fetch complete (69000 records). [2025-10-10T17:09:31.792527] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-10T17:09:32.109376] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-10T17:09:32.191526] [INFO ] [REMOTE ] AKA: Full fetch complete (2396 records). [2025-10-10T17:09:32.196444] [DEBUG] [LOCAL ] ALB: Loaded 53678 existing records from primary storage. [2025-10-10T17:09:32.208586] [INFO ] [MAIN ] ALB: Loaded 53678 existing records. [2025-10-10T17:09:32.203211] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-10T17:09:32.217201] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T17:09:32.242773] [FATAL] [VALIDATOR ] AKA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:09:32.261884] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:09:32.318105] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:09:32.342783] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-10T17:09:32.392154] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-10T17:09:32.403683] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-10T17:09:32.403955] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-10T17:09:32.403856] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-10T17:09:32.404095] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-10T17:09:32.409400] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-10T17:09:32.420014] [INFO ] [MAIN ] Update Progress: 75/2373 symbols completed. AKA took 35.9s. Estimated remaining: 4h 50m 15s. Rate: 7.9 symbols/min [2025-10-10T17:09:32.420913] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-10T17:09:32.479029] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-10T17:09:32.644327] [DEBUG] [LOCAL ] AJG: Trimmed 69000 records to 47279 (keeping 200 days of data) [2025-10-10T17:09:32.657304] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:09:32.673414] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-10T17:09:32.678665] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-10T17:09:32.723470] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-10T17:09:32.727608] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:09:32.724343] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-10T17:09:33.214105] [DEBUG] [LOCAL ] ALC: Loaded 51409 existing records from primary storage. [2025-10-10T17:09:33.282799] [INFO ] [MAIN ] ALC: Loaded 51409 existing records. [2025-10-10T17:09:33.460113] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:09:33.503095] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-10T17:09:33.657081] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:09:33.660024] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-10T17:09:33.661123] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-10T17:09:33.667737] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-10T17:09:33.667870] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-10T17:09:33.930074] [DEBUG] [LOCAL ] AJG: Primary data saved (47279 records). [2025-10-10T17:09:33.948819] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-10T17:09:33.954354] [INFO ] [MAIN ] Update Progress: 76/2373 symbols completed. AJG took 47.2s. Estimated remaining: 4h 47m 5s. Rate: 8.0 symbols/min [2025-10-10T17:09:34.295304] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:09:34.311234] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-10T17:09:34.333761] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:09:34.364583] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T17:09:34.406830] [DEBUG] [LOCAL ] ALE: Loaded 31566 existing records from primary storage. [2025-10-10T17:09:34.407191] [INFO ] [MAIN ] ALE: Loaded 31566 existing records. [2025-10-10T17:09:34.594742] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:09:34.595036] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-10T17:09:34.595087] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-10T17:09:34.595400] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-10T17:09:34.595456] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-10T17:09:34.695761] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-10T17:09:34.983239] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:09:35.489399] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-10T17:09:35.870143] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-10T17:09:35.913615] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-10T17:09:36.289396] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-10T17:09:36.697830] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-10T17:09:37.023431] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-10T17:09:37.089388] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-10T17:09:37.689729] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-10T17:09:37.889404] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-10T17:09:38.109587] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-10T17:09:38.689404] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-10T17:09:39.152955] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T17:09:39.489447] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-10T17:09:40.170794] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T17:09:40.289390] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-10T17:09:40.765233] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T17:09:41.089421] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-10T17:09:41.889428] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-10T17:09:42.155530] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T17:09:42.160772] [INFO ] [REMOTE ] AL: Full fetch complete (62926 records). [2025-10-10T17:09:42.160945] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-10T17:09:42.588055] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T17:09:42.591700] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-10T17:09:42.597540] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-10T17:09:42.598924] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-10T17:09:42.599021] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-10T17:09:42.600826] [DEBUG] [LOCAL ] AL: Trimmed 62926 records to 45184 (keeping 200 days of data) [2025-10-10T17:09:42.693575] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-10T17:09:42.882808] [DEBUG] [LOCAL ] AL: Primary data saved (45184 records). [2025-10-10T17:09:42.882990] [INFO ] [MAIN ] AL: Full history saved. [2025-10-10T17:09:42.883123] [INFO ] [MAIN ] Update Progress: 77/2373 symbols completed. AL took 33.6s. Estimated remaining: 4h 47m 40s. Rate: 8.0 symbols/min [2025-10-10T17:09:43.489383] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-10T17:09:43.828870] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T17:09:44.288970] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-10T17:09:44.295908] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-10T17:09:45.089428] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-10T17:09:45.820892] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-10T17:09:45.865286] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-10T17:09:45.891213] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-10T17:09:45.892955] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-10T17:09:46.689396] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-10T17:09:47.489495] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-10T17:09:48.002538] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-10T17:09:48.210439] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T17:09:48.289418] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-10T17:09:49.089416] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-10T17:09:49.704201] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-10T17:09:49.809397] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T17:09:49.889427] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-10T17:09:50.689426] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-10T17:09:51.026958] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T17:09:51.489362] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-10T17:09:51.535693] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-10T17:09:52.289417] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-10T17:09:52.777146] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T17:09:53.089421] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-10T17:09:53.456469] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-10T17:09:53.893248] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-10T17:09:53.896557] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-10T17:09:54.689410] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-10T17:09:55.435132] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-10T17:09:55.489371] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-10T17:09:55.549433] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-10T17:09:55.919700] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-10T17:09:55.923752] [INFO ] [REMOTE ] ALE: Full fetch complete (43406 records). [2025-10-10T17:09:55.923845] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-10T17:09:56.294510] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-10T17:09:56.336704] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-10T17:09:56.336805] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-10T17:09:56.337364] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-10T17:09:56.337451] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-10T17:09:56.338753] [DEBUG] [LOCAL ] ALE: Trimmed 43406 records to 31823 (keeping 200 days of data) [2025-10-10T17:09:56.546346] [DEBUG] [LOCAL ] ALE: Primary data saved (31823 records). [2025-10-10T17:09:56.546696] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-10T17:09:56.546857] [INFO ] [MAIN ] Update Progress: 78/2373 symbols completed. ALE took 22.6s. Estimated remaining: 4h 50m 34s. Rate: 7.9 symbols/min [2025-10-10T17:09:57.168990] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T17:09:57.181375] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-10T17:09:58.430618] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T17:09:58.443195] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-10T17:09:59.269569] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-10T17:09:59.281387] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-10T17:10:00.333397] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-10T17:10:00.339551] [INFO ] [REMOTE ] ALC: Full fetch complete (73215 records). [2025-10-10T17:10:00.339817] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-10T17:10:00.772960] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-10T17:10:00.773073] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-10T17:10:00.774037] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-10T17:10:00.774107] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-10T17:10:00.776267] [DEBUG] [LOCAL ] ALC: Trimmed 73215 records to 51798 (keeping 200 days of data) [2025-10-10T17:10:01.124728] [DEBUG] [LOCAL ] ALC: Primary data saved (51798 records). [2025-10-10T17:10:01.125222] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-10T17:10:01.125371] [INFO ] [MAIN ] Update Progress: 79/2373 symbols completed. ALC took 28.7s. Estimated remaining: 4h 48m 58s. Rate: 7.9 symbols/min [2025-10-10T17:10:02.101992] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-10T17:10:02.115202] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-10T17:10:04.949360] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-10-10T17:10:04.960958] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-10T17:10:07.282231] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-10T17:10:07.294769] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-10T17:10:09.886440] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.59 seconds). [2025-10-10T17:10:09.891791] [INFO ] [REMOTE ] ALB: Full fetch complete (76893 records). [2025-10-10T17:10:09.892038] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-10T17:10:10.305690] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-10T17:10:10.305815] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-10T17:10:10.306737] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-10T17:10:10.306811] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-10T17:10:10.309066] [DEBUG] [LOCAL ] ALB: Trimmed 76893 records to 54068 (keeping 200 days of data) [2025-10-10T17:10:10.659270] [DEBUG] [LOCAL ] ALB: Primary data saved (54068 records). [2025-10-10T17:10:10.659461] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-10T17:10:10.660216] [INFO ] [MAIN ] Update Progress: 80/2373 symbols completed. ALB took 39.1s. Estimated remaining: 4h 49m 47s. Rate: 7.9 symbols/min [2025-10-10T17:10:11.347758] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:10:11.377340] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:10:11.375424] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-10T17:10:11.377968] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-10T17:10:11.358022] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:10:11.384216] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-10T17:10:11.407038] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-10T17:10:11.414447] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:10:11.414925] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-10T17:10:11.415103] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-10T17:10:11.611505] [DEBUG] [LOCAL ] ALG: Loaded 9904 existing records from primary storage. [2025-10-10T17:10:11.680113] [DEBUG] [LOCAL ] ALEX: Loaded 31426 existing records from primary storage. [2025-10-10T17:10:11.705194] [INFO ] [MAIN ] ALEX: Loaded 31426 existing records. [2025-10-10T17:10:11.704728] [INFO ] [MAIN ] ALG: Loaded 9904 existing records. [2025-10-10T17:10:11.754047] [DEBUG] [LOCAL ] ALIT: Loaded 53167 existing records from primary storage. [2025-10-10T17:10:11.867162] [INFO ] [MAIN ] ALIT: Loaded 53167 existing records. [2025-10-10T17:10:12.275755] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:10:12.317127] [INFO ] [REMOTE ] ALH: Fetching primary data for 2024-12. [2025-10-10T17:10:12.315396] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:10:12.384279] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-10T17:10:12.384140] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:10:12.409223] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-10T17:10:12.413401] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:10:12.413499] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-10T17:10:12.413684] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-10T17:10:12.413774] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-10T17:10:12.407433] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-10T17:10:12.414343] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-10T17:10:12.414501] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-10T17:10:12.425623] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-10T17:10:12.434821] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-10T17:10:12.425527] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-10T17:10:12.467292] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-10T17:10:12.631173] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:10:12.725902] [WARN ] [REMOTE ] ALH: No data returned for month 2024-12 [2025-10-10T17:10:12.791554] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:10:12.885702] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-10T17:10:12.970579] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:10:13.087343] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-10T17:10:13.168109] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-10T17:10:13.223241] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-10T17:10:13.267107] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-10T17:10:13.289507] [INFO ] [MAIN ] Update Progress: 81/2373 symbols completed. ALH took 2.6s. Estimated remaining: 4h 47m 20s. Rate: 8.0 symbols/min [2025-10-10T17:10:13.411844] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:10:13.427471] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-10T17:10:13.542360] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:10:13.538504] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:10:13.587851] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-10T17:10:13.577573] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-10T17:10:13.707486] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:10:13.756406] [DEBUG] [LOCAL ] ALK: Loaded 53447 existing records from primary storage. [2025-10-10T17:10:13.756824] [INFO ] [MAIN ] ALK: Loaded 53447 existing records. [2025-10-10T17:10:13.931681] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:10:13.931950] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-10T17:10:13.932000] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-10T17:10:13.932298] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-10T17:10:13.932355] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-10T17:10:14.281341] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:10:14.281715] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-10T17:10:14.859069] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T17:10:14.862011] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-10T17:10:14.906126] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T17:10:14.913154] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-10T17:10:15.520498] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-10T17:10:15.523623] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-10T17:10:15.615960] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-10T17:10:15.627054] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-10T17:10:15.896893] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T17:10:15.907852] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-10T17:10:16.350303] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T17:10:16.357730] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-10T17:10:16.549877] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-10T17:10:16.553019] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-10T17:10:17.179573] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-10T17:10:17.192769] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-10T17:10:17.282636] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-10T17:10:17.288264] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-10T17:10:17.441902] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-10T17:10:17.445539] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-10T17:10:18.473356] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-10T17:10:18.477040] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-10T17:10:18.564585] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-10T17:10:18.576262] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-10T17:10:18.795601] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-10T17:10:18.806251] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-10T17:10:18.874796] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-10T17:10:18.882890] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-10T17:10:19.009402] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-10T17:10:19.012205] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-10T17:10:19.703206] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-10T17:10:19.707601] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-10T17:10:20.365157] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-10T17:10:20.377150] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-10T17:10:20.427721] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-10T17:10:20.431358] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-10T17:10:20.476277] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T17:10:20.486856] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-10T17:10:20.572387] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T17:10:20.937990] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-10T17:10:21.089460] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-10T17:10:21.889457] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-10T17:10:21.964916] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-10T17:10:22.258988] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T17:10:22.605740] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-10T17:10:22.689405] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-10T17:10:22.735286] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-10T17:10:23.489422] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-10T17:10:23.645030] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-10T17:10:24.289456] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-10T17:10:25.089390] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-10T17:10:25.571008] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-10T17:10:25.604032] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-10T17:10:25.889393] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-10T17:10:26.166418] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T17:10:26.167920] [INFO ] [REMOTE ] ALG: Full fetch complete (15530 records). [2025-10-10T17:10:26.168001] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-10T17:10:26.571227] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-10T17:10:26.571315] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-10T17:10:26.571614] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-10T17:10:26.571686] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-10T17:10:26.572271] [DEBUG] [LOCAL ] ALG: Trimmed 15530 records to 9947 (keeping 200 days of data) [2025-10-10T17:10:26.639945] [DEBUG] [LOCAL ] ALG: Primary data saved (9947 records). [2025-10-10T17:10:26.640132] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-10T17:10:26.640235] [INFO ] [MAIN ] Update Progress: 82/2373 symbols completed. ALG took 16.0s. Estimated remaining: 4h 49m 55s. Rate: 7.9 symbols/min [2025-10-10T17:10:26.699422] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-10T17:10:26.830557] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:10:26.883523] [DEBUG] [LOCAL ] ALL: Loaded 50206 existing records from primary storage. [2025-10-10T17:10:26.883990] [INFO ] [MAIN ] ALL: Loaded 50206 existing records. [2025-10-10T17:10:27.078850] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:10:27.079118] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-10T17:10:27.079189] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-10T17:10:27.079631] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-10T17:10:27.079728] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-10T17:10:27.461916] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:10:27.489367] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-10T17:10:27.582927] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-10T17:10:28.289378] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-10T17:10:28.723478] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-10T17:10:28.873708] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-10T17:10:29.089401] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-10T17:10:29.780414] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T17:10:29.889405] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-10T17:10:30.561637] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-10T17:10:30.689379] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-10T17:10:31.489373] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-10T17:10:32.048571] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-10T17:10:32.111721] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-10T17:10:32.115614] [INFO ] [REMOTE ] ALEX: Full fetch complete (44644 records). [2025-10-10T17:10:32.115741] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-10T17:10:32.307996] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-10T17:10:32.506639] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-10T17:10:32.506764] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-10T17:10:32.507335] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-10T17:10:32.507376] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-10T17:10:32.508530] [DEBUG] [LOCAL ] ALEX: Trimmed 44644 records to 31679 (keeping 200 days of data) [2025-10-10T17:10:32.706547] [DEBUG] [LOCAL ] ALEX: Primary data saved (31679 records). [2025-10-10T17:10:32.706742] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-10T17:10:32.706839] [INFO ] [MAIN ] Update Progress: 83/2373 symbols completed. ALEX took 22.0s. Estimated remaining: 4h 49m 5s. Rate: 7.9 symbols/min [2025-10-10T17:10:32.887484] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:10:32.887860] [DEBUG] [LOCAL ] ALLE: No existing data file found in primary storage. [2025-10-10T17:10:32.887915] [WARN ] [MAIN ] ALLE: No existing data found, performing full refresh instead. [2025-10-10T17:10:32.888031] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-10T17:10:32.888076] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-10T17:10:32.888120] [DEBUG] [LOCAL ] ALLE: No primary data file found to delete. [2025-10-10T17:10:32.888161] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-10T17:10:33.106295] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-10T17:10:33.273069] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:10:33.300429] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T17:10:33.641377] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-10T17:10:33.889407] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-10T17:10:34.689421] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-10T17:10:35.226510] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-10T17:10:35.489413] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-10T17:10:36.003953] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-10T17:10:36.289368] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-10T17:10:36.339040] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-10T17:10:37.000134] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-10T17:10:37.089462] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-10T17:10:37.733677] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-10T17:10:37.889395] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-10T17:10:38.689364] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-10T17:10:39.273732] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-10T17:10:39.436478] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T17:10:39.489462] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-10T17:10:40.289413] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-10T17:10:40.487161] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T17:10:40.851118] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-10T17:10:41.089399] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-10T17:10:41.890106] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-10T17:10:41.896360] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-10T17:10:42.405036] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T17:10:42.410510] [INFO ] [REMOTE ] ALIT: Full fetch complete (76445 records). [2025-10-10T17:10:42.410706] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-10T17:10:42.697064] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-10T17:10:42.842519] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-10T17:10:42.842627] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-10T17:10:42.843478] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-10T17:10:42.843536] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-10T17:10:42.845614] [DEBUG] [LOCAL ] ALIT: Trimmed 76445 records to 53554 (keeping 200 days of data) [2025-10-10T17:10:43.174603] [DEBUG] [LOCAL ] ALIT: Primary data saved (53554 records). [2025-10-10T17:10:43.174850] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-10T17:10:43.175452] [INFO ] [MAIN ] Update Progress: 84/2373 symbols completed. ALIT took 32.5s. Estimated remaining: 4h 50m 17s. Rate: 7.9 symbols/min [2025-10-10T17:10:43.362695] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:10:43.435953] [DEBUG] [LOCAL ] ALLY: Loaded 53617 existing records from primary storage. [2025-10-10T17:10:43.436741] [INFO ] [MAIN ] ALLY: Loaded 53617 existing records. [2025-10-10T17:10:43.494537] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-10T17:10:43.629270] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:10:43.629751] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-10T17:10:43.629907] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-10T17:10:43.630425] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-10T17:10:43.630498] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-10T17:10:43.976165] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-10T17:10:44.070140] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:10:44.289382] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-10T17:10:44.458522] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T17:10:45.089365] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-10T17:10:45.493395] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T17:10:45.889401] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-10T17:10:46.260854] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T17:10:46.689369] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-10T17:10:46.763156] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-10T17:10:47.489351] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-10T17:10:47.827137] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T17:10:48.289384] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-10T17:10:48.468573] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T17:10:48.474197] [INFO ] [REMOTE ] ALK: Full fetch complete (76836 records). [2025-10-10T17:10:48.474394] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-10T17:10:48.900739] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-10T17:10:48.900929] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-10T17:10:48.902004] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-10T17:10:48.902128] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-10T17:10:48.904251] [DEBUG] [LOCAL ] ALK: Trimmed 76836 records to 53837 (keeping 200 days of data) [2025-10-10T17:10:49.103074] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-10T17:10:49.225213] [DEBUG] [LOCAL ] ALK: Primary data saved (53837 records). [2025-10-10T17:10:49.225411] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-10T17:10:49.225536] [INFO ] [MAIN ] Update Progress: 85/2373 symbols completed. ALK took 35.8s. Estimated remaining: 4h 49m 27s. Rate: 7.9 symbols/min [2025-10-10T17:10:49.421134] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:10:49.450620] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T17:10:49.499482] [DEBUG] [LOCAL ] ALSN: Loaded 43701 existing records from primary storage. [2025-10-10T17:10:49.499876] [INFO ] [MAIN ] ALSN: Loaded 43701 existing records. [2025-10-10T17:10:49.677752] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:10:49.678007] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-10T17:10:49.678056] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-10T17:10:49.678379] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-10T17:10:49.678436] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-10T17:10:49.907554] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-10T17:10:50.072771] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:10:50.468314] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-10T17:10:50.689403] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-10T17:10:51.055314] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T17:10:51.191756] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-10T17:10:51.489378] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-10T17:10:52.289429] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-10T17:10:52.541835] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T17:10:52.810688] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-10T17:10:53.089489] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-10T17:10:53.836290] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-10T17:10:53.889387] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-10T17:10:54.689442] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-10T17:10:54.794677] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T17:10:55.384498] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T17:10:55.489411] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-10T17:10:55.976526] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T17:10:56.289386] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-10T17:10:57.089427] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-10T17:10:57.670520] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-10T17:10:57.889364] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-10T17:10:58.120246] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T17:10:58.689382] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-10T17:10:58.952058] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T17:10:59.268254] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-10T17:10:59.489410] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-10T17:11:00.289388] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-10T17:11:00.561692] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T17:11:01.089400] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-10T17:11:01.889372] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-10T17:11:01.931701] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-10T17:11:02.257379] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T17:11:02.661334] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T17:11:02.689358] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-10T17:11:03.489423] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-10T17:11:03.750429] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T17:11:04.289380] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-10T17:11:05.089371] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-10T17:11:05.114780] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-10T17:11:05.119354] [INFO ] [REMOTE ] ALL: Full fetch complete (72284 records). [2025-10-10T17:11:05.119507] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-10T17:11:05.243562] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T17:11:05.299321] [INFO ] [REMOTE ] ALLE: Full fetch complete (64534 records). [2025-10-10T17:11:05.333974] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-10T17:11:05.763123] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-10T17:11:05.795916] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-10T17:11:05.797058] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-10T17:11:05.815705] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-10T17:11:05.890910] [DEBUG] [LOCAL ] ALL: Trimmed 72284 records to 50524 (keeping 200 days of data) [2025-10-10T17:11:05.975729] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-10T17:11:06.010225] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-10T17:11:06.065782] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-10T17:11:06.076878] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-10T17:11:06.104055] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-10T17:11:06.077588] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-10T17:11:06.133115] [DEBUG] [LOCAL ] ALLE: Trimmed 64534 records to 44999 (keeping 200 days of data) [2025-10-10T17:11:06.583695] [DEBUG] [LOCAL ] ALL: Primary data saved (50524 records). [2025-10-10T17:11:06.592974] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-10T17:11:06.593418] [INFO ] [MAIN ] Update Progress: 86/2373 symbols completed. ALL took 40.0s. Estimated remaining: 4h 53m 40s. Rate: 7.8 symbols/min [2025-10-10T17:11:06.851199] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:11:06.861620] [DEBUG] [LOCAL ] ALLE: Primary data saved (44999 records). [2025-10-10T17:11:06.861826] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-10T17:11:06.861916] [INFO ] [MAIN ] Update Progress: 87/2373 symbols completed. ALLE took 34.2s. Estimated remaining: 4h 50m 16s. Rate: 7.9 symbols/min [2025-10-10T17:11:07.042220] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:11:07.052923] [DEBUG] [LOCAL ] ALTG: Loaded 23737 existing records from primary storage. [2025-10-10T17:11:07.053221] [INFO ] [MAIN ] ALTG: Loaded 23737 existing records. [2025-10-10T17:11:07.162513] [DEBUG] [LOCAL ] ALUR: Loaded 10452 existing records from primary storage. [2025-10-10T17:11:07.166553] [INFO ] [MAIN ] ALUR: Loaded 10452 existing records. [2025-10-10T17:11:07.377555] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:11:07.411440] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-10T17:11:07.441152] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-10T17:11:07.456341] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-10T17:11:07.456719] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-10T17:11:07.466266] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-10T17:11:07.493464] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:11:07.535580] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-10T17:11:07.568560] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-10T17:11:07.590237] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-10T17:11:07.601316] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-10T17:11:07.605577] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-10T17:11:08.125957] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-10T17:11:08.173850] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:11:08.186491] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-10T17:11:08.267768] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:11:08.289326] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-10T17:11:09.089379] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-10T17:11:09.774035] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T17:11:09.889371] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-10T17:11:09.937298] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-10T17:11:09.976993] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-10T17:11:10.397492] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-10T17:11:10.689446] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-10T17:11:11.021137] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-10T17:11:11.489377] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-10T17:11:12.174710] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-10T17:11:12.289392] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-10T17:11:12.672726] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-10T17:11:13.089415] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-10T17:11:13.889466] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-10T17:11:14.268073] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T17:11:14.514689] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-10T17:11:14.689404] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-10T17:11:15.369585] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-10T17:11:15.489366] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-10T17:11:15.874301] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T17:11:16.289177] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-10T17:11:16.289349] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-10T17:11:17.089429] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-10T17:11:17.672318] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-10T17:11:17.889396] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-10T17:11:18.325970] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-10T17:11:18.330622] [INFO ] [REMOTE ] ALSN: Full fetch complete (62242 records). [2025-10-10T17:11:18.330806] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-10T17:11:18.694523] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-10T17:11:18.716371] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-10T17:11:18.716547] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-10T17:11:18.717346] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-10T17:11:18.728173] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-10T17:11:18.729350] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-10T17:11:18.734614] [DEBUG] [LOCAL ] ALSN: Trimmed 62242 records to 44031 (keeping 200 days of data) [2025-10-10T17:11:18.997445] [DEBUG] [LOCAL ] ALSN: Primary data saved (44031 records). [2025-10-10T17:11:18.997589] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-10T17:11:18.997689] [INFO ] [MAIN ] Update Progress: 88/2373 symbols completed. ALSN took 29.8s. Estimated remaining: 4h 52m 6s. Rate: 7.8 symbols/min [2025-10-10T17:11:19.165362] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:11:19.205248] [DEBUG] [LOCAL ] ALV: Loaded 42387 existing records from primary storage. [2025-10-10T17:11:19.205557] [INFO ] [MAIN ] ALV: Loaded 42387 existing records. [2025-10-10T17:11:19.378773] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:11:19.378942] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-10T17:11:19.378989] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-10T17:11:19.379272] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-10T17:11:19.379309] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-10T17:11:19.494588] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-10T17:11:19.729540] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:11:20.289353] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-10T17:11:20.366210] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T17:11:20.493464] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T17:11:21.089346] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-10T17:11:21.199696] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-10T17:11:21.889378] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-10T17:11:22.037458] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-10T17:11:22.689342] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-10T17:11:22.775477] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-10T17:11:23.489370] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-10T17:11:23.596403] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-10T17:11:24.289421] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-10T17:11:24.787860] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T17:11:25.089386] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-10T17:11:25.890889] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-10T17:11:25.897571] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-10T17:11:26.145810] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-10T17:11:26.689384] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-10T17:11:27.393788] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-10T17:11:27.489358] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-10T17:11:28.124012] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T17:11:28.132191] [INFO ] [REMOTE ] ALLY: Full fetch complete (76946 records). [2025-10-10T17:11:28.132353] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-10T17:11:28.290429] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-10T17:11:28.492062] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-10T17:11:28.544039] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-10T17:11:28.544379] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-10T17:11:28.545160] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-10T17:11:28.545223] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-10T17:11:28.546699] [DEBUG] [LOCAL ] ALLY: Trimmed 76946 records to 54004 (keeping 200 days of data) [2025-10-10T17:11:28.864555] [DEBUG] [LOCAL ] ALLY: Primary data saved (54004 records). [2025-10-10T17:11:28.864740] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-10T17:11:28.865516] [INFO ] [MAIN ] Update Progress: 89/2373 symbols completed. ALLY took 45.7s. Estimated remaining: 4h 52m 55s. Rate: 7.8 symbols/min [2025-10-10T17:11:28.997815] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-10T17:11:29.050153] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:11:29.059709] [DEBUG] [LOCAL ] ALX: Loaded 6663 existing records from primary storage. [2025-10-10T17:11:29.059950] [INFO ] [MAIN ] ALX: Loaded 6663 existing records. [2025-10-10T17:11:29.094520] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-10T17:11:29.236164] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:11:29.236406] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-10T17:11:29.236461] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-10T17:11:29.236719] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-10T17:11:29.236782] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-10T17:11:29.584439] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:11:29.889402] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-10T17:11:30.418426] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T17:11:30.421339] [INFO ] [REMOTE ] ALTG: Full fetch complete (33562 records). [2025-10-10T17:11:30.421408] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-10T17:11:30.539904] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-10T17:11:30.694590] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-10T17:11:30.791245] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-10T17:11:30.791322] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-10T17:11:30.791740] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-10T17:11:30.791803] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-10T17:11:30.792500] [DEBUG] [LOCAL ] ALTG: Trimmed 33562 records to 23947 (keeping 200 days of data) [2025-10-10T17:11:30.919945] [DEBUG] [LOCAL ] ALTG: Primary data saved (23947 records). [2025-10-10T17:11:30.920083] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-10T17:11:30.920161] [INFO ] [MAIN ] Update Progress: 90/2373 symbols completed. ALTG took 24.3s. Estimated remaining: 4h 50m 24s. Rate: 7.9 symbols/min [2025-10-10T17:11:31.083033] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:11:31.134847] [DEBUG] [LOCAL ] AM: Loaded 52383 existing records from primary storage. [2025-10-10T17:11:31.135200] [INFO ] [MAIN ] AM: Loaded 52383 existing records. [2025-10-10T17:11:31.331327] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:11:31.331615] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-10T17:11:31.331709] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-10T17:11:31.332375] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-10T17:11:31.332433] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-10T17:11:31.493738] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-10T17:11:31.609841] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T17:11:31.636775] [INFO ] [REMOTE ] ALUR: Full fetch complete (19836 records). [2025-10-10T17:11:31.647855] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-10T17:11:31.796337] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:11:32.069431] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-10T17:11:32.069514] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-10T17:11:32.069786] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-10T17:11:32.069846] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-10T17:11:32.070334] [DEBUG] [LOCAL ] ALUR: Trimmed 19836 records to 10535 (keeping 200 days of data) [2025-10-10T17:11:32.126502] [DEBUG] [LOCAL ] ALUR: Primary data saved (10535 records). [2025-10-10T17:11:32.126638] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-10T17:11:32.126755] [INFO ] [MAIN ] Update Progress: 91/2373 symbols completed. ALUR took 25.3s. Estimated remaining: 4h 47m 35s. Rate: 7.9 symbols/min [2025-10-10T17:11:32.290230] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-10T17:11:32.290160] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:11:32.325896] [DEBUG] [LOCAL ] AMBC: Loaded 36609 existing records from primary storage. [2025-10-10T17:11:32.328803] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-10T17:11:32.329010] [INFO ] [MAIN ] AMBC: Loaded 36609 existing records. [2025-10-10T17:11:32.508628] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:11:32.508934] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-10T17:11:32.508986] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-10T17:11:32.509327] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-10T17:11:32.509367] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-10T17:11:32.867505] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:11:33.089378] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-10T17:11:33.455198] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-10T17:11:33.507447] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-10T17:11:33.889396] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-10T17:11:34.689396] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-10T17:11:34.914032] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T17:11:35.489416] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-10T17:11:36.018434] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T17:11:36.289419] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-10T17:11:37.089402] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-10T17:11:37.430915] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T17:11:37.889383] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-10T17:11:38.011352] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-10T17:11:38.327341] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T17:11:38.689404] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-10T17:11:39.489407] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-10T17:11:39.676404] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T17:11:40.014635] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-10T17:11:40.108615] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-10T17:11:40.289346] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-10T17:11:41.089420] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-10T17:11:41.685125] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-10T17:11:41.889370] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-10T17:11:42.517122] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-10T17:11:42.689416] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-10T17:11:43.489400] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-10T17:11:43.807327] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T17:11:44.289410] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-10T17:11:44.393896] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-10T17:11:45.021443] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-10T17:11:45.089330] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-10T17:11:45.219352] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T17:11:45.889393] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-10T17:11:46.540075] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-10T17:11:46.689371] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-10T17:11:47.489350] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-10T17:11:47.603121] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T17:11:48.182391] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-10T17:11:48.289352] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-10T17:11:49.089377] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-10T17:11:49.377068] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T17:11:49.637445] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-10T17:11:49.662700] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-10T17:11:49.889413] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-10T17:11:50.689429] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-10T17:11:51.457819] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-10T17:11:51.489374] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-10T17:11:51.852505] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T17:11:52.289380] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-10T17:11:52.485514] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-10T17:11:53.089395] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-10T17:11:53.622996] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-10T17:11:53.869021] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-10T17:11:53.889334] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-10T17:11:54.689379] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-10T17:11:55.368187] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-10T17:11:55.489395] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-10T17:11:55.641631] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-10T17:11:56.289369] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-10T17:11:56.701236] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-10T17:11:57.089386] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-10T17:11:57.889349] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-10T17:11:57.971693] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-10T17:11:58.100111] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-10T17:11:58.689431] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-10T17:11:59.042167] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-10T17:11:59.489349] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-10T17:11:59.636961] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T17:11:59.638521] [INFO ] [REMOTE ] ALX: Full fetch complete (7581 records). [2025-10-10T17:11:59.638595] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-10T17:11:59.999867] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-10T17:11:59.999955] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-10T17:12:00.000177] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-10T17:12:00.000218] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-10T17:12:00.000610] [DEBUG] [LOCAL ] ALX: Trimmed 7581 records to 6768 (keeping 200 days of data) [2025-10-10T17:12:00.043078] [DEBUG] [LOCAL ] ALX: Primary data saved (6768 records). [2025-10-10T17:12:00.043262] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-10T17:12:00.043362] [INFO ] [MAIN ] Update Progress: 92/2373 symbols completed. ALX took 31.2s. Estimated remaining: 4h 55m 52s. Rate: 7.7 symbols/min [2025-10-10T17:12:00.219696] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:12:00.265385] [DEBUG] [LOCAL ] AMBP: Loaded 44975 existing records from primary storage. [2025-10-10T17:12:00.265770] [INFO ] [MAIN ] AMBP: Loaded 44975 existing records. [2025-10-10T17:12:00.297070] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-10T17:12:00.456470] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:12:00.456831] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-10T17:12:00.456890] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-10T17:12:00.457344] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-10T17:12:00.457425] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-10T17:12:00.869029] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:12:01.100127] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-10T17:12:01.106228] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T17:12:01.889393] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-10T17:12:02.026710] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T17:12:02.582308] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T17:12:02.689418] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-10T17:12:03.489357] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-10T17:12:03.809154] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T17:12:04.289460] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-10T17:12:04.458390] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T17:12:04.928763] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T17:12:04.932827] [INFO ] [REMOTE ] AMBC: Full fetch complete (51563 records). [2025-10-10T17:12:04.932996] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-10T17:12:05.089372] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-10T17:12:05.335766] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-10T17:12:05.335871] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-10T17:12:05.336630] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-10T17:12:05.336717] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-10T17:12:05.338314] [DEBUG] [LOCAL ] AMBC: Trimmed 51563 records to 36913 (keeping 200 days of data) [2025-10-10T17:12:05.560434] [DEBUG] [LOCAL ] AMBC: Primary data saved (36913 records). [2025-10-10T17:12:05.560808] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-10T17:12:05.561333] [INFO ] [MAIN ] Update Progress: 93/2373 symbols completed. AMBC took 33.4s. Estimated remaining: 4h 54m 49s. Rate: 7.7 symbols/min [2025-10-10T17:12:05.608369] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T17:12:05.660328] [INFO ] [REMOTE ] ALV: Full fetch complete (61755 records). [2025-10-10T17:12:05.688518] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-10T17:12:05.885935] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:12:05.891273] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-10T17:12:05.921380] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-10T17:12:05.963669] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-10T17:12:06.045968] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-10T17:12:06.051620] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-10T17:12:06.072753] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-10T17:12:06.083391] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-10T17:12:06.292815] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-10T17:12:06.303196] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-10T17:12:06.314508] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-10T17:12:06.328166] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-10T17:12:06.460230] [DEBUG] [LOCAL ] ALV: Trimmed 61755 records to 42734 (keeping 200 days of data) [2025-10-10T17:12:06.665962] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:12:06.705378] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-10T17:12:06.716849] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T17:12:06.883562] [DEBUG] [LOCAL ] ALV: Primary data saved (42734 records). [2025-10-10T17:12:06.883776] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-10T17:12:06.883911] [INFO ] [MAIN ] Update Progress: 94/2373 symbols completed. ALV took 47.9s. Estimated remaining: 4h 52m 5s. Rate: 7.8 symbols/min [2025-10-10T17:12:07.026168] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:12:07.059992] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:12:07.060114] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-10T17:12:07.060357] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:12:07.060702] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-10T17:12:07.060948] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:12:07.061024] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-10T17:12:07.061113] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-10T17:12:07.061151] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-10T17:12:07.061190] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-10T17:12:07.061241] [INFO ] [MAIN ] Update Progress: 95/2373 symbols completed. AMBQ took 1.5s. Estimated remaining: 4h 48m 57s. Rate: 7.9 symbols/min [2025-10-10T17:12:07.230996] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:12:07.269571] [DEBUG] [LOCAL ] AMC: Loaded 54151 existing records from primary storage. [2025-10-10T17:12:07.270283] [INFO ] [MAIN ] AMC: Loaded 54151 existing records. [2025-10-10T17:12:07.466599] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:12:07.467338] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-10T17:12:07.467534] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-10T17:12:07.485102] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-10T17:12:07.486808] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-10T17:12:07.492100] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-10T17:12:07.525153] [DEBUG] [LOCAL ] AMCR: Loaded 54059 existing records from primary storage. [2025-10-10T17:12:07.559066] [INFO ] [MAIN ] AMCR: Loaded 54059 existing records. [2025-10-10T17:12:07.922916] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:12:07.956108] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-10T17:12:07.971873] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-10T17:12:07.985840] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-10T17:12:08.009544] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-10T17:12:08.009620] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-10T17:12:08.216570] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:12:08.295515] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-10T17:12:08.449373] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:12:08.925529] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T17:12:08.930369] [INFO ] [REMOTE ] AM: Full fetch complete (75560 records). [2025-10-10T17:12:08.930496] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-10T17:12:09.093363] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-10T17:12:09.320228] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-10T17:12:09.320329] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-10T17:12:09.321091] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-10T17:12:09.321168] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-10T17:12:09.322794] [DEBUG] [LOCAL ] AM: Trimmed 75560 records to 52754 (keeping 200 days of data) [2025-10-10T17:12:09.635960] [DEBUG] [LOCAL ] AM: Primary data saved (52754 records). [2025-10-10T17:12:09.636132] [INFO ] [MAIN ] AM: Full history saved. [2025-10-10T17:12:09.636235] [INFO ] [MAIN ] Update Progress: 96/2373 symbols completed. AM took 38.7s. Estimated remaining: 4h 46m 50s. Rate: 7.9 symbols/min [2025-10-10T17:12:09.807245] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:12:09.853566] [DEBUG] [LOCAL ] AME: Loaded 49074 existing records from primary storage. [2025-10-10T17:12:09.853970] [INFO ] [MAIN ] AME: Loaded 49074 existing records. [2025-10-10T17:12:09.896545] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-10T17:12:10.065453] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:12:10.065794] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-10T17:12:10.065853] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-10T17:12:10.066334] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-10T17:12:10.066393] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-10T17:12:10.414256] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:12:10.689350] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-10T17:12:11.186245] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T17:12:11.262870] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.97 seconds). [2025-10-10T17:12:11.261874] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T17:12:11.489423] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-10T17:12:12.289360] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-10T17:12:12.781130] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-10T17:12:13.089411] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-10T17:12:13.889423] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-10T17:12:14.035323] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-10T17:12:14.151207] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T17:12:14.689375] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-10T17:12:14.965156] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-10T17:12:15.489368] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-10T17:12:15.799735] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T17:12:16.289388] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-10T17:12:16.677236] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-10T17:12:17.089390] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-10T17:12:17.284782] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T17:12:17.889375] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-10T17:12:18.168804] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T17:12:18.689431] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-10T17:12:19.383257] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-10T17:12:19.489426] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-10T17:12:19.760589] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-10T17:12:20.050199] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-10T17:12:20.289400] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-10T17:12:21.089411] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-10T17:12:21.889410] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-10T17:12:22.133783] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-10T17:12:22.293938] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T17:12:22.689377] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-10T17:12:22.828179] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T17:12:23.424727] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-10T17:12:23.489344] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-10T17:12:24.289395] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-10T17:12:25.089385] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-10T17:12:25.258460] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-10T17:12:25.539313] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-10T17:12:25.694383] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-10T17:12:25.889374] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-10T17:12:26.689366] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-10T17:12:27.091963] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T17:12:27.489400] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-10T17:12:27.793028] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T17:12:28.166082] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-10T17:12:28.289348] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-10T17:12:28.728035] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-10T17:12:29.089372] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-10T17:12:29.889427] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-10T17:12:30.229318] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T17:12:30.689415] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-10T17:12:31.287010] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-10T17:12:31.489452] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-10T17:12:31.701798] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-10T17:12:32.289443] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-10T17:12:32.737469] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-10T17:12:33.089415] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-10T17:12:33.732091] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-10T17:12:33.786931] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-10T17:12:33.889439] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-10T17:12:34.689421] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-10T17:12:34.925446] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-10T17:12:35.489405] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-10T17:12:35.996113] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-10T17:12:36.289369] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-10T17:12:37.048980] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-10T17:12:37.089348] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-10T17:12:37.443052] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-10T17:12:37.707105] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-10T17:12:37.889402] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-10T17:12:38.689398] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-10T17:12:39.270818] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-10T17:12:39.276179] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-10-10T17:12:39.276374] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-10T17:12:39.492688] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-10T17:12:39.513039] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-10T17:12:39.545843] [INFO ] [REMOTE ] AMBP: Full fetch complete (65309 records). [2025-10-10T17:12:39.568954] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-10T17:12:39.899950] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-10T17:12:39.917539] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-10T17:12:39.996593] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-10T17:12:40.007981] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-10T17:12:40.072114] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 54541 (keeping 200 days of data) [2025-10-10T17:12:40.214222] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-10T17:12:40.218471] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-10T17:12:40.227014] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-10T17:12:40.228101] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-10T17:12:40.243020] [DEBUG] [LOCAL ] AMBP: Trimmed 65309 records to 45241 (keeping 200 days of data) [2025-10-10T17:12:40.694418] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T17:12:40.721594] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-10T17:12:40.732804] [DEBUG] [LOCAL ] AMC: Primary data saved (54541 records). [2025-10-10T17:12:40.737682] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-10T17:12:40.737870] [INFO ] [MAIN ] Update Progress: 97/2373 symbols completed. AMC took 33.9s. Estimated remaining: 4h 55m 55s. Rate: 7.7 symbols/min [2025-10-10T17:12:40.947918] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:12:40.948010] [DEBUG] [LOCAL ] AMBP: Primary data saved (45241 records). [2025-10-10T17:12:40.948709] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-10T17:12:40.948831] [INFO ] [MAIN ] Update Progress: 98/2373 symbols completed. AMBP took 40.9s. Estimated remaining: 4h 52m 51s. Rate: 7.8 symbols/min [2025-10-10T17:12:41.130988] [DEBUG] [LOCAL ] AMG: Loaded 20269 existing records from primary storage. [2025-10-10T17:12:41.150094] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:12:41.150528] [INFO ] [MAIN ] AMG: Loaded 20269 existing records. [2025-10-10T17:12:41.334518] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:12:41.334931] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-10T17:12:41.334979] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-10T17:12:41.335437] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-10T17:12:41.335495] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-10T17:12:41.570421] [DEBUG] [LOCAL ] AMH: Loaded 52145 existing records from primary storage. [2025-10-10T17:12:41.600224] [INFO ] [MAIN ] AMH: Loaded 52145 existing records. [2025-10-10T17:12:41.927467] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:12:41.941358] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-10T17:12:41.967312] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:12:41.968318] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-10T17:12:41.980872] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-10T17:12:41.999161] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-10T17:12:41.999282] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-10T17:12:42.000274] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-10T17:12:42.085554] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-10T17:12:42.409971] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:12:42.498028] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T17:12:42.502864] [INFO ] [REMOTE ] AME: Full fetch complete (69881 records). [2025-10-10T17:12:42.502993] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-10T17:12:42.703720] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-10T17:12:42.926371] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-10T17:12:42.926462] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-10T17:12:42.927207] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-10T17:12:42.927271] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-10T17:12:42.928759] [DEBUG] [LOCAL ] AME: Trimmed 69881 records to 49435 (keeping 200 days of data) [2025-10-10T17:12:43.254127] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-10T17:12:43.291426] [DEBUG] [LOCAL ] AME: Primary data saved (49435 records). [2025-10-10T17:12:43.291617] [INFO ] [MAIN ] AME: Full history saved. [2025-10-10T17:12:43.291763] [INFO ] [MAIN ] Update Progress: 99/2373 symbols completed. AME took 33.7s. Estimated remaining: 4h 50m 40s. Rate: 7.8 symbols/min [2025-10-10T17:12:43.470921] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:12:43.499789] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-10T17:12:43.520012] [DEBUG] [LOCAL ] AMN: Loaded 42026 existing records from primary storage. [2025-10-10T17:12:43.520396] [INFO ] [MAIN ] AMN: Loaded 42026 existing records. [2025-10-10T17:12:43.762150] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:12:43.762614] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-10T17:12:43.762723] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-10T17:12:43.763099] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-10T17:12:43.763157] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-10T17:12:44.145148] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:12:44.189030] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-10T17:12:44.195893] [INFO ] [REMOTE ] AMCR: Full fetch complete (77680 records). [2025-10-10T17:12:44.196119] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-10T17:12:44.294578] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-10T17:12:44.620305] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-10T17:12:44.620492] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-10T17:12:44.621388] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-10T17:12:44.621465] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-10T17:12:44.623277] [DEBUG] [LOCAL ] AMCR: Trimmed 77680 records to 54449 (keeping 200 days of data) [2025-10-10T17:12:44.852919] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-10T17:12:44.912289] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-10T17:12:45.033531] [DEBUG] [LOCAL ] AMCR: Primary data saved (54449 records). [2025-10-10T17:12:45.033747] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-10T17:12:45.034253] [INFO ] [MAIN ] Update Progress: 100/2373 symbols completed. AMCR took 38.0s. Estimated remaining: 4h 48m 18s. Rate: 7.9 symbols/min [2025-10-10T17:12:45.097132] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-10T17:12:45.207747] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:12:45.247713] [DEBUG] [LOCAL ] AMP: Loaded 32147 existing records from primary storage. [2025-10-10T17:12:45.248036] [INFO ] [MAIN ] AMP: Loaded 32147 existing records. [2025-10-10T17:12:45.425198] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:12:45.425429] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-10T17:12:45.425477] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-10T17:12:45.425974] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-10T17:12:45.426048] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-10T17:12:45.781909] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:12:45.890053] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-10T17:12:45.893525] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T17:12:46.689358] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-10T17:12:47.000912] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T17:12:47.040367] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T17:12:47.489371] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-10T17:12:47.957124] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-10T17:12:48.289424] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-10T17:12:48.408699] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-10T17:12:49.089362] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-10T17:12:49.889406] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-10T17:12:50.153108] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T17:12:50.689433] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-10T17:12:50.756370] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T17:12:50.967474] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T17:12:51.489374] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-10T17:12:52.254801] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T17:12:52.289351] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-10T17:12:52.526207] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-10T17:12:53.089402] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-10T17:12:53.889408] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-10T17:12:54.136440] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-10T17:12:54.555095] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-10T17:12:54.689367] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-10T17:12:55.140601] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T17:12:55.489391] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-10T17:12:55.591462] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-10T17:12:56.289419] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-10T17:12:57.089434] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-10T17:12:57.368871] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T17:12:57.889388] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-10T17:12:58.255858] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T17:12:58.689390] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-10T17:12:59.014439] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-10T17:12:59.409911] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-10T17:12:59.489356] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-10T17:12:59.645044] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T17:13:00.289388] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-10T17:13:01.089345] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-10T17:13:01.219824] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T17:13:01.889356] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-10T17:13:01.979826] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-10T17:13:02.039925] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T17:13:02.689394] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-10T17:13:03.446229] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-10T17:13:03.489398] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-10T17:13:03.633430] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-10T17:13:04.289403] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-10T17:13:05.090228] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-10T17:13:05.094571] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-10T17:13:05.889388] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-10T17:13:06.120570] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T17:13:06.541620] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-10T17:13:06.689396] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-10T17:13:07.298968] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-10T17:13:07.489379] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-10T17:13:08.289379] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-10T17:13:08.378694] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T17:13:09.089370] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-10T17:13:09.348908] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T17:13:09.889387] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-10T17:13:10.227596] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T17:13:10.229604] [INFO ] [REMOTE ] AMG: Full fetch complete (29612 records). [2025-10-10T17:13:10.229701] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-10T17:13:10.546185] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-10T17:13:10.640332] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-10T17:13:10.640415] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-10T17:13:10.640812] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-10T17:13:10.640907] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-10T17:13:10.641605] [DEBUG] [LOCAL ] AMG: Trimmed 29612 records to 20399 (keeping 200 days of data) [2025-10-10T17:13:10.694346] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-10T17:13:10.773614] [DEBUG] [LOCAL ] AMG: Primary data saved (20399 records). [2025-10-10T17:13:10.773776] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-10T17:13:10.774731] [INFO ] [MAIN ] Update Progress: 101/2373 symbols completed. AMG took 30.0s. Estimated remaining: 4h 54m 58s. Rate: 7.7 symbols/min [2025-10-10T17:13:10.942519] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:13:10.993102] [DEBUG] [LOCAL ] AMPX: Loaded 52708 existing records from primary storage. [2025-10-10T17:13:10.993433] [INFO ] [MAIN ] AMPX: Loaded 52708 existing records. [2025-10-10T17:13:11.174865] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:13:11.175218] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-10T17:13:11.175395] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-10T17:13:11.184194] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-10T17:13:11.197475] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-10T17:13:11.244111] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T17:13:11.494575] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-10T17:13:11.568171] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:13:12.289407] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-10T17:13:12.625037] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T17:13:13.089366] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-10T17:13:13.264927] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-10T17:13:13.269148] [INFO ] [REMOTE ] AMN: Full fetch complete (60264 records). [2025-10-10T17:13:13.269282] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-10T17:13:13.669903] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-10T17:13:13.670027] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-10T17:13:13.670743] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-10T17:13:13.670893] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-10T17:13:13.672318] [DEBUG] [LOCAL ] AMN: Trimmed 60264 records to 42328 (keeping 200 days of data) [2025-10-10T17:13:13.795166] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T17:13:13.906468] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-10T17:13:13.953737] [DEBUG] [LOCAL ] AMN: Primary data saved (42328 records). [2025-10-10T17:13:13.953887] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-10T17:13:13.953970] [INFO ] [MAIN ] Update Progress: 102/2373 symbols completed. AMN took 30.7s. Estimated remaining: 4h 53m 7s. Rate: 7.7 symbols/min [2025-10-10T17:13:14.137393] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:13:14.177511] [DEBUG] [LOCAL ] AMPY: Loaded 38919 existing records from primary storage. [2025-10-10T17:13:14.177923] [INFO ] [MAIN ] AMPY: Loaded 38919 existing records. [2025-10-10T17:13:14.428623] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T17:13:14.471507] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:13:14.471849] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-10T17:13:14.472707] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-10T17:13:14.473243] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-10T17:13:14.473333] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-10T17:13:14.697268] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-10T17:13:15.008781] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:13:15.291589] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-10T17:13:15.489392] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-10T17:13:16.289412] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-10T17:13:16.324278] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T17:13:16.851905] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T17:13:17.089372] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-10T17:13:17.889368] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-10T17:13:18.144815] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T17:13:18.390751] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T17:13:18.689401] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-10T17:13:18.914244] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T17:13:18.917690] [INFO ] [REMOTE ] AMP: Full fetch complete (47349 records). [2025-10-10T17:13:18.917816] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-10T17:13:19.318952] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-10T17:13:19.319060] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-10T17:13:19.319727] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-10T17:13:19.319795] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-10T17:13:19.321242] [DEBUG] [LOCAL ] AMP: Trimmed 47349 records to 32366 (keeping 200 days of data) [2025-10-10T17:13:19.491128] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-10T17:13:19.540845] [DEBUG] [LOCAL ] AMP: Primary data saved (32366 records). [2025-10-10T17:13:19.541012] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-10T17:13:19.541116] [INFO ] [MAIN ] Update Progress: 103/2373 symbols completed. AMP took 34.5s. Estimated remaining: 4h 52m 12s. Rate: 7.8 symbols/min [2025-10-10T17:13:19.725699] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:13:19.761118] [DEBUG] [LOCAL ] AMR: Loaded 29174 existing records from primary storage. [2025-10-10T17:13:19.761467] [INFO ] [MAIN ] AMR: Loaded 29174 existing records. [2025-10-10T17:13:19.957576] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:13:19.957899] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-10T17:13:19.957953] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-10T17:13:19.958561] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-10T17:13:19.958623] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-10T17:13:20.294608] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-10T17:13:20.313810] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-10T17:13:20.361677] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:13:20.371117] [INFO ] [REMOTE ] AMH: Full fetch complete (74816 records). [2025-10-10T17:13:20.371418] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-10T17:13:20.813662] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-10T17:13:20.813778] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-10T17:13:20.814745] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-10T17:13:20.814811] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-10T17:13:20.816348] [DEBUG] [LOCAL ] AMH: Trimmed 74816 records to 52533 (keeping 200 days of data) [2025-10-10T17:13:21.117844] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-10T17:13:21.197379] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T17:13:21.199397] [DEBUG] [LOCAL ] AMH: Primary data saved (52533 records). [2025-10-10T17:13:21.210298] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-10T17:13:21.211489] [INFO ] [MAIN ] Update Progress: 104/2373 symbols completed. AMH took 40.3s. Estimated remaining: 4h 49m 52s. Rate: 7.8 symbols/min [2025-10-10T17:13:21.386843] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:13:21.427847] [DEBUG] [LOCAL ] AMRC: Loaded 38412 existing records from primary storage. [2025-10-10T17:13:21.428222] [INFO ] [MAIN ] AMRC: Loaded 38412 existing records. [2025-10-10T17:13:21.619535] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:13:21.619874] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-10T17:13:21.619926] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-10T17:13:21.620383] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-10T17:13:21.620448] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-10T17:13:21.812598] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-10T17:13:21.898397] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-10T17:13:22.023059] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:13:22.572687] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-10T17:13:22.689377] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-10T17:13:23.489412] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-10T17:13:23.820094] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T17:13:23.850876] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-10T17:13:24.289389] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-10T17:13:24.496069] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-10T17:13:25.089415] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-10T17:13:25.889396] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-10T17:13:26.443674] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T17:13:26.531048] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T17:13:26.689458] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-10T17:13:27.489407] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-10T17:13:27.547218] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-10T17:13:27.662033] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T17:13:28.289407] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-10T17:13:29.089446] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-10T17:13:29.584989] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T17:13:29.668961] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T17:13:29.889400] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-10T17:13:30.689375] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-10T17:13:30.737996] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-10T17:13:31.489391] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-10T17:13:31.917720] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-10T17:13:32.136744] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-10T17:13:32.289403] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-10T17:13:33.089422] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-10T17:13:33.250797] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T17:13:33.792908] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-10T17:13:33.889342] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-10T17:13:34.443360] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T17:13:34.689415] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-10T17:13:35.489481] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-10T17:13:36.207384] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-10T17:13:36.289362] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-10T17:13:36.445795] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-10T17:13:37.089387] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-10T17:13:37.235373] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-10T17:13:37.495539] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-10T17:13:37.889420] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-10T17:13:38.023851] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-10T17:13:38.689431] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-10T17:13:39.472278] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-10T17:13:39.489325] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-10T17:13:40.256075] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-10T17:13:40.289332] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-10T17:13:40.609828] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T17:13:41.089403] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-10T17:13:41.699216] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-10T17:13:41.889413] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-10T17:13:42.689384] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-10T17:13:43.387992] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-10T17:13:43.489416] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-10T17:13:43.670131] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-10-10T17:13:44.181323] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T17:13:44.289479] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-10T17:13:44.761710] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-10T17:13:44.768607] [INFO ] [REMOTE ] AMPY: Full fetch complete (52338 records). [2025-10-10T17:13:44.768979] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-10T17:13:45.094566] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-10T17:13:45.162669] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-10T17:13:45.162777] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-10T17:13:45.163368] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-10T17:13:45.163409] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-10T17:13:45.164599] [DEBUG] [LOCAL ] AMPY: Trimmed 52338 records to 39277 (keeping 200 days of data) [2025-10-10T17:13:45.382288] [DEBUG] [LOCAL ] AMPY: Primary data saved (39277 records). [2025-10-10T17:13:45.382450] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-10T17:13:45.382537] [INFO ] [MAIN ] Update Progress: 105/2373 symbols completed. AMPY took 31.4s. Estimated remaining: 4h 55m 41s. Rate: 7.7 symbols/min [2025-10-10T17:13:45.549758] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:13:45.549946] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-10T17:13:45.549984] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-10T17:13:45.550096] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-10T17:13:45.550136] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-10T17:13:45.550175] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-10T17:13:45.550206] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-10T17:13:45.898257] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-10T17:13:45.903227] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:13:46.655573] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-10T17:13:46.689333] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-10T17:13:46.948779] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-10T17:13:47.249974] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T17:13:47.489444] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-10T17:13:48.289440] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-10T17:13:49.084447] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-10T17:13:49.093240] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-10T17:13:49.116455] [INFO ] [REMOTE ] AMPX: Full fetch complete (75028 records). [2025-10-10T17:13:49.116716] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-10T17:13:49.119838] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-10T17:13:49.322739] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:13:49.328371] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-10T17:13:49.369276] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:13:49.395585] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-10T17:13:49.412927] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:13:49.431084] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-10T17:13:49.431317] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-10T17:13:49.431494] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-10T17:13:49.442366] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-10T17:13:49.442559] [INFO ] [MAIN ] Update Progress: 106/2373 symbols completed. AMRZ took 4.1s. Estimated remaining: 4h 54m 13s. Rate: 7.7 symbols/min [2025-10-10T17:13:49.632336] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-10T17:13:49.643155] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-10T17:13:49.644502] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-10T17:13:49.671136] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-10T17:13:49.715632] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:13:49.739494] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-10T17:13:49.748303] [DEBUG] [LOCAL ] AMPX: Trimmed 75028 records to 53098 (keeping 200 days of data) [2025-10-10T17:13:49.889469] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-10T17:13:49.890797] [DEBUG] [LOCAL ] AMT: Loaded 52828 existing records from primary storage. [2025-10-10T17:13:49.894901] [INFO ] [MAIN ] AMT: Loaded 52828 existing records. [2025-10-10T17:13:50.168456] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:13:50.171555] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-10T17:13:50.171951] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-10T17:13:50.172320] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-10T17:13:50.172671] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-10T17:13:50.666959] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:13:50.675566] [DEBUG] [LOCAL ] AMPX: Primary data saved (53098 records). [2025-10-10T17:13:50.675784] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-10T17:13:50.676572] [INFO ] [MAIN ] Update Progress: 107/2373 symbols completed. AMPX took 39.9s. Estimated remaining: 4h 51m 46s. Rate: 7.8 symbols/min [2025-10-10T17:13:50.697744] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-10T17:13:50.882222] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:13:50.905764] [DEBUG] [LOCAL ] AMTB: Loaded 20610 existing records from primary storage. [2025-10-10T17:13:50.906349] [INFO ] [MAIN ] AMTB: Loaded 20610 existing records. [2025-10-10T17:13:51.090608] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:13:51.090888] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-10T17:13:51.090938] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-10T17:13:51.091203] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-10T17:13:51.091260] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-10T17:13:51.444971] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:13:51.489330] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-10T17:13:51.621540] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T17:13:51.709101] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-10T17:13:52.289398] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-10T17:13:52.877090] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T17:13:53.089426] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-10T17:13:53.622812] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T17:13:53.626520] [INFO ] [REMOTE ] AMR: Full fetch complete (40363 records). [2025-10-10T17:13:53.626735] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-10T17:13:53.899947] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-10T17:13:54.038148] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-10T17:13:54.038245] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-10T17:13:54.038804] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-10T17:13:54.038870] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-10T17:13:54.040150] [DEBUG] [LOCAL ] AMR: Trimmed 40363 records to 29346 (keeping 200 days of data) [2025-10-10T17:13:54.222894] [DEBUG] [LOCAL ] AMR: Primary data saved (29346 records). [2025-10-10T17:13:54.223075] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-10T17:13:54.223185] [INFO ] [MAIN ] Update Progress: 108/2373 symbols completed. AMR took 34.7s. Estimated remaining: 4h 50m 11s. Rate: 7.8 symbols/min [2025-10-10T17:13:54.366439] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T17:13:54.429234] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:13:54.436477] [DEBUG] [LOCAL ] AMTD: Loaded 3770 existing records from primary storage. [2025-10-10T17:13:54.436724] [INFO ] [MAIN ] AMTD: Loaded 3770 existing records. [2025-10-10T17:13:54.627298] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:13:54.627574] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-10T17:13:54.627627] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-10T17:13:54.627906] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-10T17:13:54.627966] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-10T17:13:54.694963] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-10T17:13:55.009237] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:13:55.186353] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-10T17:13:55.190435] [INFO ] [REMOTE ] AMRC: Full fetch complete (53727 records). [2025-10-10T17:13:55.190577] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-10T17:13:55.494471] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-10T17:13:55.575520] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-10T17:13:55.575702] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-10T17:13:55.576378] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-10T17:13:55.576444] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-10T17:13:55.577804] [DEBUG] [LOCAL ] AMRC: Trimmed 53727 records to 38710 (keeping 200 days of data) [2025-10-10T17:13:55.809790] [DEBUG] [LOCAL ] AMRC: Primary data saved (38710 records). [2025-10-10T17:13:55.809950] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-10T17:13:55.810041] [INFO ] [MAIN ] Update Progress: 109/2373 symbols completed. AMRC took 34.6s. Estimated remaining: 4h 47m 57s. Rate: 7.9 symbols/min [2025-10-10T17:13:55.992250] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T17:13:55.995260] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:13:56.049080] [DEBUG] [LOCAL ] AMTM: Loaded 51005 existing records from primary storage. [2025-10-10T17:13:56.049432] [INFO ] [MAIN ] AMTM: Loaded 51005 existing records. [2025-10-10T17:13:56.234353] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:13:56.234720] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-10T17:13:56.234831] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-10T17:13:56.235409] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-10T17:13:56.235474] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-10T17:13:56.299396] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-10T17:13:56.528281] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-10T17:13:56.602243] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:13:57.089397] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-10T17:13:57.542512] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-10T17:13:57.889374] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-10T17:13:58.647576] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-10T17:13:58.689356] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-10T17:13:59.084393] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T17:13:59.364131] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-10T17:13:59.489400] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-10T17:14:00.289474] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-10T17:14:01.090052] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-10T17:14:01.415891] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T17:14:01.646736] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T17:14:01.889386] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-10T17:14:02.689380] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-10T17:14:02.747755] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-10T17:14:03.067446] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-10T17:14:03.176339] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T17:14:03.489386] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-10T17:14:04.289418] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-10T17:14:04.621908] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-10T17:14:05.089431] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-10T17:14:05.889416] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-10T17:14:06.034217] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-10T17:14:06.199984] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-10T17:14:06.689462] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-10T17:14:06.754777] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T17:14:07.489417] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-10T17:14:07.901985] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T17:14:08.289396] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-10T17:14:08.883053] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-10T17:14:09.035116] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T17:14:09.089393] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-10T17:14:09.889419] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-10T17:14:10.189519] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-10T17:14:10.657771] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-10T17:14:10.689409] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-10T17:14:11.489432] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-10T17:14:12.079026] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-10T17:14:12.289366] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-10T17:14:12.759427] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T17:14:13.089411] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-10T17:14:13.829151] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-10T17:14:13.889423] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-10T17:14:14.211140] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-10T17:14:14.689476] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-10T17:14:15.130143] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-10T17:14:15.132731] [INFO ] [REMOTE ] AMTB: Full fetch complete (29622 records). [2025-10-10T17:14:15.132803] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-10T17:14:15.490066] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-10T17:14:15.490985] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-10T17:14:15.491040] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-10T17:14:15.491399] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-10T17:14:15.491442] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-10T17:14:15.492380] [DEBUG] [LOCAL ] AMTB: Trimmed 29622 records to 20747 (keeping 200 days of data) [2025-10-10T17:14:15.614472] [DEBUG] [LOCAL ] AMTB: Primary data saved (20747 records). [2025-10-10T17:14:15.614594] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-10T17:14:15.614694] [INFO ] [MAIN ] Update Progress: 110/2373 symbols completed. AMTB took 24.9s. Estimated remaining: 4h 51m 59s. Rate: 7.8 symbols/min [2025-10-10T17:14:15.785099] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:14:15.794560] [DEBUG] [LOCAL ] AMWL: Loaded 9317 existing records from primary storage. [2025-10-10T17:14:15.794759] [INFO ] [MAIN ] AMWL: Loaded 9317 existing records. [2025-10-10T17:14:15.968475] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:14:15.968758] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-10T17:14:15.968812] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-10T17:14:15.968994] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-10T17:14:15.969051] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-10T17:14:16.290159] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-10T17:14:16.328298] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:14:16.335486] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-10T17:14:16.593301] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T17:14:17.089383] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-10T17:14:17.889391] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-10T17:14:18.197054] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T17:14:18.263260] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-10T17:14:18.689353] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-10T17:14:18.798270] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T17:14:18.799361] [INFO ] [REMOTE ] AMTD: Full fetch complete (5599 records). [2025-10-10T17:14:18.799429] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-10T17:14:19.167068] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-10T17:14:19.167227] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-10T17:14:19.167509] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-10T17:14:19.167567] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-10T17:14:19.168384] [DEBUG] [LOCAL ] AMTD: Trimmed 5599 records to 3793 (keeping 200 days of data) [2025-10-10T17:14:19.190698] [DEBUG] [LOCAL ] AMTD: Primary data saved (3793 records). [2025-10-10T17:14:19.190801] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-10T17:14:19.190887] [INFO ] [MAIN ] Update Progress: 111/2373 symbols completed. AMTD took 25.0s. Estimated remaining: 4h 50m 27s. Rate: 7.8 symbols/min [2025-10-10T17:14:19.368109] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:14:19.368318] [DEBUG] [LOCAL ] AMX: No existing data file found in primary storage. [2025-10-10T17:14:19.368359] [WARN ] [MAIN ] AMX: No existing data found, performing full refresh instead. [2025-10-10T17:14:19.368474] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-10T17:14:19.368518] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-10T17:14:19.368564] [DEBUG] [LOCAL ] AMX: No primary data file found to delete. [2025-10-10T17:14:19.368596] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-10T17:14:19.494774] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-10T17:14:19.774923] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:14:19.776197] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-10T17:14:20.289401] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-10T17:14:21.089445] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-10T17:14:21.228237] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-10T17:14:21.562910] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-10T17:14:21.889398] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-10T17:14:22.689420] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-10T17:14:22.755410] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-10T17:14:22.990359] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T17:14:23.489364] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-10T17:14:24.289379] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-10T17:14:24.590761] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T17:14:25.089418] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-10T17:14:25.225784] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-10T17:14:25.885728] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T17:14:25.895939] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-10T17:14:26.047094] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-10T17:14:26.689375] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-10T17:14:27.489456] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-10T17:14:27.847158] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-10T17:14:27.951903] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T17:14:28.141429] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-10T17:14:28.289380] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-10T17:14:29.089352] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-10T17:14:29.199114] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-10T17:14:29.889369] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-10T17:14:30.689369] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-10T17:14:30.796121] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-10T17:14:30.981020] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T17:14:31.489384] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-10T17:14:32.289360] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-10T17:14:32.694869] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T17:14:32.785967] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-10T17:14:33.089510] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-10T17:14:33.695049] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-10T17:14:33.713711] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-10T17:14:33.889342] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-10T17:14:34.689375] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-10T17:14:35.489375] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-10T17:14:35.918363] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T17:14:36.289359] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-10T17:14:36.527251] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-10T17:14:36.529344] [INFO ] [REMOTE ] AMWL: Full fetch complete (14320 records). [2025-10-10T17:14:36.529535] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-10T17:14:36.787549] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-10T17:14:36.844383] [INFO ] [REMOTE ] AMTM: Full fetch complete (73866 records). [2025-10-10T17:14:36.863428] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-10T17:14:37.124403] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-10T17:14:37.093527] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-10T17:14:37.150632] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-10T17:14:37.153099] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-10T17:14:37.153216] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-10T17:14:37.242450] [DEBUG] [LOCAL ] AMWL: Trimmed 14320 records to 9466 (keeping 200 days of data) [2025-10-10T17:14:37.431534] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-10T17:14:37.436794] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-10T17:14:37.436681] [DEBUG] [LOCAL ] AMWL: Primary data saved (9466 records). [2025-10-10T17:14:37.437956] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-10T17:14:37.437038] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-10T17:14:37.438166] [INFO ] [MAIN ] Update Progress: 112/2373 symbols completed. AMWL took 21.8s. Estimated remaining: 4h 53m 52s. Rate: 7.7 symbols/min [2025-10-10T17:14:37.438286] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-10T17:14:37.544737] [DEBUG] [LOCAL ] AMTM: Trimmed 73866 records to 51363 (keeping 200 days of data) [2025-10-10T17:14:37.703958] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:14:37.893038] [DEBUG] [LOCAL ] AN: Loaded 31875 existing records from primary storage. [2025-10-10T17:14:37.921140] [INFO ] [MAIN ] AN: Loaded 31875 existing records. [2025-10-10T17:14:38.073702] [DEBUG] [LOCAL ] AMTM: Primary data saved (51363 records). [2025-10-10T17:14:38.090196] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-10T17:14:38.094173] [INFO ] [MAIN ] Update Progress: 113/2373 symbols completed. AMTM took 42.3s. Estimated remaining: 4h 51m 21s. Rate: 7.8 symbols/min [2025-10-10T17:14:38.307581] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:14:38.330075] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-10T17:14:38.340857] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-10T17:14:38.370352] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-10T17:14:38.389912] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-10T17:14:38.389794] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:14:38.729245] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-10T17:14:38.790274] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-10T17:14:38.873135] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:14:38.873773] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-10T17:14:38.875876] [DEBUG] [LOCAL ] ANET: Loaded 54156 existing records from primary storage. [2025-10-10T17:14:38.876787] [INFO ] [MAIN ] ANET: Loaded 54156 existing records. [2025-10-10T17:14:39.091831] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:14:39.109791] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-10T17:14:39.110155] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-10T17:14:39.111955] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-10T17:14:39.122195] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-10T17:14:39.122636] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-10T17:14:39.497012] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-10T17:14:39.504498] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:14:40.237402] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-10T17:14:40.287738] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T17:14:40.294777] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-10T17:14:40.659744] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-10T17:14:41.089410] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-10T17:14:41.889410] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-10T17:14:42.135177] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-10T17:14:42.356425] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-10T17:14:42.689382] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-10T17:14:43.489440] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-10T17:14:44.289380] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-10T17:14:44.586288] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-10-10T17:14:44.721344] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T17:14:44.810598] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-10T17:14:45.089434] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-10T17:14:45.889347] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-10T17:14:45.949368] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T17:14:46.689375] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-10T17:14:46.875376] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T17:14:47.378729] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T17:14:47.489332] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-10T17:14:48.289353] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-10T17:14:48.527238] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T17:14:49.089416] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-10T17:14:49.559066] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-10T17:14:49.564567] [INFO ] [REMOTE ] AMT: Full fetch complete (76028 records). [2025-10-10T17:14:49.564815] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-10T17:14:49.904751] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-10T17:14:49.971602] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-10T17:14:49.971865] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-10T17:14:49.972875] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-10T17:14:49.972997] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-10T17:14:49.975033] [DEBUG] [LOCAL ] AMT: Trimmed 76028 records to 53216 (keeping 200 days of data) [2025-10-10T17:14:50.098698] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T17:14:50.344086] [DEBUG] [LOCAL ] AMT: Primary data saved (53216 records). [2025-10-10T17:14:50.344325] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-10T17:14:50.344419] [INFO ] [MAIN ] Update Progress: 114/2373 symbols completed. AMT took 1m 1s. Estimated remaining: 4h 52m 43s. Rate: 7.7 symbols/min [2025-10-10T17:14:50.524549] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:14:50.524852] [DEBUG] [LOCAL ] ANF: No existing data file found in primary storage. [2025-10-10T17:14:50.524997] [WARN ] [MAIN ] ANF: No existing data found, performing full refresh instead. [2025-10-10T17:14:50.525173] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-10T17:14:50.525332] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-10T17:14:50.525391] [DEBUG] [LOCAL ] ANF: No primary data file found to delete. [2025-10-10T17:14:50.525592] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-10T17:14:50.690809] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-10T17:14:50.751177] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T17:14:50.953159] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:14:51.489375] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-10T17:14:52.289363] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-10T17:14:52.477854] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T17:14:52.570448] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-10T17:14:53.089385] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-10T17:14:53.249796] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-10T17:14:53.254407] [INFO ] [REMOTE ] AMX: Full fetch complete (70690 records). [2025-10-10T17:14:53.254517] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-10T17:14:53.649289] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-10T17:14:53.650225] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-10T17:14:53.650962] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-10T17:14:53.651024] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-10T17:14:53.652442] [DEBUG] [LOCAL ] AMX: Trimmed 70690 records to 49829 (keeping 200 days of data) [2025-10-10T17:14:53.889728] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-10T17:14:53.988687] [DEBUG] [LOCAL ] AMX: Primary data saved (49829 records). [2025-10-10T17:14:53.989557] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-10T17:14:53.990237] [INFO ] [MAIN ] Update Progress: 115/2373 symbols completed. AMX took 34.8s. Estimated remaining: 4h 51m 14s. Rate: 7.8 symbols/min [2025-10-10T17:14:53.992058] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T17:14:54.174792] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T17:14:54.193052] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:14:54.198892] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-10T17:14:54.198964] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-10T17:14:54.199440] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-10T17:14:54.199492] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-10T17:14:54.199846] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-10T17:14:54.199899] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-10T17:14:54.554392] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:14:54.689341] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-10T17:14:54.940922] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:14:54.941206] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-10T17:14:54.941309] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:14:54.941357] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-10T17:14:54.941420] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:14:54.941469] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-10T17:14:54.941527] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-10T17:14:54.941562] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-10T17:14:54.941601] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-10T17:14:54.941678] [INFO ] [MAIN ] Update Progress: 116/2373 symbols completed. ANGX took 0.9s. Estimated remaining: 4h 48m 54s. Rate: 7.8 symbols/min [2025-10-10T17:14:55.113803] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:14:55.133811] [DEBUG] [LOCAL ] ANRO: Loaded 19411 existing records from primary storage. [2025-10-10T17:14:55.134073] [INFO ] [MAIN ] ANRO: Loaded 19411 existing records. [2025-10-10T17:14:55.306464] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:14:55.306720] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-10T17:14:55.306779] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-10T17:14:55.307111] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-10T17:14:55.307167] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-10T17:14:55.498259] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-10T17:14:55.654293] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:14:56.211375] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-10T17:14:56.289373] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-10T17:14:57.089413] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-10T17:14:57.370574] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-10T17:14:57.889383] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-10T17:14:58.378567] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T17:14:58.697886] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-10T17:14:58.700854] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-10T17:14:59.194109] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T17:14:59.489407] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-10T17:15:00.289440] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-10T17:15:00.853796] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-10T17:15:01.089454] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-10T17:15:01.630527] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-10T17:15:01.889348] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-10T17:15:01.970863] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T17:15:02.689411] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-10T17:15:03.392528] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-10T17:15:03.489373] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-10T17:15:03.739710] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-10T17:15:04.030667] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T17:15:04.289469] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-10T17:15:04.753122] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T17:15:05.089395] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-10T17:15:05.820091] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T17:15:05.889351] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-10T17:15:06.689390] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-10T17:15:07.161990] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-10T17:15:07.378816] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-10T17:15:07.489403] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-10T17:15:08.146570] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-10T17:15:08.289452] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-10T17:15:09.100395] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-10T17:15:09.106761] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-10T17:15:09.889408] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-10T17:15:10.241853] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-10T17:15:10.689370] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-10T17:15:10.931746] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-10T17:15:11.315232] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-10T17:15:11.489393] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-10T17:15:12.191228] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T17:15:12.194720] [INFO ] [REMOTE ] AN: Full fetch complete (47139 records). [2025-10-10T17:15:12.194869] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-10T17:15:12.296710] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-10T17:15:12.625407] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-10T17:15:12.625503] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-10T17:15:12.626173] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-10T17:15:12.626250] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-10T17:15:12.627513] [DEBUG] [LOCAL ] AN: Trimmed 47139 records to 32078 (keeping 200 days of data) [2025-10-10T17:15:12.833232] [DEBUG] [LOCAL ] AN: Primary data saved (32078 records). [2025-10-10T17:15:12.833424] [INFO ] [MAIN ] AN: Full history saved. [2025-10-10T17:15:12.835819] [INFO ] [MAIN ] Update Progress: 117/2373 symbols completed. AN took 35.4s. Estimated remaining: 4h 52m 4s. Rate: 7.7 symbols/min [2025-10-10T17:15:12.876089] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-10T17:15:13.089381] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-10T17:15:13.889346] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-10T17:15:14.163932] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-10T17:15:14.450964] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T17:15:14.689388] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-10T17:15:15.489401] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-10T17:15:15.922991] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-10T17:15:16.289367] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-10T17:15:16.817427] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-10-10T17:15:17.017093] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-10T17:15:17.089343] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-10T17:15:17.471922] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-10T17:15:17.889374] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-10T17:15:18.689349] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-10T17:15:18.800315] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-10T17:15:18.931857] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T17:15:19.489390] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-10T17:15:20.289437] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-10T17:15:20.774310] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T17:15:20.777765] [INFO ] [REMOTE ] ANRO: Full fetch complete (29641 records). [2025-10-10T17:15:20.777868] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-10T17:15:21.162432] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-10T17:15:21.162551] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-10T17:15:21.162998] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-10T17:15:21.163087] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-10T17:15:21.164387] [DEBUG] [LOCAL ] ANRO: Trimmed 29641 records to 19612 (keeping 200 days of data) [2025-10-10T17:15:21.279046] [DEBUG] [LOCAL ] ANRO: Primary data saved (19612 records). [2025-10-10T17:15:21.279232] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-10T17:15:21.279330] [INFO ] [MAIN ] Update Progress: 118/2373 symbols completed. ANRO took 26.3s. Estimated remaining: 4h 52m 9s. Rate: 7.7 symbols/min [2025-10-10T17:15:21.480186] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-10T17:15:21.493057] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-10T17:15:22.305039] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-10T17:15:22.310351] [INFO ] [REMOTE ] ANF: Full fetch complete (75583 records). [2025-10-10T17:15:22.310536] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-10T17:15:22.733630] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-10T17:15:22.733748] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-10T17:15:22.734675] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-10T17:15:22.734740] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-10T17:15:22.736318] [DEBUG] [LOCAL ] ANF: Trimmed 75583 records to 52849 (keeping 200 days of data) [2025-10-10T17:15:23.058842] [DEBUG] [LOCAL ] ANF: Primary data saved (52849 records). [2025-10-10T17:15:23.058983] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-10T17:15:23.059058] [INFO ] [MAIN ] Update Progress: 119/2373 symbols completed. ANF took 32.7s. Estimated remaining: 4h 50m 7s. Rate: 7.8 symbols/min [2025-10-10T17:15:23.642151] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-10T17:15:23.647248] [INFO ] [REMOTE ] ANET: Full fetch complete (77860 records). [2025-10-10T17:15:23.647401] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-10T17:15:24.039078] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-10T17:15:24.039178] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-10T17:15:24.040634] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-10T17:15:24.040779] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-10T17:15:24.042772] [DEBUG] [LOCAL ] ANET: Trimmed 77860 records to 54546 (keeping 200 days of data) [2025-10-10T17:15:24.430591] [DEBUG] [LOCAL ] ANET: Primary data saved (54546 records). [2025-10-10T17:15:24.430774] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-10T17:15:24.431542] [INFO ] [MAIN ] Update Progress: 120/2373 symbols completed. ANET took 46.3s. Estimated remaining: 4h 48m 0s. Rate: 7.8 symbols/min [2025-10-10T17:15:25.075081] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:15:25.086149] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:15:25.141972] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:15:25.162767] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:15:25.163163] [DEBUG] [LOCAL ] AOMR: No existing data file found in primary storage. [2025-10-10T17:15:25.163361] [WARN ] [MAIN ] AOMR: No existing data found, performing full refresh instead. [2025-10-10T17:15:25.163493] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-10T17:15:25.163637] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-10T17:15:25.163735] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-10T17:15:25.163785] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-10-10T17:15:25.163820] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-10T17:15:25.169261] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-10T17:15:25.205763] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-10T17:15:25.247346] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-10T17:15:25.283974] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-10T17:15:25.284188] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-10T17:15:25.486722] [DEBUG] [LOCAL ] AOD: Loaded 30853 existing records from primary storage. [2025-10-10T17:15:25.485518] [DEBUG] [LOCAL ] ANVS: Loaded 23421 existing records from primary storage. [2025-10-10T17:15:25.568257] [INFO ] [MAIN ] AOD: Loaded 30853 existing records. [2025-10-10T17:15:25.664360] [INFO ] [MAIN ] ANVS: Loaded 23421 existing records. [2025-10-10T17:15:26.106283] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:15:26.178329] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-10T17:15:26.181479] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:15:26.219173] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-10T17:15:26.224885] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-10T17:15:26.230175] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-10T17:15:26.230260] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-10T17:15:26.340099] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:15:26.413150] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:15:26.402560] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-10T17:15:26.426827] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-10T17:15:26.427592] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-10T17:15:26.441815] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-10T17:15:26.457529] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-10T17:15:26.671282] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:15:26.710015] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-10T17:15:26.715726] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:15:26.716193] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-10T17:15:26.747195] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:15:26.766585] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-10T17:15:26.857680] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-10T17:15:26.914963] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:15:26.875725] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-10T17:15:26.933890] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-10T17:15:26.933627] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-10T17:15:26.948421] [INFO ] [MAIN ] Update Progress: 121/2373 symbols completed. AOMD took 2.5s. Estimated remaining: 4h 46m 17s. Rate: 7.9 symbols/min [2025-10-10T17:15:27.203185] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T17:15:27.236812] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-10T17:15:27.242401] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:15:27.248596] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-10T17:15:27.269810] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:15:27.270061] [DEBUG] [LOCAL ] AON: No existing data file found in primary storage. [2025-10-10T17:15:27.270106] [WARN ] [MAIN ] AON: No existing data found, performing full refresh instead. [2025-10-10T17:15:27.270222] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-10T17:15:27.270306] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-10T17:15:27.270357] [DEBUG] [LOCAL ] AON: No primary data file found to delete. [2025-10-10T17:15:27.270390] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-10T17:15:27.658322] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:15:27.658636] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-10T17:15:27.835202] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-10T17:15:27.837959] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-10T17:15:28.344302] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-10T17:15:28.350517] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-10T17:15:28.499696] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-10T17:15:28.506052] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-10T17:15:29.011895] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-10T17:15:29.094488] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-10T17:15:29.107436] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-10T17:15:29.200024] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-10T17:15:29.889384] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-10T17:15:29.984629] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-10T17:15:30.246387] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T17:15:30.689363] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-10T17:15:31.489369] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-10T17:15:31.513977] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T17:15:31.535614] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-10T17:15:32.289339] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-10T17:15:32.503215] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-10T17:15:33.089342] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-10T17:15:33.625200] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-10T17:15:33.889461] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-10T17:15:34.279597] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-10T17:15:34.689434] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-10T17:15:35.489391] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-10T17:15:35.697454] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-10T17:15:35.769841] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-10T17:15:36.289438] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-10T17:15:36.800723] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T17:15:37.089344] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-10T17:15:37.403985] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-10T17:15:37.889371] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-10T17:15:38.689385] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-10T17:15:38.896950] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T17:15:39.054931] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T17:15:39.489378] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-10T17:15:40.289403] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-10T17:15:40.334478] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T17:15:41.000453] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-10T17:15:41.089363] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-10T17:15:41.276548] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-10T17:15:41.889388] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-10T17:15:42.689412] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-10T17:15:42.956931] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T17:15:43.270479] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-10T17:15:43.489386] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-10T17:15:43.617529] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-10T17:15:44.289394] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-10T17:15:45.043090] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T17:15:45.089393] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-10T17:15:45.261012] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-10T17:15:45.734247] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-10T17:15:45.889406] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-10T17:15:46.689371] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-10T17:15:46.877538] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T17:15:46.879260] [INFO ] [REMOTE ] AOMR: Full fetch complete (23051 records). [2025-10-10T17:15:46.879339] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-10T17:15:46.880072] [FATAL] [VALIDATOR ] AOMR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:15:46.880169] [FATAL] [MAIN ] AOMR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:15:46.880216] [WARN ] [MAIN ] AOMR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:15:46.880260] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-10T17:15:46.880324] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-10-10T17:15:46.880365] [INFO ] [LOCAL ] AOMR: Starting deletion of derivative data. [2025-10-10T17:15:46.880407] [DEBUG] [LOCAL ] AOMR: No derivative data file found to delete. [2025-10-10T17:15:46.880469] [INFO ] [MAIN ] Update Progress: 122/2373 symbols completed. AOMR took 22.4s. Estimated remaining: 4h 49m 56s. Rate: 7.8 symbols/min [2025-10-10T17:15:47.068830] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:15:47.101412] [DEBUG] [LOCAL ] AORT: Loaded 29364 existing records from primary storage. [2025-10-10T17:15:47.101753] [INFO ] [MAIN ] AORT: Loaded 29364 existing records. [2025-10-10T17:15:47.310919] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:15:47.311187] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-10T17:15:47.311276] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-10T17:15:47.311634] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-10T17:15:47.311727] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-10T17:15:47.498949] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-10T17:15:47.687304] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:15:48.092511] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-10T17:15:48.289373] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-10T17:15:48.479905] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T17:15:49.089398] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-10T17:15:49.141604] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-10T17:15:49.889402] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-10T17:15:50.689355] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-10T17:15:50.830324] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-10T17:15:50.938056] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T17:15:51.489377] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-10T17:15:51.823483] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-10T17:15:52.289386] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-10T17:15:52.916593] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-10T17:15:53.089368] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-10T17:15:53.785007] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-10T17:15:53.889386] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-10T17:15:54.110676] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-10T17:15:54.689391] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-10T17:15:55.295515] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-10T17:15:55.301093] [INFO ] [REMOTE ] AOD: Full fetch complete (44547 records). [2025-10-10T17:15:55.301311] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-10T17:15:55.490322] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-10T17:15:55.710510] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-10T17:15:55.710606] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-10T17:15:55.711211] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-10T17:15:55.711273] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-10T17:15:55.712736] [DEBUG] [LOCAL ] AOD: Trimmed 44547 records to 31144 (keeping 200 days of data) [2025-10-10T17:15:55.893571] [DEBUG] [LOCAL ] AOD: Primary data saved (31144 records). [2025-10-10T17:15:55.893730] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-10T17:15:55.893825] [INFO ] [MAIN ] Update Progress: 123/2373 symbols completed. AOD took 31.4s. Estimated remaining: 4h 50m 12s. Rate: 7.8 symbols/min [2025-10-10T17:15:56.057633] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T17:15:56.097017] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:15:56.140046] [DEBUG] [LOCAL ] AOS: Loaded 49043 existing records from primary storage. [2025-10-10T17:15:56.140375] [INFO ] [MAIN ] AOS: Loaded 49043 existing records. [2025-10-10T17:15:56.309667] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-10T17:15:56.314267] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:15:56.315204] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-10T17:15:56.315280] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-10T17:15:56.315528] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-10T17:15:56.315568] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-10T17:15:56.675563] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:15:56.876431] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-10T17:15:57.089409] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-10T17:15:57.889371] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-10T17:15:58.689367] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-10T17:15:58.827090] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-10T17:15:58.928562] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T17:15:59.476790] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-10T17:15:59.489330] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-10T17:15:59.864079] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-10T17:16:00.289378] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-10T17:16:00.886882] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-10T17:16:01.089377] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-10T17:16:01.702870] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-10T17:16:01.705863] [INFO ] [REMOTE ] ANVS: Full fetch complete (36316 records). [2025-10-10T17:16:01.705946] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-10T17:16:01.896313] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-10T17:16:02.117523] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-10T17:16:02.117626] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-10T17:16:02.118142] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-10T17:16:02.118191] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-10T17:16:02.119368] [DEBUG] [LOCAL ] ANVS: Trimmed 36316 records to 23802 (keeping 200 days of data) [2025-10-10T17:16:02.251483] [DEBUG] [LOCAL ] ANVS: Primary data saved (23802 records). [2025-10-10T17:16:02.251632] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-10T17:16:02.251760] [INFO ] [MAIN ] Update Progress: 124/2373 symbols completed. ANVS took 37.8s. Estimated remaining: 4h 49m 39s. Rate: 7.8 symbols/min [2025-10-10T17:16:02.421904] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:16:02.422149] [DEBUG] [LOCAL ] AP: No existing data file found in primary storage. [2025-10-10T17:16:02.422218] [WARN ] [MAIN ] AP: No existing data found, performing full refresh instead. [2025-10-10T17:16:02.422418] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-10T17:16:02.422473] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-10T17:16:02.437696] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-10T17:16:02.437858] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-10T17:16:02.514499] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-10T17:16:02.700216] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-10T17:16:02.820722] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:16:03.489386] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-10T17:16:03.693470] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T17:16:04.289409] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-10T17:16:04.345358] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-10T17:16:04.609141] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T17:16:05.089382] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-10T17:16:05.695848] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T17:16:05.889384] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-10T17:16:06.001722] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T17:16:06.689371] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-10T17:16:07.489348] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-10T17:16:07.700769] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-10T17:16:07.704922] [INFO ] [REMOTE ] AON: Full fetch complete (64574 records). [2025-10-10T17:16:07.705034] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-10T17:16:08.090165] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-10T17:16:08.090265] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-10T17:16:08.091083] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-10T17:16:08.091165] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-10T17:16:08.106530] [DEBUG] [LOCAL ] AON: Trimmed 64574 records to 45735 (keeping 200 days of data) [2025-10-10T17:16:08.118201] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-10T17:16:08.306384] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-10T17:16:08.415681] [DEBUG] [LOCAL ] AON: Primary data saved (45735 records). [2025-10-10T17:16:08.415826] [INFO ] [MAIN ] AON: Full history saved. [2025-10-10T17:16:08.415899] [INFO ] [MAIN ] Update Progress: 125/2373 symbols completed. AON took 41.5s. Estimated remaining: 4h 49m 3s. Rate: 7.8 symbols/min [2025-10-10T17:16:08.585443] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:16:08.585663] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-10-10T17:16:08.585812] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-10-10T17:16:08.585980] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-10T17:16:08.586068] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-10T17:16:08.586189] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-10T17:16:08.586235] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-10T17:16:08.753918] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T17:16:08.978246] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:16:09.089519] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-10T17:16:09.889402] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-10T17:16:10.380829] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-10T17:16:10.383941] [INFO ] [REMOTE ] AORT: Full fetch complete (42075 records). [2025-10-10T17:16:10.384052] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-10T17:16:10.691265] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-10T17:16:10.703727] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-10T17:16:10.711610] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-10T17:16:10.816407] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-10T17:16:10.816494] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-10T17:16:10.817024] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-10T17:16:10.817087] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-10T17:16:10.818052] [DEBUG] [LOCAL ] AORT: Trimmed 42075 records to 29573 (keeping 200 days of data) [2025-10-10T17:16:10.996882] [DEBUG] [LOCAL ] AORT: Primary data saved (29573 records). [2025-10-10T17:16:10.997039] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-10T17:16:10.997125] [INFO ] [MAIN ] Update Progress: 126/2373 symbols completed. AORT took 24.1s. Estimated remaining: 4h 47m 24s. Rate: 7.8 symbols/min [2025-10-10T17:16:11.188548] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:16:11.241431] [DEBUG] [LOCAL ] APD: Loaded 45648 existing records from primary storage. [2025-10-10T17:16:11.241824] [INFO ] [MAIN ] APD: Loaded 45648 existing records. [2025-10-10T17:16:11.480580] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:16:11.480897] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-10T17:16:11.480955] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-10T17:16:11.481924] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-10T17:16:11.481992] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-10T17:16:11.495391] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-10T17:16:12.006776] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:16:12.291885] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-10T17:16:12.295813] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T17:16:13.089372] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-10T17:16:13.532289] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T17:16:13.776327] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-10T17:16:13.889372] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-10T17:16:14.248257] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-10T17:16:14.689446] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-10T17:16:15.406740] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-10T17:16:15.489371] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-10T17:16:16.289375] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-10T17:16:16.692405] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-10T17:16:17.089386] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-10T17:16:17.124910] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T17:16:17.889387] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-10T17:16:18.209226] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T17:16:18.327225] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-10T17:16:18.546284] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T17:16:18.689409] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-10T17:16:19.489392] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-10T17:16:20.289353] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-10T17:16:20.567637] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T17:16:21.089430] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-10T17:16:21.124586] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-10T17:16:21.700723] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T17:16:21.889398] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-10T17:16:22.689366] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-10T17:16:23.050692] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T17:16:23.489354] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-10T17:16:23.731286] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-10T17:16:24.289348] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-10T17:16:24.588877] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T17:16:24.931688] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-10T17:16:25.030597] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-10T17:16:25.089353] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-10T17:16:25.889451] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-10T17:16:26.689360] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-10T17:16:26.695858] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-10T17:16:26.837405] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T17:16:27.489378] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-10T17:16:28.289368] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-10T17:16:28.338366] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-10T17:16:29.089412] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-10T17:16:29.353116] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-10T17:16:29.381491] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T17:16:29.889385] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-10T17:16:30.611677] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T17:16:30.689325] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-10T17:16:31.131141] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-10T17:16:31.135631] [INFO ] [REMOTE ] AOS: Full fetch complete (70669 records). [2025-10-10T17:16:31.135800] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-10T17:16:31.495088] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-10T17:16:31.519124] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-10T17:16:31.519191] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-10T17:16:31.520291] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-10T17:16:31.520374] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-10T17:16:31.522423] [DEBUG] [LOCAL ] AOS: Trimmed 70669 records to 49405 (keeping 200 days of data) [2025-10-10T17:16:31.817560] [DEBUG] [LOCAL ] AOS: Primary data saved (49405 records). [2025-10-10T17:16:31.817739] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-10T17:16:31.818188] [INFO ] [MAIN ] Update Progress: 127/2373 symbols completed. AOS took 35.9s. Estimated remaining: 4h 51m 9s. Rate: 7.7 symbols/min [2025-10-10T17:16:32.007831] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:16:32.008094] [DEBUG] [LOCAL ] APG: No existing data file found in primary storage. [2025-10-10T17:16:32.008290] [WARN ] [MAIN ] APG: No existing data found, performing full refresh instead. [2025-10-10T17:16:32.008503] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-10T17:16:32.008604] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-10T17:16:32.008774] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-10-10T17:16:32.008836] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-10T17:16:32.292864] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-10T17:16:32.380820] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T17:16:32.493019] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:16:33.089428] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-10T17:16:33.268135] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T17:16:33.318189] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-10T17:16:33.889422] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-10T17:16:34.689367] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-10T17:16:35.074115] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T17:16:35.489352] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-10T17:16:35.567881] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-10T17:16:36.289414] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-10T17:16:36.691224] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T17:16:37.089400] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-10T17:16:37.454288] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T17:16:37.556699] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T17:16:37.837059] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-10T17:16:37.889383] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-10T17:16:38.689394] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-10T17:16:39.447430] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T17:16:39.477592] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-10T17:16:39.481047] [INFO ] [REMOTE ] APAM: Full fetch complete (51811 records). [2025-10-10T17:16:39.481139] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-10T17:16:39.494536] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-10T17:16:39.877604] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-10T17:16:39.877711] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-10T17:16:39.878346] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-10T17:16:39.878411] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-10T17:16:39.879609] [DEBUG] [LOCAL ] APAM: Trimmed 51811 records to 36563 (keeping 200 days of data) [2025-10-10T17:16:40.099571] [DEBUG] [LOCAL ] APAM: Primary data saved (36563 records). [2025-10-10T17:16:40.099743] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-10T17:16:40.099828] [INFO ] [MAIN ] Update Progress: 128/2373 symbols completed. APAM took 31.7s. Estimated remaining: 4h 51m 10s. Rate: 7.7 symbols/min [2025-10-10T17:16:40.284132] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:16:40.289383] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-10T17:16:40.346243] [DEBUG] [LOCAL ] APH: Loaded 54081 existing records from primary storage. [2025-10-10T17:16:40.346697] [INFO ] [MAIN ] APH: Loaded 54081 existing records. [2025-10-10T17:16:40.529571] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:16:40.529907] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-10T17:16:40.529960] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-10T17:16:40.530587] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-10T17:16:40.530686] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-10T17:16:40.910397] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:16:40.949129] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-10T17:16:41.089364] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-10T17:16:41.200217] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-10T17:16:41.889378] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-10T17:16:42.415357] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T17:16:42.420193] [INFO ] [REMOTE ] APD: Full fetch complete (66877 records). [2025-10-10T17:16:42.420312] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-10T17:16:42.693407] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-10T17:16:42.693255] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-10T17:16:42.721917] [INFO ] [REMOTE ] AP: Full fetch complete (8969 records). [2025-10-10T17:16:42.760840] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-10T17:16:42.899875] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-10T17:16:42.918222] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-10T17:16:42.921275] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-10T17:16:42.921359] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-10T17:16:42.978865] [DEBUG] [LOCAL ] APD: Trimmed 66877 records to 45975 (keeping 200 days of data) [2025-10-10T17:16:43.331875] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-10T17:16:43.336069] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-10T17:16:43.336359] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-10T17:16:43.336443] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-10T17:16:43.353109] [DEBUG] [LOCAL ] AP: Trimmed 8969 records to 7276 (keeping 200 days of data) [2025-10-10T17:16:43.492300] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-10T17:16:43.528785] [DEBUG] [LOCAL ] AP: Primary data saved (7276 records). [2025-10-10T17:16:43.532841] [INFO ] [MAIN ] AP: Full history saved. [2025-10-10T17:16:43.532945] [INFO ] [MAIN ] Update Progress: 129/2373 symbols completed. AP took 41.3s. Estimated remaining: 4h 49m 47s. Rate: 7.7 symbols/min [2025-10-10T17:16:43.676941] [DEBUG] [LOCAL ] APD: Primary data saved (45975 records). [2025-10-10T17:16:43.692973] [INFO ] [MAIN ] APD: Full history saved. [2025-10-10T17:16:43.703525] [INFO ] [MAIN ] Update Progress: 130/2373 symbols completed. APD took 32.7s. Estimated remaining: 4h 47m 28s. Rate: 7.8 symbols/min [2025-10-10T17:16:43.841836] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:16:43.956556] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:16:43.999699] [DEBUG] [LOCAL ] APLE: Loaded 52309 existing records from primary storage. [2025-10-10T17:16:44.000202] [INFO ] [MAIN ] APLE: Loaded 52309 existing records. [2025-10-10T17:16:44.219270] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:16:44.219957] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-10T17:16:44.236820] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-10T17:16:44.238702] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-10T17:16:44.238847] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-10T17:16:44.265559] [DEBUG] [LOCAL ] APO: Loaded 53773 existing records from primary storage. [2025-10-10T17:16:44.283571] [INFO ] [MAIN ] APO: Loaded 53773 existing records. [2025-10-10T17:16:44.838863] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:16:44.850609] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-10T17:16:44.864151] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-10T17:16:44.878126] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-10T17:16:44.884329] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-10T17:16:44.913553] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-10T17:16:44.889964] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-10T17:16:44.979568] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:16:45.094489] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-10T17:16:45.318723] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:16:45.728864] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-10T17:16:45.889416] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-10T17:16:46.457350] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T17:16:46.689383] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-10T17:16:46.735633] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T17:16:47.489420] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-10T17:16:48.074774] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-10T17:16:48.289358] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-10T17:16:48.818586] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-10T17:16:49.089398] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-10T17:16:49.323775] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-10T17:16:49.804751] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-10T17:16:49.889357] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-10T17:16:50.689356] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-10T17:16:51.141079] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-10T17:16:51.489367] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-10T17:16:51.934679] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-10T17:16:52.284566] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-10T17:16:52.295105] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-10T17:16:53.089387] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-10T17:16:53.285198] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T17:16:53.889397] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-10T17:16:54.370061] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-10T17:16:54.689410] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-10T17:16:54.867265] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T17:16:55.257252] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T17:16:55.489383] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-10T17:16:56.289421] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-10T17:16:56.497732] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T17:16:57.089386] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-10T17:16:57.573591] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T17:16:57.687280] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-10T17:16:57.889363] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-10T17:16:58.689462] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-10T17:16:59.256765] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-10T17:16:59.489362] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-10T17:16:59.954472] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T17:17:00.289381] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-10T17:17:01.089357] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-10T17:17:01.410744] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-10T17:17:01.753703] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-10T17:17:01.889345] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-10T17:17:01.997484] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T17:17:02.689395] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-10T17:17:03.077807] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T17:17:03.489412] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-10T17:17:04.096138] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-10T17:17:04.289474] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-10T17:17:04.891609] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-10T17:17:05.016325] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-10T17:17:05.089409] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-10T17:17:05.889394] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-10T17:17:06.120141] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T17:17:06.422075] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T17:17:06.689415] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-10T17:17:07.489385] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-10T17:17:08.076359] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-10T17:17:08.289405] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-10T17:17:08.533253] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T17:17:09.089405] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-10T17:17:09.888685] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-10T17:17:09.899734] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-10T17:17:09.934502] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-10T17:17:09.939362] [INFO ] [REMOTE ] APG: Full fetch complete (71801 records). [2025-10-10T17:17:09.939483] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-10T17:17:10.321332] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-10T17:17:10.321434] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-10T17:17:10.322180] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-10T17:17:10.322271] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-10T17:17:10.323789] [DEBUG] [LOCAL ] APG: Trimmed 71801 records to 51201 (keeping 200 days of data) [2025-10-10T17:17:10.579601] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-10T17:17:10.661202] [DEBUG] [LOCAL ] APG: Primary data saved (51201 records). [2025-10-10T17:17:10.661326] [INFO ] [MAIN ] APG: Full history saved. [2025-10-10T17:17:10.661415] [INFO ] [MAIN ] Update Progress: 131/2373 symbols completed. APG took 38.8s. Estimated remaining: 4h 52m 50s. Rate: 7.7 symbols/min [2025-10-10T17:17:10.694294] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-10T17:17:10.839876] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:17:10.849930] [DEBUG] [LOCAL ] APOS: Loaded 7556 existing records from primary storage. [2025-10-10T17:17:10.850137] [INFO ] [MAIN ] APOS: Loaded 7556 existing records. [2025-10-10T17:17:11.028243] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:17:11.029575] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-10T17:17:11.029670] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-10T17:17:11.030507] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-10T17:17:11.030567] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-10T17:17:11.380871] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:17:11.489350] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-10T17:17:11.638141] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-10T17:17:12.289381] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-10T17:17:12.630074] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T17:17:12.836842] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T17:17:13.089356] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-10T17:17:13.141891] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-10T17:17:13.889377] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-10T17:17:14.689380] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-10T17:17:15.020842] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T17:17:15.438152] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T17:17:15.489366] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-10T17:17:16.271174] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T17:17:16.276397] [INFO ] [REMOTE ] APLE: Full fetch complete (74418 records). [2025-10-10T17:17:16.276567] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-10T17:17:16.298248] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-10T17:17:16.677762] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-10T17:17:16.677855] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-10T17:17:16.678666] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-10T17:17:16.678732] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-10T17:17:16.680619] [DEBUG] [LOCAL ] APLE: Trimmed 74418 records to 52694 (keeping 200 days of data) [2025-10-10T17:17:16.989917] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-10T17:17:17.012798] [DEBUG] [LOCAL ] APLE: Primary data saved (52694 records). [2025-10-10T17:17:17.012927] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-10T17:17:17.013783] [INFO ] [MAIN ] Update Progress: 132/2373 symbols completed. APLE took 33.5s. Estimated remaining: 4h 52m 17s. Rate: 7.7 symbols/min [2025-10-10T17:17:17.090619] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-10T17:17:17.197709] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:17:17.198083] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-10-10T17:17:17.198131] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-10-10T17:17:17.198258] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-10T17:17:17.198302] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-10T17:17:17.198345] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-10T17:17:17.198380] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-10T17:17:17.592183] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:17:17.637612] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-10T17:17:17.889343] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-10T17:17:17.992332] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T17:17:18.689378] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-10T17:17:19.489391] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-10T17:17:19.737753] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T17:17:19.801832] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-10T17:17:20.289423] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-10T17:17:21.089348] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-10T17:17:21.165331] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-10T17:17:21.489051] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-10T17:17:21.497275] [INFO ] [REMOTE ] APO: Full fetch complete (77290 records). [2025-10-10T17:17:21.497486] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-10T17:17:21.903022] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-10T17:17:21.927571] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-10T17:17:21.927674] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-10T17:17:21.928530] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-10T17:17:21.928697] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-10T17:17:21.930351] [DEBUG] [LOCAL ] APO: Trimmed 77290 records to 54163 (keeping 200 days of data) [2025-10-10T17:17:22.257320] [DEBUG] [LOCAL ] APO: Primary data saved (54163 records). [2025-10-10T17:17:22.257466] [INFO ] [MAIN ] APO: Full history saved. [2025-10-10T17:17:22.258232] [INFO ] [MAIN ] Update Progress: 133/2373 symbols completed. APO took 38.6s. Estimated remaining: 4h 51m 26s. Rate: 7.7 symbols/min [2025-10-10T17:17:22.436400] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:17:22.436721] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-10-10T17:17:22.436776] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-10-10T17:17:22.436914] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-10T17:17:22.436960] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-10T17:17:22.437034] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-10T17:17:22.437069] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-10T17:17:22.694593] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-10T17:17:22.814137] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:17:22.826572] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T17:17:22.831193] [INFO ] [REMOTE ] APH: Full fetch complete (77301 records). [2025-10-10T17:17:22.831322] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-10T17:17:22.832207] [FATAL] [VALIDATOR ] APH: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:17:22.832305] [FATAL] [MAIN ] APH: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:17:22.832347] [WARN ] [MAIN ] APH: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:17:22.832387] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-10T17:17:22.832446] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-10T17:17:22.832482] [INFO ] [LOCAL ] APH: Starting deletion of derivative data. [2025-10-10T17:17:22.832790] [DEBUG] [LOCAL ] APH: Deleted derivative data file. [2025-10-10T17:17:22.832902] [INFO ] [MAIN ] Update Progress: 134/2373 symbols completed. APH took 42.7s. Estimated remaining: 4h 49m 17s. Rate: 7.7 symbols/min [2025-10-10T17:17:22.997500] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:17:23.003666] [DEBUG] [LOCAL ] AQNB: Loaded 4155 existing records from primary storage. [2025-10-10T17:17:23.003828] [INFO ] [MAIN ] AQNB: Loaded 4155 existing records. [2025-10-10T17:17:23.175219] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:17:23.175459] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-10T17:17:23.175509] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-10T17:17:23.176441] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-10T17:17:23.176500] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-10T17:17:23.499368] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-10T17:17:23.531321] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:17:23.609493] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-10T17:17:23.964214] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T17:17:24.289392] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-10T17:17:25.089379] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-10T17:17:25.164664] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-10T17:17:25.453870] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T17:17:25.555344] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-10T17:17:25.889374] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-10T17:17:26.689391] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-10T17:17:27.385848] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-10T17:17:27.489411] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-10T17:17:27.710374] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T17:17:28.201523] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-10T17:17:28.289402] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-10T17:17:29.089394] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-10T17:17:29.189486] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-10T17:17:29.889429] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-10T17:17:30.689422] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-10T17:17:30.734692] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T17:17:30.736215] [INFO ] [REMOTE ] APOS: Full fetch complete (10371 records). [2025-10-10T17:17:30.736287] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-10T17:17:31.090853] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-10T17:17:31.172262] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-10T17:17:31.172361] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-10T17:17:31.172635] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-10T17:17:31.172720] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-10T17:17:31.173252] [DEBUG] [LOCAL ] APOS: Trimmed 10371 records to 7591 (keeping 200 days of data) [2025-10-10T17:17:31.224629] [DEBUG] [LOCAL ] APOS: Primary data saved (7591 records). [2025-10-10T17:17:31.224897] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-10T17:17:31.225076] [INFO ] [MAIN ] Update Progress: 135/2373 symbols completed. APOS took 20.6s. Estimated remaining: 4h 49m 20s. Rate: 7.7 symbols/min [2025-10-10T17:17:31.406023] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:17:31.406272] [DEBUG] [LOCAL ] AR: No existing data file found in primary storage. [2025-10-10T17:17:31.406314] [WARN ] [MAIN ] AR: No existing data found, performing full refresh instead. [2025-10-10T17:17:31.406435] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-10T17:17:31.406477] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-10T17:17:31.406527] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-10T17:17:31.406563] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-10T17:17:31.498182] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-10T17:17:31.798796] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:17:32.289398] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-10T17:17:32.660265] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T17:17:32.802123] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T17:17:33.089427] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-10T17:17:33.889429] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-10T17:17:34.533573] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-10T17:17:34.573662] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-10T17:17:34.689433] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-10T17:17:35.043601] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-10T17:17:35.336490] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-10T17:17:35.489449] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-10T17:17:36.289380] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-10T17:17:37.089391] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-10T17:17:37.473487] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T17:17:37.623638] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-10T17:17:37.676042] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T17:17:37.889399] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-10T17:17:38.603074] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-10T17:17:38.689418] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-10T17:17:39.489428] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-10T17:17:40.289366] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-10T17:17:40.512859] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T17:17:40.986612] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-10T17:17:41.089443] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-10T17:17:41.517337] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-10T17:17:41.822237] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-10T17:17:41.889448] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-10T17:17:42.689408] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-10T17:17:43.197804] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-10T17:17:43.489409] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-10T17:17:43.746751] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-10T17:17:43.881509] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-10T17:17:44.289395] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-10T17:17:45.089478] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-10T17:17:45.858005] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T17:17:45.879028] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-10T17:17:45.889343] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-10T17:17:46.576302] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-10T17:17:46.689427] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-10T17:17:47.489407] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-10T17:17:48.002155] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-10T17:17:48.003304] [INFO ] [REMOTE ] AQNB: Full fetch complete (5579 records). [2025-10-10T17:17:48.003392] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-10T17:17:48.299717] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-10T17:17:48.400753] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-10T17:17:48.400858] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-10T17:17:48.401094] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-10T17:17:48.401159] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-10T17:17:48.401580] [DEBUG] [LOCAL ] AQNB: Trimmed 5579 records to 4197 (keeping 200 days of data) [2025-10-10T17:17:48.428465] [DEBUG] [LOCAL ] AQNB: Primary data saved (4197 records). [2025-10-10T17:17:48.428612] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-10T17:17:48.428742] [INFO ] [MAIN ] Update Progress: 136/2373 symbols completed. AQNB took 25.6s. Estimated remaining: 4h 51m 48s. Rate: 7.7 symbols/min [2025-10-10T17:17:48.618825] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:17:48.666113] [DEBUG] [LOCAL ] ARCO: Loaded 44723 existing records from primary storage. [2025-10-10T17:17:48.666488] [INFO ] [MAIN ] ARCO: Loaded 44723 existing records. [2025-10-10T17:17:48.859495] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:17:48.859942] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-10T17:17:48.860006] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-10T17:17:48.888513] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-10T17:17:48.891954] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-10T17:17:48.937448] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-10T17:17:49.097333] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-10T17:17:49.294217] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:17:49.889354] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-10T17:17:50.545540] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-10T17:17:50.674588] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-10T17:17:50.689351] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-10T17:17:51.193709] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T17:17:51.489389] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-10T17:17:52.289420] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-10T17:17:52.544038] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T17:17:53.060699] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T17:17:53.089344] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-10T17:17:53.889426] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-10T17:17:54.151341] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T17:17:54.689424] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-10T17:17:55.210808] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-10T17:17:55.489387] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-10T17:17:55.881743] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-10T17:17:56.289461] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-10T17:17:56.443131] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T17:17:56.939904] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-10T17:17:57.089425] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-10T17:17:57.889413] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-10T17:17:58.084141] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-10T17:17:58.089797] [INFO ] [REMOTE ] AQN: Full fetch complete (74858 records). [2025-10-10T17:17:58.089989] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-10T17:17:58.091207] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:17:58.091328] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:17:58.091374] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:17:58.091454] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-10T17:17:58.091530] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-10T17:17:58.091570] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-10T17:17:58.091611] [DEBUG] [LOCAL ] AQN: No derivative data file found to delete. [2025-10-10T17:17:58.091751] [INFO ] [MAIN ] Update Progress: 137/2373 symbols completed. AQN took 35.8s. Estimated remaining: 4h 52m 10s. Rate: 7.7 symbols/min [2025-10-10T17:17:58.268774] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:17:58.268991] [DEBUG] [LOCAL ] ARDC: No existing data file found in primary storage. [2025-10-10T17:17:58.269030] [WARN ] [MAIN ] ARDC: No existing data found, performing full refresh instead. [2025-10-10T17:17:58.269150] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-10T17:17:58.269194] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-10T17:17:58.269236] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-10-10T17:17:58.269269] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-10T17:17:58.660608] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:17:58.694445] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-10T17:17:58.702891] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-10T17:17:59.234171] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-10T17:17:59.489399] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-10T17:18:00.289388] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-10T17:18:00.331353] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T17:18:01.089362] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-10T17:18:01.871525] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-10T17:18:01.889334] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-10T17:18:02.217020] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-10T17:18:02.222504] [INFO ] [REMOTE ] APTV: Full fetch complete (75840 records). [2025-10-10T17:18:02.222677] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-10T17:18:02.660891] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-10T17:18:02.671272] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-10T17:18:02.688976] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-10T17:18:02.689967] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-10T17:18:02.691732] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T17:18:02.689404] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-10T17:18:02.706121] [DEBUG] [LOCAL ] APTV: Trimmed 75840 records to 52790 (keeping 200 days of data) [2025-10-10T17:18:03.055778] [DEBUG] [LOCAL ] APTV: Primary data saved (52790 records). [2025-10-10T17:18:03.055980] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-10T17:18:03.056103] [INFO ] [MAIN ] Update Progress: 138/2373 symbols completed. APTV took 46.0s. Estimated remaining: 4h 51m 15s. Rate: 7.7 symbols/min [2025-10-10T17:18:03.240315] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:18:03.269180] [DEBUG] [LOCAL ] ARDT: Loaded 27921 existing records from primary storage. [2025-10-10T17:18:03.269509] [INFO ] [MAIN ] ARDT: Loaded 27921 existing records. [2025-10-10T17:18:03.474712] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:18:03.475077] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-10T17:18:03.475171] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-10T17:18:03.475676] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-10T17:18:03.475771] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-10T17:18:03.501706] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-10T17:18:03.749046] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-10T17:18:03.896994] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:18:04.072121] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-10T17:18:04.289436] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-10T17:18:05.089387] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-10T17:18:05.358202] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-10T17:18:05.683831] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-10T17:18:05.889394] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-10T17:18:06.689366] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-10T17:18:06.875469] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-10T17:18:06.985789] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T17:18:07.489428] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-10T17:18:08.004202] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-10T17:18:08.289390] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-10T17:18:09.089379] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-10T17:18:09.167393] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-10T17:18:09.381306] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-10T17:18:09.387057] [INFO ] [REMOTE ] AR: Full fetch complete (77548 records). [2025-10-10T17:18:09.387265] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-10T17:18:09.816439] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-10T17:18:09.816536] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-10T17:18:09.817419] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-10T17:18:09.817488] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-10T17:18:09.819105] [DEBUG] [LOCAL ] AR: Trimmed 77548 records to 54366 (keeping 200 days of data) [2025-10-10T17:18:09.900961] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-10T17:18:10.141128] [DEBUG] [LOCAL ] AR: Primary data saved (54366 records). [2025-10-10T17:18:10.141301] [INFO ] [MAIN ] AR: Full history saved. [2025-10-10T17:18:10.141384] [INFO ] [MAIN ] Update Progress: 139/2373 symbols completed. AR took 38.9s. Estimated remaining: 4h 50m 56s. Rate: 7.7 symbols/min [2025-10-10T17:18:10.315022] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:18:10.344025] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-10T17:18:10.407622] [DEBUG] [LOCAL ] ARE: Loaded 51142 existing records from primary storage. [2025-10-10T17:18:10.408095] [INFO ] [MAIN ] ARE: Loaded 51142 existing records. [2025-10-10T17:18:10.593952] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:18:10.594254] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-10T17:18:10.594306] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-10T17:18:10.594737] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-10T17:18:10.594795] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-10T17:18:10.696929] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-10T17:18:11.007725] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:18:11.094524] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-10T17:18:11.489374] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-10T17:18:12.183973] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-10T17:18:12.289335] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-10T17:18:12.424581] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T17:18:13.089386] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-10T17:18:13.627505] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T17:18:13.889376] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-10T17:18:14.689468] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-10T17:18:14.757680] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-10T17:18:15.137359] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T17:18:15.489377] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-10T17:18:15.573767] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-10T17:18:16.289387] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-10T17:18:17.089369] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-10T17:18:17.329852] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T17:18:17.744160] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-10T17:18:17.889384] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-10T17:18:18.689410] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-10T17:18:18.762471] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-10T17:18:18.766484] [INFO ] [REMOTE ] ARCO: Full fetch complete (64838 records). [2025-10-10T17:18:18.766629] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-10T17:18:18.767365] [FATAL] [VALIDATOR ] ARCO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:18:18.767446] [FATAL] [MAIN ] ARCO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:18:18.767512] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:18:18.767581] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-10T17:18:18.767668] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-10T17:18:18.767735] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-10-10T17:18:18.767929] [DEBUG] [LOCAL ] ARCO: Deleted derivative data file. [2025-10-10T17:18:18.768023] [INFO ] [MAIN ] Update Progress: 140/2373 symbols completed. ARCO took 30.3s. Estimated remaining: 4h 51m 1s. Rate: 7.7 symbols/min [2025-10-10T17:18:18.935141] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:18:18.986715] [DEBUG] [LOCAL ] ARES: Loaded 50035 existing records from primary storage. [2025-10-10T17:18:18.987083] [INFO ] [MAIN ] ARES: Loaded 50035 existing records. [2025-10-10T17:18:19.165955] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:18:19.166205] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-10T17:18:19.166254] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-10T17:18:19.167496] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-10T17:18:19.167556] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-10T17:18:19.495186] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-10T17:18:19.538417] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:18:19.693671] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T17:18:19.852383] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-10T17:18:20.289452] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-10T17:18:20.574360] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-10T17:18:21.075122] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-10T17:18:21.089344] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-10T17:18:21.889370] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-10T17:18:22.190754] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-10T17:18:22.689429] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-10T17:18:23.374119] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-10T17:18:23.489383] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-10T17:18:24.289346] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-10T17:18:24.436897] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-10T17:18:24.667500] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T17:18:25.089368] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-10T17:18:25.889367] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-10T17:18:26.193880] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T17:18:26.689379] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-10T17:18:26.760610] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T17:18:26.861313] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-10T17:18:27.489347] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-10T17:18:27.911952] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T17:18:28.289430] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-10T17:18:29.089350] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-10T17:18:29.338441] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T17:18:29.339681] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-10T17:18:29.352753] [INFO ] [REMOTE ] ARDC: Full fetch complete (21238 records). [2025-10-10T17:18:29.352993] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-10T17:18:29.721936] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-10T17:18:29.722041] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-10T17:18:29.722491] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-10T17:18:29.722535] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-10T17:18:29.723608] [DEBUG] [LOCAL ] ARDC: Trimmed 21238 records to 15383 (keeping 200 days of data) [2025-10-10T17:18:29.824191] [DEBUG] [LOCAL ] ARDC: Primary data saved (15383 records). [2025-10-10T17:18:29.824373] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-10T17:18:29.824463] [INFO ] [MAIN ] Update Progress: 141/2373 symbols completed. ARDC took 31.7s. Estimated remaining: 4h 51m 44s. Rate: 7.7 symbols/min [2025-10-10T17:18:29.894692] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-10T17:18:30.011821] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:18:30.058017] [DEBUG] [LOCAL ] ARI: Loaded 43991 existing records from primary storage. [2025-10-10T17:18:30.058413] [INFO ] [MAIN ] ARI: Loaded 43991 existing records. [2025-10-10T17:18:30.246634] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:18:30.246977] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-10T17:18:30.247033] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-10T17:18:30.247601] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-10T17:18:30.247722] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-10T17:18:30.652559] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:18:30.672085] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T17:18:30.689323] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-10T17:18:31.489381] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-10T17:18:31.780234] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T17:18:32.278835] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T17:18:32.289331] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-10T17:18:33.089433] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-10T17:18:33.493317] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T17:18:33.752573] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-10T17:18:33.889387] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-10T17:18:34.689401] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-10T17:18:35.165076] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T17:18:35.223267] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-10T17:18:35.489369] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-10T17:18:36.289420] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-10T17:18:36.653982] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T17:18:37.089443] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-10T17:18:37.446136] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T17:18:37.889423] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-10T17:18:38.214888] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T17:18:38.689419] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-10T17:18:39.279949] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-10T17:18:39.489375] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-10T17:18:39.522373] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T17:18:39.825320] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T17:18:39.828525] [INFO ] [REMOTE ] ARDT: Full fetch complete (41487 records). [2025-10-10T17:18:39.828616] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-10T17:18:40.196147] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-10T17:18:40.196229] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-10T17:18:40.196793] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-10T17:18:40.196854] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-10T17:18:40.197805] [DEBUG] [LOCAL ] ARDT: Trimmed 41487 records to 28107 (keeping 200 days of data) [2025-10-10T17:18:40.292883] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-10T17:18:40.373327] [DEBUG] [LOCAL ] ARDT: Primary data saved (28107 records). [2025-10-10T17:18:40.373492] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-10T17:18:40.373578] [INFO ] [MAIN ] Update Progress: 142/2373 symbols completed. ARDT took 37.3s. Estimated remaining: 4h 52m 19s. Rate: 7.6 symbols/min [2025-10-10T17:18:40.549632] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:18:40.589166] [DEBUG] [LOCAL ] ARIS: Loaded 42740 existing records from primary storage. [2025-10-10T17:18:40.589477] [INFO ] [MAIN ] ARIS: Loaded 42740 existing records. [2025-10-10T17:18:40.761300] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:18:40.761531] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-10T17:18:40.761578] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-10T17:18:40.762209] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-10-10T17:18:40.762268] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-10T17:18:41.114250] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-10T17:18:41.119063] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:18:41.554082] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-10T17:18:41.889401] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-10T17:18:42.036606] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-10T17:18:42.519078] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-10T17:18:42.689407] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-10T17:18:43.489358] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-10T17:18:43.583486] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T17:18:43.994857] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T17:18:44.289431] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-10T17:18:45.089380] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-10T17:18:45.406870] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T17:18:45.889347] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-10T17:18:46.019987] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T17:18:46.689423] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-10T17:18:46.897182] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T17:18:47.326970] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T17:18:47.489360] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-10T17:18:48.265339] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T17:18:48.270752] [INFO ] [REMOTE ] ARE: Full fetch complete (72729 records). [2025-10-10T17:18:48.270977] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-10T17:18:48.295049] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-10T17:18:48.838056] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-10T17:18:48.838285] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-10T17:18:48.839675] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-10T17:18:48.839775] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-10T17:18:48.841759] [DEBUG] [LOCAL ] ARE: Trimmed 72729 records to 51530 (keeping 200 days of data) [2025-10-10T17:18:49.090540] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-10T17:18:49.136354] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-10T17:18:49.261121] [DEBUG] [LOCAL ] ARE: Primary data saved (51530 records). [2025-10-10T17:18:49.261287] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-10T17:18:49.261667] [INFO ] [MAIN ] Update Progress: 143/2373 symbols completed. ARE took 39.1s. Estimated remaining: 4h 52m 27s. Rate: 7.6 symbols/min [2025-10-10T17:18:49.431586] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:18:49.474595] [DEBUG] [LOCAL ] ARLO: Loaded 43989 existing records from primary storage. [2025-10-10T17:18:49.474946] [INFO ] [MAIN ] ARLO: Loaded 43989 existing records. [2025-10-10T17:18:49.648566] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:18:49.648823] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-10T17:18:49.648875] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-10T17:18:49.649283] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-10T17:18:49.649341] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-10T17:18:49.897294] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-10T17:18:49.999835] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:18:50.264025] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-10T17:18:50.371756] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T17:18:50.689417] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-10T17:18:51.489434] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-10T17:18:51.775005] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-10T17:18:51.780138] [INFO ] [REMOTE ] ARES: Full fetch complete (70935 records). [2025-10-10T17:18:51.780259] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-10T17:18:52.165934] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-10T17:18:52.166036] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-10T17:18:52.166777] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-10T17:18:52.166841] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-10T17:18:52.168281] [DEBUG] [LOCAL ] ARES: Trimmed 70935 records to 50417 (keeping 200 days of data) [2025-10-10T17:18:52.294254] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-10T17:18:52.489323] [DEBUG] [LOCAL ] ARES: Primary data saved (50417 records). [2025-10-10T17:18:52.489943] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-10T17:18:52.490098] [INFO ] [MAIN ] Update Progress: 144/2373 symbols completed. ARES took 33.7s. Estimated remaining: 4h 51m 8s. Rate: 7.7 symbols/min [2025-10-10T17:18:52.631616] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T17:18:52.693693] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:18:52.741291] [DEBUG] [LOCAL ] ARMK: Loaded 50707 existing records from primary storage. [2025-10-10T17:18:52.741630] [INFO ] [MAIN ] ARMK: Loaded 50707 existing records. [2025-10-10T17:18:52.919901] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:18:52.920242] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-10T17:18:52.920297] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-10T17:18:52.920691] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-10T17:18:52.920770] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-10T17:18:53.109225] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-10T17:18:53.300603] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:18:53.332358] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-10T17:18:53.889385] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-10T17:18:54.288015] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T17:18:54.344002] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-10T17:18:54.689400] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-10T17:18:55.489369] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-10T17:18:55.759324] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T17:18:56.289390] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-10T17:18:56.360415] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-10T17:18:56.547636] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-10T17:18:57.089376] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-10T17:18:57.593464] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T17:18:57.889409] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-10T17:18:58.689416] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-10T17:18:58.874310] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T17:18:59.489357] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-10T17:18:59.702471] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-10T17:19:00.289350] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-10T17:19:00.370027] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T17:19:01.089376] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-10T17:19:01.543071] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-10T17:19:01.889403] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-10T17:19:02.219682] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T17:19:02.689359] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-10T17:19:02.922438] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T17:19:03.489450] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-10T17:19:03.658525] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T17:19:03.801024] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-10T17:19:04.289391] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-10T17:19:04.814966] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-10T17:19:05.089367] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-10T17:19:05.889384] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-10T17:19:06.109400] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T17:19:06.334164] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T17:19:06.689399] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-10T17:19:07.489383] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-10T17:19:07.694988] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-10T17:19:08.289456] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-10T17:19:08.491537] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-10T17:19:08.496306] [INFO ] [REMOTE ] ARI: Full fetch complete (62513 records). [2025-10-10T17:19:08.496496] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-10T17:19:08.960501] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-10T17:19:08.961220] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-10T17:19:08.962173] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-10T17:19:08.963307] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-10T17:19:08.973189] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-10T17:19:08.975591] [DEBUG] [LOCAL ] ARI: Trimmed 62513 records to 44298 (keeping 200 days of data) [2025-10-10T17:19:09.089509] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-10T17:19:09.269045] [DEBUG] [LOCAL ] ARI: Primary data saved (44298 records). [2025-10-10T17:19:09.269192] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-10T17:19:09.269274] [INFO ] [MAIN ] Update Progress: 145/2373 symbols completed. ARI took 39.4s. Estimated remaining: 4h 53m 17s. Rate: 7.6 symbols/min [2025-10-10T17:19:09.441143] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:19:09.486774] [DEBUG] [LOCAL ] AROC: Loaded 49324 existing records from primary storage. [2025-10-10T17:19:09.487112] [INFO ] [MAIN ] AROC: Loaded 49324 existing records. [2025-10-10T17:19:09.676135] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:19:09.676455] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-10T17:19:09.676503] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-10T17:19:09.677019] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-10T17:19:09.677076] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-10T17:19:09.893926] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-10T17:19:10.033264] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:19:10.248609] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T17:19:10.566229] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-10T17:19:10.689393] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-10T17:19:11.489370] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-10T17:19:11.808457] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T17:19:12.289407] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-10T17:19:12.524442] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T17:19:12.920189] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T17:19:13.089366] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-10T17:19:13.760105] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-10T17:19:13.889368] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-10T17:19:14.380598] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-10T17:19:14.689415] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-10T17:19:15.489395] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-10T17:19:15.701247] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T17:19:16.289413] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-10T17:19:16.555447] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T17:19:16.560891] [INFO ] [REMOTE ] ARIS: Full fetch complete (61278 records). [2025-10-10T17:19:16.561095] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-10T17:19:16.954199] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-10-10T17:19:16.954350] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-10-10T17:19:16.955126] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-10-10T17:19:16.955190] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-10-10T17:19:16.958441] [DEBUG] [LOCAL ] ARIS: Trimmed 61278 records to 43096 (keeping 200 days of data) [2025-10-10T17:19:17.130914] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-10T17:19:17.224186] [DEBUG] [LOCAL ] ARIS: Primary data saved (43096 records). [2025-10-10T17:19:17.224337] [INFO ] [MAIN ] ARIS: Full history saved. [2025-10-10T17:19:17.225029] [INFO ] [MAIN ] Update Progress: 146/2373 symbols completed. ARIS took 36.9s. Estimated remaining: 4h 53m 10s. Rate: 7.6 symbols/min [2025-10-10T17:19:17.406568] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T17:19:17.442708] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:19:17.497441] [DEBUG] [LOCAL ] ARR: Loaded 52462 existing records from primary storage. [2025-10-10T17:19:17.497784] [INFO ] [MAIN ] ARR: Loaded 52462 existing records. [2025-10-10T17:19:17.675226] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:19:17.675674] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-10T17:19:17.675748] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-10T17:19:17.690815] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-10T17:19:17.691364] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-10T17:19:17.692224] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-10T17:19:17.776707] [INFO ] [REMOTE ] ARLO: Full fetch complete (62531 records). [2025-10-10T17:19:17.794847] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-10T17:19:17.804211] [FATAL] [VALIDATOR ] ARLO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:19:17.814738] [FATAL] [MAIN ] ARLO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:19:17.825210] [WARN ] [MAIN ] ARLO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:19:17.848087] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-10T17:19:17.856734] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-10T17:19:17.856825] [INFO ] [LOCAL ] ARLO: Starting deletion of derivative data. [2025-10-10T17:19:17.896799] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-10T17:19:17.912530] [DEBUG] [LOCAL ] ARLO: Deleted derivative data file. [2025-10-10T17:19:17.919681] [INFO ] [MAIN ] Update Progress: 147/2373 symbols completed. ARLO took 28.7s. Estimated remaining: 4h 51m 13s. Rate: 7.6 symbols/min [2025-10-10T17:19:18.227566] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:19:18.246932] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:19:18.294477] [DEBUG] [LOCAL ] ARW: Loaded 33052 existing records from primary storage. [2025-10-10T17:19:18.294962] [INFO ] [MAIN ] ARW: Loaded 33052 existing records. [2025-10-10T17:19:18.486511] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:19:18.487094] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-10T17:19:18.487193] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-10T17:19:18.487679] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-10T17:19:18.487747] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-10T17:19:18.699130] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-10T17:19:18.868502] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:19:18.903853] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T17:19:19.489355] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-10T17:19:19.958327] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-10T17:19:20.289361] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-10T17:19:20.383514] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T17:19:21.089394] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-10T17:19:21.351954] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T17:19:21.889401] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-10T17:19:22.003017] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T17:19:22.622253] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-10T17:19:22.689398] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-10T17:19:23.489361] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-10T17:19:23.739810] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T17:19:24.167348] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-10T17:19:24.289343] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-10T17:19:25.089384] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-10T17:19:25.439927] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T17:19:25.889419] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-10T17:19:26.330617] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T17:19:26.689408] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-10T17:19:26.953582] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T17:19:27.489409] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-10T17:19:28.053858] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T17:19:28.289415] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-10T17:19:28.334422] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T17:19:29.034705] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T17:19:29.089407] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-10T17:19:29.889433] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-10T17:19:30.267453] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-10T17:19:30.487981] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-10T17:19:30.689392] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-10T17:19:31.489378] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-10T17:19:31.794613] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-10T17:19:32.289459] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-10T17:19:32.962617] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-10T17:19:33.089428] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-10T17:19:33.431402] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T17:19:33.522134] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-10T17:19:33.889422] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-10T17:19:34.689382] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-10T17:19:34.725669] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-10T17:19:35.489364] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-10T17:19:35.757700] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T17:19:35.762861] [INFO ] [REMOTE ] ARMK: Full fetch complete (72664 records). [2025-10-10T17:19:35.763013] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-10T17:19:36.176806] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-10T17:19:36.176959] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-10T17:19:36.178068] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-10T17:19:36.178142] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-10T17:19:36.180313] [DEBUG] [LOCAL ] ARMK: Trimmed 72664 records to 51094 (keeping 200 days of data) [2025-10-10T17:19:36.289470] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-10T17:19:36.537718] [DEBUG] [LOCAL ] ARMK: Primary data saved (51094 records). [2025-10-10T17:19:36.539503] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-10T17:19:36.539809] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-10T17:19:36.548439] [INFO ] [MAIN ] Update Progress: 148/2373 symbols completed. ARMK took 44.1s. Estimated remaining: 4h 53m 47s. Rate: 7.6 symbols/min [2025-10-10T17:19:36.728276] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:19:36.728541] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-10T17:19:36.728583] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-10T17:19:36.728736] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-10T17:19:36.728783] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-10T17:19:36.728836] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-10T17:19:36.728875] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-10T17:19:37.101588] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-10T17:19:37.106790] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:19:37.179496] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-10T17:19:37.889447] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-10T17:19:38.119730] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T17:19:38.673000] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-10T17:19:38.689349] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-10T17:19:39.489362] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-10T17:19:39.673401] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T17:19:40.201062] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-10T17:19:40.289373] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-10T17:19:40.771044] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T17:19:41.089421] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-10T17:19:41.319069] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:19:41.319394] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-10T17:19:41.319487] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:19:41.319534] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-10T17:19:41.319570] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:19:41.319610] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-10T17:19:41.319694] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-10T17:19:41.319751] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-10T17:19:41.319795] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-10T17:19:41.319843] [INFO ] [MAIN ] Update Progress: 149/2373 symbols completed. ARX took 4.8s. Estimated remaining: 4h 52m 52s. Rate: 7.6 symbols/min [2025-10-10T17:19:41.516101] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:19:41.567257] [DEBUG] [LOCAL ] AS: Loaded 53512 existing records from primary storage. [2025-10-10T17:19:41.567621] [INFO ] [MAIN ] AS: Loaded 53512 existing records. [2025-10-10T17:19:41.770848] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:19:41.771045] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-10T17:19:41.771106] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-10T17:19:41.771433] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-10T17:19:41.771510] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-10T17:19:41.894516] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-10T17:19:42.191722] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:19:42.406268] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-10T17:19:42.689407] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-10T17:19:43.489483] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-10T17:19:43.510917] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T17:19:44.289391] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-10T17:19:44.554626] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T17:19:45.089383] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-10T17:19:45.341903] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-10T17:19:45.347292] [INFO ] [REMOTE ] ARR: Full fetch complete (75275 records). [2025-10-10T17:19:45.347470] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-10T17:19:45.758165] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-10T17:19:45.758278] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-10T17:19:45.759510] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-10T17:19:45.759584] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-10T17:19:45.761617] [DEBUG] [LOCAL ] ARR: Trimmed 75275 records to 52847 (keeping 200 days of data) [2025-10-10T17:19:45.889519] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-10T17:19:46.118177] [DEBUG] [LOCAL ] ARR: Primary data saved (52847 records). [2025-10-10T17:19:46.118357] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-10T17:19:46.118450] [INFO ] [MAIN ] Update Progress: 150/2373 symbols completed. ARR took 28.9s. Estimated remaining: 4h 51m 59s. Rate: 7.6 symbols/min [2025-10-10T17:19:46.294324] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:19:46.326009] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-10T17:19:46.349139] [DEBUG] [LOCAL ] ASA: Loaded 14879 existing records from primary storage. [2025-10-10T17:19:46.349440] [INFO ] [MAIN ] ASA: Loaded 14879 existing records. [2025-10-10T17:19:46.535475] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:19:46.539473] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-10T17:19:46.539677] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-10T17:19:46.540104] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-10T17:19:46.540174] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-10T17:19:46.691168] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-10T17:19:46.896297] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:19:46.997342] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T17:19:47.065840] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-10T17:19:47.489387] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-10T17:19:48.011981] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-10T17:19:48.289378] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-10T17:19:48.657254] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-10T17:19:48.662380] [INFO ] [REMOTE ] AROC: Full fetch complete (70981 records). [2025-10-10T17:19:48.662536] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-10T17:19:49.051065] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-10T17:19:49.051145] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-10T17:19:49.052508] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-10T17:19:49.052570] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-10T17:19:49.053988] [DEBUG] [LOCAL ] AROC: Trimmed 70981 records to 49688 (keeping 200 days of data) [2025-10-10T17:19:49.108013] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-10T17:19:49.348923] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-10T17:19:49.366399] [DEBUG] [LOCAL ] AROC: Primary data saved (49688 records). [2025-10-10T17:19:49.366551] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-10T17:19:49.366639] [INFO ] [MAIN ] Update Progress: 151/2373 symbols completed. AROC took 40.1s. Estimated remaining: 4h 50m 42s. Rate: 7.6 symbols/min [2025-10-10T17:19:49.538246] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:19:49.596138] [DEBUG] [LOCAL ] ASAN: Loaded 53111 existing records from primary storage. [2025-10-10T17:19:49.596550] [INFO ] [MAIN ] ASAN: Loaded 53111 existing records. [2025-10-10T17:19:49.808637] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:19:49.808989] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-10T17:19:49.809063] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-10T17:19:49.809614] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-10T17:19:49.809713] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-10T17:19:49.894501] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-10T17:19:50.215769] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:19:50.689426] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-10T17:19:50.896213] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T17:19:51.489413] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-10T17:19:51.523660] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T17:19:52.289437] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-10T17:19:52.919210] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-10T17:19:52.964450] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-10T17:19:53.089399] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-10T17:19:53.379989] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T17:19:53.889391] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-10T17:19:54.689413] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-10T17:19:55.160864] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-10T17:19:55.233366] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T17:19:55.237065] [INFO ] [REMOTE ] ARW: Full fetch complete (48037 records). [2025-10-10T17:19:55.237181] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-10T17:19:55.501734] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-10T17:19:55.654933] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-10T17:19:55.655730] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-10T17:19:55.656070] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-10T17:19:55.660825] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-10T17:19:55.660901] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-10T17:19:55.662517] [DEBUG] [LOCAL ] ARW: Trimmed 48037 records to 33344 (keeping 200 days of data) [2025-10-10T17:19:55.880408] [DEBUG] [LOCAL ] ARW: Primary data saved (33344 records). [2025-10-10T17:19:55.880601] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-10T17:19:55.880724] [INFO ] [MAIN ] Update Progress: 152/2373 symbols completed. ARW took 37.9s. Estimated remaining: 4h 50m 15s. Rate: 7.7 symbols/min [2025-10-10T17:19:56.050298] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:19:56.099046] [DEBUG] [LOCAL ] ASB: Loaded 49923 existing records from primary storage. [2025-10-10T17:19:56.099438] [INFO ] [MAIN ] ASB: Loaded 49923 existing records. [2025-10-10T17:19:56.277111] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:19:56.277396] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-10T17:19:56.277447] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-10T17:19:56.277798] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-10T17:19:56.277857] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-10T17:19:56.298024] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-10T17:19:56.634684] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:19:57.089462] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-10T17:19:57.362568] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T17:19:57.835328] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-10T17:19:57.889409] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-10T17:19:58.381702] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-10T17:19:58.689432] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-10T17:19:59.489399] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-10T17:19:59.859194] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T17:20:00.060287] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T17:20:00.125048] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-10T17:20:00.289399] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-10T17:20:01.089387] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-10T17:20:01.889395] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-10T17:20:02.097111] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T17:20:02.560031] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-10T17:20:02.689412] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-10T17:20:02.819766] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-10T17:20:03.489397] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-10T17:20:04.289405] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-10T17:20:04.531142] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T17:20:04.958806] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-10T17:20:05.089394] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-10T17:20:05.895218] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-10T17:20:05.901370] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-10T17:20:06.689371] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-10T17:20:07.059872] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T17:20:07.090723] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T17:20:07.489436] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-10T17:20:08.289378] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-10T17:20:08.509707] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T17:20:08.936809] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T17:20:09.089376] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-10T17:20:09.611586] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-10T17:20:09.889409] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-10T17:20:10.689358] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-10T17:20:10.809572] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T17:20:11.489366] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-10T17:20:11.956062] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T17:20:12.289388] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-10T17:20:12.645345] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-10T17:20:12.648200] [INFO ] [REMOTE ] ASA: Full fetch complete (19671 records). [2025-10-10T17:20:12.648284] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-10T17:20:13.021544] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-10T17:20:13.021638] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-10T17:20:13.022076] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-10T17:20:13.022178] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-10T17:20:13.022921] [DEBUG] [LOCAL ] ASA: Trimmed 19671 records to 15035 (keeping 200 days of data) [2025-10-10T17:20:13.092130] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-10T17:20:13.117080] [DEBUG] [LOCAL ] ASA: Primary data saved (15035 records). [2025-10-10T17:20:13.117210] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-10T17:20:13.117302] [INFO ] [MAIN ] Update Progress: 153/2373 symbols completed. ASA took 27.0s. Estimated remaining: 4h 52m 24s. Rate: 7.6 symbols/min [2025-10-10T17:20:13.293324] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:20:13.299990] [DEBUG] [LOCAL ] ASBA: Loaded 3471 existing records from primary storage. [2025-10-10T17:20:13.300237] [INFO ] [MAIN ] ASBA: Loaded 3471 existing records. [2025-10-10T17:20:13.483916] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:20:13.484210] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-10T17:20:13.484274] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-10T17:20:13.484586] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-10T17:20:13.484722] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-10T17:20:13.875373] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:20:13.894464] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-10T17:20:13.916234] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-10T17:20:14.004443] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T17:20:14.689405] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-10T17:20:14.738605] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-10T17:20:14.775268] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-10T17:20:15.489410] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-10T17:20:16.289374] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-10T17:20:16.830720] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T17:20:17.089431] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-10T17:20:17.657296] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T17:20:17.831098] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-10T17:20:17.889369] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-10T17:20:18.689408] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-10T17:20:18.870068] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T17:20:18.875112] [INFO ] [REMOTE ] AS: Full fetch complete (76181 records). [2025-10-10T17:20:18.875278] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-10T17:20:18.876400] [FATAL] [VALIDATOR ] AS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:20:18.876498] [FATAL] [MAIN ] AS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:20:18.876543] [WARN ] [MAIN ] AS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:20:18.876586] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-10T17:20:18.876672] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-10-10T17:20:18.876733] [INFO ] [LOCAL ] AS: Starting deletion of derivative data. [2025-10-10T17:20:18.877002] [DEBUG] [LOCAL ] AS: Deleted derivative data file. [2025-10-10T17:20:18.877143] [INFO ] [MAIN ] Update Progress: 154/2373 symbols completed. AS took 37.6s. Estimated remaining: 4h 51m 45s. Rate: 7.6 symbols/min [2025-10-10T17:20:19.060786] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:20:19.102740] [DEBUG] [LOCAL ] ASC: Loaded 37693 existing records from primary storage. [2025-10-10T17:20:19.103147] [INFO ] [MAIN ] ASC: Loaded 37693 existing records. [2025-10-10T17:20:19.295914] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:20:19.296361] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-10T17:20:19.296424] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-10T17:20:19.297294] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-10T17:20:19.297351] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-10T17:20:19.494895] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-10T17:20:19.736284] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T17:20:19.741786] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:20:20.289351] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-10T17:20:20.383756] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T17:20:20.573615] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T17:20:21.089381] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-10T17:20:21.773744] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-10T17:20:21.889356] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-10T17:20:22.467280] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-10T17:20:22.689381] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-10T17:20:23.489349] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-10T17:20:23.793725] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T17:20:23.866291] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-10T17:20:24.289350] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-10T17:20:24.722068] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T17:20:25.089358] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-10T17:20:25.602559] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T17:20:25.889374] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-10T17:20:26.689391] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-10T17:20:26.934822] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T17:20:27.015893] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-10T17:20:27.489419] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-10T17:20:28.289364] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-10T17:20:28.321699] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T17:20:28.326828] [INFO ] [REMOTE ] ASAN: Full fetch complete (76527 records). [2025-10-10T17:20:28.326997] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-10T17:20:28.720274] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-10T17:20:28.720367] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-10T17:20:28.721129] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-10T17:20:28.721216] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-10T17:20:28.722730] [DEBUG] [LOCAL ] ASAN: Trimmed 76527 records to 53501 (keeping 200 days of data) [2025-10-10T17:20:29.049127] [DEBUG] [LOCAL ] ASAN: Primary data saved (53501 records). [2025-10-10T17:20:29.049364] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-10T17:20:29.049482] [INFO ] [MAIN ] Update Progress: 155/2373 symbols completed. ASAN took 39.7s. Estimated remaining: 4h 52m 10s. Rate: 7.6 symbols/min [2025-10-10T17:20:29.113542] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-10T17:20:29.091076] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-10T17:20:29.303351] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:20:29.328083] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T17:20:29.355256] [DEBUG] [LOCAL ] ASG: Loaded 19644 existing records from primary storage. [2025-10-10T17:20:29.355594] [INFO ] [MAIN ] ASG: Loaded 19644 existing records. [2025-10-10T17:20:29.556116] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:20:29.556429] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-10T17:20:29.556498] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-10T17:20:29.556827] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-10T17:20:29.556896] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-10T17:20:29.897780] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-10T17:20:29.933983] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:20:30.643526] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-10T17:20:30.689397] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-10T17:20:30.867697] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T17:20:30.873198] [INFO ] [REMOTE ] ASB: Full fetch complete (71768 records). [2025-10-10T17:20:30.873372] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-10T17:20:31.075495] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-10T17:20:31.313278] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-10T17:20:31.313377] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-10T17:20:31.314329] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-10T17:20:31.314406] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-10T17:20:31.315972] [DEBUG] [LOCAL ] ASB: Trimmed 71768 records to 50308 (keeping 200 days of data) [2025-10-10T17:20:31.493316] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-10T17:20:31.624982] [DEBUG] [LOCAL ] ASB: Primary data saved (50308 records). [2025-10-10T17:20:31.625147] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-10T17:20:31.625625] [INFO ] [MAIN ] Update Progress: 156/2373 symbols completed. ASB took 35.7s. Estimated remaining: 4h 50m 46s. Rate: 7.6 symbols/min [2025-10-10T17:20:31.789682] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:20:31.813853] [DEBUG] [LOCAL ] ASGI: Loaded 22863 existing records from primary storage. [2025-10-10T17:20:31.814094] [INFO ] [MAIN ] ASGI: Loaded 22863 existing records. [2025-10-10T17:20:31.984265] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:20:31.984518] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-10T17:20:31.984566] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-10T17:20:31.984911] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-10T17:20:31.984967] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-10T17:20:32.294468] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-10T17:20:32.339430] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:20:32.855185] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T17:20:33.028915] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-10T17:20:33.089369] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-10T17:20:33.564186] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-10T17:20:33.889397] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-10T17:20:34.689376] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-10T17:20:35.358064] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-10T17:20:35.489391] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-10T17:20:35.913752] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-10T17:20:36.289381] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-10T17:20:37.089365] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-10T17:20:37.292058] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T17:20:37.554102] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T17:20:37.744945] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-10T17:20:37.889376] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-10T17:20:38.689375] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-10T17:20:39.206542] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-10T17:20:39.207606] [INFO ] [REMOTE ] ASBA: Full fetch complete (5203 records). [2025-10-10T17:20:39.207703] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-10T17:20:39.494496] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-10T17:20:39.590839] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-10T17:20:39.590983] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-10T17:20:39.591222] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-10T17:20:39.591400] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-10T17:20:39.592245] [DEBUG] [LOCAL ] ASBA: Trimmed 5203 records to 3495 (keeping 200 days of data) [2025-10-10T17:20:39.623161] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T17:20:39.644026] [DEBUG] [LOCAL ] ASBA: Primary data saved (3495 records). [2025-10-10T17:20:39.644495] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-10T17:20:39.644612] [INFO ] [MAIN ] Update Progress: 157/2373 symbols completed. ASBA took 26.5s. Estimated remaining: 4h 50m 40s. Rate: 7.6 symbols/min [2025-10-10T17:20:40.289376] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-10T17:20:40.906622] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-10T17:20:41.089359] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-10T17:20:41.385584] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-10T17:20:41.889418] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-10T17:20:42.252065] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T17:20:42.689396] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-10T17:20:43.489428] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-10T17:20:43.661794] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T17:20:43.729975] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-10T17:20:44.148488] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-10T17:20:44.289410] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-10T17:20:45.089443] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-10T17:20:45.222018] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T17:20:45.873525] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-10T17:20:45.889335] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-10T17:20:46.689426] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-10T17:20:47.090688] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T17:20:47.489381] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-10T17:20:48.032594] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T17:20:48.289346] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-10T17:20:48.289291] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-10T17:20:49.089356] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-10T17:20:49.889411] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-10T17:20:50.317893] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-10T17:20:50.342938] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-10T17:20:50.689393] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-10T17:20:50.792586] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T17:20:51.489408] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-10T17:20:52.255833] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T17:20:52.289336] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-10T17:20:52.765353] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-10T17:20:53.089467] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-10T17:20:53.527950] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-10T17:20:53.532478] [INFO ] [REMOTE ] ASC: Full fetch complete (56298 records). [2025-10-10T17:20:53.532727] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-10T17:20:53.907826] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-10T17:20:53.945477] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-10T17:20:53.945702] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-10T17:20:53.946508] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-10T17:20:53.946799] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-10T17:20:53.958526] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-10T17:20:53.963480] [DEBUG] [LOCAL ] ASC: Trimmed 56298 records to 37942 (keeping 200 days of data) [2025-10-10T17:20:54.192624] [DEBUG] [LOCAL ] ASC: Primary data saved (37942 records). [2025-10-10T17:20:54.192808] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-10T17:20:54.192892] [INFO ] [MAIN ] Update Progress: 158/2373 symbols completed. ASC took 35.3s. Estimated remaining: 4h 52m 6s. Rate: 7.6 symbols/min [2025-10-10T17:20:54.689398] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-10T17:20:54.801821] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-10T17:20:55.489399] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-10T17:20:55.823179] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T17:20:56.289346] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-10T17:20:56.410405] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-10T17:20:57.027204] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T17:20:57.029150] [INFO ] [REMOTE ] ASG: Full fetch complete (30974 records). [2025-10-10T17:20:57.029226] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-10T17:20:57.096469] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-10T17:20:57.388603] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-10T17:20:57.388709] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-10T17:20:57.389130] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-10T17:20:57.389171] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-10T17:20:57.389896] [DEBUG] [LOCAL ] ASG: Trimmed 30974 records to 19812 (keeping 200 days of data) [2025-10-10T17:20:57.500976] [DEBUG] [LOCAL ] ASG: Primary data saved (19812 records). [2025-10-10T17:20:57.501124] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-10T17:20:57.501204] [INFO ] [MAIN ] Update Progress: 159/2373 symbols completed. ASG took 28.5s. Estimated remaining: 4h 50m 54s. Rate: 7.6 symbols/min [2025-10-10T17:20:58.178022] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T17:20:58.180536] [INFO ] [REMOTE ] ASGI: Full fetch complete (33341 records). [2025-10-10T17:20:58.180615] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-10T17:20:58.548121] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-10T17:20:58.548200] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-10T17:20:58.548633] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-10T17:20:58.548712] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-10T17:20:58.549488] [DEBUG] [LOCAL ] ASGI: Trimmed 33341 records to 23095 (keeping 200 days of data) [2025-10-10T17:20:58.693426] [DEBUG] [LOCAL ] ASGI: Primary data saved (23095 records). [2025-10-10T17:20:58.693712] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-10T17:20:58.693836] [INFO ] [MAIN ] Update Progress: 160/2373 symbols completed. ASGI took 27.1s. Estimated remaining: 4h 49m 14s. Rate: 7.7 symbols/min [2025-10-10T17:20:59.341017] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:20:59.383386] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:20:59.410608] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:20:59.486922] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:20:59.521770] [DEBUG] [LOCAL ] ASIX: Loaded 22989 existing records from primary storage. [2025-10-10T17:20:59.522381] [INFO ] [MAIN ] ASIX: Loaded 22989 existing records. [2025-10-10T17:20:59.643189] [DEBUG] [LOCAL ] ASH: Loaded 37885 existing records from primary storage. [2025-10-10T17:20:59.678926] [INFO ] [MAIN ] ASH: Loaded 37885 existing records. [2025-10-10T17:20:59.712022] [DEBUG] [LOCAL ] ASPN: Loaded 50114 existing records from primary storage. [2025-10-10T17:20:59.728282] [DEBUG] [LOCAL ] ASGN: Loaded 36566 existing records from primary storage. [2025-10-10T17:20:59.796329] [INFO ] [MAIN ] ASPN: Loaded 50114 existing records. [2025-10-10T17:20:59.870376] [INFO ] [MAIN ] ASGN: Loaded 36566 existing records. [2025-10-10T17:20:59.940248] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:21:00.038982] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-10T17:21:00.060822] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-10T17:21:00.264263] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:21:00.280903] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-10T17:21:00.291372] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-10T17:21:00.269703] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-10T17:21:00.355581] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-10T17:21:00.355960] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-10T17:21:00.356145] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-10T17:21:00.481518] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:21:00.488795] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:21:00.510727] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-10T17:21:00.521839] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-10T17:21:00.533383] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-10T17:21:00.564287] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-10T17:21:00.575253] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-10T17:21:00.575405] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-10T17:21:00.580578] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-10T17:21:00.657846] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-10T17:21:01.551212] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:21:01.577411] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-10T17:21:01.857073] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:21:01.890051] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-10T17:21:01.913279] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:21:01.919885] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-10T17:21:02.003936] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:21:02.004338] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-10T17:21:03.131721] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T17:21:03.135739] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-10T17:21:03.398884] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-10T17:21:03.409439] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-10T17:21:03.600118] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T17:21:03.607326] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-10T17:21:03.695229] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T17:21:03.704294] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-10T17:21:03.745275] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-10T17:21:04.289434] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-10T17:21:05.001233] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T17:21:05.089373] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-10T17:21:05.298890] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T17:21:05.368985] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T17:21:05.382302] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T17:21:05.889728] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-10T17:21:05.890491] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-10T17:21:06.689383] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-10T17:21:07.489363] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-10T17:21:07.621783] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T17:21:08.289415] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-10T17:21:08.713682] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T17:21:09.089578] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-10T17:21:09.095131] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T17:21:09.133306] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-10T17:21:09.889388] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-10T17:21:10.689362] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-10T17:21:10.791317] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-10T17:21:11.489344] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-10T17:21:11.524334] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-10T17:21:11.675996] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T17:21:12.289386] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-10T17:21:13.089359] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-10T17:21:13.243003] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T17:21:13.590991] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T17:21:13.889405] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-10T17:21:14.376800] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-10T17:21:14.689357] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-10T17:21:15.489354] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-10T17:21:15.878623] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T17:21:16.289342] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-10T17:21:16.393638] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T17:21:16.939534] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T17:21:17.089369] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-10T17:21:17.831718] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-10T17:21:17.889381] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-10T17:21:18.420000] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T17:21:18.689483] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-10T17:21:19.381764] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-10T17:21:19.489362] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-10T17:21:20.289388] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-10T17:21:20.328426] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T17:21:20.917061] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-10T17:21:21.089426] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-10T17:21:21.467940] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T17:21:21.889371] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-10T17:21:22.608487] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T17:21:22.689346] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-10T17:21:22.816682] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T17:21:22.819420] [INFO ] [REMOTE ] ASIX: Full fetch complete (30560 records). [2025-10-10T17:21:22.819514] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-10T17:21:23.188412] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-10T17:21:23.188548] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-10T17:21:23.188975] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-10T17:21:23.189040] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-10T17:21:23.189856] [DEBUG] [LOCAL ] ASIX: Trimmed 30560 records to 23212 (keeping 200 days of data) [2025-10-10T17:21:23.329375] [DEBUG] [LOCAL ] ASIX: Primary data saved (23212 records). [2025-10-10T17:21:23.329515] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-10T17:21:23.329592] [INFO ] [MAIN ] Update Progress: 161/2373 symbols completed. ASIX took 24.6s. Estimated remaining: 4h 52m 56s. Rate: 7.6 symbols/min [2025-10-10T17:21:23.494566] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-10T17:21:23.497238] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:21:23.510458] [DEBUG] [LOCAL ] ASR: Loaded 9380 existing records from primary storage. [2025-10-10T17:21:23.510848] [INFO ] [MAIN ] ASR: Loaded 9380 existing records. [2025-10-10T17:21:23.687828] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:21:23.688049] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-10T17:21:23.688100] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-10T17:21:23.688372] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-10T17:21:23.688431] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-10T17:21:24.086192] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:21:24.289375] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-10T17:21:24.332258] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T17:21:25.089428] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-10T17:21:25.508663] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-10T17:21:25.566849] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T17:21:25.889382] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-10T17:21:26.689380] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-10T17:21:26.703681] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-10T17:21:26.810722] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-10T17:21:27.489453] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-10T17:21:28.018764] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-10T17:21:28.289371] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-10T17:21:28.837001] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-10T17:21:29.089372] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-10T17:21:29.571445] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T17:21:29.889395] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-10T17:21:30.449413] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-10T17:21:30.689396] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-10T17:21:30.746118] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-10T17:21:31.489379] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-10T17:21:32.289358] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-10T17:21:32.611141] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-10T17:21:32.616139] [INFO ] [REMOTE ] ASPN: Full fetch complete (72426 records). [2025-10-10T17:21:32.616266] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-10T17:21:32.998679] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-10T17:21:32.998776] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-10T17:21:32.999506] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-10T17:21:32.999549] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-10T17:21:33.001154] [DEBUG] [LOCAL ] ASPN: Trimmed 72426 records to 50499 (keeping 200 days of data) [2025-10-10T17:21:33.092854] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-10T17:21:33.298862] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T17:21:33.314098] [DEBUG] [LOCAL ] ASPN: Primary data saved (50499 records). [2025-10-10T17:21:33.314248] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-10T17:21:33.314335] [INFO ] [MAIN ] Update Progress: 162/2373 symbols completed. ASPN took 34.6s. Estimated remaining: 4h 53m 16s. Rate: 7.5 symbols/min [2025-10-10T17:21:33.476533] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:21:33.530602] [DEBUG] [LOCAL ] ASX: Loaded 53246 existing records from primary storage. [2025-10-10T17:21:33.530969] [INFO ] [MAIN ] ASX: Loaded 53246 existing records. [2025-10-10T17:21:33.710137] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:21:33.710465] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-10T17:21:33.710550] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-10T17:21:33.711302] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-10T17:21:33.711460] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-10T17:21:33.822675] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-10T17:21:33.894986] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-10T17:21:34.096204] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:21:34.436829] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-10T17:21:34.689398] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-10T17:21:35.128550] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-10T17:21:35.489385] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-10T17:21:36.289385] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-10T17:21:37.054730] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-10T17:21:37.089334] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-10T17:21:37.227371] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-10T17:21:37.786880] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T17:21:37.791522] [INFO ] [REMOTE ] ASGN: Full fetch complete (52742 records). [2025-10-10T17:21:37.791626] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-10T17:21:37.898110] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-10T17:21:38.192949] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-10T17:21:38.193034] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-10T17:21:38.193616] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-10T17:21:38.193688] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-10T17:21:38.196488] [DEBUG] [LOCAL ] ASGN: Trimmed 52742 records to 36896 (keeping 200 days of data) [2025-10-10T17:21:38.413779] [DEBUG] [LOCAL ] ASGN: Primary data saved (36896 records). [2025-10-10T17:21:38.413981] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-10T17:21:38.414092] [INFO ] [MAIN ] Update Progress: 163/2373 symbols completed. ASGN took 39.7s. Estimated remaining: 4h 52m 30s. Rate: 7.6 symbols/min [2025-10-10T17:21:38.592531] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:21:38.634294] [DEBUG] [LOCAL ] ATEN: Loaded 39032 existing records from primary storage. [2025-10-10T17:21:38.634714] [INFO ] [MAIN ] ATEN: Loaded 39032 existing records. [2025-10-10T17:21:38.696277] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-10T17:21:38.827853] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:21:38.828115] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-10T17:21:38.828164] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-10T17:21:38.828961] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-10T17:21:38.829019] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-10T17:21:39.179872] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:21:39.213755] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-10T17:21:39.347752] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T17:21:39.351683] [INFO ] [REMOTE ] ASH: Full fetch complete (55169 records). [2025-10-10T17:21:39.351787] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-10T17:21:39.503415] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-10T17:21:39.629599] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-10T17:21:39.757776] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-10T17:21:39.757860] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-10T17:21:39.758456] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-10T17:21:39.758497] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-10T17:21:39.759605] [DEBUG] [LOCAL ] ASH: Trimmed 55169 records to 38182 (keeping 200 days of data) [2025-10-10T17:21:39.985188] [DEBUG] [LOCAL ] ASH: Primary data saved (38182 records). [2025-10-10T17:21:39.985334] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-10T17:21:39.985415] [INFO ] [MAIN ] Update Progress: 164/2373 symbols completed. ASH took 41.3s. Estimated remaining: 4h 50m 56s. Rate: 7.6 symbols/min [2025-10-10T17:21:40.148324] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:21:40.178831] [DEBUG] [LOCAL ] ATGE: Loaded 31305 existing records from primary storage. [2025-10-10T17:21:40.179102] [INFO ] [MAIN ] ATGE: Loaded 31305 existing records. [2025-10-10T17:21:40.294525] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-10T17:21:40.360065] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:21:40.360310] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-10T17:21:40.360394] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-10T17:21:40.361035] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-10T17:21:40.361092] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-10T17:21:40.703911] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:21:41.089387] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-10T17:21:41.238915] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-10T17:21:41.478355] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T17:21:41.889387] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-10T17:21:42.689392] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-10T17:21:42.858484] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-10T17:21:43.165677] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-10T17:21:43.489385] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-10T17:21:44.096373] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-10T17:21:44.289355] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-10T17:21:44.516417] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-10T17:21:45.089446] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-10T17:21:45.372347] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-10T17:21:45.889480] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-10T17:21:46.027903] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-10T17:21:46.689414] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-10T17:21:46.895843] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-10T17:21:47.489405] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-10T17:21:48.289399] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-10T17:21:49.091224] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-10T17:21:49.096175] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-10T17:21:49.241374] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-10T17:21:49.889377] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-10T17:21:50.256843] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T17:21:50.694562] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-10T17:21:50.707285] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T17:21:51.494505] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-10T17:21:51.515241] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T17:21:52.289353] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-10T17:21:52.407747] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T17:21:52.535512] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-10T17:21:53.089369] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-10T17:21:53.889409] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-10T17:21:54.280847] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T17:21:54.689375] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-10T17:21:54.919357] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T17:21:55.428080] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T17:21:55.429267] [INFO ] [REMOTE ] ASR: Full fetch complete (12347 records). [2025-10-10T17:21:55.429370] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-10T17:21:55.494460] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-10T17:21:55.792871] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T17:21:55.904616] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-10T17:21:55.904817] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-10T17:21:55.905127] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-10T17:21:55.905189] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-10T17:21:55.905662] [DEBUG] [LOCAL ] ASR: Trimmed 12347 records to 9416 (keeping 200 days of data) [2025-10-10T17:21:55.968064] [DEBUG] [LOCAL ] ASR: Primary data saved (9416 records). [2025-10-10T17:21:55.968221] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-10T17:21:55.968311] [INFO ] [MAIN ] Update Progress: 165/2373 symbols completed. ASR took 32.6s. Estimated remaining: 4h 52m 36s. Rate: 7.5 symbols/min [2025-10-10T17:21:56.135364] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:21:56.168594] [DEBUG] [LOCAL ] ATHM: Loaded 32029 existing records from primary storage. [2025-10-10T17:21:56.168915] [INFO ] [MAIN ] ATHM: Loaded 32029 existing records. [2025-10-10T17:21:56.294573] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-10T17:21:56.354822] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:21:56.355084] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-10T17:21:56.355144] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-10T17:21:56.355515] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-10T17:21:56.355573] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-10T17:21:56.727626] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:21:56.882721] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-10T17:21:57.089368] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-10T17:21:57.682123] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T17:21:57.889424] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-10T17:21:58.592471] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-10T17:21:58.689381] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-10T17:21:59.489346] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-10T17:21:59.667189] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T17:21:59.715317] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T17:22:00.289453] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-10T17:22:01.089376] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-10T17:22:01.665293] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-10T17:22:01.861774] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-10T17:22:01.889368] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-10T17:22:02.689395] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-10T17:22:02.750428] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T17:22:03.489352] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-10T17:22:03.818718] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T17:22:03.917271] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-10T17:22:04.289377] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-10T17:22:05.089363] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-10T17:22:05.292232] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-10T17:22:05.889447] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-10T17:22:06.671309] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-10T17:22:06.694682] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-10T17:22:06.709192] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-10T17:22:07.489363] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-10T17:22:07.566031] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-10T17:22:08.289424] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-10T17:22:08.590804] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T17:22:08.995200] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-10T17:22:08.997910] [INFO ] [REMOTE ] ATGE: Full fetch complete (45941 records). [2025-10-10T17:22:08.997991] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-10T17:22:09.097432] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-10T17:22:09.375098] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-10T17:22:09.375203] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-10T17:22:09.375774] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-10T17:22:09.375839] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-10T17:22:09.377016] [DEBUG] [LOCAL ] ATGE: Trimmed 45941 records to 31480 (keeping 200 days of data) [2025-10-10T17:22:09.564038] [DEBUG] [LOCAL ] ATGE: Primary data saved (31480 records). [2025-10-10T17:22:09.564180] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-10T17:22:09.564262] [INFO ] [MAIN ] Update Progress: 166/2373 symbols completed. ATGE took 29.6s. Estimated remaining: 4h 53m 43s. Rate: 7.5 symbols/min [2025-10-10T17:22:09.741218] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:22:09.750762] [DEBUG] [LOCAL ] ATHS: Loaded 6815 existing records from primary storage. [2025-10-10T17:22:09.751045] [INFO ] [MAIN ] ATHS: Loaded 6815 existing records. [2025-10-10T17:22:09.894909] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-10T17:22:09.933303] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:22:09.933802] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-10T17:22:09.934035] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-10T17:22:09.934333] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-10T17:22:09.934409] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-10T17:22:10.138702] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T17:22:10.329550] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:22:10.662841] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T17:22:10.689418] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-10T17:22:11.489429] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-10T17:22:11.924330] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-10T17:22:11.930211] [INFO ] [REMOTE ] ASX: Full fetch complete (76587 records). [2025-10-10T17:22:11.930427] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-10T17:22:12.304717] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-10T17:22:12.322299] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-10T17:22:12.367087] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-10T17:22:12.367217] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-10T17:22:12.368132] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-10T17:22:12.368221] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-10T17:22:12.369992] [DEBUG] [LOCAL ] ASX: Trimmed 76587 records to 53634 (keeping 200 days of data) [2025-10-10T17:22:12.502010] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T17:22:12.722384] [DEBUG] [LOCAL ] ASX: Primary data saved (53634 records). [2025-10-10T17:22:12.722533] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-10T17:22:12.723034] [INFO ] [MAIN ] Update Progress: 167/2373 symbols completed. ASX took 39.4s. Estimated remaining: 4h 52m 31s. Rate: 7.5 symbols/min [2025-10-10T17:22:12.885808] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:22:12.939487] [DEBUG] [LOCAL ] ATI: Loaded 51732 existing records from primary storage. [2025-10-10T17:22:12.939847] [INFO ] [MAIN ] ATI: Loaded 51732 existing records. [2025-10-10T17:22:13.091954] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-10T17:22:13.113312] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:22:13.114493] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-10T17:22:13.114580] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-10T17:22:13.115060] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-10T17:22:13.115132] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-10T17:22:13.481836] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:22:13.875794] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-10T17:22:13.879868] [INFO ] [REMOTE ] ATEN: Full fetch complete (56840 records). [2025-10-10T17:22:13.879965] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-10T17:22:13.895098] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-10T17:22:14.031380] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-10T17:22:14.280553] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-10T17:22:14.280636] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-10T17:22:14.281346] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-10T17:22:14.281409] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-10T17:22:14.282698] [DEBUG] [LOCAL ] ATEN: Trimmed 56840 records to 39300 (keeping 200 days of data) [2025-10-10T17:22:14.520890] [DEBUG] [LOCAL ] ATEN: Primary data saved (39300 records). [2025-10-10T17:22:14.521035] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-10T17:22:14.521116] [INFO ] [MAIN ] Update Progress: 168/2373 symbols completed. ATEN took 36.1s. Estimated remaining: 4h 51m 3s. Rate: 7.6 symbols/min [2025-10-10T17:22:14.685413] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:22:14.689416] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-10T17:22:14.721499] [DEBUG] [LOCAL ] ATKR: Loaded 35606 existing records from primary storage. [2025-10-10T17:22:14.721868] [INFO ] [MAIN ] ATKR: Loaded 35606 existing records. [2025-10-10T17:22:14.909386] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:22:14.909682] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-10T17:22:14.909742] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-10T17:22:14.910023] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-10T17:22:14.910084] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-10T17:22:15.294502] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:22:15.489395] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-10T17:22:15.569247] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-10T17:22:16.289464] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-10T17:22:16.451702] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T17:22:16.822089] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T17:22:17.089423] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-10T17:22:17.769479] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-10T17:22:17.889373] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-10T17:22:18.217263] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-10T17:22:18.689429] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-10T17:22:19.229348] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-10T17:22:19.264984] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-10T17:22:19.489435] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-10T17:22:20.289435] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-10T17:22:20.883951] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-10T17:22:21.089376] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-10T17:22:21.581439] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-10T17:22:21.779113] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-10T17:22:21.889404] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-10T17:22:22.689388] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-10T17:22:23.489360] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-10T17:22:23.791789] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T17:22:23.904001] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-10T17:22:23.907272] [INFO ] [REMOTE ] ATHM: Full fetch complete (50408 records). [2025-10-10T17:22:23.907399] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-10T17:22:24.288261] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-10T17:22:24.288386] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-10T17:22:24.289005] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-10T17:22:24.289070] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-10T17:22:24.289485] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-10T17:22:24.291588] [DEBUG] [LOCAL ] ATHM: Trimmed 50408 records to 32282 (keeping 200 days of data) [2025-10-10T17:22:24.493076] [DEBUG] [LOCAL ] ATHM: Primary data saved (32282 records). [2025-10-10T17:22:24.493262] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-10T17:22:24.493393] [INFO ] [MAIN ] Update Progress: 169/2373 symbols completed. ATHM took 28.5s. Estimated remaining: 4h 51m 22s. Rate: 7.6 symbols/min [2025-10-10T17:22:24.683385] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:22:24.729173] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T17:22:24.754180] [DEBUG] [LOCAL ] ATMU: Loaded 39408 existing records from primary storage. [2025-10-10T17:22:24.754691] [INFO ] [MAIN ] ATMU: Loaded 39408 existing records. [2025-10-10T17:22:24.963598] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:22:24.963888] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-10T17:22:24.963952] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-10T17:22:24.964283] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-10T17:22:24.964343] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-10T17:22:25.094691] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-10T17:22:25.393283] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:22:25.404037] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-10T17:22:25.889414] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-10T17:22:26.689348] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-10T17:22:27.356158] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-10T17:22:27.489437] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-10T17:22:27.512074] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-10T17:22:27.793334] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T17:22:28.289384] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-10T17:22:29.089447] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-10T17:22:29.146935] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-10T17:22:29.889409] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-10T17:22:30.653424] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-10T17:22:30.689336] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-10T17:22:30.742102] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-10T17:22:31.194345] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (3.70 seconds). [2025-10-10T17:22:31.489386] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-10T17:22:32.031389] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T17:22:32.289423] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-10T17:22:33.089356] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-10T17:22:33.200106] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-10T17:22:33.403213] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-10T17:22:33.889379] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-10T17:22:34.689360] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-10T17:22:34.727749] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-10T17:22:35.027560] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-10T17:22:35.489388] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-10T17:22:36.289376] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-10T17:22:36.297899] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-10T17:22:36.693416] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T17:22:37.089410] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-10T17:22:37.563598] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-10T17:22:37.564801] [INFO ] [REMOTE ] ATHS: Full fetch complete (9687 records). [2025-10-10T17:22:37.564892] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-10T17:22:37.894614] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-10T17:22:38.079393] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-10T17:22:38.079508] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-10T17:22:38.079802] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-10T17:22:38.079957] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-10T17:22:38.080704] [DEBUG] [LOCAL ] ATHS: Trimmed 9687 records to 6841 (keeping 200 days of data) [2025-10-10T17:22:38.123750] [DEBUG] [LOCAL ] ATHS: Primary data saved (6841 records). [2025-10-10T17:22:38.123911] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-10T17:22:38.124066] [INFO ] [MAIN ] Update Progress: 170/2373 symbols completed. ATHS took 28.6s. Estimated remaining: 4h 52m 27s. Rate: 7.5 symbols/min [2025-10-10T17:22:38.316230] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:22:38.343019] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-10T17:22:38.392533] [DEBUG] [LOCAL ] ATO: Loaded 42098 existing records from primary storage. [2025-10-10T17:22:38.392889] [INFO ] [MAIN ] ATO: Loaded 42098 existing records. [2025-10-10T17:22:38.564613] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:22:38.564882] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-10T17:22:38.564929] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-10T17:22:38.565274] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-10T17:22:38.565333] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-10T17:22:38.702038] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-10T17:22:38.914241] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:22:39.489362] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-10T17:22:39.773397] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T17:22:40.289414] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-10T17:22:40.531212] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T17:22:40.863843] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T17:22:41.089383] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-10T17:22:41.889404] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-10T17:22:41.972504] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T17:22:42.689369] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-10T17:22:42.870480] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-10T17:22:43.489400] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-10T17:22:43.714431] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T17:22:44.289368] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-10T17:22:44.331600] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-10T17:22:45.089447] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-10T17:22:45.202720] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T17:22:45.889389] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-10T17:22:45.970144] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T17:22:46.649048] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-10T17:22:46.689332] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-10T17:22:47.489376] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-10T17:22:47.716937] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-10T17:22:47.864687] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-10T17:22:48.289443] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-10T17:22:48.899310] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T17:22:49.089383] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-10T17:22:49.738070] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-10T17:22:49.889411] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-10T17:22:50.689418] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-10T17:22:50.957993] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T17:22:51.297491] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T17:22:51.489369] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-10T17:22:51.976270] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T17:22:52.289373] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-10T17:22:53.089367] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-10T17:22:53.889430] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-10T17:23:06.782480] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (15.29 seconds). [2025-10-10T17:23:06.786709] [INFO ] [REMOTE ] ATMU: Full fetch complete (56651 records). [2025-10-10T17:23:06.786875] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-10T17:23:07.221201] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-10T17:23:07.221425] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-10T17:23:07.222415] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-10T17:23:07.222596] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-10T17:23:07.230771] [DEBUG] [LOCAL ] ATMU: Trimmed 56651 records to 39700 (keeping 200 days of data) [2025-10-10T17:23:07.239353] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (13.35 seconds). [2025-10-10T17:23:07.332305] [INFO ] [REMOTE ] ATI: Full fetch complete (73807 records). [2025-10-10T17:23:07.363683] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (14.27 seconds). [2025-10-10T17:23:07.364624] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-10T17:23:07.388391] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-10T17:23:07.672348] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (15.38 seconds). [2025-10-10T17:23:07.749955] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-10T17:23:07.779972] [DEBUG] [LOCAL ] ATMU: Primary data saved (39700 records). [2025-10-10T17:23:07.786442] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-10T17:23:07.817408] [INFO ] [MAIN ] Update Progress: 171/2373 symbols completed. ATMU took 43.3s. Estimated remaining: 4h 56m 59s. Rate: 7.4 symbols/min [2025-10-10T17:23:08.159714] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:23:08.166014] [DEBUG] [LOCAL ] ATR: No existing data file found in primary storage. [2025-10-10T17:23:08.180958] [WARN ] [MAIN ] ATR: No existing data found, performing full refresh instead. [2025-10-10T17:23:08.184622] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-10T17:23:08.184970] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-10T17:23:08.184850] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-10T17:23:08.185164] [DEBUG] [LOCAL ] ATR: No primary data file found to delete. [2025-10-10T17:23:08.185260] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-10T17:23:08.185338] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-10T17:23:08.191591] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-10T17:23:08.229600] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-10T17:23:08.295399] [DEBUG] [LOCAL ] ATI: Trimmed 73807 records to 52075 (keeping 200 days of data) [2025-10-10T17:23:08.735701] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:23:08.745950] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-10T17:23:08.889733] [DEBUG] [LOCAL ] ATI: Primary data saved (52075 records). [2025-10-10T17:23:08.889949] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-10T17:23:08.892514] [INFO ] [MAIN ] Update Progress: 172/2373 symbols completed. ATI took 56.2s. Estimated remaining: 4h 55m 21s. Rate: 7.5 symbols/min [2025-10-10T17:23:09.110892] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:23:09.134458] [DEBUG] [LOCAL ] ATS: Loaded 17815 existing records from primary storage. [2025-10-10T17:23:09.134821] [INFO ] [MAIN ] ATS: Loaded 17815 existing records. [2025-10-10T17:23:09.333530] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:23:09.334316] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-10T17:23:09.334520] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-10T17:23:09.343847] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-10T17:23:09.344052] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-10T17:23:09.435986] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-10T17:23:09.531847] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T17:23:09.567870] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-10T17:23:09.586496] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-10T17:23:09.847687] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:23:09.848155] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-10T17:23:09.865784] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-10T17:23:09.871924] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-10T17:23:11.069515] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T17:23:11.078516] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-10T17:23:11.117224] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-10T17:23:11.126414] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-10T17:23:11.143450] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-10T17:23:11.151409] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-10T17:23:11.186671] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T17:23:11.190563] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-10T17:23:11.959790] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-10T17:23:11.964182] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-10T17:23:12.429770] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T17:23:12.434673] [INFO ] [REMOTE ] ATKR: Full fetch complete (53178 records). [2025-10-10T17:23:12.434874] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-10T17:23:12.435843] [FATAL] [VALIDATOR ] ATKR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:23:12.435945] [FATAL] [MAIN ] ATKR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:23:12.436083] [WARN ] [MAIN ] ATKR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:23:12.436181] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-10T17:23:12.436289] [DEBUG] [LOCAL ] ATKR: No primary data file found to delete. [2025-10-10T17:23:12.436349] [INFO ] [LOCAL ] ATKR: Starting deletion of derivative data. [2025-10-10T17:23:12.436556] [DEBUG] [LOCAL ] ATKR: Deleted derivative data file. [2025-10-10T17:23:12.436695] [INFO ] [MAIN ] Update Progress: 173/2373 symbols completed. ATKR took 57.9s. Estimated remaining: 4h 54m 16s. Rate: 7.5 symbols/min [2025-10-10T17:23:12.628360] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:23:12.653531] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-10T17:23:12.662910] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-10T17:23:12.702499] [DEBUG] [LOCAL ] ATUS: Loaded 49851 existing records from primary storage. [2025-10-10T17:23:12.702887] [INFO ] [MAIN ] ATUS: Loaded 49851 existing records. [2025-10-10T17:23:12.917045] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:23:12.926265] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-10T17:23:12.928759] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T17:23:12.928374] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T17:23:12.940549] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-10T17:23:12.942038] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-10T17:23:12.943520] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-10T17:23:12.943596] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-10T17:23:12.943476] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-10T17:23:13.291621] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:23:13.291956] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-10T17:23:14.268337] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-10T17:23:14.276241] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-10T17:23:14.302249] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-10T17:23:14.312816] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-10T17:23:14.356028] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-10T17:23:14.360758] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-10T17:23:15.118234] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T17:23:15.128160] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-10T17:23:15.634439] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T17:23:15.638502] [INFO ] [REMOTE ] ATO: Full fetch complete (60386 records). [2025-10-10T17:23:15.638694] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-10T17:23:15.764127] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-10T17:23:15.781444] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-10T17:23:15.976759] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-10T17:23:16.004320] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-10T17:23:16.113000] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-10T17:23:16.113092] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-10T17:23:16.113974] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-10T17:23:16.114058] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-10T17:23:16.115732] [DEBUG] [LOCAL ] ATO: Trimmed 60386 records to 42368 (keeping 200 days of data) [2025-10-10T17:23:16.396248] [DEBUG] [LOCAL ] ATO: Primary data saved (42368 records). [2025-10-10T17:23:16.396390] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-10T17:23:16.396498] [INFO ] [MAIN ] Update Progress: 174/2373 symbols completed. ATO took 38.3s. Estimated remaining: 4h 53m 17s. Rate: 7.5 symbols/min [2025-10-10T17:23:16.562780] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:23:16.612105] [DEBUG] [LOCAL ] AU: Loaded 53379 existing records from primary storage. [2025-10-10T17:23:16.612430] [INFO ] [MAIN ] AU: Loaded 53379 existing records. [2025-10-10T17:23:16.791381] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:23:16.791715] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-10T17:23:16.791771] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-10T17:23:16.792261] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-10T17:23:16.792316] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-10T17:23:17.163027] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-10T17:23:17.179400] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-10T17:23:17.212618] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:23:17.215107] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-10T17:23:17.214717] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-10T17:23:17.227618] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-10T17:23:17.716993] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T17:23:17.724521] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-10T17:23:18.310029] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-10T17:23:18.314548] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-10T17:23:18.479387] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T17:23:18.490573] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-10T17:23:18.647331] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-10T17:23:18.655941] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-10T17:23:18.751848] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T17:23:18.762604] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-10T17:23:19.325828] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-10T17:23:19.331140] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-10T17:23:19.753028] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T17:23:19.764130] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-10T17:23:19.967106] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-10T17:23:20.168679] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-10T17:23:20.289406] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-10T17:23:20.878872] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-10T17:23:20.998716] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T17:23:21.089383] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-10T17:23:21.491970] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T17:23:21.889391] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-10T17:23:22.689401] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-10T17:23:23.282214] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-10T17:23:23.286488] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-10T17:23:23.298689] [INFO ] [REMOTE ] ATS: Full fetch complete (25574 records). [2025-10-10T17:23:23.299396] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-10T17:23:23.491102] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-10T17:23:23.701517] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-10T17:23:23.701617] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-10T17:23:23.702093] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-10T17:23:23.702152] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-10T17:23:23.703949] [DEBUG] [LOCAL ] ATS: Trimmed 25574 records to 17912 (keeping 200 days of data) [2025-10-10T17:23:23.818512] [DEBUG] [LOCAL ] ATS: Primary data saved (17912 records). [2025-10-10T17:23:23.818737] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-10T17:23:23.818857] [INFO ] [MAIN ] Update Progress: 175/2373 symbols completed. ATS took 14.9s. Estimated remaining: 4h 53m 1s. Rate: 7.5 symbols/min [2025-10-10T17:23:23.999158] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:23:24.043147] [DEBUG] [LOCAL ] AUB: Loaded 46506 existing records from primary storage. [2025-10-10T17:23:24.043485] [INFO ] [MAIN ] AUB: Loaded 46506 existing records. [2025-10-10T17:23:24.223313] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:23:24.223836] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-10T17:23:24.223915] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-10T17:23:24.224621] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-10T17:23:24.224874] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-10T17:23:24.299054] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-10T17:23:24.435639] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T17:23:24.638339] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:23:25.089368] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-10T17:23:25.712846] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-10T17:23:25.889407] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-10T17:23:26.422842] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-10T17:23:26.695915] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-10T17:23:26.701489] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-10T17:23:27.489439] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-10T17:23:27.591819] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-10T17:23:28.289462] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-10T17:23:28.758515] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-10T17:23:29.089397] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-10T17:23:29.788914] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T17:23:29.792525] [INFO ] [REMOTE ] ATR: Full fetch complete (43713 records). [2025-10-10T17:23:29.792677] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-10T17:23:29.892553] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-10T17:23:30.172873] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-10T17:23:30.256263] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-10T17:23:30.256369] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-10T17:23:30.257138] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-10T17:23:30.257207] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-10T17:23:30.258625] [DEBUG] [LOCAL ] ATR: Trimmed 43713 records to 31070 (keeping 200 days of data) [2025-10-10T17:23:30.467003] [DEBUG] [LOCAL ] ATR: Primary data saved (31070 records). [2025-10-10T17:23:30.467206] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-10T17:23:30.467303] [INFO ] [MAIN ] Update Progress: 176/2373 symbols completed. ATR took 22.6s. Estimated remaining: 4h 52m 36s. Rate: 7.5 symbols/min [2025-10-10T17:23:30.660278] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:23:30.669585] [DEBUG] [LOCAL ] AUNA: Loaded 5085 existing records from primary storage. [2025-10-10T17:23:30.669936] [INFO ] [MAIN ] AUNA: Loaded 5085 existing records. [2025-10-10T17:23:30.704835] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-10T17:23:30.882610] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:23:30.883421] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-10T17:23:30.883490] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-10T17:23:30.883718] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-10T17:23:30.883776] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-10T17:23:31.200350] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T17:23:31.323388] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:23:31.354513] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T17:23:31.489407] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-10T17:23:32.261629] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-10T17:23:32.289409] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-10T17:23:32.879929] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-10T17:23:33.089374] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-10T17:23:33.738975] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-10T17:23:33.889411] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-10T17:23:34.689398] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-10T17:23:35.204048] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-10T17:23:35.316487] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-10T17:23:35.489393] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-10T17:23:36.034352] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T17:23:36.289401] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-10T17:23:37.089370] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-10T17:23:37.250606] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-10T17:23:37.889403] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-10T17:23:37.919571] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-10T17:23:38.038341] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T17:23:38.044958] [INFO ] [REMOTE ] ATUS: Full fetch complete (71034 records). [2025-10-10T17:23:38.045115] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-10T17:23:38.458114] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-10T17:23:38.458232] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-10T17:23:38.459115] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-10T17:23:38.459185] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-10T17:23:38.461252] [DEBUG] [LOCAL ] ATUS: Trimmed 71034 records to 50199 (keeping 200 days of data) [2025-10-10T17:23:38.695419] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-10T17:23:38.784452] [DEBUG] [LOCAL ] ATUS: Primary data saved (50199 records). [2025-10-10T17:23:38.784869] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-10T17:23:38.785011] [INFO ] [MAIN ] Update Progress: 177/2373 symbols completed. ATUS took 26.3s. Estimated remaining: 4h 52m 33s. Rate: 7.5 symbols/min [2025-10-10T17:23:39.017717] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:23:39.059705] [DEBUG] [LOCAL ] AVA: Loaded 39336 existing records from primary storage. [2025-10-10T17:23:39.060157] [INFO ] [MAIN ] AVA: Loaded 39336 existing records. [2025-10-10T17:23:39.242605] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:23:39.243106] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-10T17:23:39.243159] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-10T17:23:39.243397] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-10T17:23:39.243455] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-10T17:23:39.498426] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-10T17:23:39.613213] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:23:40.198286] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-10T17:23:40.289363] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-10T17:23:40.349808] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-10T17:23:40.716075] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-10T17:23:41.089392] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-10T17:23:41.788967] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-10T17:23:41.889405] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-10T17:23:42.607933] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-10T17:23:42.689369] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-10T17:23:43.071855] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-10T17:23:43.489402] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-10T17:23:44.289362] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-10T17:23:44.410233] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-10T17:23:44.415679] [INFO ] [REMOTE ] AU: Full fetch complete (76305 records). [2025-10-10T17:23:44.415844] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-10T17:23:44.829511] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-10T17:23:44.829625] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-10T17:23:44.830592] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-10T17:23:44.830693] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-10T17:23:44.832839] [DEBUG] [LOCAL ] AU: Trimmed 76305 records to 53767 (keeping 200 days of data) [2025-10-10T17:23:45.071613] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-10T17:23:45.093104] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-10T17:23:45.215626] [DEBUG] [LOCAL ] AU: Primary data saved (53767 records). [2025-10-10T17:23:45.215841] [INFO ] [MAIN ] AU: Full history saved. [2025-10-10T17:23:45.215939] [INFO ] [MAIN ] Update Progress: 178/2373 symbols completed. AU took 28.8s. Estimated remaining: 4h 52m 5s. Rate: 7.5 symbols/min [2025-10-10T17:23:45.487949] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:23:45.550153] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-10T17:23:45.555888] [DEBUG] [LOCAL ] AVAL: Loaded 8696 existing records from primary storage. [2025-10-10T17:23:45.569885] [INFO ] [MAIN ] AVAL: Loaded 8696 existing records. [2025-10-10T17:23:45.722214] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-10T17:23:45.847067] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:23:45.847381] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-10T17:23:45.847435] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-10T17:23:45.847709] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-10T17:23:45.847795] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-10T17:23:45.894753] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-10T17:23:46.311765] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:23:46.689383] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-10T17:23:46.948371] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-10T17:23:47.489401] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-10T17:23:47.626901] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-10T17:23:48.289401] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-10T17:23:49.089368] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-10T17:23:49.328460] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-10T17:23:49.331045] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T17:23:49.720064] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-10T17:23:49.889402] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-10T17:23:50.585048] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-10T17:23:50.689409] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-10T17:23:51.177633] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-10T17:23:51.489402] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-10T17:23:52.289388] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-10T17:23:52.595250] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T17:23:52.895948] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-10T17:23:52.897362] [INFO ] [REMOTE ] AUNA: Full fetch complete (7819 records). [2025-10-10T17:23:52.897432] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-10T17:23:53.094518] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-10T17:23:53.278086] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-10T17:23:53.278182] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-10T17:23:53.278460] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-10T17:23:53.278502] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-10T17:23:53.279024] [DEBUG] [LOCAL ] AUNA: Trimmed 7819 records to 5124 (keeping 200 days of data) [2025-10-10T17:23:53.311755] [DEBUG] [LOCAL ] AUNA: Primary data saved (5124 records). [2025-10-10T17:23:53.311953] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-10T17:23:53.312062] [INFO ] [MAIN ] Update Progress: 179/2373 symbols completed. AUNA took 22.8s. Estimated remaining: 4h 51m 59s. Rate: 7.5 symbols/min [2025-10-10T17:23:53.522157] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:23:53.522424] [DEBUG] [LOCAL ] AVB: No existing data file found in primary storage. [2025-10-10T17:23:53.522468] [WARN ] [MAIN ] AVB: No existing data found, performing full refresh instead. [2025-10-10T17:23:53.522603] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-10T17:23:53.522674] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-10T17:23:53.522751] [DEBUG] [LOCAL ] AVB: No primary data file found to delete. [2025-10-10T17:23:53.522793] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-10T17:23:53.895323] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-10T17:23:53.902910] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:23:54.238093] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-10T17:23:54.689396] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-10T17:23:55.376379] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-10T17:23:55.489433] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-10T17:23:56.289419] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-10T17:23:56.558675] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T17:23:56.808352] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T17:23:57.089409] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-10T17:23:57.167612] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-10T17:23:57.889403] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-10T17:23:58.068402] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T17:23:58.551518] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-10T17:23:58.689359] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-10T17:23:59.166816] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-10T17:23:59.489397] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-10T17:24:00.289462] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-10T17:24:01.089385] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-10T17:24:01.376253] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-10T17:24:01.606703] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T17:24:01.889388] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-10T17:24:02.015728] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-10T17:24:02.689393] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-10T17:24:03.489427] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-10T17:24:03.571210] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-10T17:24:03.647606] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-10T17:24:04.289405] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-10T17:24:04.611464] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-10T17:24:05.089409] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-10T17:24:05.150197] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-10T17:24:05.889400] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-10T17:24:06.376263] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T17:24:06.400923] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-10T17:24:06.402712] [INFO ] [REMOTE ] AVAL: Full fetch complete (14768 records). [2025-10-10T17:24:06.402810] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-10T17:24:06.694574] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-10T17:24:06.784128] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-10T17:24:06.784232] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-10T17:24:06.784673] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-10T17:24:06.784737] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-10T17:24:06.785284] [DEBUG] [LOCAL ] AVAL: Trimmed 14768 records to 8816 (keeping 200 days of data) [2025-10-10T17:24:06.839737] [DEBUG] [LOCAL ] AVAL: Primary data saved (8816 records). [2025-10-10T17:24:06.839958] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-10T17:24:06.840070] [INFO ] [MAIN ] Update Progress: 180/2373 symbols completed. AVAL took 21.6s. Estimated remaining: 4h 52m 58s. Rate: 7.5 symbols/min [2025-10-10T17:24:07.022129] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:24:07.022434] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-10T17:24:07.022500] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-10T17:24:07.022635] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-10T17:24:07.022716] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-10T17:24:07.022767] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-10T17:24:07.022802] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-10T17:24:07.396186] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:24:07.489414] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-10T17:24:08.289373] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-10T17:24:08.630469] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T17:24:08.748629] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T17:24:09.089448] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-10T17:24:09.645017] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-10T17:24:09.889405] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-10T17:24:10.469374] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-10T17:24:10.689397] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-10T17:24:10.935481] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:24:10.935921] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-10T17:24:10.936039] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:24:10.936097] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-10T17:24:10.936173] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:24:10.936259] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-10T17:24:10.936349] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-10T17:24:10.936401] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-10T17:24:10.936464] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-10T17:24:10.936549] [INFO ] [MAIN ] Update Progress: 181/2373 symbols completed. AVBC took 4.1s. Estimated remaining: 4h 52m 3s. Rate: 7.5 symbols/min [2025-10-10T17:24:11.136275] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:24:11.160160] [DEBUG] [LOCAL ] AVD: Loaded 22339 existing records from primary storage. [2025-10-10T17:24:11.160483] [INFO ] [MAIN ] AVD: Loaded 22339 existing records. [2025-10-10T17:24:11.344174] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:24:11.344406] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-10T17:24:11.344463] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-10T17:24:11.344735] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-10T17:24:11.344792] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-10T17:24:11.491671] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-10T17:24:11.743158] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:24:11.788440] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T17:24:12.289397] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-10T17:24:13.089363] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-10T17:24:13.305474] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-10T17:24:13.310587] [INFO ] [REMOTE ] AUB: Full fetch complete (65785 records). [2025-10-10T17:24:13.310832] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-10T17:24:13.711497] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-10T17:24:13.711596] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-10T17:24:13.712381] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-10T17:24:13.712452] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-10T17:24:13.714204] [DEBUG] [LOCAL ] AUB: Trimmed 65785 records to 46863 (keeping 200 days of data) [2025-10-10T17:24:13.897156] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-10T17:24:13.986520] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-10T17:24:14.047877] [DEBUG] [LOCAL ] AUB: Primary data saved (46863 records). [2025-10-10T17:24:14.048756] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-10T17:24:14.049347] [INFO ] [MAIN ] Update Progress: 182/2373 symbols completed. AUB took 50.2s. Estimated remaining: 4h 50m 56s. Rate: 7.5 symbols/min [2025-10-10T17:24:14.235352] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:24:14.294992] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-10T17:24:14.318203] [DEBUG] [LOCAL ] AVK: Loaded 18448 existing records from primary storage. [2025-10-10T17:24:14.318475] [INFO ] [MAIN ] AVK: Loaded 18448 existing records. [2025-10-10T17:24:14.491781] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:24:14.492038] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-10T17:24:14.492088] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-10T17:24:14.492344] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-10T17:24:14.492403] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-10T17:24:14.694579] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-10T17:24:14.841291] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:24:15.167781] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-10T17:24:15.489435] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-10T17:24:16.289373] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-10T17:24:16.479392] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T17:24:17.089343] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-10T17:24:17.113817] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-10T17:24:17.292392] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-10T17:24:17.889400] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-10T17:24:18.689407] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-10T17:24:18.942195] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T17:24:19.234578] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-10T17:24:19.489415] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-10T17:24:20.289441] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-10T17:24:20.582599] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-10T17:24:20.659850] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T17:24:21.089396] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-10T17:24:21.391028] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-10T17:24:21.889454] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-10T17:24:22.689376] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-10T17:24:22.927477] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T17:24:23.003168] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-10T17:24:23.007089] [INFO ] [REMOTE ] AVA: Full fetch complete (55483 records). [2025-10-10T17:24:23.007217] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-10T17:24:23.438298] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-10T17:24:23.439185] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-10T17:24:23.440125] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-10T17:24:23.440950] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-10T17:24:23.441153] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-10T17:24:23.447325] [DEBUG] [LOCAL ] AVA: Trimmed 55483 records to 39567 (keeping 200 days of data) [2025-10-10T17:24:23.514619] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-10T17:24:23.734774] [DEBUG] [LOCAL ] AVA: Primary data saved (39567 records). [2025-10-10T17:24:23.735010] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-10T17:24:23.735166] [INFO ] [MAIN ] Update Progress: 183/2373 symbols completed. AVA took 45.0s. Estimated remaining: 4h 51m 9s. Rate: 7.5 symbols/min [2025-10-10T17:24:23.919349] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:24:23.962747] [DEBUG] [LOCAL ] AVNS: Loaded 33765 existing records from primary storage. [2025-10-10T17:24:23.963229] [INFO ] [MAIN ] AVNS: Loaded 33765 existing records. [2025-10-10T17:24:24.202151] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:24:24.202518] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-10T17:24:24.202604] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-10T17:24:24.203077] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-10T17:24:24.203157] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-10T17:24:24.294539] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-10T17:24:24.617235] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:24:24.689952] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-10T17:24:25.089409] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-10T17:24:25.889428] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-10T17:24:26.182233] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T17:24:26.641619] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T17:24:26.689396] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-10T17:24:26.742085] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-10T17:24:27.489370] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-10T17:24:27.570496] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-10T17:24:28.289407] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-10T17:24:28.833204] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T17:24:29.089425] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-10T17:24:29.889391] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-10T17:24:30.043997] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T17:24:30.048462] [INFO ] [REMOTE ] AVB: Full fetch complete (58745 records). [2025-10-10T17:24:30.048620] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-10T17:24:30.453624] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-10T17:24:30.453853] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-10T17:24:30.454505] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-10T17:24:30.454550] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-10T17:24:30.456009] [DEBUG] [LOCAL ] AVB: Trimmed 58745 records to 42671 (keeping 200 days of data) [2025-10-10T17:24:30.565055] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-10T17:24:30.697057] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-10T17:24:30.752064] [DEBUG] [LOCAL ] AVB: Primary data saved (42671 records). [2025-10-10T17:24:30.753162] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-10T17:24:30.753305] [INFO ] [MAIN ] Update Progress: 184/2373 symbols completed. AVB took 37.4s. Estimated remaining: 4h 50m 49s. Rate: 7.5 symbols/min [2025-10-10T17:24:30.923381] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:24:30.924055] [DEBUG] [LOCAL ] AVNT: No existing data file found in primary storage. [2025-10-10T17:24:30.924108] [WARN ] [MAIN ] AVNT: No existing data found, performing full refresh instead. [2025-10-10T17:24:30.924224] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-10T17:24:30.924273] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-10T17:24:30.924338] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-10-10T17:24:30.924372] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-10T17:24:31.231156] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T17:24:31.317544] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:24:31.374462] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-10T17:24:31.489421] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-10T17:24:32.289457] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-10T17:24:32.806514] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T17:24:33.089389] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-10T17:24:33.564471] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T17:24:33.889409] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-10T17:24:34.546977] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T17:24:34.689403] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-10T17:24:35.489363] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-10T17:24:35.514803] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T17:24:35.864856] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-10T17:24:36.183812] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-10T17:24:36.289338] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-10T17:24:37.089349] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-10T17:24:37.548967] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T17:24:37.889441] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-10T17:24:38.447731] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T17:24:38.689407] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-10T17:24:39.485764] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-10T17:24:39.493173] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-10T17:24:39.996660] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-10T17:24:40.289460] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-10T17:24:41.004544] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-10T17:24:41.089410] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-10T17:24:41.896836] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-10T17:24:41.902329] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-10T17:24:42.013441] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-10T17:24:42.689353] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-10T17:24:42.775920] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-10T17:24:43.489375] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-10T17:24:44.141459] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T17:24:44.289373] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-10T17:24:44.483437] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-10T17:24:45.089390] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-10T17:24:45.433554] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-10T17:24:45.862198] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T17:24:45.864203] [INFO ] [REMOTE ] AVD: Full fetch complete (33098 records). [2025-10-10T17:24:45.864305] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-10T17:24:45.898542] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-10T17:24:46.260624] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-10T17:24:46.260732] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-10T17:24:46.261131] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-10T17:24:46.261172] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-10T17:24:46.261925] [DEBUG] [LOCAL ] AVD: Trimmed 33098 records to 22475 (keeping 200 days of data) [2025-10-10T17:24:46.383337] [DEBUG] [LOCAL ] AVD: Primary data saved (22475 records). [2025-10-10T17:24:46.383469] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-10T17:24:46.383546] [INFO ] [MAIN ] Update Progress: 185/2373 symbols completed. AVD took 35.4s. Estimated remaining: 4h 52m 12s. Rate: 7.5 symbols/min [2025-10-10T17:24:46.549473] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:24:46.600319] [DEBUG] [LOCAL ] AVTR: Loaded 53951 existing records from primary storage. [2025-10-10T17:24:46.600631] [INFO ] [MAIN ] AVTR: Loaded 53951 existing records. [2025-10-10T17:24:46.694580] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-10T17:24:46.793280] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:24:46.793584] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-10T17:24:46.793638] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-10T17:24:46.793990] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-10T17:24:46.794090] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-10T17:24:47.168226] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:24:47.489393] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-10T17:24:47.859038] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T17:24:48.289411] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-10T17:24:48.339444] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-10T17:24:48.701141] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T17:24:49.089369] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-10T17:24:49.889406] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-10T17:24:50.334618] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T17:24:50.529554] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-10T17:24:50.692954] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-10T17:24:50.694324] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-10T17:24:51.489384] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-10T17:24:52.289440] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-10T17:24:52.367509] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-10T17:24:52.910153] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-10T17:24:52.913588] [INFO ] [REMOTE ] AVNS: Full fetch complete (48265 records). [2025-10-10T17:24:52.913698] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-10T17:24:53.094762] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-10T17:24:53.243695] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T17:24:53.287875] [INFO ] [REMOTE ] AVK: Full fetch complete (26732 records). [2025-10-10T17:24:53.302931] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-10T17:24:53.426104] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-10T17:24:53.437748] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-10T17:24:53.459507] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-10T17:24:53.462789] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-10T17:24:53.525328] [DEBUG] [LOCAL ] AVNS: Trimmed 48265 records to 33979 (keeping 200 days of data) [2025-10-10T17:24:53.850523] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-10T17:24:53.850987] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-10T17:24:53.851500] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-10T17:24:53.852519] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-10T17:24:53.858165] [DEBUG] [LOCAL ] AVK: Trimmed 26732 records to 18620 (keeping 200 days of data) [2025-10-10T17:24:53.912671] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-10T17:24:54.070837] [DEBUG] [LOCAL ] AVK: Primary data saved (18620 records). [2025-10-10T17:24:54.073468] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-10T17:24:54.088564] [INFO ] [MAIN ] Update Progress: 186/2373 symbols completed. AVK took 40.0s. Estimated remaining: 4h 52m 0s. Rate: 7.5 symbols/min [2025-10-10T17:24:54.096792] [DEBUG] [LOCAL ] AVNS: Primary data saved (33979 records). [2025-10-10T17:24:54.148399] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-10T17:24:54.163301] [INFO ] [MAIN ] Update Progress: 187/2373 symbols completed. AVNS took 30.4s. Estimated remaining: 4h 50m 19s. Rate: 7.5 symbols/min [2025-10-10T17:24:54.445337] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:24:54.465515] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:24:54.499309] [DEBUG] [LOCAL ] AWF: Loaded 24414 existing records from primary storage. [2025-10-10T17:24:54.499903] [INFO ] [MAIN ] AWF: Loaded 24414 existing records. [2025-10-10T17:24:54.650138] [DEBUG] [LOCAL ] AVY: Loaded 37848 existing records from primary storage. [2025-10-10T17:24:54.661879] [INFO ] [MAIN ] AVY: Loaded 37848 existing records. [2025-10-10T17:24:54.822996] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:24:54.860727] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-10T17:24:54.860921] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-10T17:24:54.861545] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-10T17:24:54.866984] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-10T17:24:55.029466] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:24:55.067009] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-10T17:24:55.067251] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-10T17:24:55.073156] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-10T17:24:55.073301] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-10T17:24:55.418925] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-10T17:24:55.515531] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-10T17:24:55.600727] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:24:55.627206] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-10T17:24:55.820954] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-10T17:24:55.867978] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:24:56.289450] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-10T17:24:57.089458] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-10T17:24:57.153990] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-10T17:24:57.513040] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T17:24:57.573567] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-10T17:24:57.889408] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-10T17:24:58.536774] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T17:24:58.689362] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-10T17:24:59.192603] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T17:24:59.489387] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-10T17:25:00.078159] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-10T17:25:00.289425] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-10T17:25:01.089421] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-10T17:25:01.580746] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T17:25:01.736196] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-10T17:25:01.889434] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-10T17:25:02.195878] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-10T17:25:02.689383] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-10T17:25:03.489430] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-10T17:25:03.682201] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T17:25:04.162542] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-10T17:25:04.166899] [INFO ] [REMOTE ] AVNT: Full fetch complete (56367 records). [2025-10-10T17:25:04.167077] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-10T17:25:04.294541] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-10T17:25:04.600455] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-10T17:25:04.600712] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-10T17:25:04.601579] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-10T17:25:04.601695] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-10T17:25:04.603600] [DEBUG] [LOCAL ] AVNT: Trimmed 56367 records to 39655 (keeping 200 days of data) [2025-10-10T17:25:04.864043] [DEBUG] [LOCAL ] AVNT: Primary data saved (39655 records). [2025-10-10T17:25:04.864269] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-10T17:25:04.864393] [INFO ] [MAIN ] Update Progress: 188/2373 symbols completed. AVNT took 34.1s. Estimated remaining: 4h 50m 43s. Rate: 7.5 symbols/min [2025-10-10T17:25:05.043352] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:25:05.073985] [DEBUG] [LOCAL ] AWI: Loaded 25458 existing records from primary storage. [2025-10-10T17:25:05.074347] [INFO ] [MAIN ] AWI: Loaded 25458 existing records. [2025-10-10T17:25:05.107693] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-10T17:25:05.271130] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:25:05.271452] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-10T17:25:05.271508] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-10T17:25:05.271868] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-10T17:25:05.271929] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-10T17:25:05.700582] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:25:05.739938] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-10T17:25:05.889367] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-10T17:25:06.351102] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-10T17:25:06.471918] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-10T17:25:06.689405] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-10T17:25:06.807861] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-10T17:25:07.489428] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-10T17:25:08.289400] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-10T17:25:08.819945] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-10T17:25:08.946875] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-10T17:25:09.038981] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-10T17:25:09.089394] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-10T17:25:09.889414] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-10T17:25:10.689422] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-10T17:25:11.088164] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-10T17:25:11.123381] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-10T17:25:11.489339] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-10T17:25:11.617989] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-10T17:25:12.289375] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-10T17:25:12.909465] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-10T17:25:13.089424] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-10T17:25:13.889540] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-10T17:25:14.007234] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T17:25:14.675585] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T17:25:14.689340] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-10T17:25:14.727180] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-10T17:25:15.489429] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-10T17:25:16.289360] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-10T17:25:16.469519] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T17:25:16.708184] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T17:25:17.089409] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-10T17:25:17.835243] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T17:25:17.861984] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-10T17:25:17.889339] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-10T17:25:18.689412] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-10T17:25:19.080078] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T17:25:19.489388] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-10T17:25:19.991310] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T17:25:20.289341] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-10T17:25:20.821707] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T17:25:21.089386] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-10T17:25:21.677182] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-10T17:25:21.889417] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-10T17:25:22.254992] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-10T17:25:22.689395] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-10T17:25:23.489436] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-10T17:25:23.761444] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T17:25:24.289421] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-10T17:25:24.508507] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T17:25:24.804115] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-10T17:25:24.806691] [INFO ] [REMOTE ] AWF: Full fetch complete (35728 records). [2025-10-10T17:25:24.806769] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-10T17:25:25.094514] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-10T17:25:25.174108] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-10T17:25:25.174187] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-10T17:25:25.174631] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-10T17:25:25.174712] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-10T17:25:25.175500] [DEBUG] [LOCAL ] AWF: Trimmed 35728 records to 24541 (keeping 200 days of data) [2025-10-10T17:25:25.320478] [DEBUG] [LOCAL ] AWF: Primary data saved (24541 records). [2025-10-10T17:25:25.320617] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-10T17:25:25.320732] [INFO ] [MAIN ] Update Progress: 189/2373 symbols completed. AWF took 31.2s. Estimated remaining: 4h 52m 59s. Rate: 7.5 symbols/min [2025-10-10T17:25:25.496081] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:25:25.506303] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-10T17:25:25.510176] [INFO ] [REMOTE ] AVY: Full fetch complete (56023 records). [2025-10-10T17:25:25.510272] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-10T17:25:25.511003] [FATAL] [VALIDATOR ] AVY: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:25:25.511134] [FATAL] [MAIN ] AVY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:25:25.511221] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:25:25.511297] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-10T17:25:25.511390] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-10T17:25:25.511538] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-10-10T17:25:25.511792] [DEBUG] [LOCAL ] AVY: Deleted derivative data file. [2025-10-10T17:25:25.512297] [INFO ] [MAIN ] Update Progress: 190/2373 symbols completed. AVY took 31.4s. Estimated remaining: 4h 51m 21s. Rate: 7.5 symbols/min [2025-10-10T17:25:25.700530] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:25:25.700769] [DEBUG] [LOCAL ] AWP: No existing data file found in primary storage. [2025-10-10T17:25:25.700819] [WARN ] [MAIN ] AWP: No existing data found, performing full refresh instead. [2025-10-10T17:25:25.700933] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-10T17:25:25.700975] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-10T17:25:25.701017] [DEBUG] [LOCAL ] AWP: No primary data file found to delete. [2025-10-10T17:25:25.701050] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-10T17:25:25.855568] [DEBUG] [LOCAL ] AWK: Loaded 49030 existing records from primary storage. [2025-10-10T17:25:25.890880] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-10T17:25:25.906410] [INFO ] [MAIN ] AWK: Loaded 49030 existing records. [2025-10-10T17:25:26.254136] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:25:26.249174] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:25:26.254784] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-10T17:25:26.254888] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-10T17:25:26.255246] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-10T17:25:26.255374] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-10T17:25:26.609767] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:25:26.626980] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T17:25:26.689384] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-10T17:25:27.489349] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-10T17:25:27.982526] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T17:25:28.022312] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-10T17:25:28.027812] [INFO ] [REMOTE ] AVTR: Full fetch complete (77441 records). [2025-10-10T17:25:28.027992] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-10T17:25:28.296137] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-10T17:25:28.421347] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-10T17:25:28.421435] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-10T17:25:28.422322] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-10T17:25:28.422392] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-10T17:25:28.423963] [DEBUG] [LOCAL ] AVTR: Trimmed 77441 records to 54340 (keeping 200 days of data) [2025-10-10T17:25:28.752616] [DEBUG] [LOCAL ] AVTR: Primary data saved (54340 records). [2025-10-10T17:25:28.752814] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-10T17:25:28.752921] [INFO ] [MAIN ] Update Progress: 191/2373 symbols completed. AVTR took 42.4s. Estimated remaining: 4h 50m 19s. Rate: 7.5 symbols/min [2025-10-10T17:25:28.931820] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:25:28.953754] [DEBUG] [LOCAL ] AWR: Loaded 22850 existing records from primary storage. [2025-10-10T17:25:28.954191] [INFO ] [MAIN ] AWR: Loaded 22850 existing records. [2025-10-10T17:25:29.067635] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-10T17:25:29.094434] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-10T17:25:29.152765] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:25:29.152956] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-10T17:25:29.153003] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-10T17:25:29.153244] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-10T17:25:29.153301] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-10T17:25:29.495123] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:25:29.629237] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-10T17:25:29.889404] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-10T17:25:30.689422] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-10T17:25:31.243479] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-10T17:25:31.272201] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-10T17:25:31.489388] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-10T17:25:31.650290] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-10T17:25:32.289384] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-10T17:25:32.825017] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T17:25:33.089436] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-10T17:25:33.800549] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T17:25:33.889352] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-10T17:25:34.367026] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T17:25:34.689351] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-10T17:25:35.204823] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-10T17:25:35.489397] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-10T17:25:35.959775] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-10T17:25:36.289424] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-10T17:25:36.618725] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-10T17:25:37.089384] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-10T17:25:37.727771] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-10T17:25:37.889400] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-10T17:25:38.689383] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-10T17:25:38.900084] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T17:25:38.978231] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-10T17:25:39.489372] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-10T17:25:39.863967] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-10T17:25:39.866903] [INFO ] [REMOTE ] AWI: Full fetch complete (35749 records). [2025-10-10T17:25:39.867033] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-10T17:25:40.277709] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-10T17:25:40.277791] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-10T17:25:40.278231] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-10T17:25:40.278271] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-10T17:25:40.279096] [DEBUG] [LOCAL ] AWI: Trimmed 35749 records to 25695 (keeping 200 days of data) [2025-10-10T17:25:40.333219] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-10T17:25:40.436913] [DEBUG] [LOCAL ] AWI: Primary data saved (25695 records). [2025-10-10T17:25:40.437070] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-10T17:25:40.437167] [INFO ] [MAIN ] Update Progress: 192/2373 symbols completed. AWI took 35.6s. Estimated remaining: 4h 50m 53s. Rate: 7.5 symbols/min [2025-10-10T17:25:40.612854] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:25:40.613039] [DEBUG] [LOCAL ] AX: No existing data file found in primary storage. [2025-10-10T17:25:40.613092] [WARN ] [MAIN ] AX: No existing data found, performing full refresh instead. [2025-10-10T17:25:40.613218] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-10T17:25:40.613260] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-10T17:25:40.613303] [DEBUG] [LOCAL ] AX: No primary data file found to delete. [2025-10-10T17:25:40.613337] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-10T17:25:40.964746] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:25:41.089401] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-10T17:25:41.440835] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T17:25:41.535039] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T17:25:41.889382] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-10T17:25:42.210637] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-10T17:25:42.689419] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-10T17:25:43.203922] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-10T17:25:43.489383] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-10T17:25:43.947134] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T17:25:44.289383] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-10T17:25:44.867228] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-10T17:25:44.936363] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-10T17:25:45.089357] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-10T17:25:45.889386] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-10T17:25:46.203800] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-10T17:25:46.689343] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-10T17:25:47.078796] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-10T17:25:47.489380] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-10T17:25:48.177054] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T17:25:48.289385] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-10T17:25:49.089388] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-10T17:25:49.146141] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-10T17:25:49.450041] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T17:25:49.889364] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-10T17:25:50.033336] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-10T17:25:50.689339] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-10T17:25:51.223904] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T17:25:51.489392] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-10T17:25:52.189446] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-10T17:25:52.289343] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-10T17:25:52.923043] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-10T17:25:53.089380] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-10T17:25:53.440872] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-10T17:25:53.889404] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-10T17:25:54.689356] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-10T17:25:55.144975] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-10T17:25:55.210412] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-10T17:25:55.489406] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-10T17:25:55.623245] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T17:25:55.626041] [INFO ] [REMOTE ] AWR: Full fetch complete (32190 records). [2025-10-10T17:25:55.626119] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-10T17:25:55.989546] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-10T17:25:55.989675] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-10T17:25:55.990110] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-10T17:25:55.990153] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-10T17:25:55.990963] [DEBUG] [LOCAL ] AWR: Trimmed 32190 records to 23017 (keeping 200 days of data) [2025-10-10T17:25:56.127831] [DEBUG] [LOCAL ] AWR: Primary data saved (23017 records). [2025-10-10T17:25:56.127968] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-10T17:25:56.128052] [INFO ] [MAIN ] Update Progress: 193/2373 symbols completed. AWR took 27.4s. Estimated remaining: 4h 52m 11s. Rate: 7.5 symbols/min [2025-10-10T17:25:56.294054] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-10T17:25:56.296110] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:25:56.343518] [DEBUG] [LOCAL ] AXL: Loaded 50878 existing records from primary storage. [2025-10-10T17:25:56.343873] [INFO ] [MAIN ] AXL: Loaded 50878 existing records. [2025-10-10T17:25:56.523077] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:25:56.523282] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-10T17:25:56.523504] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-10T17:25:56.523835] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-10T17:25:56.523964] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-10T17:25:56.646888] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T17:25:56.904960] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:25:57.094560] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-10T17:25:57.101175] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-10T17:25:57.889441] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-10T17:25:58.689399] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-10T17:25:59.190148] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-10T17:25:59.219335] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T17:25:59.489361] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-10T17:26:00.289439] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-10T17:26:00.467724] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T17:26:01.089399] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-10T17:26:01.460189] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T17:26:01.889376] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-10T17:26:01.926591] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T17:26:02.567140] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-10T17:26:02.689437] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-10T17:26:03.489360] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-10T17:26:04.014305] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-10T17:26:04.289460] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-10T17:26:04.463248] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-10T17:26:04.843191] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (2.95 seconds). [2025-10-10T17:26:05.089357] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-10T17:26:05.889348] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-10T17:26:06.244897] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T17:26:06.363948] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-10T17:26:06.689372] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-10T17:26:07.057618] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-10T17:26:07.489392] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-10T17:26:08.010044] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T17:26:08.013058] [INFO ] [REMOTE ] AX: Full fetch complete (42214 records). [2025-10-10T17:26:08.013211] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-10T17:26:08.295820] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-10T17:26:08.386590] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-10T17:26:08.386696] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-10T17:26:08.387174] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-10T17:26:08.387215] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-10T17:26:08.388131] [DEBUG] [LOCAL ] AX: Trimmed 42214 records to 28446 (keeping 200 days of data) [2025-10-10T17:26:08.552750] [DEBUG] [LOCAL ] AX: Primary data saved (28446 records). [2025-10-10T17:26:08.552924] [INFO ] [MAIN ] AX: Full history saved. [2025-10-10T17:26:08.553007] [INFO ] [MAIN ] Update Progress: 194/2373 symbols completed. AX took 28.1s. Estimated remaining: 4h 52m 53s. Rate: 7.4 symbols/min [2025-10-10T17:26:08.724342] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:26:08.724528] [DEBUG] [LOCAL ] AXP: No existing data file found in primary storage. [2025-10-10T17:26:08.724565] [WARN ] [MAIN ] AXP: No existing data found, performing full refresh instead. [2025-10-10T17:26:08.724703] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-10T17:26:08.724754] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-10T17:26:08.724818] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-10-10T17:26:08.724852] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-10T17:26:09.067287] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:26:09.089343] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-10T17:26:09.546968] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-10T17:26:09.889483] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-10T17:26:10.693231] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-10T17:26:10.697906] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-10T17:26:10.781635] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T17:26:11.489394] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-10T17:26:11.744126] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T17:26:11.955638] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T17:26:11.957741] [INFO ] [REMOTE ] AWP: Full fetch complete (31929 records). [2025-10-10T17:26:11.957818] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-10T17:26:12.294559] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-10T17:26:12.331035] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-10T17:26:12.331118] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-10T17:26:12.331583] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-10T17:26:12.331678] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-10T17:26:12.332550] [DEBUG] [LOCAL ] AWP: Trimmed 31929 records to 21748 (keeping 200 days of data) [2025-10-10T17:26:12.456283] [DEBUG] [LOCAL ] AWP: Primary data saved (21748 records). [2025-10-10T17:26:12.456410] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-10T17:26:12.456480] [INFO ] [MAIN ] Update Progress: 195/2373 symbols completed. AWP took 46.9s. Estimated remaining: 4h 51m 58s. Rate: 7.5 symbols/min [2025-10-10T17:26:12.622392] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:26:12.627705] [DEBUG] [LOCAL ] AXR: Loaded 3001 existing records from primary storage. [2025-10-10T17:26:12.627868] [INFO ] [MAIN ] AXR: Loaded 3001 existing records. [2025-10-10T17:26:12.805633] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:26:12.805879] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-10T17:26:12.805925] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-10T17:26:12.806183] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-10T17:26:12.806249] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-10T17:26:13.094576] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-10T17:26:13.159794] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:26:13.739316] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-10T17:26:13.889359] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-10T17:26:14.186558] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-10T17:26:14.191703] [INFO ] [REMOTE ] AWK: Full fetch complete (70675 records). [2025-10-10T17:26:14.191825] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-10T17:26:14.579171] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-10T17:26:14.579262] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-10T17:26:14.580055] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-10T17:26:14.580141] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-10T17:26:14.581617] [DEBUG] [LOCAL ] AWK: Trimmed 70675 records to 49396 (keeping 200 days of data) [2025-10-10T17:26:14.691025] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-10T17:26:14.901033] [DEBUG] [LOCAL ] AWK: Primary data saved (49396 records). [2025-10-10T17:26:14.901226] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-10T17:26:14.901953] [INFO ] [MAIN ] Update Progress: 196/2373 symbols completed. AWK took 49.6s. Estimated remaining: 4h 50m 48s. Rate: 7.5 symbols/min [2025-10-10T17:26:15.045293] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-10T17:26:15.112574] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T17:26:15.115889] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:26:15.165237] [DEBUG] [LOCAL ] AXS: Loaded 38952 existing records from primary storage. [2025-10-10T17:26:15.165540] [INFO ] [MAIN ] AXS: Loaded 38952 existing records. [2025-10-10T17:26:15.338524] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:26:15.338815] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-10T17:26:15.338918] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-10T17:26:15.339208] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-10T17:26:15.339279] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-10T17:26:15.492886] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-10T17:26:15.696161] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:26:16.011960] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-10T17:26:16.289400] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-10T17:26:16.654560] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-10T17:26:17.033843] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-10T17:26:17.089349] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-10T17:26:17.594899] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-10T17:26:17.889414] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-10T17:26:18.689472] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-10T17:26:19.489442] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-10T17:26:19.838490] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-10T17:26:19.895927] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-10T17:26:20.289377] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-10T17:26:20.419810] [DEBUG] [REMOTE ] AXR: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-10T17:26:20.420073] [WARN ] [REMOTE ] AXR: No data returned for month 2025-04 [2025-10-10T17:26:20.420182] [FATAL] [REMOTE ] AXR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:26:20.420285] [FATAL] [MAIN ] AXR: Failed to fetch primary data. [2025-10-10T17:26:20.420354] [WARN ] [MAIN ] AXR: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:26:20.420428] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-10T17:26:20.420493] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-10T17:26:20.420531] [INFO ] [LOCAL ] AXR: Starting deletion of derivative data. [2025-10-10T17:26:20.420718] [DEBUG] [LOCAL ] AXR: Deleted derivative data file. [2025-10-10T17:26:20.420814] [INFO ] [MAIN ] Update Progress: 197/2373 symbols completed. AXR took 8.0s. Estimated remaining: 4h 50m 12s. Rate: 7.5 symbols/min [2025-10-10T17:26:21.089348] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-10T17:26:21.290160] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-10T17:26:21.889458] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-10T17:26:22.451263] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-10T17:26:22.689420] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-10T17:26:23.468567] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-10T17:26:23.489441] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-10T17:26:24.289473] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-10T17:26:24.637465] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T17:26:25.089394] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-10T17:26:25.248469] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T17:26:25.889462] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-10T17:26:26.164725] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T17:26:26.689420] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-10T17:26:26.908928] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T17:26:27.207288] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T17:26:27.489391] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-10T17:26:28.289384] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-10T17:26:28.396262] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-10T17:26:28.401844] [INFO ] [REMOTE ] AXL: Full fetch complete (72798 records). [2025-10-10T17:26:28.402058] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-10T17:26:28.831298] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-10T17:26:28.831411] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-10T17:26:28.832168] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-10T17:26:28.832232] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-10T17:26:28.833712] [DEBUG] [LOCAL ] AXL: Trimmed 72798 records to 51267 (keeping 200 days of data) [2025-10-10T17:26:29.126153] [DEBUG] [LOCAL ] AXL: Primary data saved (51267 records). [2025-10-10T17:26:29.126291] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-10T17:26:29.126373] [INFO ] [MAIN ] Update Progress: 198/2373 symbols completed. AXL took 33.0s. Estimated remaining: 4h 50m 12s. Rate: 7.5 symbols/min [2025-10-10T17:26:29.483410] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T17:26:29.495253] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-10T17:26:30.056305] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T17:26:30.066075] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-10T17:26:31.756213] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-10T17:26:31.769370] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-10T17:26:31.935957] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-10T17:26:31.945562] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-10T17:26:33.604431] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T17:26:33.612924] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-10T17:26:34.166457] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-10T17:26:34.179226] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-10T17:26:35.261415] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T17:26:35.271846] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-10T17:26:36.410776] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-10T17:26:36.422548] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-10T17:26:37.020351] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T17:26:37.031148] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-10T17:26:38.116251] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-10T17:26:38.121483] [INFO ] [REMOTE ] AXP: Full fetch complete (76909 records). [2025-10-10T17:26:38.121688] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-10T17:26:38.525576] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-10T17:26:38.525835] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-10T17:26:38.526716] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-10T17:26:38.526972] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-10T17:26:38.554560] [DEBUG] [LOCAL ] AXP: Trimmed 76909 records to 53949 (keeping 200 days of data) [2025-10-10T17:26:38.556280] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-10T17:26:38.568207] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-10T17:26:38.898035] [DEBUG] [LOCAL ] AXP: Primary data saved (53949 records). [2025-10-10T17:26:38.898178] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-10T17:26:38.898254] [INFO ] [MAIN ] Update Progress: 199/2373 symbols completed. AXP took 30.3s. Estimated remaining: 4h 50m 23s. Rate: 7.5 symbols/min [2025-10-10T17:26:39.969255] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-10T17:26:39.974903] [INFO ] [REMOTE ] AXS: Full fetch complete (55678 records). [2025-10-10T17:26:39.975095] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-10T17:26:40.366388] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-10T17:26:40.366481] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-10T17:26:40.367174] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-10T17:26:40.367243] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-10T17:26:40.368578] [DEBUG] [LOCAL ] AXS: Trimmed 55678 records to 39207 (keeping 200 days of data) [2025-10-10T17:26:40.612500] [DEBUG] [LOCAL ] AXS: Primary data saved (39207 records). [2025-10-10T17:26:40.612670] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-10T17:26:40.612770] [INFO ] [MAIN ] Update Progress: 200/2373 symbols completed. AXS took 25.7s. Estimated remaining: 4h 49m 7s. Rate: 7.5 symbols/min [2025-10-10T17:26:41.138456] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:26:41.219308] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:26:41.319930] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:26:41.355592] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:26:41.371452] [DEBUG] [LOCAL ] AZO: Loaded 11333 existing records from primary storage. [2025-10-10T17:26:41.370911] [DEBUG] [LOCAL ] AZZ: Loaded 22454 existing records from primary storage. [2025-10-10T17:26:41.371963] [INFO ] [MAIN ] AZO: Loaded 11333 existing records. [2025-10-10T17:26:41.394118] [INFO ] [MAIN ] AZZ: Loaded 22454 existing records. [2025-10-10T17:26:41.794230] [DEBUG] [LOCAL ] AXTA: Loaded 52567 existing records from primary storage. [2025-10-10T17:26:41.821359] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:26:41.865415] [INFO ] [MAIN ] AXTA: Loaded 52567 existing records. [2025-10-10T17:26:41.865165] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-10T17:26:41.865018] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:26:41.865689] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-10T17:26:41.886771] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-10T17:26:41.898003] [DEBUG] [LOCAL ] AYI: Loaded 25419 existing records from primary storage. [2025-10-10T17:26:41.898169] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-10T17:26:41.898282] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-10T17:26:41.923177] [INFO ] [MAIN ] AYI: Loaded 25419 existing records. [2025-10-10T17:26:41.932292] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-10T17:26:42.033290] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-10T17:26:42.069782] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-10T17:26:42.403570] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:26:42.481949] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-10T17:26:42.501744] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-10T17:26:42.548996] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-10T17:26:42.643396] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:26:42.720900] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-10T17:26:42.769636] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-10T17:26:42.916379] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-10T17:26:42.951416] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-10T17:26:43.002116] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-10T17:26:43.164250] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:26:43.193827] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-10T17:26:43.193528] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:26:43.219831] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-10T17:26:43.711321] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:26:43.720138] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-10T17:26:43.741405] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:26:43.741684] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-10T17:26:44.528164] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-10T17:26:44.532797] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-10T17:26:44.835994] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-10T17:26:44.841099] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-10T17:26:44.996909] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T17:26:45.001715] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-10T17:26:45.122057] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T17:26:45.132143] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-10T17:26:45.821182] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-10T17:26:45.827483] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-10T17:26:45.973086] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T17:26:45.976326] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-10T17:26:46.035552] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-10T17:26:46.042362] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-10T17:26:46.499314] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T17:26:46.509517] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-10T17:26:46.795199] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T17:26:46.799943] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-10T17:26:46.912803] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-10T17:26:47.385157] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T17:26:47.489381] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-10T17:26:48.063255] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T17:26:48.289412] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-10T17:26:48.323570] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T17:26:48.528423] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-10T17:26:49.065870] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-10T17:26:49.089329] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-10T17:26:49.889441] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-10T17:26:50.252390] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-10T17:26:50.689371] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-10T17:26:51.487780] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-10T17:26:51.490333] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-10T17:26:51.970474] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T17:26:52.289400] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-10T17:26:52.844288] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T17:26:53.089419] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-10T17:26:53.693772] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-10T17:26:53.839009] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-10T17:26:53.889385] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-10T17:26:54.689426] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-10T17:26:54.946579] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-10T17:26:55.489420] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-10T17:26:56.289441] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-10T17:26:56.447300] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T17:26:56.881401] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-10T17:26:56.921600] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-10T17:26:57.089399] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-10T17:26:57.780983] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-10T17:26:57.889396] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-10T17:26:58.641861] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-10T17:26:58.643336] [INFO ] [REMOTE ] AZO: Full fetch complete (16022 records). [2025-10-10T17:26:58.643407] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-10T17:26:58.696432] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-10T17:26:59.020509] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-10T17:26:59.020624] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-10T17:26:59.021204] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-10T17:26:59.021278] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-10T17:26:59.021939] [DEBUG] [LOCAL ] AZO: Trimmed 16022 records to 11422 (keeping 200 days of data) [2025-10-10T17:26:59.100705] [DEBUG] [LOCAL ] AZO: Primary data saved (11422 records). [2025-10-10T17:26:59.100898] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-10T17:26:59.101009] [INFO ] [MAIN ] Update Progress: 201/2373 symbols completed. AZO took 18.5s. Estimated remaining: 4h 50m 52s. Rate: 7.5 symbols/min [2025-10-10T17:26:59.280281] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:26:59.280540] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-10T17:26:59.280584] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-10T17:26:59.280745] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-10T17:26:59.280794] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-10T17:26:59.280838] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-10T17:26:59.280875] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-10T17:26:59.497455] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-10T17:26:59.654099] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:27:00.255284] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-10T17:27:00.289349] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-10T17:27:00.994535] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-10T17:27:01.089400] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-10T17:27:01.230050] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-10T17:27:01.889416] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-10T17:27:02.278820] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-10T17:27:02.689394] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-10T17:27:03.108021] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T17:27:03.489386] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-10T17:27:04.267030] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-10T17:27:04.289334] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-10T17:27:05.040879] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T17:27:05.089356] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-10T17:27:05.118613] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-10T17:27:05.889388] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-10T17:27:06.621396] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-10T17:27:06.689376] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-10T17:27:06.933181] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:27:06.933638] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-10T17:27:06.933757] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:27:06.933853] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-10T17:27:06.933917] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:27:06.933993] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-10T17:27:06.934065] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-10T17:27:06.934102] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-10T17:27:06.934142] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-10T17:27:06.934195] [INFO ] [MAIN ] Update Progress: 202/2373 symbols completed. B took 7.8s. Estimated remaining: 4h 50m 42s. Rate: 7.5 symbols/min [2025-10-10T17:27:07.122207] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:27:07.185187] [DEBUG] [LOCAL ] BA: Loaded 54180 existing records from primary storage. [2025-10-10T17:27:07.185665] [INFO ] [MAIN ] BA: Loaded 54180 existing records. [2025-10-10T17:27:07.374091] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:27:07.374450] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-10T17:27:07.374534] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-10T17:27:07.380779] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-10T17:27:07.389280] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-10T17:27:07.473748] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-10T17:27:07.491162] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-10T17:27:07.780157] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:27:08.289397] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-10T17:27:08.942834] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-10T17:27:09.089386] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-10T17:27:09.642888] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T17:27:09.646296] [INFO ] [REMOTE ] AYI: Full fetch complete (36992 records). [2025-10-10T17:27:09.646388] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-10T17:27:09.896049] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-10T17:27:10.037699] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-10T17:27:10.037803] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-10T17:27:10.038379] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-10T17:27:10.038445] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-10T17:27:10.039489] [DEBUG] [LOCAL ] AYI: Trimmed 36992 records to 25627 (keeping 200 days of data) [2025-10-10T17:27:10.207119] [DEBUG] [LOCAL ] AYI: Primary data saved (25627 records). [2025-10-10T17:27:10.207264] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-10T17:27:10.207364] [INFO ] [MAIN ] Update Progress: 203/2373 symbols completed. AYI took 29.6s. Estimated remaining: 4h 49m 43s. Rate: 7.5 symbols/min [2025-10-10T17:27:10.394245] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:27:10.395179] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-10T17:27:10.398949] [INFO ] [REMOTE ] AZZ: Full fetch complete (31431 records). [2025-10-10T17:27:10.399103] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-10T17:27:10.703997] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-10T17:27:10.826471] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-10T17:27:10.826600] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-10T17:27:10.827234] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-10T17:27:10.827317] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-10T17:27:10.829198] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-10-10T17:27:10.829768] [INFO ] [MAIN ] BABA: Loaded 54210 existing records. [2025-10-10T17:27:10.910126] [DEBUG] [LOCAL ] AZZ: Trimmed 31431 records to 22750 (keeping 200 days of data) [2025-10-10T17:27:11.107957] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:27:11.109952] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-10T17:27:11.110019] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-10T17:27:11.111014] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-10T17:27:11.111906] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-10T17:27:11.507215] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:27:11.508993] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-10T17:27:11.538005] [DEBUG] [LOCAL ] AZZ: Primary data saved (22750 records). [2025-10-10T17:27:11.538188] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-10T17:27:11.538304] [INFO ] [MAIN ] Update Progress: 204/2373 symbols completed. AZZ took 30.9s. Estimated remaining: 4h 48m 24s. Rate: 7.5 symbols/min [2025-10-10T17:27:11.711858] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:27:11.760985] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-10-10T17:27:11.761319] [INFO ] [MAIN ] BAC: Loaded 54198 existing records. [2025-10-10T17:27:11.939375] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:27:11.939750] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-10T17:27:11.939862] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-10T17:27:11.940176] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-10T17:27:11.940234] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-10T17:27:12.343360] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:27:12.346443] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-10T17:27:12.347008] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-10T17:27:13.059291] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-10T17:27:13.089331] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-10T17:27:13.832122] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-10T17:27:13.889369] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-10T17:27:14.689366] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-10T17:27:14.998397] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-10T17:27:15.489460] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-10T17:27:15.657369] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-10T17:27:16.118428] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-10T17:27:16.289501] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-10T17:27:16.817576] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-10T17:27:17.089380] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-10T17:27:17.539317] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-10T17:27:17.889403] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-10T17:27:18.113053] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T17:27:18.689438] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-10T17:27:19.157510] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T17:27:19.489395] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-10T17:27:19.804453] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T17:27:20.289411] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-10T17:27:21.089349] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-10T17:27:21.332809] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-10T17:27:21.453960] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T17:27:21.889427] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-10T17:27:22.384044] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T17:27:22.689384] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-10T17:27:23.307283] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-10T17:27:23.489474] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-10T17:27:23.919922] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T17:27:24.289372] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-10T17:27:25.089406] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-10T17:27:25.481502] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-10T17:27:25.889343] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-10T17:27:25.999031] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-10T17:27:26.648664] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-10T17:27:26.654578] [INFO ] [REMOTE ] AXTA: Full fetch complete (75108 records). [2025-10-10T17:27:26.654832] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-10T17:27:26.694781] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-10T17:27:27.106288] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-10T17:27:27.106482] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-10T17:27:27.107592] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-10T17:27:27.107937] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-10T17:27:27.110025] [DEBUG] [LOCAL ] AXTA: Trimmed 75108 records to 52953 (keeping 200 days of data) [2025-10-10T17:27:27.225057] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-10T17:27:27.479902] [DEBUG] [LOCAL ] AXTA: Primary data saved (52953 records). [2025-10-10T17:27:27.480114] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-10T17:27:27.480328] [INFO ] [MAIN ] Update Progress: 205/2373 symbols completed. AXTA took 46.9s. Estimated remaining: 4h 49m 40s. Rate: 7.5 symbols/min [2025-10-10T17:27:27.515058] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-10T17:27:27.670295] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:27:27.728786] [DEBUG] [LOCAL ] BAH: Loaded 52055 existing records from primary storage. [2025-10-10T17:27:27.729215] [INFO ] [MAIN ] BAH: Loaded 52055 existing records. [2025-10-10T17:27:27.926820] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:27:27.927240] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-10T17:27:27.927302] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-10T17:27:27.927728] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-10T17:27:27.927784] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-10T17:27:28.299847] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:27:28.300243] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-10T17:27:29.016396] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (3.13 seconds). [2025-10-10T17:27:29.089383] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-10T17:27:29.411947] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-10T17:27:29.845292] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-10T17:27:29.889352] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-10T17:27:30.347300] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T17:27:30.689455] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-10T17:27:31.240605] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-10T17:27:31.489483] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-10T17:27:32.289460] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-10T17:27:32.417069] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-10T17:27:33.019894] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-10T17:27:33.089337] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-10T17:27:33.484770] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-10T17:27:33.889392] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-10T17:27:34.689418] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-10T17:27:35.048179] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-10T17:27:35.489404] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-10T17:27:35.866431] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-10-10T17:27:36.127849] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-10T17:27:36.289375] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-10T17:27:36.825896] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-10-10T17:27:37.089391] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-10T17:27:37.467533] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T17:27:37.889396] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-10T17:27:38.689439] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-10T17:27:39.076623] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T17:27:39.347130] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-10-10T17:27:39.489391] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-10T17:27:40.207744] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-10T17:27:40.289395] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-10T17:27:40.462226] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-10T17:27:41.089394] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-10T17:27:41.889413] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-10T17:27:42.371828] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-10-10T17:27:42.689395] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-10T17:27:43.110335] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-10-10T17:27:43.137095] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-10T17:27:43.142835] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-10-10T17:27:43.142981] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-10T17:27:43.506195] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-10T17:27:43.563420] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-10T17:27:43.563517] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-10T17:27:43.564464] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-10T17:27:43.564532] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-10T17:27:43.566596] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 54588 (keeping 200 days of data) [2025-10-10T17:27:43.938129] [DEBUG] [LOCAL ] BAC: Primary data saved (54588 records). [2025-10-10T17:27:43.938475] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-10T17:27:43.938714] [INFO ] [MAIN ] Update Progress: 206/2373 symbols completed. BAC took 32.4s. Estimated remaining: 4h 51m 1s. Rate: 7.4 symbols/min [2025-10-10T17:27:44.087174] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-10T17:27:44.176813] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:27:44.193287] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T17:27:44.199528] [INFO ] [REMOTE ] BA: Full fetch complete (77924 records). [2025-10-10T17:27:44.199771] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-10T17:27:44.290225] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-10T17:27:44.547405] [DEBUG] [LOCAL ] BAK: Loaded 39681 existing records from primary storage. [2025-10-10T17:27:44.569163] [INFO ] [MAIN ] BAK: Loaded 39681 existing records. [2025-10-10T17:27:44.823701] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-10T17:27:44.829000] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-10T17:27:44.830282] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-10T17:27:44.835973] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-10T17:27:44.869436] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:27:44.870036] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-10T17:27:44.870180] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-10T17:27:44.870694] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-10T17:27:44.870773] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-10T17:27:44.876083] [DEBUG] [LOCAL ] BA: Trimmed 77924 records to 54570 (keeping 200 days of data) [2025-10-10T17:27:45.392199] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:27:45.393986] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-10T17:27:45.681535] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.99 seconds). [2025-10-10T17:27:45.695726] [DEBUG] [LOCAL ] BA: Primary data saved (54570 records). [2025-10-10T17:27:45.696040] [INFO ] [MAIN ] BA: Full history saved. [2025-10-10T17:27:45.697875] [INFO ] [MAIN ] Update Progress: 207/2373 symbols completed. BA took 38.8s. Estimated remaining: 4h 49m 47s. Rate: 7.5 symbols/min [2025-10-10T17:27:45.881062] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:27:45.896134] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-10T17:27:45.919450] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T17:27:45.986763] [DEBUG] [LOCAL ] BALL: Loaded 52213 existing records from primary storage. [2025-10-10T17:27:45.987283] [INFO ] [MAIN ] BALL: Loaded 52213 existing records. [2025-10-10T17:27:46.175032] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:27:46.175374] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-10T17:27:46.175428] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-10T17:27:46.175800] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-10T17:27:46.175861] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-10T17:27:46.545278] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:27:46.689354] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-10T17:27:47.364525] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T17:27:47.489418] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-10T17:27:48.289382] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-10T17:27:48.556192] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T17:27:48.605797] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-10T17:27:48.835190] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-10T17:27:48.840881] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-10-10T17:27:48.841065] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-10T17:27:49.096032] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-10T17:27:49.256798] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-10T17:27:49.256916] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-10T17:27:49.257758] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-10T17:27:49.257823] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-10T17:27:49.259318] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 54600 (keeping 200 days of data) [2025-10-10T17:27:49.599210] [DEBUG] [LOCAL ] BABA: Primary data saved (54600 records). [2025-10-10T17:27:49.599367] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-10T17:27:49.599456] [INFO ] [MAIN ] Update Progress: 208/2373 symbols completed. BABA took 39.4s. Estimated remaining: 4h 48m 56s. Rate: 7.5 symbols/min [2025-10-10T17:27:49.774753] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:27:49.775057] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-10T17:27:49.775114] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-10T17:27:49.775238] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-10T17:27:49.775283] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-10T17:27:49.775324] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-10T17:27:49.775359] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-10T17:27:49.894747] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-10T17:27:50.174292] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:27:50.181565] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T17:27:50.689373] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-10T17:27:51.357466] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-10T17:27:51.395143] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-10T17:27:51.489426] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-10T17:27:52.184737] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-10T17:27:52.289427] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-10T17:27:53.033954] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-10T17:27:53.089367] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-10T17:27:53.163390] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-10T17:27:53.889457] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-10T17:27:54.277141] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-10T17:27:54.689374] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-10T17:27:55.489427] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-10T17:27:55.918315] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T17:27:55.987235] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T17:27:56.289402] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-10T17:27:57.089386] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-10T17:27:57.396631] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-10T17:27:57.889362] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-10T17:27:58.024016] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-10T17:27:58.329094] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T17:27:58.689422] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-10T17:27:59.380333] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-10T17:27:59.399774] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T17:27:59.489383] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-10T17:28:00.289350] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-10T17:28:00.392418] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-10T17:28:01.089398] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-10T17:28:01.604956] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-10T17:28:01.889448] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-10T17:28:02.498391] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-10T17:28:02.689373] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-10T17:28:02.728329] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-10T17:28:03.489433] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-10T17:28:04.289368] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-10T17:28:04.331244] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-10T17:28:04.740788] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-10T17:28:04.746254] [INFO ] [REMOTE ] BAH: Full fetch complete (74932 records). [2025-10-10T17:28:04.746446] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-10T17:28:05.094596] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-10T17:28:05.173159] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-10T17:28:05.173293] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-10T17:28:05.174394] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-10T17:28:05.174479] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-10T17:28:05.176871] [DEBUG] [LOCAL ] BAH: Trimmed 74932 records to 52445 (keeping 200 days of data) [2025-10-10T17:28:05.552418] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-10T17:28:05.585687] [DEBUG] [LOCAL ] BAH: Primary data saved (52445 records). [2025-10-10T17:28:05.585959] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-10T17:28:05.586620] [INFO ] [MAIN ] Update Progress: 209/2373 symbols completed. BAH took 38.1s. Estimated remaining: 4h 50m 11s. Rate: 7.5 symbols/min [2025-10-10T17:28:05.720304] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-10T17:28:05.787364] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:28:05.849384] [DEBUG] [LOCAL ] BAM: Loaded 52387 existing records from primary storage. [2025-10-10T17:28:05.849838] [INFO ] [MAIN ] BAM: Loaded 52387 existing records. [2025-10-10T17:28:05.894546] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-10T17:28:06.037933] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:28:06.038238] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-10T17:28:06.038292] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-10T17:28:06.038553] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-10T17:28:06.038619] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-10T17:28:06.405505] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:28:06.689379] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-10T17:28:07.489395] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-10T17:28:07.642377] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T17:28:08.190349] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-10T17:28:08.289402] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-10T17:28:08.756943] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T17:28:08.810717] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-10T17:28:09.089374] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-10T17:28:09.889412] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-10T17:28:10.689411] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-10T17:28:11.155139] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T17:28:11.301135] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-10T17:28:11.303517] [INFO ] [REMOTE ] BALY: Full fetch complete (16656 records). [2025-10-10T17:28:11.303949] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-10T17:28:11.491226] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-10T17:28:11.499989] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T17:28:11.501792] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:28:11.501878] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:28:11.501932] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-10T17:28:11.502028] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-10T17:28:11.502108] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-10T17:28:11.502162] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-10T17:28:11.502237] [INFO ] [MAIN ] Update Progress: 210/2373 symbols completed. BALY took 21.9s. Estimated remaining: 4h 49m 41s. Rate: 7.5 symbols/min [2025-10-10T17:28:11.687991] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:28:11.747097] [DEBUG] [LOCAL ] BANC: Loaded 51663 existing records from primary storage. [2025-10-10T17:28:11.776274] [INFO ] [MAIN ] BANC: Loaded 51663 existing records. [2025-10-10T17:28:11.841980] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T17:28:11.981927] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:28:11.982234] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-10T17:28:11.982287] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-10T17:28:11.982921] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-10T17:28:11.982979] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-10T17:28:12.294733] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-10T17:28:12.363220] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:28:13.089413] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-10T17:28:13.295381] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T17:28:13.889393] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-10T17:28:14.186504] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-10T17:28:14.492997] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T17:28:14.689416] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-10T17:28:15.021865] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-10T17:28:15.025812] [INFO ] [REMOTE ] BAK: Full fetch complete (56720 records). [2025-10-10T17:28:15.025974] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-10T17:28:15.026873] [FATAL] [VALIDATOR ] BAK: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:28:15.026964] [FATAL] [MAIN ] BAK: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:28:15.027010] [WARN ] [MAIN ] BAK: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:28:15.027054] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-10T17:28:15.027119] [DEBUG] [LOCAL ] BAK: No primary data file found to delete. [2025-10-10T17:28:15.027159] [INFO ] [LOCAL ] BAK: Starting deletion of derivative data. [2025-10-10T17:28:15.027474] [DEBUG] [LOCAL ] BAK: Deleted derivative data file. [2025-10-10T17:28:15.027577] [INFO ] [MAIN ] Update Progress: 211/2373 symbols completed. BAK took 31.1s. Estimated remaining: 4h 48m 47s. Rate: 7.5 symbols/min [2025-10-10T17:28:15.201168] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:28:15.229891] [DEBUG] [LOCAL ] BAP: Loaded 26069 existing records from primary storage. [2025-10-10T17:28:15.230249] [INFO ] [MAIN ] BAP: Loaded 26069 existing records. [2025-10-10T17:28:15.414305] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:28:15.414582] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-10T17:28:15.414630] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-10T17:28:15.414902] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-10T17:28:15.414958] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-10T17:28:15.494492] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-10T17:28:15.791291] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:28:16.289406] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-10T17:28:16.723280] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T17:28:16.956660] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T17:28:17.089416] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-10T17:28:17.496793] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T17:28:17.889490] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-10T17:28:18.689395] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-10T17:28:18.740592] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-10T17:28:19.489455] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-10T17:28:20.069188] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-10T17:28:20.289389] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-10T17:28:20.488179] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T17:28:21.009473] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T17:28:21.089436] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-10T17:28:21.876103] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-10T17:28:21.889351] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-10T17:28:22.468704] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-10T17:28:22.689462] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-10T17:28:23.305094] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-10T17:28:23.489434] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-10T17:28:24.289382] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-10T17:28:24.663466] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T17:28:24.921531] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-10T17:28:25.089406] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-10T17:28:25.889371] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-10T17:28:26.336087] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T17:28:26.689428] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-10T17:28:27.004510] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-10T17:28:27.011464] [INFO ] [REMOTE ] BALL: Full fetch complete (75372 records). [2025-10-10T17:28:27.011753] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-10T17:28:27.490799] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-10T17:28:27.494373] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-10T17:28:27.494197] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T17:28:27.501390] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-10T17:28:27.503250] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-10T17:28:27.503826] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-10T17:28:27.506949] [DEBUG] [LOCAL ] BALL: Trimmed 75372 records to 52599 (keeping 200 days of data) [2025-10-10T17:28:27.849977] [DEBUG] [LOCAL ] BALL: Primary data saved (52599 records). [2025-10-10T17:28:27.850117] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-10T17:28:27.850895] [INFO ] [MAIN ] Update Progress: 212/2373 symbols completed. BALL took 42.2s. Estimated remaining: 4h 49m 28s. Rate: 7.5 symbols/min [2025-10-10T17:28:28.023368] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:28:28.063438] [DEBUG] [LOCAL ] BARK: Loaded 38242 existing records from primary storage. [2025-10-10T17:28:28.063845] [INFO ] [MAIN ] BARK: Loaded 38242 existing records. [2025-10-10T17:28:28.240934] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:28:28.241206] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-10T17:28:28.241256] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-10T17:28:28.241685] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-10T17:28:28.241744] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-10T17:28:28.300852] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-10T17:28:28.637094] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:28:28.690393] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T17:28:28.877273] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T17:28:29.089448] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-10T17:28:29.556497] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-10T17:28:29.889445] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-10T17:28:30.689425] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-10T17:28:30.863853] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T17:28:31.397435] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-10T17:28:31.489432] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-10T17:28:32.289409] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-10T17:28:32.376732] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-10T17:28:32.627949] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T17:28:33.089386] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-10T17:28:33.589559] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T17:28:33.889383] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-10T17:28:34.384709] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T17:28:34.689411] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-10T17:28:34.757403] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-10T17:28:35.489395] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-10T17:28:36.294599] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-10T17:28:36.306292] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T17:28:36.405802] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-10T17:28:37.089387] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-10T17:28:37.889342] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-10T17:28:38.068565] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T17:28:38.316199] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T17:28:38.689405] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-10T17:28:39.489405] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-10T17:28:39.956069] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T17:28:40.289412] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-10T17:28:40.637248] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-10T17:28:41.062335] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-10T17:28:41.064963] [INFO ] [REMOTE ] BAP: Full fetch complete (37337 records). [2025-10-10T17:28:41.065040] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-10T17:28:41.095740] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-10T17:28:41.439867] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-10T17:28:41.439954] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-10T17:28:41.440411] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-10T17:28:41.440450] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-10T17:28:41.441341] [DEBUG] [LOCAL ] BAP: Trimmed 37337 records to 26295 (keeping 200 days of data) [2025-10-10T17:28:41.602040] [DEBUG] [LOCAL ] BAP: Primary data saved (26295 records). [2025-10-10T17:28:41.602161] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-10T17:28:41.602245] [INFO ] [MAIN ] Update Progress: 213/2373 symbols completed. BAP took 26.6s. Estimated remaining: 4h 50m 18s. Rate: 7.4 symbols/min [2025-10-10T17:28:41.772590] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:28:41.822170] [DEBUG] [LOCAL ] BAX: Loaded 53893 existing records from primary storage. [2025-10-10T17:28:41.822506] [INFO ] [MAIN ] BAX: Loaded 53893 existing records. [2025-10-10T17:28:41.893938] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-10T17:28:42.005609] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:28:42.015552] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-10T17:28:42.029472] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-10T17:28:42.032688] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-10T17:28:42.033141] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-10T17:28:42.039440] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T17:28:42.403933] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:28:42.689382] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-10T17:28:42.750881] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T17:28:43.489471] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-10T17:28:43.853359] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T17:28:44.289495] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-10T17:28:44.847779] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-10T17:28:44.952348] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T17:28:45.089340] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-10T17:28:45.889355] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-10T17:28:46.253975] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T17:28:46.415281] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T17:28:46.420457] [INFO ] [REMOTE ] BAM: Full fetch complete (74573 records). [2025-10-10T17:28:46.420575] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-10T17:28:46.694877] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-10T17:28:46.817239] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-10T17:28:46.817365] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-10T17:28:46.818161] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-10T17:28:46.818227] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-10T17:28:46.819770] [DEBUG] [LOCAL ] BAM: Trimmed 74573 records to 52777 (keeping 200 days of data) [2025-10-10T17:28:47.140997] [DEBUG] [LOCAL ] BAM: Primary data saved (52777 records). [2025-10-10T17:28:47.141190] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-10T17:28:47.141302] [INFO ] [MAIN ] Update Progress: 214/2373 symbols completed. BAM took 41.6s. Estimated remaining: 4h 49m 44s. Rate: 7.5 symbols/min [2025-10-10T17:28:47.311548] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:28:47.361396] [DEBUG] [LOCAL ] BB: Loaded 53323 existing records from primary storage. [2025-10-10T17:28:47.361746] [INFO ] [MAIN ] BB: Loaded 53323 existing records. [2025-10-10T17:28:47.494582] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-10T17:28:47.577381] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:28:47.578250] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-10T17:28:47.578323] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-10T17:28:47.578577] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-10T17:28:47.578618] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-10T17:28:47.955310] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:28:47.987775] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-10T17:28:48.289387] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-10T17:28:48.419115] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-10T17:28:49.089920] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-10T17:28:49.363288] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T17:28:49.368482] [INFO ] [REMOTE ] BANC: Full fetch complete (74330 records). [2025-10-10T17:28:49.368622] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-10T17:28:49.769177] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-10T17:28:49.769263] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-10T17:28:49.770026] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-10T17:28:49.770104] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-10T17:28:49.771502] [DEBUG] [LOCAL ] BANC: Trimmed 74330 records to 52050 (keeping 200 days of data) [2025-10-10T17:28:49.892750] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-10T17:28:50.101578] [DEBUG] [LOCAL ] BANC: Primary data saved (52050 records). [2025-10-10T17:28:50.101753] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-10T17:28:50.101843] [INFO ] [MAIN ] Update Progress: 215/2373 symbols completed. BANC took 38.6s. Estimated remaining: 4h 48m 45s. Rate: 7.5 symbols/min [2025-10-10T17:28:50.299431] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:28:50.304321] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-10T17:28:50.362706] [DEBUG] [LOCAL ] BBAI: Loaded 54210 existing records from primary storage. [2025-10-10T17:28:50.363038] [INFO ] [MAIN ] BBAI: Loaded 54210 existing records. [2025-10-10T17:28:50.536942] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:28:50.537191] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-10T17:28:50.537244] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-10T17:28:50.537529] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-10T17:28:50.537586] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-10T17:28:50.689541] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-10T17:28:50.894968] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:28:50.923813] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T17:28:51.489416] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-10T17:28:51.529610] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T17:28:52.289373] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-10T17:28:52.923502] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-10T17:28:53.089356] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-10T17:28:53.889343] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-10T17:28:53.938913] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T17:28:54.539528] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (3.05 seconds). [2025-10-10T17:28:54.689337] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-10T17:28:55.239738] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-10T17:28:55.387068] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-10T17:28:55.489344] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-10T17:28:56.289399] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-10T17:28:57.089425] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-10T17:28:57.424119] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-10T17:28:57.889408] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-10T17:28:57.992091] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-10T17:28:58.107273] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T17:28:58.689341] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-10T17:28:58.824723] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-10T17:28:59.489437] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-10T17:29:00.115749] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-10T17:29:00.289410] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-10T17:29:01.018189] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-10T17:29:01.089449] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-10T17:29:01.496002] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-10T17:29:01.889418] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-10T17:29:02.631119] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-10T17:29:02.689395] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-10T17:29:03.255843] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-10T17:29:03.489379] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-10T17:29:03.552223] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T17:29:04.289448] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-10T17:29:05.089414] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-10T17:29:05.361196] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-10T17:29:05.650926] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-10-10T17:29:05.770254] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-10T17:29:05.889372] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-10T17:29:06.620979] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-10T17:29:06.689349] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-10T17:29:07.489364] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-10T17:29:07.569996] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-10T17:29:08.289363] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-10T17:29:08.588074] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T17:29:09.089404] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-10T17:29:09.889392] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-10T17:29:09.980473] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-10T17:29:10.019119] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T17:29:10.689372] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-10T17:29:11.120375] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-10T17:29:11.125945] [INFO ] [REMOTE ] BAX: Full fetch complete (77440 records). [2025-10-10T17:29:11.126119] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-10T17:29:11.494768] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-10T17:29:11.547131] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-10T17:29:11.547543] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-10T17:29:11.548507] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-10T17:29:11.548575] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-10T17:29:11.550291] [DEBUG] [LOCAL ] BAX: Trimmed 77440 records to 54283 (keeping 200 days of data) [2025-10-10T17:29:11.822209] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T17:29:11.934805] [DEBUG] [LOCAL ] BAX: Primary data saved (54283 records). [2025-10-10T17:29:11.934961] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-10T17:29:11.935048] [INFO ] [MAIN ] Update Progress: 216/2373 symbols completed. BAX took 30.3s. Estimated remaining: 4h 50m 55s. Rate: 7.4 symbols/min [2025-10-10T17:29:12.103183] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:29:12.141528] [DEBUG] [LOCAL ] BBAR: Loaded 42187 existing records from primary storage. [2025-10-10T17:29:12.141911] [INFO ] [MAIN ] BBAR: Loaded 42187 existing records. [2025-10-10T17:29:12.295997] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-10T17:29:12.318068] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:29:12.318502] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-10T17:29:12.318569] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-10T17:29:12.318848] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-10T17:29:12.318905] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-10T17:29:12.667561] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:29:13.089453] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-10T17:29:13.122349] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-10T17:29:13.224027] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-10T17:29:13.227961] [INFO ] [REMOTE ] BARK: Full fetch complete (56022 records). [2025-10-10T17:29:13.228097] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-10T17:29:13.624081] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-10T17:29:13.624177] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-10T17:29:13.624930] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-10T17:29:13.624997] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-10T17:29:13.626402] [DEBUG] [LOCAL ] BARK: Trimmed 56022 records to 38560 (keeping 200 days of data) [2025-10-10T17:29:13.864250] [DEBUG] [LOCAL ] BARK: Primary data saved (38560 records). [2025-10-10T17:29:13.864456] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-10T17:29:13.864563] [INFO ] [MAIN ] Update Progress: 217/2373 symbols completed. BARK took 46.0s. Estimated remaining: 4h 49m 45s. Rate: 7.4 symbols/min [2025-10-10T17:29:13.900269] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-10T17:29:14.059574] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:29:14.118091] [DEBUG] [LOCAL ] BBD: Loaded 53631 existing records from primary storage. [2025-10-10T17:29:14.118521] [INFO ] [MAIN ] BBD: Loaded 53631 existing records. [2025-10-10T17:29:14.312624] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:29:14.313306] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-10T17:29:14.313578] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-10T17:29:14.313972] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-10T17:29:14.314039] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-10T17:29:14.632791] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-10T17:29:14.689477] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-10T17:29:14.783313] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:29:14.818378] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T17:29:15.489392] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-10T17:29:16.289482] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-10T17:29:16.609584] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-10T17:29:17.003825] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-10T17:29:17.069940] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-10T17:29:17.089362] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-10T17:29:17.889381] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-10T17:29:17.985963] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-10T17:29:18.689394] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-10T17:29:19.489363] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-10T17:29:19.513898] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-10T17:29:19.521119] [INFO ] [REMOTE ] BB: Full fetch complete (76985 records). [2025-10-10T17:29:19.521335] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-10T17:29:19.952491] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-10T17:29:19.952594] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-10T17:29:19.953415] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-10T17:29:19.953509] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-10T17:29:19.955189] [DEBUG] [LOCAL ] BB: Trimmed 76985 records to 53713 (keeping 200 days of data) [2025-10-10T17:29:20.263014] [DEBUG] [LOCAL ] BB: Primary data saved (53713 records). [2025-10-10T17:29:20.263170] [INFO ] [MAIN ] BB: Full history saved. [2025-10-10T17:29:20.263270] [INFO ] [MAIN ] Update Progress: 218/2373 symbols completed. BB took 33.1s. Estimated remaining: 4h 49m 21s. Rate: 7.4 symbols/min [2025-10-10T17:29:20.458500] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:29:20.514048] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T17:29:20.524303] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-10T17:29:20.538062] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-10T17:29:20.565474] [DEBUG] [LOCAL ] BBDC: Loaded 33271 existing records from primary storage. [2025-10-10T17:29:20.565803] [INFO ] [MAIN ] BBDC: Loaded 33271 existing records. [2025-10-10T17:29:20.807061] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:29:20.807295] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-10T17:29:20.807344] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-10T17:29:20.807556] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-10T17:29:20.807614] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-10T17:29:21.100639] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-10T17:29:21.222674] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:29:21.479424] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-10T17:29:21.641323] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-10T17:29:21.889400] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-10T17:29:22.689415] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-10T17:29:23.489404] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-10T17:29:23.905732] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-10T17:29:23.946029] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-10-10T17:29:24.033558] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-10T17:29:24.289393] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-10T17:29:24.827259] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T17:29:25.089409] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-10T17:29:25.723939] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-10T17:29:25.889411] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-10T17:29:26.689374] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-10T17:29:27.068733] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T17:29:27.398891] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-10T17:29:27.489372] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-10T17:29:28.007210] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T17:29:28.289397] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-10T17:29:29.089453] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-10T17:29:29.889407] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-10T17:29:29.976623] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T17:29:30.689384] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-10T17:29:30.794782] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T17:29:30.894630] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (3.41 seconds). [2025-10-10T17:29:30.900565] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-10-10T17:29:30.900804] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-10T17:29:31.321134] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-10T17:29:31.321290] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-10T17:29:31.322293] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-10T17:29:31.322362] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-10T17:29:31.324423] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-10-10T17:29:31.496781] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-10T17:29:31.667322] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T17:29:31.699543] [DEBUG] [LOCAL ] BBAI: Primary data saved (54600 records). [2025-10-10T17:29:31.699737] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-10T17:29:31.699838] [INFO ] [MAIN ] Update Progress: 219/2373 symbols completed. BBAI took 41.6s. Estimated remaining: 4h 49m 46s. Rate: 7.4 symbols/min [2025-10-10T17:29:31.868746] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:29:31.875820] [DEBUG] [LOCAL ] BBDO: Loaded 5042 existing records from primary storage. [2025-10-10T17:29:31.876047] [INFO ] [MAIN ] BBDO: Loaded 5042 existing records. [2025-10-10T17:29:32.057871] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:29:32.058436] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-10T17:29:32.058496] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-10T17:29:32.058764] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-10T17:29:32.058823] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-10T17:29:32.294689] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-10T17:29:32.467779] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:29:32.486448] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-10T17:29:33.099229] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-10T17:29:33.102465] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-10T17:29:33.889402] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-10T17:29:34.112217] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-10T17:29:34.399328] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-10T17:29:34.689381] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-10T17:29:35.202987] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-10T17:29:35.489360] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-10T17:29:36.065168] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T17:29:36.289411] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-10T17:29:37.029513] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-10T17:29:37.079555] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-10T17:29:37.089329] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-10T17:29:37.889489] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-10T17:29:38.511410] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-10T17:29:38.596762] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T17:29:38.689364] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-10T17:29:39.468382] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-10T17:29:39.489374] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-10T17:29:40.289383] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-10T17:29:41.089419] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-10T17:29:41.474779] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T17:29:41.728736] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T17:29:41.889406] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-10T17:29:42.689401] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-10T17:29:42.912968] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T17:29:43.070608] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T17:29:43.489418] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-10T17:29:44.289442] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-10T17:29:44.530622] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-10T17:29:44.896759] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-10T17:29:45.089381] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-10T17:29:45.821518] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-10T17:29:45.889364] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-10T17:29:46.127155] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T17:29:46.689431] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-10T17:29:47.489352] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-10T17:29:47.581369] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-10T17:29:47.585180] [INFO ] [REMOTE ] BBDC: Full fetch complete (48513 records). [2025-10-10T17:29:47.585305] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-10T17:29:47.951687] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-10T17:29:47.951788] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-10T17:29:47.952337] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-10T17:29:47.952379] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-10T17:29:47.953595] [DEBUG] [LOCAL ] BBDC: Trimmed 48513 records to 33535 (keeping 200 days of data) [2025-10-10T17:29:48.152394] [DEBUG] [LOCAL ] BBDC: Primary data saved (33535 records). [2025-10-10T17:29:48.152536] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-10T17:29:48.152620] [INFO ] [MAIN ] Update Progress: 220/2373 symbols completed. BBDC took 27.9s. Estimated remaining: 4h 51m 0s. Rate: 7.4 symbols/min [2025-10-10T17:29:48.299420] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-10T17:29:48.361863] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:29:48.366515] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T17:29:48.398429] [DEBUG] [LOCAL ] BBN: Loaded 18140 existing records from primary storage. [2025-10-10T17:29:48.398732] [INFO ] [MAIN ] BBN: Loaded 18140 existing records. [2025-10-10T17:29:48.576293] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:29:48.576533] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-10T17:29:48.576583] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-10T17:29:48.577073] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-10T17:29:48.577133] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-10T17:29:48.868586] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T17:29:48.896989] [INFO ] [REMOTE ] BBAR: Full fetch complete (61031 records). [2025-10-10T17:29:48.907494] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-10T17:29:49.008287] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:29:49.094483] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-10T17:29:49.302216] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-10T17:29:49.377378] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-10T17:29:49.377487] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-10T17:29:49.378208] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-10T17:29:49.378271] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-10T17:29:49.379499] [DEBUG] [LOCAL ] BBAR: Trimmed 61031 records to 42518 (keeping 200 days of data) [2025-10-10T17:29:49.631056] [DEBUG] [LOCAL ] BBAR: Primary data saved (42518 records). [2025-10-10T17:29:49.631192] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-10T17:29:49.631277] [INFO ] [MAIN ] Update Progress: 221/2373 symbols completed. BBAR took 37.7s. Estimated remaining: 4h 49m 47s. Rate: 7.4 symbols/min [2025-10-10T17:29:49.835471] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:29:49.835682] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-10T17:29:49.835737] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-10T17:29:49.835854] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-10T17:29:49.835896] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-10T17:29:49.835988] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-10T17:29:49.836052] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-10T17:29:49.897737] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-10T17:29:50.185598] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:29:50.689458] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-10T17:29:51.146356] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-10T17:29:51.151788] [INFO ] [REMOTE ] BBD: Full fetch complete (77106 records). [2025-10-10T17:29:51.151925] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-10T17:29:51.464608] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-10T17:29:51.494467] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-10T17:29:51.571674] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-10T17:29:51.571796] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-10T17:29:51.573191] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-10T17:29:51.573284] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-10T17:29:51.590411] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T17:29:51.597130] [DEBUG] [LOCAL ] BBD: Trimmed 77106 records to 54018 (keeping 200 days of data) [2025-10-10T17:29:51.822077] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:29:51.824705] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-10T17:29:51.825338] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:29:51.825634] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-10T17:29:51.826025] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:29:51.826329] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-10T17:29:51.827411] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-10T17:29:51.828255] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-10T17:29:51.828670] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-10T17:29:51.828755] [INFO ] [MAIN ] Update Progress: 222/2373 symbols completed. BBT took 2.2s. Estimated remaining: 4h 48m 42s. Rate: 7.5 symbols/min [2025-10-10T17:29:52.009985] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:29:52.011705] [DEBUG] [LOCAL ] BBU: No existing data file found in primary storage. [2025-10-10T17:29:52.012001] [WARN ] [MAIN ] BBU: No existing data found, performing full refresh instead. [2025-10-10T17:29:52.013684] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-10T17:29:52.017577] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-10T17:29:52.017709] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-10T17:29:52.017756] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-10T17:29:52.294401] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-10T17:29:52.398887] [DEBUG] [LOCAL ] BBD: Primary data saved (54018 records). [2025-10-10T17:29:52.414800] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-10T17:29:52.469599] [INFO ] [MAIN ] Update Progress: 223/2373 symbols completed. BBD took 38.6s. Estimated remaining: 4h 47m 23s. Rate: 7.5 symbols/min [2025-10-10T17:29:52.474250] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:29:52.647127] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:29:52.665879] [DEBUG] [LOCAL ] BBUC: Loaded 13573 existing records from primary storage. [2025-10-10T17:29:52.666208] [INFO ] [MAIN ] BBUC: Loaded 13573 existing records. [2025-10-10T17:29:52.855825] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:29:52.856217] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-10T17:29:52.856284] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-10T17:29:52.856532] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-10T17:29:52.856594] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-10T17:29:53.035065] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-10T17:29:53.094507] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-10T17:29:53.238361] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:29:53.889405] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-10T17:29:54.315668] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-10T17:29:54.689357] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-10T17:29:54.892693] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T17:29:55.489389] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-10T17:29:55.501140] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-10T17:29:56.289428] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-10T17:29:56.439525] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-10T17:29:57.089425] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-10T17:29:57.459053] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-10T17:29:57.836093] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-10T17:29:57.889409] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-10T17:29:58.593827] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-10T17:29:58.689333] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-10T17:29:59.390352] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T17:29:59.489388] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-10T17:30:00.211754] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-10T17:30:00.289373] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-10T17:30:00.880392] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-10T17:30:01.089370] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-10T17:30:01.889494] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-10T17:30:02.335867] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-10T17:30:02.506934] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-10T17:30:02.689401] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-10T17:30:03.367239] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-10T17:30:03.489410] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-10T17:30:04.043922] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-10T17:30:04.289419] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-10T17:30:05.089378] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-10T17:30:05.188068] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-10T17:30:05.889361] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-10T17:30:06.255741] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-10T17:30:06.689463] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-10T17:30:06.756363] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-10T17:30:07.250770] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-10T17:30:07.251936] [INFO ] [REMOTE ] BBDO: Full fetch complete (7547 records). [2025-10-10T17:30:07.252072] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-10T17:30:07.494575] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-10T17:30:07.651660] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-10T17:30:07.651779] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-10T17:30:07.652153] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-10T17:30:07.652218] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-10T17:30:07.652796] [DEBUG] [LOCAL ] BBDO: Trimmed 7547 records to 5077 (keeping 200 days of data) [2025-10-10T17:30:07.686614] [DEBUG] [LOCAL ] BBDO: Primary data saved (5077 records). [2025-10-10T17:30:07.686838] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-10T17:30:07.686969] [INFO ] [MAIN ] Update Progress: 224/2373 symbols completed. BBDO took 36.0s. Estimated remaining: 4h 48m 24s. Rate: 7.5 symbols/min [2025-10-10T17:30:07.877366] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:30:07.932700] [DEBUG] [LOCAL ] BBVA: Loaded 49530 existing records from primary storage. [2025-10-10T17:30:07.933133] [INFO ] [MAIN ] BBVA: Loaded 49530 existing records. [2025-10-10T17:30:08.171583] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:30:08.179364] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-10T17:30:08.179620] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-10T17:30:08.182028] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-10T17:30:08.183884] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-10T17:30:08.183996] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-10T17:30:08.295036] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-10T17:30:08.736696] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:30:09.089481] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-10T17:30:09.248702] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-10T17:30:09.889397] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-10T17:30:10.196253] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-10T17:30:10.671441] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-10T17:30:10.689349] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-10T17:30:11.489371] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-10T17:30:11.666880] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T17:30:11.668711] [INFO ] [REMOTE ] BBU: Full fetch complete (7067 records). [2025-10-10T17:30:11.668781] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-10T17:30:12.089373] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-10T17:30:12.089484] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-10T17:30:12.089912] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-10T17:30:12.089986] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-10T17:30:12.090478] [DEBUG] [LOCAL ] BBU: Trimmed 7067 records to 5254 (keeping 200 days of data) [2025-10-10T17:30:12.127230] [DEBUG] [LOCAL ] BBU: Primary data saved (5254 records). [2025-10-10T17:30:12.127401] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-10T17:30:12.127484] [INFO ] [MAIN ] Update Progress: 225/2373 symbols completed. BBU took 20.3s. Estimated remaining: 4h 47m 41s. Rate: 7.5 symbols/min [2025-10-10T17:30:12.294532] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-10T17:30:12.297187] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:30:12.326716] [DEBUG] [LOCAL ] BBW: Loaded 27318 existing records from primary storage. [2025-10-10T17:30:12.327023] [INFO ] [MAIN ] BBW: Loaded 27318 existing records. [2025-10-10T17:30:12.501484] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:30:12.501846] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-10T17:30:12.501913] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-10T17:30:12.502195] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-10T17:30:12.502251] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-10T17:30:12.861912] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:30:12.875391] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T17:30:13.038513] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-10T17:30:13.089398] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-10T17:30:13.889399] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-10T17:30:14.309863] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T17:30:14.495369] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-10T17:30:14.689417] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-10T17:30:15.489380] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-10T17:30:16.124391] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-10T17:30:16.289382] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-10T17:30:17.034376] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-10T17:30:17.089430] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-10T17:30:17.658999] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T17:30:17.889397] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-10T17:30:18.043142] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-10T17:30:18.689363] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-10T17:30:19.489405] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-10T17:30:19.634110] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-10T17:30:20.127553] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-10T17:30:20.289395] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-10T17:30:20.843518] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-10T17:30:21.089426] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-10T17:30:21.889431] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-10T17:30:22.162440] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-10T17:30:22.613030] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T17:30:22.689410] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-10T17:30:22.991201] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-10T17:30:22.993372] [INFO ] [REMOTE ] BBUC: Full fetch complete (18406 records). [2025-10-10T17:30:22.993570] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-10T17:30:22.994123] [FATAL] [VALIDATOR ] BBUC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:30:22.994197] [FATAL] [MAIN ] BBUC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:30:22.994254] [WARN ] [MAIN ] BBUC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:30:22.994297] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-10T17:30:22.994358] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-10T17:30:22.994394] [INFO ] [LOCAL ] BBUC: Starting deletion of derivative data. [2025-10-10T17:30:22.994704] [DEBUG] [LOCAL ] BBUC: Deleted derivative data file. [2025-10-10T17:30:22.994830] [INFO ] [MAIN ] Update Progress: 226/2373 symbols completed. BBUC took 30.5s. Estimated remaining: 4h 48m 0s. Rate: 7.5 symbols/min [2025-10-10T17:30:23.166269] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:30:23.229853] [DEBUG] [LOCAL ] BBWI: Loaded 53972 existing records from primary storage. [2025-10-10T17:30:23.230338] [INFO ] [MAIN ] BBWI: Loaded 53972 existing records. [2025-10-10T17:30:23.424377] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:30:23.424845] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-10T17:30:23.424915] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-10T17:30:23.425233] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-10T17:30:23.425290] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-10T17:30:23.499078] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-10T17:30:23.819741] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:30:24.289375] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-10T17:30:24.637867] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T17:30:24.642935] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T17:30:24.655824] [INFO ] [REMOTE ] BBN: Full fetch complete (25890 records). [2025-10-10T17:30:24.655938] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-10T17:30:25.010391] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-10T17:30:25.010475] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-10T17:30:25.010896] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-10T17:30:25.010957] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-10T17:30:25.012337] [DEBUG] [LOCAL ] BBN: Trimmed 25890 records to 18236 (keeping 200 days of data) [2025-10-10T17:30:25.093917] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-10T17:30:25.129361] [DEBUG] [LOCAL ] BBN: Primary data saved (18236 records). [2025-10-10T17:30:25.129537] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-10T17:30:25.129629] [INFO ] [MAIN ] Update Progress: 227/2373 symbols completed. BBN took 37.0s. Estimated remaining: 4h 46m 56s. Rate: 7.5 symbols/min [2025-10-10T17:30:25.294593] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:30:25.349684] [DEBUG] [LOCAL ] BBY: Loaded 53840 existing records from primary storage. [2025-10-10T17:30:25.350058] [INFO ] [MAIN ] BBY: Loaded 53840 existing records. [2025-10-10T17:30:25.584920] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:30:25.585268] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-10T17:30:25.585338] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-10T17:30:25.585941] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-10T17:30:25.585998] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-10T17:30:25.892679] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-10T17:30:26.009747] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:30:26.063518] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T17:30:26.118192] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-10T17:30:26.689424] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-10T17:30:27.489410] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-10T17:30:28.180501] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-10T17:30:28.230062] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-10T17:30:28.289407] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-10T17:30:29.089400] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-10T17:30:29.621636] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-10T17:30:29.889408] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-10T17:30:30.280499] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T17:30:30.373613] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T17:30:30.689400] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-10T17:30:31.489364] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-10T17:30:31.592817] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-10T17:30:32.264396] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T17:30:32.289354] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-10T17:30:33.004245] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-10T17:30:33.089440] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-10T17:30:33.847745] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T17:30:33.889405] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-10T17:30:34.431523] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T17:30:34.689455] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-10T17:30:35.213451] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T17:30:35.489432] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-10T17:30:36.289412] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-10T17:30:37.018764] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-10T17:30:37.047539] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-10T17:30:37.089375] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-10T17:30:37.889381] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-10T17:30:37.940567] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-10T17:30:38.402310] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-10T17:30:38.689444] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-10T17:30:39.382610] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T17:30:39.489378] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-10T17:30:40.212124] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T17:30:40.289459] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-10T17:30:41.089400] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-10T17:30:41.601173] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T17:30:41.889430] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-10T17:30:42.070805] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T17:30:42.689363] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-10T17:30:42.942910] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-10T17:30:43.488065] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T17:30:43.498489] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-10T17:30:44.276474] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-10T17:30:44.280187] [INFO ] [REMOTE ] BBW: Full fetch complete (39676 records). [2025-10-10T17:30:44.280287] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-10T17:30:44.294703] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-10T17:30:44.663776] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-10T17:30:44.663895] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-10T17:30:44.664428] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-10T17:30:44.664471] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-10T17:30:44.665750] [DEBUG] [LOCAL ] BBW: Trimmed 39676 records to 27623 (keeping 200 days of data) [2025-10-10T17:30:44.844403] [DEBUG] [LOCAL ] BBW: Primary data saved (27623 records). [2025-10-10T17:30:44.844573] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-10T17:30:44.844692] [INFO ] [MAIN ] Update Progress: 228/2373 symbols completed. BBW took 32.7s. Estimated remaining: 4h 48m 38s. Rate: 7.4 symbols/min [2025-10-10T17:30:45.016879] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:30:45.061974] [DEBUG] [LOCAL ] BC: Loaded 44402 existing records from primary storage. [2025-10-10T17:30:45.062474] [INFO ] [MAIN ] BC: Loaded 44402 existing records. [2025-10-10T17:30:45.093909] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-10T17:30:45.257776] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:30:45.258378] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-10T17:30:45.258634] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-10T17:30:45.259186] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-10T17:30:45.259253] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-10T17:30:45.414473] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T17:30:45.671833] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:30:45.889368] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-10T17:30:46.308383] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T17:30:46.689403] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-10T17:30:47.356906] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-10T17:30:47.398065] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-10T17:30:47.489389] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-10T17:30:48.289352] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-10T17:30:48.477080] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-10T17:30:48.481895] [INFO ] [REMOTE ] BBVA: Full fetch complete (71597 records). [2025-10-10T17:30:48.482023] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-10T17:30:48.871493] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-10T17:30:48.871604] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-10T17:30:48.872388] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-10T17:30:48.872446] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-10T17:30:48.873831] [DEBUG] [LOCAL ] BBVA: Trimmed 71597 records to 49892 (keeping 200 days of data) [2025-10-10T17:30:49.090901] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-10T17:30:49.170440] [DEBUG] [LOCAL ] BBVA: Primary data saved (49892 records). [2025-10-10T17:30:49.170614] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-10T17:30:49.170744] [INFO ] [MAIN ] Update Progress: 229/2373 symbols completed. BBVA took 41.5s. Estimated remaining: 4h 47m 55s. Rate: 7.4 symbols/min [2025-10-10T17:30:49.338180] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:30:49.369886] [DEBUG] [LOCAL ] BCAT: Loaded 34322 existing records from primary storage. [2025-10-10T17:30:49.370249] [INFO ] [MAIN ] BCAT: Loaded 34322 existing records. [2025-10-10T17:30:49.546195] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:30:49.546707] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-10T17:30:49.546846] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-10T17:30:49.547212] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-10T17:30:49.547411] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-10T17:30:49.833959] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-10T17:30:49.889745] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-10T17:30:49.954451] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:30:50.386536] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-10T17:30:50.499789] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T17:30:50.689374] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-10T17:30:51.489444] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-10T17:30:52.289433] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-10T17:30:52.294255] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-10T17:30:52.342815] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T17:30:53.089379] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-10T17:30:53.367392] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T17:30:53.525737] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T17:30:53.889395] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-10T17:30:54.689350] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-10T17:30:54.721880] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T17:30:54.888463] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-10T17:30:55.489380] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-10T17:30:56.289418] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-10T17:30:56.818824] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-10T17:30:57.089417] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-10T17:30:57.366585] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T17:30:57.444499] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T17:30:57.889383] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-10T17:30:58.689406] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-10T17:30:59.205689] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-10T17:30:59.281350] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-10T17:30:59.489435] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-10T17:31:00.289466] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-10T17:31:00.975458] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-10T17:31:01.084834] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-10T17:31:01.095160] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-10T17:31:01.889406] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-10T17:31:02.497965] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-10T17:31:02.503059] [INFO ] [REMOTE ] BBY: Full fetch complete (77230 records). [2025-10-10T17:31:02.503204] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-10T17:31:02.699747] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-10T17:31:02.903123] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-10T17:31:02.903205] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-10T17:31:02.904028] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-10T17:31:02.904092] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-10T17:31:02.905519] [DEBUG] [LOCAL ] BBY: Trimmed 77230 records to 54230 (keeping 200 days of data) [2025-10-10T17:31:03.240373] [DEBUG] [LOCAL ] BBY: Primary data saved (54230 records). [2025-10-10T17:31:03.240517] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-10T17:31:03.241079] [INFO ] [MAIN ] Update Progress: 230/2373 symbols completed. BBY took 38.1s. Estimated remaining: 4h 48m 43s. Rate: 7.4 symbols/min [2025-10-10T17:31:03.411025] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:31:03.441164] [DEBUG] [LOCAL ] BCC: Loaded 28437 existing records from primary storage. [2025-10-10T17:31:03.441675] [INFO ] [MAIN ] BCC: Loaded 28437 existing records. [2025-10-10T17:31:03.657486] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:31:03.660922] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-10T17:31:03.661325] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-10T17:31:03.663346] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-10T17:31:03.663439] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-10T17:31:03.674828] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-10T17:31:03.731531] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-10T17:31:03.983734] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-10T17:31:04.096048] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:31:04.115963] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-10T17:31:04.289361] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-10T17:31:05.089385] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-10T17:31:05.348282] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-10T17:31:05.354107] [INFO ] [REMOTE ] BBWI: Full fetch complete (77443 records). [2025-10-10T17:31:05.354250] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-10T17:31:05.751779] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-10T17:31:05.751878] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-10T17:31:05.752718] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-10T17:31:05.752785] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-10T17:31:05.754324] [DEBUG] [LOCAL ] BBWI: Trimmed 77443 records to 54362 (keeping 200 days of data) [2025-10-10T17:31:05.936453] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-10T17:31:06.025316] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T17:31:06.133734] [DEBUG] [LOCAL ] BBWI: Primary data saved (54362 records). [2025-10-10T17:31:06.133902] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-10T17:31:06.134549] [INFO ] [MAIN ] Update Progress: 231/2373 symbols completed. BBWI took 43.1s. Estimated remaining: 4h 47m 47s. Rate: 7.4 symbols/min [2025-10-10T17:31:06.316163] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:31:06.396863] [DEBUG] [LOCAL ] BCE: Loaded 52590 existing records from primary storage. [2025-10-10T17:31:06.397217] [INFO ] [MAIN ] BCE: Loaded 52590 existing records. [2025-10-10T17:31:06.580328] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:31:06.580871] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-10T17:31:06.581140] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-10T17:31:06.581434] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-10T17:31:06.581593] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-10T17:31:06.694743] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-10T17:31:06.702349] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-10T17:31:06.970330] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:31:07.425885] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T17:31:07.489462] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-10T17:31:07.661664] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-10T17:31:08.289370] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-10T17:31:08.729477] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T17:31:09.089465] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-10T17:31:09.654140] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T17:31:09.889393] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-10T17:31:10.689411] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-10T17:31:11.132679] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T17:31:11.296786] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-10T17:31:11.489391] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-10T17:31:12.134100] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T17:31:12.289445] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-10T17:31:12.984301] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-10T17:31:13.089412] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-10T17:31:13.852837] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T17:31:13.889343] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-10T17:31:14.689407] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-10T17:31:15.049151] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-10T17:31:15.489423] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-10T17:31:15.708230] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T17:31:16.271262] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T17:31:16.289440] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-10T17:31:17.089443] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-10T17:31:17.473975] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T17:31:17.889350] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-10T17:31:17.909591] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T17:31:18.363933] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T17:31:18.689391] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-10T17:31:19.385160] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-10T17:31:19.489440] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-10T17:31:19.946719] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T17:31:19.950135] [INFO ] [REMOTE ] BCAT: Full fetch complete (49701 records). [2025-10-10T17:31:19.950260] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-10T17:31:19.950962] [FATAL] [VALIDATOR ] BCAT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:31:19.951050] [FATAL] [MAIN ] BCAT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:31:19.951093] [WARN ] [MAIN ] BCAT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:31:19.951133] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-10T17:31:19.951197] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-10-10T17:31:19.951232] [INFO ] [LOCAL ] BCAT: Starting deletion of derivative data. [2025-10-10T17:31:19.951490] [DEBUG] [LOCAL ] BCAT: Deleted derivative data file. [2025-10-10T17:31:19.951609] [INFO ] [MAIN ] Update Progress: 232/2373 symbols completed. BCAT took 30.8s. Estimated remaining: 4h 48m 32s. Rate: 7.4 symbols/min [2025-10-10T17:31:20.119505] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:31:20.151706] [DEBUG] [LOCAL ] BCH: Loaded 30038 existing records from primary storage. [2025-10-10T17:31:20.152081] [INFO ] [MAIN ] BCH: Loaded 30038 existing records. [2025-10-10T17:31:20.295380] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-10T17:31:20.337989] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:31:20.338842] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-10T17:31:20.338957] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-10T17:31:20.339342] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-10T17:31:20.339403] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-10T17:31:20.778050] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:31:21.020550] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T17:31:21.089378] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-10T17:31:21.889416] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-10T17:31:22.370111] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T17:31:22.461474] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T17:31:22.686385] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-10T17:31:22.692899] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-10T17:31:23.489427] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-10T17:31:24.289363] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-10T17:31:24.394583] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-10T17:31:24.398579] [INFO ] [REMOTE ] BC: Full fetch complete (63623 records). [2025-10-10T17:31:24.398712] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-10T17:31:24.801009] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-10T17:31:24.801564] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T17:31:24.801782] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-10T17:31:24.807898] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-10T17:31:24.807986] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-10T17:31:24.809355] [DEBUG] [LOCAL ] BC: Trimmed 63623 records to 44741 (keeping 200 days of data) [2025-10-10T17:31:25.084511] [DEBUG] [LOCAL ] BC: Primary data saved (44741 records). [2025-10-10T17:31:25.084717] [INFO ] [MAIN ] BC: Full history saved. [2025-10-10T17:31:25.084842] [INFO ] [MAIN ] Update Progress: 233/2373 symbols completed. BC took 40.2s. Estimated remaining: 4h 47m 57s. Rate: 7.4 symbols/min [2025-10-10T17:31:25.097066] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-10T17:31:25.261344] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:31:25.291914] [DEBUG] [LOCAL ] BCO: Loaded 25899 existing records from primary storage. [2025-10-10T17:31:25.292300] [INFO ] [MAIN ] BCO: Loaded 25899 existing records. [2025-10-10T17:31:25.488215] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:31:25.488518] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-10T17:31:25.488570] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-10T17:31:25.488864] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-10T17:31:25.488922] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-10T17:31:25.875481] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:31:25.889365] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-10T17:31:26.022867] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-10T17:31:26.250412] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T17:31:26.689382] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-10T17:31:26.794458] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-10T17:31:27.489382] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-10T17:31:27.608733] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-10T17:31:28.206314] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-10T17:31:28.289347] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-10T17:31:29.089399] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-10T17:31:29.575363] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T17:31:29.889393] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-10T17:31:30.529552] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-10T17:31:30.680505] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-10T17:31:30.689328] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-10T17:31:31.489449] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-10T17:31:32.236072] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-10T17:31:32.289358] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-10T17:31:33.089394] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-10T17:31:33.212092] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-10T17:31:33.662599] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T17:31:33.889413] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-10T17:31:34.156433] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-10T17:31:34.689401] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-10T17:31:34.834077] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-10T17:31:35.489408] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-10T17:31:36.103463] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-10T17:31:36.289374] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-10T17:31:36.452480] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-10T17:31:37.089414] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-10T17:31:37.685482] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-10T17:31:37.889372] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-10T17:31:38.530347] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T17:31:38.689355] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-10T17:31:39.489358] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-10T17:31:40.066666] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-10T17:31:40.211259] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T17:31:40.289413] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-10T17:31:40.761205] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-10T17:31:41.089398] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-10T17:31:41.889416] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-10T17:31:42.061548] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T17:31:42.671225] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-10T17:31:42.689349] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-10T17:31:43.261091] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-10T17:31:43.489357] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-10T17:31:44.130127] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T17:31:44.135163] [INFO ] [REMOTE ] BCE: Full fetch complete (75943 records). [2025-10-10T17:31:44.135312] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-10T17:31:44.294275] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-10T17:31:44.562977] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-10T17:31:44.563061] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-10T17:31:44.563889] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-10T17:31:44.563958] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-10T17:31:44.565517] [DEBUG] [LOCAL ] BCE: Trimmed 75943 records to 52976 (keeping 200 days of data) [2025-10-10T17:31:44.799816] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-10T17:31:44.804260] [INFO ] [REMOTE ] BCO: Full fetch complete (36296 records). [2025-10-10T17:31:44.805622] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-10T17:31:45.094954] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-10T17:31:45.296505] [DEBUG] [LOCAL ] BCE: Primary data saved (52976 records). [2025-10-10T17:31:45.299814] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-10T17:31:45.300026] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-10T17:31:45.300182] [INFO ] [MAIN ] Update Progress: 234/2373 symbols completed. BCE took 39.2s. Estimated remaining: 4h 49m 40s. Rate: 7.4 symbols/min [2025-10-10T17:31:45.300468] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-10T17:31:45.333614] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-10T17:31:45.338871] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-10T17:31:45.405369] [DEBUG] [LOCAL ] BCO: Trimmed 36296 records to 26031 (keeping 200 days of data) [2025-10-10T17:31:45.580778] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:31:45.581922] [DEBUG] [LOCAL ] BCS: No existing data file found in primary storage. [2025-10-10T17:31:45.582278] [WARN ] [MAIN ] BCS: No existing data found, performing full refresh instead. [2025-10-10T17:31:45.582701] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-10T17:31:45.583452] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-10T17:31:45.584534] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-10-10T17:31:45.584863] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-10T17:31:45.984444] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:31:45.993946] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-10T17:31:46.009327] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-10T17:31:46.061107] [DEBUG] [LOCAL ] BCO: Primary data saved (26031 records). [2025-10-10T17:31:46.061276] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-10T17:31:46.061365] [INFO ] [MAIN ] Update Progress: 235/2373 symbols completed. BCO took 21.0s. Estimated remaining: 4h 48m 24s. Rate: 7.4 symbols/min [2025-10-10T17:31:46.230963] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:31:46.261168] [DEBUG] [LOCAL ] BCSF: Loaded 28234 existing records from primary storage. [2025-10-10T17:31:46.261460] [INFO ] [MAIN ] BCSF: Loaded 28234 existing records. [2025-10-10T17:31:46.435318] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:31:46.435541] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-10T17:31:46.435586] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-10T17:31:46.436133] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-10T17:31:46.436199] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-10T17:31:46.689531] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-10T17:31:46.813522] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:31:46.814505] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-10T17:31:47.489350] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-10T17:31:47.580153] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T17:31:48.094351] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-10T17:31:48.289381] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-10T17:31:48.984750] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T17:31:48.988730] [INFO ] [REMOTE ] BCC: Full fetch complete (41004 records). [2025-10-10T17:31:48.988837] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-10T17:31:49.094615] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-10T17:31:49.409175] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-10T17:31:49.409316] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-10T17:31:49.410059] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-10T17:31:49.410143] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-10T17:31:49.411580] [DEBUG] [LOCAL ] BCC: Trimmed 41004 records to 28719 (keeping 200 days of data) [2025-10-10T17:31:49.614738] [DEBUG] [LOCAL ] BCC: Primary data saved (28719 records). [2025-10-10T17:31:49.614929] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-10T17:31:49.615030] [INFO ] [MAIN ] Update Progress: 236/2373 symbols completed. BCC took 46.4s. Estimated remaining: 4h 47m 35s. Rate: 7.4 symbols/min [2025-10-10T17:31:49.790040] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:31:49.813150] [DEBUG] [LOCAL ] BCX: Loaded 21780 existing records from primary storage. [2025-10-10T17:31:49.813498] [INFO ] [MAIN ] BCX: Loaded 21780 existing records. [2025-10-10T17:31:49.892715] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-10T17:31:50.011978] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:31:50.012456] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-10T17:31:50.012568] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-10T17:31:50.013114] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-10T17:31:50.013324] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-10T17:31:50.400849] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-10T17:31:50.445546] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:31:50.629989] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-10T17:31:50.634407] [INFO ] [REMOTE ] BCH: Full fetch complete (41265 records). [2025-10-10T17:31:50.634522] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-10T17:31:50.694741] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-10T17:31:51.047105] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-10T17:31:51.047210] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-10T17:31:51.047823] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-10T17:31:51.047891] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-10T17:31:51.049441] [DEBUG] [LOCAL ] BCH: Trimmed 41265 records to 30383 (keeping 200 days of data) [2025-10-10T17:31:51.227816] [DEBUG] [LOCAL ] BCH: Primary data saved (30383 records). [2025-10-10T17:31:51.227964] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-10T17:31:51.228061] [INFO ] [MAIN ] Update Progress: 237/2373 symbols completed. BCH took 31.3s. Estimated remaining: 4h 46m 29s. Rate: 7.5 symbols/min [2025-10-10T17:31:51.451541] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-10T17:31:51.489402] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-10T17:31:52.289413] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-10T17:31:52.822626] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-10T17:31:52.916361] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T17:31:53.089379] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-10T17:31:53.183476] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T17:31:53.889442] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-10T17:31:54.689429] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-10T17:31:55.385205] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-10T17:31:55.413033] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-10T17:31:55.489391] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-10T17:31:56.067017] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-10T17:31:56.289414] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-10T17:31:57.052971] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-10T17:31:57.089331] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-10T17:31:57.153443] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T17:31:57.889456] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-10T17:31:58.367474] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T17:31:58.689381] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-10T17:31:59.489338] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-10T17:31:59.660966] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-10T17:32:00.017918] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-10T17:32:00.289399] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-10T17:32:01.089380] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-10T17:32:01.195483] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T17:32:01.492258] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T17:32:01.889395] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-10T17:32:02.621050] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T17:32:02.689412] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-10T17:32:02.790327] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T17:32:03.489392] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-10T17:32:04.182307] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-10T17:32:04.289416] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-10T17:32:04.849443] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-10T17:32:05.089411] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-10T17:32:05.889101] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-10T17:32:05.895698] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-10T17:32:06.298328] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T17:32:06.689373] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-10T17:32:07.489346] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-10T17:32:08.047750] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-10T17:32:08.074509] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-10T17:32:08.289424] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-10T17:32:08.674000] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T17:32:09.089441] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-10T17:32:09.889409] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-10T17:32:09.998879] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T17:32:10.029692] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-10T17:32:10.689341] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-10T17:32:11.101723] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-10T17:32:11.104285] [INFO ] [REMOTE ] BCX: Full fetch complete (33594 records). [2025-10-10T17:32:11.104360] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-10T17:32:11.480467] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-10T17:32:11.480549] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-10T17:32:11.481034] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-10T17:32:11.481097] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-10T17:32:11.482089] [DEBUG] [LOCAL ] BCX: Trimmed 33594 records to 22009 (keeping 200 days of data) [2025-10-10T17:32:11.531820] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-10T17:32:11.616389] [DEBUG] [LOCAL ] BCX: Primary data saved (22009 records). [2025-10-10T17:32:11.616539] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-10T17:32:11.616625] [INFO ] [MAIN ] Update Progress: 238/2373 symbols completed. BCX took 22.0s. Estimated remaining: 4h 48m 12s. Rate: 7.4 symbols/min [2025-10-10T17:32:12.135094] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T17:32:12.289386] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-10T17:32:13.612858] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-10T17:32:13.618880] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-10T17:32:13.730716] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-10T17:32:13.735749] [INFO ] [REMOTE ] BCS: Full fetch complete (77331 records). [2025-10-10T17:32:13.735879] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-10T17:32:14.117752] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-10T17:32:14.117838] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-10T17:32:14.118637] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-10T17:32:14.118725] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-10T17:32:14.120324] [DEBUG] [LOCAL ] BCS: Trimmed 77331 records to 54222 (keeping 200 days of data) [2025-10-10T17:32:14.453777] [DEBUG] [LOCAL ] BCS: Primary data saved (54222 records). [2025-10-10T17:32:14.453928] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-10T17:32:14.454007] [INFO ] [MAIN ] Update Progress: 239/2373 symbols completed. BCS took 29.2s. Estimated remaining: 4h 47m 16s. Rate: 7.4 symbols/min [2025-10-10T17:32:15.138553] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T17:32:15.146439] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-10T17:32:16.391438] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-10T17:32:16.394902] [INFO ] [REMOTE ] BCSF: Full fetch complete (39073 records). [2025-10-10T17:32:16.394989] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-10T17:32:16.805411] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-10T17:32:16.805490] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-10T17:32:16.806002] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-10T17:32:16.806065] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-10T17:32:16.807004] [DEBUG] [LOCAL ] BCSF: Trimmed 39073 records to 28477 (keeping 200 days of data) [2025-10-10T17:32:16.976482] [DEBUG] [LOCAL ] BCSF: Primary data saved (28477 records). [2025-10-10T17:32:16.976632] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-10T17:32:16.976756] [INFO ] [MAIN ] Update Progress: 240/2373 symbols completed. BCSF took 30.9s. Estimated remaining: 4h 46m 19s. Rate: 7.4 symbols/min [2025-10-10T17:32:17.566065] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:32:17.643474] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:32:17.720826] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:32:17.722520] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:32:17.754146] [DEBUG] [LOCAL ] BDC: Loaded 24705 existing records from primary storage. [2025-10-10T17:32:17.754545] [INFO ] [MAIN ] BDC: Loaded 24705 existing records. [2025-10-10T17:32:17.872381] [DEBUG] [LOCAL ] BDJ: Loaded 29460 existing records from primary storage. [2025-10-10T17:32:17.907011] [DEBUG] [LOCAL ] BDN: Loaded 47913 existing records from primary storage. [2025-10-10T17:32:17.907195] [INFO ] [MAIN ] BDJ: Loaded 29460 existing records. [2025-10-10T17:32:17.907706] [INFO ] [MAIN ] BDN: Loaded 47913 existing records. [2025-10-10T17:32:18.185737] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:32:18.208523] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-10T17:32:18.203165] [DEBUG] [LOCAL ] BDX: Loaded 52620 existing records from primary storage. [2025-10-10T17:32:18.239049] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-10T17:32:18.290285] [INFO ] [MAIN ] BDX: Loaded 52620 existing records. [2025-10-10T17:32:18.324330] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:32:18.306346] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-10T17:32:18.413767] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-10T17:32:18.428686] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-10T17:32:18.460597] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-10T17:32:18.479999] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:32:18.557770] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-10T17:32:18.538337] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-10T17:32:18.578509] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-10T17:32:18.588937] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-10T17:32:18.628481] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-10T17:32:18.637297] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-10T17:32:18.862185] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:32:18.896108] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-10T17:32:18.913078] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-10T17:32:18.955113] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-10T17:32:18.984400] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-10T17:32:19.713213] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:32:19.823927] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-10T17:32:19.828248] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:32:19.959007] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-10T17:32:19.923283] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:32:19.986170] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-10T17:32:20.063077] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:32:20.063445] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-10T17:32:21.403804] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-10T17:32:21.409241] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-10T17:32:21.517127] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-10T17:32:21.523940] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-10T17:32:21.901786] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T17:32:21.913692] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-10T17:32:22.158680] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-10T17:32:22.169880] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-10T17:32:22.278091] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-10T17:32:22.283901] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-10T17:32:22.975865] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-10T17:32:22.982602] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-10T17:32:23.333093] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-10T17:32:23.344200] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-10T17:32:23.699744] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T17:32:23.705408] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-10T17:32:23.870292] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-10T17:32:24.115800] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T17:32:24.289369] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-10T17:32:24.662684] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-10T17:32:25.089344] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-10T17:32:25.216218] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-10T17:32:25.581067] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T17:32:25.889388] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-10T17:32:26.634925] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-10T17:32:26.689343] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-10T17:32:27.489376] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-10T17:32:27.815230] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T17:32:27.956699] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-10T17:32:28.289368] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-10T17:32:29.089378] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-10T17:32:29.540382] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T17:32:29.796847] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-10T17:32:29.889390] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-10T17:32:30.689412] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-10T17:32:31.031452] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T17:32:31.426369] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-10T17:32:31.489336] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-10T17:32:31.510108] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-10T17:32:32.289456] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-10T17:32:33.089366] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-10T17:32:33.224932] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T17:32:33.695281] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-10T17:32:33.889367] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-10T17:32:34.659352] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-10T17:32:34.689333] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-10T17:32:34.727550] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-10T17:32:35.489438] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-10T17:32:36.289397] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-10T17:32:36.815821] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-10T17:32:36.843629] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-10T17:32:37.089349] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-10T17:32:37.568860] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T17:32:37.889365] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-10T17:32:38.699347] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-10T17:32:38.704213] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-10T17:32:39.217012] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T17:32:39.489418] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-10T17:32:40.289418] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-10T17:32:40.724691] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T17:32:41.089371] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-10T17:32:41.570325] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-10T17:32:41.775312] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-10T17:32:41.889375] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-10T17:32:42.466837] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T17:32:42.469430] [INFO ] [REMOTE ] BDC: Full fetch complete (35780 records). [2025-10-10T17:32:42.469525] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-10T17:32:42.694538] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-10T17:32:42.839136] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-10T17:32:42.839239] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-10T17:32:42.839754] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-10T17:32:42.839816] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-10T17:32:42.840582] [DEBUG] [LOCAL ] BDC: Trimmed 35780 records to 24890 (keeping 200 days of data) [2025-10-10T17:32:42.998100] [DEBUG] [LOCAL ] BDC: Primary data saved (24890 records). [2025-10-10T17:32:42.998258] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-10T17:32:42.998348] [INFO ] [MAIN ] Update Progress: 241/2373 symbols completed. BDC took 26.0s. Estimated remaining: 4h 48m 50s. Rate: 7.4 symbols/min [2025-10-10T17:32:43.161939] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:32:43.217004] [DEBUG] [LOCAL ] BE: Loaded 54049 existing records from primary storage. [2025-10-10T17:32:43.217466] [INFO ] [MAIN ] BE: Loaded 54049 existing records. [2025-10-10T17:32:43.396859] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:32:43.397191] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-10T17:32:43.397246] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-10T17:32:43.397549] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-10T17:32:43.397590] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-10T17:32:43.493287] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-10T17:32:43.768567] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:32:43.867620] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T17:32:44.266198] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T17:32:44.289341] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-10T17:32:44.581145] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-10T17:32:45.089427] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-10T17:32:45.889384] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-10T17:32:46.482540] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-10T17:32:46.689376] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-10T17:32:46.998160] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-10T17:32:47.489446] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-10T17:32:48.281735] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-10T17:32:48.293716] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-10T17:32:48.645286] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T17:32:49.089402] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-10T17:32:49.352939] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T17:32:49.669563] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T17:32:49.672846] [INFO ] [REMOTE ] BDJ: Full fetch complete (42973 records). [2025-10-10T17:32:49.672933] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-10T17:32:49.897458] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-10T17:32:50.078353] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-10T17:32:50.078431] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-10T17:32:50.078951] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-10T17:32:50.079011] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-10T17:32:50.079885] [DEBUG] [LOCAL ] BDJ: Trimmed 42973 records to 29717 (keeping 200 days of data) [2025-10-10T17:32:50.253011] [DEBUG] [LOCAL ] BDJ: Primary data saved (29717 records). [2025-10-10T17:32:50.253168] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-10T17:32:50.253253] [INFO ] [MAIN ] Update Progress: 242/2373 symbols completed. BDJ took 33.3s. Estimated remaining: 4h 48m 34s. Rate: 7.4 symbols/min [2025-10-10T17:32:50.418267] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:32:50.418462] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-10T17:32:50.418498] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-10T17:32:50.418623] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-10T17:32:50.418695] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-10T17:32:50.418750] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-10T17:32:50.418789] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-10T17:32:50.694722] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-10T17:32:50.783416] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:32:50.790344] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-10T17:32:50.794913] [INFO ] [REMOTE ] BDX: Full fetch complete (75512 records). [2025-10-10T17:32:50.795008] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-10T17:32:51.180462] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-10T17:32:51.180544] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-10T17:32:51.181333] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-10T17:32:51.181395] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-10T17:32:51.183035] [DEBUG] [LOCAL ] BDX: Trimmed 75512 records to 52941 (keeping 200 days of data) [2025-10-10T17:32:51.489814] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-10T17:32:51.515996] [DEBUG] [LOCAL ] BDX: Primary data saved (52941 records). [2025-10-10T17:32:51.516144] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-10T17:32:51.516236] [INFO ] [MAIN ] Update Progress: 243/2373 symbols completed. BDX took 34.5s. Estimated remaining: 4h 47m 26s. Rate: 7.4 symbols/min [2025-10-10T17:32:51.691389] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:32:51.740455] [DEBUG] [LOCAL ] BEKE: Loaded 53617 existing records from primary storage. [2025-10-10T17:32:51.740808] [INFO ] [MAIN ] BEKE: Loaded 53617 existing records. [2025-10-10T17:32:51.920323] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:32:51.930859] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-10T17:32:51.931408] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-10T17:32:51.931862] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-10T17:32:51.936762] [INFO ] [REMOTE ] BDN: Full fetch complete (69188 records). [2025-10-10T17:32:51.936863] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-10T17:32:51.937200] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-10T17:32:51.962914] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-10T17:32:52.066353] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-10T17:32:52.307254] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-10T17:32:52.687963] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-10T17:32:52.694936] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-10T17:32:52.723827] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:32:52.714868] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-10T17:32:52.724445] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-10T17:32:52.726716] [DEBUG] [LOCAL ] BDN: Trimmed 69188 records to 48258 (keeping 200 days of data) [2025-10-10T17:32:52.846356] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-10T17:32:52.862167] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-10T17:32:53.062239] [DEBUG] [LOCAL ] BDN: Primary data saved (48258 records). [2025-10-10T17:32:53.062414] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-10T17:32:53.062511] [INFO ] [MAIN ] Update Progress: 244/2373 symbols completed. BDN took 36.1s. Estimated remaining: 4h 46m 21s. Rate: 7.4 symbols/min [2025-10-10T17:32:53.096499] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-10T17:32:53.248557] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:32:53.300275] [DEBUG] [LOCAL ] BEN: Loaded 53434 existing records from primary storage. [2025-10-10T17:32:53.300632] [INFO ] [MAIN ] BEN: Loaded 53434 existing records. [2025-10-10T17:32:53.473195] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:32:53.473499] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-10T17:32:53.473549] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-10T17:32:53.474032] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-10T17:32:53.474089] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-10T17:32:53.822246] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:32:53.889396] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-10T17:32:54.689428] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-10T17:32:54.731635] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T17:32:55.098601] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-10T17:32:55.489393] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-10T17:32:55.785535] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-10T17:32:55.917912] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-10T17:32:56.289399] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-10T17:32:57.089390] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-10T17:32:57.889426] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-10T17:32:58.615113] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-10T17:32:58.689341] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-10T17:32:59.284494] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-10T17:32:59.489356] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-10T17:32:59.822918] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T17:33:00.289411] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-10T17:33:00.340559] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T17:33:01.089496] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-10T17:33:01.510808] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T17:33:01.633723] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T17:33:01.889404] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-10T17:33:02.689392] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-10T17:33:03.286106] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-10T17:33:03.303269] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-10T17:33:03.489394] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-10T17:33:03.752051] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T17:33:03.907421] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-10T17:33:04.289478] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-10T17:33:05.089378] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-10T17:33:05.424479] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-10T17:33:05.889432] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-10T17:33:06.177259] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-10T17:33:06.377847] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T17:33:06.689382] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-10T17:33:07.489377] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-10T17:33:08.289357] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-10T17:33:08.872605] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-10T17:33:08.901920] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-10T17:33:09.089370] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-10T17:33:09.324556] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T17:33:09.889380] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-10T17:33:10.689365] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-10T17:33:10.861235] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T17:33:10.994122] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-10T17:33:11.489373] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-10T17:33:12.266741] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-10T17:33:12.289342] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-10T17:33:13.051097] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T17:33:13.089368] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-10T17:33:13.889396] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-10T17:33:14.689426] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-10T17:33:14.840466] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-10T17:33:15.137138] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T17:33:15.195281] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-10T17:33:15.196274] [INFO ] [REMOTE ] BEDU: Full fetch complete (1447 records). [2025-10-10T17:33:15.196348] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-10T17:33:15.376472] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-10T17:33:15.376746] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:33:15.376822] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:33:15.376873] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-10T17:33:15.376939] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-10T17:33:15.376977] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-10T17:33:15.377018] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-10T17:33:15.377085] [INFO ] [MAIN ] Update Progress: 245/2373 symbols completed. BEDU took 25.1s. Estimated remaining: 4h 48m 16s. Rate: 7.4 symbols/min [2025-10-10T17:33:15.494580] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-10T17:33:15.567366] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:33:15.609889] [DEBUG] [LOCAL ] BEP: Loaded 39259 existing records from primary storage. [2025-10-10T17:33:15.610268] [INFO ] [MAIN ] BEP: Loaded 39259 existing records. [2025-10-10T17:33:15.805338] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:33:15.805628] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-10T17:33:15.805713] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-10T17:33:15.806353] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-10T17:33:15.806591] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-10T17:33:16.212310] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:33:16.289425] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-10T17:33:16.896344] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-10T17:33:17.089367] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-10T17:33:17.557032] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-10T17:33:17.889392] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-10T17:33:18.689419] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-10T17:33:18.805488] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-10T17:33:18.819094] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T17:33:19.489396] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-10T17:33:19.528855] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T17:33:20.289359] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-10T17:33:20.625188] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T17:33:21.089394] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-10T17:33:21.889434] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-10T17:33:22.182305] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T17:33:22.456493] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.97 seconds). [2025-10-10T17:33:22.462102] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-10-10T17:33:22.462270] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-10T17:33:22.701830] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-10T17:33:22.969785] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-10T17:33:22.970063] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-10T17:33:22.971546] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-10T17:33:22.971663] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-10T17:33:22.974921] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-10T17:33:22.988395] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 54439 (keeping 200 days of data) [2025-10-10T17:33:23.325739] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T17:33:23.382071] [DEBUG] [LOCAL ] BE: Primary data saved (54439 records). [2025-10-10T17:33:23.382286] [INFO ] [MAIN ] BE: Full history saved. [2025-10-10T17:33:23.382418] [INFO ] [MAIN ] Update Progress: 246/2373 symbols completed. BE took 40.4s. Estimated remaining: 4h 48m 7s. Rate: 7.4 symbols/min [2025-10-10T17:33:23.494567] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-10T17:33:23.586518] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:33:23.632822] [DEBUG] [LOCAL ] BEPC: Loaded 46858 existing records from primary storage. [2025-10-10T17:33:23.633246] [INFO ] [MAIN ] BEPC: Loaded 46858 existing records. [2025-10-10T17:33:23.822062] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:33:23.822349] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-10T17:33:23.822400] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-10T17:33:23.822715] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-10T17:33:23.822773] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-10T17:33:24.209122] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:33:24.261964] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-10T17:33:24.289336] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-10T17:33:25.089445] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-10T17:33:25.271110] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T17:33:25.708551] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-10T17:33:25.714057] [INFO ] [REMOTE ] BEN: Full fetch complete (76911 records). [2025-10-10T17:33:25.714226] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-10T17:33:25.901452] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-10T17:33:26.133342] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-10T17:33:26.133440] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-10T17:33:26.134315] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-10T17:33:26.134384] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-10T17:33:26.136842] [DEBUG] [LOCAL ] BEN: Trimmed 76911 records to 53824 (keeping 200 days of data) [2025-10-10T17:33:26.485108] [DEBUG] [LOCAL ] BEN: Primary data saved (53824 records). [2025-10-10T17:33:26.485332] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-10T17:33:26.486340] [INFO ] [MAIN ] Update Progress: 247/2373 symbols completed. BEN took 33.4s. Estimated remaining: 4h 47m 16s. Rate: 7.4 symbols/min [2025-10-10T17:33:26.670556] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:33:26.681107] [DEBUG] [LOCAL ] BEPH: Loaded 5383 existing records from primary storage. [2025-10-10T17:33:26.681458] [INFO ] [MAIN ] BEPH: Loaded 5383 existing records. [2025-10-10T17:33:26.703888] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-10T17:33:26.884451] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:33:26.884925] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-10T17:33:26.885077] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-10T17:33:26.885562] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-10T17:33:26.885629] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-10T17:33:27.122549] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T17:33:27.344227] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:33:27.372753] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-10T17:33:27.489396] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-10T17:33:27.980801] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-10T17:33:28.289410] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-10T17:33:28.691013] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-10T17:33:29.089392] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-10T17:33:29.889412] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-10T17:33:30.308956] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-10T17:33:30.455553] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-10T17:33:30.689370] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-10T17:33:30.904449] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-10T17:33:31.489442] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-10T17:33:32.289424] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-10T17:33:32.569408] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-10T17:33:32.575484] [INFO ] [REMOTE ] BEKE: Full fetch complete (77190 records). [2025-10-10T17:33:32.575738] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-10T17:33:33.055840] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-10T17:33:33.056214] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-10T17:33:33.057504] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-10T17:33:33.057601] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-10T17:33:33.059725] [DEBUG] [LOCAL ] BEKE: Trimmed 77190 records to 54007 (keeping 200 days of data) [2025-10-10T17:33:33.112922] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-10T17:33:33.349179] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T17:33:33.449795] [DEBUG] [LOCAL ] BEKE: Primary data saved (54007 records). [2025-10-10T17:33:33.450049] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-10T17:33:33.450193] [INFO ] [MAIN ] Update Progress: 248/2373 symbols completed. BEKE took 41.9s. Estimated remaining: 4h 46m 58s. Rate: 7.4 symbols/min [2025-10-10T17:33:33.585036] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-10T17:33:33.651142] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:33:33.658601] [DEBUG] [LOCAL ] BEPI: Loaded 3623 existing records from primary storage. [2025-10-10T17:33:33.658860] [INFO ] [MAIN ] BEPI: Loaded 3623 existing records. [2025-10-10T17:33:33.844816] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:33:33.845339] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-10T17:33:33.845495] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-10T17:33:33.845744] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-10T17:33:33.845801] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-10T17:33:33.900441] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-10T17:33:34.218807] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:33:34.245482] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-10T17:33:34.689419] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-10T17:33:34.718305] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-10T17:33:35.240695] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-10T17:33:35.489391] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-10T17:33:36.131244] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-10T17:33:36.289411] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-10T17:33:37.089387] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-10T17:33:37.889456] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-10T17:33:38.048107] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T17:33:38.109569] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-10T17:33:38.689393] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-10T17:33:38.994206] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-10T17:33:39.327202] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-10T17:33:39.489380] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-10T17:33:40.234903] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-10T17:33:40.289348] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-10T17:33:40.844796] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-10T17:33:41.089388] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-10T17:33:41.767859] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-10T17:33:41.889421] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-10T17:33:42.579010] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-10T17:33:42.689414] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-10T17:33:43.217492] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-10T17:33:43.489401] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-10T17:33:43.899841] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-10T17:33:44.289391] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-10T17:33:44.757235] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-10T17:33:45.089401] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-10T17:33:45.889419] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-10T17:33:46.689427] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-10T17:33:46.897935] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-10T17:33:47.375758] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-10T17:33:47.489447] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-10T17:33:47.758401] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T17:33:48.071591] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-10T17:33:48.072880] [INFO ] [REMOTE ] BEPH: Full fetch complete (7641 records). [2025-10-10T17:33:48.072961] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-10T17:33:48.294565] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-10T17:33:48.472758] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-10T17:33:48.472861] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-10T17:33:48.473195] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-10T17:33:48.473240] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-10T17:33:48.473708] [DEBUG] [LOCAL ] BEPH: Trimmed 7641 records to 5407 (keeping 200 days of data) [2025-10-10T17:33:48.509857] [DEBUG] [LOCAL ] BEPH: Primary data saved (5407 records). [2025-10-10T17:33:48.510029] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-10T17:33:48.510160] [INFO ] [MAIN ] Update Progress: 249/2373 symbols completed. BEPH took 22.0s. Estimated remaining: 4h 47m 49s. Rate: 7.4 symbols/min [2025-10-10T17:33:48.688622] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:33:48.688885] [DEBUG] [LOCAL ] BEPJ: No existing data file found in primary storage. [2025-10-10T17:33:48.688942] [WARN ] [MAIN ] BEPJ: No existing data found, performing full refresh instead. [2025-10-10T17:33:48.689075] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-10T17:33:48.689120] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-10T17:33:48.689165] [DEBUG] [LOCAL ] BEPJ: No primary data file found to delete. [2025-10-10T17:33:48.689200] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-10T17:33:49.096564] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-10T17:33:49.109464] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:33:49.889419] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-10T17:33:50.352416] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-10T17:33:50.638349] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-10T17:33:50.689364] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-10T17:33:50.803617] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-10T17:33:51.092627] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-10T17:33:51.489404] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-10T17:33:51.891355] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-10T17:33:52.289394] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-10T17:33:52.695257] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-10T17:33:53.089401] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-10T17:33:53.498973] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-10T17:33:53.500032] [INFO ] [REMOTE ] BEPI: Full fetch complete (4828 records). [2025-10-10T17:33:53.500107] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-10T17:33:53.894590] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-10T17:33:53.937812] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-10T17:33:53.937945] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-10T17:33:53.938217] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-10T17:33:53.938304] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-10T17:33:53.938752] [DEBUG] [LOCAL ] BEPI: Trimmed 4828 records to 3641 (keeping 200 days of data) [2025-10-10T17:33:53.962166] [DEBUG] [LOCAL ] BEPI: Primary data saved (3641 records). [2025-10-10T17:33:53.962295] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-10T17:33:53.962392] [INFO ] [MAIN ] Update Progress: 250/2373 symbols completed. BEPI took 20.5s. Estimated remaining: 4h 47m 18s. Rate: 7.4 symbols/min [2025-10-10T17:33:54.134594] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:33:54.168894] [DEBUG] [LOCAL ] BFAM: Loaded 33733 existing records from primary storage. [2025-10-10T17:33:54.169275] [INFO ] [MAIN ] BFAM: Loaded 33733 existing records. [2025-10-10T17:33:54.339291] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:33:54.339467] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-10T17:33:54.339513] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-10T17:33:54.339917] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-10T17:33:54.339976] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-10T17:33:54.680627] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:33:54.689330] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-10T17:33:55.301001] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T17:33:55.489420] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-10T17:33:56.273632] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-10T17:33:56.289325] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-10T17:33:57.020331] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-10T17:33:57.089389] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-10T17:33:57.336284] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-10T17:33:57.889393] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-10T17:33:58.689404] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-10T17:33:58.915773] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T17:33:59.489376] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-10T17:33:59.537787] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-10T17:33:59.546635] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-10T17:33:59.548128] [INFO ] [REMOTE ] BEP: Full fetch complete (58741 records). [2025-10-10T17:33:59.548213] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-10T17:33:59.955063] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-10T17:33:59.955172] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-10T17:33:59.956229] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-10T17:33:59.956298] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-10T17:33:59.958168] [DEBUG] [LOCAL ] BEP: Trimmed 58741 records to 39584 (keeping 200 days of data) [2025-10-10T17:34:00.211895] [DEBUG] [LOCAL ] BEP: Primary data saved (39584 records). [2025-10-10T17:34:00.212086] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-10T17:34:00.212565] [INFO ] [MAIN ] Update Progress: 251/2373 symbols completed. BEP took 44.8s. Estimated remaining: 4h 46m 54s. Rate: 7.4 symbols/min [2025-10-10T17:34:00.294478] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-10T17:34:00.392233] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:34:00.438611] [DEBUG] [LOCAL ] BFH: Loaded 41731 existing records from primary storage. [2025-10-10T17:34:00.439054] [INFO ] [MAIN ] BFH: Loaded 41731 existing records. [2025-10-10T17:34:00.642787] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:34:00.643156] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-10T17:34:00.643233] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-10T17:34:00.643569] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-10T17:34:00.643634] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-10T17:34:00.826846] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T17:34:01.056141] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:34:01.089372] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-10T17:34:01.889368] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-10T17:34:02.406073] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T17:34:02.554851] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-10T17:34:02.689392] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-10T17:34:03.489359] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-10T17:34:03.724636] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T17:34:04.289389] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-10T17:34:04.503033] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-10T17:34:04.572934] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-10T17:34:05.089388] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-10T17:34:05.889401] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-10T17:34:06.040671] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T17:34:06.594594] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-10T17:34:06.689434] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-10T17:34:06.910078] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T17:34:07.100318] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-10T17:34:07.489380] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-10T17:34:08.289451] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-10T17:34:09.089422] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-10T17:34:09.398599] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T17:34:09.451909] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-10T17:34:09.457446] [INFO ] [REMOTE ] BEPC: Full fetch complete (68681 records). [2025-10-10T17:34:09.457681] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-10T17:34:09.766999] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-10T17:34:09.857348] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-10T17:34:09.857444] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-10T17:34:09.858206] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-10T17:34:09.858272] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-10T17:34:09.859812] [DEBUG] [LOCAL ] BEPC: Trimmed 68681 records to 47216 (keeping 200 days of data) [2025-10-10T17:34:09.912982] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-10T17:34:10.143029] [DEBUG] [LOCAL ] BEPC: Primary data saved (47216 records). [2025-10-10T17:34:10.143169] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-10T17:34:10.143249] [INFO ] [MAIN ] Update Progress: 252/2373 symbols completed. BEPC took 46.8s. Estimated remaining: 4h 47m 1s. Rate: 7.4 symbols/min [2025-10-10T17:34:10.307034] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:34:10.321290] [DEBUG] [LOCAL ] BFK: Loaded 13777 existing records from primary storage. [2025-10-10T17:34:10.321503] [INFO ] [MAIN ] BFK: Loaded 13777 existing records. [2025-10-10T17:34:10.513887] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:34:10.514191] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-10T17:34:10.514245] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-10T17:34:10.514452] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-10T17:34:10.514511] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-10T17:34:10.697679] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-10T17:34:10.875407] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:34:11.489388] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-10T17:34:11.867430] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T17:34:11.926942] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-10T17:34:12.037405] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-10T17:34:12.289419] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-10T17:34:13.089398] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-10T17:34:13.889405] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-10T17:34:14.293964] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-10T17:34:14.334215] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T17:34:14.383504] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T17:34:14.689447] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-10T17:34:15.489430] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-10T17:34:16.289400] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-10T17:34:16.472741] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-10T17:34:16.503063] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-10T17:34:17.089432] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-10T17:34:17.593838] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-10T17:34:17.675742] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-10T17:34:17.889359] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-10T17:34:18.660452] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-10T17:34:18.689338] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-10T17:34:19.489378] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-10T17:34:19.710957] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-10T17:34:20.220522] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-10T17:34:20.289401] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-10T17:34:20.815332] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-10T17:34:21.089405] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-10T17:34:21.889368] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-10T17:34:21.987299] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T17:34:22.689448] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-10T17:34:23.489431] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-10T17:34:23.615805] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T17:34:23.812446] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-10T17:34:24.289401] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-10T17:34:25.089404] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-10T17:34:25.166502] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-10T17:34:25.889385] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-10T17:34:26.015339] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T17:34:26.082989] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T17:34:26.689400] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-10T17:34:27.411105] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T17:34:27.489442] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-10T17:34:27.652462] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T17:34:28.289396] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-10T17:34:29.061523] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-10T17:34:29.089374] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-10T17:34:29.240974] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-10T17:34:29.889464] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-10T17:34:30.689430] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-10T17:34:30.777415] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T17:34:30.975528] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T17:34:30.981552] [INFO ] [REMOTE ] BFAM: Full fetch complete (46968 records). [2025-10-10T17:34:30.981813] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-10T17:34:31.313708] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T17:34:31.320821] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4474 records). [2025-10-10T17:34:31.331310] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-10T17:34:31.518384] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-10T17:34:31.489722] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-10T17:34:31.518577] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-10T17:34:31.537931] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-10T17:34:31.542153] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-10T17:34:31.614028] [DEBUG] [LOCAL ] BFAM: Trimmed 46968 records to 33979 (keeping 200 days of data) [2025-10-10T17:34:31.940688] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-10T17:34:31.940827] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-10T17:34:31.941031] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-10T17:34:31.941119] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-10T17:34:31.942027] [DEBUG] [LOCAL ] BEPJ: Trimmed 4474 records to 3156 (keeping 200 days of data) [2025-10-10T17:34:31.964208] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3156 records). [2025-10-10T17:34:31.964953] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-10T17:34:31.965057] [INFO ] [MAIN ] Update Progress: 253/2373 symbols completed. BEPJ took 43.5s. Estimated remaining: 4h 48m 48s. Rate: 7.3 symbols/min [2025-10-10T17:34:32.148487] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:34:32.149765] [DEBUG] [LOCAL ] BFLY: No existing data file found in primary storage. [2025-10-10T17:34:32.150431] [WARN ] [MAIN ] BFLY: No existing data found, performing full refresh instead. [2025-10-10T17:34:32.150596] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-10T17:34:32.151609] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-10T17:34:32.153938] [DEBUG] [LOCAL ] BFLY: No primary data file found to delete. [2025-10-10T17:34:32.154861] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-10T17:34:32.302615] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-10T17:34:32.552114] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:34:32.631321] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-10T17:34:32.663801] [DEBUG] [LOCAL ] BFAM: Primary data saved (33979 records). [2025-10-10T17:34:32.664003] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-10T17:34:32.664146] [INFO ] [MAIN ] Update Progress: 254/2373 symbols completed. BFAM took 38.7s. Estimated remaining: 4h 47m 38s. Rate: 7.4 symbols/min [2025-10-10T17:34:32.850381] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:34:32.850823] [DEBUG] [LOCAL ] BFS: No existing data file found in primary storage. [2025-10-10T17:34:32.850875] [WARN ] [MAIN ] BFS: No existing data found, performing full refresh instead. [2025-10-10T17:34:32.850998] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-10T17:34:32.851089] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-10T17:34:32.851207] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-10T17:34:32.851251] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-10T17:34:33.097544] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-10T17:34:33.232756] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:34:33.889365] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-10T17:34:34.063146] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-10T17:34:34.067599] [INFO ] [REMOTE ] BFH: Full fetch complete (59655 records). [2025-10-10T17:34:34.067753] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-10T17:34:34.188671] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-10T17:34:34.502571] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-10T17:34:34.502840] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-10T17:34:34.504151] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-10T17:34:34.504222] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-10T17:34:34.505920] [DEBUG] [LOCAL ] BFH: Trimmed 59655 records to 42048 (keeping 200 days of data) [2025-10-10T17:34:34.604906] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-10T17:34:34.696524] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-10T17:34:34.786089] [DEBUG] [LOCAL ] BFH: Primary data saved (42048 records). [2025-10-10T17:34:34.786263] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-10T17:34:34.786869] [INFO ] [MAIN ] Update Progress: 255/2373 symbols completed. BFH took 34.6s. Estimated remaining: 4h 46m 39s. Rate: 7.4 symbols/min [2025-10-10T17:34:34.961886] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:34:34.979360] [DEBUG] [LOCAL ] BFZ: Loaded 11992 existing records from primary storage. [2025-10-10T17:34:34.979683] [INFO ] [MAIN ] BFZ: Loaded 11992 existing records. [2025-10-10T17:34:35.158770] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:34:35.159059] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-10T17:34:35.159111] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-10T17:34:35.159348] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-10T17:34:35.159406] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-10T17:34:35.500166] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-10T17:34:35.523089] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:34:35.637974] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-10T17:34:36.289392] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-10T17:34:36.394908] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-10T17:34:37.089438] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-10T17:34:37.889380] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-10T17:34:38.329439] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T17:34:38.456158] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T17:34:38.689442] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-10T17:34:38.749774] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-10T17:34:39.489424] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-10T17:34:39.628154] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T17:34:39.630089] [INFO ] [REMOTE ] BFK: Full fetch complete (18954 records). [2025-10-10T17:34:39.630199] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-10T17:34:39.997850] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-10T17:34:39.997960] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-10T17:34:39.998386] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-10T17:34:39.998428] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-10T17:34:39.999002] [DEBUG] [LOCAL ] BFK: Trimmed 18954 records to 13833 (keeping 200 days of data) [2025-10-10T17:34:40.082338] [DEBUG] [LOCAL ] BFK: Primary data saved (13833 records). [2025-10-10T17:34:40.082475] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-10T17:34:40.082558] [INFO ] [MAIN ] Update Progress: 256/2373 symbols completed. BFK took 29.9s. Estimated remaining: 4h 46m 8s. Rate: 7.4 symbols/min [2025-10-10T17:34:40.251987] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:34:40.267808] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-10T17:34:40.289395] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-10T17:34:40.308841] [DEBUG] [LOCAL ] BG: Loaded 50781 existing records from primary storage. [2025-10-10T17:34:40.309180] [INFO ] [MAIN ] BG: Loaded 50781 existing records. [2025-10-10T17:34:40.507041] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:34:40.507332] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-10T17:34:40.507393] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-10T17:34:40.507843] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-10T17:34:40.507902] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-10T17:34:40.880772] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:34:41.089425] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-10T17:34:41.253635] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-10T17:34:41.889394] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-10T17:34:42.001568] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-10T17:34:42.689393] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-10T17:34:42.825428] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T17:34:43.489459] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-10T17:34:44.289378] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-10T17:34:44.349259] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-10T17:34:44.695523] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T17:34:44.946842] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-10T17:34:45.089407] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-10T17:34:45.889361] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-10T17:34:46.083568] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-10T17:34:46.689406] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-10T17:34:47.489421] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-10T17:34:47.942376] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T17:34:48.295140] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-10T17:34:48.309428] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-10T17:34:49.089378] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-10T17:34:49.331019] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-10T17:34:49.889443] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-10T17:34:49.998853] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-10T17:34:50.689384] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-10T17:34:50.901442] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-10T17:34:51.464950] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-10T17:34:51.489360] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-10T17:34:52.289359] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-10T17:34:52.415807] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-10T17:34:52.608590] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T17:34:53.089402] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-10T17:34:53.303300] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-10T17:34:53.886910] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-10T17:34:53.888601] [INFO ] [REMOTE ] BFS: Full fetch complete (12838 records). [2025-10-10T17:34:53.888727] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-10T17:34:53.894583] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-10T17:34:54.269454] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-10T17:34:54.269546] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-10T17:34:54.269962] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-10T17:34:54.270027] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-10T17:34:54.270591] [DEBUG] [LOCAL ] BFS: Trimmed 12838 records to 9495 (keeping 200 days of data) [2025-10-10T17:34:54.338735] [DEBUG] [LOCAL ] BFS: Primary data saved (9495 records). [2025-10-10T17:34:54.338907] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-10T17:34:54.338993] [INFO ] [MAIN ] Update Progress: 257/2373 symbols completed. BFS took 21.7s. Estimated remaining: 4h 46m 50s. Rate: 7.4 symbols/min [2025-10-10T17:34:54.505135] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:34:54.525141] [DEBUG] [LOCAL ] BGB: Loaded 18011 existing records from primary storage. [2025-10-10T17:34:54.525383] [INFO ] [MAIN ] BGB: Loaded 18011 existing records. [2025-10-10T17:34:54.693852] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-10T17:34:54.697620] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:34:54.698321] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-10T17:34:54.699290] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-10T17:34:54.699518] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-10T17:34:54.699576] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-10T17:34:55.054715] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:34:55.065945] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-10T17:34:55.489405] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-10T17:34:56.289364] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-10T17:34:56.425979] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-10T17:34:56.813810] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-10T17:34:57.089396] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-10T17:34:57.889420] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-10T17:34:58.373197] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T17:34:58.410907] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-10T17:34:58.689365] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-10T17:34:59.218107] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T17:34:59.489397] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-10T17:35:00.289419] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-10T17:35:00.715231] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-10T17:35:00.800461] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T17:35:01.089463] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-10T17:35:01.889425] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-10T17:35:02.304491] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T17:35:02.689420] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-10T17:35:03.150253] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T17:35:03.194068] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-10T17:35:03.489372] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-10T17:35:04.289404] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-10T17:35:04.328128] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T17:35:04.673498] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-10T17:35:04.675144] [INFO ] [REMOTE ] BFZ: Full fetch complete (17523 records). [2025-10-10T17:35:04.675230] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-10T17:35:05.091686] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-10T17:35:05.119253] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-10T17:35:05.119375] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-10T17:35:05.119817] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-10T17:35:05.119881] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-10T17:35:05.120687] [DEBUG] [LOCAL ] BFZ: Trimmed 17523 records to 12034 (keeping 200 days of data) [2025-10-10T17:35:05.196852] [DEBUG] [LOCAL ] BFZ: Primary data saved (12034 records). [2025-10-10T17:35:05.197023] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-10T17:35:05.197159] [INFO ] [MAIN ] Update Progress: 258/2373 symbols completed. BFZ took 30.4s. Estimated remaining: 4h 47m 5s. Rate: 7.4 symbols/min [2025-10-10T17:35:05.366972] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:35:05.385584] [DEBUG] [LOCAL ] BGH: Loaded 17324 existing records from primary storage. [2025-10-10T17:35:05.385936] [INFO ] [MAIN ] BGH: Loaded 17324 existing records. [2025-10-10T17:35:05.581994] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:35:05.584885] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T17:35:05.583449] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-10T17:35:05.590668] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-10T17:35:05.590926] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-10T17:35:05.590988] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-10T17:35:05.898725] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-10T17:35:05.938837] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:35:06.690561] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-10T17:35:06.694615] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-10T17:35:07.022277] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-10T17:35:07.489373] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-10T17:35:08.289363] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-10T17:35:08.396111] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-10T17:35:08.903472] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-10T17:35:08.927254] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-10T17:35:09.089385] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-10T17:35:09.889386] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-10T17:35:10.689362] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-10T17:35:10.797991] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-10T17:35:11.352702] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-10T17:35:11.489373] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-10T17:35:12.157382] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-10T17:35:12.267956] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-10T17:35:12.289332] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-10T17:35:13.089378] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-10T17:35:13.814269] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T17:35:13.889378] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-10T17:35:14.689368] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-10T17:35:15.031073] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-10T17:35:15.136626] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-10T17:35:15.489374] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-10T17:35:15.962750] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-10T17:35:16.289368] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-10T17:35:17.089443] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-10T17:35:17.190833] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-10T17:35:17.889404] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-10T17:35:18.277111] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-10T17:35:18.432542] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T17:35:18.689409] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-10T17:35:18.980522] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T17:35:19.489410] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-10T17:35:20.133329] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T17:35:20.140054] [INFO ] [REMOTE ] BG: Full fetch complete (72715 records). [2025-10-10T17:35:20.140260] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-10T17:35:20.304253] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-10T17:35:20.591435] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-10T17:35:20.591737] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-10T17:35:20.592545] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-10T17:35:20.592588] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-10T17:35:20.594027] [DEBUG] [LOCAL ] BG: Trimmed 72715 records to 51146 (keeping 200 days of data) [2025-10-10T17:35:20.701048] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-10T17:35:20.941257] [DEBUG] [LOCAL ] BG: Primary data saved (51146 records). [2025-10-10T17:35:20.941458] [INFO ] [MAIN ] BG: Full history saved. [2025-10-10T17:35:20.941582] [INFO ] [MAIN ] Update Progress: 259/2373 symbols completed. BG took 40.9s. Estimated remaining: 4h 47m 59s. Rate: 7.3 symbols/min [2025-10-10T17:35:21.096925] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-10T17:35:21.131293] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:35:21.147868] [DEBUG] [LOCAL ] BGR: Loaded 13650 existing records from primary storage. [2025-10-10T17:35:21.148171] [INFO ] [MAIN ] BGR: Loaded 13650 existing records. [2025-10-10T17:35:21.326931] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:35:21.327209] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-10T17:35:21.327258] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-10T17:35:21.327502] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-10T17:35:21.327560] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-10T17:35:21.683497] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:35:21.889375] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-10T17:35:22.388259] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T17:35:22.689343] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-10T17:35:22.756172] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-10T17:35:22.761744] [INFO ] [REMOTE ] BFLY: Full fetch complete (75319 records). [2025-10-10T17:35:22.761877] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-10T17:35:23.152242] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-10T17:35:23.152326] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-10T17:35:23.153102] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-10T17:35:23.153166] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-10T17:35:23.154613] [DEBUG] [LOCAL ] BFLY: Trimmed 75319 records to 52599 (keeping 200 days of data) [2025-10-10T17:35:23.277559] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T17:35:23.386277] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-10T17:35:23.483432] [DEBUG] [LOCAL ] BFLY: Primary data saved (52599 records). [2025-10-10T17:35:23.483592] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-10T17:35:23.483694] [INFO ] [MAIN ] Update Progress: 260/2373 symbols completed. BFLY took 51.5s. Estimated remaining: 4h 47m 5s. Rate: 7.4 symbols/min [2025-10-10T17:35:23.494683] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-10T17:35:23.651782] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:35:23.697791] [DEBUG] [LOCAL ] BGS: Loaded 50853 existing records from primary storage. [2025-10-10T17:35:23.698110] [INFO ] [MAIN ] BGS: Loaded 50853 existing records. [2025-10-10T17:35:23.870090] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:35:23.870307] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-10T17:35:23.870354] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-10T17:35:23.870788] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-10T17:35:23.870845] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-10T17:35:24.216640] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:35:24.289443] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-10T17:35:24.729719] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T17:35:25.089381] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-10T17:35:25.465280] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-10T17:35:25.889394] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-10T17:35:26.526922] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-10T17:35:26.689497] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-10T17:35:27.123591] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-10T17:35:27.489443] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-10T17:35:27.777773] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-10T17:35:28.289347] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-10T17:35:28.586379] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-10T17:35:29.089358] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-10T17:35:29.301356] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-10T17:35:29.889448] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-10T17:35:30.243427] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-10T17:35:30.689382] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-10T17:35:31.489397] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-10T17:35:31.655350] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T17:35:31.836739] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-10T17:35:31.839061] [INFO ] [REMOTE ] BGB: Full fetch complete (26991 records). [2025-10-10T17:35:31.839132] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-10T17:35:32.231310] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-10T17:35:32.231430] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-10T17:35:32.232074] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-10T17:35:32.232161] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-10T17:35:32.233132] [DEBUG] [LOCAL ] BGB: Trimmed 26991 records to 18164 (keeping 200 days of data) [2025-10-10T17:35:32.289617] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-10T17:35:32.353476] [DEBUG] [LOCAL ] BGB: Primary data saved (18164 records). [2025-10-10T17:35:32.366710] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-10T17:35:32.367488] [INFO ] [MAIN ] Update Progress: 261/2373 symbols completed. BGB took 38.0s. Estimated remaining: 4h 47m 2s. Rate: 7.4 symbols/min [2025-10-10T17:35:32.368297] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-10T17:35:32.544292] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:35:32.554381] [DEBUG] [LOCAL ] BGSF: Loaded 7799 existing records from primary storage. [2025-10-10T17:35:32.554673] [INFO ] [MAIN ] BGSF: Loaded 7799 existing records. [2025-10-10T17:35:32.728446] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:35:32.728759] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-10T17:35:32.728816] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-10T17:35:32.728960] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-10T17:35:32.728999] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-10T17:35:33.091184] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-10T17:35:33.091094] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:35:33.889368] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-10T17:35:34.220750] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T17:35:34.286403] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T17:35:34.667545] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-10T17:35:34.689424] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-10T17:35:35.489420] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-10T17:35:36.192461] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-10T17:35:36.289446] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-10T17:35:36.560096] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T17:35:36.823010] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-10T17:35:37.089454] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-10T17:35:37.889401] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-10T17:35:38.307446] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-10T17:35:38.689378] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-10T17:35:39.075191] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T17:35:39.489398] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-10T17:35:39.936433] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-10T17:35:39.939677] [INFO ] [REMOTE ] BGH: Full fetch complete (22819 records). [2025-10-10T17:35:39.939774] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-10T17:35:40.294478] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-10T17:35:40.365679] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-10T17:35:40.365816] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-10T17:35:40.366405] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-10T17:35:40.366499] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-10T17:35:40.367264] [DEBUG] [LOCAL ] BGH: Trimmed 22819 records to 17497 (keeping 200 days of data) [2025-10-10T17:35:40.480621] [DEBUG] [LOCAL ] BGH: Primary data saved (17497 records). [2025-10-10T17:35:40.480803] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-10T17:35:40.480919] [INFO ] [MAIN ] Update Progress: 262/2373 symbols completed. BGH took 35.3s. Estimated remaining: 4h 46m 54s. Rate: 7.4 symbols/min [2025-10-10T17:35:40.670018] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:35:40.690611] [DEBUG] [LOCAL ] BGT: Loaded 16689 existing records from primary storage. [2025-10-10T17:35:40.690931] [INFO ] [MAIN ] BGT: Loaded 16689 existing records. [2025-10-10T17:35:40.900279] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:35:40.901128] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-10T17:35:40.901373] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-10T17:35:40.902009] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-10T17:35:40.902085] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-10T17:35:40.986566] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-10T17:35:41.057183] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-10T17:35:41.091293] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-10T17:35:41.307666] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:35:41.769339] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-10T17:35:41.889361] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-10T17:35:42.689351] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-10T17:35:43.432245] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-10T17:35:43.489327] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-10T17:35:43.698456] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-10T17:35:44.289367] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-10T17:35:44.638106] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-10T17:35:45.089367] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-10T17:35:45.881002] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-10T17:35:45.889320] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-10T17:35:46.211773] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T17:35:46.673275] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-10T17:35:46.689325] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-10T17:35:47.489383] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-10T17:35:47.728128] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-10T17:35:48.289349] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-10T17:35:48.552122] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-10T17:35:49.089400] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-10T17:35:49.667814] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-10T17:35:49.889411] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-10T17:35:50.312637] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-10T17:35:50.689415] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-10T17:35:50.860503] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-10T17:35:51.489395] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-10T17:35:51.500457] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-10T17:35:52.264374] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-10T17:35:52.289337] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-10T17:35:53.089376] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-10T17:35:53.379164] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-10T17:35:53.889480] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-10T17:35:54.622692] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-10T17:35:54.689360] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-10T17:35:55.108095] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-10T17:35:55.154086] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-10T17:35:55.489412] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-10T17:35:56.289401] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-10T17:35:57.089405] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-10T17:35:57.295630] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-10T17:35:57.300723] [INFO ] [REMOTE ] BGS: Full fetch complete (72485 records). [2025-10-10T17:35:57.300860] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-10T17:35:57.385148] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-10T17:35:57.416977] [INFO ] [REMOTE ] BGR: Full fetch complete (20105 records). [2025-10-10T17:35:57.438712] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-10T17:35:57.903891] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-10T17:35:58.010024] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-10T17:35:58.016870] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-10T17:35:58.046202] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-10T17:35:58.057724] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-10T17:35:58.135278] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-10T17:35:58.135164] [DEBUG] [LOCAL ] BGS: Trimmed 72485 records to 51214 (keeping 200 days of data) [2025-10-10T17:35:58.135770] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-10T17:35:58.136766] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-10T17:35:58.137295] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-10T17:35:58.197322] [DEBUG] [LOCAL ] BGR: Trimmed 20105 records to 13729 (keeping 200 days of data) [2025-10-10T17:35:58.207729] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T17:35:58.539305] [DEBUG] [LOCAL ] BGR: Primary data saved (13729 records). [2025-10-10T17:35:58.545930] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-10T17:35:58.545770] [DEBUG] [LOCAL ] BGS: Primary data saved (51214 records). [2025-10-10T17:35:58.546340] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-10T17:35:58.546110] [INFO ] [MAIN ] Update Progress: 263/2373 symbols completed. BGR took 37.6s. Estimated remaining: 4h 48m 5s. Rate: 7.3 symbols/min [2025-10-10T17:35:58.546824] [INFO ] [MAIN ] Update Progress: 264/2373 symbols completed. BGS took 35.1s. Estimated remaining: 4h 46m 52s. Rate: 7.4 symbols/min [2025-10-10T17:35:58.704459] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-10T17:35:58.898723] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:35:58.935467] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:35:58.947877] [DEBUG] [LOCAL ] BGX: Loaded 11222 existing records from primary storage. [2025-10-10T17:35:58.948280] [INFO ] [MAIN ] BGX: Loaded 11222 existing records. [2025-10-10T17:35:59.081082] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-10T17:35:59.081766] [DEBUG] [LOCAL ] BGY: Loaded 22233 existing records from primary storage. [2025-10-10T17:35:59.103042] [INFO ] [MAIN ] BGY: Loaded 22233 existing records. [2025-10-10T17:35:59.278205] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:35:59.289774] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-10T17:35:59.295005] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-10T17:35:59.324719] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-10T17:35:59.333843] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-10T17:35:59.437170] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:35:59.454603] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-10T17:35:59.477857] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-10T17:35:59.478555] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-10T17:35:59.484134] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-10T17:35:59.489366] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-10T17:36:00.036575] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:36:00.160793] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:36:00.268044] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-10T17:36:00.270396] [INFO ] [REMOTE ] BGSF: Full fetch complete (9367 records). [2025-10-10T17:36:00.270495] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-10T17:36:00.301687] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-10T17:36:00.668249] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-10T17:36:00.668368] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-10T17:36:00.668735] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-10T17:36:00.668800] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-10T17:36:00.669375] [DEBUG] [LOCAL ] BGSF: Trimmed 9367 records to 7869 (keeping 200 days of data) [2025-10-10T17:36:00.726164] [DEBUG] [LOCAL ] BGSF: Primary data saved (7869 records). [2025-10-10T17:36:00.726386] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-10T17:36:00.726537] [INFO ] [MAIN ] Update Progress: 265/2373 symbols completed. BGSF took 28.4s. Estimated remaining: 4h 45m 56s. Rate: 7.4 symbols/min [2025-10-10T17:36:00.944325] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:36:00.959899] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-10T17:36:00.981154] [DEBUG] [LOCAL ] BH: Loaded 16265 existing records from primary storage. [2025-10-10T17:36:00.981467] [INFO ] [MAIN ] BH: Loaded 16265 existing records. [2025-10-10T17:36:01.089700] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-10T17:36:01.176231] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:36:01.176499] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-10T17:36:01.176551] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-10T17:36:01.176875] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-10T17:36:01.176937] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-10T17:36:01.613498] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:36:01.856203] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T17:36:01.889426] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-10T17:36:02.396768] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-10T17:36:02.689408] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-10T17:36:03.016233] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T17:36:03.489409] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-10T17:36:04.014018] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T17:36:04.289372] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-10T17:36:04.375998] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T17:36:05.089397] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-10T17:36:05.109544] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-10T17:36:05.889409] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-10T17:36:06.306607] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-10T17:36:06.507804] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-10T17:36:06.689407] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-10T17:36:07.354910] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-10T17:36:07.489425] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-10T17:36:08.003208] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-10T17:36:08.289372] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-10T17:36:09.089430] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-10T17:36:09.209592] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-10T17:36:09.703947] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-10T17:36:09.889357] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-10T17:36:10.689363] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-10T17:36:11.337630] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-10T17:36:11.489421] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-10T17:36:11.604396] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-10T17:36:12.289399] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-10T17:36:13.085099] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-10T17:36:13.090667] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-10T17:36:13.096944] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T17:36:13.099093] [INFO ] [REMOTE ] BGT: Full fetch complete (24203 records). [2025-10-10T17:36:13.099238] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-10T17:36:13.524287] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-10T17:36:13.524381] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-10T17:36:13.524882] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-10T17:36:13.524962] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-10T17:36:13.525834] [DEBUG] [LOCAL ] BGT: Trimmed 24203 records to 16808 (keeping 200 days of data) [2025-10-10T17:36:13.644602] [DEBUG] [LOCAL ] BGT: Primary data saved (16808 records). [2025-10-10T17:36:13.644840] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-10T17:36:13.644949] [INFO ] [MAIN ] Update Progress: 266/2373 symbols completed. BGT took 33.2s. Estimated remaining: 4h 46m 26s. Rate: 7.4 symbols/min [2025-10-10T17:36:13.824346] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:36:13.868662] [DEBUG] [LOCAL ] BHC: Loaded 47131 existing records from primary storage. [2025-10-10T17:36:13.869028] [INFO ] [MAIN ] BHC: Loaded 47131 existing records. [2025-10-10T17:36:13.898994] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-10T17:36:14.052363] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-10T17:36:14.056691] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:36:14.060481] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-10T17:36:14.060556] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-10T17:36:14.061136] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-10T17:36:14.061199] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-10T17:36:14.515091] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:36:14.689344] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-10T17:36:15.024845] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T17:36:15.489358] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-10T17:36:15.664381] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-10T17:36:16.289333] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-10T17:36:16.739818] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-10T17:36:17.089360] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-10T17:36:17.253393] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T17:36:17.889414] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-10T17:36:18.461369] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-10T17:36:18.689383] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-10T17:36:18.822675] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-10T17:36:19.489461] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-10T17:36:19.975929] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T17:36:20.170328] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-10T17:36:20.289379] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-10T17:36:21.089467] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-10T17:36:21.753991] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-10T17:36:21.791827] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-10T17:36:21.889410] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-10T17:36:22.677010] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-10T17:36:22.689407] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-10T17:36:23.489454] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-10T17:36:24.002910] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-10T17:36:24.289440] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-10T17:36:24.729620] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T17:36:24.747286] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-10T17:36:25.089374] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-10T17:36:25.889411] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-10T17:36:26.689376] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-10T17:36:26.726143] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-10T17:36:26.904839] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T17:36:27.302040] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-10T17:36:27.489408] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-10T17:36:28.289399] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-10T17:36:28.801275] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-10T17:36:28.805355] [INFO ] [REMOTE ] BGY: Full fetch complete (32954 records). [2025-10-10T17:36:28.805545] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-10T17:36:29.098571] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-10T17:36:29.188014] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-10T17:36:29.188097] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-10T17:36:29.188662] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-10T17:36:29.188725] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-10T17:36:29.189490] [DEBUG] [LOCAL ] BGY: Trimmed 32954 records to 22421 (keeping 200 days of data) [2025-10-10T17:36:29.317564] [DEBUG] [LOCAL ] BGY: Primary data saved (22421 records). [2025-10-10T17:36:29.317739] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-10T17:36:29.317833] [INFO ] [MAIN ] Update Progress: 267/2373 symbols completed. BGY took 30.7s. Estimated remaining: 4h 47m 17s. Rate: 7.3 symbols/min [2025-10-10T17:36:29.485314] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:36:29.508697] [DEBUG] [LOCAL ] BHE: Loaded 24178 existing records from primary storage. [2025-10-10T17:36:29.508972] [INFO ] [MAIN ] BHE: Loaded 24178 existing records. [2025-10-10T17:36:29.703686] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T17:36:29.707515] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:36:29.713980] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-10T17:36:29.714467] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-10T17:36:29.714853] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-10T17:36:29.714918] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-10T17:36:29.898742] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-10T17:36:30.098695] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:36:30.501308] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-10T17:36:30.689390] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-10T17:36:31.325340] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-10T17:36:31.361578] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T17:36:31.489397] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-10T17:36:32.289361] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-10T17:36:32.509123] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T17:36:32.511349] [INFO ] [REMOTE ] BGX: Full fetch complete (16528 records). [2025-10-10T17:36:32.511419] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-10T17:36:32.871114] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-10T17:36:32.871201] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-10T17:36:32.871531] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-10T17:36:32.871572] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-10T17:36:32.872081] [DEBUG] [LOCAL ] BGX: Trimmed 16528 records to 11399 (keeping 200 days of data) [2025-10-10T17:36:32.947778] [DEBUG] [LOCAL ] BGX: Primary data saved (11399 records). [2025-10-10T17:36:32.948036] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-10T17:36:32.948156] [INFO ] [MAIN ] Update Progress: 268/2373 symbols completed. BGX took 34.4s. Estimated remaining: 4h 46m 33s. Rate: 7.3 symbols/min [2025-10-10T17:36:33.095035] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-10T17:36:33.129361] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:36:33.156978] [DEBUG] [LOCAL ] BHK: Loaded 23537 existing records from primary storage. [2025-10-10T17:36:33.157332] [INFO ] [MAIN ] BHK: Loaded 23537 existing records. [2025-10-10T17:36:33.342255] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:36:33.342532] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-10T17:36:33.342593] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-10T17:36:33.342948] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-10T17:36:33.343008] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-10T17:36:33.650073] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T17:36:33.731296] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:36:33.790728] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-10T17:36:33.792546] [INFO ] [REMOTE ] BH: Full fetch complete (19590 records). [2025-10-10T17:36:33.792617] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-10T17:36:33.891518] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-10T17:36:34.165398] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-10T17:36:34.165486] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-10T17:36:34.165862] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-10T17:36:34.165945] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-10T17:36:34.166617] [DEBUG] [LOCAL ] BH: Trimmed 19590 records to 16341 (keeping 200 days of data) [2025-10-10T17:36:34.269032] [DEBUG] [LOCAL ] BH: Primary data saved (16341 records). [2025-10-10T17:36:34.269195] [INFO ] [MAIN ] BH: Full history saved. [2025-10-10T17:36:34.269283] [INFO ] [MAIN ] Update Progress: 269/2373 symbols completed. BH took 33.5s. Estimated remaining: 4h 45m 31s. Rate: 7.4 symbols/min [2025-10-10T17:36:34.440247] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:36:34.489801] [DEBUG] [LOCAL ] BHP: Loaded 53762 existing records from primary storage. [2025-10-10T17:36:34.490160] [INFO ] [MAIN ] BHP: Loaded 53762 existing records. [2025-10-10T17:36:34.666794] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:36:34.667044] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-10T17:36:34.667097] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-10T17:36:34.667631] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-10T17:36:34.667728] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-10T17:36:34.697864] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-10T17:36:35.037099] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:36:35.290693] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-10T17:36:35.489723] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-10T17:36:35.978375] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T17:36:36.289386] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-10T17:36:37.089384] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-10T17:36:37.461540] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T17:36:37.595490] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T17:36:37.889384] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-10T17:36:38.527697] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-10T17:36:38.542476] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-10T17:36:38.689416] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-10T17:36:39.415607] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-10T17:36:39.489348] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-10T17:36:40.289387] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-10T17:36:40.652561] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-10T17:36:41.089403] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-10T17:36:41.732374] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-10T17:36:41.889439] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-10T17:36:42.689367] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-10T17:36:42.821798] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T17:36:42.943539] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-10T17:36:43.489381] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-10T17:36:44.289348] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-10T17:36:44.903911] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-10T17:36:45.031582] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-10T17:36:45.089376] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-10T17:36:45.662620] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T17:36:45.889468] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-10T17:36:46.689409] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-10T17:36:46.876489] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T17:36:47.236550] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-10T17:36:47.489424] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-10T17:36:48.229854] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-10T17:36:48.289404] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-10T17:36:48.814838] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-10T17:36:49.089411] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-10T17:36:49.889410] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-10T17:36:50.308980] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T17:36:50.375487] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T17:36:50.689420] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-10T17:36:50.858222] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-10T17:36:51.489420] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-10T17:36:51.923365] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-10T17:36:52.289391] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-10T17:36:53.089369] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-10T17:36:53.108388] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T17:36:53.111006] [INFO ] [REMOTE ] BHE: Full fetch complete (36297 records). [2025-10-10T17:36:53.111102] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-10T17:36:53.516472] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-10T17:36:53.516809] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-10T17:36:53.517431] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-10T17:36:53.517622] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-10T17:36:53.518978] [DEBUG] [LOCAL ] BHE: Trimmed 36297 records to 24326 (keeping 200 days of data) [2025-10-10T17:36:53.687028] [DEBUG] [LOCAL ] BHE: Primary data saved (24326 records). [2025-10-10T17:36:53.687289] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-10T17:36:53.687414] [INFO ] [MAIN ] Update Progress: 270/2373 symbols completed. BHE took 24.4s. Estimated remaining: 4h 46m 51s. Rate: 7.3 symbols/min [2025-10-10T17:36:53.851409] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-10T17:36:53.922813] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:36:53.918621] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-10T17:36:53.948226] [DEBUG] [LOCAL ] BHR: Loaded 22080 existing records from primary storage. [2025-10-10T17:36:53.948572] [INFO ] [MAIN ] BHR: Loaded 22080 existing records. [2025-10-10T17:36:54.132371] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:36:54.132690] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-10T17:36:54.132751] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-10T17:36:54.133084] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-10T17:36:54.133144] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-10T17:36:54.511402] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:36:54.689349] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-10T17:36:55.046832] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T17:36:55.489431] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-10T17:36:55.608471] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-10T17:36:56.289435] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-10T17:36:56.751507] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T17:36:56.916310] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-10T17:36:57.089417] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-10T17:36:57.735588] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-10T17:36:57.889345] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-10T17:36:57.931377] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-10T17:36:58.689352] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-10T17:36:58.822968] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T17:36:59.489391] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-10T17:37:00.289418] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-10T17:37:00.780881] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-10T17:37:01.089399] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-10T17:37:01.115400] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T17:37:01.889438] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-10T17:37:02.123963] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-10T17:37:02.689473] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-10T17:37:03.289111] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-10T17:37:03.489380] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-10T17:37:03.543245] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-10T17:37:03.546029] [INFO ] [REMOTE ] BHK: Full fetch complete (30408 records). [2025-10-10T17:37:03.546119] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-10T17:37:03.546827] [FATAL] [VALIDATOR ] BHK: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:37:03.546915] [FATAL] [MAIN ] BHK: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:37:03.546959] [WARN ] [MAIN ] BHK: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:37:03.547006] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-10T17:37:03.547070] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-10T17:37:03.547108] [INFO ] [LOCAL ] BHK: Starting deletion of derivative data. [2025-10-10T17:37:03.547334] [DEBUG] [LOCAL ] BHK: Deleted derivative data file. [2025-10-10T17:37:03.547438] [INFO ] [MAIN ] Update Progress: 271/2373 symbols completed. BHK took 30.6s. Estimated remaining: 4h 46m 56s. Rate: 7.3 symbols/min [2025-10-10T17:37:03.735309] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:37:03.735581] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-10T17:37:03.735620] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-10T17:37:03.735775] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-10T17:37:03.735819] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-10T17:37:03.735933] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-10T17:37:03.735978] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-10T17:37:04.124937] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:37:04.289369] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-10T17:37:04.587391] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-10T17:37:04.657552] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-10T17:37:04.662520] [INFO ] [REMOTE ] BHC: Full fetch complete (67160 records). [2025-10-10T17:37:04.662716] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-10T17:37:04.871439] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-10T17:37:05.078198] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-10T17:37:05.078330] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-10T17:37:05.079299] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-10T17:37:05.079366] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-10T17:37:05.081349] [DEBUG] [LOCAL ] BHC: Trimmed 67160 records to 47488 (keeping 200 days of data) [2025-10-10T17:37:05.127310] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-10T17:37:05.370893] [DEBUG] [LOCAL ] BHC: Primary data saved (47488 records). [2025-10-10T17:37:05.371085] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-10T17:37:05.371442] [INFO ] [MAIN ] Update Progress: 272/2373 symbols completed. BHC took 51.7s. Estimated remaining: 4h 45m 58s. Rate: 7.3 symbols/min [2025-10-10T17:37:05.470225] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-10T17:37:05.559391] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:37:05.625240] [DEBUG] [LOCAL ] BHVN: Loaded 50578 existing records from primary storage. [2025-10-10T17:37:05.625727] [INFO ] [MAIN ] BHVN: Loaded 50578 existing records. [2025-10-10T17:37:05.811834] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:37:05.812129] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-10T17:37:05.812184] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-10T17:37:05.812582] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-10T17:37:05.812625] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-10T17:37:05.894635] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-10T17:37:06.189079] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:37:06.689396] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-10T17:37:07.489391] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-10T17:37:07.808044] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-10T17:37:08.289365] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-10T17:37:08.330781] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-10T17:37:08.572299] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T17:37:08.596376] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-10T17:37:09.089402] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-10T17:37:09.889389] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-10T17:37:10.502023] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-10T17:37:10.689434] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-10T17:37:11.489378] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-10T17:37:11.708730] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-10T17:37:11.795686] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-10T17:37:12.002271] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T17:37:12.289370] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-10T17:37:13.089355] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-10T17:37:13.526298] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-10T17:37:13.889382] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-10T17:37:14.669259] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-10T17:37:14.689408] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-10T17:37:15.361356] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-10T17:37:15.489351] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-10T17:37:15.878797] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T17:37:16.289386] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-10T17:37:16.806189] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-10T17:37:17.089369] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-10T17:37:17.702288] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-10T17:37:17.889350] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-10T17:37:18.381249] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T17:37:18.689393] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-10T17:37:19.300943] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-10T17:37:19.489378] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-10T17:37:19.903994] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-10T17:37:20.289371] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-10T17:37:20.860387] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-10T17:37:20.865161] [INFO ] [REMOTE ] BHP: Full fetch complete (76878 records). [2025-10-10T17:37:20.865318] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-10T17:37:20.866131] [FATAL] [VALIDATOR ] BHP: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:37:20.866248] [FATAL] [MAIN ] BHP: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:37:20.866316] [WARN ] [MAIN ] BHP: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:37:20.866412] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-10T17:37:20.866733] [DEBUG] [LOCAL ] BHP: No primary data file found to delete. [2025-10-10T17:37:20.866999] [INFO ] [LOCAL ] BHP: Starting deletion of derivative data. [2025-10-10T17:37:20.867304] [DEBUG] [LOCAL ] BHP: Deleted derivative data file. [2025-10-10T17:37:20.867466] [INFO ] [MAIN ] Update Progress: 273/2373 symbols completed. BHP took 46.6s. Estimated remaining: 4h 46m 46s. Rate: 7.3 symbols/min [2025-10-10T17:37:21.043068] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:37:21.093590] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-10T17:37:21.096550] [DEBUG] [LOCAL ] BILL: Loaded 52792 existing records from primary storage. [2025-10-10T17:37:21.097024] [INFO ] [MAIN ] BILL: Loaded 52792 existing records. [2025-10-10T17:37:21.290755] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:37:21.291191] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-10T17:37:21.291280] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-10T17:37:21.291902] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-10T17:37:21.292168] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-10T17:37:21.468159] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-10T17:37:21.618977] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T17:37:21.704527] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:37:21.889389] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-10T17:37:22.689413] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-10T17:37:23.489365] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-10T17:37:23.574173] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T17:37:23.578519] [INFO ] [REMOTE ] BHR: Full fetch complete (31282 records). [2025-10-10T17:37:23.578632] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-10T17:37:23.980553] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-10T17:37:23.980808] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-10T17:37:23.981714] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-10T17:37:23.981842] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-10T17:37:23.994715] [DEBUG] [LOCAL ] BHR: Trimmed 31282 records to 22281 (keeping 200 days of data) [2025-10-10T17:37:24.013982] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-10T17:37:24.165828] [DEBUG] [LOCAL ] BHR: Primary data saved (22281 records). [2025-10-10T17:37:24.166016] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-10T17:37:24.166113] [INFO ] [MAIN ] Update Progress: 274/2373 symbols completed. BHR took 30.5s. Estimated remaining: 4h 46m 1s. Rate: 7.3 symbols/min [2025-10-10T17:37:24.294621] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-10T17:37:24.361910] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:37:24.362139] [DEBUG] [LOCAL ] BIO: No existing data file found in primary storage. [2025-10-10T17:37:24.362194] [WARN ] [MAIN ] BIO: No existing data found, performing full refresh instead. [2025-10-10T17:37:24.362311] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-10T17:37:24.362363] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-10T17:37:24.362430] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-10T17:37:24.362466] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-10T17:37:24.718666] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:37:24.749550] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T17:37:24.763387] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-10T17:37:25.089382] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-10T17:37:25.889390] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-10T17:37:26.504927] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T17:37:26.689416] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-10T17:37:27.489409] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-10T17:37:27.746728] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T17:37:27.948799] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-10T17:37:27.948690] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-10T17:37:28.289391] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-10T17:37:28.837572] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-10T17:37:28.838422] [INFO ] [REMOTE ] BHV: Full fetch complete (1378 records). [2025-10-10T17:37:28.838491] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-10T17:37:29.022227] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-10T17:37:29.022475] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:37:29.022546] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:37:29.022619] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-10T17:37:29.022745] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-10T17:37:29.022804] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-10T17:37:29.022850] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-10T17:37:29.022931] [INFO ] [MAIN ] Update Progress: 275/2373 symbols completed. BHV took 25.5s. Estimated remaining: 4h 45m 27s. Rate: 7.3 symbols/min [2025-10-10T17:37:29.094629] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-10T17:37:29.196509] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:37:29.238914] [DEBUG] [LOCAL ] BIP: Loaded 39590 existing records from primary storage. [2025-10-10T17:37:29.239295] [INFO ] [MAIN ] BIP: Loaded 39590 existing records. [2025-10-10T17:37:29.426318] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:37:29.426661] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-10T17:37:29.426728] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-10T17:37:29.427091] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-10T17:37:29.427147] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-10T17:37:29.820764] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:37:29.889415] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-10T17:37:30.689364] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-10T17:37:30.792664] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T17:37:31.162749] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T17:37:31.489392] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-10T17:37:32.294482] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-10T17:37:32.306017] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T17:37:32.422791] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-10T17:37:33.089413] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-10T17:37:33.889492] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-10T17:37:34.168081] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-10T17:37:34.543166] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-10T17:37:34.689430] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-10T17:37:35.489450] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-10T17:37:35.560774] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-10T17:37:35.776227] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-10T17:37:36.289388] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-10T17:37:37.023727] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-10T17:37:37.089406] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-10T17:37:37.889504] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-10T17:37:38.162772] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T17:37:38.695317] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-10T17:37:38.706525] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T17:37:39.489449] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-10T17:37:39.786888] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T17:37:39.942925] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T17:37:40.289377] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-10T17:37:40.898959] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-10T17:37:41.089430] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-10T17:37:41.889433] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-10T17:37:42.412891] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-10T17:37:42.595732] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-10T17:37:42.689394] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-10T17:37:43.397455] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-10T17:37:43.489381] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-10T17:37:44.289415] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-10T17:37:44.734312] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-10T17:37:45.089388] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-10T17:37:45.133931] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T17:37:45.212474] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-10T17:37:45.889519] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-10T17:37:46.689379] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-10T17:37:47.106401] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T17:37:47.489432] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-10T17:37:47.767312] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-10T17:37:47.814189] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-10T17:37:48.289425] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-10T17:37:48.781605] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T17:37:49.089393] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-10T17:37:49.658034] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-10T17:37:49.889398] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-10T17:37:50.689373] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-10T17:37:51.088431] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-10T17:37:51.464174] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-10T17:37:51.469287] [INFO ] [REMOTE ] BHVN: Full fetch complete (70133 records). [2025-10-10T17:37:51.469429] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-10T17:37:51.494591] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-10T17:37:51.894279] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-10T17:37:51.894396] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-10T17:37:51.895387] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-10T17:37:51.895477] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-10T17:37:51.897056] [DEBUG] [LOCAL ] BHVN: Trimmed 70133 records to 50961 (keeping 200 days of data) [2025-10-10T17:37:52.197698] [DEBUG] [LOCAL ] BHVN: Primary data saved (50961 records). [2025-10-10T17:37:52.198057] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-10T17:37:52.198695] [INFO ] [MAIN ] Update Progress: 276/2373 symbols completed. BHVN took 46.8s. Estimated remaining: 4h 47m 13s. Rate: 7.3 symbols/min [2025-10-10T17:37:52.301869] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-10T17:37:52.357512] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T17:37:52.417392] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:37:52.417607] [DEBUG] [LOCAL ] BIPC: No existing data file found in primary storage. [2025-10-10T17:37:52.417669] [WARN ] [MAIN ] BIPC: No existing data found, performing full refresh instead. [2025-10-10T17:37:52.417799] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-10T17:37:52.417843] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-10T17:37:52.417885] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-10-10T17:37:52.417918] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-10T17:37:52.811598] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:37:53.094563] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-10T17:37:53.114884] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-10T17:37:53.737363] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-10T17:37:53.889383] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-10T17:37:54.491962] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T17:37:54.687093] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-10T17:37:54.689296] [INFO ] [REMOTE ] BIO: Full fetch complete (33987 records). [2025-10-10T17:37:54.689730] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-10T17:37:54.689438] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-10T17:37:55.074564] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-10T17:37:55.074695] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-10T17:37:55.075270] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-10T17:37:55.075317] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-10T17:37:55.076702] [DEBUG] [LOCAL ] BIO: Trimmed 33987 records to 24502 (keeping 200 days of data) [2025-10-10T17:37:55.247215] [DEBUG] [LOCAL ] BIO: Primary data saved (24502 records). [2025-10-10T17:37:55.247384] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-10T17:37:55.247475] [INFO ] [MAIN ] Update Progress: 277/2373 symbols completed. BIO took 31.1s. Estimated remaining: 4h 46m 26s. Rate: 7.3 symbols/min [2025-10-10T17:37:55.489408] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-10T17:37:56.289441] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-10T17:37:56.380772] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T17:37:56.768226] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-10T17:37:57.089427] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-10T17:37:57.889409] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-10T17:37:58.317367] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-10T17:37:58.397158] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-10T17:37:58.402322] [INFO ] [REMOTE ] BILL: Full fetch complete (75889 records). [2025-10-10T17:37:58.402453] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-10T17:37:58.702928] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-10T17:37:58.810374] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-10T17:37:58.810456] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-10T17:37:58.811279] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-10T17:37:58.811341] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-10T17:37:58.812803] [DEBUG] [LOCAL ] BILL: Trimmed 75889 records to 53182 (keeping 200 days of data) [2025-10-10T17:37:59.116816] [DEBUG] [LOCAL ] BILL: Primary data saved (53182 records). [2025-10-10T17:37:59.116956] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-10T17:37:59.117041] [INFO ] [MAIN ] Update Progress: 278/2373 symbols completed. BILL took 38.2s. Estimated remaining: 4h 45m 45s. Rate: 7.3 symbols/min [2025-10-10T17:37:59.524215] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T17:37:59.533125] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-10T17:38:00.473550] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T17:38:00.483246] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-10T17:38:01.369731] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T17:38:01.379698] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-10T17:38:02.117342] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T17:38:02.121976] [INFO ] [REMOTE ] BIP: Full fetch complete (56692 records). [2025-10-10T17:38:02.122258] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-10T17:38:02.123626] [FATAL] [VALIDATOR ] BIP: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:38:02.124544] [FATAL] [MAIN ] BIP: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:38:02.124626] [WARN ] [MAIN ] BIP: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:38:02.124732] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-10T17:38:02.124848] [DEBUG] [LOCAL ] BIP: No primary data file found to delete. [2025-10-10T17:38:02.124916] [INFO ] [LOCAL ] BIP: Starting deletion of derivative data. [2025-10-10T17:38:02.125498] [DEBUG] [LOCAL ] BIP: Deleted derivative data file. [2025-10-10T17:38:02.125626] [INFO ] [MAIN ] Update Progress: 279/2373 symbols completed. BIP took 33.1s. Estimated remaining: 4h 44m 58s. Rate: 7.3 symbols/min [2025-10-10T17:38:03.139706] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T17:38:03.150585] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-10T17:38:04.873216] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T17:38:04.883334] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-10T17:38:06.572664] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T17:38:06.582006] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-10T17:38:07.817138] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T17:38:07.827976] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-10T17:38:09.575562] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T17:38:09.584501] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-10T17:38:10.716610] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T17:38:10.726499] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-10T17:38:12.321900] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T17:38:12.326183] [INFO ] [REMOTE ] BIPC: Full fetch complete (59933 records). [2025-10-10T17:38:12.326318] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-10T17:38:12.730004] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-10T17:38:12.730109] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-10T17:38:12.730898] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-10T17:38:12.730966] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-10T17:38:12.732471] [DEBUG] [LOCAL ] BIPC: Trimmed 59933 records to 41873 (keeping 200 days of data) [2025-10-10T17:38:13.003082] [DEBUG] [LOCAL ] BIPC: Primary data saved (41873 records). [2025-10-10T17:38:13.003230] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-10T17:38:13.003307] [INFO ] [MAIN ] Update Progress: 280/2373 symbols completed. BIPC took 20.8s. Estimated remaining: 4h 45m 10s. Rate: 7.3 symbols/min [2025-10-10T17:38:13.624128] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:38:13.742027] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:38:13.749670] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:38:13.747421] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:38:13.754889] [DEBUG] [LOCAL ] BIPH: Loaded 2577 existing records from primary storage. [2025-10-10T17:38:13.755912] [INFO ] [MAIN ] BIPH: Loaded 2577 existing records. [2025-10-10T17:38:13.806522] [DEBUG] [LOCAL ] BIPJ: Loaded 3177 existing records from primary storage. [2025-10-10T17:38:13.812460] [INFO ] [MAIN ] BIPJ: Loaded 3177 existing records. [2025-10-10T17:38:13.825254] [DEBUG] [LOCAL ] BIPI: Loaded 3170 existing records from primary storage. [2025-10-10T17:38:13.850730] [INFO ] [MAIN ] BIPI: Loaded 3170 existing records. [2025-10-10T17:38:14.211575] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:38:14.228866] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-10T17:38:14.281764] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-10T17:38:14.340979] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-10T17:38:14.341289] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-10T17:38:14.444319] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:38:14.451356] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-10T17:38:14.506615] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-10T17:38:14.506491] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:38:14.518911] [DEBUG] [LOCAL ] BIRK: Loaded 51374 existing records from primary storage. [2025-10-10T17:38:14.536064] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-10T17:38:14.537328] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-10T17:38:14.537189] [INFO ] [MAIN ] BIRK: Loaded 51374 existing records. [2025-10-10T17:38:14.537591] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-10T17:38:14.577849] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-10T17:38:14.664762] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-10T17:38:14.722425] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-10T17:38:15.411863] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:38:15.482633] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-10T17:38:15.512528] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-10T17:38:15.500118] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:38:15.570016] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-10T17:38:15.541254] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-10T17:38:15.625944] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-10T17:38:15.883868] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:38:15.929455] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-10T17:38:16.014433] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:38:16.031363] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-10T17:38:16.265949] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:38:16.266276] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-10T17:38:16.424339] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-10T17:38:16.426819] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-10T17:38:16.841717] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-10T17:38:16.843886] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-10T17:38:17.078987] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-10T17:38:17.081485] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-10T17:38:17.155706] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-10T17:38:17.157692] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-10T17:38:17.204074] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-10T17:38:17.206353] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-10T17:38:17.474039] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-10T17:38:17.475175] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-10T17:38:17.758782] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-10T17:38:17.764508] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-10T17:38:17.764218] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-10T17:38:17.767511] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-10T17:38:17.935946] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-10T17:38:17.937715] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-10T17:38:17.974040] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T17:38:17.985523] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-10T17:38:18.124829] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-10T17:38:18.126382] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-10T17:38:18.302827] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-10T17:38:18.555892] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-10T17:38:18.689452] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-10T17:38:18.736373] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-10T17:38:19.143503] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-10T17:38:19.489433] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-10T17:38:19.732076] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T17:38:20.029882] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-10T17:38:20.289382] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-10T17:38:20.681515] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-10T17:38:21.089416] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-10T17:38:21.697746] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-10T17:38:21.889384] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-10T17:38:22.418098] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-10T17:38:22.689390] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-10T17:38:23.352146] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-10T17:38:23.489421] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-10T17:38:24.011152] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-10T17:38:24.289385] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-10T17:38:24.837267] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-10T17:38:25.089378] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-10T17:38:25.889370] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-10T17:38:26.427824] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-10T17:38:26.689371] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-10T17:38:26.771461] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-10T17:38:27.186816] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-10T17:38:27.489457] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-10T17:38:28.090318] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-10T17:38:28.289451] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-10T17:38:29.089412] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-10T17:38:29.609953] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-10T17:38:29.889401] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-10T17:38:30.297361] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-10T17:38:30.429130] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-10T17:38:30.430187] [INFO ] [REMOTE ] BIPH: Full fetch complete (4177 records). [2025-10-10T17:38:30.430312] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-10T17:38:30.694581] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-10T17:38:30.806098] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-10T17:38:30.806192] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-10T17:38:30.806401] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-10T17:38:30.806443] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-10T17:38:30.806825] [DEBUG] [LOCAL ] BIPH: Trimmed 4177 records to 2591 (keeping 200 days of data) [2025-10-10T17:38:30.822785] [DEBUG] [LOCAL ] BIPH: Primary data saved (2591 records). [2025-10-10T17:38:30.822848] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-10T17:38:30.822918] [INFO ] [MAIN ] Update Progress: 281/2373 symbols completed. BIPH took 17.8s. Estimated remaining: 4h 46m 14s. Rate: 7.3 symbols/min [2025-10-10T17:38:30.988597] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:38:31.012710] [DEBUG] [LOCAL ] BIT: Loaded 23392 existing records from primary storage. [2025-10-10T17:38:31.012978] [INFO ] [MAIN ] BIT: Loaded 23392 existing records. [2025-10-10T17:38:31.184276] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:38:31.184493] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-10T17:38:31.184539] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-10T17:38:31.184745] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-10T17:38:31.184801] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-10T17:38:31.463318] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-10T17:38:31.504039] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-10T17:38:31.544711] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:38:31.959518] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-10T17:38:31.960368] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4378 records). [2025-10-10T17:38:31.960435] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-10T17:38:32.292569] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-10T17:38:32.307423] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-10T17:38:32.307491] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-10T17:38:32.307695] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-10T17:38:32.307757] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-10T17:38:32.308113] [DEBUG] [LOCAL ] BIPJ: Trimmed 4378 records to 3196 (keeping 200 days of data) [2025-10-10T17:38:32.327708] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3196 records). [2025-10-10T17:38:32.327775] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-10T17:38:32.327842] [INFO ] [MAIN ] Update Progress: 282/2373 symbols completed. BIPJ took 19.3s. Estimated remaining: 4h 45m 16s. Rate: 7.3 symbols/min [2025-10-10T17:38:32.493538] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:38:32.542907] [DEBUG] [LOCAL ] BJ: Loaded 51896 existing records from primary storage. [2025-10-10T17:38:32.543219] [INFO ] [MAIN ] BJ: Loaded 51896 existing records. [2025-10-10T17:38:32.715699] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:38:32.715917] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-10T17:38:32.715974] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-10T17:38:32.716167] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-10T17:38:32.716205] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-10T17:38:32.874682] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-10T17:38:33.077585] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:38:33.089341] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-10T17:38:33.889436] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-10T17:38:34.677302] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T17:38:34.689341] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-10T17:38:35.219477] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T17:38:35.489445] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-10T17:38:36.072475] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-10T17:38:36.107852] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-10T17:38:36.289348] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-10T17:38:36.674094] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-10T17:38:37.089400] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-10T17:38:37.889399] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-10T17:38:38.246937] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-10T17:38:38.689427] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-10T17:38:39.489449] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-10T17:38:39.771371] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-10T17:38:40.289413] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-10T17:38:40.631523] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-10T17:38:40.702080] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T17:38:41.089402] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-10T17:38:41.445891] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T17:38:41.889387] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-10T17:38:42.321490] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-10T17:38:42.689506] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-10T17:38:42.690386] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-10T17:38:43.489452] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-10T17:38:43.938277] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T17:38:44.289418] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-10T17:38:44.855183] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T17:38:45.089381] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-10T17:38:45.820412] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-10T17:38:45.889346] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-10T17:38:46.689372] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-10T17:38:46.983463] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-10T17:38:47.235550] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-10T17:38:47.236437] [INFO ] [REMOTE ] BIPI: Full fetch complete (4942 records). [2025-10-10T17:38:47.236506] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-10T17:38:47.496103] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-10T17:38:47.641779] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-10T17:38:47.642048] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-10T17:38:47.642456] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-10T17:38:47.642556] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-10T17:38:47.643489] [DEBUG] [LOCAL ] BIPI: Trimmed 4942 records to 3192 (keeping 200 days of data) [2025-10-10T17:38:47.676689] [DEBUG] [LOCAL ] BIPI: Primary data saved (3192 records). [2025-10-10T17:38:47.676885] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-10T17:38:47.677006] [INFO ] [MAIN ] Update Progress: 283/2373 symbols completed. BIPI took 34.7s. Estimated remaining: 4h 46m 0s. Rate: 7.3 symbols/min [2025-10-10T17:38:47.942259] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:38:48.002753] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T17:38:48.097144] [DEBUG] [LOCAL ] BK: Loaded 53922 existing records from primary storage. [2025-10-10T17:38:48.097707] [INFO ] [MAIN ] BK: Loaded 53922 existing records. [2025-10-10T17:38:48.290446] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-10T17:38:48.290328] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:38:48.290829] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-10T17:38:48.290932] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-10T17:38:48.292091] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-10T17:38:48.292154] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-10T17:38:48.679515] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:38:48.781264] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T17:38:49.089374] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-10T17:38:49.889361] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-10T17:38:50.142006] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-10T17:38:50.217918] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T17:38:50.689400] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-10T17:38:51.489378] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-10T17:38:51.795252] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T17:38:51.955001] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-10T17:38:52.289381] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-10T17:38:53.097298] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-10T17:38:53.120477] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T17:38:53.889409] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-10T17:38:54.232157] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T17:38:54.268836] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T17:38:54.689381] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-10T17:38:55.489450] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-10T17:38:55.783218] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-10T17:38:55.788684] [INFO ] [REMOTE ] BIRK: Full fetch complete (73055 records). [2025-10-10T17:38:55.788846] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-10T17:38:56.218739] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-10T17:38:56.218848] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-10T17:38:56.219675] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-10T17:38:56.219740] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-10T17:38:56.221197] [DEBUG] [LOCAL ] BIRK: Trimmed 73055 records to 51758 (keeping 200 days of data) [2025-10-10T17:38:56.303698] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-10T17:38:56.341565] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T17:38:56.508772] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-10T17:38:56.596011] [DEBUG] [LOCAL ] BIRK: Primary data saved (51758 records). [2025-10-10T17:38:56.596139] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-10T17:38:56.596216] [INFO ] [MAIN ] Update Progress: 284/2373 symbols completed. BIRK took 43.6s. Estimated remaining: 4h 45m 57s. Rate: 7.3 symbols/min [2025-10-10T17:38:56.784894] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:38:56.836984] [DEBUG] [LOCAL ] BKD: Loaded 50711 existing records from primary storage. [2025-10-10T17:38:56.837372] [INFO ] [MAIN ] BKD: Loaded 50711 existing records. [2025-10-10T17:38:57.011696] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:38:57.011950] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-10T17:38:57.012005] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-10T17:38:57.012292] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-10T17:38:57.012348] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-10T17:38:57.094630] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-10T17:38:57.401157] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:38:57.668850] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T17:38:57.889452] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-10T17:38:58.484149] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-10T17:38:58.487431] [INFO ] [REMOTE ] BIT: Full fetch complete (31855 records). [2025-10-10T17:38:58.487582] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-10T17:38:58.695412] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-10T17:38:58.894388] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-10T17:38:58.894504] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-10T17:38:58.895595] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-10T17:38:58.895699] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-10T17:38:58.897195] [DEBUG] [LOCAL ] BIT: Trimmed 31855 records to 23580 (keeping 200 days of data) [2025-10-10T17:38:59.046936] [DEBUG] [LOCAL ] BIT: Primary data saved (23580 records). [2025-10-10T17:38:59.047101] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-10T17:38:59.047202] [INFO ] [MAIN ] Update Progress: 285/2373 symbols completed. BIT took 28.2s. Estimated remaining: 4h 45m 7s. Rate: 7.3 symbols/min [2025-10-10T17:38:59.224098] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:38:59.261724] [DEBUG] [LOCAL ] BKE: Loaded 34235 existing records from primary storage. [2025-10-10T17:38:59.262058] [INFO ] [MAIN ] BKE: Loaded 34235 existing records. [2025-10-10T17:38:59.450569] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:38:59.450856] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-10T17:38:59.450909] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-10T17:38:59.451129] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-10T17:38:59.451186] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-10T17:38:59.496927] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-10T17:38:59.847945] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:38:59.998858] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-10T17:39:00.289389] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-10T17:39:00.720974] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-10T17:39:01.089377] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-10T17:39:01.569421] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-10T17:39:01.897807] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-10T17:39:01.902393] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-10T17:39:02.689414] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-10T17:39:02.980421] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-10T17:39:03.301750] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-10T17:39:03.489410] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-10T17:39:04.289382] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-10T17:39:04.477630] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T17:39:05.089392] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-10T17:39:05.542929] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T17:39:05.746271] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-10T17:39:05.889422] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-10T17:39:06.689415] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-10T17:39:07.044519] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T17:39:07.489406] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-10T17:39:08.006407] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-10T17:39:08.264224] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T17:39:08.289343] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-10T17:39:09.089366] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-10T17:39:09.522675] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-10T17:39:09.528210] [INFO ] [REMOTE ] BJ: Full fetch complete (74063 records). [2025-10-10T17:39:09.528380] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-10T17:39:09.915365] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-10T17:39:09.942381] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-10T17:39:09.942550] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-10T17:39:09.943611] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-10T17:39:09.943721] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-10T17:39:09.962567] [DEBUG] [LOCAL ] BJ: Trimmed 74063 records to 52284 (keeping 200 days of data) [2025-10-10T17:39:09.976047] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T17:39:10.314417] [DEBUG] [LOCAL ] BJ: Primary data saved (52284 records). [2025-10-10T17:39:10.314610] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-10T17:39:10.314741] [INFO ] [MAIN ] Update Progress: 286/2373 symbols completed. BJ took 38.0s. Estimated remaining: 4h 45m 21s. Rate: 7.3 symbols/min [2025-10-10T17:39:10.495236] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:39:10.534283] [DEBUG] [LOCAL ] BKH: Loaded 37211 existing records from primary storage. [2025-10-10T17:39:10.534634] [INFO ] [MAIN ] BKH: Loaded 37211 existing records. [2025-10-10T17:39:10.696142] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-10T17:39:10.720944] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:39:10.721533] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-10T17:39:10.721627] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-10T17:39:10.721952] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-10T17:39:10.722012] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-10T17:39:11.083930] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:39:11.489481] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-10T17:39:12.129728] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (3.04 seconds). [2025-10-10T17:39:12.289383] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-10T17:39:12.721573] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-10-10T17:39:12.908843] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-10T17:39:13.089454] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-10T17:39:13.258843] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T17:39:13.889405] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-10T17:39:14.133057] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T17:39:14.689364] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-10T17:39:14.773566] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-10T17:39:15.182884] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T17:39:15.489422] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-10T17:39:16.289352] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-10T17:39:16.409296] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-10T17:39:17.089399] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-10T17:39:17.538479] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-10T17:39:17.812754] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-10T17:39:17.889424] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-10T17:39:18.689398] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-10T17:39:18.734139] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T17:39:19.428634] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-10T17:39:19.489405] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-10T17:39:20.160327] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-10T17:39:20.289374] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-10T17:39:21.089426] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-10T17:39:21.464555] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T17:39:21.703817] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T17:39:21.889402] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-10T17:39:22.644126] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T17:39:22.689380] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-10T17:39:23.489409] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-10T17:39:23.788015] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T17:39:24.289372] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-10T17:39:24.433517] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T17:39:25.089376] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-10T17:39:25.413208] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-10T17:39:25.418806] [INFO ] [REMOTE ] BK: Full fetch complete (77480 records). [2025-10-10T17:39:25.418972] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-10T17:39:25.837874] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-10T17:39:25.838167] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-10T17:39:25.839387] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-10T17:39:25.839516] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-10T17:39:25.841748] [DEBUG] [LOCAL ] BK: Trimmed 77480 records to 54309 (keeping 200 days of data) [2025-10-10T17:39:25.898518] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-10T17:39:25.968444] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T17:39:26.231802] [DEBUG] [LOCAL ] BK: Primary data saved (54309 records). [2025-10-10T17:39:26.231977] [INFO ] [MAIN ] BK: Full history saved. [2025-10-10T17:39:26.232078] [INFO ] [MAIN ] Update Progress: 287/2373 symbols completed. BK took 38.6s. Estimated remaining: 4h 46m 9s. Rate: 7.3 symbols/min [2025-10-10T17:39:26.414671] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:39:26.454780] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T17:39:26.495789] [DEBUG] [LOCAL ] BKKT: Loaded 36101 existing records from primary storage. [2025-10-10T17:39:26.496193] [INFO ] [MAIN ] BKKT: Loaded 36101 existing records. [2025-10-10T17:39:26.687426] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:39:26.688004] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-10T17:39:26.688069] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-10T17:39:26.688511] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-10T17:39:26.688577] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-10T17:39:26.699626] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-10T17:39:27.054372] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:39:27.489394] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-10T17:39:27.614995] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T17:39:28.289387] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-10T17:39:28.520820] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T17:39:29.094948] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-10T17:39:29.106443] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T17:39:29.889353] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-10T17:39:29.912000] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-10T17:39:30.689422] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-10T17:39:30.826011] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-10T17:39:30.831972] [INFO ] [REMOTE ] BKD: Full fetch complete (71845 records). [2025-10-10T17:39:30.832157] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-10T17:39:31.188924] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T17:39:31.279184] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-10T17:39:31.280086] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-10T17:39:31.281015] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-10T17:39:31.281094] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-10T17:39:31.283177] [DEBUG] [LOCAL ] BKD: Trimmed 71845 records to 51097 (keeping 200 days of data) [2025-10-10T17:39:31.490574] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-10T17:39:31.599981] [DEBUG] [LOCAL ] BKD: Primary data saved (51097 records). [2025-10-10T17:39:31.600192] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-10T17:39:31.601042] [INFO ] [MAIN ] Update Progress: 288/2373 symbols completed. BKD took 35.0s. Estimated remaining: 4h 45m 40s. Rate: 7.3 symbols/min [2025-10-10T17:39:31.776776] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:39:31.790356] [DEBUG] [LOCAL ] BKN: Loaded 7712 existing records from primary storage. [2025-10-10T17:39:31.790638] [INFO ] [MAIN ] BKN: Loaded 7712 existing records. [2025-10-10T17:39:31.972620] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:39:31.973036] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-10T17:39:31.973090] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-10T17:39:31.973311] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-10T17:39:31.973368] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-10T17:39:32.295483] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-10T17:39:32.337775] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:39:32.502091] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T17:39:32.636411] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-10T17:39:33.089379] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-10T17:39:33.425600] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T17:39:33.889380] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-10T17:39:34.382176] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T17:39:34.689397] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-10T17:39:35.236273] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T17:39:35.239792] [INFO ] [REMOTE ] BKE: Full fetch complete (50135 records). [2025-10-10T17:39:35.239894] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-10T17:39:35.495792] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-10T17:39:35.625829] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-10T17:39:35.625949] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-10T17:39:35.626682] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-10T17:39:35.626762] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-10T17:39:35.627943] [DEBUG] [LOCAL ] BKE: Trimmed 50135 records to 34527 (keeping 200 days of data) [2025-10-10T17:39:35.862382] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-10T17:39:35.878858] [DEBUG] [LOCAL ] BKE: Primary data saved (34527 records). [2025-10-10T17:39:35.879068] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-10T17:39:35.879193] [INFO ] [MAIN ] Update Progress: 289/2373 symbols completed. BKE took 36.8s. Estimated remaining: 4h 45m 4s. Rate: 7.3 symbols/min [2025-10-10T17:39:36.050503] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:39:36.099863] [DEBUG] [LOCAL ] BKSY: Loaded 48849 existing records from primary storage. [2025-10-10T17:39:36.100240] [INFO ] [MAIN ] BKSY: Loaded 48849 existing records. [2025-10-10T17:39:36.284330] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:39:36.284598] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-10T17:39:36.284676] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-10T17:39:36.285029] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-10T17:39:36.285089] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-10T17:39:36.296337] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-10T17:39:36.600928] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-10T17:39:36.672312] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:39:37.089403] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-10T17:39:37.889361] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-10T17:39:38.033940] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-10T17:39:38.268828] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-10T17:39:38.689385] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-10T17:39:39.489359] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-10T17:39:39.994853] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-10T17:39:40.033626] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-10T17:39:40.203869] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T17:39:40.289407] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-10T17:39:41.089400] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-10T17:39:41.654471] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T17:39:41.889357] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-10T17:39:41.951094] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-10T17:39:42.689399] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-10T17:39:43.489377] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-10T17:39:43.518301] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T17:39:44.216405] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-10T17:39:44.220450] [INFO ] [REMOTE ] BKH: Full fetch complete (52485 records). [2025-10-10T17:39:44.220623] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-10T17:39:44.294726] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-10T17:39:44.627592] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-10T17:39:44.627724] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-10T17:39:44.628532] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-10T17:39:44.628578] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-10T17:39:44.629993] [DEBUG] [LOCAL ] BKH: Trimmed 52485 records to 37451 (keeping 200 days of data) [2025-10-10T17:39:44.870386] [DEBUG] [LOCAL ] BKH: Primary data saved (37451 records). [2025-10-10T17:39:44.870610] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-10T17:39:44.870752] [INFO ] [MAIN ] Update Progress: 290/2373 symbols completed. BKH took 34.6s. Estimated remaining: 4h 45m 1s. Rate: 7.3 symbols/min [2025-10-10T17:39:45.058178] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:39:45.073730] [DEBUG] [LOCAL ] BKT: Loaded 12044 existing records from primary storage. [2025-10-10T17:39:45.074053] [INFO ] [MAIN ] BKT: Loaded 12044 existing records. [2025-10-10T17:39:45.107400] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-10T17:39:45.266082] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:39:45.266357] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-10T17:39:45.266427] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-10T17:39:45.266686] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-10T17:39:45.266758] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-10T17:39:45.624721] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-10T17:39:45.676450] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:39:45.727617] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-10T17:39:45.786931] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T17:39:45.889403] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-10T17:39:46.689390] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-10T17:39:47.489387] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-10T17:39:48.038348] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T17:39:48.289392] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-10T17:39:48.600173] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-10T17:39:49.089397] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-10T17:39:49.121279] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-10T17:39:49.368280] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-10T17:39:49.889375] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-10T17:39:50.689419] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-10T17:39:51.221084] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-10T17:39:51.224141] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-10T17:39:51.489408] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-10T17:39:51.982308] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T17:39:52.289412] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-10T17:39:52.794066] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-10T17:39:53.089360] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-10T17:39:53.379272] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T17:39:53.889382] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-10T17:39:54.000832] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-10T17:39:54.689421] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-10T17:39:54.822923] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-10T17:39:55.489404] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-10T17:39:56.289409] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-10T17:39:56.824774] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-10T17:39:56.914606] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-10T17:39:56.919979] [INFO ] [REMOTE ] BKKT: Full fetch complete (50850 records). [2025-10-10T17:39:56.920123] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-10T17:39:57.092843] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-10T17:39:57.344998] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-10T17:39:57.345228] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-10T17:39:57.346071] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-10T17:39:57.346157] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-10T17:39:57.347781] [DEBUG] [LOCAL ] BKKT: Trimmed 50850 records to 36488 (keeping 200 days of data) [2025-10-10T17:39:57.505003] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T17:39:57.625116] [DEBUG] [LOCAL ] BKKT: Primary data saved (36488 records). [2025-10-10T17:39:57.625318] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-10T17:39:57.625423] [INFO ] [MAIN ] Update Progress: 291/2373 symbols completed. BKKT took 31.4s. Estimated remaining: 4h 45m 25s. Rate: 7.3 symbols/min [2025-10-10T17:39:57.807220] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:39:57.850740] [DEBUG] [LOCAL ] BKU: Loaded 42027 existing records from primary storage. [2025-10-10T17:39:57.851160] [INFO ] [MAIN ] BKU: Loaded 42027 existing records. [2025-10-10T17:39:57.894967] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-10T17:39:57.968792] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-10T17:39:58.054507] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:39:58.054818] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-10T17:39:58.054880] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-10T17:39:58.055150] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-10T17:39:58.055190] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-10T17:39:58.434878] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:39:58.689404] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-10T17:39:59.320066] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-10T17:39:59.489409] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-10T17:39:59.791051] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-10T17:40:00.289393] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-10T17:40:01.020841] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T17:40:01.022271] [INFO ] [REMOTE ] BKN: Full fetch complete (11537 records). [2025-10-10T17:40:01.022350] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-10T17:40:01.094341] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-10T17:40:01.485358] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-10T17:40:01.485540] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-10T17:40:01.486138] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-10T17:40:01.486283] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-10T17:40:01.487231] [DEBUG] [LOCAL ] BKN: Trimmed 11537 records to 7736 (keeping 200 days of data) [2025-10-10T17:40:01.519915] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T17:40:01.584388] [DEBUG] [LOCAL ] BKN: Primary data saved (7736 records). [2025-10-10T17:40:01.584546] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-10T17:40:01.584791] [INFO ] [MAIN ] Update Progress: 292/2373 symbols completed. BKN took 30.0s. Estimated remaining: 4h 44m 47s. Rate: 7.3 symbols/min [2025-10-10T17:40:01.767302] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:40:01.801694] [DEBUG] [LOCAL ] BKV: Loaded 30121 existing records from primary storage. [2025-10-10T17:40:01.802046] [INFO ] [MAIN ] BKV: Loaded 30121 existing records. [2025-10-10T17:40:01.894511] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-10T17:40:02.011472] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:40:02.012183] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-10T17:40:02.012307] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-10T17:40:02.012704] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-10T17:40:02.012784] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-10T17:40:02.345582] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T17:40:02.409378] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:40:02.689393] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-10T17:40:03.364452] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-10T17:40:03.489414] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-10T17:40:04.289443] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-10T17:40:04.510458] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-10T17:40:05.089401] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-10T17:40:05.121606] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T17:40:05.670518] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T17:40:05.889400] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-10T17:40:06.689386] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-10T17:40:07.265350] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-10T17:40:07.342247] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-10T17:40:07.489460] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-10T17:40:07.518946] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-10T17:40:08.289444] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-10T17:40:09.089393] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-10T17:40:09.166142] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-10T17:40:09.501549] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T17:40:09.889408] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-10T17:40:10.565081] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-10T17:40:10.689397] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-10T17:40:11.489389] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-10T17:40:12.183818] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-10T17:40:12.189431] [INFO ] [REMOTE ] BKSY: Full fetch complete (70029 records). [2025-10-10T17:40:12.189606] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-10T17:40:12.297610] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-10T17:40:12.651813] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-10T17:40:12.652542] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-10T17:40:12.655989] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-10T17:40:12.657550] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-10T17:40:12.657713] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-10T17:40:12.659610] [DEBUG] [LOCAL ] BKSY: Trimmed 70029 records to 49237 (keeping 200 days of data) [2025-10-10T17:40:12.785174] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-10T17:40:13.017472] [DEBUG] [LOCAL ] BKSY: Primary data saved (49237 records). [2025-10-10T17:40:13.017689] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-10T17:40:13.017837] [INFO ] [MAIN ] Update Progress: 293/2373 symbols completed. BKSY took 37.1s. Estimated remaining: 4h 45m 1s. Rate: 7.3 symbols/min [2025-10-10T17:40:13.094635] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-10T17:40:13.205423] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:40:13.253218] [DEBUG] [LOCAL ] BLCO: Loaded 35773 existing records from primary storage. [2025-10-10T17:40:13.253670] [INFO ] [MAIN ] BLCO: Loaded 35773 existing records. [2025-10-10T17:40:13.460163] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:40:13.460592] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-10T17:40:13.460676] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-10T17:40:13.460923] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-10T17:40:13.460981] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-10T17:40:13.881409] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-10T17:40:13.887663] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:40:13.896631] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-10T17:40:14.375754] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T17:40:14.689401] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-10T17:40:15.489412] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-10T17:40:15.543857] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-10T17:40:16.125032] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-10T17:40:16.289411] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-10T17:40:16.734467] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-10T17:40:16.736965] [INFO ] [REMOTE ] BKT: Full fetch complete (15893 records). [2025-10-10T17:40:16.737042] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-10T17:40:17.103356] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-10T17:40:17.114603] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-10T17:40:17.115999] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-10T17:40:17.116413] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-10T17:40:17.116461] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-10T17:40:17.117307] [DEBUG] [LOCAL ] BKT: Trimmed 15893 records to 12155 (keeping 200 days of data) [2025-10-10T17:40:17.194458] [DEBUG] [LOCAL ] BKT: Primary data saved (12155 records). [2025-10-10T17:40:17.194691] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-10T17:40:17.194808] [INFO ] [MAIN ] Update Progress: 294/2373 symbols completed. BKT took 32.3s. Estimated remaining: 4h 44m 25s. Rate: 7.3 symbols/min [2025-10-10T17:40:17.372213] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:40:17.372441] [DEBUG] [LOCAL ] BLD: No existing data file found in primary storage. [2025-10-10T17:40:17.372480] [WARN ] [MAIN ] BLD: No existing data found, performing full refresh instead. [2025-10-10T17:40:17.372684] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-10T17:40:17.372741] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-10T17:40:17.372785] [DEBUG] [LOCAL ] BLD: No primary data file found to delete. [2025-10-10T17:40:17.372828] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-10T17:40:17.752133] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:40:17.830346] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-10T17:40:17.889375] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-10T17:40:18.689429] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-10T17:40:18.862411] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T17:40:18.881608] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-10T17:40:19.489390] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-10T17:40:20.289385] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-10T17:40:20.321377] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T17:40:21.089379] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-10T17:40:21.197471] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T17:40:21.649935] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-10T17:40:21.889401] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-10T17:40:22.524244] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-10T17:40:22.689413] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-10T17:40:22.878051] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-10T17:40:23.489410] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-10T17:40:24.289384] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-10T17:40:24.419008] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-10T17:40:24.465887] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T17:40:25.089398] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-10T17:40:25.168549] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-10T17:40:25.226009] [DEBUG] [REMOTE ] BKU: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-10T17:40:25.226431] [WARN ] [REMOTE ] BKU: No data returned for month 2025-05 [2025-10-10T17:40:25.226529] [FATAL] [REMOTE ] BKU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:40:25.226633] [FATAL] [MAIN ] BKU: Failed to fetch primary data. [2025-10-10T17:40:25.226726] [WARN ] [MAIN ] BKU: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:40:25.226806] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-10T17:40:25.226890] [DEBUG] [LOCAL ] BKU: No primary data file found to delete. [2025-10-10T17:40:25.226936] [INFO ] [LOCAL ] BKU: Starting deletion of derivative data. [2025-10-10T17:40:25.227274] [DEBUG] [LOCAL ] BKU: Deleted derivative data file. [2025-10-10T17:40:25.227377] [INFO ] [MAIN ] Update Progress: 295/2373 symbols completed. BKU took 27.6s. Estimated remaining: 4h 44m 15s. Rate: 7.3 symbols/min [2025-10-10T17:40:25.407870] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:40:25.465145] [DEBUG] [LOCAL ] BLDR: Loaded 52091 existing records from primary storage. [2025-10-10T17:40:25.465540] [INFO ] [MAIN ] BLDR: Loaded 52091 existing records. [2025-10-10T17:40:25.649350] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:40:25.649662] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-10T17:40:25.649733] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-10T17:40:25.650221] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-10T17:40:25.650279] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-10T17:40:25.894633] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-10T17:40:26.011448] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:40:26.689396] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-10T17:40:27.489378] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-10T17:40:27.692895] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-10T17:40:27.696786] [INFO ] [REMOTE ] BKV: Full fetch complete (44717 records). [2025-10-10T17:40:27.696936] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-10T17:40:28.101396] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-10T17:40:28.101510] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-10T17:40:28.102283] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-10T17:40:28.102350] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-10T17:40:28.103920] [DEBUG] [LOCAL ] BKV: Trimmed 44717 records to 30370 (keeping 200 days of data) [2025-10-10T17:40:28.291674] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-10T17:40:28.297568] [DEBUG] [LOCAL ] BKV: Primary data saved (30370 records). [2025-10-10T17:40:28.297689] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-10T17:40:28.297804] [INFO ] [MAIN ] Update Progress: 296/2373 symbols completed. BKV took 26.7s. Estimated remaining: 4h 43m 31s. Rate: 7.3 symbols/min [2025-10-10T17:40:28.482235] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:40:28.498805] [DEBUG] [LOCAL ] BLE: Loaded 14158 existing records from primary storage. [2025-10-10T17:40:28.499092] [INFO ] [MAIN ] BLE: Loaded 14158 existing records. [2025-10-10T17:40:28.687520] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:40:28.688435] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-10T17:40:28.688622] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-10T17:40:28.688931] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-10T17:40:28.689082] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-10T17:40:28.808299] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-10T17:40:29.090826] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-10T17:40:29.121952] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:40:29.154753] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T17:40:29.889389] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-10T17:40:29.967287] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T17:40:30.689358] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-10T17:40:30.792149] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-10T17:40:30.997528] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T17:40:31.489398] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-10T17:40:32.289418] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-10T17:40:32.336047] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T17:40:32.964461] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-10T17:40:33.089487] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-10T17:40:33.286848] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T17:40:33.889408] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-10T17:40:34.340866] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T17:40:34.689401] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-10T17:40:35.208374] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T17:40:35.489396] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-10T17:40:36.283560] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-10T17:40:36.294079] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-10T17:40:36.447476] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T17:40:37.089453] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-10T17:40:37.889387] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-10T17:40:37.960972] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-10T17:40:38.391755] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-10T17:40:38.689411] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-10T17:40:39.489413] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-10T17:40:39.996932] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T17:40:40.288166] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-10T17:40:40.295242] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-10T17:40:40.520554] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-10T17:40:41.089401] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-10T17:40:41.520490] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T17:40:41.889438] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-10T17:40:42.692043] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-10T17:40:42.697172] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-10T17:40:43.169610] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-10T17:40:43.394252] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-10T17:40:43.489404] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-10T17:40:44.256521] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-10T17:40:44.289392] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-10T17:40:45.089431] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-10T17:40:45.177966] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-10T17:40:45.889415] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-10T17:40:46.368558] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T17:40:46.689431] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-10T17:40:47.147843] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T17:40:47.150939] [INFO ] [REMOTE ] BLD: Full fetch complete (40037 records). [2025-10-10T17:40:47.151033] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-10T17:40:47.439151] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-10T17:40:47.494497] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-10T17:40:47.566739] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-10T17:40:47.566986] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-10T17:40:47.567693] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-10T17:40:47.567761] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-10T17:40:47.569174] [DEBUG] [LOCAL ] BLD: Trimmed 40037 records to 28106 (keeping 200 days of data) [2025-10-10T17:40:47.751939] [DEBUG] [LOCAL ] BLD: Primary data saved (28106 records). [2025-10-10T17:40:47.752109] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-10T17:40:47.752202] [INFO ] [MAIN ] Update Progress: 297/2373 symbols completed. BLD took 30.6s. Estimated remaining: 4h 44m 41s. Rate: 7.3 symbols/min [2025-10-10T17:40:47.927534] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:40:47.968334] [DEBUG] [LOCAL ] BLK: Loaded 34297 existing records from primary storage. [2025-10-10T17:40:47.968639] [INFO ] [MAIN ] BLK: Loaded 34297 existing records. [2025-10-10T17:40:48.161150] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:40:48.161450] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-10T17:40:48.161512] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-10T17:40:48.161961] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-10T17:40:48.162041] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-10T17:40:48.294485] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-10T17:40:48.491434] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-10T17:40:48.565737] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:40:49.089400] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-10T17:40:49.889385] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-10T17:40:50.030372] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-10T17:40:50.383726] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-10T17:40:50.689396] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-10T17:40:51.405992] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T17:40:51.489377] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-10T17:40:51.546453] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T17:40:51.548188] [INFO ] [REMOTE ] BLE: Full fetch complete (20028 records). [2025-10-10T17:40:51.548261] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-10T17:40:51.933913] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-10T17:40:51.934010] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-10T17:40:51.934481] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-10T17:40:51.934524] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-10T17:40:51.935191] [DEBUG] [LOCAL ] BLE: Trimmed 20028 records to 14251 (keeping 200 days of data) [2025-10-10T17:40:52.023891] [DEBUG] [LOCAL ] BLE: Primary data saved (14251 records). [2025-10-10T17:40:52.024067] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-10T17:40:52.024170] [INFO ] [MAIN ] Update Progress: 298/2373 symbols completed. BLE took 23.7s. Estimated remaining: 4h 44m 6s. Rate: 7.3 symbols/min [2025-10-10T17:40:52.202960] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:40:52.254680] [DEBUG] [LOCAL ] BLND: Loaded 49568 existing records from primary storage. [2025-10-10T17:40:52.255137] [INFO ] [MAIN ] BLND: Loaded 49568 existing records. [2025-10-10T17:40:52.298560] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-10T17:40:52.438983] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:40:52.439274] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-10T17:40:52.439331] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-10T17:40:52.439754] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-10T17:40:52.439811] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-10T17:40:52.814271] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:40:53.089411] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-10T17:40:53.238467] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-10T17:40:53.889423] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-10T17:40:54.378516] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-10T17:40:54.527082] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-10T17:40:54.689404] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-10T17:40:55.489398] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-10T17:40:55.978284] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-10T17:40:56.289413] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-10T17:40:56.821362] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-10T17:40:57.089362] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-10T17:40:57.201013] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T17:40:57.643032] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-10T17:40:57.889414] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-10T17:40:58.689365] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-10T17:40:59.230366] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-10T17:40:59.489363] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-10T17:40:59.839317] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T17:41:00.131143] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-10T17:41:00.289393] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-10T17:41:01.089402] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-10T17:41:01.889481] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-10T17:41:02.030308] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-10T17:41:02.083299] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-10T17:41:02.088166] [INFO ] [REMOTE ] BLCO: Full fetch complete (52340 records). [2025-10-10T17:41:02.088364] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-10T17:41:02.489019] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-10T17:41:02.489145] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-10T17:41:02.490005] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-10T17:41:02.490079] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-10T17:41:02.491939] [DEBUG] [LOCAL ] BLCO: Trimmed 52340 records to 36059 (keeping 200 days of data) [2025-10-10T17:41:02.689384] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-10T17:41:02.711528] [DEBUG] [LOCAL ] BLCO: Primary data saved (36059 records). [2025-10-10T17:41:02.711752] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-10T17:41:02.711870] [INFO ] [MAIN ] Update Progress: 299/2373 symbols completed. BLCO took 49.7s. Estimated remaining: 4h 44m 15s. Rate: 7.3 symbols/min [2025-10-10T17:41:02.892509] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:41:02.892761] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-10T17:41:02.892810] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-10T17:41:02.892909] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-10T17:41:02.892948] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-10T17:41:02.892988] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-10T17:41:02.893027] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-10T17:41:03.266420] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:41:03.291448] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-10T17:41:03.489402] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-10T17:41:03.610430] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T17:41:03.988584] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:41:03.989010] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-10T17:41:03.989107] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:41:03.989157] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-10T17:41:03.989218] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:41:03.989264] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-10T17:41:03.989327] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-10T17:41:03.989364] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-10T17:41:03.989403] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-10T17:41:03.989452] [INFO ] [MAIN ] Update Progress: 300/2373 symbols completed. BLSH took 1.3s. Estimated remaining: 4h 43m 18s. Rate: 7.3 symbols/min [2025-10-10T17:41:04.169214] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:41:04.187380] [DEBUG] [LOCAL ] BLW: Loaded 13433 existing records from primary storage. [2025-10-10T17:41:04.187710] [INFO ] [MAIN ] BLW: Loaded 13433 existing records. [2025-10-10T17:41:04.292117] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-10T17:41:04.375531] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:41:04.375821] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-10T17:41:04.375908] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-10T17:41:04.376192] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-10T17:41:04.376250] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-10T17:41:04.748241] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:41:04.761964] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-10T17:41:04.770986] [INFO ] [REMOTE ] BLDR: Full fetch complete (74515 records). [2025-10-10T17:41:04.771144] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-10T17:41:05.094544] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-10T17:41:05.177922] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-10T17:41:05.178025] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-10T17:41:05.179088] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-10T17:41:05.179159] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-10T17:41:05.180822] [DEBUG] [LOCAL ] BLDR: Trimmed 74515 records to 52473 (keeping 200 days of data) [2025-10-10T17:41:05.525997] [DEBUG] [LOCAL ] BLDR: Primary data saved (52473 records). [2025-10-10T17:41:05.526232] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-10T17:41:05.526336] [INFO ] [MAIN ] Update Progress: 301/2373 symbols completed. BLDR took 40.3s. Estimated remaining: 4h 42m 24s. Rate: 7.3 symbols/min [2025-10-10T17:41:05.701000] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:41:05.719521] [DEBUG] [LOCAL ] BLX: Loaded 15705 existing records from primary storage. [2025-10-10T17:41:05.719830] [INFO ] [MAIN ] BLX: Loaded 15705 existing records. [2025-10-10T17:41:05.897229] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-10T17:41:05.904719] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:41:05.905098] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-10T17:41:05.905151] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-10T17:41:05.905446] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-10T17:41:05.905507] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-10T17:41:06.317490] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:41:06.444560] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T17:41:06.504673] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T17:41:06.689413] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-10T17:41:07.489353] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-10T17:41:07.590393] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T17:41:07.772337] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T17:41:08.289397] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-10T17:41:09.030078] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-10T17:41:09.089424] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-10T17:41:09.224254] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-10T17:41:09.889381] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-10T17:41:10.461253] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-10T17:41:10.689370] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-10T17:41:10.818351] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T17:41:11.489405] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-10T17:41:11.811432] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-10T17:41:12.289392] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-10T17:41:13.089414] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-10T17:41:13.307770] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T17:41:13.384815] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-10T17:41:13.889411] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-10T17:41:14.689472] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-10T17:41:14.875354] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T17:41:14.891198] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-10T17:41:15.489364] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-10T17:41:15.972172] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-10T17:41:16.183164] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-10T17:41:16.289398] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-10T17:41:17.089429] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-10T17:41:17.519282] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T17:41:17.889416] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-10T17:41:18.689394] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-10T17:41:19.173458] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-10T17:41:19.318933] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-10T17:41:19.489401] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-10T17:41:20.043261] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-10T17:41:20.289372] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-10T17:41:20.926179] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-10T17:41:21.089391] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-10T17:41:21.257766] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T17:41:21.889396] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-10T17:41:22.037598] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-10T17:41:22.689424] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-10T17:41:23.489404] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-10T17:41:23.679384] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T17:41:24.025944] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-10T17:41:24.289387] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-10T17:41:24.500716] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-10T17:41:25.089489] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-10T17:41:25.889467] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-10T17:41:26.158148] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-10T17:41:26.202487] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-10T17:41:26.419728] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-10T17:41:26.689428] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-10T17:41:27.489402] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-10T17:41:27.673132] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T17:41:28.289427] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-10T17:41:28.617829] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-10T17:41:29.089426] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-10T17:41:29.889404] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-10T17:41:30.237142] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T17:41:30.303327] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-10T17:41:30.468796] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-10T17:41:30.689412] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-10T17:41:31.489455] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-10T17:41:31.899410] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-10T17:41:32.289386] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-10T17:41:33.089437] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-10T17:41:33.889399] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-10T17:41:34.074920] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-10T17:41:34.087344] [INFO ] [REMOTE ] BLK: Full fetch complete (52440 records). [2025-10-10T17:41:34.088312] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T17:41:34.088430] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-10T17:41:34.091247] [INFO ] [REMOTE ] BLX: Full fetch complete (22432 records). [2025-10-10T17:41:34.149789] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-10T17:41:34.166910] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-10T17:41:34.258057] [INFO ] [REMOTE ] BLND: Full fetch complete (72210 records). [2025-10-10T17:41:34.302479] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-10T17:41:35.159381] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-10T17:41:35.264675] [INFO ] [REMOTE ] BLW: Full fetch complete (19342 records). [2025-10-10T17:41:35.270230] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-10T17:41:35.270818] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-10T17:41:35.278531] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-10T17:41:35.270954] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-10T17:41:35.284011] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-10T17:41:35.285101] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-10T17:41:35.286094] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-10T17:41:35.286300] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-10T17:41:35.291714] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-10T17:41:35.418263] [DEBUG] [LOCAL ] BLX: Trimmed 22432 records to 15813 (keeping 200 days of data) [2025-10-10T17:41:35.440568] [DEBUG] [LOCAL ] BLK: Trimmed 52440 records to 34578 (keeping 200 days of data) [2025-10-10T17:41:35.507343] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-10T17:41:35.507788] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-10T17:41:35.508844] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-10T17:41:35.509606] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-10T17:41:35.788541] [DEBUG] [LOCAL ] BLND: Trimmed 72210 records to 49952 (keeping 200 days of data) [2025-10-10T17:41:36.061681] [DEBUG] [LOCAL ] BLX: Primary data saved (15813 records). [2025-10-10T17:41:36.063743] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-10T17:41:36.069996] [INFO ] [MAIN ] Update Progress: 302/2373 symbols completed. BLX took 30.5s. Estimated remaining: 4h 44m 49s. Rate: 7.3 symbols/min [2025-10-10T17:41:36.332809] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-10T17:41:36.334775] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-10T17:41:36.354444] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-10T17:41:36.405851] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-10T17:41:36.445049] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:41:36.458196] [DEBUG] [LOCAL ] BLW: Trimmed 19342 records to 13518 (keeping 200 days of data) [2025-10-10T17:41:36.610182] [DEBUG] [LOCAL ] BLK: Primary data saved (34578 records). [2025-10-10T17:41:36.619371] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-10T17:41:36.625713] [INFO ] [MAIN ] Update Progress: 303/2373 symbols completed. BLK took 48.9s. Estimated remaining: 4h 43m 49s. Rate: 7.3 symbols/min [2025-10-10T17:41:36.772918] [DEBUG] [LOCAL ] BMA: Loaded 35935 existing records from primary storage. [2025-10-10T17:41:36.785838] [INFO ] [MAIN ] BMA: Loaded 35935 existing records. [2025-10-10T17:41:36.941186] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:41:37.033423] [DEBUG] [LOCAL ] BLND: Primary data saved (49952 records). [2025-10-10T17:41:37.040805] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-10T17:41:37.047778] [INFO ] [MAIN ] Update Progress: 304/2373 symbols completed. BLND took 45.0s. Estimated remaining: 4h 42m 47s. Rate: 7.3 symbols/min [2025-10-10T17:41:37.066695] [DEBUG] [LOCAL ] BLW: Primary data saved (13518 records). [2025-10-10T17:41:37.065130] [DEBUG] [LOCAL ] BME: Loaded 11174 existing records from primary storage. [2025-10-10T17:41:37.077428] [INFO ] [MAIN ] BME: Loaded 11174 existing records. [2025-10-10T17:41:37.183767] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-10T17:41:37.213026] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:41:37.256593] [INFO ] [MAIN ] Update Progress: 305/2373 symbols completed. BLW took 33.3s. Estimated remaining: 4h 41m 45s. Rate: 7.3 symbols/min [2025-10-10T17:41:37.351744] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-10T17:41:37.412586] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-10T17:41:37.492987] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-10T17:41:37.506694] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:41:37.546770] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-10T17:41:37.614148] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:41:37.638372] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-10T17:41:37.655036] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-10T17:41:37.719578] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-10T17:41:37.749185] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-10T17:41:37.824456] [DEBUG] [LOCAL ] BMEZ: Loaded 26718 existing records from primary storage. [2025-10-10T17:41:37.838401] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:41:37.853940] [INFO ] [MAIN ] BMEZ: Loaded 26718 existing records. [2025-10-10T17:41:38.327040] [DEBUG] [LOCAL ] BMI: Loaded 24507 existing records from primary storage. [2025-10-10T17:41:38.371289] [INFO ] [MAIN ] BMI: Loaded 24507 existing records. [2025-10-10T17:41:38.481989] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:41:38.560088] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-10T17:41:38.611593] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-10T17:41:38.684712] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-10T17:41:38.695956] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:41:38.696145] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-10T17:41:38.711930] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-10T17:41:39.000001] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:41:38.994699] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:41:39.000277] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-10T17:41:39.000843] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-10T17:41:39.006223] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-10T17:41:39.061530] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-10T17:41:39.116966] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-10T17:41:39.429503] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:41:39.481109] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-10T17:41:39.628555] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:41:39.628874] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-10T17:41:39.835969] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-10T17:41:39.839686] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-10T17:41:39.902999] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T17:41:39.910168] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-10T17:41:40.888550] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T17:41:40.893119] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-10T17:41:40.990272] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-10T17:41:40.993702] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-10T17:41:41.157530] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T17:41:41.170745] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-10T17:41:41.193756] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T17:41:41.451664] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-10T17:41:41.889375] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-10T17:41:42.108209] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-10T17:41:42.689350] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-10T17:41:42.810493] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T17:41:42.905598] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-10T17:41:43.447578] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-10T17:41:43.489337] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-10T17:41:44.289340] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-10T17:41:44.769235] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T17:41:45.089574] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-10T17:41:45.217077] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T17:41:45.889398] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-10T17:41:46.685263] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-10T17:41:46.692978] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-10T17:41:46.705103] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-10T17:41:47.490331] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-10T17:41:48.280380] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-10T17:41:48.289323] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-10T17:41:48.878155] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-10T17:41:49.089393] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-10T17:41:49.432303] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-10T17:41:49.889367] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-10T17:41:49.976056] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-10T17:41:50.689387] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-10T17:41:51.071162] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-10T17:41:51.489371] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-10T17:41:52.295440] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-10T17:41:52.299472] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-10T17:41:52.527234] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-10T17:41:52.885433] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-10T17:41:53.089374] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-10T17:41:53.889366] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-10T17:41:54.023186] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T17:41:54.689345] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-10T17:41:54.862907] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-10T17:41:55.489387] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-10T17:41:56.289406] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-10T17:41:56.341865] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T17:41:57.089343] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-10T17:41:57.213811] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-10T17:41:57.287195] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-10T17:41:57.889371] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-10T17:41:58.091204] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-10T17:41:58.689345] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-10T17:41:58.984883] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-10T17:41:58.986747] [INFO ] [REMOTE ] BME: Full fetch complete (16006 records). [2025-10-10T17:41:58.986824] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-10T17:41:59.410496] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-10T17:41:59.410580] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-10T17:41:59.411064] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-10T17:41:59.411151] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-10T17:41:59.411867] [DEBUG] [LOCAL ] BME: Trimmed 16006 records to 11309 (keeping 200 days of data) [2025-10-10T17:41:59.488130] [DEBUG] [LOCAL ] BME: Primary data saved (11309 records). [2025-10-10T17:41:59.488288] [INFO ] [MAIN ] BME: Full history saved. [2025-10-10T17:41:59.488390] [INFO ] [MAIN ] Update Progress: 306/2373 symbols completed. BME took 22.9s. Estimated remaining: 4h 43m 12s. Rate: 7.3 symbols/min [2025-10-10T17:41:59.500704] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-10T17:41:59.671548] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:41:59.677001] [DEBUG] [LOCAL ] BMN: Loaded 2597 existing records from primary storage. [2025-10-10T17:41:59.677193] [INFO ] [MAIN ] BMN: Loaded 2597 existing records. [2025-10-10T17:41:59.854477] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:41:59.854915] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-10T17:41:59.854972] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-10T17:41:59.855125] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-10T17:41:59.855182] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-10T17:42:00.030477] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T17:42:00.239799] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:42:00.289366] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-10T17:42:01.089407] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-10T17:42:01.261353] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-10T17:42:01.302456] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T17:42:01.889376] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-10T17:42:01.915285] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-10T17:42:02.274966] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-10T17:42:02.689404] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-10T17:42:03.489356] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-10T17:42:04.289409] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-10T17:42:04.429324] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T17:42:04.433519] [INFO ] [REMOTE ] BMA: Full fetch complete (51588 records). [2025-10-10T17:42:04.433628] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-10T17:42:04.871047] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-10T17:42:04.876729] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-10T17:42:04.888466] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-10T17:42:04.891029] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-10T17:42:04.891155] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-10T17:42:04.893465] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-10T17:42:04.899014] [DEBUG] [LOCAL ] BMA: Trimmed 51588 records to 36296 (keeping 200 days of data) [2025-10-10T17:42:05.091499] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-10T17:42:05.123501] [DEBUG] [LOCAL ] BMA: Primary data saved (36296 records). [2025-10-10T17:42:05.123701] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-10T17:42:05.123814] [INFO ] [MAIN ] Update Progress: 307/2373 symbols completed. BMA took 29.1s. Estimated remaining: 4h 42m 46s. Rate: 7.3 symbols/min [2025-10-10T17:42:05.288147] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:42:05.327789] [DEBUG] [LOCAL ] BMO: Loaded 41397 existing records from primary storage. [2025-10-10T17:42:05.328118] [INFO ] [MAIN ] BMO: Loaded 41397 existing records. [2025-10-10T17:42:05.498529] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:42:05.498821] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-10T17:42:05.498872] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-10T17:42:05.499106] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-10T17:42:05.499163] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-10T17:42:05.846915] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:42:05.889341] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-10T17:42:06.563108] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-10T17:42:06.689418] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-10T17:42:07.128843] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T17:42:07.489443] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-10T17:42:07.615025] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T17:42:08.289418] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-10T17:42:09.089406] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-10T17:42:09.264461] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-10T17:42:09.362312] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-10T17:42:09.889389] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-10T17:42:10.437555] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-10T17:42:10.689385] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-10T17:42:11.253243] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-10T17:42:11.255953] [INFO ] [REMOTE ] BMI: Full fetch complete (33127 records). [2025-10-10T17:42:11.256050] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-10T17:42:11.496999] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-10T17:42:11.640679] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-10T17:42:11.640770] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-10T17:42:11.641262] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-10T17:42:11.641301] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-10T17:42:11.642130] [DEBUG] [LOCAL ] BMI: Trimmed 33127 records to 24727 (keeping 200 days of data) [2025-10-10T17:42:11.801122] [DEBUG] [LOCAL ] BMI: Primary data saved (24727 records). [2025-10-10T17:42:11.801275] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-10T17:42:11.801381] [INFO ] [MAIN ] Update Progress: 308/2373 symbols completed. BMI took 34.5s. Estimated remaining: 4h 42m 28s. Rate: 7.3 symbols/min [2025-10-10T17:42:11.972533] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:42:12.022537] [DEBUG] [LOCAL ] BMY: Loaded 54147 existing records from primary storage. [2025-10-10T17:42:12.022940] [INFO ] [MAIN ] BMY: Loaded 54147 existing records. [2025-10-10T17:42:12.220102] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-10T17:42:12.218761] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:42:12.220477] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-10T17:42:12.226527] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-10T17:42:12.227281] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-10T17:42:12.227379] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-10T17:42:12.294562] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-10T17:42:12.611686] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:42:13.089424] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-10T17:42:13.162303] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-10T17:42:13.208123] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T17:42:13.531150] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-10T17:42:13.889399] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-10T17:42:14.533001] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-10T17:42:14.689391] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-10T17:42:15.489424] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-10T17:42:16.289364] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-10T17:42:16.557980] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T17:42:16.883940] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-10T17:42:17.089392] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-10T17:42:17.421289] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-10T17:42:17.831971] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-10T17:42:17.889337] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-10T17:42:18.689394] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-10T17:42:19.262119] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-10T17:42:19.489352] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-10T17:42:19.828400] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T17:42:20.043021] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-10T17:42:20.289446] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-10T17:42:21.089358] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-10T17:42:21.889367] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-10T17:42:22.403716] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T17:42:22.530053] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-10T17:42:22.689375] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-10T17:42:23.070667] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-10T17:42:23.489413] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-10T17:42:24.289366] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-10T17:42:24.396950] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T17:42:25.089381] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-10T17:42:25.673190] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-10T17:42:25.859031] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T17:42:25.889338] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-10T17:42:26.689433] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-10T17:42:26.777623] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T17:42:26.824300] [DEBUG] [REMOTE ] BMN: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-10T17:42:26.824719] [WARN ] [REMOTE ] BMN: No data returned for month 2025-10 [2025-10-10T17:42:26.824833] [FATAL] [REMOTE ] BMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:42:26.824924] [FATAL] [MAIN ] BMN: Failed to fetch primary data. [2025-10-10T17:42:26.824987] [WARN ] [MAIN ] BMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:42:26.825061] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-10T17:42:26.825139] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-10-10T17:42:26.825196] [INFO ] [LOCAL ] BMN: Starting deletion of derivative data. [2025-10-10T17:42:26.825412] [DEBUG] [LOCAL ] BMN: Deleted derivative data file. [2025-10-10T17:42:26.825506] [INFO ] [MAIN ] Update Progress: 309/2373 symbols completed. BMN took 27.3s. Estimated remaining: 4h 43m 5s. Rate: 7.3 symbols/min [2025-10-10T17:42:27.034839] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:42:27.044414] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-10T17:42:27.048682] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40516 records). [2025-10-10T17:42:27.048792] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-10T17:42:27.447034] [DEBUG] [LOCAL ] BN: Loaded 53376 existing records from primary storage. [2025-10-10T17:42:27.454854] [INFO ] [MAIN ] BN: Loaded 53376 existing records. [2025-10-10T17:42:27.494697] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-10T17:42:27.546403] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-10T17:42:27.561156] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-10T17:42:27.582916] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-10T17:42:27.590744] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-10T17:42:27.637992] [DEBUG] [LOCAL ] BMEZ: Trimmed 40516 records to 26860 (keeping 200 days of data) [2025-10-10T17:42:27.676338] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:42:27.735539] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-10T17:42:27.744726] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-10T17:42:27.774694] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-10T17:42:27.775347] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-10T17:42:28.212334] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:42:28.272899] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26860 records). [2025-10-10T17:42:28.273105] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-10T17:42:28.273217] [INFO ] [MAIN ] Update Progress: 310/2373 symbols completed. BMEZ took 51.2s. Estimated remaining: 4h 42m 12s. Rate: 7.3 symbols/min [2025-10-10T17:42:28.295607] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-10T17:42:28.465084] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:42:28.497566] [DEBUG] [LOCAL ] BNED: Loaded 29262 existing records from primary storage. [2025-10-10T17:42:28.497944] [INFO ] [MAIN ] BNED: Loaded 29262 existing records. [2025-10-10T17:42:28.704898] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:42:28.705258] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-10T17:42:28.705311] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-10T17:42:28.706858] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-10T17:42:28.706922] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-10T17:42:29.105782] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-10T17:42:29.105570] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:42:29.201703] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-10T17:42:29.890477] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-10T17:42:29.896104] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T17:42:30.689414] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-10T17:42:31.490107] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-10T17:42:31.507233] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-10T17:42:31.623365] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-10T17:42:31.987729] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-10T17:42:32.289439] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-10T17:42:33.089440] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-10T17:42:33.464984] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T17:42:33.889455] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-10T17:42:34.163793] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T17:42:34.689421] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-10T17:42:34.938085] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T17:42:35.489396] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-10T17:42:35.831764] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T17:42:35.831344] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-10T17:42:35.848070] [INFO ] [REMOTE ] BMO: Full fetch complete (59563 records). [2025-10-10T17:42:35.848202] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-10T17:42:36.267497] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-10T17:42:36.267629] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-10T17:42:36.268494] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-10T17:42:36.268574] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-10T17:42:36.270097] [DEBUG] [LOCAL ] BMO: Trimmed 59563 records to 41706 (keeping 200 days of data) [2025-10-10T17:42:36.329980] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-10T17:42:36.556170] [DEBUG] [LOCAL ] BMO: Primary data saved (41706 records). [2025-10-10T17:42:36.556330] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-10T17:42:36.557432] [INFO ] [MAIN ] Update Progress: 311/2373 symbols completed. BMO took 31.4s. Estimated remaining: 4h 42m 4s. Rate: 7.3 symbols/min [2025-10-10T17:42:36.749931] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:42:36.759209] [DEBUG] [LOCAL ] BNH: Loaded 5264 existing records from primary storage. [2025-10-10T17:42:36.759451] [INFO ] [MAIN ] BNH: Loaded 5264 existing records. [2025-10-10T17:42:36.962949] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:42:36.963304] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-10T17:42:36.963547] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-10T17:42:36.963808] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-10T17:42:36.963904] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-10T17:42:37.097170] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-10T17:42:37.145311] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-10T17:42:37.411279] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:42:37.889364] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-10T17:42:38.444046] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-10T17:42:38.479446] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-10T17:42:38.689419] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-10T17:42:39.308511] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-10T17:42:39.489382] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-10T17:42:40.289362] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-10T17:42:40.428120] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T17:42:41.089388] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-10T17:42:41.618375] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T17:42:41.793693] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-10T17:42:41.889363] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-10T17:42:41.974596] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-10T17:42:42.689424] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-10T17:42:43.385194] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T17:42:43.489366] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-10T17:42:43.786097] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T17:42:44.211214] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-10T17:42:44.289348] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-10T17:42:45.089370] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-10T17:42:45.889355] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-10T17:42:45.959517] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-10T17:42:46.339033] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-10T17:42:46.689372] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-10T17:42:47.402858] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-10T17:42:47.489382] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-10T17:42:48.103983] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T17:42:48.289395] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-10T17:42:48.996926] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-10T17:42:49.089364] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-10T17:42:49.889401] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-10T17:42:50.312885] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-10T17:42:50.386845] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T17:42:50.689378] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-10T17:42:51.489373] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-10T17:42:51.601909] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T17:42:51.607500] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-10-10T17:42:51.607679] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-10T17:42:52.025036] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-10T17:42:52.025159] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-10T17:42:52.026382] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-10T17:42:52.026477] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-10T17:42:52.028577] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 54537 (keeping 200 days of data) [2025-10-10T17:42:52.159665] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-10T17:42:52.298431] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-10T17:42:52.340572] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-10T17:42:52.446993] [DEBUG] [LOCAL ] BMY: Primary data saved (54537 records). [2025-10-10T17:42:52.447229] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-10T17:42:52.447347] [INFO ] [MAIN ] Update Progress: 312/2373 symbols completed. BMY took 40.6s. Estimated remaining: 4h 42m 46s. Rate: 7.3 symbols/min [2025-10-10T17:42:52.620004] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:42:52.625719] [DEBUG] [LOCAL ] BNJ: Loaded 2684 existing records from primary storage. [2025-10-10T17:42:52.625964] [INFO ] [MAIN ] BNJ: Loaded 2684 existing records. [2025-10-10T17:42:52.810988] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:42:52.811232] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-10T17:42:52.811281] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-10T17:42:52.811419] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-10T17:42:52.811458] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-10T17:42:53.095049] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-10T17:42:53.187742] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:42:53.704411] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-10T17:42:53.889395] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-10T17:42:54.174593] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-10T17:42:54.549704] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-10T17:42:54.689362] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-10T17:42:55.169896] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-10T17:42:55.489446] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-10T17:42:56.289405] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-10T17:42:57.089406] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-10T17:42:57.102304] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-10T17:42:57.581951] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-10T17:42:57.764528] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-10T17:42:57.889414] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-10T17:42:58.561754] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T17:42:58.563153] [INFO ] [REMOTE ] BNH: Full fetch complete (6967 records). [2025-10-10T17:42:58.563232] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-10T17:42:58.694486] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-10T17:42:58.947780] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-10T17:42:58.947866] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-10T17:42:58.948121] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-10T17:42:58.948164] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-10T17:42:58.948623] [DEBUG] [LOCAL ] BNH: Trimmed 6967 records to 5306 (keeping 200 days of data) [2025-10-10T17:42:58.982748] [DEBUG] [LOCAL ] BNH: Primary data saved (5306 records). [2025-10-10T17:42:58.982887] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-10T17:42:58.982984] [INFO ] [MAIN ] Update Progress: 313/2373 symbols completed. BNH took 22.4s. Estimated remaining: 4h 42m 27s. Rate: 7.3 symbols/min [2025-10-10T17:42:59.155278] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:42:59.211417] [DEBUG] [LOCAL ] BNL: Loaded 47534 existing records from primary storage. [2025-10-10T17:42:59.211839] [INFO ] [MAIN ] BNL: Loaded 47534 existing records. [2025-10-10T17:42:59.396938] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:42:59.397194] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-10T17:42:59.397262] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-10T17:42:59.397579] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-10T17:42:59.397634] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-10T17:42:59.496731] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-10T17:42:59.766217] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:43:00.289400] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-10T17:43:00.634279] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-10T17:43:00.639744] [INFO ] [REMOTE ] BN: Full fetch complete (76706 records). [2025-10-10T17:43:00.639928] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-10T17:43:00.963170] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-10T17:43:01.070411] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-10T17:43:01.070542] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-10T17:43:01.071517] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-10T17:43:01.071601] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-10T17:43:01.073703] [DEBUG] [LOCAL ] BN: Trimmed 76706 records to 53765 (keeping 200 days of data) [2025-10-10T17:43:01.131520] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-10T17:43:01.324202] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T17:43:01.467531] [DEBUG] [LOCAL ] BN: Primary data saved (53765 records). [2025-10-10T17:43:01.467746] [INFO ] [MAIN ] BN: Full history saved. [2025-10-10T17:43:01.467865] [INFO ] [MAIN ] Update Progress: 314/2373 symbols completed. BN took 34.6s. Estimated remaining: 4h 41m 41s. Rate: 7.3 symbols/min [2025-10-10T17:43:01.641961] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:43:01.693532] [DEBUG] [LOCAL ] BNS: Loaded 51843 existing records from primary storage. [2025-10-10T17:43:01.693961] [INFO ] [MAIN ] BNS: Loaded 51843 existing records. [2025-10-10T17:43:01.807220] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-10T17:43:01.889806] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-10T17:43:01.893541] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:43:01.894948] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-10T17:43:01.895013] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-10T17:43:01.895293] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-10T17:43:01.895353] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-10T17:43:02.260912] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:43:02.689424] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-10T17:43:03.489352] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-10T17:43:03.781402] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T17:43:04.289359] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-10T17:43:04.592462] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-10T17:43:04.739348] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T17:43:04.990813] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-10T17:43:05.089398] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-10T17:43:05.889402] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-10T17:43:06.560976] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-10T17:43:06.689407] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-10T17:43:07.483384] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T17:43:07.492280] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-10T17:43:08.093822] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-10T17:43:08.289376] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-10T17:43:08.983564] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-10T17:43:09.089380] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-10T17:43:09.624147] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-10T17:43:09.889403] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-10T17:43:10.184564] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T17:43:10.449177] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-10T17:43:10.689393] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-10T17:43:11.489412] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-10T17:43:12.289421] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-10T17:43:12.329035] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T17:43:12.811306] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-10T17:43:12.893700] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-10T17:43:13.089361] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-10T17:43:13.889460] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-10T17:43:14.408737] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-10T17:43:14.522837] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T17:43:14.525418] [INFO ] [REMOTE ] BNED: Full fetch complete (42961 records). [2025-10-10T17:43:14.525520] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-10T17:43:14.696220] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-10T17:43:14.905958] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-10T17:43:14.906068] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-10T17:43:14.906825] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-10T17:43:14.906891] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-10T17:43:14.907871] [DEBUG] [LOCAL ] BNED: Trimmed 42961 records to 29437 (keeping 200 days of data) [2025-10-10T17:43:15.077139] [DEBUG] [LOCAL ] BNED: Primary data saved (29437 records). [2025-10-10T17:43:15.077286] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-10T17:43:15.077372] [INFO ] [MAIN ] Update Progress: 315/2373 symbols completed. BNED took 46.8s. Estimated remaining: 4h 42m 8s. Rate: 7.3 symbols/min [2025-10-10T17:43:15.244110] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:43:15.249755] [DEBUG] [LOCAL ] BNT: Loaded 3368 existing records from primary storage. [2025-10-10T17:43:15.249922] [INFO ] [MAIN ] BNT: Loaded 3368 existing records. [2025-10-10T17:43:15.353832] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-10T17:43:15.433734] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:43:15.433997] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-10T17:43:15.434049] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-10T17:43:15.434206] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-10T17:43:15.434246] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-10T17:43:15.495808] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-10T17:43:15.803309] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:43:16.289375] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-10T17:43:16.751141] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T17:43:17.089412] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-10T17:43:17.889421] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-10T17:43:18.276348] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T17:43:18.383812] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T17:43:18.537098] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-10T17:43:18.689414] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-10T17:43:19.227256] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-10T17:43:19.489437] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-10T17:43:19.827336] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-10T17:43:20.289417] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-10T17:43:21.026744] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-10T17:43:21.089397] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-10T17:43:21.813792] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-10T17:43:21.889400] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-10T17:43:22.610781] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-10T17:43:22.689411] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-10T17:43:23.489384] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-10T17:43:24.062538] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-10T17:43:24.063694] [INFO ] [REMOTE ] BNJ: Full fetch complete (4204 records). [2025-10-10T17:43:24.063788] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-10T17:43:24.295365] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-10T17:43:24.468182] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-10T17:43:24.468290] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-10T17:43:24.468689] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-10T17:43:24.468789] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-10T17:43:24.469511] [DEBUG] [LOCAL ] BNJ: Trimmed 4204 records to 2710 (keeping 200 days of data) [2025-10-10T17:43:24.516684] [DEBUG] [LOCAL ] BNJ: Primary data saved (2710 records). [2025-10-10T17:43:24.520121] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T17:43:24.520442] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-10T17:43:24.531128] [INFO ] [MAIN ] Update Progress: 316/2373 symbols completed. BNJ took 32.1s. Estimated remaining: 4h 42m 8s. Rate: 7.3 symbols/min [2025-10-10T17:43:24.712069] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:43:24.712291] [DEBUG] [LOCAL ] BNY: No existing data file found in primary storage. [2025-10-10T17:43:24.712329] [WARN ] [MAIN ] BNY: No existing data found, performing full refresh instead. [2025-10-10T17:43:24.712444] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-10T17:43:24.712485] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-10T17:43:24.712526] [DEBUG] [LOCAL ] BNY: No primary data file found to delete. [2025-10-10T17:43:24.712559] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-10T17:43:25.077085] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:43:25.089350] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-10T17:43:25.889472] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-10T17:43:26.112976] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T17:43:26.206683] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-10T17:43:26.689426] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-10T17:43:27.130791] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-10T17:43:27.489383] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-10T17:43:27.858260] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T17:43:27.951578] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-10T17:43:28.289405] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-10T17:43:28.716515] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-10T17:43:29.089396] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-10T17:43:29.755290] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-10T17:43:29.889441] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-10T17:43:30.637380] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-10T17:43:30.689402] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-10T17:43:31.207789] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-10T17:43:31.489391] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-10T17:43:32.289393] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-10T17:43:32.348540] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-10T17:43:32.809717] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-10T17:43:33.089440] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-10T17:43:33.889402] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-10T17:43:33.933178] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-10T17:43:34.689412] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-10T17:43:35.385168] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-10T17:43:35.437123] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-10T17:43:35.489333] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-10T17:43:36.289414] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-10T17:43:36.797443] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-10T17:43:37.089366] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-10T17:43:37.264046] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-10T17:43:37.889393] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-10T17:43:38.509999] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-10T17:43:38.674989] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-10T17:43:38.689358] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-10T17:43:39.489381] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-10T17:43:39.569389] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-10T17:43:40.289391] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-10T17:43:40.731533] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-10T17:43:41.089456] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-10T17:43:41.252209] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T17:43:41.735768] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-10T17:43:41.736945] [INFO ] [REMOTE ] BNT: Full fetch complete (4572 records). [2025-10-10T17:43:41.737024] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-10T17:43:41.896501] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-10T17:43:42.113743] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-10T17:43:42.113842] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-10T17:43:42.114072] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-10T17:43:42.114117] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-10T17:43:42.114500] [DEBUG] [LOCAL ] BNT: Trimmed 4572 records to 3433 (keeping 200 days of data) [2025-10-10T17:43:42.136459] [DEBUG] [LOCAL ] BNT: Primary data saved (3433 records). [2025-10-10T17:43:42.136569] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-10T17:43:42.136686] [INFO ] [MAIN ] Update Progress: 317/2373 symbols completed. BNT took 27.1s. Estimated remaining: 4h 43m 1s. Rate: 7.3 symbols/min [2025-10-10T17:43:42.689413] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-10T17:43:43.489495] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-10T17:43:43.831974] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-10T17:43:43.968523] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T17:43:43.973376] [INFO ] [REMOTE ] BNS: Full fetch complete (74367 records). [2025-10-10T17:43:43.973471] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-10T17:43:44.302225] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-10T17:43:44.362082] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-10T17:43:44.366801] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-10T17:43:44.367846] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-10T17:43:44.367935] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-10T17:43:44.369310] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T17:43:44.372339] [INFO ] [REMOTE ] BNY: Full fetch complete (10428 records). [2025-10-10T17:43:44.372769] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-10T17:43:44.378741] [DEBUG] [LOCAL ] BNS: Trimmed 74367 records to 52233 (keeping 200 days of data) [2025-10-10T17:43:44.858459] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-10T17:43:44.859086] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-10T17:43:44.860149] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-10T17:43:44.860227] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-10T17:43:44.862027] [DEBUG] [LOCAL ] BNY: Trimmed 10428 records to 7231 (keeping 200 days of data) [2025-10-10T17:43:44.924430] [DEBUG] [LOCAL ] BNY: Primary data saved (7231 records). [2025-10-10T17:43:44.924631] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-10T17:43:44.924776] [INFO ] [MAIN ] Update Progress: 318/2373 symbols completed. BNY took 20.4s. Estimated remaining: 4h 42m 17s. Rate: 7.3 symbols/min [2025-10-10T17:43:45.120022] [DEBUG] [LOCAL ] BNS: Primary data saved (52233 records). [2025-10-10T17:43:45.120183] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-10T17:43:45.120271] [INFO ] [MAIN ] Update Progress: 319/2373 symbols completed. BNS took 43.7s. Estimated remaining: 4h 41m 17s. Rate: 7.3 symbols/min [2025-10-10T17:43:46.201032] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T17:43:46.212578] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-10T17:43:48.137510] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T17:43:48.148452] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-10T17:43:49.422136] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-10T17:43:49.427404] [INFO ] [REMOTE ] BNL: Full fetch complete (67064 records). [2025-10-10T17:43:49.427596] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-10T17:43:49.843180] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-10T17:43:49.843312] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-10T17:43:49.844224] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-10T17:43:49.844328] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-10T17:43:49.846313] [DEBUG] [LOCAL ] BNL: Trimmed 67064 records to 47890 (keeping 200 days of data) [2025-10-10T17:43:50.157661] [DEBUG] [LOCAL ] BNL: Primary data saved (47890 records). [2025-10-10T17:43:50.157845] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-10T17:43:50.158027] [INFO ] [MAIN ] Update Progress: 320/2373 symbols completed. BNL took 51.2s. Estimated remaining: 4h 40m 48s. Rate: 7.3 symbols/min [2025-10-10T17:43:50.804450] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:43:50.840512] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:43:50.892844] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:43:50.948422] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:43:50.983383] [DEBUG] [LOCAL ] BOE: Loaded 18227 existing records from primary storage. [2025-10-10T17:43:51.004822] [DEBUG] [LOCAL ] BOC: Loaded 18567 existing records from primary storage. [2025-10-10T17:43:51.006706] [INFO ] [MAIN ] BOE: Loaded 18227 existing records. [2025-10-10T17:43:51.007387] [DEBUG] [LOCAL ] BOH: Loaded 30612 existing records from primary storage. [2025-10-10T17:43:51.035058] [INFO ] [MAIN ] BOC: Loaded 18567 existing records. [2025-10-10T17:43:51.073723] [INFO ] [MAIN ] BOH: Loaded 30612 existing records. [2025-10-10T17:43:51.202192] [DEBUG] [LOCAL ] BOND: Loaded 32491 existing records from primary storage. [2025-10-10T17:43:51.270418] [INFO ] [MAIN ] BOND: Loaded 32491 existing records. [2025-10-10T17:43:51.691293] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:43:51.719206] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-10T17:43:51.731341] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-10T17:43:51.681638] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:43:51.757638] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:43:51.759198] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-10T17:43:51.759320] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-10T17:43:51.759752] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-10T17:43:51.759595] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-10T17:43:51.781202] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-10T17:43:51.781481] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-10T17:43:51.781686] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-10T17:43:51.781892] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-10T17:43:51.880341] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-10T17:43:51.934048] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-10T17:43:51.995343] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:43:52.112725] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-10T17:43:52.163881] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-10T17:43:52.213679] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-10T17:43:52.228959] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-10T17:43:53.286563] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:43:53.290783] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:43:53.301993] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-10T17:43:53.330944] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-10T17:43:53.479108] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:43:53.507955] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-10T17:43:53.545914] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:43:53.546274] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-10T17:43:54.441359] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-10T17:43:54.448209] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-10T17:43:54.719670] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T17:43:54.724051] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-10T17:43:54.784437] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T17:43:54.789905] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-10T17:43:54.906259] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T17:43:54.913511] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-10T17:43:55.900375] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-10T17:43:55.908904] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-10T17:43:55.922537] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-10T17:43:55.927399] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-10T17:43:55.994819] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-10T17:43:56.002328] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-10T17:43:56.031933] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T17:43:56.036845] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-10T17:43:56.653511] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-10T17:43:56.658016] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-10T17:43:56.792706] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-10T17:43:56.794981] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-10T17:43:56.881363] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-10T17:43:57.089416] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-10T17:43:57.804749] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T17:43:57.889403] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-10T17:43:58.586397] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T17:43:58.689399] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-10T17:43:58.715825] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-10T17:43:59.489418] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-10T17:43:59.827577] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-10T17:44:00.289424] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-10T17:44:00.896735] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-10T17:44:01.089453] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-10T17:44:01.886314] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-10T17:44:01.892056] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-10T17:44:02.011947] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T17:44:02.689413] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-10T17:44:03.027369] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T17:44:03.489397] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-10T17:44:04.254500] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T17:44:04.275726] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-10T17:44:04.289347] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-10T17:44:05.089408] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-10T17:44:05.550047] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-10T17:44:05.889390] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-10T17:44:06.689362] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-10T17:44:06.777449] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-10T17:44:07.120397] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-10T17:44:07.342226] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-10T17:44:07.489334] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-10T17:44:08.289388] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-10T17:44:08.803406] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T17:44:09.089374] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-10T17:44:09.425993] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T17:44:09.889452] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-10T17:44:10.570871] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-10T17:44:10.632680] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-10T17:44:10.689391] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-10T17:44:11.489429] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-10T17:44:11.980622] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-10T17:44:12.209225] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-10T17:44:12.289340] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-10T17:44:13.089346] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-10T17:44:13.147516] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-10T17:44:13.889439] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-10T17:44:14.159291] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-10T17:44:14.689368] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-10T17:44:14.750285] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-10T17:44:15.489416] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-10T17:44:15.720777] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-10T17:44:16.230415] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-10T17:44:16.289365] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-10T17:44:17.089390] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-10T17:44:17.617723] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T17:44:17.620568] [INFO ] [REMOTE ] BOE: Full fetch complete (26783 records). [2025-10-10T17:44:17.620679] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-10T17:44:17.899190] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-10T17:44:18.061317] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-10T17:44:18.061421] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-10T17:44:18.062080] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-10T17:44:18.062151] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-10T17:44:18.063410] [DEBUG] [LOCAL ] BOE: Trimmed 26783 records to 18415 (keeping 200 days of data) [2025-10-10T17:44:18.235954] [DEBUG] [LOCAL ] BOE: Primary data saved (18415 records). [2025-10-10T17:44:18.236190] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-10T17:44:18.236318] [INFO ] [MAIN ] Update Progress: 321/2373 symbols completed. BOE took 28.1s. Estimated remaining: 4h 42m 47s. Rate: 7.3 symbols/min [2025-10-10T17:44:18.480275] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-10T17:44:18.572229] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:44:18.621904] [DEBUG] [LOCAL ] BOOT: Loaded 40347 existing records from primary storage. [2025-10-10T17:44:18.622416] [INFO ] [MAIN ] BOOT: Loaded 40347 existing records. [2025-10-10T17:44:18.700027] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-10T17:44:18.852301] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:44:18.852605] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-10T17:44:18.852696] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-10T17:44:18.853710] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-10T17:44:18.853770] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-10T17:44:19.258945] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:44:19.489436] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-10T17:44:19.628944] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T17:44:19.994900] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T17:44:20.289406] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-10T17:44:21.089409] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-10T17:44:21.234803] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T17:44:21.238353] [INFO ] [REMOTE ] BOH: Full fetch complete (44816 records). [2025-10-10T17:44:21.238470] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-10T17:44:21.550174] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-10T17:44:21.673250] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-10T17:44:21.673336] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-10T17:44:21.674092] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-10T17:44:21.674161] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-10T17:44:21.675321] [DEBUG] [LOCAL ] BOH: Trimmed 44816 records to 30903 (keeping 200 days of data) [2025-10-10T17:44:21.862937] [DEBUG] [LOCAL ] BOH: Primary data saved (30903 records). [2025-10-10T17:44:21.863099] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-10T17:44:21.863186] [INFO ] [MAIN ] Update Progress: 322/2373 symbols completed. BOH took 31.7s. Estimated remaining: 4h 42m 9s. Rate: 7.3 symbols/min [2025-10-10T17:44:21.894526] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-10T17:44:22.033704] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:44:22.081347] [DEBUG] [LOCAL ] BORR: Loaded 51475 existing records from primary storage. [2025-10-10T17:44:22.081702] [INFO ] [MAIN ] BORR: Loaded 51475 existing records. [2025-10-10T17:44:22.261976] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:44:22.262263] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-10T17:44:22.262310] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-10T17:44:22.262548] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-10T17:44:22.262604] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-10T17:44:22.518534] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T17:44:22.560398] [INFO ] [REMOTE ] BOC: Full fetch complete (25803 records). [2025-10-10T17:44:22.566486] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-10T17:44:22.693898] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:44:22.699199] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-10T17:44:23.044676] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-10T17:44:23.044775] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-10T17:44:23.045347] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-10T17:44:23.045388] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-10T17:44:23.046860] [DEBUG] [LOCAL ] BOC: Trimmed 25803 records to 18790 (keeping 200 days of data) [2025-10-10T17:44:23.160871] [DEBUG] [LOCAL ] BOC: Primary data saved (18790 records). [2025-10-10T17:44:23.161066] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-10T17:44:23.161180] [INFO ] [MAIN ] Update Progress: 323/2373 symbols completed. BOC took 33.0s. Estimated remaining: 4h 41m 17s. Rate: 7.3 symbols/min [2025-10-10T17:44:23.353193] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:44:23.380834] [DEBUG] [LOCAL ] BOW: Loaded 23981 existing records from primary storage. [2025-10-10T17:44:23.381347] [INFO ] [MAIN ] BOW: Loaded 23981 existing records. [2025-10-10T17:44:23.490817] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-10T17:44:23.582056] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:44:23.582413] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-10T17:44:23.582465] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-10T17:44:23.582710] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-10T17:44:23.582769] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-10T17:44:23.932702] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T17:44:23.993850] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:44:24.236818] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-10T17:44:24.240943] [INFO ] [REMOTE ] BOND: Full fetch complete (46463 records). [2025-10-10T17:44:24.241069] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-10T17:44:24.301555] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-10T17:44:24.655815] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-10T17:44:24.655956] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-10T17:44:24.656852] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-10T17:44:24.656921] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-10T17:44:24.658430] [DEBUG] [LOCAL ] BOND: Trimmed 46463 records to 32729 (keeping 200 days of data) [2025-10-10T17:44:24.871018] [DEBUG] [LOCAL ] BOND: Primary data saved (32729 records). [2025-10-10T17:44:24.871286] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-10T17:44:24.871417] [INFO ] [MAIN ] Update Progress: 324/2373 symbols completed. BOND took 34.7s. Estimated remaining: 4h 40m 27s. Rate: 7.3 symbols/min [2025-10-10T17:44:25.061181] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:44:25.094224] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-10T17:44:25.117436] [DEBUG] [LOCAL ] BOX: Loaded 50568 existing records from primary storage. [2025-10-10T17:44:25.117925] [INFO ] [MAIN ] BOX: Loaded 50568 existing records. [2025-10-10T17:44:25.308140] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:44:25.308592] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-10T17:44:25.308694] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-10T17:44:25.309178] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-10T17:44:25.309246] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-10T17:44:25.687811] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-10T17:44:25.737168] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:44:25.754894] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-10T17:44:25.889389] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-10T17:44:26.404715] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T17:44:26.689365] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-10T17:44:27.489441] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-10T17:44:27.966906] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-10T17:44:28.098924] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-10T17:44:28.289370] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-10T17:44:29.089363] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-10T17:44:29.433401] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T17:44:29.591052] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T17:44:29.889373] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-10T17:44:30.472011] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T17:44:30.689477] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-10T17:44:31.489356] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-10T17:44:31.651159] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-10T17:44:31.807584] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-10T17:44:32.289449] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-10T17:44:33.089413] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-10T17:44:33.242763] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-10T17:44:33.580300] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T17:44:33.889403] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-10T17:44:34.689351] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-10T17:44:35.107170] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-10T17:44:35.489352] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-10T17:44:35.571085] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-10T17:44:36.289360] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-10T17:44:36.957547] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-10T17:44:37.089347] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-10T17:44:37.187992] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-10T17:44:37.735579] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-10T17:44:37.889334] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-10T17:44:38.689429] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-10T17:44:38.757605] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-10T17:44:39.489412] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-10T17:44:39.842295] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T17:44:39.881015] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T17:44:40.289393] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-10T17:44:41.089459] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-10T17:44:41.311022] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T17:44:41.860000] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T17:44:41.889333] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-10T17:44:42.214100] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-10T17:44:42.689400] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-10T17:44:43.311027] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-10T17:44:43.489385] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-10T17:44:44.289368] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-10T17:44:44.716154] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-10T17:44:44.857388] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T17:44:45.089353] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-10T17:44:45.619110] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-10T17:44:45.889396] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-10T17:44:46.689457] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-10T17:44:47.153246] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-10T17:44:47.489386] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-10T17:44:47.941886] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T17:44:47.967494] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T17:44:48.289411] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-10T17:44:48.469536] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T17:44:48.473193] [INFO ] [REMOTE ] BOOT: Full fetch complete (60000 records). [2025-10-10T17:44:48.473301] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-10T17:44:48.861932] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-10T17:44:48.862292] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-10T17:44:48.863094] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-10T17:44:48.863159] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-10T17:44:48.864633] [DEBUG] [LOCAL ] BOOT: Trimmed 60000 records to 40592 (keeping 200 days of data) [2025-10-10T17:44:49.090396] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-10T17:44:49.108561] [DEBUG] [LOCAL ] BOOT: Primary data saved (40592 records). [2025-10-10T17:44:49.108760] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-10T17:44:49.108871] [INFO ] [MAIN ] Update Progress: 325/2373 symbols completed. BOOT took 30.9s. Estimated remaining: 4h 42m 0s. Rate: 7.3 symbols/min [2025-10-10T17:44:49.285111] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:44:49.337514] [DEBUG] [LOCAL ] BP: Loaded 54099 existing records from primary storage. [2025-10-10T17:44:49.337910] [INFO ] [MAIN ] BP: Loaded 54099 existing records. [2025-10-10T17:44:49.526745] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:44:49.527112] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-10T17:44:49.527179] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-10T17:44:49.528040] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-10T17:44:49.528101] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-10T17:44:49.893659] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-10T17:44:49.903203] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-10T17:44:49.938406] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:44:49.982633] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T17:44:50.689391] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-10T17:44:51.489412] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-10T17:44:51.999018] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-10T17:44:52.289391] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-10T17:44:52.908670] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-10T17:44:53.047560] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-10T17:44:53.089366] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-10T17:44:53.606802] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T17:44:53.889394] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-10T17:44:54.689380] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-10T17:44:54.903027] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T17:44:55.289548] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-10T17:44:55.390263] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-10T17:44:55.489393] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-10T17:44:56.289392] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-10T17:44:57.089398] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-10T17:44:57.530356] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-10T17:44:57.535561] [INFO ] [REMOTE ] BORR: Full fetch complete (74555 records). [2025-10-10T17:44:57.535718] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-10T17:44:57.709183] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-10T17:44:57.746944] [INFO ] [REMOTE ] BOW: Full fetch complete (32036 records). [2025-10-10T17:44:57.790839] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-10T17:44:57.902755] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-10T17:44:58.213608] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-10T17:44:58.228182] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-10T17:44:58.252109] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-10T17:44:58.269483] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-10T17:44:58.345921] [DEBUG] [LOCAL ] BORR: Trimmed 74555 records to 51843 (keeping 200 days of data) [2025-10-10T17:44:58.529043] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-10T17:44:58.535965] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-10T17:44:58.541050] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-10T17:44:58.554251] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-10T17:44:58.564223] [DEBUG] [LOCAL ] BOW: Trimmed 32036 records to 24153 (keeping 200 days of data) [2025-10-10T17:44:58.875702] [DEBUG] [LOCAL ] BOW: Primary data saved (24153 records). [2025-10-10T17:44:58.885684] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-10T17:44:58.896416] [INFO ] [MAIN ] Update Progress: 326/2373 symbols completed. BOW took 35.7s. Estimated remaining: 4h 42m 1s. Rate: 7.3 symbols/min [2025-10-10T17:44:58.919392] [DEBUG] [LOCAL ] BORR: Primary data saved (51843 records). [2025-10-10T17:44:58.958720] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-10T17:44:58.982055] [INFO ] [MAIN ] Update Progress: 327/2373 symbols completed. BORR took 37.1s. Estimated remaining: 4h 41m 2s. Rate: 7.3 symbols/min [2025-10-10T17:44:59.179174] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:44:59.204617] [DEBUG] [LOCAL ] BR: No existing data file found in primary storage. [2025-10-10T17:44:59.205025] [WARN ] [MAIN ] BR: No existing data found, performing full refresh instead. [2025-10-10T17:44:59.205542] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-10T17:44:59.210896] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-10T17:44:59.232277] [DEBUG] [LOCAL ] BR: No primary data file found to delete. [2025-10-10T17:44:59.237532] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-10T17:44:59.353236] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-10T17:44:59.349709] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:44:59.423671] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-10T17:44:59.736462] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:44:59.750875] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-10T17:44:59.754078] [DEBUG] [LOCAL ] BRBR: Loaded 51836 existing records from primary storage. [2025-10-10T17:44:59.754550] [INFO ] [MAIN ] BRBR: Loaded 51836 existing records. [2025-10-10T17:44:59.947054] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:44:59.947428] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-10T17:44:59.947495] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-10T17:44:59.947827] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-10T17:44:59.947885] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-10T17:45:00.337722] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:45:00.338259] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-10T17:45:00.369043] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-10T17:45:01.089477] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-10T17:45:01.594203] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T17:45:01.620064] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-10T17:45:01.626064] [INFO ] [REMOTE ] BOX: Full fetch complete (72084 records). [2025-10-10T17:45:01.626434] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-10T17:45:01.896613] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-10T17:45:02.094517] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-10T17:45:02.094805] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-10T17:45:02.095961] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-10T17:45:02.096130] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-10T17:45:02.098328] [DEBUG] [LOCAL ] BOX: Trimmed 72084 records to 50941 (keeping 200 days of data) [2025-10-10T17:45:02.239332] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T17:45:02.470832] [DEBUG] [LOCAL ] BOX: Primary data saved (50941 records). [2025-10-10T17:45:02.471025] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-10T17:45:02.471130] [INFO ] [MAIN ] Update Progress: 328/2373 symbols completed. BOX took 37.6s. Estimated remaining: 4h 40m 24s. Rate: 7.3 symbols/min [2025-10-10T17:45:02.648822] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:45:02.649067] [DEBUG] [LOCAL ] BRC: No existing data file found in primary storage. [2025-10-10T17:45:02.649118] [WARN ] [MAIN ] BRC: No existing data found, performing full refresh instead. [2025-10-10T17:45:02.649243] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-10T17:45:02.649292] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-10T17:45:02.649336] [DEBUG] [LOCAL ] BRC: No primary data file found to delete. [2025-10-10T17:45:02.649370] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-10T17:45:02.715052] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-10T17:45:03.051610] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:45:03.462129] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-10T17:45:03.489347] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-10T17:45:03.678134] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-10T17:45:04.250324] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-10T17:45:04.289362] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-10T17:45:04.956688] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-10T17:45:05.089415] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-10T17:45:05.889453] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-10T17:45:06.064713] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T17:45:06.697923] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-10T17:45:06.703444] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T17:45:07.080409] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-10T17:45:07.489403] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-10T17:45:08.289429] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-10T17:45:08.534553] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T17:45:08.790327] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T17:45:09.089428] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-10T17:45:09.583023] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T17:45:09.889408] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-10T17:45:10.689427] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-10T17:45:11.057849] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T17:45:11.137627] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T17:45:11.489460] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-10T17:45:12.089242] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-10T17:45:12.289413] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-10T17:45:13.089369] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-10T17:45:13.520621] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T17:45:13.609009] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T17:45:13.889445] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-10T17:45:14.689438] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-10T17:45:15.407301] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-10T17:45:15.494478] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-10T17:45:15.522123] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-10T17:45:16.289358] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-10T17:45:16.742330] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T17:45:17.089372] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-10T17:45:17.304960] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T17:45:17.384459] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-10T17:45:17.889384] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-10T17:45:18.689429] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-10T17:45:18.950768] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-10T17:45:19.029739] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T17:45:19.489401] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-10T17:45:20.289492] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-10T17:45:21.035797] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-10T17:45:21.089374] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-10T17:45:21.112713] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T17:45:21.889394] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-10T17:45:22.100367] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T17:45:22.689440] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-10T17:45:23.168697] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T17:45:23.489392] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-10T17:45:23.615412] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-10T17:45:24.289407] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-10T17:45:24.709544] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T17:45:24.843166] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-10T17:45:25.089444] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-10T17:45:25.544873] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T17:45:25.777393] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-10T17:45:25.889373] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-10T17:45:26.689408] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-10T17:45:27.489392] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-10T17:45:27.771539] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T17:45:27.816388] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-10T17:45:27.820198] [INFO ] [REMOTE ] BR: Full fetch complete (49541 records). [2025-10-10T17:45:27.820304] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-10T17:45:28.223757] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-10T17:45:28.223898] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-10T17:45:28.224680] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-10T17:45:28.224743] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-10T17:45:28.226034] [DEBUG] [LOCAL ] BR: Trimmed 49541 records to 35349 (keeping 200 days of data) [2025-10-10T17:45:28.314129] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-10T17:45:28.444605] [DEBUG] [LOCAL ] BR: Primary data saved (35349 records). [2025-10-10T17:45:28.444780] [INFO ] [MAIN ] BR: Full history saved. [2025-10-10T17:45:28.444859] [INFO ] [MAIN ] Update Progress: 329/2373 symbols completed. BR took 29.5s. Estimated remaining: 4h 42m 6s. Rate: 7.2 symbols/min [2025-10-10T17:45:28.617080] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:45:28.617295] [DEBUG] [LOCAL ] BRCC: No existing data file found in primary storage. [2025-10-10T17:45:28.617331] [WARN ] [MAIN ] BRCC: No existing data found, performing full refresh instead. [2025-10-10T17:45:28.617459] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-10T17:45:28.617512] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-10T17:45:28.617555] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-10-10T17:45:28.617588] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-10T17:45:29.007569] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:45:29.089338] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-10T17:45:29.140302] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-10T17:45:29.889437] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-10T17:45:30.042708] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-10T17:45:30.689369] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-10T17:45:30.854607] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T17:45:31.032020] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T17:45:31.034251] [INFO ] [REMOTE ] BRC: Full fetch complete (28467 records). [2025-10-10T17:45:31.034321] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-10T17:45:31.390959] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-10T17:45:31.391044] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-10T17:45:31.391495] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-10T17:45:31.391534] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-10T17:45:31.392250] [DEBUG] [LOCAL ] BRC: Trimmed 28467 records to 19046 (keeping 200 days of data) [2025-10-10T17:45:31.494792] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-10T17:45:31.506227] [DEBUG] [LOCAL ] BRC: Primary data saved (19046 records). [2025-10-10T17:45:31.506452] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-10T17:45:31.506535] [INFO ] [MAIN ] Update Progress: 330/2373 symbols completed. BRC took 29.0s. Estimated remaining: 4h 41m 26s. Rate: 7.3 symbols/min [2025-10-10T17:45:31.675904] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:45:31.676132] [DEBUG] [LOCAL ] BRO: No existing data file found in primary storage. [2025-10-10T17:45:31.676170] [WARN ] [MAIN ] BRO: No existing data found, performing full refresh instead. [2025-10-10T17:45:31.676280] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-10T17:45:31.676321] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-10T17:45:31.676391] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-10T17:45:31.676436] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-10T17:45:32.019894] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:45:32.289364] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-10T17:45:32.982704] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-10T17:45:33.089486] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-10T17:45:33.440357] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-10T17:45:33.446080] [INFO ] [REMOTE ] BRBR: Full fetch complete (72386 records). [2025-10-10T17:45:33.446289] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-10T17:45:33.859369] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-10T17:45:33.859509] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-10T17:45:33.860482] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-10T17:45:33.860568] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-10T17:45:33.873237] [DEBUG] [LOCAL ] BRBR: Trimmed 72386 records to 52223 (keeping 200 days of data) [2025-10-10T17:45:33.889714] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-10T17:45:33.894170] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T17:45:34.243917] [DEBUG] [LOCAL ] BRBR: Primary data saved (52223 records). [2025-10-10T17:45:34.244130] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-10T17:45:34.244252] [INFO ] [MAIN ] Update Progress: 331/2373 symbols completed. BRBR took 35.3s. Estimated remaining: 4h 40m 43s. Rate: 7.3 symbols/min [2025-10-10T17:45:34.430129] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:45:34.485423] [DEBUG] [LOCAL ] BROS: Loaded 53689 existing records from primary storage. [2025-10-10T17:45:34.485862] [INFO ] [MAIN ] BROS: Loaded 53689 existing records. [2025-10-10T17:45:34.675281] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:45:34.675555] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-10T17:45:34.675606] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-10T17:45:34.675907] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-10T17:45:34.675964] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-10T17:45:34.708497] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-10T17:45:35.074868] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:45:35.089227] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-10T17:45:35.094498] [INFO ] [REMOTE ] BP: Full fetch complete (77761 records). [2025-10-10T17:45:35.094724] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-10T17:45:35.492988] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-10T17:45:35.493213] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-10T17:45:35.493471] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-10T17:45:35.494793] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-10T17:45:35.496154] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-10T17:45:35.498566] [DEBUG] [LOCAL ] BP: Trimmed 77761 records to 54489 (keeping 200 days of data) [2025-10-10T17:45:35.623278] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T17:45:35.862492] [DEBUG] [LOCAL ] BP: Primary data saved (54489 records). [2025-10-10T17:45:35.862671] [INFO ] [MAIN ] BP: Full history saved. [2025-10-10T17:45:35.863489] [INFO ] [MAIN ] Update Progress: 332/2373 symbols completed. BP took 46.8s. Estimated remaining: 4h 39m 54s. Rate: 7.3 symbols/min [2025-10-10T17:45:36.035010] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:45:36.035229] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-10T17:45:36.035284] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-10T17:45:36.035424] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-10T17:45:36.035501] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-10T17:45:36.035573] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-10T17:45:36.035610] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-10T17:45:36.297186] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-10T17:45:36.393722] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:45:36.738771] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T17:45:37.089371] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-10T17:45:37.423088] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-10T17:45:37.776828] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-10T17:45:37.889367] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-10T17:45:38.613773] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-10T17:45:38.689419] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-10T17:45:38.931864] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:45:38.932250] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-10T17:45:38.932359] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:45:38.932405] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-10T17:45:38.932441] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:45:38.932481] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-10T17:45:38.932540] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-10T17:45:38.932575] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-10T17:45:38.932615] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-10T17:45:38.932698] [INFO ] [MAIN ] Update Progress: 333/2373 symbols completed. BRSL took 3.1s. Estimated remaining: 4h 39m 14s. Rate: 7.3 symbols/min [2025-10-10T17:45:39.096803] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:45:39.134607] [DEBUG] [LOCAL ] BRSP: Loaded 36934 existing records from primary storage. [2025-10-10T17:45:39.134953] [INFO ] [MAIN ] BRSP: Loaded 36934 existing records. [2025-10-10T17:45:39.308725] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:45:39.309000] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-10T17:45:39.309073] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-10T17:45:39.309369] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-10T17:45:39.309427] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-10T17:45:39.494559] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-10T17:45:39.663569] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:45:40.062238] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-10T17:45:40.289404] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-10T17:45:41.089384] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-10T17:45:41.619876] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-10T17:45:41.657400] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-10T17:45:41.889395] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-10T17:45:42.689435] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-10T17:45:43.166199] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-10T17:45:43.489360] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-10T17:45:43.964074] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T17:45:44.289385] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-10T17:45:44.370828] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-10T17:45:45.089385] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-10T17:45:45.650599] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-10T17:45:45.777378] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-10T17:45:45.889346] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-10T17:45:46.211240] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-10T17:45:46.689352] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-10T17:45:47.489387] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-10T17:45:48.181773] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-10T17:45:48.289389] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-10T17:45:48.366245] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-10T17:45:49.089341] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-10T17:45:49.124416] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-10T17:45:49.889375] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-10T17:45:50.182747] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T17:45:50.689405] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-10T17:45:51.368599] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-10T17:45:51.425365] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-10T17:45:51.489328] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-10T17:45:51.653876] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-10T17:45:52.289330] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-10T17:45:53.089400] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-10T17:45:53.613205] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-10T17:45:53.703401] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-10T17:45:53.889383] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-10T17:45:54.689418] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-10T17:45:55.244340] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T17:45:55.489342] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-10T17:45:55.525492] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-10T17:45:56.073087] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-10T17:45:56.289407] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-10T17:45:57.089459] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-10T17:45:57.629634] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-10T17:45:57.889450] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-10T17:45:57.942773] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-10T17:45:58.689367] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-10T17:45:58.870362] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T17:45:59.489366] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-10T17:45:59.748239] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T17:46:00.251167] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-10T17:46:00.254771] [INFO ] [REMOTE ] BRCC: Full fetch complete (57384 records). [2025-10-10T17:46:00.254890] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-10T17:46:00.297028] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-10T17:46:00.629578] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-10T17:46:00.629696] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-10T17:46:00.631032] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-10T17:46:00.631095] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-10T17:46:00.632209] [DEBUG] [LOCAL ] BRCC: Trimmed 57384 records to 40648 (keeping 200 days of data) [2025-10-10T17:46:00.856951] [DEBUG] [LOCAL ] BRCC: Primary data saved (40648 records). [2025-10-10T17:46:00.857099] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-10T17:46:00.857173] [INFO ] [MAIN ] Update Progress: 334/2373 symbols completed. BRCC took 32.4s. Estimated remaining: 4h 40m 30s. Rate: 7.3 symbols/min [2025-10-10T17:46:01.033263] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:46:01.041131] [DEBUG] [LOCAL ] BRT: Loaded 5083 existing records from primary storage. [2025-10-10T17:46:01.041334] [INFO ] [MAIN ] BRT: Loaded 5083 existing records. [2025-10-10T17:46:01.107860] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-10T17:46:01.223196] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:46:01.223559] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-10T17:46:01.223687] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-10T17:46:01.223898] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-10T17:46:01.223956] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-10T17:46:01.575255] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:46:01.772597] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-10T17:46:01.836727] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-10T17:46:01.889366] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-10T17:46:02.669544] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-10T17:46:02.689364] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-10T17:46:03.489404] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-10T17:46:03.768393] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T17:46:04.177358] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T17:46:04.289383] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-10T17:46:04.389450] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-10T17:46:05.089435] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-10T17:46:05.604504] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-10T17:46:05.889423] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-10T17:46:06.061928] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T17:46:06.485779] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-10T17:46:06.689398] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-10T17:46:07.386836] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-10T17:46:07.489383] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-10T17:46:08.278754] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-10T17:46:08.289331] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-10T17:46:09.089374] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-10T17:46:09.655050] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-10T17:46:09.889439] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-10T17:46:10.689485] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-10T17:46:10.712584] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-10T17:46:10.718138] [INFO ] [REMOTE ] BROS: Full fetch complete (77077 records). [2025-10-10T17:46:10.718332] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-10T17:46:11.108062] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-10T17:46:11.108133] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-10T17:46:11.109005] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-10T17:46:11.109075] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-10T17:46:11.110738] [DEBUG] [LOCAL ] BROS: Trimmed 77077 records to 54079 (keeping 200 days of data) [2025-10-10T17:46:11.416862] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-10T17:46:11.477978] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-10T17:46:11.484985] [DEBUG] [LOCAL ] BROS: Primary data saved (54079 records). [2025-10-10T17:46:11.485124] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-10T17:46:11.485202] [INFO ] [MAIN ] Update Progress: 335/2373 symbols completed. BROS took 37.2s. Estimated remaining: 4h 40m 36s. Rate: 7.3 symbols/min [2025-10-10T17:46:11.496834] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-10T17:46:11.661100] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:46:11.661275] [DEBUG] [LOCAL ] BRW: No existing data file found in primary storage. [2025-10-10T17:46:11.661312] [WARN ] [MAIN ] BRW: No existing data found, performing full refresh instead. [2025-10-10T17:46:11.661424] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-10T17:46:11.661465] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-10T17:46:11.661507] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-10T17:46:11.661571] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-10T17:46:12.012564] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:46:12.289389] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-10T17:46:12.310311] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-10T17:46:13.089423] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-10T17:46:13.889404] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-10T17:46:14.050360] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-10T17:46:14.328750] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-10T17:46:14.333949] [INFO ] [REMOTE ] BRO: Full fetch complete (74425 records). [2025-10-10T17:46:14.334108] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-10T17:46:14.694734] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-10T17:46:14.744183] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-10T17:46:14.744285] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-10T17:46:14.745249] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-10T17:46:14.745317] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-10T17:46:14.747016] [DEBUG] [LOCAL ] BRO: Trimmed 74425 records to 52722 (keeping 200 days of data) [2025-10-10T17:46:15.085039] [DEBUG] [LOCAL ] BRO: Primary data saved (52722 records). [2025-10-10T17:46:15.085228] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-10T17:46:15.085324] [INFO ] [MAIN ] Update Progress: 336/2373 symbols completed. BRO took 43.6s. Estimated remaining: 4h 39m 60s. Rate: 7.3 symbols/min [2025-10-10T17:46:15.267810] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:46:15.284577] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T17:46:15.335401] [DEBUG] [LOCAL ] BRX: Loaded 52155 existing records from primary storage. [2025-10-10T17:46:15.335796] [INFO ] [MAIN ] BRX: Loaded 52155 existing records. [2025-10-10T17:46:15.498420] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-10T17:46:15.522727] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:46:15.523912] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-10T17:46:15.524025] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-10T17:46:15.524353] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-10T17:46:15.524509] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-10T17:46:15.780022] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-10T17:46:15.882094] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:46:16.289440] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-10T17:46:16.615153] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T17:46:17.089366] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-10T17:46:17.793119] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-10T17:46:17.889386] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-10T17:46:18.097584] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-10T17:46:18.102446] [INFO ] [REMOTE ] BRSP: Full fetch complete (54335 records). [2025-10-10T17:46:18.102637] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-10T17:46:18.622023] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-10T17:46:18.622242] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-10T17:46:18.623560] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-10T17:46:18.623707] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-10T17:46:18.625697] [DEBUG] [LOCAL ] BRSP: Trimmed 54335 records to 37280 (keeping 200 days of data) [2025-10-10T17:46:18.691258] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-10T17:46:18.755228] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T17:46:18.804821] [INFO ] [REMOTE ] BRT: Full fetch complete (6835 records). [2025-10-10T17:46:18.815980] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-10T17:46:18.816913] [FATAL] [VALIDATOR ] BRT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:46:18.876639] [FATAL] [MAIN ] BRT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:46:18.887141] [WARN ] [MAIN ] BRT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:46:18.923307] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-10T17:46:18.940399] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-10T17:46:18.947754] [INFO ] [LOCAL ] BRT: Starting deletion of derivative data. [2025-10-10T17:46:18.972245] [DEBUG] [LOCAL ] BRSP: Primary data saved (37280 records). [2025-10-10T17:46:18.972587] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-10T17:46:18.972791] [INFO ] [MAIN ] Update Progress: 337/2373 symbols completed. BRSP took 40.0s. Estimated remaining: 4h 39m 25s. Rate: 7.3 symbols/min [2025-10-10T17:46:18.972882] [DEBUG] [LOCAL ] BRT: Deleted derivative data file. [2025-10-10T17:46:18.990248] [INFO ] [MAIN ] Update Progress: 338/2373 symbols completed. BRT took 18.1s. Estimated remaining: 4h 38m 27s. Rate: 7.3 symbols/min [2025-10-10T17:46:19.451789] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:46:19.469488] [DEBUG] [LOCAL ] BSAC: No existing data file found in primary storage. [2025-10-10T17:46:19.471398] [WARN ] [MAIN ] BSAC: No existing data found, performing full refresh instead. [2025-10-10T17:46:19.471311] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:46:19.471759] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-10T17:46:19.472194] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-10T17:46:19.472263] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-10-10T17:46:19.472301] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-10T17:46:19.494466] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-10T17:46:19.773764] [DEBUG] [LOCAL ] BSBR: Loaded 35593 existing records from primary storage. [2025-10-10T17:46:19.790565] [INFO ] [MAIN ] BSBR: Loaded 35593 existing records. [2025-10-10T17:46:20.008496] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:46:20.091446] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:46:20.091899] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-10T17:46:20.091974] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-10T17:46:20.092392] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-10T17:46:20.092480] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-10T17:46:20.219678] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-10T17:46:20.294436] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-10T17:46:20.479633] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:46:21.089438] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-10T17:46:21.438344] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T17:46:21.680944] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T17:46:21.889379] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-10T17:46:22.237938] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-10T17:46:22.689381] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-10T17:46:23.054012] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T17:46:23.489348] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-10T17:46:23.783297] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-10T17:46:24.289423] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-10T17:46:25.041317] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T17:46:25.089341] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-10T17:46:25.578797] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-10T17:46:25.889401] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-10T17:46:26.639983] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-10T17:46:26.689341] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-10T17:46:27.488878] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-10T17:46:27.499031] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-10T17:46:28.289382] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-10T17:46:28.633532] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-10T17:46:28.804476] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T17:46:29.034849] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-10T17:46:29.089377] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-10T17:46:29.889376] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-10T17:46:30.425459] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-10T17:46:30.689367] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-10T17:46:31.086358] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-10T17:46:31.489365] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-10T17:46:32.289343] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-10T17:46:32.321445] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T17:46:32.469267] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-10T17:46:33.089515] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-10T17:46:33.443376] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T17:46:33.889378] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-10T17:46:34.689408] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-10T17:46:34.922817] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T17:46:35.468399] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-10T17:46:35.489348] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-10T17:46:36.289351] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-10T17:46:36.426201] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T17:46:37.089353] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-10T17:46:37.124121] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T17:46:37.456731] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-10T17:46:37.889415] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-10T17:46:38.689351] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-10T17:46:38.815671] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-10T17:46:39.183152] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-10T17:46:39.489374] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-10T17:46:39.701937] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-10T17:46:40.289400] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-10T17:46:41.040583] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-10T17:46:41.089341] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-10T17:46:41.583521] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T17:46:41.889382] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-10T17:46:42.098102] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-10T17:46:42.689392] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-10T17:46:43.489394] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-10T17:46:43.840608] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T17:46:44.289422] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-10T17:46:44.352111] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T17:46:44.902282] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T17:46:45.089461] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-10T17:46:45.873860] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T17:46:45.879356] [INFO ] [REMOTE ] BRX: Full fetch complete (74936 records). [2025-10-10T17:46:45.879547] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-10T17:46:45.894607] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-10T17:46:46.295487] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-10T17:46:46.295602] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-10T17:46:46.296861] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-10T17:46:46.296954] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-10T17:46:46.298997] [DEBUG] [LOCAL ] BRX: Trimmed 74936 records to 52530 (keeping 200 days of data) [2025-10-10T17:46:46.535357] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T17:46:46.555728] [INFO ] [REMOTE ] BRW: Full fetch complete (30501 records). [2025-10-10T17:46:46.558215] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-10T17:46:46.713167] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-10T17:46:47.043257] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-10T17:46:47.044067] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-10T17:46:47.045099] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-10T17:46:47.045529] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-10T17:46:47.049447] [DEBUG] [LOCAL ] BRW: Trimmed 30501 records to 21087 (keeping 200 days of data) [2025-10-10T17:46:47.100700] [DEBUG] [LOCAL ] BRX: Primary data saved (52530 records). [2025-10-10T17:46:47.109338] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-10T17:46:47.136768] [INFO ] [MAIN ] Update Progress: 339/2373 symbols completed. BRX took 32.1s. Estimated remaining: 4h 40m 19s. Rate: 7.3 symbols/min [2025-10-10T17:46:47.355092] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:46:47.378894] [DEBUG] [LOCAL ] BRW: Primary data saved (21087 records). [2025-10-10T17:46:47.383937] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-10T17:46:47.384079] [INFO ] [MAIN ] Update Progress: 340/2373 symbols completed. BRW took 35.9s. Estimated remaining: 4h 39m 22s. Rate: 7.3 symbols/min [2025-10-10T17:46:47.383828] [DEBUG] [LOCAL ] BSL: Loaded 8276 existing records from primary storage. [2025-10-10T17:46:47.390054] [INFO ] [MAIN ] BSL: Loaded 8276 existing records. [2025-10-10T17:46:47.700237] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:46:47.760755] [DEBUG] [LOCAL ] BSM: No existing data file found in primary storage. [2025-10-10T17:46:47.778930] [WARN ] [MAIN ] BSM: No existing data found, performing full refresh instead. [2025-10-10T17:46:47.779356] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-10T17:46:47.783132] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:46:47.784179] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-10T17:46:47.787753] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T17:46:47.795257] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-10T17:46:47.795960] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-10T17:46:47.796509] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-10T17:46:47.796633] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-10T17:46:47.796160] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-10T17:46:47.797880] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-10T17:46:47.797965] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-10T17:46:48.533809] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T17:46:48.579014] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:46:48.617625] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:46:48.626318] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-10T17:46:49.089330] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-10T17:46:49.410813] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-10T17:46:49.671796] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-10T17:46:49.889390] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-10T17:46:50.393718] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T17:46:50.689391] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-10T17:46:50.778966] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T17:46:51.489404] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-10T17:46:52.107034] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-10T17:46:52.122009] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-10T17:46:52.289362] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-10T17:46:53.089451] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-10T17:46:53.888808] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-10T17:46:53.896478] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-10T17:46:54.560682] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-10T17:46:54.565530] [INFO ] [REMOTE ] BSBR: Full fetch complete (50614 records). [2025-10-10T17:46:54.565693] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-10T17:46:54.694573] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-10T17:46:54.965402] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-10T17:46:54.965494] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-10T17:46:54.966228] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-10T17:46:54.966294] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-10T17:46:54.967350] [DEBUG] [LOCAL ] BSBR: Trimmed 50614 records to 35864 (keeping 200 days of data) [2025-10-10T17:46:55.086277] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T17:46:55.202571] [DEBUG] [LOCAL ] BSBR: Primary data saved (35864 records). [2025-10-10T17:46:55.202747] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-10T17:46:55.202838] [INFO ] [MAIN ] Update Progress: 341/2373 symbols completed. BSBR took 36.2s. Estimated remaining: 4h 39m 12s. Rate: 7.3 symbols/min [2025-10-10T17:46:55.374138] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:46:55.393689] [DEBUG] [LOCAL ] BST: Loaded 19081 existing records from primary storage. [2025-10-10T17:46:55.393964] [INFO ] [MAIN ] BST: Loaded 19081 existing records. [2025-10-10T17:46:55.495423] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-10T17:46:55.574955] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:46:55.575185] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-10T17:46:55.575231] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-10T17:46:55.575479] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-10T17:46:55.575535] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-10T17:46:55.926992] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:46:56.166055] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-10T17:46:56.169775] [INFO ] [REMOTE ] BSAC: Full fetch complete (44410 records). [2025-10-10T17:46:56.169915] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-10T17:46:56.291238] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-10T17:46:56.381188] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-10T17:46:56.589995] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-10T17:46:56.590141] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-10T17:46:56.590834] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-10T17:46:56.590898] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-10T17:46:56.591977] [DEBUG] [LOCAL ] BSAC: Trimmed 44410 records to 33396 (keeping 200 days of data) [2025-10-10T17:46:56.785499] [DEBUG] [LOCAL ] BSAC: Primary data saved (33396 records). [2025-10-10T17:46:56.785667] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-10T17:46:56.785776] [INFO ] [MAIN ] Update Progress: 342/2373 symbols completed. BSAC took 37.8s. Estimated remaining: 4h 38m 24s. Rate: 7.3 symbols/min [2025-10-10T17:46:56.956373] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:46:56.956572] [DEBUG] [LOCAL ] BSTZ: No existing data file found in primary storage. [2025-10-10T17:46:56.956611] [WARN ] [MAIN ] BSTZ: No existing data found, performing full refresh instead. [2025-10-10T17:46:56.956800] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-10T17:46:56.956851] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-10T17:46:56.956895] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-10T17:46:56.956929] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-10T17:46:57.100329] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-10T17:46:57.338757] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:46:57.739200] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-10T17:46:57.889378] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-10T17:46:57.967858] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-10T17:46:58.689385] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-10T17:46:58.894226] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T17:46:59.335708] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-10T17:46:59.489378] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-10T17:47:00.289363] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-10T17:47:00.480210] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-10T17:47:01.089402] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-10T17:47:01.481964] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T17:47:01.889381] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-10T17:47:02.694497] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-10T17:47:02.706131] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T17:47:03.153890] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-10T17:47:03.489386] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-10T17:47:04.089296] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-10T17:47:04.229930] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-10T17:47:04.289439] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-10T17:47:05.089385] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-10T17:47:05.163783] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-10T17:47:05.889398] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-10T17:47:06.689366] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-10T17:47:06.721375] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T17:47:07.139170] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T17:47:07.489393] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-10T17:47:07.585538] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-10T17:47:08.289443] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-10T17:47:08.744206] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T17:47:09.017179] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-10T17:47:09.089386] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-10T17:47:09.889402] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-10T17:47:10.070757] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T17:47:10.689420] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-10T17:47:11.122166] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-10T17:47:11.489355] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-10T17:47:11.733581] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-10T17:47:11.735541] [INFO ] [REMOTE ] BSL: Full fetch complete (12817 records). [2025-10-10T17:47:11.735635] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-10T17:47:12.109861] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-10T17:47:12.109992] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-10T17:47:12.110830] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-10T17:47:12.110929] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-10T17:47:12.112067] [DEBUG] [LOCAL ] BSL: Trimmed 12817 records to 8430 (keeping 200 days of data) [2025-10-10T17:47:12.194839] [DEBUG] [LOCAL ] BSL: Primary data saved (8430 records). [2025-10-10T17:47:12.195054] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-10T17:47:12.195181] [INFO ] [MAIN ] Update Progress: 343/2373 symbols completed. BSL took 25.1s. Estimated remaining: 4h 38m 58s. Rate: 7.3 symbols/min [2025-10-10T17:47:12.294547] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-10T17:47:12.409179] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:47:12.467096] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-10-10T17:47:12.467434] [INFO ] [MAIN ] BSX: Loaded 54078 existing records. [2025-10-10T17:47:12.662799] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:47:12.663044] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-10T17:47:12.663290] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-10T17:47:12.670422] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-10T17:47:12.678857] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-10T17:47:12.720695] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T17:47:13.096416] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-10T17:47:13.104249] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:47:13.889361] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-10T17:47:13.921441] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T17:47:14.123568] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-10T17:47:14.689377] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-10T17:47:14.783772] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-10T17:47:15.489385] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-10T17:47:16.115390] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-10T17:47:16.289410] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-10T17:47:16.768593] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T17:47:17.089423] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-10T17:47:17.564324] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-10T17:47:17.889372] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-10T17:47:18.689365] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-10T17:47:19.138393] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-10T17:47:19.206973] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-10T17:47:19.489372] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-10T17:47:19.807691] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T17:47:20.289405] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-10T17:47:21.027499] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-10T17:47:21.089375] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-10T17:47:21.442042] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-10T17:47:21.889388] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-10T17:47:22.689384] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-10T17:47:23.125143] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-10T17:47:23.315899] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-10T17:47:23.410788] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-10T17:47:23.489353] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-10T17:47:24.289363] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-10T17:47:24.637803] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-10T17:47:25.089421] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-10T17:47:25.889385] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-10T17:47:26.510547] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-10T17:47:26.543372] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T17:47:26.689359] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-10T17:47:27.194208] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T17:47:27.489375] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-10T17:47:27.924062] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-10T17:47:28.289394] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-10T17:47:29.089414] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-10T17:47:29.514301] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-10T17:47:29.516491] [INFO ] [REMOTE ] BST: Full fetch complete (28618 records). [2025-10-10T17:47:29.516562] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-10T17:47:29.899114] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-10T17:47:29.898833] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-10T17:47:29.900146] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-10T17:47:29.900894] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-10T17:47:29.900984] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-10T17:47:29.902406] [DEBUG] [LOCAL ] BST: Trimmed 28618 records to 19239 (keeping 200 days of data) [2025-10-10T17:47:30.039683] [DEBUG] [LOCAL ] BST: Primary data saved (19239 records). [2025-10-10T17:47:30.055784] [INFO ] [MAIN ] BST: Full history saved. [2025-10-10T17:47:30.059064] [INFO ] [MAIN ] Update Progress: 344/2373 symbols completed. BST took 34.9s. Estimated remaining: 4h 39m 47s. Rate: 7.3 symbols/min [2025-10-10T17:47:30.094590] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-10T17:47:30.250849] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:47:30.259822] [DEBUG] [LOCAL ] BTA: Loaded 5536 existing records from primary storage. [2025-10-10T17:47:30.260052] [INFO ] [MAIN ] BTA: Loaded 5536 existing records. [2025-10-10T17:47:30.449240] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:47:30.449519] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-10T17:47:30.449570] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-10T17:47:30.449747] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-10T17:47:30.449803] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-10T17:47:30.695787] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-10T17:47:30.722272] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T17:47:30.777302] [INFO ] [REMOTE ] BSM: Full fetch complete (46990 records). [2025-10-10T17:47:30.787814] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-10T17:47:30.938732] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:47:31.266684] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-10T17:47:31.266879] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-10T17:47:31.267634] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-10T17:47:31.267739] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-10T17:47:31.284238] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-10T17:47:31.289823] [DEBUG] [LOCAL ] BSM: Trimmed 46990 records to 32627 (keeping 200 days of data) [2025-10-10T17:47:31.490714] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-10T17:47:31.493174] [DEBUG] [LOCAL ] BSM: Primary data saved (32627 records). [2025-10-10T17:47:31.494382] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-10T17:47:31.494487] [INFO ] [MAIN ] Update Progress: 345/2373 symbols completed. BSM took 44.1s. Estimated remaining: 4h 38m 58s. Rate: 7.3 symbols/min [2025-10-10T17:47:31.668974] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:47:31.686508] [DEBUG] [LOCAL ] BTCM: Loaded 16265 existing records from primary storage. [2025-10-10T17:47:31.686792] [INFO ] [MAIN ] BTCM: Loaded 16265 existing records. [2025-10-10T17:47:31.870731] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:47:31.871020] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-10T17:47:31.871111] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-10T17:47:31.871369] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-10T17:47:31.871427] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-10T17:47:32.231096] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:47:32.289362] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-10T17:47:32.488283] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T17:47:32.773352] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T17:47:32.776251] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36748 records). [2025-10-10T17:47:32.776341] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-10T17:47:33.095412] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-10T17:47:33.143408] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-10T17:47:33.143492] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-10T17:47:33.144150] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-10T17:47:33.144212] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-10T17:47:33.145101] [DEBUG] [LOCAL ] BSTZ: Trimmed 36748 records to 25316 (keeping 200 days of data) [2025-10-10T17:47:33.313133] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25316 records). [2025-10-10T17:47:33.314086] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-10T17:47:33.314236] [INFO ] [MAIN ] Update Progress: 346/2373 symbols completed. BSTZ took 36.5s. Estimated remaining: 4h 38m 12s. Rate: 7.3 symbols/min [2025-10-10T17:47:33.313968] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T17:47:33.518759] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:47:33.518988] [DEBUG] [LOCAL ] BTE: No existing data file found in primary storage. [2025-10-10T17:47:33.519027] [WARN ] [MAIN ] BTE: No existing data found, performing full refresh instead. [2025-10-10T17:47:33.519156] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-10T17:47:33.519197] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-10T17:47:33.519239] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-10T17:47:33.519272] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-10T17:47:33.894556] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-10T17:47:33.932571] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:47:34.689417] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-10T17:47:34.838778] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-10T17:47:35.197309] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-10T17:47:35.489381] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-10T17:47:36.077915] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T17:47:36.289404] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-10T17:47:36.915617] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-10T17:47:37.060227] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T17:47:37.089391] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-10T17:47:37.889411] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-10T17:47:38.000896] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-10T17:47:38.689365] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-10T17:47:39.148532] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-10T17:47:39.489358] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-10T17:47:39.858625] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T17:47:40.289411] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-10T17:47:41.089404] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-10T17:47:41.447617] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-10T17:47:41.889379] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-10T17:47:41.962701] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-10T17:47:42.028377] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-10T17:47:42.689466] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-10T17:47:43.474910] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-10T17:47:43.489388] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-10T17:47:43.806599] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-10T17:47:44.289460] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-10T17:47:44.380956] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-10T17:47:44.390050] [INFO ] [REMOTE ] BSX: Full fetch complete (77699 records). [2025-10-10T17:47:44.390251] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-10T17:47:44.834830] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-10T17:47:44.834930] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-10T17:47:44.836051] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-10T17:47:44.836127] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-10T17:47:44.838072] [DEBUG] [LOCAL ] BSX: Trimmed 77699 records to 54468 (keeping 200 days of data) [2025-10-10T17:47:45.090492] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-10T17:47:45.196181] [DEBUG] [LOCAL ] BSX: Primary data saved (54468 records). [2025-10-10T17:47:45.196409] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-10T17:47:45.196562] [INFO ] [MAIN ] Update Progress: 347/2373 symbols completed. BSX took 33.0s. Estimated remaining: 4h 38m 25s. Rate: 7.3 symbols/min [2025-10-10T17:47:45.373884] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:47:45.428718] [DEBUG] [LOCAL ] BTI: Loaded 53966 existing records from primary storage. [2025-10-10T17:47:45.429122] [INFO ] [MAIN ] BTI: Loaded 53966 existing records. [2025-10-10T17:47:45.607514] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:47:45.607811] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-10T17:47:45.607865] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-10T17:47:45.608419] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-10T17:47:45.608479] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-10T17:47:45.890009] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-10T17:47:45.984150] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:47:46.021913] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-10T17:47:46.103118] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T17:47:46.650139] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-10T17:47:46.689370] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-10T17:47:47.420562] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-10T17:47:47.489415] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-10T17:47:48.289377] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-10T17:47:49.089406] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-10T17:47:49.540873] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T17:47:49.889402] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-10T17:47:49.945476] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-10T17:47:50.303232] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-10T17:47:50.689417] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-10T17:47:51.489518] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-10T17:47:51.489425] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-10T17:47:52.231685] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-10T17:47:52.289409] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-10T17:47:52.664083] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T17:47:52.753449] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-10T17:47:53.089345] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-10T17:47:53.824326] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-10T17:47:53.889405] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-10T17:47:54.689417] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-10T17:47:55.489439] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-10T17:47:55.497127] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-10T17:47:55.954253] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-10T17:47:56.289407] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-10T17:47:56.901895] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-10T17:47:56.902211] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-10T17:47:57.089457] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-10T17:47:57.889393] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-10T17:47:58.621112] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-10T17:47:58.689388] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-10T17:47:59.489405] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-10T17:48:00.152411] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T17:48:00.199934] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-10T17:48:00.289373] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-10T17:48:01.089427] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-10T17:48:01.166974] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-10T17:48:01.889423] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-10T17:48:02.385487] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-10T17:48:02.425001] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T17:48:02.427909] [INFO ] [REMOTE ] BTCM: Full fetch complete (19746 records). [2025-10-10T17:48:02.428043] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-10T17:48:02.694567] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-10T17:48:02.819957] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-10T17:48:02.820061] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-10T17:48:02.820552] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-10T17:48:02.820596] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-10T17:48:02.821503] [DEBUG] [LOCAL ] BTCM: Trimmed 19746 records to 16477 (keeping 200 days of data) [2025-10-10T17:48:02.941239] [DEBUG] [LOCAL ] BTCM: Primary data saved (16477 records). [2025-10-10T17:48:02.941485] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-10T17:48:02.941628] [INFO ] [MAIN ] Update Progress: 348/2373 symbols completed. BTCM took 31.4s. Estimated remaining: 4h 39m 12s. Rate: 7.3 symbols/min [2025-10-10T17:48:03.187043] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:48:03.201018] [DEBUG] [LOCAL ] BTO: Loaded 8777 existing records from primary storage. [2025-10-10T17:48:03.201335] [INFO ] [MAIN ] BTO: Loaded 8777 existing records. [2025-10-10T17:48:03.453885] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T17:48:03.492627] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-10T17:48:03.500165] [INFO ] [REMOTE ] BTA: Full fetch complete (9479 records). [2025-10-10T17:48:03.500749] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-10T17:48:03.510171] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:48:03.545957] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-10T17:48:03.557147] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-10T17:48:03.607333] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-10T17:48:03.661840] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-10T17:48:04.194679] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-10T17:48:04.305618] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-10T17:48:04.403254] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-10T17:48:04.408482] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-10T17:48:04.408962] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-10T17:48:04.409045] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-10T17:48:04.435003] [DEBUG] [LOCAL ] BTA: Trimmed 9479 records to 5614 (keeping 200 days of data) [2025-10-10T17:48:04.522543] [DEBUG] [LOCAL ] BTA: Primary data saved (5614 records). [2025-10-10T17:48:04.535780] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-10T17:48:04.541669] [INFO ] [MAIN ] Update Progress: 349/2373 symbols completed. BTA took 34.5s. Estimated remaining: 4h 38m 25s. Rate: 7.3 symbols/min [2025-10-10T17:48:04.568068] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:48:04.735696] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:48:04.752704] [DEBUG] [LOCAL ] BTT: Loaded 15974 existing records from primary storage. [2025-10-10T17:48:04.752999] [INFO ] [MAIN ] BTT: Loaded 15974 existing records. [2025-10-10T17:48:04.923126] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:48:04.923313] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-10T17:48:04.923364] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-10T17:48:04.923583] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-10T17:48:04.923662] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-10T17:48:05.123378] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-10T17:48:05.266697] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:48:05.752409] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-10T17:48:05.889383] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-10T17:48:05.965596] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-10T17:48:05.986261] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-10T17:48:06.689399] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-10T17:48:07.350671] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T17:48:07.489390] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-10T17:48:08.289339] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-10T17:48:08.297791] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-10T17:48:08.433983] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T17:48:09.089382] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-10T17:48:09.164720] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-10T17:48:09.889377] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-10T17:48:10.689373] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-10T17:48:11.177991] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-10T17:48:11.489361] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-10T17:48:11.590780] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T17:48:11.903006] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-10T17:48:11.908453] [INFO ] [REMOTE ] BTE: Full fetch complete (76141 records). [2025-10-10T17:48:11.908681] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-10T17:48:12.290038] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-10T17:48:12.358014] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-10T17:48:12.358123] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-10T17:48:12.359156] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-10T17:48:12.359232] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-10T17:48:12.361301] [DEBUG] [LOCAL ] BTE: Trimmed 76141 records to 53492 (keeping 200 days of data) [2025-10-10T17:48:12.601997] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-10T17:48:12.720749] [DEBUG] [LOCAL ] BTE: Primary data saved (53492 records). [2025-10-10T17:48:12.720959] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-10T17:48:12.721056] [INFO ] [MAIN ] Update Progress: 350/2373 symbols completed. BTE took 39.4s. Estimated remaining: 4h 38m 17s. Rate: 7.3 symbols/min [2025-10-10T17:48:12.918202] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:48:12.918523] [DEBUG] [LOCAL ] BTU: No existing data file found in primary storage. [2025-10-10T17:48:12.918577] [WARN ] [MAIN ] BTU: No existing data found, performing full refresh instead. [2025-10-10T17:48:12.918758] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-10T17:48:12.918803] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-10T17:48:12.918847] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-10T17:48:12.918880] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-10T17:48:13.092390] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-10T17:48:13.133305] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-10T17:48:13.329990] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:48:13.889408] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-10T17:48:14.689392] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-10T17:48:14.813191] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-10T17:48:15.150420] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-10T17:48:15.489443] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-10T17:48:16.289458] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-10T17:48:16.614537] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-10T17:48:16.683538] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-10T17:48:17.089405] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-10T17:48:17.320770] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-10T17:48:17.783959] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-10T17:48:17.889401] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-10T17:48:18.689421] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-10T17:48:19.489448] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-10T17:48:19.852546] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T17:48:19.908818] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T17:48:20.289377] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-10T17:48:20.531792] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-10T17:48:21.089385] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-10T17:48:21.889450] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-10T17:48:22.134409] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T17:48:22.237783] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-10T17:48:22.413553] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-10T17:48:22.689408] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-10T17:48:23.316938] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-10T17:48:23.489393] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-10T17:48:24.124166] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-10T17:48:24.289375] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-10T17:48:25.089414] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-10T17:48:25.889413] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-10T17:48:25.943822] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-10T17:48:26.491939] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-10T17:48:26.689384] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-10T17:48:27.489398] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-10T17:48:28.187888] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-10T17:48:28.295889] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-10T17:48:28.315911] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-10T17:48:28.982292] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-10T17:48:29.089401] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-10T17:48:29.143689] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-10T17:48:29.228785] [DEBUG] [REMOTE ] BTI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-10T17:48:29.229145] [WARN ] [REMOTE ] BTI: No data returned for month 2025-09 [2025-10-10T17:48:29.229239] [FATAL] [REMOTE ] BTI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:48:29.229331] [FATAL] [MAIN ] BTI: Failed to fetch primary data. [2025-10-10T17:48:29.229403] [WARN ] [MAIN ] BTI: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:48:29.229477] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-10T17:48:29.229544] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-10-10T17:48:29.229583] [INFO ] [LOCAL ] BTI: Starting deletion of derivative data. [2025-10-10T17:48:29.229910] [DEBUG] [LOCAL ] BTI: Deleted derivative data file. [2025-10-10T17:48:29.230014] [INFO ] [MAIN ] Update Progress: 351/2373 symbols completed. BTI took 44.0s. Estimated remaining: 4h 38m 56s. Rate: 7.2 symbols/min [2025-10-10T17:48:29.413519] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:48:29.413883] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-10T17:48:29.413942] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-10T17:48:29.414107] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-10T17:48:29.414187] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-10T17:48:29.414234] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-10T17:48:29.414269] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-10T17:48:29.770202] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:48:29.889393] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-10T17:48:30.111570] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:48:30.112021] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-10T17:48:30.112122] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:48:30.112170] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-10T17:48:30.112205] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:48:30.112250] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-10T17:48:30.112321] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-10T17:48:30.112364] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-10T17:48:30.112406] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-10T17:48:30.112458] [INFO ] [MAIN ] Update Progress: 352/2373 symbols completed. BTX took 0.9s. Estimated remaining: 4h 38m 5s. Rate: 7.3 symbols/min [2025-10-10T17:48:30.289343] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:48:30.314701] [DEBUG] [LOCAL ] BTZ: Loaded 22883 existing records from primary storage. [2025-10-10T17:48:30.315013] [INFO ] [MAIN ] BTZ: Loaded 22883 existing records. [2025-10-10T17:48:30.502996] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:48:30.503322] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-10T17:48:30.503391] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-10T17:48:30.503720] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-10T17:48:30.503781] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-10T17:48:30.694816] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-10T17:48:30.885256] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:48:31.489436] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-10T17:48:32.289377] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-10T17:48:32.893817] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-10T17:48:32.914685] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T17:48:33.089371] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-10T17:48:33.303987] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-10T17:48:33.305370] [INFO ] [REMOTE ] BTO: Full fetch complete (13141 records). [2025-10-10T17:48:33.305438] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-10T17:48:33.665406] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-10T17:48:33.665524] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-10T17:48:33.665952] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-10T17:48:33.666018] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-10T17:48:33.666485] [DEBUG] [LOCAL ] BTO: Trimmed 13141 records to 8861 (keeping 200 days of data) [2025-10-10T17:48:33.719836] [DEBUG] [LOCAL ] BTO: Primary data saved (8861 records). [2025-10-10T17:48:33.719976] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-10T17:48:33.720077] [INFO ] [MAIN ] Update Progress: 353/2373 symbols completed. BTO took 30.8s. Estimated remaining: 4h 37m 30s. Rate: 7.3 symbols/min [2025-10-10T17:48:33.888601] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:48:33.889346] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-10T17:48:33.905763] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-10T17:48:33.954153] [DEBUG] [LOCAL ] BUD: Loaded 53080 existing records from primary storage. [2025-10-10T17:48:33.954500] [INFO ] [MAIN ] BUD: Loaded 53080 existing records. [2025-10-10T17:48:34.138362] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:48:34.140188] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-10T17:48:34.140252] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-10T17:48:34.140902] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-10T17:48:34.140971] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-10T17:48:34.500206] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:48:34.689376] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-10T17:48:35.489357] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-10T17:48:35.882187] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T17:48:36.289407] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-10T17:48:36.751208] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T17:48:36.955639] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-10T17:48:37.089361] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-10T17:48:37.862748] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T17:48:37.889334] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-10T17:48:38.689380] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-10T17:48:39.246133] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-10T17:48:39.489371] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-10T17:48:39.542313] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-10T17:48:39.912583] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T17:48:40.289425] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-10T17:48:41.089384] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-10T17:48:41.546477] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-10T17:48:41.894522] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-10T17:48:41.925902] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T17:48:42.380502] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T17:48:42.689367] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-10T17:48:42.916132] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T17:48:42.918031] [INFO ] [REMOTE ] BTT: Full fetch complete (23332 records). [2025-10-10T17:48:42.918101] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-10T17:48:43.297985] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-10T17:48:43.298086] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-10T17:48:43.298553] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-10T17:48:43.298597] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-10T17:48:43.299284] [DEBUG] [LOCAL ] BTT: Trimmed 23332 records to 16040 (keeping 200 days of data) [2025-10-10T17:48:43.397373] [DEBUG] [LOCAL ] BTT: Primary data saved (16040 records). [2025-10-10T17:48:43.397543] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-10T17:48:43.397669] [INFO ] [MAIN ] Update Progress: 354/2373 symbols completed. BTT took 38.8s. Estimated remaining: 4h 37m 30s. Rate: 7.3 symbols/min [2025-10-10T17:48:43.494541] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-10T17:48:43.616567] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:48:43.629401] [DEBUG] [LOCAL ] BUI: Loaded 11912 existing records from primary storage. [2025-10-10T17:48:43.629608] [INFO ] [MAIN ] BUI: Loaded 11912 existing records. [2025-10-10T17:48:43.871013] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:48:43.871813] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-10T17:48:43.871898] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-10T17:48:43.873154] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-10T17:48:43.873267] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-10T17:48:44.050231] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T17:48:44.284792] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:48:44.289340] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-10T17:48:45.089447] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-10T17:48:45.446846] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-10T17:48:45.525456] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-10T17:48:45.531530] [INFO ] [REMOTE ] BTU: Full fetch complete (77048 records). [2025-10-10T17:48:45.531750] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-10T17:48:45.895976] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-10T17:48:45.954286] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-10T17:48:45.954637] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-10T17:48:45.955871] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-10T17:48:45.956279] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-10T17:48:45.958597] [DEBUG] [LOCAL ] BTU: Trimmed 77048 records to 54095 (keeping 200 days of data) [2025-10-10T17:48:46.289717] [DEBUG] [LOCAL ] BTU: Primary data saved (54095 records). [2025-10-10T17:48:46.289869] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-10T17:48:46.289945] [INFO ] [MAIN ] Update Progress: 355/2373 symbols completed. BTU took 33.6s. Estimated remaining: 4h 36m 52s. Rate: 7.3 symbols/min [2025-10-10T17:48:46.467054] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:48:46.514584] [DEBUG] [LOCAL ] BUR: Loaded 45527 existing records from primary storage. [2025-10-10T17:48:46.515039] [INFO ] [MAIN ] BUR: Loaded 45527 existing records. [2025-10-10T17:48:46.692224] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-10T17:48:46.692084] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:48:46.693941] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-10T17:48:46.694002] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-10T17:48:46.694500] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-10T17:48:46.694562] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-10T17:48:47.056667] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:48:47.067439] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T17:48:47.408042] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-10T17:48:47.489400] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-10T17:48:47.539475] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-10T17:48:48.289441] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-10T17:48:48.974532] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-10T17:48:49.089404] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-10T17:48:49.377673] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-10T17:48:49.889383] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-10T17:48:50.335548] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-10T17:48:50.689398] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-10T17:48:51.297613] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T17:48:51.489370] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-10T17:48:52.165468] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-10T17:48:52.289352] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-10T17:48:52.615551] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-10T17:48:53.056628] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-10T17:48:53.089334] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-10T17:48:53.889394] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-10T17:48:54.495416] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-10T17:48:54.498611] [INFO ] [REMOTE ] BTZ: Full fetch complete (33593 records). [2025-10-10T17:48:54.498729] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-10T17:48:54.695847] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-10T17:48:54.890311] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-10T17:48:54.890418] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-10T17:48:54.891078] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-10T17:48:54.891146] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-10T17:48:54.892382] [DEBUG] [LOCAL ] BTZ: Trimmed 33593 records to 23117 (keeping 200 days of data) [2025-10-10T17:48:55.037686] [DEBUG] [LOCAL ] BTZ: Primary data saved (23117 records). [2025-10-10T17:48:55.037859] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-10T17:48:55.037960] [INFO ] [MAIN ] Update Progress: 356/2373 symbols completed. BTZ took 24.9s. Estimated remaining: 4h 36m 46s. Rate: 7.3 symbols/min [2025-10-10T17:48:55.235093] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:48:55.285875] [DEBUG] [LOCAL ] BURL: Loaded 46039 existing records from primary storage. [2025-10-10T17:48:55.286245] [INFO ] [MAIN ] BURL: Loaded 46039 existing records. [2025-10-10T17:48:55.537021] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-10T17:48:55.536854] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:48:55.543613] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-10T17:48:55.544343] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-10T17:48:55.549893] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T17:48:55.566584] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-10T17:48:55.568698] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-10T17:48:56.113464] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:48:56.289444] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-10T17:48:56.472365] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-10T17:48:56.505920] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T17:48:57.089399] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-10T17:48:57.889430] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-10T17:48:58.601833] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-10T17:48:58.620704] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-10T17:48:58.673784] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T17:48:58.689342] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-10T17:48:59.489375] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-10T17:49:00.121756] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-10T17:49:00.289371] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-10T17:49:01.022907] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-10T17:49:01.089381] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-10T17:49:01.889414] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-10T17:49:02.510629] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-10T17:49:02.689391] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-10T17:49:02.994414] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T17:49:03.489376] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-10T17:49:03.608316] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-10T17:49:04.289431] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-10T17:49:04.903291] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-10T17:49:05.089415] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-10T17:49:05.120530] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T17:49:05.889420] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-10T17:49:06.189725] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T17:49:06.687103] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T17:49:06.691761] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-10T17:49:06.693852] [INFO ] [REMOTE ] BUD: Full fetch complete (76430 records). [2025-10-10T17:49:06.694051] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-10T17:49:07.084135] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-10T17:49:07.139318] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-10T17:49:07.139427] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-10T17:49:07.140774] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-10T17:49:07.140870] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-10T17:49:07.142689] [DEBUG] [LOCAL ] BUD: Trimmed 76430 records to 53443 (keeping 200 days of data) [2025-10-10T17:49:07.461432] [DEBUG] [LOCAL ] BUD: Primary data saved (53443 records). [2025-10-10T17:49:07.461590] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-10T17:49:07.461700] [INFO ] [MAIN ] Update Progress: 357/2373 symbols completed. BUD took 33.7s. Estimated remaining: 4h 37m 2s. Rate: 7.3 symbols/min [2025-10-10T17:49:07.489377] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-10T17:49:08.289421] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-10T17:49:08.352527] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T17:49:08.992410] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T17:49:09.089372] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-10T17:49:09.210124] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-10T17:49:09.889381] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-10T17:49:10.689459] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-10T17:49:10.815041] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-10T17:49:11.007397] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T17:49:11.489439] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-10T17:49:12.182896] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-10T17:49:12.289353] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-10T17:49:12.764294] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T17:49:13.070799] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-10T17:49:13.089338] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-10T17:49:13.889403] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-10T17:49:14.131846] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-10T17:49:14.689395] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-10T17:49:15.406426] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T17:49:15.421946] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T17:49:15.424204] [INFO ] [REMOTE ] BUI: Full fetch complete (16527 records). [2025-10-10T17:49:15.424277] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-10T17:49:15.494474] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-10T17:49:15.808730] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-10T17:49:15.808830] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-10T17:49:15.809297] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-10T17:49:15.809342] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-10T17:49:15.809995] [DEBUG] [LOCAL ] BUI: Trimmed 16527 records to 12043 (keeping 200 days of data) [2025-10-10T17:49:15.887262] [DEBUG] [LOCAL ] BUI: Primary data saved (12043 records). [2025-10-10T17:49:15.887458] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-10T17:49:15.887562] [INFO ] [MAIN ] Update Progress: 358/2373 symbols completed. BUI took 32.5s. Estimated remaining: 4h 36m 54s. Rate: 7.3 symbols/min [2025-10-10T17:49:16.289398] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-10T17:49:17.007431] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-10T17:49:17.089402] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-10T17:49:18.151130] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T17:49:18.162971] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-10T17:49:18.361173] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-10T17:49:18.689401] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-10T17:49:19.991901] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-10T17:49:19.996622] [INFO ] [REMOTE ] BUR: Full fetch complete (63705 records). [2025-10-10T17:49:19.996775] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-10T17:49:20.419409] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-10T17:49:20.419555] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-10T17:49:20.420542] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-10T17:49:20.420798] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-10T17:49:20.422973] [DEBUG] [LOCAL ] BUR: Trimmed 63705 records to 45896 (keeping 200 days of data) [2025-10-10T17:49:20.706698] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T17:49:20.721568] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-10T17:49:20.782441] [DEBUG] [LOCAL ] BUR: Primary data saved (45896 records). [2025-10-10T17:49:20.782675] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-10T17:49:20.782808] [INFO ] [MAIN ] Update Progress: 359/2373 symbols completed. BUR took 34.5s. Estimated remaining: 4h 36m 27s. Rate: 7.3 symbols/min [2025-10-10T17:49:22.043378] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-10T17:49:22.055118] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-10T17:49:24.036691] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T17:49:24.047636] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-10T17:49:25.811806] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-10T17:49:25.816110] [INFO ] [REMOTE ] BURL: Full fetch complete (65622 records). [2025-10-10T17:49:25.816299] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-10T17:49:26.213556] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-10T17:49:26.213671] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-10T17:49:26.214552] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-10T17:49:26.214616] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-10T17:49:26.216381] [DEBUG] [LOCAL ] BURL: Trimmed 65622 records to 46344 (keeping 200 days of data) [2025-10-10T17:49:26.516490] [DEBUG] [LOCAL ] BURL: Primary data saved (46344 records). [2025-10-10T17:49:26.516696] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-10T17:49:26.516815] [INFO ] [MAIN ] Update Progress: 360/2373 symbols completed. BURL took 31.5s. Estimated remaining: 4h 36m 5s. Rate: 7.3 symbols/min [2025-10-10T17:49:27.182256] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:49:27.274678] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:49:27.273087] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:49:27.251362] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:49:27.336021] [DEBUG] [LOCAL ] BUXX: Loaded 15346 existing records from primary storage. [2025-10-10T17:49:27.336614] [INFO ] [MAIN ] BUXX: Loaded 15346 existing records. [2025-10-10T17:49:27.497210] [DEBUG] [LOCAL ] BV: Loaded 38789 existing records from primary storage. [2025-10-10T17:49:27.491774] [DEBUG] [LOCAL ] BW: Loaded 40536 existing records from primary storage. [2025-10-10T17:49:27.497919] [INFO ] [MAIN ] BV: Loaded 38789 existing records. [2025-10-10T17:49:27.508828] [INFO ] [MAIN ] BW: Loaded 40536 existing records. [2025-10-10T17:49:27.581613] [DEBUG] [LOCAL ] BVN: Loaded 44431 existing records from primary storage. [2025-10-10T17:49:27.633117] [INFO ] [MAIN ] BVN: Loaded 44431 existing records. [2025-10-10T17:49:27.692155] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:49:27.708055] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-10T17:49:27.740014] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-10T17:49:27.833150] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-10T17:49:27.854913] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-10T17:49:28.115011] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:49:28.188151] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-10T17:49:28.202885] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:49:28.249974] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-10T17:49:28.274214] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-10T17:49:28.239258] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-10T17:49:28.293074] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-10T17:49:28.309548] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-10T17:49:28.336507] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-10T17:49:28.371810] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:49:28.372337] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-10T17:49:28.388338] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-10T17:49:28.431064] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-10T17:49:28.637409] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-10T17:49:28.688714] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-10T17:49:29.524817] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:49:29.564699] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-10T17:49:29.770381] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:49:29.790675] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-10T17:49:29.830709] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:49:29.852254] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-10T17:49:29.857104] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:49:29.858918] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-10T17:49:30.782132] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T17:49:30.785427] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-10T17:49:31.187686] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T17:49:31.197457] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-10T17:49:31.519154] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-10T17:49:31.526893] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-10T17:49:31.702041] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-10T17:49:31.711875] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-10T17:49:31.765942] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-10T17:49:31.769377] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-10T17:49:32.253779] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-10T17:49:32.256849] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-10T17:49:32.451009] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T17:49:32.459550] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-10T17:49:32.772818] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-10T17:49:32.782269] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-10T17:49:32.965430] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T17:49:32.972541] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-10T17:49:32.984797] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-10T17:49:32.988586] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-10T17:49:33.994762] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-10T17:49:34.004624] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-10T17:49:34.031130] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-10T17:49:34.040139] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-10T17:49:34.189051] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-10T17:49:34.412028] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T17:49:34.689385] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-10T17:49:35.249183] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-10T17:49:35.489421] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-10T17:49:35.898455] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T17:49:35.914195] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-10T17:49:36.289396] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-10T17:49:37.089424] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-10T17:49:37.135278] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T17:49:37.889404] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-10T17:49:38.047818] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T17:49:38.173043] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-10T17:49:38.689410] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-10T17:49:39.489424] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-10T17:49:39.610746] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T17:49:39.852083] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T17:49:40.289398] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-10T17:49:41.089407] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-10T17:49:41.314450] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T17:49:41.889416] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-10T17:49:41.924231] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T17:49:42.133744] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-10T17:49:42.689407] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-10T17:49:43.489394] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-10T17:49:43.683724] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T17:49:44.289469] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-10T17:49:44.371760] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T17:49:44.613074] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T17:49:45.089434] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-10T17:49:45.889368] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-10T17:49:46.103077] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T17:49:46.218266] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-10T17:49:46.689395] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-10T17:49:47.489373] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-10T17:49:47.578149] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T17:49:47.814805] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T17:49:48.289402] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-10T17:49:48.477140] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-10T17:49:49.089426] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-10T17:49:49.889376] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-10T17:49:50.066874] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T17:49:50.581610] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T17:49:50.583547] [INFO ] [REMOTE ] BUXX: Full fetch complete (20462 records). [2025-10-10T17:49:50.583621] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-10T17:49:50.690699] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-10T17:49:50.802315] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-10T17:49:51.012903] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-10T17:49:51.013005] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-10T17:49:51.013564] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-10T17:49:51.013631] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-10T17:49:51.014343] [DEBUG] [LOCAL ] BUXX: Trimmed 20462 records to 15454 (keeping 200 days of data) [2025-10-10T17:49:51.123298] [DEBUG] [LOCAL ] BUXX: Primary data saved (15454 records). [2025-10-10T17:49:51.123475] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-10T17:49:51.123578] [INFO ] [MAIN ] Update Progress: 361/2373 symbols completed. BUXX took 24.6s. Estimated remaining: 4h 37m 28s. Rate: 7.3 symbols/min [2025-10-10T17:49:51.298577] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:49:51.347351] [DEBUG] [LOCAL ] BWA: Loaded 52541 existing records from primary storage. [2025-10-10T17:49:51.347747] [INFO ] [MAIN ] BWA: Loaded 52541 existing records. [2025-10-10T17:49:51.498601] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-10T17:49:51.546782] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:49:51.547350] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-10T17:49:51.547452] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-10T17:49:51.547789] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-10T17:49:51.547851] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-10T17:49:51.908279] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:49:52.289419] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-10T17:49:52.429086] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T17:49:52.433729] [INFO ] [REMOTE ] BV: Full fetch complete (54489 records). [2025-10-10T17:49:52.433879] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-10T17:49:52.841617] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-10T17:49:52.841933] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-10T17:49:52.842844] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-10T17:49:52.842909] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-10T17:49:52.844532] [DEBUG] [LOCAL ] BV: Trimmed 54489 records to 39079 (keeping 200 days of data) [2025-10-10T17:49:53.090226] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-10T17:49:53.090518] [DEBUG] [LOCAL ] BV: Primary data saved (39079 records). [2025-10-10T17:49:53.091920] [INFO ] [MAIN ] BV: Full history saved. [2025-10-10T17:49:53.092049] [INFO ] [MAIN ] Update Progress: 362/2373 symbols completed. BV took 26.6s. Estimated remaining: 4h 36m 45s. Rate: 7.3 symbols/min [2025-10-10T17:49:53.264119] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:49:53.264462] [DEBUG] [LOCAL ] BWG: No existing data file found in primary storage. [2025-10-10T17:49:53.264542] [WARN ] [MAIN ] BWG: No existing data found, performing full refresh instead. [2025-10-10T17:49:53.265049] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-10T17:49:53.265326] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-10T17:49:53.265403] [DEBUG] [LOCAL ] BWG: No primary data file found to delete. [2025-10-10T17:49:53.275174] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-10T17:49:53.356629] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T17:49:53.667596] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:49:53.889415] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-10T17:49:54.282325] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-10T17:49:54.494856] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-10T17:49:54.689398] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-10T17:49:54.859821] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-10T17:49:55.489415] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-10T17:49:56.289390] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-10T17:49:56.454924] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T17:49:56.661991] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T17:49:57.089397] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-10T17:49:57.889437] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-10T17:49:57.969473] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T17:49:58.501965] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-10T17:49:58.504349] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-10T17:49:58.689408] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-10T17:49:59.489388] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-10T17:50:00.241673] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-10T17:50:00.289423] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-10T17:50:00.508490] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T17:50:00.929121] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-10T17:50:01.089411] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-10T17:50:01.889474] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-10T17:50:02.172247] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-10T17:50:02.689375] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-10T17:50:03.489457] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-10T17:50:03.798105] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-10T17:50:03.804880] [INFO ] [REMOTE ] BVN: Full fetch complete (62512 records). [2025-10-10T17:50:03.805113] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-10T17:50:03.806242] [FATAL] [VALIDATOR ] BVN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:50:03.806364] [FATAL] [MAIN ] BVN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:50:03.806419] [WARN ] [MAIN ] BVN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:50:03.806474] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-10T17:50:03.806558] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-10-10T17:50:03.806607] [INFO ] [LOCAL ] BVN: Starting deletion of derivative data. [2025-10-10T17:50:03.806904] [DEBUG] [LOCAL ] BVN: Deleted derivative data file. [2025-10-10T17:50:03.807047] [INFO ] [MAIN ] Update Progress: 363/2373 symbols completed. BVN took 37.3s. Estimated remaining: 4h 36m 50s. Rate: 7.3 symbols/min [2025-10-10T17:50:04.088755] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:50:04.137459] [DEBUG] [LOCAL ] BWLP: Loaded 32641 existing records from primary storage. [2025-10-10T17:50:04.137945] [INFO ] [MAIN ] BWLP: Loaded 32641 existing records. [2025-10-10T17:50:04.294601] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-10T17:50:04.393003] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:50:04.393598] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-10T17:50:04.393752] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-10T17:50:04.394109] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-10T17:50:04.394168] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-10T17:50:04.795757] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:50:04.864030] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-10T17:50:04.993452] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-10T17:50:05.036189] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-10T17:50:05.089369] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-10T17:50:05.889374] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-10T17:50:06.689364] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-10T17:50:06.954504] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T17:50:07.489385] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-10T17:50:07.745865] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T17:50:07.750783] [INFO ] [REMOTE ] BW: Full fetch complete (59011 records). [2025-10-10T17:50:07.750904] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-10T17:50:07.876168] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T17:50:08.151424] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-10T17:50:08.151527] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-10T17:50:08.152373] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-10T17:50:08.152440] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-10T17:50:08.153862] [DEBUG] [LOCAL ] BW: Trimmed 59011 records to 40915 (keeping 200 days of data) [2025-10-10T17:50:08.289573] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-10T17:50:08.414659] [DEBUG] [LOCAL ] BW: Primary data saved (40915 records). [2025-10-10T17:50:08.414841] [INFO ] [MAIN ] BW: Full history saved. [2025-10-10T17:50:08.416228] [INFO ] [MAIN ] Update Progress: 364/2373 symbols completed. BW took 41.9s. Estimated remaining: 4h 36m 22s. Rate: 7.3 symbols/min [2025-10-10T17:50:08.594093] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:50:08.606952] [DEBUG] [LOCAL ] BWMX: Loaded 7763 existing records from primary storage. [2025-10-10T17:50:08.607229] [INFO ] [MAIN ] BWMX: Loaded 7763 existing records. [2025-10-10T17:50:08.760579] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-10T17:50:08.853663] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:50:08.853940] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-10T17:50:08.854004] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-10T17:50:08.854228] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-10T17:50:08.854286] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-10T17:50:09.097782] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-10T17:50:09.202202] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:50:09.889388] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-10T17:50:10.266871] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T17:50:10.358937] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T17:50:10.498637] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-10T17:50:10.689386] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-10T17:50:11.489381] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-10T17:50:12.289404] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-10T17:50:12.455337] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T17:50:12.950075] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-10T17:50:13.089364] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-10T17:50:13.404576] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-10T17:50:13.889418] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-10T17:50:14.366761] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-10T17:50:14.689384] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-10T17:50:15.249533] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-10T17:50:15.489380] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-10T17:50:16.289424] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-10T17:50:16.346068] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T17:50:17.089427] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-10T17:50:17.197872] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-10T17:50:17.494018] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T17:50:17.780767] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-10T17:50:17.889370] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-10T17:50:18.689405] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-10T17:50:19.489372] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-10T17:50:19.803729] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-10T17:50:19.902562] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-10T17:50:20.289426] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-10T17:50:20.304370] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T17:50:20.306059] [INFO ] [REMOTE ] BWG: Full fetch complete (17835 records). [2025-10-10T17:50:20.306137] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-10T17:50:20.687996] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-10T17:50:20.688091] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-10T17:50:20.688610] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-10T17:50:20.688707] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-10T17:50:20.689290] [DEBUG] [LOCAL ] BWG: Trimmed 17835 records to 12767 (keeping 200 days of data) [2025-10-10T17:50:20.767414] [DEBUG] [LOCAL ] BWG: Primary data saved (12767 records). [2025-10-10T17:50:20.767676] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-10T17:50:20.767831] [INFO ] [MAIN ] Update Progress: 365/2373 symbols completed. BWG took 27.7s. Estimated remaining: 4h 36m 36s. Rate: 7.3 symbols/min [2025-10-10T17:50:20.944278] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:50:20.952055] [DEBUG] [LOCAL ] BWNB: Loaded 4267 existing records from primary storage. [2025-10-10T17:50:20.952309] [INFO ] [MAIN ] BWNB: Loaded 4267 existing records. [2025-10-10T17:50:21.099417] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-10T17:50:21.146530] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:50:21.146818] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-10T17:50:21.146882] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-10T17:50:21.147058] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-10T17:50:21.147115] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-10T17:50:21.528129] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:50:21.894548] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-10T17:50:21.908074] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-10T17:50:22.368556] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-10T17:50:22.689389] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-10T17:50:23.324082] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-10T17:50:23.489408] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-10T17:50:24.023324] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-10T17:50:24.289416] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-10T17:50:25.086185] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-10T17:50:25.089320] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-10T17:50:25.324975] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-10T17:50:25.330935] [INFO ] [REMOTE ] BWA: Full fetch complete (75690 records). [2025-10-10T17:50:25.331124] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-10T17:50:25.734595] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-10T17:50:25.739974] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-10T17:50:25.741590] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-10T17:50:25.741962] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-10T17:50:25.741877] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-10T17:50:25.746056] [DEBUG] [LOCAL ] BWA: Trimmed 75690 records to 52923 (keeping 200 days of data) [2025-10-10T17:50:25.927136] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-10T17:50:26.082165] [DEBUG] [LOCAL ] BWA: Primary data saved (52923 records). [2025-10-10T17:50:26.082362] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-10T17:50:26.082500] [INFO ] [MAIN ] Update Progress: 366/2373 symbols completed. BWA took 35.0s. Estimated remaining: 4h 36m 12s. Rate: 7.3 symbols/min [2025-10-10T17:50:26.253456] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:50:26.261286] [DEBUG] [LOCAL ] BWSN: Loaded 5154 existing records from primary storage. [2025-10-10T17:50:26.261504] [INFO ] [MAIN ] BWSN: Loaded 5154 existing records. [2025-10-10T17:50:26.440573] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:50:26.440908] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-10T17:50:26.440958] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-10T17:50:26.441137] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-10T17:50:26.441195] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-10T17:50:26.554593] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-10T17:50:26.694586] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-10T17:50:26.818913] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:50:27.489401] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-10T17:50:27.898122] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T17:50:28.289417] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-10T17:50:28.386288] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-10T17:50:29.089376] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-10T17:50:29.895426] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-10T17:50:29.904129] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-10T17:50:29.920461] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-10T17:50:30.543081] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-10T17:50:30.689395] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-10T17:50:31.189398] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-10T17:50:31.489398] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-10T17:50:32.289448] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-10T17:50:33.089362] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-10T17:50:33.153096] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-10T17:50:33.157049] [INFO ] [REMOTE ] BWLP: Full fetch complete (48078 records). [2025-10-10T17:50:33.157232] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-10T17:50:33.357235] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-10T17:50:33.588249] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-10T17:50:33.589075] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-10T17:50:33.589301] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-10T17:50:33.590168] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-10T17:50:33.592441] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-10T17:50:33.594280] [DEBUG] [LOCAL ] BWLP: Trimmed 48078 records to 32930 (keeping 200 days of data) [2025-10-10T17:50:33.804801] [DEBUG] [LOCAL ] BWLP: Primary data saved (32930 records). [2025-10-10T17:50:33.804960] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-10T17:50:33.805062] [INFO ] [MAIN ] Update Progress: 367/2373 symbols completed. BWLP took 30.0s. Estimated remaining: 4h 36m 1s. Rate: 7.3 symbols/min [2025-10-10T17:50:33.894561] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-10T17:50:34.010090] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:50:34.060852] [DEBUG] [LOCAL ] BWXT: Loaded 47178 existing records from primary storage. [2025-10-10T17:50:34.061179] [INFO ] [MAIN ] BWXT: Loaded 47178 existing records. [2025-10-10T17:50:34.242514] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:50:34.242810] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-10T17:50:34.242859] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-10T17:50:34.243185] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-10T17:50:34.243242] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-10T17:50:34.602781] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:50:34.689393] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-10T17:50:34.834246] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T17:50:35.489390] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-10T17:50:36.152831] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-10T17:50:36.208366] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-10T17:50:36.289347] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-10T17:50:36.604064] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-10T17:50:37.089375] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-10T17:50:37.889371] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-10T17:50:38.127259] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-10T17:50:38.689375] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-10T17:50:39.376998] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-10T17:50:39.489425] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-10T17:50:39.875003] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-10T17:50:40.289384] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-10T17:50:40.345870] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-10T17:50:41.089444] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-10T17:50:41.681871] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-10T17:50:41.889428] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-10T17:50:42.090554] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T17:50:42.407002] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-10T17:50:42.689392] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-10T17:50:43.479303] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-10T17:50:43.489325] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-10T17:50:44.202687] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T17:50:44.204385] [INFO ] [REMOTE ] BWMX: Full fetch complete (10084 records). [2025-10-10T17:50:44.204506] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-10T17:50:44.295590] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-10T17:50:44.622823] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-10T17:50:44.622912] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-10T17:50:44.623291] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-10T17:50:44.623335] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-10T17:50:44.623926] [DEBUG] [LOCAL ] BWMX: Trimmed 10084 records to 7816 (keeping 200 days of data) [2025-10-10T17:50:44.677993] [DEBUG] [LOCAL ] BWMX: Primary data saved (7816 records). [2025-10-10T17:50:44.678168] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-10T17:50:44.678270] [INFO ] [MAIN ] Update Progress: 368/2373 symbols completed. BWMX took 36.3s. Estimated remaining: 4h 36m 7s. Rate: 7.3 symbols/min [2025-10-10T17:50:44.862480] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:50:44.926989] [DEBUG] [LOCAL ] BX: Loaded 53869 existing records from primary storage. [2025-10-10T17:50:44.927443] [INFO ] [MAIN ] BX: Loaded 53869 existing records. [2025-10-10T17:50:45.041789] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-10T17:50:45.092579] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-10T17:50:45.179164] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:50:45.179457] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-10T17:50:45.179510] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-10T17:50:45.180196] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-10T17:50:45.180274] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-10T17:50:45.535186] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:50:45.856130] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-10T17:50:45.889347] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-10T17:50:46.598840] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-10T17:50:46.689421] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-10T17:50:47.489410] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-10T17:50:48.029151] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-10T17:50:48.030062] [INFO ] [REMOTE ] BWNB: Full fetch complete (5646 records). [2025-10-10T17:50:48.030134] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-10T17:50:48.030524] [FATAL] [VALIDATOR ] BWNB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:50:48.030612] [FATAL] [MAIN ] BWNB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:50:48.030694] [WARN ] [MAIN ] BWNB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:50:48.030776] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-10T17:50:48.030846] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-10-10T17:50:48.030885] [INFO ] [LOCAL ] BWNB: Starting deletion of derivative data. [2025-10-10T17:50:48.031209] [DEBUG] [LOCAL ] BWNB: Deleted derivative data file. [2025-10-10T17:50:48.031304] [INFO ] [MAIN ] Update Progress: 369/2373 symbols completed. BWNB took 27.3s. Estimated remaining: 4h 35m 32s. Rate: 7.3 symbols/min [2025-10-10T17:50:48.214946] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:50:48.231339] [DEBUG] [LOCAL ] BXC: Loaded 13770 existing records from primary storage. [2025-10-10T17:50:48.231614] [INFO ] [MAIN ] BXC: Loaded 13770 existing records. [2025-10-10T17:50:48.299875] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-10T17:50:48.428338] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:50:48.428600] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-10T17:50:48.428677] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-10T17:50:48.428907] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-10T17:50:48.428964] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-10T17:50:48.827768] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:50:48.962414] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-10T17:50:49.005341] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-10T17:50:49.089381] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-10T17:50:49.593835] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-10T17:50:49.889374] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-10T17:50:50.689413] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-10T17:50:51.321098] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-10T17:50:51.489383] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-10T17:50:52.100012] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-10T17:50:52.289406] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-10T17:50:52.797271] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-10T17:50:53.003750] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-10T17:50:53.089438] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-10T17:50:53.889413] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-10T17:50:54.689365] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-10T17:50:55.193604] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-10T17:50:55.489383] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-10T17:50:55.565217] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-10T17:50:55.708803] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T17:50:56.058246] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-10T17:50:56.289435] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-10T17:50:56.806759] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-10T17:50:56.808072] [INFO ] [REMOTE ] BWSN: Full fetch complete (6284 records). [2025-10-10T17:50:56.808182] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-10T17:50:57.094553] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-10T17:50:57.216835] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-10T17:50:57.216929] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-10T17:50:57.217145] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-10T17:50:57.217188] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-10T17:50:57.217690] [DEBUG] [LOCAL ] BWSN: Trimmed 6284 records to 5205 (keeping 200 days of data) [2025-10-10T17:50:57.254205] [DEBUG] [LOCAL ] BWSN: Primary data saved (5205 records). [2025-10-10T17:50:57.254391] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-10T17:50:57.254515] [INFO ] [MAIN ] Update Progress: 370/2373 symbols completed. BWSN took 31.2s. Estimated remaining: 4h 35m 29s. Rate: 7.3 symbols/min [2025-10-10T17:50:57.430412] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:50:57.478837] [DEBUG] [LOCAL ] BXMT: Loaded 47558 existing records from primary storage. [2025-10-10T17:50:57.479253] [INFO ] [MAIN ] BXMT: Loaded 47558 existing records. [2025-10-10T17:50:57.664096] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:50:57.664374] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-10T17:50:57.664437] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-10T17:50:57.664799] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-10T17:50:57.664859] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-10T17:50:57.897863] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-10T17:50:58.039687] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:50:58.689446] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-10T17:50:59.230232] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-10T17:50:59.489410] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-10T17:50:59.730516] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-10T17:51:00.289439] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-10T17:51:00.469348] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-10T17:51:00.630123] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T17:51:01.089455] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-10T17:51:01.889434] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-10T17:51:02.623493] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-10T17:51:02.689414] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-10T17:51:03.252185] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-10T17:51:03.489381] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-10T17:51:03.753526] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T17:51:04.289417] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-10T17:51:04.959780] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-10T17:51:05.089419] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-10T17:51:05.144561] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T17:51:05.889354] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-10T17:51:06.063491] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T17:51:06.119623] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-10T17:51:06.689402] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-10T17:51:07.492191] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-10T17:51:07.495175] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-10T17:51:07.652638] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-10T17:51:08.289389] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-10T17:51:09.089428] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-10T17:51:09.892152] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-10T17:51:09.895300] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-10T17:51:10.532984] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-10T17:51:10.681991] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-10T17:51:10.689321] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-10T17:51:11.051043] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T17:51:11.375463] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-10T17:51:11.489387] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-10T17:51:12.289364] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-10T17:51:12.491777] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-10T17:51:13.089431] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-10T17:51:13.889411] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-10T17:51:14.252948] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T17:51:14.329704] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T17:51:14.689424] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-10T17:51:15.489410] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-10T17:51:16.118105] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-10T17:51:16.122888] [INFO ] [REMOTE ] BWXT: Full fetch complete (67599 records). [2025-10-10T17:51:16.123035] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-10T17:51:16.294537] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-10T17:51:16.527866] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-10T17:51:16.527975] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-10T17:51:16.529046] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-10T17:51:16.529224] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-10T17:51:16.557476] [DEBUG] [LOCAL ] BWXT: Trimmed 67599 records to 47543 (keeping 200 days of data) [2025-10-10T17:51:16.563022] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-10T17:51:16.675154] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T17:51:16.887345] [DEBUG] [LOCAL ] BWXT: Primary data saved (47543 records). [2025-10-10T17:51:16.887515] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-10T17:51:16.887603] [INFO ] [MAIN ] Update Progress: 371/2373 symbols completed. BWXT took 43.1s. Estimated remaining: 4h 36m 22s. Rate: 7.2 symbols/min [2025-10-10T17:51:17.069299] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:51:17.090479] [DEBUG] [LOCAL ] BXMX: Loaded 19639 existing records from primary storage. [2025-10-10T17:51:17.090068] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-10T17:51:17.091466] [INFO ] [MAIN ] BXMX: Loaded 19639 existing records. [2025-10-10T17:51:17.274829] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:51:17.275105] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-10T17:51:17.275154] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-10T17:51:17.275365] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-10T17:51:17.275423] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-10T17:51:17.668820] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:51:17.889402] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-10T17:51:18.176615] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-10T17:51:18.689390] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-10T17:51:18.824075] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-10T17:51:19.130538] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T17:51:19.489353] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-10T17:51:19.641742] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T17:51:19.643375] [INFO ] [REMOTE ] BXC: Full fetch complete (18134 records). [2025-10-10T17:51:19.643445] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-10T17:51:20.016867] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-10T17:51:20.017040] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-10T17:51:20.017623] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-10T17:51:20.017721] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-10T17:51:20.018799] [DEBUG] [LOCAL ] BXC: Trimmed 18134 records to 13860 (keeping 200 days of data) [2025-10-10T17:51:20.105863] [DEBUG] [LOCAL ] BXC: Primary data saved (13860 records). [2025-10-10T17:51:20.106047] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-10T17:51:20.106150] [INFO ] [MAIN ] Update Progress: 372/2373 symbols completed. BXC took 32.1s. Estimated remaining: 4h 35m 46s. Rate: 7.3 symbols/min [2025-10-10T17:51:20.285222] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:51:20.285443] [DEBUG] [LOCAL ] BXP: No existing data file found in primary storage. [2025-10-10T17:51:20.285483] [WARN ] [MAIN ] BXP: No existing data found, performing full refresh instead. [2025-10-10T17:51:20.285611] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-10T17:51:20.285683] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-10T17:51:20.285746] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-10-10T17:51:20.285782] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-10T17:51:20.297569] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-10T17:51:20.667611] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:51:20.989309] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T17:51:21.089361] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-10T17:51:21.889371] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-10T17:51:22.490757] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-10T17:51:22.689363] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-10T17:51:22.863401] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T17:51:23.199811] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-10T17:51:23.489417] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-10T17:51:24.289357] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-10T17:51:24.556322] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T17:51:24.727936] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T17:51:25.089378] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-10T17:51:25.889363] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-10T17:51:26.086339] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T17:51:26.687839] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T17:51:26.692418] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-10T17:51:26.694881] [INFO ] [REMOTE ] BX: Full fetch complete (77407 records). [2025-10-10T17:51:26.694980] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-10T17:51:27.144423] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-10T17:51:27.144552] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-10T17:51:27.145623] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-10T17:51:27.145732] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-10T17:51:27.158899] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-10T17:51:27.164628] [DEBUG] [LOCAL ] BX: Trimmed 77407 records to 54259 (keeping 200 days of data) [2025-10-10T17:51:27.492163] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-10T17:51:27.552990] [DEBUG] [LOCAL ] BX: Primary data saved (54259 records). [2025-10-10T17:51:27.553173] [INFO ] [MAIN ] BX: Full history saved. [2025-10-10T17:51:27.553331] [INFO ] [MAIN ] Update Progress: 373/2373 symbols completed. BX took 42.9s. Estimated remaining: 4h 35m 34s. Rate: 7.3 symbols/min [2025-10-10T17:51:27.751789] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:51:27.798062] [DEBUG] [LOCAL ] BXSL: Loaded 48220 existing records from primary storage. [2025-10-10T17:51:27.798526] [INFO ] [MAIN ] BXSL: Loaded 48220 existing records. [2025-10-10T17:51:27.972052] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:51:27.972242] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-10T17:51:27.972290] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-10T17:51:27.972587] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-10T17:51:27.972674] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-10T17:51:28.297939] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-10T17:51:28.331010] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:51:28.559603] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T17:51:28.566514] [INFO ] [REMOTE ] BXMT: Full fetch complete (69717 records). [2025-10-10T17:51:28.566720] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-10T17:51:28.961986] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-10T17:51:28.962072] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-10T17:51:28.962858] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-10T17:51:28.962923] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-10T17:51:28.964331] [DEBUG] [LOCAL ] BXMT: Trimmed 69717 records to 47937 (keeping 200 days of data) [2025-10-10T17:51:29.089384] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-10T17:51:29.226964] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-10T17:51:29.278888] [DEBUG] [LOCAL ] BXMT: Primary data saved (47937 records). [2025-10-10T17:51:29.279019] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-10T17:51:29.279096] [INFO ] [MAIN ] Update Progress: 374/2373 symbols completed. BXMT took 32.0s. Estimated remaining: 4h 34m 50s. Rate: 7.3 symbols/min [2025-10-10T17:51:29.450098] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:51:29.481628] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-10T17:51:29.511416] [DEBUG] [LOCAL ] BY: Loaded 21764 existing records from primary storage. [2025-10-10T17:51:29.511739] [INFO ] [MAIN ] BY: Loaded 21764 existing records. [2025-10-10T17:51:29.683529] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:51:29.683801] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-10T17:51:29.683854] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-10T17:51:29.684097] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-10T17:51:29.684154] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-10T17:51:29.894726] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-10T17:51:30.035638] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:51:30.689335] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-10T17:51:30.913796] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-10T17:51:31.099264] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T17:51:31.489377] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-10T17:51:31.628739] [DEBUG] [REMOTE ] BY: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-10T17:51:31.629102] [WARN ] [REMOTE ] BY: No data returned for month 2024-12 [2025-10-10T17:51:31.629211] [FATAL] [REMOTE ] BY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:51:31.629299] [FATAL] [MAIN ] BY: Failed to fetch primary data. [2025-10-10T17:51:31.629381] [WARN ] [MAIN ] BY: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:51:31.629474] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-10T17:51:31.629555] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-10-10T17:51:31.629595] [INFO ] [LOCAL ] BY: Starting deletion of derivative data. [2025-10-10T17:51:31.629793] [DEBUG] [LOCAL ] BY: Deleted derivative data file. [2025-10-10T17:51:31.629906] [INFO ] [MAIN ] Update Progress: 375/2373 symbols completed. BY took 2.4s. Estimated remaining: 4h 34m 11s. Rate: 7.3 symbols/min [2025-10-10T17:51:31.800177] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:51:31.842434] [DEBUG] [LOCAL ] BYD: Loaded 45181 existing records from primary storage. [2025-10-10T17:51:31.842809] [INFO ] [MAIN ] BYD: Loaded 45181 existing records. [2025-10-10T17:51:32.029402] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:51:32.029855] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-10T17:51:32.030114] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-10T17:51:32.030535] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-10T17:51:32.030596] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-10T17:51:32.292609] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-10T17:51:32.396265] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:51:32.430017] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-10T17:51:33.089419] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-10T17:51:33.889352] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-10T17:51:34.176072] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-10T17:51:34.400957] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-10T17:51:34.689413] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-10T17:51:35.489361] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-10T17:51:35.561555] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-10T17:51:35.734525] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T17:51:36.289505] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-10T17:51:36.960461] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-10T17:51:37.089464] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-10T17:51:37.889413] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-10T17:51:38.168147] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T17:51:38.276897] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T17:51:38.689471] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-10T17:51:39.489442] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-10T17:51:39.633874] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-10T17:51:40.228048] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-10T17:51:40.289378] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-10T17:51:40.534807] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T17:51:41.089415] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-10T17:51:41.538175] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T17:51:41.889432] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-10T17:51:42.689379] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-10T17:51:42.866624] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T17:51:43.208152] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-10T17:51:43.489389] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-10T17:51:44.289360] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-10T17:51:44.480367] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T17:51:44.759379] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-10T17:51:44.762141] [INFO ] [REMOTE ] BXMX: Full fetch complete (28802 records). [2025-10-10T17:51:44.762220] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-10T17:51:45.094587] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-10T17:51:45.160006] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-10T17:51:45.160106] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-10T17:51:45.160670] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-10T17:51:45.160736] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-10T17:51:45.161762] [DEBUG] [LOCAL ] BXMX: Trimmed 28802 records to 19803 (keeping 200 days of data) [2025-10-10T17:51:45.284334] [DEBUG] [LOCAL ] BXMX: Primary data saved (19803 records). [2025-10-10T17:51:45.284504] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-10T17:51:45.284593] [INFO ] [MAIN ] Update Progress: 376/2373 symbols completed. BXMX took 28.4s. Estimated remaining: 4h 34m 31s. Rate: 7.3 symbols/min [2025-10-10T17:51:45.449249] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:51:45.464368] [DEBUG] [LOCAL ] BYM: Loaded 12051 existing records from primary storage. [2025-10-10T17:51:45.464626] [INFO ] [MAIN ] BYM: Loaded 12051 existing records. [2025-10-10T17:51:45.655022] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:51:45.655332] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-10T17:51:45.655413] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-10T17:51:45.656202] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-10T17:51:45.656491] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-10T17:51:45.894826] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-10T17:51:46.032961] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:51:46.348045] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-10T17:51:46.661281] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-10T17:51:46.689346] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-10T17:51:47.489361] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-10T17:51:47.745607] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T17:51:48.083235] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-10T17:51:48.289416] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-10T17:51:49.048679] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T17:51:49.089480] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-10T17:51:49.876004] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-10T17:51:49.889333] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-10T17:51:50.413536] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-10T17:51:50.689402] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-10T17:51:51.454120] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-10T17:51:51.489332] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-10T17:51:52.289447] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-10T17:51:52.586625] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T17:51:53.089373] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-10T17:51:53.391241] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T17:51:53.519329] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-10T17:51:53.889454] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-10T17:51:54.555292] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-10T17:51:54.689442] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-10T17:51:55.489379] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-10T17:51:55.893802] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-10T17:51:56.289402] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-10T17:51:56.566463] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T17:51:56.862007] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-10T17:51:57.089443] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-10T17:51:57.460543] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T17:51:57.889400] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-10T17:51:58.587697] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T17:51:58.593901] [INFO ] [REMOTE ] BXP: Full fetch complete (71796 records). [2025-10-10T17:51:58.594077] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-10T17:51:58.695960] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-10T17:51:59.006103] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-10T17:51:59.006212] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-10T17:51:59.007151] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-10T17:51:59.007220] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-10T17:51:59.009138] [DEBUG] [LOCAL ] BXP: Trimmed 71796 records to 50547 (keeping 200 days of data) [2025-10-10T17:51:59.342363] [DEBUG] [LOCAL ] BXP: Primary data saved (50547 records). [2025-10-10T17:51:59.342571] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-10T17:51:59.342684] [INFO ] [MAIN ] Update Progress: 377/2373 symbols completed. BXP took 39.2s. Estimated remaining: 4h 34m 54s. Rate: 7.3 symbols/min [2025-10-10T17:51:59.494959] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-10T17:51:59.529700] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:51:59.564139] [DEBUG] [LOCAL ] BZH: Loaded 32653 existing records from primary storage. [2025-10-10T17:51:59.564466] [INFO ] [MAIN ] BZH: Loaded 32653 existing records. [2025-10-10T17:51:59.733838] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-10T17:51:59.768389] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:51:59.770478] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-10T17:51:59.770604] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-10T17:51:59.771285] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-10T17:51:59.783495] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-10T17:51:59.875598] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T17:52:00.172388] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:52:00.289396] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-10T17:52:01.089397] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-10T17:52:01.195255] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-10T17:52:01.258007] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-10T17:52:01.889390] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-10T17:52:02.689402] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-10T17:52:02.914888] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-10T17:52:03.424172] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-10T17:52:03.429501] [INFO ] [REMOTE ] BXSL: Full fetch complete (69651 records). [2025-10-10T17:52:03.429694] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-10T17:52:03.494971] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-10T17:52:03.843924] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-10T17:52:03.844047] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-10T17:52:03.845129] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-10T17:52:03.850688] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-10T17:52:03.856203] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-10T17:52:03.861597] [DEBUG] [LOCAL ] BXSL: Trimmed 69651 records to 48607 (keeping 200 days of data) [2025-10-10T17:52:04.182603] [DEBUG] [LOCAL ] BXSL: Primary data saved (48607 records). [2025-10-10T17:52:04.182802] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-10T17:52:04.182912] [INFO ] [MAIN ] Update Progress: 378/2373 symbols completed. BXSL took 36.6s. Estimated remaining: 4h 34m 27s. Rate: 7.3 symbols/min [2025-10-10T17:52:04.290874] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-10T17:52:04.366470] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:52:04.425504] [DEBUG] [LOCAL ] C: Loaded 54130 existing records from primary storage. [2025-10-10T17:52:04.426089] [INFO ] [MAIN ] C: Loaded 54130 existing records. [2025-10-10T17:52:04.617263] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:52:04.617624] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-10T17:52:04.617761] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-10T17:52:04.618502] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-10T17:52:04.618572] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-10T17:52:05.010800] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:52:05.089390] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-10T17:52:05.321113] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-10T17:52:05.889396] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-10T17:52:05.917041] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T17:52:06.689416] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-10T17:52:06.957078] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T17:52:07.489424] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-10T17:52:07.674387] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T17:52:07.679520] [INFO ] [REMOTE ] BYD: Full fetch complete (65135 records). [2025-10-10T17:52:07.679684] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-10T17:52:07.812745] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-10T17:52:08.106797] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-10T17:52:08.106902] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-10T17:52:08.108096] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-10T17:52:08.108169] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-10T17:52:08.109998] [DEBUG] [LOCAL ] BYD: Trimmed 65135 records to 45519 (keeping 200 days of data) [2025-10-10T17:52:08.303342] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-10T17:52:08.424430] [DEBUG] [LOCAL ] BYD: Primary data saved (45519 records). [2025-10-10T17:52:08.424632] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-10T17:52:08.424827] [INFO ] [MAIN ] Update Progress: 379/2373 symbols completed. BYD took 36.8s. Estimated remaining: 4h 33m 58s. Rate: 7.3 symbols/min [2025-10-10T17:52:08.611421] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:52:08.634810] [DEBUG] [LOCAL ] CAAP: Loaded 19969 existing records from primary storage. [2025-10-10T17:52:08.635231] [INFO ] [MAIN ] CAAP: Loaded 19969 existing records. [2025-10-10T17:52:08.841499] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:52:08.842085] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-10T17:52:08.842147] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-10T17:52:08.842408] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-10T17:52:08.842488] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-10T17:52:09.106326] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-10T17:52:09.114827] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T17:52:09.281612] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:52:09.347175] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-10T17:52:09.889396] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-10T17:52:10.689348] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-10T17:52:11.057660] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T17:52:11.224490] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T17:52:11.489399] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-10T17:52:11.785630] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-10T17:52:12.154009] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-10T17:52:12.289398] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-10T17:52:13.089381] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-10T17:52:13.308191] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-10T17:52:13.889391] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-10T17:52:14.111634] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-10T17:52:14.689421] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-10T17:52:14.934690] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-10T17:52:15.489360] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-10T17:52:15.907939] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T17:52:16.289403] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-10T17:52:16.368593] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-10T17:52:17.089397] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-10T17:52:17.474793] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-10T17:52:17.889398] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-10T17:52:18.144382] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-10T17:52:18.670342] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-10T17:52:18.689332] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-10T17:52:19.482931] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-10T17:52:19.489328] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-10T17:52:20.289392] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-10T17:52:20.685041] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-10T17:52:21.089427] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-10T17:52:21.889364] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-10T17:52:22.434198] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-10T17:52:22.494758] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-10T17:52:22.689367] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-10T17:52:22.886756] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T17:52:22.888479] [INFO ] [REMOTE ] BYM: Full fetch complete (17768 records). [2025-10-10T17:52:22.888636] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-10T17:52:23.274299] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-10T17:52:23.274427] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-10T17:52:23.275065] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-10T17:52:23.275134] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-10T17:52:23.275690] [DEBUG] [LOCAL ] BYM: Trimmed 17768 records to 12105 (keeping 200 days of data) [2025-10-10T17:52:23.351491] [DEBUG] [LOCAL ] BYM: Primary data saved (12105 records). [2025-10-10T17:52:23.351681] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-10T17:52:23.351786] [INFO ] [MAIN ] Update Progress: 380/2373 symbols completed. BYM took 38.1s. Estimated remaining: 4h 34m 25s. Rate: 7.3 symbols/min [2025-10-10T17:52:23.500415] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-10T17:52:23.541122] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:52:23.563607] [DEBUG] [LOCAL ] CABO: Loaded 16965 existing records from primary storage. [2025-10-10T17:52:23.563955] [INFO ] [MAIN ] CABO: Loaded 16965 existing records. [2025-10-10T17:52:23.797193] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:52:23.797489] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-10T17:52:23.797541] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-10T17:52:23.797828] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-10T17:52:23.797887] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-10T17:52:24.189886] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:52:24.289342] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-10T17:52:24.400336] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-10T17:52:24.990459] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-10T17:52:25.073089] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-10T17:52:25.089331] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-10T17:52:25.889391] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-10T17:52:26.475152] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-10T17:52:26.689392] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-10T17:52:27.489387] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-10T17:52:27.639447] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-10T17:52:27.958991] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-10T17:52:28.289387] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-10T17:52:28.980608] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T17:52:29.089459] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-10T17:52:29.889427] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-10T17:52:30.586246] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-10T17:52:30.661557] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-10T17:52:30.689338] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-10T17:52:31.208906] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T17:52:31.211621] [INFO ] [REMOTE ] CAAP: Full fetch complete (27803 records). [2025-10-10T17:52:31.211731] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-10T17:52:31.497163] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-10T17:52:31.602532] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-10T17:52:31.602792] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-10T17:52:31.603340] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-10T17:52:31.603482] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-10T17:52:31.604278] [DEBUG] [LOCAL ] CAAP: Trimmed 27803 records to 20121 (keeping 200 days of data) [2025-10-10T17:52:31.733519] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-10T17:52:31.754127] [DEBUG] [LOCAL ] CAAP: Primary data saved (20121 records). [2025-10-10T17:52:31.754296] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-10T17:52:31.754402] [INFO ] [MAIN ] Update Progress: 381/2373 symbols completed. CAAP took 23.3s. Estimated remaining: 4h 34m 17s. Rate: 7.3 symbols/min [2025-10-10T17:52:31.921682] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:52:31.945726] [DEBUG] [LOCAL ] CACI: Loaded 23891 existing records from primary storage. [2025-10-10T17:52:31.946039] [INFO ] [MAIN ] CACI: Loaded 23891 existing records. [2025-10-10T17:52:32.115803] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:52:32.116161] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-10T17:52:32.116230] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-10T17:52:32.116503] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-10T17:52:32.116562] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-10T17:52:32.289884] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-10T17:52:32.490474] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:52:32.519107] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-10T17:52:33.089424] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-10T17:52:33.889456] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-10T17:52:34.689440] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-10T17:52:34.766240] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-10T17:52:34.847720] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T17:52:34.940892] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-10T17:52:35.489398] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-10T17:52:35.796681] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-10T17:52:36.289423] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-10T17:52:37.089415] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-10T17:52:37.378217] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-10T17:52:37.674287] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-10T17:52:37.889391] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-10T17:52:38.683292] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-10T17:52:38.690801] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-10T17:52:39.489396] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-10T17:52:40.099293] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-10T17:52:40.292189] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-10T17:52:40.298000] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-10T17:52:41.069372] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-10T17:52:41.089399] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-10T17:52:41.163229] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-10T17:52:41.889449] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-10T17:52:42.521462] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T17:52:42.525283] [INFO ] [REMOTE ] BZH: Full fetch complete (47042 records). [2025-10-10T17:52:42.525414] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-10T17:52:42.694489] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-10T17:52:42.949209] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-10T17:52:42.949305] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-10T17:52:42.950059] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-10T17:52:42.950133] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-10T17:52:42.951444] [DEBUG] [LOCAL ] BZH: Trimmed 47042 records to 32907 (keeping 200 days of data) [2025-10-10T17:52:43.159528] [DEBUG] [LOCAL ] BZH: Primary data saved (32907 records). [2025-10-10T17:52:43.159768] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-10T17:52:43.159895] [INFO ] [MAIN ] Update Progress: 382/2373 symbols completed. BZH took 43.8s. Estimated remaining: 4h 34m 26s. Rate: 7.3 symbols/min [2025-10-10T17:52:43.354680] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:52:43.403125] [DEBUG] [LOCAL ] CADE: Loaded 49553 existing records from primary storage. [2025-10-10T17:52:43.403490] [INFO ] [MAIN ] CADE: Loaded 49553 existing records. [2025-10-10T17:52:43.494076] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-10T17:52:43.617784] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:52:43.618616] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-10T17:52:43.618818] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-10T17:52:43.619482] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-10T17:52:43.627506] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-10T17:52:43.693819] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T17:52:43.794540] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-10T17:52:44.062841] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:52:44.289447] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-10T17:52:45.089421] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-10T17:52:45.889404] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-10T17:52:46.066935] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-10T17:52:46.140304] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-10T17:52:46.317203] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-10T17:52:46.689408] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-10T17:52:47.110979] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T17:52:47.489396] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-10T17:52:47.636345] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-10T17:52:48.289399] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-10T17:52:49.029849] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T17:52:49.031766] [INFO ] [REMOTE ] CABO: Full fetch complete (23124 records). [2025-10-10T17:52:49.031857] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-10T17:52:49.102519] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-10T17:52:49.487397] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T17:52:49.485106] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-10T17:52:49.487586] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-10T17:52:49.495747] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-10T17:52:49.496405] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-10T17:52:49.497731] [DEBUG] [LOCAL ] CABO: Trimmed 23124 records to 17073 (keeping 200 days of data) [2025-10-10T17:52:49.614499] [DEBUG] [LOCAL ] CABO: Primary data saved (17073 records). [2025-10-10T17:52:49.614710] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-10T17:52:49.614828] [INFO ] [MAIN ] Update Progress: 383/2373 symbols completed. CABO took 26.3s. Estimated remaining: 4h 34m 8s. Rate: 7.3 symbols/min [2025-10-10T17:52:49.808997] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:52:49.855387] [DEBUG] [LOCAL ] CAE: Loaded 39472 existing records from primary storage. [2025-10-10T17:52:49.855777] [INFO ] [MAIN ] CAE: Loaded 39472 existing records. [2025-10-10T17:52:49.894584] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-10T17:52:50.053706] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:52:50.054118] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-10T17:52:50.054197] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-10T17:52:50.054994] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-10T17:52:50.055073] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-10T17:52:50.451984] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:52:50.523794] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-10T17:52:50.689429] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-10T17:52:51.489383] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-10T17:52:51.828045] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-10T17:52:51.836377] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-10-10T17:52:51.836562] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-10T17:52:52.072633] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T17:52:52.296546] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-10T17:52:52.297394] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-10T17:52:52.298515] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-10T17:52:52.299694] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-10T17:52:52.299858] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-10T17:52:52.302098] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 54520 (keeping 200 days of data) [2025-10-10T17:52:52.670628] [DEBUG] [LOCAL ] C: Primary data saved (54520 records). [2025-10-10T17:52:52.670837] [INFO ] [MAIN ] C: Full history saved. [2025-10-10T17:52:52.670940] [INFO ] [MAIN ] Update Progress: 384/2373 symbols completed. C took 48.5s. Estimated remaining: 4h 33m 33s. Rate: 7.3 symbols/min [2025-10-10T17:52:52.855322] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:52:52.855510] [DEBUG] [LOCAL ] CAF: No existing data file found in primary storage. [2025-10-10T17:52:52.855548] [WARN ] [MAIN ] CAF: No existing data found, performing full refresh instead. [2025-10-10T17:52:52.855693] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-10T17:52:52.855746] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-10T17:52:52.855790] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-10-10T17:52:52.855861] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-10T17:52:53.097743] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-10T17:52:53.230977] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:52:53.257875] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T17:52:53.889387] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-10T17:52:53.947741] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T17:52:54.388873] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T17:52:54.689439] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-10T17:52:54.770348] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-10T17:52:55.489406] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-10T17:52:56.052490] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-10T17:52:56.289440] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-10T17:52:57.071273] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-10T17:52:57.089350] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-10T17:52:57.238020] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-10T17:52:57.889401] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-10T17:52:58.569204] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-10T17:52:58.689405] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-10T17:52:59.489441] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-10T17:52:59.535449] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-10T17:53:00.049933] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T17:53:00.289405] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-10T17:53:00.906920] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-10T17:53:01.089397] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-10T17:53:01.867536] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-10T17:53:01.889363] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-10T17:53:02.041037] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T17:53:02.281087] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-10T17:53:02.689409] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-10T17:53:03.489390] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-10T17:53:04.289390] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-10T17:53:04.578870] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T17:53:04.667364] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-10T17:53:05.022447] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-10T17:53:05.089380] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-10T17:53:05.836101] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-10T17:53:05.889391] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-10T17:53:06.689398] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-10T17:53:07.177687] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T17:53:07.373611] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-10T17:53:07.489402] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-10T17:53:08.114443] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-10T17:53:08.289386] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-10T17:53:09.089396] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-10T17:53:09.468927] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-10T17:53:09.889401] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-10T17:53:10.133068] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T17:53:10.253346] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-10T17:53:10.689391] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-10T17:53:11.489401] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-10T17:53:11.917264] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-10T17:53:11.919468] [INFO ] [REMOTE ] CACI: Full fetch complete (38422 records). [2025-10-10T17:53:11.919612] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-10T17:53:12.313862] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-10T17:53:12.330568] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-10T17:53:12.330694] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-10T17:53:12.331323] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-10T17:53:12.331478] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-10T17:53:12.332614] [DEBUG] [LOCAL ] CACI: Trimmed 38422 records to 24045 (keeping 200 days of data) [2025-10-10T17:53:12.490829] [DEBUG] [LOCAL ] CACI: Primary data saved (24045 records). [2025-10-10T17:53:12.490979] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-10T17:53:12.491077] [INFO ] [MAIN ] Update Progress: 385/2373 symbols completed. CACI took 40.7s. Estimated remaining: 4h 34m 24s. Rate: 7.2 symbols/min [2025-10-10T17:53:12.666056] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:53:12.692408] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-10T17:53:12.749758] [DEBUG] [LOCAL ] CAG: Loaded 54054 existing records from primary storage. [2025-10-10T17:53:12.750119] [INFO ] [MAIN ] CAG: Loaded 54054 existing records. [2025-10-10T17:53:12.874268] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-10T17:53:12.944734] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:53:12.944979] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-10T17:53:12.945031] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-10T17:53:12.945427] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-10T17:53:12.945484] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-10T17:53:13.094501] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-10T17:53:13.334705] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:53:13.889390] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-10T17:53:14.689390] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-10T17:53:15.274857] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-10T17:53:15.489364] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-10T17:53:15.602363] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T17:53:15.988470] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T17:53:16.289408] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-10T17:53:16.986484] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-10T17:53:17.089397] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-10T17:53:17.889399] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-10T17:53:18.354055] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T17:53:18.456008] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T17:53:18.547548] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-10T17:53:18.548627] [INFO ] [REMOTE ] CAF: Full fetch complete (5595 records). [2025-10-10T17:53:18.548736] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-10T17:53:18.694486] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-10T17:53:18.924720] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-10T17:53:18.924817] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-10T17:53:18.925030] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-10T17:53:18.925075] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-10T17:53:18.925475] [DEBUG] [LOCAL ] CAF: Trimmed 5595 records to 3477 (keeping 200 days of data) [2025-10-10T17:53:18.946410] [DEBUG] [LOCAL ] CAF: Primary data saved (3477 records). [2025-10-10T17:53:18.946508] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-10T17:53:18.946588] [INFO ] [MAIN ] Update Progress: 386/2373 symbols completed. CAF took 26.3s. Estimated remaining: 4h 34m 6s. Rate: 7.2 symbols/min [2025-10-10T17:53:19.128622] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:53:19.189788] [DEBUG] [LOCAL ] CAH: Loaded 51836 existing records from primary storage. [2025-10-10T17:53:19.190202] [INFO ] [MAIN ] CAH: Loaded 51836 existing records. [2025-10-10T17:53:19.383451] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:53:19.383709] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-10T17:53:19.383769] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-10T17:53:19.384321] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-10T17:53:19.384391] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-10T17:53:19.494535] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-10T17:53:19.756858] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:53:20.158934] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T17:53:20.289395] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-10T17:53:21.089355] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-10T17:53:21.366798] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T17:53:21.650375] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T17:53:21.889399] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-10T17:53:22.689391] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-10T17:53:22.861972] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T17:53:23.489360] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-10T17:53:23.680743] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T17:53:24.289390] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-10T17:53:24.374314] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-10T17:53:24.380421] [INFO ] [REMOTE ] CADE: Full fetch complete (70151 records). [2025-10-10T17:53:24.380693] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-10T17:53:24.803538] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-10T17:53:24.803815] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-10T17:53:24.804858] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-10T17:53:24.804944] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-10T17:53:24.807430] [DEBUG] [LOCAL ] CADE: Trimmed 70151 records to 49940 (keeping 200 days of data) [2025-10-10T17:53:24.956808] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-10T17:53:25.089492] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-10T17:53:25.177264] [DEBUG] [LOCAL ] CADE: Primary data saved (49940 records). [2025-10-10T17:53:25.177449] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-10T17:53:25.177974] [INFO ] [MAIN ] Update Progress: 387/2373 symbols completed. CADE took 42.0s. Estimated remaining: 4h 33m 48s. Rate: 7.3 symbols/min [2025-10-10T17:53:25.352562] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:53:25.418239] [DEBUG] [LOCAL ] CAL: Loaded 43336 existing records from primary storage. [2025-10-10T17:53:25.418763] [INFO ] [MAIN ] CAL: Loaded 43336 existing records. [2025-10-10T17:53:25.607118] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:53:25.607510] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-10T17:53:25.607788] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-10T17:53:25.608239] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-10T17:53:25.608470] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-10T17:53:25.893372] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-10T17:53:26.003713] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T17:53:26.056250] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:53:26.694970] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-10T17:53:26.710600] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-10T17:53:27.201314] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T17:53:27.489394] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-10T17:53:28.289361] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-10T17:53:28.768329] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-10T17:53:28.899390] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T17:53:29.089402] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-10T17:53:29.569417] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T17:53:29.889418] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-10T17:53:30.689402] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-10T17:53:31.391197] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-10T17:53:31.489354] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-10T17:53:32.018284] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T17:53:32.291703] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-10T17:53:32.294703] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-10T17:53:33.089467] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-10T17:53:33.681680] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-10T17:53:33.763728] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-10T17:53:33.889401] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-10T17:53:34.689409] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-10T17:53:34.827799] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T17:53:34.832067] [INFO ] [REMOTE ] CAE: Full fetch complete (56156 records). [2025-10-10T17:53:34.832180] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-10T17:53:35.233216] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-10T17:53:35.233437] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-10T17:53:35.234247] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-10T17:53:35.234337] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-10T17:53:35.236261] [DEBUG] [LOCAL ] CAE: Trimmed 56156 records to 39779 (keeping 200 days of data) [2025-10-10T17:53:35.476252] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-10T17:53:35.494289] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-10T17:53:35.521328] [DEBUG] [LOCAL ] CAE: Primary data saved (39779 records). [2025-10-10T17:53:35.521496] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-10T17:53:35.521586] [INFO ] [MAIN ] Update Progress: 388/2373 symbols completed. CAE took 45.9s. Estimated remaining: 4h 33m 50s. Rate: 7.2 symbols/min [2025-10-10T17:53:35.690781] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:53:35.728573] [DEBUG] [LOCAL ] CALX: Loaded 37960 existing records from primary storage. [2025-10-10T17:53:35.728938] [INFO ] [MAIN ] CALX: Loaded 37960 existing records. [2025-10-10T17:53:35.911170] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:53:35.911860] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-10T17:53:35.911916] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-10T17:53:35.912263] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-10T17:53:35.912321] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-10T17:53:36.293134] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-10T17:53:36.315031] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:53:36.478558] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T17:53:37.089418] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-10T17:53:37.645929] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T17:53:37.769746] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-10T17:53:37.889414] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-10T17:53:38.688323] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T17:53:38.701239] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-10T17:53:39.489434] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-10T17:53:40.051769] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-10T17:53:40.289363] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-10T17:53:40.356293] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-10T17:53:40.361891] [INFO ] [REMOTE ] CAG: Full fetch complete (77655 records). [2025-10-10T17:53:40.362048] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-10T17:53:40.821610] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-10T17:53:40.821862] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-10T17:53:40.823015] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-10T17:53:40.823102] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-10T17:53:40.825215] [DEBUG] [LOCAL ] CAG: Trimmed 77655 records to 54444 (keeping 200 days of data) [2025-10-10T17:53:40.958021] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-10T17:53:41.101353] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-10T17:53:41.231088] [DEBUG] [LOCAL ] CAG: Primary data saved (54444 records). [2025-10-10T17:53:41.231271] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-10T17:53:41.231372] [INFO ] [MAIN ] Update Progress: 389/2373 symbols completed. CAG took 28.7s. Estimated remaining: 4h 33m 29s. Rate: 7.3 symbols/min [2025-10-10T17:53:41.420437] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:53:41.446391] [DEBUG] [LOCAL ] CANG: Loaded 27185 existing records from primary storage. [2025-10-10T17:53:41.446721] [INFO ] [MAIN ] CANG: Loaded 27185 existing records. [2025-10-10T17:53:41.620323] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:53:41.620591] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-10T17:53:41.620640] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-10T17:53:41.620907] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-10T17:53:41.620965] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-10T17:53:41.891687] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-10T17:53:42.014055] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:53:42.475751] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-10T17:53:42.689357] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-10T17:53:42.841285] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T17:53:43.489675] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-10T17:53:43.491672] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T17:53:44.289380] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-10T17:53:44.559781] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T17:53:44.565009] [INFO ] [REMOTE ] CAH: Full fetch complete (74579 records). [2025-10-10T17:53:44.565129] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-10T17:53:44.965534] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-10T17:53:44.965704] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-10T17:53:44.967018] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-10T17:53:44.967105] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-10T17:53:44.992573] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-10T17:53:45.002054] [DEBUG] [LOCAL ] CAH: Trimmed 74579 records to 52215 (keeping 200 days of data) [2025-10-10T17:53:45.101811] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-10T17:53:45.367360] [DEBUG] [LOCAL ] CAH: Primary data saved (52215 records). [2025-10-10T17:53:45.367541] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-10T17:53:45.367670] [INFO ] [MAIN ] Update Progress: 390/2373 symbols completed. CAH took 26.4s. Estimated remaining: 4h 32m 59s. Rate: 7.3 symbols/min [2025-10-10T17:53:45.549270] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:53:45.557787] [DEBUG] [LOCAL ] CAPL: Loaded 5748 existing records from primary storage. [2025-10-10T17:53:45.558048] [INFO ] [MAIN ] CAPL: Loaded 5748 existing records. [2025-10-10T17:53:45.744902] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:53:45.745254] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-10T17:53:45.745334] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-10T17:53:45.745546] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-10T17:53:45.745749] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-10T17:53:45.904795] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-10T17:53:45.937038] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T17:53:46.162510] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:53:46.689346] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-10T17:53:46.945836] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-10T17:53:47.489413] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-10T17:53:47.794520] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T17:53:48.156773] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-10T17:53:48.289398] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-10T17:53:48.642485] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-10T17:53:49.089482] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-10T17:53:49.889385] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-10T17:53:50.037306] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T17:53:50.587060] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-10T17:53:50.689347] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-10T17:53:51.489384] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-10T17:53:51.584147] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-10T17:53:51.655208] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T17:53:52.289394] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-10T17:53:53.089412] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-10T17:53:53.259601] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T17:53:53.889414] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-10T17:53:54.017602] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-10T17:53:54.022408] [INFO ] [REMOTE ] CAL: Full fetch complete (61753 records). [2025-10-10T17:53:54.022526] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-10T17:53:54.420448] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-10T17:53:54.420584] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-10T17:53:54.421430] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-10T17:53:54.421501] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-10T17:53:54.423300] [DEBUG] [LOCAL ] CAL: Trimmed 61753 records to 43674 (keeping 200 days of data) [2025-10-10T17:53:54.537479] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-10T17:53:54.557783] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-10T17:53:54.690407] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-10T17:53:54.742535] [DEBUG] [LOCAL ] CAL: Primary data saved (43674 records). [2025-10-10T17:53:54.742741] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-10T17:53:54.743120] [INFO ] [MAIN ] Update Progress: 391/2373 symbols completed. CAL took 29.6s. Estimated remaining: 4h 32m 57s. Rate: 7.3 symbols/min [2025-10-10T17:53:54.923135] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:53:54.984787] [DEBUG] [LOCAL ] CARR: Loaded 53987 existing records from primary storage. [2025-10-10T17:53:54.985354] [INFO ] [MAIN ] CARR: Loaded 53987 existing records. [2025-10-10T17:53:55.178617] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:53:55.178918] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-10T17:53:55.178992] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-10T17:53:55.179230] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-10T17:53:55.179284] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-10T17:53:55.495069] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-10T17:53:55.538043] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:53:56.054137] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-10T17:53:56.289389] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-10T17:53:56.399941] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T17:53:57.089375] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-10T17:53:57.518910] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T17:53:57.889389] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-10T17:53:58.593595] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-10T17:53:58.689390] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-10T17:53:58.793257] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-10T17:53:59.489400] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-10T17:54:00.289425] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-10T17:54:00.473284] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T17:54:01.089414] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-10T17:54:01.098631] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-10T17:54:01.647448] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-10T17:54:01.889404] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-10T17:54:02.689383] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-10T17:54:02.879304] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T17:54:03.489359] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-10T17:54:03.865447] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T17:54:03.965364] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T17:54:04.289401] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-10T17:54:04.686292] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T17:54:05.089396] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-10T17:54:05.889369] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-10T17:54:06.070979] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T17:54:06.090681] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-10T17:54:06.689395] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-10T17:54:07.489396] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-10T17:54:07.534865] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T17:54:07.550419] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-10T17:54:08.289413] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-10T17:54:08.805989] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-10T17:54:09.089390] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-10T17:54:09.417462] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-10T17:54:09.421091] [INFO ] [REMOTE ] CALX: Full fetch complete (53978 records). [2025-10-10T17:54:09.421204] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-10T17:54:09.546715] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-10T17:54:09.844833] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-10T17:54:09.844926] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-10T17:54:09.845727] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-10T17:54:09.845793] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-10T17:54:09.847272] [DEBUG] [LOCAL ] CALX: Trimmed 53978 records to 38212 (keeping 200 days of data) [2025-10-10T17:54:09.899194] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-10T17:54:10.090213] [DEBUG] [LOCAL ] CALX: Primary data saved (38212 records). [2025-10-10T17:54:10.090415] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-10T17:54:10.090537] [INFO ] [MAIN ] Update Progress: 392/2373 symbols completed. CALX took 34.6s. Estimated remaining: 4h 33m 24s. Rate: 7.2 symbols/min [2025-10-10T17:54:10.277104] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:54:10.323355] [DEBUG] [LOCAL ] CARS: Loaded 40024 existing records from primary storage. [2025-10-10T17:54:10.323731] [INFO ] [MAIN ] CARS: Loaded 40024 existing records. [2025-10-10T17:54:10.523429] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:54:10.523739] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-10T17:54:10.523818] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-10T17:54:10.524128] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-10T17:54:10.524206] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-10T17:54:10.714459] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-10T17:54:10.919545] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:54:11.260906] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-10T17:54:11.489406] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-10T17:54:12.186055] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-10T17:54:12.289393] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-10T17:54:13.090051] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-10T17:54:13.089916] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-10T17:54:13.142015] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-10T17:54:13.889400] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-10T17:54:14.608128] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T17:54:14.689401] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-10T17:54:15.081284] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T17:54:15.489395] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-10T17:54:16.289415] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-10T17:54:16.806533] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-10T17:54:16.894107] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-10T17:54:16.897665] [INFO ] [REMOTE ] CANG: Full fetch complete (39679 records). [2025-10-10T17:54:16.897816] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-10T17:54:16.898497] [FATAL] [VALIDATOR ] CANG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:54:16.898587] [FATAL] [MAIN ] CANG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:54:16.898633] [WARN ] [MAIN ] CANG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:54:16.898719] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-10T17:54:16.898844] [DEBUG] [LOCAL ] CANG: No primary data file found to delete. [2025-10-10T17:54:16.898903] [INFO ] [LOCAL ] CANG: Starting deletion of derivative data. [2025-10-10T17:54:16.899136] [DEBUG] [LOCAL ] CANG: Deleted derivative data file. [2025-10-10T17:54:16.899267] [INFO ] [MAIN ] Update Progress: 393/2373 symbols completed. CANG took 35.7s. Estimated remaining: 4h 33m 8s. Rate: 7.2 symbols/min [2025-10-10T17:54:17.084271] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:54:17.089364] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-10T17:54:17.144590] [DEBUG] [LOCAL ] CAT: Loaded 53301 existing records from primary storage. [2025-10-10T17:54:17.145082] [INFO ] [MAIN ] CAT: Loaded 53301 existing records. [2025-10-10T17:54:17.320051] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-10T17:54:17.372474] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:54:17.372748] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-10T17:54:17.372808] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-10T17:54:17.373071] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-10T17:54:17.373111] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-10T17:54:17.751021] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:54:17.889425] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-10T17:54:18.689372] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-10T17:54:18.738444] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-10T17:54:19.353984] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T17:54:19.489350] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-10T17:54:19.532911] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-10T17:54:20.289439] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-10T17:54:21.062831] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T17:54:21.064124] [INFO ] [REMOTE ] CAPL: Full fetch complete (8735 records). [2025-10-10T17:54:21.064200] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-10T17:54:21.095606] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-10T17:54:21.461111] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-10T17:54:21.461256] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-10T17:54:21.461724] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-10T17:54:21.461811] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-10T17:54:21.462343] [DEBUG] [LOCAL ] CAPL: Trimmed 8735 records to 5797 (keeping 200 days of data) [2025-10-10T17:54:21.501408] [DEBUG] [LOCAL ] CAPL: Primary data saved (5797 records). [2025-10-10T17:54:21.501571] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-10T17:54:21.501701] [INFO ] [MAIN ] Update Progress: 394/2373 symbols completed. CAPL took 36.1s. Estimated remaining: 4h 32m 42s. Rate: 7.3 symbols/min [2025-10-10T17:54:21.688085] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:54:21.698224] [DEBUG] [LOCAL ] CATO: Loaded 6908 existing records from primary storage. [2025-10-10T17:54:21.698509] [INFO ] [MAIN ] CATO: Loaded 6908 existing records. [2025-10-10T17:54:21.882372] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:54:21.882844] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-10T17:54:21.882925] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-10T17:54:21.883234] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-10T17:54:21.883338] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-10T17:54:21.894823] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-10T17:54:22.034057] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-10T17:54:22.307710] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:54:22.689428] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-10T17:54:22.901469] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T17:54:23.489402] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-10T17:54:24.070041] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-10T17:54:24.289406] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-10T17:54:24.686206] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-10T17:54:24.724253] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T17:54:25.089459] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-10T17:54:25.848179] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-10T17:54:25.889365] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-10T17:54:26.689356] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-10T17:54:26.942858] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T17:54:27.489367] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-10T17:54:27.721066] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T17:54:28.171532] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-10T17:54:28.289431] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-10T17:54:29.089394] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-10T17:54:29.142325] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-10T17:54:29.889385] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-10T17:54:29.993891] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-10T17:54:30.071521] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-10T17:54:30.689433] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-10T17:54:31.489403] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-10T17:54:32.257525] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T17:54:32.289386] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-10T17:54:32.350867] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-10T17:54:33.089398] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-10T17:54:33.562635] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-10T17:54:33.889375] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-10T17:54:33.998374] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T17:54:34.390850] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-10T17:54:34.689391] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-10T17:54:34.833938] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T17:54:35.207991] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-10T17:54:35.489465] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-10T17:54:36.289474] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-10T17:54:36.484293] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-10T17:54:37.089429] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-10T17:54:37.889411] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-10T17:54:37.952440] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T17:54:38.689387] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-10T17:54:38.737210] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-10T17:54:38.742416] [INFO ] [REMOTE ] CARR: Full fetch complete (77607 records). [2025-10-10T17:54:38.742549] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-10T17:54:39.129553] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-10T17:54:39.129665] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-10T17:54:39.130529] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-10T17:54:39.130591] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-10T17:54:39.132164] [DEBUG] [LOCAL ] CARR: Trimmed 77607 records to 54377 (keeping 200 days of data) [2025-10-10T17:54:39.462328] [DEBUG] [LOCAL ] CARR: Primary data saved (54377 records). [2025-10-10T17:54:39.462495] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-10T17:54:39.462963] [INFO ] [MAIN ] Update Progress: 395/2373 symbols completed. CARR took 44.7s. Estimated remaining: 4h 33m 22s. Rate: 7.2 symbols/min [2025-10-10T17:54:39.494441] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-10T17:54:39.634108] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:54:39.634369] [DEBUG] [LOCAL ] CAVA: No existing data file found in primary storage. [2025-10-10T17:54:39.634451] [WARN ] [MAIN ] CAVA: No existing data found, performing full refresh instead. [2025-10-10T17:54:39.634608] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-10T17:54:39.634674] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-10T17:54:39.634737] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-10-10T17:54:39.634771] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-10T17:54:39.986465] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:54:40.022778] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-10T17:54:40.289363] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-10T17:54:40.301063] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-10T17:54:40.305407] [INFO ] [REMOTE ] CARS: Full fetch complete (55839 records). [2025-10-10T17:54:40.305521] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-10T17:54:40.695301] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-10T17:54:40.695394] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-10T17:54:40.697533] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-10T17:54:40.697625] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-10T17:54:40.699146] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-10T17:54:40.705408] [DEBUG] [LOCAL ] CARS: Trimmed 55839 records to 40395 (keeping 200 days of data) [2025-10-10T17:54:40.962314] [DEBUG] [LOCAL ] CARS: Primary data saved (40395 records). [2025-10-10T17:54:40.962545] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-10T17:54:40.962692] [INFO ] [MAIN ] Update Progress: 396/2373 symbols completed. CARS took 30.9s. Estimated remaining: 4h 32m 40s. Rate: 7.3 symbols/min [2025-10-10T17:54:41.094955] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-10T17:54:41.239940] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:54:41.310114] [DEBUG] [LOCAL ] CB: Loaded 50296 existing records from primary storage. [2025-10-10T17:54:41.310669] [INFO ] [MAIN ] CB: Loaded 50296 existing records. [2025-10-10T17:54:41.595707] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:54:41.596087] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-10T17:54:41.596166] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-10T17:54:41.597191] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-10T17:54:41.597270] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-10T17:54:41.894597] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-10T17:54:42.006933] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-10T17:54:42.138977] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:54:42.689368] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-10T17:54:43.006108] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-10T17:54:43.118839] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-10T17:54:43.489447] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-10T17:54:44.289379] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-10T17:54:44.414153] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-10T17:54:45.089414] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-10T17:54:45.239810] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T17:54:45.889395] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-10T17:54:46.513178] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-10T17:54:46.689419] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-10T17:54:47.334974] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-10T17:54:47.489381] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-10T17:54:48.290561] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-10T17:54:48.296281] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-10T17:54:48.721902] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T17:54:49.089411] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-10T17:54:49.186930] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-10T17:54:49.632272] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-10T17:54:49.889436] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-10T17:54:50.440485] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T17:54:50.689411] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-10T17:54:51.489381] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-10T17:54:51.738893] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-10T17:54:52.104928] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-10T17:54:52.289405] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-10T17:54:53.089359] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-10T17:54:53.198862] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-10T17:54:53.568180] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T17:54:53.889445] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-10T17:54:54.689377] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-10T17:54:54.887706] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T17:54:55.489410] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-10T17:54:56.168083] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-10T17:54:56.169400] [INFO ] [REMOTE ] CATO: Full fetch complete (10988 records). [2025-10-10T17:54:56.169475] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-10T17:54:56.289540] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-10T17:54:56.296462] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-10T17:54:56.345748] [INFO ] [REMOTE ] CAT: Full fetch complete (76695 records). [2025-10-10T17:54:56.357325] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-10T17:54:56.893053] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-10T17:54:56.917182] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-10T17:54:56.929148] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-10T17:54:56.929769] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-10T17:54:56.971091] [DEBUG] [LOCAL ] CATO: Trimmed 10988 records to 6958 (keeping 200 days of data) [2025-10-10T17:54:57.036605] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-10T17:54:57.037483] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-10T17:54:57.049808] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-10T17:54:57.093892] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-10T17:54:57.105436] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-10T17:54:57.120698] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-10T17:54:57.124178] [DEBUG] [LOCAL ] CAT: Trimmed 76695 records to 53689 (keeping 200 days of data) [2025-10-10T17:54:57.127278] [DEBUG] [LOCAL ] CATO: Primary data saved (6958 records). [2025-10-10T17:54:57.128375] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-10T17:54:57.128566] [INFO ] [MAIN ] Update Progress: 397/2373 symbols completed. CATO took 35.6s. Estimated remaining: 4h 33m 11s. Rate: 7.2 symbols/min [2025-10-10T17:54:57.486642] [DEBUG] [LOCAL ] CAT: Primary data saved (53689 records). [2025-10-10T17:54:57.486831] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-10T17:54:57.486934] [INFO ] [MAIN ] Update Progress: 398/2373 symbols completed. CAT took 40.6s. Estimated remaining: 4h 32m 23s. Rate: 7.3 symbols/min [2025-10-10T17:54:58.814310] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-10T17:54:58.825919] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-10T17:54:59.169342] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T17:54:59.180470] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-10T17:55:01.154432] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-10T17:55:01.165511] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-10T17:55:01.245475] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-10T17:55:01.257483] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-10T17:55:03.337245] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T17:55:03.348860] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-10T17:55:03.448874] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-10T17:55:03.461706] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-10T17:55:05.207057] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T17:55:05.218366] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-10T17:55:05.334581] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-10T17:55:05.347316] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-10T17:55:06.853633] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T17:55:06.865369] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-10T17:55:07.703994] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-10T17:55:07.716434] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-10T17:55:08.363931] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T17:55:08.369096] [INFO ] [REMOTE ] CB: Full fetch complete (72564 records). [2025-10-10T17:55:08.369234] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-10T17:55:08.794724] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-10T17:55:08.794832] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-10T17:55:08.795739] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-10T17:55:08.795864] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-10T17:55:08.797869] [DEBUG] [LOCAL ] CB: Trimmed 72564 records to 50652 (keeping 200 days of data) [2025-10-10T17:55:09.150210] [DEBUG] [LOCAL ] CB: Primary data saved (50652 records). [2025-10-10T17:55:09.150399] [INFO ] [MAIN ] CB: Full history saved. [2025-10-10T17:55:09.151433] [INFO ] [MAIN ] Update Progress: 399/2373 symbols completed. CB took 28.2s. Estimated remaining: 4h 32m 32s. Rate: 7.2 symbols/min [2025-10-10T17:55:09.880567] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-10T17:55:09.886019] [INFO ] [REMOTE ] CAVA: Full fetch complete (77329 records). [2025-10-10T17:55:09.886210] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-10T17:55:10.269414] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-10T17:55:10.269510] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-10T17:55:10.270370] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-10T17:55:10.270440] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-10T17:55:10.272079] [DEBUG] [LOCAL ] CAVA: Trimmed 77329 records to 54334 (keeping 200 days of data) [2025-10-10T17:55:10.594696] [DEBUG] [LOCAL ] CAVA: Primary data saved (54334 records). [2025-10-10T17:55:10.594864] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-10T17:55:10.594946] [INFO ] [MAIN ] Update Progress: 400/2373 symbols completed. CAVA took 31.1s. Estimated remaining: 4h 31m 50s. Rate: 7.3 symbols/min [2025-10-10T17:55:11.283170] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:55:11.353244] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:55:11.357250] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:55:11.375831] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:55:11.377057] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-10T17:55:11.378012] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-10T17:55:11.378175] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-10T17:55:11.378222] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-10T17:55:11.378266] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-10T17:55:11.378301] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-10T17:55:11.480950] [DEBUG] [LOCAL ] CBNA: Loaded 2910 existing records from primary storage. [2025-10-10T17:55:11.498173] [INFO ] [MAIN ] CBNA: Loaded 2910 existing records. [2025-10-10T17:55:11.532406] [DEBUG] [LOCAL ] CBAN: Loaded 10711 existing records from primary storage. [2025-10-10T17:55:11.581815] [INFO ] [MAIN ] CBAN: Loaded 10711 existing records. [2025-10-10T17:55:11.728527] [DEBUG] [LOCAL ] CBL: Loaded 16385 existing records from primary storage. [2025-10-10T17:55:11.789259] [INFO ] [MAIN ] CBL: Loaded 16385 existing records. [2025-10-10T17:55:12.129611] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:55:12.163427] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-10T17:55:12.168419] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-10T17:55:12.264183] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-10T17:55:12.285064] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:55:12.299180] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-10T17:55:12.392432] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-10T17:55:12.401849] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-10T17:55:12.386157] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:55:12.424709] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-10T17:55:12.429896] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-10T17:55:12.438346] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-10T17:55:12.419087] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:55:12.457935] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-10T17:55:12.447140] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-10T17:55:12.457550] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-10T17:55:12.484010] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-10T17:55:12.758795] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:55:12.786206] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-10T17:55:12.837270] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:55:12.966880] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-10T17:55:13.026592] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:55:13.073745] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-10T17:55:13.148494] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-10T17:55:13.204034] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-10T17:55:13.375445] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:55:13.293945] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-10T17:55:13.387408] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-10T17:55:13.386887] [INFO ] [MAIN ] Update Progress: 401/2373 symbols completed. CBO took 2.8s. Estimated remaining: 4h 31m 14s. Rate: 7.3 symbols/min [2025-10-10T17:55:13.611295] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:55:13.669682] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-10T17:55:13.674813] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:55:13.679678] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-10T17:55:13.748960] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:55:13.799176] [DEBUG] [LOCAL ] CBRE: Loaded 50764 existing records from primary storage. [2025-10-10T17:55:13.799523] [INFO ] [MAIN ] CBRE: Loaded 50764 existing records. [2025-10-10T17:55:13.970951] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:55:13.971181] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-10T17:55:13.971227] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-10T17:55:13.971615] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-10T17:55:13.971706] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-10T17:55:14.315525] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:55:14.315921] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-10T17:55:14.565256] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-10T17:55:14.566940] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-10T17:55:14.688960] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T17:55:14.691384] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-10T17:55:14.973797] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-10T17:55:14.975692] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-10T17:55:15.047117] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T17:55:15.052367] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-10T17:55:15.475366] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-10T17:55:15.476777] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-10T17:55:15.821350] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-10T17:55:15.822578] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-10T17:55:15.861517] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T17:55:15.865023] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-10T17:55:16.104459] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T17:55:16.115569] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-10T17:55:16.168615] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-10T17:55:16.294735] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-10T17:55:16.295666] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T17:55:16.429925] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-10T17:55:17.089491] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-10T17:55:17.197592] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-10T17:55:17.889352] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-10T17:55:18.033213] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-10T17:55:18.245155] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T17:55:18.263597] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-10T17:55:18.689445] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-10T17:55:19.025571] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-10T17:55:19.489397] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-10T17:55:20.158838] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-10T17:55:20.289401] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-10T17:55:21.089376] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-10T17:55:21.889426] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-10T17:55:22.066168] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-10T17:55:22.227355] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-10T17:55:22.689359] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-10T17:55:23.061431] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-10T17:55:23.489380] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-10T17:55:23.609778] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-10T17:55:24.289398] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-10T17:55:25.089366] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-10T17:55:25.302260] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-10T17:55:25.493426] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T17:55:25.835973] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-10T17:55:25.889349] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-10T17:55:26.689395] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-10T17:55:26.705493] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-10T17:55:27.009402] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-10T17:55:27.489374] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-10T17:55:28.289426] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-10T17:55:29.089436] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-10T17:55:29.476151] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-10T17:55:29.798440] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-10T17:55:29.889358] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-10T17:55:30.050007] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-10T17:55:30.689382] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-10T17:55:31.228421] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-10T17:55:31.229343] [INFO ] [REMOTE ] CBNA: Full fetch complete (4460 records). [2025-10-10T17:55:31.229488] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-10T17:55:31.359975] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-10T17:55:31.494547] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-10T17:55:31.631121] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-10T17:55:31.631229] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-10T17:55:31.631465] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-10T17:55:31.631510] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-10T17:55:31.631905] [DEBUG] [LOCAL ] CBNA: Trimmed 4460 records to 2931 (keeping 200 days of data) [2025-10-10T17:55:31.648902] [DEBUG] [LOCAL ] CBNA: Primary data saved (2931 records). [2025-10-10T17:55:31.648976] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-10T17:55:31.649060] [INFO ] [MAIN ] Update Progress: 402/2373 symbols completed. CBNA took 21.0s. Estimated remaining: 4h 31m 55s. Rate: 7.2 symbols/min [2025-10-10T17:55:31.814909] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:55:31.848825] [DEBUG] [LOCAL ] CBT: Loaded 31037 existing records from primary storage. [2025-10-10T17:55:31.849117] [INFO ] [MAIN ] CBT: Loaded 31037 existing records. [2025-10-10T17:55:32.022542] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:55:32.022796] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-10T17:55:32.022844] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-10T17:55:32.023442] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-10T17:55:32.023498] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-10T17:55:32.290721] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-10T17:55:32.370609] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:55:32.634272] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-10T17:55:33.089362] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-10T17:55:33.434315] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T17:55:33.889428] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-10T17:55:34.689421] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-10T17:55:34.829088] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-10T17:55:34.871680] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T17:55:35.489393] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-10T17:55:36.289404] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-10T17:55:36.749327] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-10T17:55:36.825841] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T17:55:37.089375] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-10T17:55:37.279316] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-10T17:55:37.827639] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-10T17:55:37.889386] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-10T17:55:38.689416] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-10T17:55:38.866736] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T17:55:39.489381] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-10T17:55:40.281793] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T17:55:40.289324] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-10T17:55:41.089367] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-10T17:55:41.518343] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-10T17:55:41.884488] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-10T17:55:41.895711] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-10T17:55:41.899183] [INFO ] [REMOTE ] CBAN: Full fetch complete (16099 records). [2025-10-10T17:55:41.899967] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-10T17:55:41.900792] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-10T17:55:42.291526] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-10T17:55:42.291616] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-10T17:55:42.291998] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-10T17:55:42.292058] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-10T17:55:42.292547] [DEBUG] [LOCAL ] CBAN: Trimmed 16099 records to 10765 (keeping 200 days of data) [2025-10-10T17:55:42.356055] [DEBUG] [LOCAL ] CBAN: Primary data saved (10765 records). [2025-10-10T17:55:42.356207] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-10T17:55:42.356297] [INFO ] [MAIN ] Update Progress: 403/2373 symbols completed. CBAN took 31.8s. Estimated remaining: 4h 31m 59s. Rate: 7.2 symbols/min [2025-10-10T17:55:42.520073] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:55:42.545388] [DEBUG] [LOCAL ] CBU: Loaded 22667 existing records from primary storage. [2025-10-10T17:55:42.545699] [INFO ] [MAIN ] CBU: Loaded 22667 existing records. [2025-10-10T17:55:42.700216] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-10T17:55:42.720754] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:55:42.721923] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-10T17:55:42.721985] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-10T17:55:42.722270] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-10T17:55:42.722329] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-10T17:55:43.069872] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:55:43.489356] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-10T17:55:43.742248] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T17:55:43.844524] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T17:55:43.846631] [INFO ] [REMOTE ] CBL: Full fetch complete (25336 records). [2025-10-10T17:55:43.846741] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-10T17:55:44.201851] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-10T17:55:44.201937] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-10T17:55:44.202383] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-10T17:55:44.202421] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-10T17:55:44.203119] [DEBUG] [LOCAL ] CBL: Trimmed 25336 records to 16498 (keeping 200 days of data) [2025-10-10T17:55:44.290547] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-10T17:55:44.309590] [DEBUG] [LOCAL ] CBL: Primary data saved (16498 records). [2025-10-10T17:55:44.309730] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-10T17:55:44.309820] [INFO ] [MAIN ] Update Progress: 404/2373 symbols completed. CBL took 33.7s. Estimated remaining: 4h 31m 20s. Rate: 7.3 symbols/min [2025-10-10T17:55:44.475083] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:55:44.475303] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-10T17:55:44.475341] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-10T17:55:44.475450] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-10T17:55:44.475491] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-10T17:55:44.475531] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-10T17:55:44.475563] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-10T17:55:44.818599] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:55:45.089388] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-10T17:55:45.169408] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-10T17:55:45.696840] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T17:55:45.889374] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-10T17:55:46.471352] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T17:55:46.689367] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-10T17:55:47.489349] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-10T17:55:47.571808] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-10T17:55:47.597242] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T17:55:48.289366] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-10T17:55:49.089338] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-10T17:55:49.196739] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-10T17:55:49.222274] [INFO ] [REMOTE ] CBRE: Full fetch complete (73750 records). [2025-10-10T17:55:49.223255] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-10T17:55:49.223519] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-10T17:55:49.629379] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-10T17:55:49.629494] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-10T17:55:49.630402] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-10T17:55:49.630470] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-10T17:55:49.632212] [DEBUG] [LOCAL ] CBRE: Trimmed 73750 records to 51146 (keeping 200 days of data) [2025-10-10T17:55:49.915305] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-10T17:55:49.956957] [DEBUG] [LOCAL ] CBRE: Primary data saved (51146 records). [2025-10-10T17:55:49.957092] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-10T17:55:49.957172] [INFO ] [MAIN ] Update Progress: 405/2373 symbols completed. CBRE took 36.5s. Estimated remaining: 4h 30m 59s. Rate: 7.3 symbols/min [2025-10-10T17:55:50.129879] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:55:50.130207] [DEBUG] [LOCAL ] CBZ: No existing data file found in primary storage. [2025-10-10T17:55:50.130263] [WARN ] [MAIN ] CBZ: No existing data found, performing full refresh instead. [2025-10-10T17:55:50.130379] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-10T17:55:50.130420] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-10T17:55:50.130493] [DEBUG] [LOCAL ] CBZ: No primary data file found to delete. [2025-10-10T17:55:50.130541] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-10T17:55:50.162013] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:55:50.209826] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-10T17:55:50.220229] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:55:50.230667] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-10T17:55:50.230773] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:55:50.230881] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-10T17:55:50.231059] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-10T17:55:50.231425] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-10T17:55:50.252177] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-10T17:55:50.257407] [INFO ] [MAIN ] Update Progress: 406/2373 symbols completed. CBX took 5.9s. Estimated remaining: 4h 30m 12s. Rate: 7.3 symbols/min [2025-10-10T17:55:50.424610] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T17:55:50.692038] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:55:50.694993] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:55:50.690384] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-10T17:55:50.747047] [DEBUG] [LOCAL ] CC: Loaded 53381 existing records from primary storage. [2025-10-10T17:55:50.747395] [INFO ] [MAIN ] CC: Loaded 53381 existing records. [2025-10-10T17:55:50.922330] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:55:50.922596] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-10T17:55:50.922664] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-10T17:55:50.923183] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-10T17:55:50.923241] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-10T17:55:51.270452] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:55:51.489344] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-10T17:55:51.978543] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T17:55:52.289417] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-10T17:55:53.089386] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-10T17:55:53.137413] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T17:55:53.889351] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-10T17:55:54.214350] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T17:55:54.447182] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T17:55:54.689439] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-10T17:55:55.489376] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-10T17:55:55.717801] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-10T17:55:55.881745] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-10T17:55:56.289436] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-10T17:55:56.486161] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-10T17:55:57.089407] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-10T17:55:57.889405] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-10T17:55:58.078879] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T17:55:58.409088] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-10T17:55:58.689347] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-10T17:55:58.761160] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-10T17:55:59.489429] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-10T17:56:00.209374] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-10T17:56:00.289404] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-10T17:56:01.089398] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-10T17:56:01.603305] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-10T17:56:01.709345] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-10T17:56:01.889381] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-10T17:56:02.288065] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-10T17:56:02.689403] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-10T17:56:03.490523] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-10T17:56:03.490422] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T17:56:03.903970] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-10T17:56:04.289395] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-10T17:56:05.008403] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-10T17:56:05.089428] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-10T17:56:05.709061] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-10T17:56:05.889454] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-10T17:56:06.689380] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-10T17:56:07.143097] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-10T17:56:07.489403] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-10T17:56:07.547097] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-10T17:56:07.667115] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T17:56:08.289367] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-10T17:56:09.089373] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-10T17:56:09.467515] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T17:56:09.841019] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-10T17:56:09.889373] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-10T17:56:10.485872] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-10T17:56:10.689390] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-10T17:56:11.248984] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-10T17:56:11.489385] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-10T17:56:12.296355] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-10T17:56:12.300965] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-10T17:56:13.089323] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-10T17:56:13.784326] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-10T17:56:13.863928] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-10T17:56:13.867294] [INFO ] [REMOTE ] CBT: Full fetch complete (45551 records). [2025-10-10T17:56:13.867402] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-10T17:56:13.898612] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-10T17:56:14.286879] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T17:56:14.287030] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-10T17:56:14.289578] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-10T17:56:14.290367] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-10T17:56:14.290585] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-10T17:56:14.290508] [INFO ] [REMOTE ] CBU: Full fetch complete (32138 records). [2025-10-10T17:56:14.290984] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-10T17:56:14.291858] [FATAL] [VALIDATOR ] CBU: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:56:14.291991] [FATAL] [MAIN ] CBU: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:56:14.292146] [WARN ] [MAIN ] CBU: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:56:14.292396] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-10T17:56:14.292537] [DEBUG] [LOCAL ] CBU: No primary data file found to delete. [2025-10-10T17:56:14.292838] [INFO ] [LOCAL ] CBU: Starting deletion of derivative data. [2025-10-10T17:56:14.293020] [DEBUG] [LOCAL ] CBT: Trimmed 45551 records to 31283 (keeping 200 days of data) [2025-10-10T17:56:14.293120] [DEBUG] [LOCAL ] CBU: Deleted derivative data file. [2025-10-10T17:56:14.293305] [INFO ] [MAIN ] Update Progress: 407/2373 symbols completed. CBU took 31.9s. Estimated remaining: 4h 31m 20s. Rate: 7.2 symbols/min [2025-10-10T17:56:14.554011] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:56:14.679872] [DEBUG] [LOCAL ] CCI: Loaded 53516 existing records from primary storage. [2025-10-10T17:56:14.684286] [INFO ] [MAIN ] CCI: Loaded 53516 existing records. [2025-10-10T17:56:14.696457] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-10T17:56:14.794209] [DEBUG] [LOCAL ] CBT: Primary data saved (31283 records). [2025-10-10T17:56:14.800049] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-10T17:56:14.800197] [INFO ] [MAIN ] Update Progress: 408/2373 symbols completed. CBT took 43.2s. Estimated remaining: 4h 30m 34s. Rate: 7.3 symbols/min [2025-10-10T17:56:14.980383] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:56:14.983769] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-10T17:56:14.984170] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-10T17:56:15.000342] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-10T17:56:15.000436] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-10T17:56:15.141141] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:56:15.162815] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-10T17:56:15.163336] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-10T17:56:15.174241] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-10T17:56:15.201816] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-10T17:56:15.220802] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-10T17:56:15.244448] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-10T17:56:15.572439] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:56:15.625582] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-10T17:56:15.797769] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:56:15.824139] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T17:56:16.170822] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-10T17:56:16.289392] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-10T17:56:16.820459] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-10T17:56:17.089394] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-10T17:56:17.889353] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-10T17:56:17.923089] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-10T17:56:18.417949] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-10T17:56:18.689483] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-10T17:56:19.087119] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-10T17:56:19.200798] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-10T17:56:19.489406] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-10T17:56:20.289442] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-10T17:56:20.674702] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-10T17:56:21.027749] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-10T17:56:21.089354] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-10T17:56:21.889431] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-10T17:56:22.689441] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-10T17:56:23.061375] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-10T17:56:23.110954] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T17:56:23.381941] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-10T17:56:23.385602] [INFO ] [REMOTE ] CBZ: Full fetch complete (45740 records). [2025-10-10T17:56:23.385752] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-10T17:56:23.494522] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-10T17:56:23.764189] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-10T17:56:23.764318] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-10T17:56:23.764977] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-10T17:56:23.765040] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-10T17:56:23.766207] [DEBUG] [LOCAL ] CBZ: Trimmed 45740 records to 34491 (keeping 200 days of data) [2025-10-10T17:56:23.962720] [DEBUG] [LOCAL ] CBZ: Primary data saved (34491 records). [2025-10-10T17:56:23.962867] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-10T17:56:23.962939] [INFO ] [MAIN ] Update Progress: 409/2373 symbols completed. CBZ took 34.0s. Estimated remaining: 4h 30m 30s. Rate: 7.3 symbols/min [2025-10-10T17:56:24.126284] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:56:24.143147] [DEBUG] [LOCAL ] CCIF: Loaded 15738 existing records from primary storage. [2025-10-10T17:56:24.143387] [INFO ] [MAIN ] CCIF: Loaded 15738 existing records. [2025-10-10T17:56:24.311389] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-10T17:56:24.315920] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:56:24.316091] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-10T17:56:24.316169] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-10T17:56:24.317219] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-10T17:56:24.317273] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-10T17:56:24.663222] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:56:25.089399] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-10T17:56:25.531999] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-10T17:56:25.537995] [INFO ] [REMOTE ] CC: Full fetch complete (75728 records). [2025-10-10T17:56:25.538188] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-10T17:56:25.667461] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-10T17:56:25.894748] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-10T17:56:26.085240] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-10T17:56:26.085380] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-10T17:56:26.087122] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-10T17:56:26.087304] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-10T17:56:26.089766] [DEBUG] [LOCAL ] CC: Trimmed 75728 records to 53769 (keeping 200 days of data) [2025-10-10T17:56:26.405585] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-10T17:56:26.574467] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-10T17:56:26.580581] [DEBUG] [LOCAL ] CC: Primary data saved (53769 records). [2025-10-10T17:56:26.595138] [INFO ] [MAIN ] CC: Full history saved. [2025-10-10T17:56:26.595906] [INFO ] [MAIN ] Update Progress: 410/2373 symbols completed. CC took 36.3s. Estimated remaining: 4h 29m 55s. Rate: 7.3 symbols/min [2025-10-10T17:56:26.694850] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-10T17:56:26.792556] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:56:26.848754] [DEBUG] [LOCAL ] CCJ: Loaded 54065 existing records from primary storage. [2025-10-10T17:56:26.849171] [INFO ] [MAIN ] CCJ: Loaded 54065 existing records. [2025-10-10T17:56:27.026185] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:56:27.026575] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-10T17:56:27.026635] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-10T17:56:27.027951] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-10T17:56:27.028013] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-10T17:56:27.304947] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-10T17:56:27.401747] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:56:27.489432] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-10T17:56:28.289426] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-10T17:56:29.089400] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-10T17:56:29.613551] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-10T17:56:29.681059] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-10T17:56:29.701276] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T17:56:29.889386] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-10T17:56:30.191706] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-10T17:56:30.689411] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-10T17:56:31.489410] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-10T17:56:32.289345] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-10T17:56:32.509634] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-10T17:56:32.699042] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-10T17:56:32.701176] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T17:56:32.702239] [INFO ] [REMOTE ] CCIA: Full fetch complete (2161 records). [2025-10-10T17:56:32.712926] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-10T17:56:32.889922] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-10T17:56:32.890168] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:56:32.890239] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:56:32.890329] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-10T17:56:32.890416] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-10T17:56:32.890471] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-10T17:56:32.890515] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-10T17:56:32.890572] [INFO ] [MAIN ] Update Progress: 411/2373 symbols completed. CCIA took 18.1s. Estimated remaining: 4h 29m 37s. Rate: 7.3 symbols/min [2025-10-10T17:56:33.060871] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:56:33.089390] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-10T17:56:33.106000] [DEBUG] [LOCAL ] CCK: Loaded 46656 existing records from primary storage. [2025-10-10T17:56:33.106342] [INFO ] [MAIN ] CCK: Loaded 46656 existing records. [2025-10-10T17:56:33.279558] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:56:33.279853] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-10T17:56:33.279903] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-10T17:56:33.280428] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-10T17:56:33.280485] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-10T17:56:33.651290] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:56:33.889386] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-10T17:56:34.026084] [DEBUG] [REMOTE ] CCK: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-10T17:56:34.026426] [WARN ] [REMOTE ] CCK: No data returned for month 2024-12 [2025-10-10T17:56:34.026519] [FATAL] [REMOTE ] CCK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:56:34.026592] [FATAL] [MAIN ] CCK: Failed to fetch primary data. [2025-10-10T17:56:34.026687] [WARN ] [MAIN ] CCK: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:56:34.026760] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-10T17:56:34.026827] [DEBUG] [LOCAL ] CCK: No primary data file found to delete. [2025-10-10T17:56:34.026864] [INFO ] [LOCAL ] CCK: Starting deletion of derivative data. [2025-10-10T17:56:34.027050] [DEBUG] [LOCAL ] CCK: Deleted derivative data file. [2025-10-10T17:56:34.027149] [INFO ] [MAIN ] Update Progress: 412/2373 symbols completed. CCK took 1.1s. Estimated remaining: 4h 28m 55s. Rate: 7.3 symbols/min [2025-10-10T17:56:34.236970] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:56:34.292101] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-10-10T17:56:34.292503] [INFO ] [MAIN ] CCL: Loaded 54190 existing records. [2025-10-10T17:56:34.477553] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:56:34.477838] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-10T17:56:34.477885] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-10T17:56:34.478129] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-10T17:56:34.478183] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-10T17:56:34.694556] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-10T17:56:34.835723] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:56:35.032080] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T17:56:35.489455] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-10T17:56:35.885500] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-10T17:56:36.289375] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-10T17:56:37.089391] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-10T17:56:37.337772] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-10T17:56:37.748171] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-10T17:56:37.889419] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-10T17:56:38.689422] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-10T17:56:39.443729] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-10T17:56:39.489367] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-10T17:56:39.568924] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-10T17:56:40.289426] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-10T17:56:40.403322] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-10T17:56:40.466125] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-10T17:56:41.089489] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-10T17:56:41.892875] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-10T17:56:41.900416] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-10T17:56:42.225635] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T17:56:42.689388] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-10T17:56:43.489482] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-10T17:56:44.206613] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-10T17:56:44.289384] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-10T17:56:44.590727] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T17:56:45.089407] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-10T17:56:45.397072] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-10T17:56:45.752714] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-10T17:56:45.889367] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-10T17:56:46.680557] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-10T17:56:46.691444] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-10T17:56:47.489415] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-10T17:56:47.858236] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T17:56:48.066992] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-10T17:56:48.289384] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-10T17:56:49.089435] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-10T17:56:49.163386] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-10T17:56:49.168565] [INFO ] [REMOTE ] CCI: Full fetch complete (76980 records). [2025-10-10T17:56:49.168734] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-10T17:56:49.552577] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-10T17:56:49.552832] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-10T17:56:49.553764] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-10T17:56:49.553827] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-10T17:56:49.555398] [DEBUG] [LOCAL ] CCI: Trimmed 76980 records to 53905 (keeping 200 days of data) [2025-10-10T17:56:49.890040] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-10T17:56:49.895811] [DEBUG] [LOCAL ] CCI: Primary data saved (53905 records). [2025-10-10T17:56:49.895951] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-10T17:56:49.896040] [INFO ] [MAIN ] Update Progress: 413/2373 symbols completed. CCI took 35.6s. Estimated remaining: 4h 29m 23s. Rate: 7.3 symbols/min [2025-10-10T17:56:50.062467] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:56:50.105996] [DEBUG] [LOCAL ] CCO: Loaded 48377 existing records from primary storage. [2025-10-10T17:56:50.106472] [INFO ] [MAIN ] CCO: Loaded 48377 existing records. [2025-10-10T17:56:50.298851] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:56:50.299149] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-10T17:56:50.299311] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-10T17:56:50.300110] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-10T17:56:50.300173] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-10T17:56:50.428016] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-10T17:56:50.693617] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-10T17:56:50.736854] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-10T17:56:50.733757] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:56:51.489386] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-10T17:56:51.738944] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T17:56:51.741226] [INFO ] [REMOTE ] CCIF: Full fetch complete (21899 records). [2025-10-10T17:56:51.741351] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-10T17:56:52.111528] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-10T17:56:52.111705] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-10T17:56:52.112235] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-10T17:56:52.112278] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-10T17:56:52.112964] [DEBUG] [LOCAL ] CCIF: Trimmed 21899 records to 15808 (keeping 200 days of data) [2025-10-10T17:56:52.210919] [DEBUG] [LOCAL ] CCIF: Primary data saved (15808 records). [2025-10-10T17:56:52.211153] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-10T17:56:52.211329] [INFO ] [MAIN ] Update Progress: 414/2373 symbols completed. CCIF took 28.2s. Estimated remaining: 4h 28m 47s. Rate: 7.3 symbols/min [2025-10-10T17:56:52.294570] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-10T17:56:52.401690] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:56:52.414945] [DEBUG] [LOCAL ] CCRD: Loaded 9287 existing records from primary storage. [2025-10-10T17:56:52.415272] [INFO ] [MAIN ] CCRD: Loaded 9287 existing records. [2025-10-10T17:56:52.595002] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:56:52.595379] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-10T17:56:52.595466] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-10T17:56:52.595872] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-10T17:56:52.595995] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-10T17:56:52.757293] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-10-10T17:56:53.018286] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:56:53.054677] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-10T17:56:53.089365] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-10T17:56:53.765151] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-10T17:56:53.889418] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-10T17:56:54.619149] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-10T17:56:54.641223] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-10T17:56:54.689377] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-10T17:56:55.489390] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-10T17:56:56.289423] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-10T17:56:56.940464] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-10T17:56:57.063870] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-10T17:56:57.087823] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-10T17:56:57.090945] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-10T17:56:57.805211] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-10T17:56:57.889340] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-10T17:56:58.689433] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-10T17:56:59.489390] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-10T17:57:00.289393] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-10T17:57:00.615177] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-10T17:57:00.792464] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T17:57:01.010882] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-10T17:57:01.051945] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-10T17:57:01.089363] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-10T17:57:01.889418] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-10T17:57:02.015519] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-10T17:57:02.689389] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-10T17:57:03.489389] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-10T17:57:03.714056] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-10T17:57:04.289396] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-10T17:57:04.658998] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-10T17:57:05.089391] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-10T17:57:05.398898] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T17:57:05.476612] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T17:57:05.889405] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-10T17:57:06.689409] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-10T17:57:07.219226] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-10T17:57:07.489570] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-10T17:57:07.553883] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-10T17:57:07.713459] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T17:57:08.289422] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-10T17:57:08.876524] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-10T17:57:09.089379] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-10T17:57:09.889362] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-10T17:57:09.973380] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-10T17:57:10.311532] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-10T17:57:10.689371] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-10T17:57:11.465021] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T17:57:11.466345] [INFO ] [REMOTE ] CCRD: Full fetch complete (11801 records). [2025-10-10T17:57:11.466414] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-10T17:57:11.500022] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-10T17:57:11.843245] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-10T17:57:11.843329] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-10T17:57:11.843626] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-10T17:57:11.843701] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-10T17:57:11.844140] [DEBUG] [LOCAL ] CCRD: Trimmed 11801 records to 9338 (keeping 200 days of data) [2025-10-10T17:57:11.900354] [DEBUG] [LOCAL ] CCRD: Primary data saved (9338 records). [2025-10-10T17:57:11.900524] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-10T17:57:11.900613] [INFO ] [MAIN ] Update Progress: 415/2373 symbols completed. CCRD took 19.7s. Estimated remaining: 4h 29m 33s. Rate: 7.3 symbols/min [2025-10-10T17:57:12.073512] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:57:12.105070] [DEBUG] [LOCAL ] CCS: Loaded 30479 existing records from primary storage. [2025-10-10T17:57:12.105369] [INFO ] [MAIN ] CCS: Loaded 30479 existing records. [2025-10-10T17:57:12.300728] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:57:12.294699] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-10T17:57:12.302363] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-10T17:57:12.302440] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-10T17:57:12.302800] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-10T17:57:12.302861] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-10T17:57:12.745370] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:57:12.752764] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-10T17:57:13.089361] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-10T17:57:13.414990] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T17:57:13.889379] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-10T17:57:14.689479] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-10T17:57:14.976555] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-10T17:57:14.984324] [INFO ] [REMOTE ] CCJ: Full fetch complete (77684 records). [2025-10-10T17:57:14.984510] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-10T17:57:15.410810] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-10T17:57:15.411014] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-10T17:57:15.412110] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-10T17:57:15.412198] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-10T17:57:15.445365] [DEBUG] [LOCAL ] CCJ: Trimmed 77684 records to 54455 (keeping 200 days of data) [2025-10-10T17:57:15.447305] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-10T17:57:15.514710] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-10T17:57:15.754059] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T17:57:15.859669] [DEBUG] [LOCAL ] CCJ: Primary data saved (54455 records). [2025-10-10T17:57:15.859866] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-10T17:57:15.859975] [INFO ] [MAIN ] Update Progress: 416/2373 symbols completed. CCJ took 49.3s. Estimated remaining: 4h 29m 4s. Rate: 7.3 symbols/min [2025-10-10T17:57:16.076691] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:57:16.102341] [DEBUG] [LOCAL ] CCU: Loaded 22934 existing records from primary storage. [2025-10-10T17:57:16.102700] [INFO ] [MAIN ] CCU: Loaded 22934 existing records. [2025-10-10T17:57:16.290116] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-10T17:57:16.308671] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T17:57:16.314918] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:57:16.322854] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-10T17:57:16.322917] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-10T17:57:16.323791] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-10T17:57:16.323855] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-10T17:57:16.699139] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:57:17.089436] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-10T17:57:17.494905] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T17:57:17.889398] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-10T17:57:18.125930] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T17:57:18.572047] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T17:57:18.689452] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-10T17:57:19.475471] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-10T17:57:19.489326] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-10T17:57:20.289350] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-10T17:57:20.412733] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-10T17:57:20.418530] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-10-10T17:57:20.418752] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-10T17:57:20.699271] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T17:57:20.870556] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-10T17:57:20.870680] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-10T17:57:20.871672] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-10T17:57:20.871737] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-10T17:57:20.873803] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 54580 (keeping 200 days of data) [2025-10-10T17:57:21.097494] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-10T17:57:21.203531] [DEBUG] [LOCAL ] CCL: Primary data saved (54580 records). [2025-10-10T17:57:21.203742] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-10T17:57:21.204592] [INFO ] [MAIN ] Update Progress: 417/2373 symbols completed. CCL took 47.2s. Estimated remaining: 4h 28m 43s. Rate: 7.3 symbols/min [2025-10-10T17:57:21.373066] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:57:21.373284] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-10T17:57:21.373325] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-10T17:57:21.373460] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-10T17:57:21.373512] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-10T17:57:21.373564] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-10T17:57:21.373599] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-10T17:57:21.737487] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:57:21.889411] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-10T17:57:22.201708] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T17:57:22.353141] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-10T17:57:22.682933] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T17:57:22.689629] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-10T17:57:23.489404] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-10T17:57:23.753875] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-10T17:57:23.779523] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-10T17:57:24.289382] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-10T17:57:24.533924] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-10T17:57:25.089438] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-10T17:57:25.889410] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-10T17:57:26.600922] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-10T17:57:26.689387] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-10T17:57:27.469107] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T17:57:27.489348] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-10T17:57:28.236467] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T17:57:28.289422] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-10T17:57:28.494819] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-10-10T17:57:28.516401] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-10T17:57:29.089423] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-10T17:57:29.889382] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-10T17:57:30.261083] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-10T17:57:30.335757] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-10T17:57:30.689392] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-10T17:57:31.489356] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-10T17:57:31.881268] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-10T17:57:32.289394] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-10T17:57:33.076753] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-10T17:57:33.089320] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-10T17:57:33.541753] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-10T17:57:33.889378] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-10T17:57:34.082289] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-10T17:57:34.535266] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-10T17:57:34.689372] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-10T17:57:35.036320] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-10T17:57:35.489438] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-10T17:57:36.289454] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-10T17:57:36.670890] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T17:57:37.089426] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-10T17:57:37.350773] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:57:37.351113] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-10T17:57:37.351203] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:57:37.351284] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-10T17:57:37.351346] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:57:37.351417] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-10T17:57:37.351480] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-10T17:57:37.351517] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-10T17:57:37.351557] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-10T17:57:37.351620] [INFO ] [MAIN ] Update Progress: 418/2373 symbols completed. CCZ took 16.1s. Estimated remaining: 4h 29m 11s. Rate: 7.3 symbols/min [2025-10-10T17:57:37.520538] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:57:37.573964] [DEBUG] [LOCAL ] CDE: Loaded 54032 existing records from primary storage. [2025-10-10T17:57:37.574292] [INFO ] [MAIN ] CDE: Loaded 54032 existing records. [2025-10-10T17:57:37.757800] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:57:37.758004] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-10T17:57:37.758050] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-10T17:57:37.758521] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-10T17:57:37.758576] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-10T17:57:37.915178] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-10T17:57:38.120059] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:57:38.230534] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T17:57:38.689391] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-10T17:57:39.186010] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-10T17:57:39.489405] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-10T17:57:40.289381] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-10T17:57:40.755054] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-10T17:57:41.099228] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-10T17:57:41.102015] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-10T17:57:41.889389] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-10T17:57:41.976673] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-10T17:57:41.988596] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-10T17:57:41.988192] [INFO ] [REMOTE ] CCO: Full fetch complete (66836 records). [2025-10-10T17:57:41.990927] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-10T17:57:41.991249] [INFO ] [REMOTE ] CCU: Full fetch complete (32385 records). [2025-10-10T17:57:41.991362] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-10T17:57:42.694360] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-10T17:57:42.893296] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-10T17:57:42.902218] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-10T17:57:42.902356] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-10T17:57:42.903074] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-10T17:57:42.902000] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-10T17:57:42.903167] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-10T17:57:42.904525] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-10T17:57:42.904958] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-10T17:57:42.905869] [DEBUG] [LOCAL ] CCU: Trimmed 32385 records to 23079 (keeping 200 days of data) [2025-10-10T17:57:42.908011] [DEBUG] [LOCAL ] CCO: Trimmed 66836 records to 48697 (keeping 200 days of data) [2025-10-10T17:57:43.276156] [DEBUG] [LOCAL ] CCU: Primary data saved (23079 records). [2025-10-10T17:57:43.279691] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-10T17:57:43.280103] [INFO ] [MAIN ] Update Progress: 419/2373 symbols completed. CCU took 27.4s. Estimated remaining: 4h 28m 52s. Rate: 7.3 symbols/min [2025-10-10T17:57:43.506305] [DEBUG] [LOCAL ] CCO: Primary data saved (48697 records). [2025-10-10T17:57:43.511733] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-10T17:57:43.572539] [INFO ] [MAIN ] Update Progress: 420/2373 symbols completed. CCO took 53.7s. Estimated remaining: 4h 28m 7s. Rate: 7.3 symbols/min [2025-10-10T17:57:43.578597] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:57:43.733730] [DEBUG] [LOCAL ] CDLR: Loaded 9990 existing records from primary storage. [2025-10-10T17:57:43.757324] [INFO ] [MAIN ] CDLR: Loaded 9990 existing records. [2025-10-10T17:57:43.792451] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:57:44.047190] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:57:44.054014] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-10T17:57:44.054182] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-10T17:57:44.056242] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-10T17:57:44.056329] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-10T17:57:44.075230] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-10T17:57:44.101215] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-10T17:57:44.098162] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-10T17:57:44.229263] [DEBUG] [LOCAL ] CDP: Loaded 42803 existing records from primary storage. [2025-10-10T17:57:44.246432] [INFO ] [MAIN ] CDP: Loaded 42803 existing records. [2025-10-10T17:57:44.323917] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-10T17:57:44.719886] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:57:44.738167] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-10T17:57:44.756982] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-10T17:57:44.761190] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:57:44.762795] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-10T17:57:44.762896] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-10T17:57:45.103142] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-10T17:57:45.149044] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:57:45.722670] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-10T17:57:45.889364] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-10T17:57:45.942405] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-10T17:57:45.981966] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-10T17:57:46.689379] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-10T17:57:47.323951] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T17:57:47.327266] [INFO ] [REMOTE ] CCS: Full fetch complete (44826 records). [2025-10-10T17:57:47.327406] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-10T17:57:47.499627] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-10T17:57:47.770123] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-10T17:57:47.770209] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-10T17:57:47.770944] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-10T17:57:47.771009] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-10T17:57:47.772187] [DEBUG] [LOCAL ] CCS: Trimmed 44826 records to 30681 (keeping 200 days of data) [2025-10-10T17:57:47.966190] [DEBUG] [LOCAL ] CCS: Primary data saved (30681 records). [2025-10-10T17:57:47.966380] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-10T17:57:47.966485] [INFO ] [MAIN ] Update Progress: 421/2373 symbols completed. CCS took 36.1s. Estimated remaining: 4h 27m 41s. Rate: 7.3 symbols/min [2025-10-10T17:57:48.147302] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:57:48.173342] [DEBUG] [LOCAL ] CDRE: Loaded 24827 existing records from primary storage. [2025-10-10T17:57:48.173662] [INFO ] [MAIN ] CDRE: Loaded 24827 existing records. [2025-10-10T17:57:48.294523] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-10T17:57:48.355039] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-10T17:57:48.389116] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:57:48.389459] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-10T17:57:48.389574] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-10T17:57:48.390604] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-10T17:57:48.390737] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-10T17:57:48.779345] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T17:57:48.805559] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:57:49.089410] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-10T17:57:49.889360] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-10T17:57:50.176977] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T17:57:50.276458] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T17:57:50.602230] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T17:57:50.689348] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-10T17:57:51.489380] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-10T17:57:52.289424] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-10T17:57:52.586869] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-10T17:57:52.932037] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-10T17:57:53.089361] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-10T17:57:53.438885] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-10T17:57:53.889382] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-10T17:57:54.689391] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-10T17:57:55.156538] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-10T17:57:55.206545] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-10T17:57:55.489387] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-10T17:57:55.787916] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-10T17:57:56.289375] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-10T17:57:56.319751] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-10T17:57:57.089472] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-10T17:57:57.739295] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-10T17:57:57.889380] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-10T17:57:58.289559] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-10T17:57:58.500714] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-10T17:57:58.689385] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-10T17:57:59.489341] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-10T17:57:59.914254] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T17:58:00.289409] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-10T17:58:01.018244] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-10T17:58:01.089398] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-10T17:58:01.786749] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T17:58:01.889382] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-10T17:58:02.303071] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T17:58:02.689372] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-10T17:58:03.489391] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-10T17:58:03.583450] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-10T17:58:04.246692] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-10T17:58:04.289344] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-10T17:58:04.639840] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T17:58:05.089382] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-10T17:58:05.889383] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-10T17:58:06.096343] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-10T17:58:06.664363] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-10T17:58:06.689341] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-10T17:58:07.082264] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-10T17:58:07.489378] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-10T17:58:08.289394] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-10T17:58:08.333673] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-10T17:58:09.089445] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-10T17:58:09.140492] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-10T17:58:09.147167] [INFO ] [REMOTE ] CDE: Full fetch complete (77596 records). [2025-10-10T17:58:09.147381] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-10T17:58:09.505550] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T17:58:09.615547] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-10T17:58:09.615697] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-10T17:58:09.616908] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-10T17:58:09.616991] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-10T17:58:09.619180] [DEBUG] [LOCAL ] CDE: Trimmed 77596 records to 54422 (keeping 200 days of data) [2025-10-10T17:58:09.916078] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-10T17:58:09.975930] [DEBUG] [LOCAL ] CDE: Primary data saved (54422 records). [2025-10-10T17:58:09.976149] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-10T17:58:09.977028] [INFO ] [MAIN ] Update Progress: 422/2373 symbols completed. CDE took 32.6s. Estimated remaining: 4h 28m 36s. Rate: 7.3 symbols/min [2025-10-10T17:58:10.143626] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:58:10.193700] [DEBUG] [LOCAL ] CE: Loaded 51809 existing records from primary storage. [2025-10-10T17:58:10.194094] [INFO ] [MAIN ] CE: Loaded 51809 existing records. [2025-10-10T17:58:10.369631] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:58:10.369903] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-10T17:58:10.369961] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-10T17:58:10.370183] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-10T17:58:10.370240] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-10T17:58:10.697428] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-10T17:58:10.741902] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:58:10.770270] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-10T17:58:10.928739] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-10T17:58:10.930687] [INFO ] [REMOTE ] CDLR: Full fetch complete (13642 records). [2025-10-10T17:58:10.930761] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-10T17:58:11.319435] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-10T17:58:11.319521] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-10T17:58:11.319935] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-10T17:58:11.319996] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-10T17:58:11.320452] [DEBUG] [LOCAL ] CDLR: Trimmed 13642 records to 10107 (keeping 200 days of data) [2025-10-10T17:58:11.379529] [DEBUG] [LOCAL ] CDLR: Primary data saved (10107 records). [2025-10-10T17:58:11.379722] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-10T17:58:11.379832] [INFO ] [MAIN ] Update Progress: 423/2373 symbols completed. CDLR took 28.1s. Estimated remaining: 4h 27m 56s. Rate: 7.3 symbols/min [2025-10-10T17:58:11.494518] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-10T17:58:11.558122] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:58:11.567513] [DEBUG] [LOCAL ] CEE: Loaded 5657 existing records from primary storage. [2025-10-10T17:58:11.568181] [INFO ] [MAIN ] CEE: Loaded 5657 existing records. [2025-10-10T17:58:11.747456] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:58:11.747972] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-10T17:58:11.748258] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-10T17:58:11.748606] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-10T17:58:11.748711] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-10T17:58:12.049685] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T17:58:12.131167] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:58:12.289373] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-10T17:58:13.089367] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-10T17:58:13.592181] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T17:58:13.639574] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-10T17:58:13.889360] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-10T17:58:14.689412] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-10T17:58:14.888035] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-10T17:58:15.489380] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-10T17:58:15.621249] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-10T17:58:15.908223] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T17:58:16.289399] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-10T17:58:16.314866] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-10T17:58:17.089397] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-10T17:58:17.781884] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-10T17:58:17.889364] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-10T17:58:18.261970] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-10T17:58:18.689384] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-10T17:58:19.489371] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-10T17:58:19.578843] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-10T17:58:19.604575] [INFO ] [REMOTE ] CDRE: Full fetch complete (35091 records). [2025-10-10T17:58:19.604883] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-10T17:58:19.612444] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T17:58:19.994002] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-10T17:58:19.994096] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-10T17:58:19.994635] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-10T17:58:19.994716] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-10T17:58:19.995554] [DEBUG] [LOCAL ] CDRE: Trimmed 35091 records to 25069 (keeping 200 days of data) [2025-10-10T17:58:20.113931] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-10T17:58:20.156975] [DEBUG] [LOCAL ] CDRE: Primary data saved (25069 records). [2025-10-10T17:58:20.157122] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-10T17:58:20.157205] [INFO ] [MAIN ] Update Progress: 424/2373 symbols completed. CDRE took 32.2s. Estimated remaining: 4h 27m 51s. Rate: 7.3 symbols/min [2025-10-10T17:58:20.298492] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-10T17:58:20.323739] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:58:20.351793] [DEBUG] [LOCAL ] CEPU: Loaded 26302 existing records from primary storage. [2025-10-10T17:58:20.352091] [INFO ] [MAIN ] CEPU: Loaded 26302 existing records. [2025-10-10T17:58:20.522585] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:58:20.522866] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-10T17:58:20.522916] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-10T17:58:20.523108] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-10T17:58:20.523147] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-10T17:58:20.872383] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:58:21.089379] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-10T17:58:21.889980] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-10T17:58:22.077233] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T17:58:22.667391] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-10T17:58:22.689336] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-10T17:58:23.489578] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-10T17:58:23.757912] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T17:58:24.246878] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-10T17:58:24.289421] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-10T17:58:24.599922] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-10T17:58:25.089403] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-10T17:58:25.889402] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-10T17:58:26.047470] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T17:58:26.377989] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T17:58:26.689403] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-10T17:58:27.196610] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-10T17:58:27.489358] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-10T17:58:27.996274] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-10T17:58:28.289349] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-10T17:58:28.503178] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-10T17:58:29.089463] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-10T17:58:29.889386] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-10T17:58:30.053943] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T17:58:30.403680] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T17:58:30.689376] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-10T17:58:31.489421] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-10T17:58:31.975980] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-10T17:58:32.092454] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-10T17:58:32.237176] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-10T17:58:32.289409] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-10T17:58:33.089429] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-10T17:58:33.094881] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-10T17:58:33.889409] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-10T17:58:34.594156] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-10T17:58:34.689417] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-10T17:58:35.022910] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T17:58:35.393035] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-10T17:58:35.489403] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-10T17:58:36.289392] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-10T17:58:37.089360] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-10T17:58:37.409300] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T17:58:37.606789] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T17:58:37.889388] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-10T17:58:38.689353] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-10T17:58:38.906738] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-10T17:58:38.910873] [INFO ] [REMOTE ] CDP: Full fetch complete (61681 records). [2025-10-10T17:58:38.911006] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-10T17:58:39.295305] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-10T17:58:39.295462] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-10T17:58:39.296255] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-10T17:58:39.296342] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-10T17:58:39.297763] [DEBUG] [LOCAL ] CDP: Trimmed 61681 records to 43086 (keeping 200 days of data) [2025-10-10T17:58:39.395124] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-10T17:58:39.490055] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-10T17:58:39.569791] [DEBUG] [LOCAL ] CDP: Primary data saved (43086 records). [2025-10-10T17:58:39.569942] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-10T17:58:39.570080] [INFO ] [MAIN ] Update Progress: 425/2373 symbols completed. CDP took 56.0s. Estimated remaining: 4h 28m 34s. Rate: 7.3 symbols/min [2025-10-10T17:58:39.742477] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:58:39.791897] [DEBUG] [LOCAL ] CF: Loaded 52500 existing records from primary storage. [2025-10-10T17:58:39.792234] [INFO ] [MAIN ] CF: Loaded 52500 existing records. [2025-10-10T17:58:39.949161] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-10T17:58:39.975819] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:58:39.977931] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-10T17:58:39.978353] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-10T17:58:39.978682] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-10T17:58:39.978741] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-10T17:58:40.106882] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-10T17:58:40.290916] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-10T17:58:40.369524] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:58:40.906488] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T17:58:40.907524] [INFO ] [REMOTE ] CEE: Full fetch complete (10147 records). [2025-10-10T17:58:40.907596] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-10T17:58:41.092503] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-10T17:58:41.322050] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-10T17:58:41.322162] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-10T17:58:41.322486] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-10T17:58:41.322527] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-10T17:58:41.322958] [DEBUG] [LOCAL ] CEE: Trimmed 10147 records to 5690 (keeping 200 days of data) [2025-10-10T17:58:41.355820] [DEBUG] [LOCAL ] CEE: Primary data saved (5690 records). [2025-10-10T17:58:41.355966] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-10T17:58:41.356050] [INFO ] [MAIN ] Update Progress: 426/2373 symbols completed. CEE took 30.0s. Estimated remaining: 4h 27m 56s. Rate: 7.3 symbols/min [2025-10-10T17:58:41.521145] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:58:41.572920] [DEBUG] [LOCAL ] CFG: Loaded 54013 existing records from primary storage. [2025-10-10T17:58:41.573324] [INFO ] [MAIN ] CFG: Loaded 54013 existing records. [2025-10-10T17:58:41.756881] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:58:41.757109] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-10T17:58:41.757156] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-10T17:58:41.757487] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-10T17:58:41.757543] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-10T17:58:41.894506] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-10T17:58:42.112792] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:58:42.533565] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T17:58:42.689386] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-10T17:58:43.489449] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-10T17:58:43.855401] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T17:58:44.194114] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-10T17:58:44.289409] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-10T17:58:44.936284] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-10T17:58:45.089403] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-10T17:58:45.889383] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-10T17:58:46.252415] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-10T17:58:46.689433] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-10T17:58:47.014297] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-10T17:58:47.489397] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-10T17:58:47.788174] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T17:58:47.793564] [INFO ] [REMOTE ] CE: Full fetch complete (74761 records). [2025-10-10T17:58:47.794001] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-10T17:58:47.940224] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-10T17:58:47.998209] [INFO ] [REMOTE ] CEPU: Full fetch complete (39420 records). [2025-10-10T17:58:48.005471] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-10T17:58:48.289931] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-10T17:58:48.433555] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-10T17:58:48.442786] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-10T17:58:48.459100] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-10T17:58:48.524118] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-10T17:58:48.585171] [DEBUG] [LOCAL ] CE: Trimmed 74761 records to 52193 (keeping 200 days of data) [2025-10-10T17:58:48.712128] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-10T17:58:48.713581] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-10T17:58:48.741496] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-10T17:58:48.743105] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-10T17:58:48.748881] [DEBUG] [LOCAL ] CEPU: Trimmed 39420 records to 26570 (keeping 200 days of data) [2025-10-10T17:58:49.006284] [DEBUG] [LOCAL ] CEPU: Primary data saved (26570 records). [2025-10-10T17:58:49.034474] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-10T17:58:49.035002] [INFO ] [MAIN ] Update Progress: 427/2373 symbols completed. CEPU took 28.9s. Estimated remaining: 4h 27m 45s. Rate: 7.3 symbols/min [2025-10-10T17:58:49.246801] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:58:49.249923] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-10T17:58:49.251031] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-10T17:58:49.255179] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-10T17:58:49.256551] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-10T17:58:49.257688] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-10T17:58:49.257844] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-10T17:58:49.703839] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-10T17:58:49.749942] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-10T17:58:49.791920] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:58:49.797595] [DEBUG] [LOCAL ] CE: Primary data saved (52193 records). [2025-10-10T17:58:49.797809] [INFO ] [MAIN ] CE: Full history saved. [2025-10-10T17:58:49.797914] [INFO ] [MAIN ] Update Progress: 428/2373 symbols completed. CE took 39.8s. Estimated remaining: 4h 27m 2s. Rate: 7.3 symbols/min [2025-10-10T17:58:49.898840] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-10T17:58:49.984582] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:58:50.023867] [DEBUG] [LOCAL ] CFR: Loaded 33080 existing records from primary storage. [2025-10-10T17:58:50.024304] [INFO ] [MAIN ] CFR: Loaded 33080 existing records. [2025-10-10T17:58:50.196301] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T17:58:50.215850] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-10T17:58:50.239961] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:58:50.240393] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T17:58:50.241320] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-10T17:58:50.241051] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-10T17:58:50.241491] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T17:58:50.241849] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-10T17:58:50.241722] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-10T17:58:50.242217] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-10T17:58:50.242417] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-10T17:58:50.242549] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-10T17:58:50.242741] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-10T17:58:50.242677] [INFO ] [MAIN ] Update Progress: 429/2373 symbols completed. CFND took 1.2s. Estimated remaining: 4h 26m 19s. Rate: 7.3 symbols/min [2025-10-10T17:58:50.242965] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-10T17:58:50.516444] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-10T17:58:50.633441] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:58:50.694776] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-10T17:58:50.908222] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:58:50.911513] [DEBUG] [LOCAL ] CGAU: Loaded 43452 existing records from primary storage. [2025-10-10T17:58:50.912031] [INFO ] [MAIN ] CGAU: Loaded 43452 existing records. [2025-10-10T17:58:51.087136] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:58:51.087382] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-10T17:58:51.087433] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-10T17:58:51.087748] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-10T17:58:51.087806] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-10T17:58:51.446217] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:58:51.489357] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-10T17:58:51.646843] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T17:58:52.289365] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-10T17:58:52.798292] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-10T17:58:53.076982] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T17:58:53.089336] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-10T17:58:53.526017] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T17:58:53.889417] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-10T17:58:54.674708] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T17:58:54.689337] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-10T17:58:55.489376] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-10T17:58:55.761354] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T17:58:56.222193] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-10T17:58:56.289357] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-10T17:58:56.499959] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-10T17:58:57.089382] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-10T17:58:57.515239] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-10T17:58:57.889367] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-10T17:58:58.689434] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-10T17:58:59.412271] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-10T17:58:59.494435] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-10T17:58:59.506632] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T17:59:00.289408] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-10T17:59:00.775495] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-10T17:59:01.089409] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-10T17:59:01.704988] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-10T17:59:01.889384] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-10T17:59:02.036303] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T17:59:02.337851] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-10T17:59:02.689399] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-10T17:59:03.489366] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-10T17:59:03.833694] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T17:59:04.289448] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-10T17:59:04.559147] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T17:59:05.089351] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-10T17:59:05.201803] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T17:59:05.889448] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-10T17:59:06.439776] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T17:59:06.481685] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-10T17:59:06.689403] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-10T17:59:07.316904] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-10T17:59:07.489455] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-10T17:59:08.289434] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-10T17:59:08.410702] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T17:59:08.940304] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T17:59:09.089457] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-10T17:59:09.866108] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-10T17:59:09.889340] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-10T17:59:10.670203] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-10T17:59:10.689331] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-10T17:59:11.489434] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-10T17:59:12.018895] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-10T17:59:12.289388] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-10T17:59:12.667136] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T17:59:13.089376] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-10T17:59:13.122638] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-10T17:59:13.889397] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-10T17:59:14.007096] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T17:59:14.689420] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-10T17:59:14.793675] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-10T17:59:15.489398] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-10T17:59:15.786121] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T17:59:15.791241] [INFO ] [REMOTE ] CFG: Full fetch complete (77185 records). [2025-10-10T17:59:15.791411] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-10T17:59:15.792454] [FATAL] [VALIDATOR ] CFG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T17:59:15.792551] [FATAL] [MAIN ] CFG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T17:59:15.792597] [WARN ] [MAIN ] CFG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T17:59:15.792639] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-10T17:59:15.792752] [DEBUG] [LOCAL ] CFG: No primary data file found to delete. [2025-10-10T17:59:15.792793] [INFO ] [LOCAL ] CFG: Starting deletion of derivative data. [2025-10-10T17:59:15.793065] [DEBUG] [LOCAL ] CFG: Deleted derivative data file. [2025-10-10T17:59:15.793171] [INFO ] [MAIN ] Update Progress: 430/2373 symbols completed. CFG took 34.4s. Estimated remaining: 4h 27m 29s. Rate: 7.3 symbols/min [2025-10-10T17:59:15.973345] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:59:15.977688] [DEBUG] [LOCAL ] CGV: Loaded 1399 existing records from primary storage. [2025-10-10T17:59:15.977852] [INFO ] [MAIN ] CGV: Loaded 1399 existing records. [2025-10-10T17:59:16.179451] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:59:16.179800] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-10T17:59:16.179856] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-10T17:59:16.180862] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-10T17:59:16.180944] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-10T17:59:16.294579] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-10T17:59:16.585625] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:59:16.670930] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T17:59:17.089447] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-10T17:59:17.383837] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T17:59:17.647232] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T17:59:17.889388] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-10T17:59:18.545055] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T17:59:18.689405] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-10T17:59:19.159988] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-10T17:59:19.489401] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-10T17:59:19.851823] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T17:59:20.289406] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-10T17:59:20.896143] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-10T17:59:20.899796] [INFO ] [REMOTE ] CFR: Full fetch complete (48187 records). [2025-10-10T17:59:20.899978] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-10T17:59:21.095305] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-10T17:59:21.399434] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-10T17:59:21.399583] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-10T17:59:21.401107] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-10T17:59:21.401237] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-10T17:59:21.403307] [DEBUG] [LOCAL ] CFR: Trimmed 48187 records to 33311 (keeping 200 days of data) [2025-10-10T17:59:21.724282] [DEBUG] [LOCAL ] CFR: Primary data saved (33311 records). [2025-10-10T17:59:21.724489] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-10T17:59:21.724601] [INFO ] [MAIN ] Update Progress: 431/2373 symbols completed. CFR took 31.9s. Estimated remaining: 4h 27m 10s. Rate: 7.3 symbols/min [2025-10-10T17:59:21.830585] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-10T17:59:21.893689] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-10T17:59:21.989961] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:59:22.020528] [DEBUG] [LOCAL ] CHCT: Loaded 24068 existing records from primary storage. [2025-10-10T17:59:22.020942] [INFO ] [MAIN ] CHCT: Loaded 24068 existing records. [2025-10-10T17:59:22.222381] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:59:22.222661] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-10T17:59:22.222729] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-10T17:59:22.223047] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-10T17:59:22.223107] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-10T17:59:22.486463] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-10T17:59:22.562733] [INFO ] [REMOTE ] CF: Full fetch complete (75256 records). [2025-10-10T17:59:22.563770] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-10T17:59:22.742061] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:59:22.742149] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-10T17:59:23.100579] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-10T17:59:23.100706] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-10T17:59:23.101689] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-10T17:59:23.101754] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-10T17:59:23.103683] [DEBUG] [LOCAL ] CF: Trimmed 75256 records to 52873 (keeping 200 days of data) [2025-10-10T17:59:23.349261] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-10T17:59:23.471304] [DEBUG] [LOCAL ] CF: Primary data saved (52873 records). [2025-10-10T17:59:23.471527] [INFO ] [MAIN ] CF: Full history saved. [2025-10-10T17:59:23.471666] [INFO ] [MAIN ] Update Progress: 432/2373 symbols completed. CF took 43.9s. Estimated remaining: 4h 26m 33s. Rate: 7.3 symbols/min [2025-10-10T17:59:23.494566] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-10T17:59:23.662728] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:59:23.678189] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T17:59:23.683877] [INFO ] [REMOTE ] CGAU: Full fetch complete (61048 records). [2025-10-10T17:59:23.684090] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-10T17:59:24.059165] [DEBUG] [LOCAL ] CHD: Loaded 52580 existing records from primary storage. [2025-10-10T17:59:24.075831] [INFO ] [MAIN ] CHD: Loaded 52580 existing records. [2025-10-10T17:59:24.191631] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-10T17:59:24.280545] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-10T17:59:24.283576] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-10T17:59:24.290452] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-10T17:59:24.290370] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-10T17:59:24.302590] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-10T17:59:24.371902] [DEBUG] [LOCAL ] CGAU: Trimmed 61048 records to 43834 (keeping 200 days of data) [2025-10-10T17:59:24.378244] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:59:24.379147] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-10T17:59:24.379281] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-10T17:59:24.380015] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-10T17:59:24.380072] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-10T17:59:24.848554] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-10T17:59:24.961464] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:59:25.057441] [DEBUG] [LOCAL ] CGAU: Primary data saved (43834 records). [2025-10-10T17:59:25.057605] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-10T17:59:25.057728] [INFO ] [MAIN ] Update Progress: 433/2373 symbols completed. CGAU took 34.8s. Estimated remaining: 4h 25m 55s. Rate: 7.3 symbols/min [2025-10-10T17:59:25.094481] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-10T17:59:25.242222] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:59:25.242448] [DEBUG] [LOCAL ] CHE: No existing data file found in primary storage. [2025-10-10T17:59:25.242547] [WARN ] [MAIN ] CHE: No existing data found, performing full refresh instead. [2025-10-10T17:59:25.242707] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-10T17:59:25.242761] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-10T17:59:25.242810] [DEBUG] [LOCAL ] CHE: No primary data file found to delete. [2025-10-10T17:59:25.242845] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-10T17:59:25.502320] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-10T17:59:25.646586] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:59:25.889396] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-10T17:59:26.689403] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-10T17:59:27.245616] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T17:59:27.489406] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-10T17:59:28.289426] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-10T17:59:28.703224] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T17:59:28.798733] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-10T17:59:28.824887] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T17:59:29.089399] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-10T17:59:29.890344] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-10T17:59:29.891703] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-10T17:59:30.689410] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-10T17:59:31.307661] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-10T17:59:31.489412] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-10T17:59:31.757609] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T17:59:31.886860] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-10T17:59:32.289397] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-10T17:59:33.089413] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-10T17:59:33.555122] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-10T17:59:33.889457] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-10T17:59:34.689408] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-10T17:59:34.882180] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-10T17:59:34.949499] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T17:59:35.131537] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-10T17:59:35.489388] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-10T17:59:36.289423] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-10T17:59:36.694549] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-10T17:59:36.695415] [INFO ] [REMOTE ] CGV: Full fetch complete (2271 records). [2025-10-10T17:59:36.695488] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-10T17:59:37.085894] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-10T17:59:37.086056] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-10T17:59:37.086218] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-10T17:59:37.086265] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-10T17:59:37.086693] [DEBUG] [LOCAL ] CGV: Trimmed 2271 records to 1406 (keeping 200 days of data) [2025-10-10T17:59:37.091818] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-10T17:59:37.096356] [DEBUG] [LOCAL ] CGV: Primary data saved (1406 records). [2025-10-10T17:59:37.097452] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-10T17:59:37.097552] [INFO ] [MAIN ] Update Progress: 434/2373 symbols completed. CGV took 21.3s. Estimated remaining: 4h 26m 4s. Rate: 7.3 symbols/min [2025-10-10T17:59:37.282921] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:59:37.336145] [DEBUG] [LOCAL ] CHGG: Loaded 48154 existing records from primary storage. [2025-10-10T17:59:37.336545] [INFO ] [MAIN ] CHGG: Loaded 48154 existing records. [2025-10-10T17:59:37.533021] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:59:37.533567] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-10T17:59:37.533631] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-10T17:59:37.546345] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-10T17:59:37.568156] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-10T17:59:37.639676] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T17:59:37.894547] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-10T17:59:37.971296] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:59:38.163154] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-10T17:59:38.689405] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-10T17:59:39.503191] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-10T17:59:39.510171] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-10T17:59:40.016959] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-10T17:59:40.289397] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-10T17:59:40.361296] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-10T17:59:41.089403] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-10T17:59:41.834453] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-10T17:59:41.889375] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-10T17:59:42.689419] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-10T17:59:43.118492] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-10T17:59:43.241996] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-10T17:59:43.489401] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-10T17:59:44.039708] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T17:59:44.289406] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-10T17:59:45.089438] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-10T17:59:45.399341] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T17:59:45.539408] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T17:59:45.889394] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-10T17:59:46.144357] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-10T17:59:46.689502] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-10T17:59:47.489361] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-10T17:59:47.822766] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T17:59:48.289359] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-10T17:59:48.747426] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-10T17:59:48.780179] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-10T17:59:49.089382] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-10T17:59:49.889401] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-10T17:59:50.130381] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T17:59:50.215099] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-10T17:59:50.689383] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-10T17:59:50.756759] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-10T17:59:51.489381] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-10T17:59:52.289425] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-10T17:59:52.695735] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T17:59:53.089375] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-10T17:59:53.453808] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-10T17:59:53.554538] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T17:59:53.889395] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-10T17:59:54.484175] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-10T17:59:54.689392] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-10T17:59:55.489378] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-10T17:59:55.886480] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-10T17:59:55.964264] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T17:59:56.289388] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-10T17:59:57.089350] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-10T17:59:57.356353] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-10T17:59:57.485759] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T17:59:57.488794] [INFO ] [REMOTE ] CHCT: Full fetch complete (34761 records). [2025-10-10T17:59:57.488885] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-10T17:59:57.882285] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-10T17:59:57.882374] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-10T17:59:57.883041] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-10T17:59:57.883112] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-10T17:59:57.884317] [DEBUG] [LOCAL ] CHCT: Trimmed 34761 records to 24273 (keeping 200 days of data) [2025-10-10T17:59:57.940116] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-10T17:59:58.046515] [DEBUG] [LOCAL ] CHCT: Primary data saved (24273 records). [2025-10-10T17:59:58.046719] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-10T17:59:58.046840] [INFO ] [MAIN ] Update Progress: 435/2373 symbols completed. CHCT took 36.3s. Estimated remaining: 4h 26m 52s. Rate: 7.3 symbols/min [2025-10-10T17:59:58.234759] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T17:59:58.276884] [DEBUG] [LOCAL ] CHH: Loaded 32538 existing records from primary storage. [2025-10-10T17:59:58.277236] [INFO ] [MAIN ] CHH: Loaded 32538 existing records. [2025-10-10T17:59:58.412286] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T17:59:58.487465] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T17:59:58.487840] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-10T17:59:58.487906] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-10T17:59:58.488108] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-10T17:59:58.488147] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-10T17:59:58.694561] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-10T17:59:58.909534] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T17:59:59.489398] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-10T17:59:59.902835] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-10T17:59:59.908829] [INFO ] [REMOTE ] CHD: Full fetch complete (74471 records). [2025-10-10T17:59:59.909043] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-10T18:00:00.031636] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T18:00:00.298094] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-10T18:00:00.346168] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-10T18:00:00.346279] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-10T18:00:00.347485] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-10T18:00:00.347567] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-10T18:00:00.349622] [DEBUG] [LOCAL ] CHD: Trimmed 74471 records to 52964 (keeping 200 days of data) [2025-10-10T18:00:00.721733] [DEBUG] [LOCAL ] CHD: Primary data saved (52964 records). [2025-10-10T18:00:00.721978] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-10T18:00:00.722621] [INFO ] [MAIN ] Update Progress: 436/2373 symbols completed. CHD took 37.3s. Estimated remaining: 4h 26m 19s. Rate: 7.3 symbols/min [2025-10-10T18:00:00.914572] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:00:00.914799] [DEBUG] [LOCAL ] CHMI: No existing data file found in primary storage. [2025-10-10T18:00:00.914844] [WARN ] [MAIN ] CHMI: No existing data found, performing full refresh instead. [2025-10-10T18:00:00.914944] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-10T18:00:00.914982] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-10T18:00:00.915023] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-10T18:00:00.915057] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-10T18:00:01.090780] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-10T18:00:01.339033] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T18:00:01.373014] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:00:01.399024] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-10T18:00:01.889409] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-10T18:00:02.689426] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-10T18:00:03.323243] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-10T18:00:03.489458] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-10T18:00:03.567332] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-10T18:00:04.289400] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-10T18:00:04.312392] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T18:00:05.089441] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-10T18:00:05.774826] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-10T18:00:05.895945] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-10T18:00:05.922430] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T18:00:06.343187] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T18:00:06.689462] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-10T18:00:06.879792] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T18:00:06.882097] [INFO ] [REMOTE ] CHE: Full fetch complete (20218 records). [2025-10-10T18:00:06.882235] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-10T18:00:07.279830] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-10T18:00:07.279935] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-10T18:00:07.280697] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-10T18:00:07.280763] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-10T18:00:07.281431] [DEBUG] [LOCAL ] CHE: Trimmed 20218 records to 15536 (keeping 200 days of data) [2025-10-10T18:00:07.395133] [DEBUG] [LOCAL ] CHE: Primary data saved (15536 records). [2025-10-10T18:00:07.395327] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-10T18:00:07.395423] [INFO ] [MAIN ] Update Progress: 437/2373 symbols completed. CHE took 42.3s. Estimated remaining: 4h 26m 4s. Rate: 7.3 symbols/min [2025-10-10T18:00:07.489401] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-10T18:00:07.943112] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T18:00:08.289437] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-10T18:00:08.975299] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-10T18:00:09.089424] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-10T18:00:09.889378] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-10T18:00:10.242732] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-10T18:00:10.689370] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-10T18:00:10.826440] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-10T18:00:11.089035] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T18:00:11.489399] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-10T18:00:12.289447] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-10T18:00:12.609354] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T18:00:12.783534] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T18:00:13.089455] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-10T18:00:13.500141] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T18:00:13.889470] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-10T18:00:14.067815] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T18:00:14.689469] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-10T18:00:15.401341] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-10T18:00:15.489372] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-10T18:00:15.883168] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T18:00:16.289435] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-10T18:00:16.831888] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-10T18:00:17.089435] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-10T18:00:17.889421] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-10T18:00:18.162471] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T18:00:18.167529] [INFO ] [REMOTE ] CHGG: Full fetch complete (70363 records). [2025-10-10T18:00:18.167738] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-10T18:00:18.443493] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T18:00:18.612710] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-10T18:00:18.612833] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-10T18:00:18.613818] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-10T18:00:18.613889] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-10T18:00:18.615699] [DEBUG] [LOCAL ] CHGG: Trimmed 70363 records to 48509 (keeping 200 days of data) [2025-10-10T18:00:18.709686] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-10T18:00:18.929378] [DEBUG] [LOCAL ] CHGG: Primary data saved (48509 records). [2025-10-10T18:00:18.929609] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-10T18:00:18.929762] [INFO ] [MAIN ] Update Progress: 438/2373 symbols completed. CHGG took 41.8s. Estimated remaining: 4h 26m 10s. Rate: 7.3 symbols/min [2025-10-10T18:00:19.579312] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-10T18:00:19.584155] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-10T18:00:19.658193] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T18:00:20.289413] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-10T18:00:20.974385] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-10T18:00:21.089438] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-10T18:00:21.425812] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-10T18:00:21.889413] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-10T18:00:22.285923] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T18:00:22.288265] [INFO ] [REMOTE ] CHMI: Full fetch complete (31761 records). [2025-10-10T18:00:22.288358] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-10T18:00:22.661552] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-10T18:00:22.661635] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-10T18:00:22.662206] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-10T18:00:22.662267] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-10T18:00:22.663068] [DEBUG] [LOCAL ] CHMI: Trimmed 31761 records to 21964 (keeping 200 days of data) [2025-10-10T18:00:22.794324] [DEBUG] [LOCAL ] CHMI: Primary data saved (21964 records). [2025-10-10T18:00:22.794467] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-10T18:00:22.794539] [INFO ] [MAIN ] Update Progress: 439/2373 symbols completed. CHMI took 22.1s. Estimated remaining: 4h 25m 42s. Rate: 7.3 symbols/min [2025-10-10T18:00:23.078425] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-10T18:00:23.082305] [INFO ] [REMOTE ] CHH: Full fetch complete (47196 records). [2025-10-10T18:00:23.082423] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-10T18:00:23.459554] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-10T18:00:23.459683] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-10T18:00:23.460413] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-10T18:00:23.460457] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-10T18:00:23.461720] [DEBUG] [LOCAL ] CHH: Trimmed 47196 records to 32827 (keeping 200 days of data) [2025-10-10T18:00:23.678243] [DEBUG] [LOCAL ] CHH: Primary data saved (32827 records). [2025-10-10T18:00:23.679680] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-10T18:00:23.679855] [INFO ] [MAIN ] Update Progress: 440/2373 symbols completed. CHH took 25.6s. Estimated remaining: 4h 25m 2s. Rate: 7.3 symbols/min [2025-10-10T18:00:24.417995] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:00:24.423039] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:00:24.418941] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:00:24.487207] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:00:24.491939] [DEBUG] [LOCAL ] CHN: Loaded 4772 existing records from primary storage. [2025-10-10T18:00:24.492313] [INFO ] [MAIN ] CHN: Loaded 4772 existing records. [2025-10-10T18:00:24.610848] [DEBUG] [LOCAL ] CHT: Loaded 19652 existing records from primary storage. [2025-10-10T18:00:24.675207] [INFO ] [MAIN ] CHT: Loaded 19652 existing records. [2025-10-10T18:00:24.749853] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:00:24.783767] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-10T18:00:24.799819] [DEBUG] [LOCAL ] CHPT: Loaded 48419 existing records from primary storage. [2025-10-10T18:00:24.792692] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-10T18:00:24.815715] [INFO ] [MAIN ] CHPT: Loaded 48419 existing records. [2025-10-10T18:00:24.904095] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-10T18:00:24.885197] [DEBUG] [LOCAL ] CHWY: Loaded 54043 existing records from primary storage. [2025-10-10T18:00:24.923260] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-10T18:00:24.950292] [INFO ] [MAIN ] CHWY: Loaded 54043 existing records. [2025-10-10T18:00:25.195179] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:00:25.231838] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-10T18:00:25.298145] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-10T18:00:25.354320] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-10T18:00:25.370892] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:00:25.431568] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-10T18:00:25.459687] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-10T18:00:25.431396] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-10T18:00:25.461062] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-10T18:00:25.584440] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-10T18:00:25.644574] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:00:25.709251] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-10T18:00:25.709428] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-10T18:00:25.726591] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-10T18:00:25.767375] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-10T18:00:26.300811] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:00:26.378504] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-10T18:00:26.727309] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:00:26.765568] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-10T18:00:26.802430] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:00:26.813913] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-10T18:00:26.877251] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:00:26.877624] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-10T18:00:27.397466] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T18:00:27.399335] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-10T18:00:27.724870] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-10T18:00:27.728892] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-10T18:00:28.205544] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-10T18:00:28.207590] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-10T18:00:28.461538] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-10T18:00:28.465367] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-10T18:00:28.972093] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-10T18:00:29.065093] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-10T18:00:29.089343] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-10T18:00:29.289056] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-10T18:00:29.451668] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-10T18:00:29.651365] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-10T18:00:29.889382] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-10T18:00:30.689387] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-10T18:00:31.489432] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-10T18:00:32.049561] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-10T18:00:32.285487] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-10T18:00:32.289948] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-10T18:00:32.305368] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-10T18:00:33.089344] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-10T18:00:33.620833] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-10T18:00:33.889429] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-10T18:00:34.689340] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-10T18:00:35.270099] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-10T18:00:35.489409] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-10T18:00:35.798408] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-10T18:00:36.019604] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-10T18:00:36.289440] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-10T18:00:37.089357] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-10T18:00:37.422936] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T18:00:37.889434] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-10T18:00:38.218783] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-10T18:00:38.361842] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-10T18:00:38.689452] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-10T18:00:38.711609] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-10T18:00:39.489429] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-10T18:00:40.289423] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-10T18:00:41.089402] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-10T18:00:41.321478] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-10T18:00:41.462172] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-10T18:00:41.589930] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-10T18:00:41.641559] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T18:00:41.889388] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-10T18:00:42.689364] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-10T18:00:42.824881] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-10T18:00:43.489378] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-10T18:00:44.289415] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-10T18:00:45.020166] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-10T18:00:45.089410] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-10T18:00:45.634235] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-10T18:00:45.898117] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-10T18:00:45.899879] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-10T18:00:46.689354] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-10T18:00:46.785064] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T18:00:47.489377] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-10T18:00:47.959575] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T18:00:48.289352] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-10T18:00:48.334374] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-10T18:00:49.089401] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-10T18:00:49.613351] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T18:00:49.615878] [INFO ] [REMOTE ] CHT: Full fetch complete (27526 records). [2025-10-10T18:00:49.616040] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-10T18:00:49.895427] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-10T18:00:49.987762] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-10T18:00:50.035181] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-10T18:00:50.035262] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-10T18:00:50.035767] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-10T18:00:50.035852] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-10T18:00:50.036521] [DEBUG] [LOCAL ] CHT: Trimmed 27526 records to 19798 (keeping 200 days of data) [2025-10-10T18:00:50.160688] [DEBUG] [LOCAL ] CHT: Primary data saved (19798 records). [2025-10-10T18:00:50.161113] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-10T18:00:50.161233] [INFO ] [MAIN ] Update Progress: 441/2373 symbols completed. CHT took 26.5s. Estimated remaining: 4h 26m 14s. Rate: 7.3 symbols/min [2025-10-10T18:00:50.327227] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:00:50.327399] [DEBUG] [LOCAL ] CI: No existing data file found in primary storage. [2025-10-10T18:00:50.327460] [WARN ] [MAIN ] CI: No existing data found, performing full refresh instead. [2025-10-10T18:00:50.327665] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-10T18:00:50.327738] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-10T18:00:50.327801] [DEBUG] [LOCAL ] CI: No primary data file found to delete. [2025-10-10T18:00:50.327859] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-10T18:00:50.677979] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:00:50.689327] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-10T18:00:50.824689] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-10T18:00:51.489422] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-10T18:00:51.602371] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-10T18:00:52.242538] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T18:00:52.255489] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T18:00:52.256404] [INFO ] [REMOTE ] CHN: Full fetch complete (7437 records). [2025-10-10T18:00:52.256472] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-10T18:00:52.295358] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-10T18:00:52.618361] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-10T18:00:52.618458] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-10T18:00:52.618721] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-10T18:00:52.618782] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-10T18:00:52.619170] [DEBUG] [LOCAL ] CHN: Trimmed 7437 records to 4832 (keeping 200 days of data) [2025-10-10T18:00:52.648336] [DEBUG] [LOCAL ] CHN: Primary data saved (4832 records). [2025-10-10T18:00:52.648453] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-10T18:00:52.648535] [INFO ] [MAIN ] Update Progress: 442/2373 symbols completed. CHN took 28.9s. Estimated remaining: 4h 25m 40s. Rate: 7.3 symbols/min [2025-10-10T18:00:52.818575] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:00:52.837254] [DEBUG] [LOCAL ] CIA: Loaded 16925 existing records from primary storage. [2025-10-10T18:00:52.837512] [INFO ] [MAIN ] CIA: Loaded 16925 existing records. [2025-10-10T18:00:53.036664] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:00:53.036896] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-10T18:00:53.036980] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-10T18:00:53.037243] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-10T18:00:53.037299] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-10T18:00:53.099049] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-10T18:00:53.390612] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:00:53.889395] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-10T18:00:54.689400] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-10T18:00:54.880373] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-10T18:00:55.112251] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-10T18:00:55.326931] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-10T18:00:55.489369] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-10T18:00:56.289368] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-10T18:00:56.352208] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-10T18:00:56.618400] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-10T18:00:57.089415] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-10T18:00:57.889371] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-10T18:00:58.196235] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T18:00:58.390161] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-10T18:00:58.689410] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-10T18:00:59.489415] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-10T18:00:59.851789] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-10T18:01:00.184829] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-10T18:01:00.289363] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-10T18:01:01.089358] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-10T18:01:01.243423] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T18:01:01.889430] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-10T18:01:02.338918] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T18:01:02.689411] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-10T18:01:02.788843] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-10T18:01:03.031154] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-10T18:01:03.489384] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-10T18:01:04.289435] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-10T18:01:04.917554] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-10T18:01:04.924393] [INFO ] [REMOTE ] CHWY: Full fetch complete (77634 records). [2025-10-10T18:01:04.924703] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-10T18:01:05.063732] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-10T18:01:05.099553] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-10T18:01:05.342921] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-10T18:01:05.343076] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-10T18:01:05.344155] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-10T18:01:05.344271] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-10T18:01:05.346224] [DEBUG] [LOCAL ] CHWY: Trimmed 77634 records to 54433 (keeping 200 days of data) [2025-10-10T18:01:05.592953] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T18:01:05.705667] [DEBUG] [LOCAL ] CHWY: Primary data saved (54433 records). [2025-10-10T18:01:05.705873] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-10T18:01:05.705978] [INFO ] [MAIN ] Update Progress: 443/2373 symbols completed. CHWY took 42.0s. Estimated remaining: 4h 25m 53s. Rate: 7.3 symbols/min [2025-10-10T18:01:05.873058] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:01:05.892802] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-10T18:01:05.906420] [DEBUG] [LOCAL ] CIB: Loaded 30800 existing records from primary storage. [2025-10-10T18:01:05.906779] [INFO ] [MAIN ] CIB: Loaded 30800 existing records. [2025-10-10T18:01:06.082071] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:01:06.082306] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-10T18:01:06.082400] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-10T18:01:06.082779] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-10T18:01:06.082835] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-10T18:01:06.433332] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:01:06.689369] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-10T18:01:07.079114] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T18:01:07.489440] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-10T18:01:07.561701] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-10T18:01:07.591206] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T18:01:08.289396] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-10T18:01:09.089386] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-10T18:01:09.275739] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-10T18:01:09.280225] [INFO ] [REMOTE ] CHPT: Full fetch complete (72028 records). [2025-10-10T18:01:09.280333] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-10T18:01:09.449382] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T18:01:09.734728] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-10T18:01:09.734839] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-10T18:01:09.735973] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-10T18:01:09.736049] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-10T18:01:09.737979] [DEBUG] [LOCAL ] CHPT: Trimmed 72028 records to 48725 (keeping 200 days of data) [2025-10-10T18:01:09.914143] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-10T18:01:10.046382] [DEBUG] [LOCAL ] CHPT: Primary data saved (48725 records). [2025-10-10T18:01:10.046562] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-10T18:01:10.046694] [INFO ] [MAIN ] Update Progress: 444/2373 symbols completed. CHPT took 46.4s. Estimated remaining: 4h 25m 27s. Rate: 7.3 symbols/min [2025-10-10T18:01:10.256011] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:01:10.256264] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-10T18:01:10.256308] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-10T18:01:10.256391] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-10T18:01:10.256430] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-10T18:01:10.256471] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-10T18:01:10.256505] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-10T18:01:10.638740] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:01:10.666741] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T18:01:10.689336] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-10T18:01:11.288716] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T18:01:11.489388] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-10T18:01:12.153469] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-10T18:01:12.289348] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-10T18:01:12.374335] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T18:01:12.819443] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-10T18:01:13.089382] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-10T18:01:13.600322] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-10T18:01:13.889359] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-10T18:01:14.310202] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-10T18:01:14.689400] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-10T18:01:15.489353] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-10T18:01:15.882712] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T18:01:16.289419] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-10T18:01:16.555130] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-10T18:01:17.089369] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-10T18:01:17.225159] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-10T18:01:17.889382] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-10T18:01:18.450537] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-10T18:01:18.689397] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-10T18:01:19.260148] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-10T18:01:19.489404] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-10T18:01:19.774502] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T18:01:19.776425] [INFO ] [REMOTE ] CIA: Full fetch complete (23507 records). [2025-10-10T18:01:19.776514] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-10T18:01:19.848241] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-10T18:01:20.149168] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-10T18:01:20.149258] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-10T18:01:20.149731] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-10T18:01:20.149795] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-10T18:01:20.150479] [DEBUG] [LOCAL ] CIA: Trimmed 23507 records to 17004 (keeping 200 days of data) [2025-10-10T18:01:20.241769] [DEBUG] [LOCAL ] CIA: Primary data saved (17004 records). [2025-10-10T18:01:20.241912] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-10T18:01:20.241994] [INFO ] [MAIN ] Update Progress: 445/2373 symbols completed. CIA took 27.6s. Estimated remaining: 4h 25m 27s. Rate: 7.3 symbols/min [2025-10-10T18:01:20.294517] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-10T18:01:20.415449] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:01:20.415695] [DEBUG] [LOCAL ] CIEN: No existing data file found in primary storage. [2025-10-10T18:01:20.415751] [WARN ] [MAIN ] CIEN: No existing data found, performing full refresh instead. [2025-10-10T18:01:20.415880] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-10T18:01:20.415925] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-10T18:01:20.415968] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-10T18:01:20.416001] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-10T18:01:20.680728] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-10T18:01:20.768091] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:01:21.089384] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-10T18:01:21.380231] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-10T18:01:21.889448] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-10T18:01:22.689397] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-10T18:01:23.489366] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-10T18:01:23.836719] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T18:01:23.960184] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-10T18:01:24.288621] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T18:01:24.296209] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-10T18:01:25.089446] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-10T18:01:25.611253] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-10T18:01:25.634789] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T18:01:25.889354] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-10T18:01:26.689430] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-10T18:01:27.494539] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-10T18:01:27.499554] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-10T18:01:27.523423] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T18:01:27.528423] [INFO ] [REMOTE ] CI: Full fetch complete (71808 records). [2025-10-10T18:01:27.528764] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-10T18:01:27.530181] [FATAL] [VALIDATOR ] CI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:01:27.530280] [FATAL] [MAIN ] CI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:01:27.530325] [WARN ] [MAIN ] CI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:01:27.530371] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-10T18:01:27.530439] [DEBUG] [LOCAL ] CI: No primary data file found to delete. [2025-10-10T18:01:27.530479] [INFO ] [LOCAL ] CI: Starting deletion of derivative data. [2025-10-10T18:01:27.530519] [DEBUG] [LOCAL ] CI: No derivative data file found to delete. [2025-10-10T18:01:27.530592] [INFO ] [MAIN ] Update Progress: 446/2373 symbols completed. CI took 37.4s. Estimated remaining: 4h 25m 15s. Rate: 7.3 symbols/min [2025-10-10T18:01:27.721310] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:01:27.731291] [DEBUG] [LOCAL ] CIF: Loaded 4108 existing records from primary storage. [2025-10-10T18:01:27.731614] [INFO ] [MAIN ] CIF: Loaded 4108 existing records. [2025-10-10T18:01:27.917581] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:01:27.917911] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-10T18:01:27.917965] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-10T18:01:27.918225] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-10T18:01:27.918284] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-10T18:01:28.025288] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-10T18:01:28.026542] [INFO ] [REMOTE ] CICB: Full fetch complete (1988 records). [2025-10-10T18:01:28.026674] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-10T18:01:28.299924] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-10T18:01:28.377290] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-10T18:01:28.389616] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:01:28.420019] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:01:28.420772] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-10T18:01:28.470202] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-10T18:01:28.486738] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-10T18:01:28.509129] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-10T18:01:28.512853] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:01:28.513291] [INFO ] [MAIN ] Update Progress: 447/2373 symbols completed. CICB took 18.5s. Estimated remaining: 4h 24m 35s. Rate: 7.3 symbols/min [2025-10-10T18:01:28.704942] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:01:28.752545] [DEBUG] [LOCAL ] CIG: Loaded 44200 existing records from primary storage. [2025-10-10T18:01:28.753053] [INFO ] [MAIN ] CIG: Loaded 44200 existing records. [2025-10-10T18:01:28.943213] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:01:28.943514] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-10T18:01:28.943567] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-10T18:01:28.943885] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-10T18:01:28.943945] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-10T18:01:29.095091] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-10T18:01:29.346233] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:01:29.889439] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-10T18:01:30.044058] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-10T18:01:30.071171] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T18:01:30.689435] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-10T18:01:31.489394] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-10T18:01:31.617070] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T18:01:31.898388] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-10T18:01:32.225184] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-10T18:01:32.289390] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-10T18:01:33.089394] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-10T18:01:33.790634] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T18:01:33.813685] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T18:01:33.889346] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-10T18:01:34.689409] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-10T18:01:35.203380] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-10T18:01:35.489377] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-10T18:01:35.858025] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T18:01:36.289352] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-10T18:01:36.354460] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-10T18:01:37.089414] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-10T18:01:37.823196] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-10T18:01:37.889339] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-10T18:01:38.694886] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-10T18:01:38.698603] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T18:01:39.457981] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T18:01:39.489349] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-10T18:01:39.499768] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-10T18:01:40.289386] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-10T18:01:40.418626] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T18:01:40.422140] [INFO ] [REMOTE ] CIB: Full fetch complete (44716 records). [2025-10-10T18:01:40.422335] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-10T18:01:40.810493] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-10T18:01:40.810611] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-10T18:01:40.811352] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-10T18:01:40.811415] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-10T18:01:40.812858] [DEBUG] [LOCAL ] CIB: Trimmed 44716 records to 31088 (keeping 200 days of data) [2025-10-10T18:01:41.019217] [DEBUG] [LOCAL ] CIB: Primary data saved (31088 records). [2025-10-10T18:01:41.019419] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-10T18:01:41.019539] [INFO ] [MAIN ] Update Progress: 448/2373 symbols completed. CIB took 35.3s. Estimated remaining: 4h 24m 45s. Rate: 7.3 symbols/min [2025-10-10T18:01:41.093236] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-10T18:01:41.207767] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:01:41.214801] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-10T18:01:41.236471] [DEBUG] [LOCAL ] CII: Loaded 15402 existing records from primary storage. [2025-10-10T18:01:41.236818] [INFO ] [MAIN ] CII: Loaded 15402 existing records. [2025-10-10T18:01:41.411805] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:01:41.412076] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-10T18:01:41.412133] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-10T18:01:41.412418] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-10T18:01:41.412477] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-10T18:01:41.762902] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:01:41.889378] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-10T18:01:42.689361] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-10T18:01:43.048409] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-10T18:01:43.242351] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-10T18:01:43.291549] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T18:01:43.489401] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-10T18:01:44.200930] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-10T18:01:44.289377] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-10T18:01:44.993046] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-10T18:01:45.089391] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-10T18:01:45.889378] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-10T18:01:46.569199] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-10T18:01:46.689361] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-10T18:01:47.050228] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T18:01:47.489447] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-10T18:01:48.037398] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T18:01:48.289366] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-10T18:01:48.682498] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-10T18:01:49.089381] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-10T18:01:49.889387] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-10T18:01:49.986616] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-10T18:01:50.022105] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T18:01:50.601892] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-10T18:01:50.689379] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-10T18:01:51.489387] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-10T18:01:52.250812] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T18:01:52.251706] [INFO ] [REMOTE ] CIF: Full fetch complete (6594 records). [2025-10-10T18:01:52.251774] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-10T18:01:52.294625] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-10T18:01:52.610804] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-10T18:01:52.610956] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-10T18:01:52.611204] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-10T18:01:52.611264] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-10T18:01:52.611636] [DEBUG] [LOCAL ] CIF: Trimmed 6594 records to 4139 (keeping 200 days of data) [2025-10-10T18:01:52.635916] [DEBUG] [LOCAL ] CIF: Primary data saved (4139 records). [2025-10-10T18:01:52.636055] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-10T18:01:52.636261] [INFO ] [MAIN ] Update Progress: 449/2373 symbols completed. CIF took 25.1s. Estimated remaining: 4h 24m 52s. Rate: 7.3 symbols/min [2025-10-10T18:01:52.834552] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:01:52.836840] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T18:01:52.888591] [DEBUG] [LOCAL ] CIM: Loaded 37987 existing records from primary storage. [2025-10-10T18:01:52.888928] [INFO ] [MAIN ] CIM: Loaded 37987 existing records. [2025-10-10T18:01:53.059931] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:01:53.060190] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-10T18:01:53.060237] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-10T18:01:53.060461] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-10T18:01:53.060518] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-10T18:01:53.094538] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-10T18:01:53.410621] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:01:53.784290] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-10T18:01:53.889361] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-10T18:01:54.689364] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-10T18:01:54.887197] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T18:01:55.028247] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-10T18:01:55.489388] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-10T18:01:56.289384] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-10T18:01:56.474531] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T18:01:57.089100] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-10T18:01:57.097755] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-10T18:01:57.889390] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-10T18:01:58.170552] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-10T18:01:58.207942] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T18:01:58.689421] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-10T18:01:59.489405] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-10T18:01:59.642823] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-10T18:01:59.676503] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T18:02:00.289426] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-10T18:02:01.089360] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-10T18:02:01.105864] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-10T18:02:01.368862] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T18:02:01.889374] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-10T18:02:02.689360] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-10T18:02:02.728513] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T18:02:03.061603] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-10T18:02:03.489400] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-10T18:02:04.289449] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-10T18:02:04.609478] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T18:02:05.089360] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-10T18:02:05.113959] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T18:02:05.861851] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T18:02:05.889339] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-10T18:02:06.576485] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-10T18:02:06.689384] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-10T18:02:07.402628] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-10T18:02:07.404872] [INFO ] [REMOTE ] CII: Full fetch complete (22942 records). [2025-10-10T18:02:07.404951] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-10T18:02:07.494613] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-10T18:02:07.774858] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-10T18:02:07.774950] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-10T18:02:07.775379] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-10T18:02:07.775420] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-10T18:02:07.776094] [DEBUG] [LOCAL ] CII: Trimmed 22942 records to 15532 (keeping 200 days of data) [2025-10-10T18:02:07.868477] [DEBUG] [LOCAL ] CII: Primary data saved (15532 records). [2025-10-10T18:02:07.868618] [INFO ] [MAIN ] CII: Full history saved. [2025-10-10T18:02:07.868736] [INFO ] [MAIN ] Update Progress: 450/2373 symbols completed. CII took 26.8s. Estimated remaining: 4h 25m 13s. Rate: 7.3 symbols/min [2025-10-10T18:02:08.036141] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:02:08.036314] [DEBUG] [LOCAL ] CIMN: No existing data file found in primary storage. [2025-10-10T18:02:08.036351] [WARN ] [MAIN ] CIMN: No existing data found, performing full refresh instead. [2025-10-10T18:02:08.036458] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-10T18:02:08.036498] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-10T18:02:08.036537] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-10T18:02:08.036569] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-10T18:02:08.289806] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-10T18:02:08.422533] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-10T18:02:08.426191] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:02:09.089373] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-10T18:02:09.273553] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T18:02:09.889422] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-10T18:02:10.400637] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T18:02:10.447304] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-10T18:02:10.689368] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-10T18:02:11.489380] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-10T18:02:11.698342] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T18:02:12.053861] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-10T18:02:12.059373] [INFO ] [REMOTE ] CIEN: Full fetch complete (75171 records). [2025-10-10T18:02:12.059602] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-10T18:02:12.060873] [FATAL] [VALIDATOR ] CIEN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:02:12.060995] [FATAL] [MAIN ] CIEN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:02:12.061042] [WARN ] [MAIN ] CIEN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:02:12.061086] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-10T18:02:12.061154] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-10T18:02:12.061193] [INFO ] [LOCAL ] CIEN: Starting deletion of derivative data. [2025-10-10T18:02:12.061233] [DEBUG] [LOCAL ] CIEN: No derivative data file found to delete. [2025-10-10T18:02:12.061304] [INFO ] [MAIN ] Update Progress: 451/2373 symbols completed. CIEN took 51.8s. Estimated remaining: 4h 24m 48s. Rate: 7.3 symbols/min [2025-10-10T18:02:12.245117] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:02:12.245533] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-10T18:02:12.245592] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-10T18:02:12.245737] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-10T18:02:12.245810] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-10T18:02:12.245876] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-10T18:02:12.245912] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-10T18:02:12.298766] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-10T18:02:12.616229] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:02:12.871698] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-10T18:02:13.089384] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-10T18:02:13.194920] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-10T18:02:13.199077] [INFO ] [REMOTE ] CIG: Full fetch complete (61224 records). [2025-10-10T18:02:13.199201] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-10T18:02:13.199895] [FATAL] [VALIDATOR ] CIG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:02:13.199984] [FATAL] [MAIN ] CIG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:02:13.200027] [WARN ] [MAIN ] CIG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:02:13.200066] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-10T18:02:13.200123] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-10T18:02:13.200157] [INFO ] [LOCAL ] CIG: Starting deletion of derivative data. [2025-10-10T18:02:13.200371] [DEBUG] [LOCAL ] CIG: Deleted derivative data file. [2025-10-10T18:02:13.200464] [INFO ] [MAIN ] Update Progress: 452/2373 symbols completed. CIG took 44.7s. Estimated remaining: 4h 24m 9s. Rate: 7.3 symbols/min [2025-10-10T18:02:13.367360] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:02:13.367721] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-10T18:02:13.367781] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-10T18:02:13.367898] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-10T18:02:13.367940] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-10T18:02:13.367983] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-10T18:02:13.368016] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-10T18:02:13.715618] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:02:13.889373] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-10T18:02:14.470297] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-10T18:02:14.595104] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-10T18:02:14.689394] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-10T18:02:15.235563] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-10T18:02:15.489404] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-10T18:02:16.289371] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-10T18:02:16.639203] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-10T18:02:17.089419] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-10T18:02:17.635191] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-10T18:02:17.889410] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-10T18:02:17.921745] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T18:02:18.127192] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T18:02:18.127526] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-10T18:02:18.127637] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:02:18.127747] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-10T18:02:18.127810] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:02:18.127882] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-10T18:02:18.127946] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-10T18:02:18.127982] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-10T18:02:18.128066] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-10T18:02:18.128137] [INFO ] [MAIN ] Update Progress: 453/2373 symbols completed. CIMP took 4.9s. Estimated remaining: 4h 23m 47s. Rate: 7.3 symbols/min [2025-10-10T18:02:18.296424] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:02:18.314530] [DEBUG] [LOCAL ] CINT: Loaded 19687 existing records from primary storage. [2025-10-10T18:02:18.314837] [INFO ] [MAIN ] CINT: Loaded 19687 existing records. [2025-10-10T18:02:18.491034] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:02:18.491317] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-10T18:02:18.491366] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-10T18:02:18.491670] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-10T18:02:18.491730] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-10T18:02:18.699076] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-10T18:02:18.847236] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:02:19.358465] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-10T18:02:19.489445] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-10T18:02:20.034789] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-10T18:02:20.289384] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-10T18:02:20.822445] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-10T18:02:21.089438] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-10T18:02:21.889355] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-10T18:02:22.165207] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-10T18:02:22.689392] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-10T18:02:23.205023] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-10T18:02:23.428999] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-10T18:02:23.489429] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-10T18:02:24.289432] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-10T18:02:24.595705] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-10T18:02:24.729501] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-10T18:02:25.089358] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-10T18:02:25.630493] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-10T18:02:25.889350] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-10T18:02:26.577479] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-10T18:02:26.689372] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-10T18:02:27.230802] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-10T18:02:27.489409] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-10T18:02:28.289378] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-10T18:02:29.061079] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-10T18:02:29.089354] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-10T18:02:29.526337] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T18:02:29.889376] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-10T18:02:30.407560] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-10T18:02:30.689408] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-10T18:02:30.738671] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-10T18:02:31.393079] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-10T18:02:31.489353] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-10T18:02:32.289353] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-10T18:02:32.719005] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-10T18:02:32.840260] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-10T18:02:33.089433] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-10T18:02:33.663105] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-10T18:02:33.889367] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-10T18:02:34.689374] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-10T18:02:35.046317] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-10T18:02:35.489236] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-10T18:02:35.489360] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-10T18:02:36.289414] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-10T18:02:36.670552] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-10T18:02:37.089419] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-10T18:02:37.889441] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-10T18:02:37.968933] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T18:02:37.980487] [INFO ] [REMOTE ] CIMO: Full fetch complete (5154 records). [2025-10-10T18:02:37.980357] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-10T18:02:37.980690] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-10T18:02:37.990115] [INFO ] [REMOTE ] CIM: Full fetch complete (54703 records). [2025-10-10T18:02:38.051420] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-10T18:02:38.088423] [FATAL] [VALIDATOR ] CIM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:02:38.091464] [FATAL] [MAIN ] CIM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:02:38.097362] [WARN ] [MAIN ] CIM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:02:38.107723] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-10T18:02:38.113013] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-10-10T18:02:38.118330] [INFO ] [LOCAL ] CIM: Starting deletion of derivative data. [2025-10-10T18:02:38.142696] [DEBUG] [LOCAL ] CIM: Deleted derivative data file. [2025-10-10T18:02:38.170558] [INFO ] [MAIN ] Update Progress: 454/2373 symbols completed. CIM took 45.5s. Estimated remaining: 4h 24m 28s. Rate: 7.3 symbols/min [2025-10-10T18:02:38.177955] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T18:02:38.221722] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:02:38.260994] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:02:38.277385] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-10T18:02:38.289165] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-10T18:02:38.295163] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-10T18:02:38.305565] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-10T18:02:38.315991] [INFO ] [MAIN ] Update Progress: 455/2373 symbols completed. CIMO took 26.3s. Estimated remaining: 4h 23m 46s. Rate: 7.3 symbols/min [2025-10-10T18:02:38.467562] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:02:38.552743] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:02:38.552985] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-10T18:02:38.553038] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-10T18:02:38.553182] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-10T18:02:38.553231] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-10T18:02:38.553285] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-10T18:02:38.553325] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-10T18:02:38.656093] [DEBUG] [LOCAL ] CIO: Loaded 20663 existing records from primary storage. [2025-10-10T18:02:38.667504] [INFO ] [MAIN ] CIO: Loaded 20663 existing records. [2025-10-10T18:02:38.704841] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-10T18:02:39.120608] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:02:39.185499] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-10T18:02:39.190107] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-10T18:02:39.189936] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:02:39.191601] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-10T18:02:39.192029] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-10T18:02:39.192143] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-10T18:02:39.490264] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-10T18:02:39.576241] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:02:39.581691] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-10T18:02:40.254246] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-10T18:02:40.289335] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-10T18:02:41.051584] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T18:02:41.089459] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-10T18:02:41.595904] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-10T18:02:41.889381] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-10T18:02:42.689364] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-10T18:02:42.819743] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-10T18:02:43.489424] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-10T18:02:44.036713] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-10T18:02:44.037589] [INFO ] [REMOTE ] CIMN: Full fetch complete (3886 records). [2025-10-10T18:02:44.037698] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-10T18:02:44.038093] [FATAL] [VALIDATOR ] CIMN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:02:44.038178] [FATAL] [MAIN ] CIMN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:02:44.038222] [WARN ] [MAIN ] CIMN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:02:44.038263] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-10T18:02:44.038319] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-10T18:02:44.038354] [INFO ] [LOCAL ] CIMN: Starting deletion of derivative data. [2025-10-10T18:02:44.038393] [DEBUG] [LOCAL ] CIMN: No derivative data file found to delete. [2025-10-10T18:02:44.038445] [INFO ] [MAIN ] Update Progress: 456/2373 symbols completed. CIMN took 36.2s. Estimated remaining: 4h 23m 27s. Rate: 7.3 symbols/min [2025-10-10T18:02:44.240888] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:02:44.260067] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T18:02:44.293539] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-10T18:02:44.318061] [DEBUG] [LOCAL ] CIVI: Loaded 53005 existing records from primary storage. [2025-10-10T18:02:44.318454] [INFO ] [MAIN ] CIVI: Loaded 53005 existing records. [2025-10-10T18:02:44.531334] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:02:44.531665] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-10T18:02:44.531729] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-10T18:02:44.532121] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-10T18:02:44.532169] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-10T18:02:44.884546] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:02:45.089481] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-10T18:02:45.869687] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-10T18:02:45.889340] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-10T18:02:46.177583] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T18:02:46.180842] [INFO ] [REMOTE ] CINT: Full fetch complete (27577 records). [2025-10-10T18:02:46.180929] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-10T18:02:46.554515] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-10T18:02:46.554625] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-10T18:02:46.555182] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-10T18:02:46.555235] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-10T18:02:46.556109] [DEBUG] [LOCAL ] CINT: Trimmed 27577 records to 19896 (keeping 200 days of data) [2025-10-10T18:02:46.674393] [DEBUG] [LOCAL ] CINT: Primary data saved (19896 records). [2025-10-10T18:02:46.674577] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-10T18:02:46.674708] [INFO ] [MAIN ] Update Progress: 457/2373 symbols completed. CINT took 28.5s. Estimated remaining: 4h 22m 55s. Rate: 7.3 symbols/min [2025-10-10T18:02:46.699193] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-10T18:02:46.859317] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:02:46.917366] [DEBUG] [LOCAL ] CL: Loaded 54038 existing records from primary storage. [2025-10-10T18:02:46.917800] [INFO ] [MAIN ] CL: Loaded 54038 existing records. [2025-10-10T18:02:47.123892] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:02:47.124360] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-10T18:02:47.124525] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-10T18:02:47.130149] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-10T18:02:47.138340] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-10T18:02:47.144590] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-10T18:02:47.498097] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-10T18:02:47.511392] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:02:47.703339] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-10T18:02:48.289410] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-10T18:02:49.089371] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-10T18:02:49.430469] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T18:02:49.497107] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T18:02:49.889385] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-10T18:02:49.966451] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-10T18:02:50.689452] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-10T18:02:51.094503] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-10T18:02:51.489412] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-10T18:02:52.289359] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-10T18:02:52.551730] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-10T18:02:52.589616] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T18:02:53.089381] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-10T18:02:53.872975] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-10T18:02:53.889339] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-10T18:02:54.689351] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-10T18:02:55.168690] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-10T18:02:55.490999] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-10T18:02:55.493477] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-10T18:02:55.546849] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-10T18:02:56.289399] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-10T18:02:57.089369] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-10T18:02:57.577293] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-10T18:02:57.889400] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-10T18:02:58.476342] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-10T18:02:58.512691] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-10T18:02:58.689406] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-10T18:02:59.489377] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-10T18:02:59.761057] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-10T18:03:00.057289] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-10T18:03:00.289438] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-10T18:03:01.074992] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-10T18:03:01.089339] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-10T18:03:01.876683] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T18:03:01.890833] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-10T18:03:02.469749] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-10T18:03:02.689438] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-10T18:03:03.318230] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-10T18:03:03.489390] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-10T18:03:04.289358] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-10T18:03:04.871793] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-10T18:03:04.959748] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-10T18:03:05.089354] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-10T18:03:05.732710] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T18:03:05.889447] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-10T18:03:06.474698] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-10T18:03:06.689400] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-10T18:03:07.489434] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-10T18:03:07.995511] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-10T18:03:08.047455] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-10T18:03:08.289499] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-10T18:03:09.089419] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-10T18:03:09.135494] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-10T18:03:09.889343] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-10T18:03:10.245716] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T18:03:10.515040] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T18:03:10.518840] [INFO ] [REMOTE ] CION: Full fetch complete (40487 records). [2025-10-10T18:03:10.519009] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-10T18:03:10.699164] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-10T18:03:10.947728] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-10T18:03:10.948078] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-10T18:03:10.948733] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-10T18:03:10.948806] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-10T18:03:10.949734] [DEBUG] [LOCAL ] CION: Trimmed 40487 records to 28885 (keeping 200 days of data) [2025-10-10T18:03:11.121337] [DEBUG] [LOCAL ] CION: Primary data saved (28885 records). [2025-10-10T18:03:11.121477] [INFO ] [MAIN ] CION: Full history saved. [2025-10-10T18:03:11.121564] [INFO ] [MAIN ] Update Progress: 458/2373 symbols completed. CION took 32.8s. Estimated remaining: 4h 23m 55s. Rate: 7.3 symbols/min [2025-10-10T18:03:11.291758] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:03:11.331709] [DEBUG] [LOCAL ] CLB: Loaded 33260 existing records from primary storage. [2025-10-10T18:03:11.331993] [INFO ] [MAIN ] CLB: Loaded 33260 existing records. [2025-10-10T18:03:11.511025] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-10T18:03:11.517773] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:03:11.518289] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-10T18:03:11.518379] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-10T18:03:11.519030] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-10T18:03:11.519105] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-10T18:03:11.672902] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T18:03:11.933634] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:03:12.289413] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-10T18:03:12.834170] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-10T18:03:12.893740] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T18:03:12.896758] [INFO ] [REMOTE ] CIO: Full fetch complete (29267 records). [2025-10-10T18:03:12.896836] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-10T18:03:13.100030] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-10T18:03:13.264703] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-10T18:03:13.264794] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-10T18:03:13.265266] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-10T18:03:13.265306] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-10T18:03:13.266137] [DEBUG] [LOCAL ] CIO: Trimmed 29267 records to 20876 (keeping 200 days of data) [2025-10-10T18:03:13.388268] [DEBUG] [LOCAL ] CIO: Primary data saved (20876 records). [2025-10-10T18:03:13.388398] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-10T18:03:13.388491] [INFO ] [MAIN ] Update Progress: 459/2373 symbols completed. CIO took 35.2s. Estimated remaining: 4h 23m 21s. Rate: 7.3 symbols/min [2025-10-10T18:03:13.561555] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:03:13.576214] [DEBUG] [LOCAL ] CLCO: Loaded 12916 existing records from primary storage. [2025-10-10T18:03:13.576480] [INFO ] [MAIN ] CLCO: Loaded 12916 existing records. [2025-10-10T18:03:13.759132] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:03:13.759444] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-10T18:03:13.759513] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-10T18:03:13.759767] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-10T18:03:13.759834] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-10T18:03:13.903124] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-10T18:03:14.128213] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:03:14.239461] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T18:03:14.604697] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-10T18:03:14.689390] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-10T18:03:15.489357] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-10T18:03:16.015054] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T18:03:16.289344] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-10T18:03:16.585676] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-10-10T18:03:16.976049] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-10T18:03:17.089342] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-10T18:03:17.889390] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-10T18:03:18.244791] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T18:03:18.321188] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-10T18:03:18.689493] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-10T18:03:19.489356] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-10T18:03:19.867011] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-10T18:03:19.902772] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T18:03:20.289429] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-10T18:03:21.089439] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-10T18:03:21.568115] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T18:03:21.608792] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-10T18:03:21.889395] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-10T18:03:22.685588] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-10T18:03:22.691883] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-10T18:03:23.489381] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-10T18:03:23.901799] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T18:03:24.289439] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-10T18:03:24.707254] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-10T18:03:24.712617] [INFO ] [REMOTE ] CL: Full fetch complete (77620 records). [2025-10-10T18:03:24.712857] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-10T18:03:24.842128] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T18:03:25.089885] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-10T18:03:25.137225] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-10T18:03:25.137352] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-10T18:03:25.138549] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-10T18:03:25.138622] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-10T18:03:25.140590] [DEBUG] [LOCAL ] CL: Trimmed 77620 records to 54428 (keeping 200 days of data) [2025-10-10T18:03:25.490321] [DEBUG] [LOCAL ] CL: Primary data saved (54428 records). [2025-10-10T18:03:25.490472] [INFO ] [MAIN ] CL: Full history saved. [2025-10-10T18:03:25.490556] [INFO ] [MAIN ] Update Progress: 460/2373 symbols completed. CL took 38.8s. Estimated remaining: 4h 23m 29s. Rate: 7.3 symbols/min [2025-10-10T18:03:25.656231] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:03:25.681723] [DEBUG] [LOCAL ] CLDT: Loaded 25582 existing records from primary storage. [2025-10-10T18:03:25.681993] [INFO ] [MAIN ] CLDT: Loaded 25582 existing records. [2025-10-10T18:03:25.860375] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:03:25.860724] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-10T18:03:25.860887] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-10T18:03:25.861246] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-10T18:03:25.861316] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-10T18:03:25.891779] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-10T18:03:26.158216] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T18:03:26.271137] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:03:26.689380] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-10T18:03:26.750094] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T18:03:27.041282] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-10T18:03:27.489377] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-10T18:03:28.140460] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T18:03:28.145982] [INFO ] [REMOTE ] CIVI: Full fetch complete (75747 records). [2025-10-10T18:03:28.146119] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-10T18:03:28.298924] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-10T18:03:28.557102] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-10T18:03:28.557240] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-10T18:03:28.558185] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-10T18:03:28.558248] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-10T18:03:28.559837] [DEBUG] [LOCAL ] CIVI: Trimmed 75747 records to 53392 (keeping 200 days of data) [2025-10-10T18:03:28.886722] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T18:03:28.911663] [DEBUG] [LOCAL ] CIVI: Primary data saved (53392 records). [2025-10-10T18:03:28.911831] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-10T18:03:28.912796] [INFO ] [MAIN ] Update Progress: 461/2373 symbols completed. CIVI took 44.9s. Estimated remaining: 4h 23m 1s. Rate: 7.3 symbols/min [2025-10-10T18:03:29.077040] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:03:29.089441] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-10T18:03:29.134096] [DEBUG] [LOCAL ] CLF: Loaded 54131 existing records from primary storage. [2025-10-10T18:03:29.134466] [INFO ] [MAIN ] CLF: Loaded 54131 existing records. [2025-10-10T18:03:29.306449] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:03:29.306721] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-10T18:03:29.306779] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-10T18:03:29.307085] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-10T18:03:29.307127] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-10T18:03:29.657249] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:03:29.889351] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-10T18:03:30.099833] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T18:03:30.606809] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-10T18:03:30.689335] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-10T18:03:31.489338] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-10T18:03:31.534057] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-10T18:03:32.289353] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-10T18:03:32.360130] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-10T18:03:32.393489] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-10T18:03:33.089408] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-10T18:03:33.760546] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-10T18:03:33.889350] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-10T18:03:34.083677] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-10T18:03:34.689383] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-10T18:03:35.489436] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-10T18:03:35.561689] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T18:03:36.184243] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T18:03:36.289385] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-10T18:03:37.089346] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-10T18:03:37.130463] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T18:03:37.889350] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-10T18:03:38.019558] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-10T18:03:38.116351] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-10T18:03:38.689371] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-10T18:03:39.489440] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-10T18:03:39.725546] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-10T18:03:40.196280] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-10T18:03:40.289366] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-10T18:03:40.981831] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-10T18:03:41.089384] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-10T18:03:41.819824] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-10T18:03:41.889353] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-10T18:03:42.054356] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T18:03:42.689370] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-10T18:03:42.815269] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T18:03:43.489389] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-10T18:03:43.856676] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-10T18:03:44.289388] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-10T18:03:45.089406] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-10T18:03:45.353119] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-10T18:03:45.791461] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-10T18:03:45.889383] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-10T18:03:46.646430] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-10T18:03:46.689373] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-10T18:03:47.489406] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-10T18:03:47.855727] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-10T18:03:47.858545] [INFO ] [REMOTE ] CLB: Full fetch complete (46320 records). [2025-10-10T18:03:47.858630] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-10T18:03:47.859291] [FATAL] [VALIDATOR ] CLB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:03:47.859376] [FATAL] [MAIN ] CLB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:03:47.859419] [WARN ] [MAIN ] CLB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:03:47.859481] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-10T18:03:47.859536] [DEBUG] [LOCAL ] CLB: No primary data file found to delete. [2025-10-10T18:03:47.859570] [INFO ] [LOCAL ] CLB: Starting deletion of derivative data. [2025-10-10T18:03:47.859762] [DEBUG] [LOCAL ] CLB: Deleted derivative data file. [2025-10-10T18:03:47.859850] [INFO ] [MAIN ] Update Progress: 462/2373 symbols completed. CLB took 36.7s. Estimated remaining: 4h 23m 37s. Rate: 7.2 symbols/min [2025-10-10T18:03:48.030432] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:03:48.059035] [DEBUG] [LOCAL ] CLH: Loaded 27839 existing records from primary storage. [2025-10-10T18:03:48.059310] [INFO ] [MAIN ] CLH: Loaded 27839 existing records. [2025-10-10T18:03:48.243336] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:03:48.244256] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-10T18:03:48.244393] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-10T18:03:48.244769] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-10T18:03:48.244871] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-10T18:03:48.289686] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-10T18:03:48.422923] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T18:03:48.714396] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:03:48.739563] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-10-10T18:03:49.089388] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-10T18:03:49.570451] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T18:03:49.573172] [INFO ] [REMOTE ] CLCO: Full fetch complete (22674 records). [2025-10-10T18:03:49.573248] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-10T18:03:49.894580] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-10T18:03:49.961305] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-10T18:03:49.961404] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-10T18:03:49.962226] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-10T18:03:49.962295] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-10T18:03:49.963111] [DEBUG] [LOCAL ] CLCO: Trimmed 22674 records to 13109 (keeping 200 days of data) [2025-10-10T18:03:50.043620] [DEBUG] [LOCAL ] CLCO: Primary data saved (13109 records). [2025-10-10T18:03:50.043838] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-10T18:03:50.043951] [INFO ] [MAIN ] Update Progress: 463/2373 symbols completed. CLCO took 36.7s. Estimated remaining: 4h 23m 3s. Rate: 7.3 symbols/min [2025-10-10T18:03:50.222442] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:03:50.235944] [DEBUG] [LOCAL ] CLPR: Loaded 10621 existing records from primary storage. [2025-10-10T18:03:50.236197] [INFO ] [MAIN ] CLPR: Loaded 10621 existing records. [2025-10-10T18:03:50.417197] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:03:50.417472] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-10T18:03:50.417525] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-10T18:03:50.418215] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-10T18:03:50.418276] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-10T18:03:50.695033] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-10T18:03:50.786610] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:03:51.426614] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-10T18:03:51.489448] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-10T18:03:51.687322] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T18:03:51.789118] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-10T18:03:52.289406] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-10T18:03:53.089357] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-10T18:03:53.534902] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-10T18:03:53.593035] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T18:03:53.889431] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-10T18:03:54.396227] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-10T18:03:54.399560] [INFO ] [REMOTE ] CLDT: Full fetch complete (37270 records). [2025-10-10T18:03:54.399683] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-10T18:03:54.696320] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-10T18:03:54.801416] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-10T18:03:54.801517] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-10T18:03:54.802325] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-10T18:03:54.802396] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-10T18:03:54.803543] [DEBUG] [LOCAL ] CLDT: Trimmed 37270 records to 25799 (keeping 200 days of data) [2025-10-10T18:03:54.967893] [DEBUG] [LOCAL ] CLDT: Primary data saved (25799 records). [2025-10-10T18:03:54.968069] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-10T18:03:54.968175] [INFO ] [MAIN ] Update Progress: 464/2373 symbols completed. CLDT took 29.5s. Estimated remaining: 4h 22m 41s. Rate: 7.3 symbols/min [2025-10-10T18:03:55.144729] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:03:55.201587] [DEBUG] [LOCAL ] CLS: Loaded 53980 existing records from primary storage. [2025-10-10T18:03:55.202228] [INFO ] [MAIN ] CLS: Loaded 53980 existing records. [2025-10-10T18:03:55.419304] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:03:55.419590] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-10T18:03:55.419664] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-10T18:03:55.419956] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-10T18:03:55.420014] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-10T18:03:55.495319] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-10T18:03:55.816623] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:03:56.175594] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-10T18:03:56.272814] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-10T18:03:56.289324] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-10T18:03:56.462103] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T18:03:57.089434] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-10T18:03:57.857372] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T18:03:57.889402] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-10T18:03:58.689390] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-10T18:03:58.886952] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-10T18:03:59.340253] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-10T18:03:59.489407] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-10T18:04:00.289441] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-10T18:04:01.089408] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-10T18:04:01.223553] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T18:04:01.428594] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-10T18:04:01.607513] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.92 seconds). [2025-10-10T18:04:01.889447] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-10T18:04:02.689422] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-10T18:04:03.033217] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-10T18:04:03.382094] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-10T18:04:03.388125] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-10-10T18:04:03.388359] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-10T18:04:03.497856] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-10T18:04:03.840095] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-10T18:04:03.840236] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-10T18:04:03.841348] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-10T18:04:03.841419] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-10T18:04:03.844763] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 54521 (keeping 200 days of data) [2025-10-10T18:04:04.187385] [DEBUG] [LOCAL ] CLF: Primary data saved (54521 records). [2025-10-10T18:04:04.187560] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-10T18:04:04.188255] [INFO ] [MAIN ] Update Progress: 465/2373 symbols completed. CLF took 35.3s. Estimated remaining: 4h 22m 37s. Rate: 7.3 symbols/min [2025-10-10T18:04:04.292997] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-10T18:04:04.373718] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:04:04.430410] [DEBUG] [LOCAL ] CLVT: Loaded 52362 existing records from primary storage. [2025-10-10T18:04:04.430936] [INFO ] [MAIN ] CLVT: Loaded 52362 existing records. [2025-10-10T18:04:04.618223] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:04:04.626306] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-10T18:04:04.626501] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-10T18:04:04.627623] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-10T18:04:04.627785] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-10T18:04:04.627544] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T18:04:05.001888] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:04:05.032384] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-10T18:04:05.089350] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-10T18:04:05.889373] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-10T18:04:06.352310] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-10T18:04:06.689393] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-10T18:04:06.792109] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T18:04:07.005257] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T18:04:07.489416] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-10T18:04:08.289452] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-10T18:04:08.470920] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T18:04:08.770176] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-10T18:04:09.089407] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-10T18:04:09.889377] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-10T18:04:09.945575] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-10T18:04:10.434455] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T18:04:10.689378] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-10T18:04:10.785222] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-10T18:04:11.441518] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-10T18:04:11.489390] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-10T18:04:12.255805] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T18:04:12.257401] [INFO ] [REMOTE ] CLPR: Full fetch complete (16447 records). [2025-10-10T18:04:12.257484] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-10T18:04:12.295243] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-10T18:04:12.628741] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-10T18:04:12.628854] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-10T18:04:12.629534] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-10T18:04:12.629581] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-10T18:04:12.630155] [DEBUG] [LOCAL ] CLPR: Trimmed 16447 records to 10667 (keeping 200 days of data) [2025-10-10T18:04:12.694945] [DEBUG] [LOCAL ] CLPR: Primary data saved (10667 records). [2025-10-10T18:04:12.695109] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-10T18:04:12.695197] [INFO ] [MAIN ] Update Progress: 466/2373 symbols completed. CLPR took 22.7s. Estimated remaining: 4h 22m 30s. Rate: 7.3 symbols/min [2025-10-10T18:04:12.875391] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:04:12.903742] [DEBUG] [LOCAL ] CLW: Loaded 21847 existing records from primary storage. [2025-10-10T18:04:12.904026] [INFO ] [MAIN ] CLW: Loaded 21847 existing records. [2025-10-10T18:04:13.087158] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:04:13.087443] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-10T18:04:13.087493] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-10T18:04:13.087829] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-10T18:04:13.087921] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-10T18:04:13.099308] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-10T18:04:13.447821] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:04:13.786817] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T18:04:13.889359] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-10T18:04:14.451050] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-10T18:04:14.689406] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-10T18:04:15.375257] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-10T18:04:15.489375] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-10T18:04:16.289355] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-10T18:04:16.836726] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-10T18:04:17.089443] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-10T18:04:17.347385] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-10T18:04:17.459981] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-10T18:04:17.889414] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-10T18:04:18.602012] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-10T18:04:18.689449] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-10T18:04:19.489396] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-10T18:04:20.189620] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-10T18:04:20.289401] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-10T18:04:20.339895] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-10T18:04:21.089483] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-10T18:04:21.419181] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-10T18:04:21.635547] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T18:04:21.889413] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-10T18:04:22.689422] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-10T18:04:23.489614] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-10T18:04:23.545006] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-10T18:04:23.678420] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T18:04:24.185302] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T18:04:24.188779] [INFO ] [REMOTE ] CLH: Full fetch complete (41537 records). [2025-10-10T18:04:24.188912] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-10T18:04:24.189691] [FATAL] [VALIDATOR ] CLH: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:04:24.189784] [FATAL] [MAIN ] CLH: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:04:24.189901] [WARN ] [MAIN ] CLH: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:04:24.190067] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-10T18:04:24.190166] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-10-10T18:04:24.190272] [INFO ] [LOCAL ] CLH: Starting deletion of derivative data. [2025-10-10T18:04:24.190606] [DEBUG] [LOCAL ] CLH: Deleted derivative data file. [2025-10-10T18:04:24.190773] [INFO ] [MAIN ] Update Progress: 467/2373 symbols completed. CLH took 36.3s. Estimated remaining: 4h 22m 35s. Rate: 7.3 symbols/min [2025-10-10T18:04:24.295088] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-10T18:04:24.414409] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:04:24.477770] [DEBUG] [LOCAL ] CLX: Loaded 51973 existing records from primary storage. [2025-10-10T18:04:24.478145] [INFO ] [MAIN ] CLX: Loaded 51973 existing records. [2025-10-10T18:04:24.683155] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-10T18:04:24.687970] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:04:24.694581] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-10T18:04:24.694719] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-10T18:04:24.695000] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-10T18:04:24.695057] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-10T18:04:25.041134] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:04:25.089378] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-10T18:04:25.889397] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-10T18:04:26.689358] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-10T18:04:26.913445] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-10T18:04:27.041321] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-10T18:04:27.326979] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-10T18:04:27.489449] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-10T18:04:27.786404] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-10T18:04:28.289415] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-10T18:04:29.089451] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-10T18:04:29.539065] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-10T18:04:29.889371] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-10T18:04:30.232199] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T18:04:30.408437] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T18:04:30.689375] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-10T18:04:31.489393] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-10T18:04:31.931736] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-10T18:04:32.289388] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-10T18:04:32.486130] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-10T18:04:32.954573] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-10T18:04:33.089384] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-10T18:04:33.889365] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-10T18:04:34.126308] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T18:04:34.689406] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-10T18:04:35.119406] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-10T18:04:35.200821] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T18:04:35.489373] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-10T18:04:36.289343] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-10T18:04:36.517083] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-10T18:04:36.784936] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-10T18:04:36.789841] [INFO ] [REMOTE ] CLS: Full fetch complete (77471 records). [2025-10-10T18:04:36.789951] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-10T18:04:37.094564] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-10T18:04:37.186786] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-10T18:04:37.186869] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-10T18:04:37.187763] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-10T18:04:37.187827] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-10T18:04:37.189298] [DEBUG] [LOCAL ] CLS: Trimmed 77471 records to 54367 (keeping 200 days of data) [2025-10-10T18:04:37.517183] [DEBUG] [LOCAL ] CLS: Primary data saved (54367 records). [2025-10-10T18:04:37.517346] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-10T18:04:37.517471] [INFO ] [MAIN ] Update Progress: 468/2373 symbols completed. CLS took 42.5s. Estimated remaining: 4h 22m 47s. Rate: 7.2 symbols/min [2025-10-10T18:04:37.683448] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:04:37.725964] [DEBUG] [LOCAL ] CM: Loaded 49101 existing records from primary storage. [2025-10-10T18:04:37.726291] [INFO ] [MAIN ] CM: Loaded 49101 existing records. [2025-10-10T18:04:37.895814] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-10T18:04:37.900782] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:04:37.901962] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-10T18:04:37.902028] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-10T18:04:37.902257] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-10T18:04:37.902314] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-10T18:04:38.256321] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:04:38.371098] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T18:04:38.583854] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-10T18:04:38.689339] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-10T18:04:39.238449] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T18:04:39.489383] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-10T18:04:40.207978] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T18:04:40.289404] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-10T18:04:40.810972] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-10T18:04:41.089378] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-10T18:04:41.697497] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-10T18:04:41.889420] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-10T18:04:42.353878] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T18:04:42.356171] [INFO ] [REMOTE ] CLW: Full fetch complete (34233 records). [2025-10-10T18:04:42.356245] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-10T18:04:42.691607] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-10T18:04:42.725108] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-10T18:04:42.725252] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-10T18:04:42.725892] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-10T18:04:42.725957] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-10T18:04:42.726756] [DEBUG] [LOCAL ] CLW: Trimmed 34233 records to 21986 (keeping 200 days of data) [2025-10-10T18:04:42.856352] [DEBUG] [LOCAL ] CLW: Primary data saved (21986 records). [2025-10-10T18:04:42.856511] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-10T18:04:42.856625] [INFO ] [MAIN ] Update Progress: 469/2373 symbols completed. CLW took 30.2s. Estimated remaining: 4h 22m 27s. Rate: 7.3 symbols/min [2025-10-10T18:04:43.029082] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:04:43.029264] [DEBUG] [LOCAL ] CMA: No existing data file found in primary storage. [2025-10-10T18:04:43.029303] [WARN ] [MAIN ] CMA: No existing data found, performing full refresh instead. [2025-10-10T18:04:43.029418] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-10T18:04:43.029459] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-10T18:04:43.029501] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-10-10T18:04:43.029535] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-10T18:04:43.376184] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:04:43.489343] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-10T18:04:43.860328] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-10T18:04:43.866050] [INFO ] [REMOTE ] CLVT: Full fetch complete (75212 records). [2025-10-10T18:04:43.866209] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-10T18:04:44.291378] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-10T18:04:44.290874] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-10T18:04:44.291577] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-10T18:04:44.293764] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-10T18:04:44.293976] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-10T18:04:44.296051] [DEBUG] [LOCAL ] CLVT: Trimmed 75212 records to 52731 (keeping 200 days of data) [2025-10-10T18:04:44.619993] [DEBUG] [LOCAL ] CLVT: Primary data saved (52731 records). [2025-10-10T18:04:44.620172] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-10T18:04:44.620277] [INFO ] [MAIN ] Update Progress: 470/2373 symbols completed. CLVT took 40.4s. Estimated remaining: 4h 21m 52s. Rate: 7.3 symbols/min [2025-10-10T18:04:44.815853] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:04:44.846777] [DEBUG] [LOCAL ] CMBT: Loaded 25145 existing records from primary storage. [2025-10-10T18:04:44.847107] [INFO ] [MAIN ] CMBT: Loaded 25145 existing records. [2025-10-10T18:04:45.077239] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:04:45.081373] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-10T18:04:45.082787] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-10T18:04:45.082668] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-10T18:04:45.093547] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-10T18:04:45.093931] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-10T18:04:45.127097] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-10T18:04:45.528451] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:04:45.558864] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-10T18:04:45.889362] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-10T18:04:46.218134] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T18:04:46.689353] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-10T18:04:47.244949] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-10T18:04:47.489396] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-10T18:04:47.823788] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T18:04:48.036112] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T18:04:48.289423] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-10T18:04:49.089340] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-10T18:04:49.350337] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T18:04:49.546266] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-10T18:04:49.889366] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-10T18:04:50.251439] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-10T18:04:50.689369] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-10T18:04:51.489406] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-10T18:04:51.764581] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T18:04:52.289394] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-10T18:04:52.524955] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T18:04:52.600141] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T18:04:53.089362] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-10T18:04:53.889436] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-10T18:04:54.421231] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-10T18:04:54.689364] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-10T18:04:54.932373] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T18:04:55.489346] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-10T18:04:56.054910] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-10T18:04:56.078472] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-10T18:04:56.289397] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-10T18:04:57.089445] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-10T18:04:57.468694] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-10T18:04:57.604748] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-10T18:04:57.889477] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-10T18:04:58.386456] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T18:04:58.689362] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-10T18:04:59.246082] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T18:04:59.489414] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-10T18:05:00.289394] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-10T18:05:00.549969] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T18:05:00.633366] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T18:05:01.089380] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-10T18:05:01.607950] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T18:05:01.889381] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-10T18:05:02.689379] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-10T18:05:02.836053] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T18:05:03.284638] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-10T18:05:03.489452] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-10T18:05:03.910896] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T18:05:04.289498] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-10T18:05:05.089387] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-10T18:05:05.456982] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T18:05:05.889356] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-10T18:05:06.114858] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-10T18:05:06.689418] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-10T18:05:07.033422] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-10T18:05:07.489502] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-10T18:05:07.796175] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-10T18:05:07.803942] [INFO ] [REMOTE ] CLX: Full fetch complete (73249 records). [2025-10-10T18:05:07.804162] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-10T18:05:08.291351] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-10T18:05:08.378525] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-10T18:05:08.378636] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-10T18:05:08.379806] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-10T18:05:08.379893] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-10T18:05:08.381618] [DEBUG] [LOCAL ] CLX: Trimmed 73249 records to 52350 (keeping 200 days of data) [2025-10-10T18:05:08.722375] [DEBUG] [LOCAL ] CLX: Primary data saved (52350 records). [2025-10-10T18:05:08.722537] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-10T18:05:08.722907] [INFO ] [MAIN ] Update Progress: 471/2373 symbols completed. CLX took 44.5s. Estimated remaining: 4h 22m 48s. Rate: 7.2 symbols/min [2025-10-10T18:05:08.896022] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:05:08.896341] [DEBUG] [LOCAL ] CMC: No existing data file found in primary storage. [2025-10-10T18:05:08.896547] [WARN ] [MAIN ] CMC: No existing data found, performing full refresh instead. [2025-10-10T18:05:08.896783] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-10T18:05:08.897001] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-10T18:05:08.897064] [DEBUG] [LOCAL ] CMC: No primary data file found to delete. [2025-10-10T18:05:08.897279] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-10T18:05:09.033972] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-10T18:05:09.095056] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-10T18:05:09.299445] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:05:09.504266] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T18:05:09.889413] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-10T18:05:10.076291] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T18:05:10.689415] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-10T18:05:10.860049] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-10T18:05:10.864715] [INFO ] [REMOTE ] CMBT: Full fetch complete (31874 records). [2025-10-10T18:05:10.864830] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-10T18:05:11.239983] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-10T18:05:11.240073] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-10T18:05:11.240758] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-10T18:05:11.240827] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-10T18:05:11.241770] [DEBUG] [LOCAL ] CMBT: Trimmed 31874 records to 25517 (keeping 200 days of data) [2025-10-10T18:05:11.393184] [DEBUG] [LOCAL ] CMBT: Primary data saved (25517 records). [2025-10-10T18:05:11.393331] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-10T18:05:11.393416] [INFO ] [MAIN ] Update Progress: 472/2373 symbols completed. CMBT took 26.8s. Estimated remaining: 4h 22m 17s. Rate: 7.2 symbols/min [2025-10-10T18:05:11.495934] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-10T18:05:11.576158] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:05:11.584383] [DEBUG] [LOCAL ] CMCM: Loaded 4766 existing records from primary storage. [2025-10-10T18:05:11.584672] [INFO ] [MAIN ] CMCM: Loaded 4766 existing records. [2025-10-10T18:05:11.773857] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:05:11.790409] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-10T18:05:11.790536] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-10T18:05:11.792111] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T18:05:11.792202] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-10T18:05:11.802364] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-10T18:05:12.166073] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:05:12.208622] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T18:05:12.289352] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-10T18:05:12.856740] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-10T18:05:13.089375] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-10T18:05:13.439054] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T18:05:13.889374] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-10T18:05:14.689445] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-10T18:05:15.099731] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T18:05:15.282807] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-10T18:05:15.489374] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-10T18:05:15.832235] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-10T18:05:15.837755] [INFO ] [REMOTE ] CM: Full fetch complete (69586 records). [2025-10-10T18:05:15.837863] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-10T18:05:16.214759] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-10T18:05:16.214855] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-10T18:05:16.215676] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-10T18:05:16.215743] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-10T18:05:16.217186] [DEBUG] [LOCAL ] CM: Trimmed 69586 records to 49467 (keeping 200 days of data) [2025-10-10T18:05:16.306430] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-10T18:05:16.519168] [DEBUG] [LOCAL ] CM: Primary data saved (49467 records). [2025-10-10T18:05:16.519316] [INFO ] [MAIN ] CM: Full history saved. [2025-10-10T18:05:16.519398] [INFO ] [MAIN ] Update Progress: 473/2373 symbols completed. CM took 39.0s. Estimated remaining: 4h 21m 56s. Rate: 7.3 symbols/min [2025-10-10T18:05:16.689636] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:05:16.689801] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-10T18:05:16.689839] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-10T18:05:16.690002] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-10T18:05:16.690043] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-10T18:05:16.690107] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-10T18:05:16.690160] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-10T18:05:17.037042] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:05:17.089330] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-10T18:05:17.322415] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T18:05:17.322770] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-10T18:05:17.323077] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:05:17.323247] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-10T18:05:17.323316] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:05:17.323384] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-10T18:05:17.323448] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-10T18:05:17.323484] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-10T18:05:17.323522] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-10T18:05:17.323569] [INFO ] [MAIN ] Update Progress: 474/2373 symbols completed. CMDB took 0.8s. Estimated remaining: 4h 21m 18s. Rate: 7.3 symbols/min [2025-10-10T18:05:17.475985] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-10T18:05:17.535163] [INFO ] [REMOTE ] CMA: Full fetch complete (73120 records). [2025-10-10T18:05:17.534854] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:05:17.536323] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-10T18:05:17.902402] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-10T18:05:17.905890] [DEBUG] [LOCAL ] CMG: Loaded 54111 existing records from primary storage. [2025-10-10T18:05:17.912396] [INFO ] [MAIN ] CMG: Loaded 54111 existing records. [2025-10-10T18:05:18.068165] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-10T18:05:18.077107] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-10T18:05:18.105225] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-10T18:05:18.145037] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-10T18:05:18.176091] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T18:05:18.250182] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:05:18.250560] [DEBUG] [LOCAL ] CMA: Trimmed 73120 records to 50699 (keeping 200 days of data) [2025-10-10T18:05:18.251025] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-10T18:05:18.251610] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-10T18:05:18.252573] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-10T18:05:18.252694] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-10T18:05:18.690952] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-10T18:05:18.736124] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:05:18.751925] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-10T18:05:18.972999] [DEBUG] [LOCAL ] CMA: Primary data saved (50699 records). [2025-10-10T18:05:18.973220] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-10T18:05:18.973320] [INFO ] [MAIN ] Update Progress: 475/2373 symbols completed. CMA took 36.1s. Estimated remaining: 4h 20m 43s. Rate: 7.3 symbols/min [2025-10-10T18:05:19.138068] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:05:19.176404] [DEBUG] [LOCAL ] CMI: Loaded 41934 existing records from primary storage. [2025-10-10T18:05:19.176736] [INFO ] [MAIN ] CMI: Loaded 41934 existing records. [2025-10-10T18:05:19.350174] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:05:19.350384] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-10T18:05:19.350432] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-10T18:05:19.350748] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-10T18:05:19.350804] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-10T18:05:19.494528] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-10T18:05:19.694180] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:05:20.289352] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-10T18:05:20.637933] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T18:05:21.089399] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-10T18:05:21.835055] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-10T18:05:21.889339] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-10T18:05:22.002848] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-10T18:05:22.113950] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-10T18:05:22.527128] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-10T18:05:22.689354] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-10T18:05:23.354591] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-10T18:05:23.489413] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-10T18:05:24.289363] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-10T18:05:24.662046] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-10T18:05:25.089380] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-10T18:05:25.775308] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-10T18:05:25.889381] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-10T18:05:25.899284] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-10T18:05:26.689387] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-10T18:05:27.489397] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-10T18:05:27.791190] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T18:05:28.280776] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-10T18:05:28.289322] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-10T18:05:28.741314] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-10T18:05:29.089389] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-10T18:05:29.201746] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-10T18:05:29.889447] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-10T18:05:30.689371] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-10T18:05:31.489353] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-10T18:05:31.625398] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-10T18:05:31.650264] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T18:05:31.651544] [INFO ] [REMOTE ] CMCM: Full fetch complete (6905 records). [2025-10-10T18:05:31.651618] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-10T18:05:31.787507] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-10T18:05:32.083157] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-10T18:05:32.083246] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-10T18:05:32.083467] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-10T18:05:32.083508] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-10T18:05:32.083918] [DEBUG] [LOCAL ] CMCM: Trimmed 6905 records to 4862 (keeping 200 days of data) [2025-10-10T18:05:32.110190] [DEBUG] [LOCAL ] CMCM: Primary data saved (4862 records). [2025-10-10T18:05:32.110300] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-10T18:05:32.110380] [INFO ] [MAIN ] Update Progress: 476/2373 symbols completed. CMCM took 20.7s. Estimated remaining: 4h 20m 55s. Rate: 7.3 symbols/min [2025-10-10T18:05:32.274761] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:05:32.296594] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-10T18:05:32.312783] [DEBUG] [LOCAL ] CMP: Loaded 36351 existing records from primary storage. [2025-10-10T18:05:32.313105] [INFO ] [MAIN ] CMP: Loaded 36351 existing records. [2025-10-10T18:05:32.486447] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:05:32.486697] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-10T18:05:32.486756] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-10T18:05:32.486947] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-10T18:05:32.486986] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-10T18:05:32.832741] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:05:33.089375] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-10T18:05:33.585867] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-10T18:05:33.889374] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-10T18:05:34.310690] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T18:05:34.689413] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-10T18:05:34.853229] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T18:05:35.489353] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-10T18:05:35.878940] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T18:05:35.990319] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T18:05:36.289432] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-10T18:05:37.077333] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T18:05:37.089321] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-10T18:05:37.889441] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-10T18:05:38.201395] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T18:05:38.698612] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-10T18:05:38.705672] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T18:05:39.489392] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-10T18:05:40.203438] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-10T18:05:40.289371] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-10T18:05:40.449162] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T18:05:41.089382] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-10T18:05:41.126974] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-10T18:05:41.889391] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-10T18:05:42.453898] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-10T18:05:42.562173] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-10T18:05:42.689360] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-10T18:05:43.489355] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-10T18:05:43.556934] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T18:05:44.289383] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-10T18:05:45.089376] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-10T18:05:45.377825] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T18:05:45.421143] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-10T18:05:45.638620] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-10T18:05:45.889403] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-10T18:05:46.689363] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-10T18:05:47.043932] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T18:05:47.489352] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-10T18:05:47.588259] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-10T18:05:48.139275] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-10T18:05:48.289403] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-10T18:05:49.089471] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-10T18:05:49.528584] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-10T18:05:49.889417] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-10T18:05:50.689379] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-10T18:05:50.751959] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T18:05:50.939630] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-10T18:05:51.447620] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-10T18:05:51.452140] [INFO ] [REMOTE ] CMC: Full fetch complete (66816 records). [2025-10-10T18:05:51.452310] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-10T18:05:51.495338] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-10T18:05:51.863728] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-10T18:05:51.863831] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-10T18:05:51.864683] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-10T18:05:51.864748] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-10T18:05:51.866630] [DEBUG] [LOCAL ] CMC: Trimmed 66816 records to 46065 (keeping 200 days of data) [2025-10-10T18:05:52.138214] [DEBUG] [LOCAL ] CMC: Primary data saved (46065 records). [2025-10-10T18:05:52.138364] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-10T18:05:52.138438] [INFO ] [MAIN ] Update Progress: 477/2373 symbols completed. CMC took 43.4s. Estimated remaining: 4h 21m 33s. Rate: 7.2 symbols/min [2025-10-10T18:05:52.289403] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-10T18:05:52.315755] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T18:05:53.094001] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-10T18:05:53.096525] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T18:05:53.889410] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-10T18:05:54.249135] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T18:05:54.581952] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-10T18:05:54.689361] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-10T18:05:55.300124] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T18:05:55.489392] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-10T18:05:56.040843] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-10T18:05:56.289355] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-10T18:05:56.373694] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T18:05:56.379723] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-10-10T18:05:56.379879] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-10T18:05:56.773755] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-10T18:05:56.773846] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-10T18:05:56.774856] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-10T18:05:56.774927] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-10T18:05:56.776483] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 54500 (keeping 200 days of data) [2025-10-10T18:05:57.112325] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-10T18:05:57.143914] [DEBUG] [LOCAL ] CMG: Primary data saved (54500 records). [2025-10-10T18:05:57.144042] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-10T18:05:57.144187] [INFO ] [MAIN ] Update Progress: 478/2373 symbols completed. CMG took 39.8s. Estimated remaining: 4h 21m 12s. Rate: 7.3 symbols/min [2025-10-10T18:05:58.108836] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T18:05:58.113719] [INFO ] [REMOTE ] CMP: Full fetch complete (51831 records). [2025-10-10T18:05:58.113929] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-10T18:05:58.438835] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-10T18:05:58.465623] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-10T18:05:58.544364] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-10T18:05:58.544456] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-10T18:05:58.545315] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-10T18:05:58.545381] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-10T18:05:58.546545] [DEBUG] [LOCAL ] CMP: Trimmed 51831 records to 36590 (keeping 200 days of data) [2025-10-10T18:05:58.757230] [DEBUG] [LOCAL ] CMP: Primary data saved (36590 records). [2025-10-10T18:05:58.757386] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-10T18:05:58.757474] [INFO ] [MAIN ] Update Progress: 479/2373 symbols completed. CMP took 26.6s. Estimated remaining: 4h 20m 37s. Rate: 7.3 symbols/min [2025-10-10T18:06:00.152877] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-10T18:06:00.160201] [INFO ] [REMOTE ] CMI: Full fetch complete (60197 records). [2025-10-10T18:06:00.160468] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-10T18:06:00.680014] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-10T18:06:00.680149] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-10T18:06:00.681466] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-10T18:06:00.681562] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-10T18:06:00.683446] [DEBUG] [LOCAL ] CMI: Trimmed 60197 records to 42226 (keeping 200 days of data) [2025-10-10T18:06:00.967625] [DEBUG] [LOCAL ] CMI: Primary data saved (42226 records). [2025-10-10T18:06:00.967801] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-10T18:06:00.968332] [INFO ] [MAIN ] Update Progress: 480/2373 symbols completed. CMI took 42.0s. Estimated remaining: 4h 20m 5s. Rate: 7.3 symbols/min [2025-10-10T18:06:01.712804] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:06:01.781935] [DEBUG] [LOCAL ] CMSA: No existing data file found in primary storage. [2025-10-10T18:06:01.784242] [WARN ] [MAIN ] CMSA: No existing data found, performing full refresh instead. [2025-10-10T18:06:01.814013] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:06:01.858549] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:06:01.853757] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-10T18:06:01.861302] [DEBUG] [LOCAL ] CMS: No existing data file found in primary storage. [2025-10-10T18:06:01.861422] [WARN ] [MAIN ] CMS: No existing data found, performing full refresh instead. [2025-10-10T18:06:01.861560] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-10T18:06:01.861001] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:06:01.862698] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-10T18:06:01.862850] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-10T18:06:01.863204] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-10T18:06:01.863018] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-10T18:06:01.875292] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-10T18:06:01.900890] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-10T18:06:02.239139] [DEBUG] [LOCAL ] CMRE: Loaded 35870 existing records from primary storage. [2025-10-10T18:06:02.276349] [DEBUG] [LOCAL ] CMPO: Loaded 39261 existing records from primary storage. [2025-10-10T18:06:02.290324] [INFO ] [MAIN ] CMRE: Loaded 35870 existing records. [2025-10-10T18:06:02.339366] [INFO ] [MAIN ] CMPO: Loaded 39261 existing records. [2025-10-10T18:06:03.021921] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:06:03.124094] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:06:03.145899] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-10T18:06:03.135075] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-10T18:06:03.199102] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-10T18:06:03.205109] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:06:03.211131] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-10T18:06:03.210858] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:06:03.212458] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-10T18:06:03.212557] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-10T18:06:03.212698] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-10T18:06:03.218051] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-10T18:06:03.259814] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-10T18:06:03.294799] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-10T18:06:03.985230] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:06:03.999383] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-10T18:06:04.033715] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:06:04.039991] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-10T18:06:04.043154] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-10T18:06:04.045728] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-10T18:06:04.487315] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-10T18:06:04.489076] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-10T18:06:05.067136] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T18:06:05.095716] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-10T18:06:05.097176] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-10T18:06:05.094257] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-10T18:06:05.100003] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-10T18:06:05.106939] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-10T18:06:05.456239] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-10T18:06:05.877600] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T18:06:05.889334] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-10T18:06:06.099869] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-10T18:06:06.689388] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-10T18:06:07.139591] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T18:06:07.330509] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T18:06:07.489404] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-10T18:06:08.289371] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-10T18:06:08.360281] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-10T18:06:08.651350] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T18:06:09.038862] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-10T18:06:09.089402] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-10T18:06:09.759966] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-10T18:06:09.889395] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-10T18:06:10.585503] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-10T18:06:10.689413] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-10T18:06:11.072207] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-10T18:06:11.489400] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-10T18:06:12.289398] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-10T18:06:13.089357] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-10T18:06:13.120257] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T18:06:13.532871] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-10T18:06:13.889387] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-10T18:06:14.403941] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T18:06:14.689402] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-10T18:06:15.489395] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-10T18:06:15.646114] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T18:06:16.289439] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-10T18:06:16.432569] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-10T18:06:16.458972] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T18:06:17.089397] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-10T18:06:17.889467] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-10T18:06:18.123160] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T18:06:18.257834] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T18:06:18.689395] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-10T18:06:19.479372] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-10T18:06:19.490678] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-10T18:06:20.289399] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-10T18:06:20.356331] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T18:06:20.561462] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-10T18:06:21.089410] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-10T18:06:21.715290] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-10T18:06:21.889443] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-10T18:06:22.564243] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-10T18:06:22.681158] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T18:06:22.689429] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-10T18:06:23.383721] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T18:06:23.384816] [INFO ] [REMOTE ] CMSA: Full fetch complete (5083 records). [2025-10-10T18:06:23.384912] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-10T18:06:23.489944] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-10T18:06:23.766934] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-10T18:06:23.767034] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-10T18:06:23.767248] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-10T18:06:23.767290] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-10T18:06:23.767744] [DEBUG] [LOCAL ] CMSA: Trimmed 5083 records to 3556 (keeping 200 days of data) [2025-10-10T18:06:23.791733] [DEBUG] [LOCAL ] CMSA: Primary data saved (3556 records). [2025-10-10T18:06:23.791875] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-10T18:06:23.792010] [INFO ] [MAIN ] Update Progress: 481/2373 symbols completed. CMSA took 22.8s. Estimated remaining: 4h 20m 54s. Rate: 7.3 symbols/min [2025-10-10T18:06:23.969701] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:06:23.982947] [DEBUG] [LOCAL ] CMSC: Loaded 5017 existing records from primary storage. [2025-10-10T18:06:23.983260] [INFO ] [MAIN ] CMSC: Loaded 5017 existing records. [2025-10-10T18:06:24.171795] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:06:24.172067] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-10T18:06:24.172117] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-10T18:06:24.172483] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-10T18:06:24.172820] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-10T18:06:24.294539] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-10T18:06:24.566134] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:06:24.699037] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T18:06:25.089375] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-10T18:06:25.889404] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-10T18:06:26.376697] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-10T18:06:26.589962] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T18:06:26.689431] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-10T18:06:27.489350] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-10T18:06:27.576242] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T18:06:28.221300] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-10T18:06:28.289406] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-10T18:06:28.616171] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T18:06:29.089418] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-10T18:06:29.692263] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-10T18:06:29.889367] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-10T18:06:30.689389] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-10T18:06:30.739673] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-10T18:06:30.743689] [INFO ] [REMOTE ] CMRE: Full fetch complete (50704 records). [2025-10-10T18:06:30.743838] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-10T18:06:31.159454] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-10T18:06:31.159612] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-10T18:06:31.160846] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-10T18:06:31.161132] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-10T18:06:31.185523] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T18:06:31.195739] [DEBUG] [LOCAL ] CMRE: Trimmed 50704 records to 36148 (keeping 200 days of data) [2025-10-10T18:06:31.411740] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-10T18:06:31.438954] [DEBUG] [LOCAL ] CMRE: Primary data saved (36148 records). [2025-10-10T18:06:31.439130] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-10T18:06:31.439225] [INFO ] [MAIN ] Update Progress: 482/2373 symbols completed. CMRE took 30.5s. Estimated remaining: 4h 20m 44s. Rate: 7.3 symbols/min [2025-10-10T18:06:31.494566] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-10T18:06:31.608977] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:06:31.619543] [DEBUG] [LOCAL ] CMSD: Loaded 8044 existing records from primary storage. [2025-10-10T18:06:31.619839] [INFO ] [MAIN ] CMSD: Loaded 8044 existing records. [2025-10-10T18:06:31.794501] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:06:31.794733] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-10T18:06:31.794842] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-10T18:06:31.795109] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-10T18:06:31.795177] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-10T18:06:32.137659] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:06:32.289374] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-10T18:06:33.089399] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-10T18:06:33.220363] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-10T18:06:33.377790] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-10T18:06:33.889415] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-10T18:06:34.168772] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T18:06:34.172744] [INFO ] [REMOTE ] CMPO: Full fetch complete (58655 records). [2025-10-10T18:06:34.172882] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-10T18:06:34.497913] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-10T18:06:34.598546] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-10T18:06:34.598670] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-10T18:06:34.599573] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-10T18:06:34.599670] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-10T18:06:34.601225] [DEBUG] [LOCAL ] CMPO: Trimmed 58655 records to 39544 (keeping 200 days of data) [2025-10-10T18:06:34.691358] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-10T18:06:34.844192] [DEBUG] [LOCAL ] CMPO: Primary data saved (39544 records). [2025-10-10T18:06:34.844432] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-10T18:06:34.844558] [INFO ] [MAIN ] Update Progress: 483/2373 symbols completed. CMPO took 33.9s. Estimated remaining: 4h 20m 16s. Rate: 7.3 symbols/min [2025-10-10T18:06:35.015144] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:06:35.053811] [DEBUG] [LOCAL ] CMTG: Loaded 36441 existing records from primary storage. [2025-10-10T18:06:35.054160] [INFO ] [MAIN ] CMTG: Loaded 36441 existing records. [2025-10-10T18:06:35.235016] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:06:35.235334] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-10T18:06:35.235384] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-10T18:06:35.235707] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-10T18:06:35.235798] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-10T18:06:35.495716] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-10T18:06:35.510043] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-10T18:06:35.613990] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:06:36.289496] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-10T18:06:36.371105] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-10T18:06:37.089419] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-10T18:06:37.438767] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-10T18:06:37.889402] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-10T18:06:38.039686] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-10T18:06:38.689410] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-10T18:06:39.479528] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T18:06:39.489333] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-10T18:06:39.555257] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-10T18:06:40.289442] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-10T18:06:40.532714] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-10T18:06:41.002504] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-10T18:06:41.089396] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-10T18:06:41.795383] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-10T18:06:41.889376] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-10T18:06:42.689416] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-10T18:06:43.489449] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-10T18:06:43.962361] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-10T18:06:44.009247] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T18:06:44.289384] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-10T18:06:44.371849] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-10T18:06:45.024440] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-10T18:06:45.089339] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-10T18:06:45.844480] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T18:06:45.889365] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-10T18:06:46.546802] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-10T18:06:46.689420] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-10T18:06:47.421206] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T18:06:47.422498] [INFO ] [REMOTE ] CMSC: Full fetch complete (7106 records). [2025-10-10T18:06:47.422579] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-10T18:06:47.494488] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-10T18:06:47.834308] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-10T18:06:47.834407] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-10T18:06:47.834801] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-10T18:06:47.834866] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-10T18:06:47.835368] [DEBUG] [LOCAL ] CMSC: Trimmed 7106 records to 5028 (keeping 200 days of data) [2025-10-10T18:06:47.870048] [DEBUG] [LOCAL ] CMSC: Primary data saved (5028 records). [2025-10-10T18:06:47.870280] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-10T18:06:47.870410] [INFO ] [MAIN ] Update Progress: 484/2373 symbols completed. CMSC took 24.1s. Estimated remaining: 4h 20m 27s. Rate: 7.3 symbols/min [2025-10-10T18:06:48.049975] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:06:48.060542] [DEBUG] [LOCAL ] CMU: Loaded 6361 existing records from primary storage. [2025-10-10T18:06:48.060801] [INFO ] [MAIN ] CMU: Loaded 6361 existing records. [2025-10-10T18:06:48.245301] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:06:48.245696] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-10T18:06:48.245784] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-10T18:06:48.246011] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-10T18:06:48.246070] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-10T18:06:48.301156] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-10T18:06:48.616598] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:06:49.089350] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-10T18:06:49.426710] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T18:06:49.889466] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-10T18:06:49.914997] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-10T18:06:50.206014] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T18:06:50.689373] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-10T18:06:51.446282] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-10T18:06:51.489410] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-10T18:06:51.752537] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T18:06:51.757528] [INFO ] [REMOTE ] CMS: Full fetch complete (75978 records). [2025-10-10T18:06:51.757683] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-10T18:06:52.144160] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-10T18:06:52.144272] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-10T18:06:52.145274] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-10T18:06:52.145341] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-10T18:06:52.147036] [DEBUG] [LOCAL ] CMS: Trimmed 75978 records to 53373 (keeping 200 days of data) [2025-10-10T18:06:52.334151] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-10T18:06:52.553439] [DEBUG] [LOCAL ] CMS: Primary data saved (53373 records). [2025-10-10T18:06:52.553680] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-10T18:06:52.553807] [INFO ] [MAIN ] Update Progress: 485/2373 symbols completed. CMS took 51.6s. Estimated remaining: 4h 20m 4s. Rate: 7.3 symbols/min [2025-10-10T18:06:52.798350] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:06:52.855555] [DEBUG] [LOCAL ] CNA: Loaded 33082 existing records from primary storage. [2025-10-10T18:06:52.856156] [INFO ] [MAIN ] CNA: Loaded 33082 existing records. [2025-10-10T18:06:53.092985] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-10T18:06:53.100841] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:06:53.101882] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-10T18:06:53.103605] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-10T18:06:53.103977] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-10T18:06:53.104052] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-10T18:06:53.256836] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-10T18:06:53.289094] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-10T18:06:53.606838] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:06:53.889394] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-10T18:06:54.052518] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T18:06:54.689364] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-10T18:06:55.489420] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-10T18:06:55.538702] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T18:06:55.551114] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-10T18:06:56.289395] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-10T18:06:56.913524] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T18:06:57.089376] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-10T18:06:57.198697] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-10T18:06:57.889443] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-10T18:06:57.891308] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-10T18:06:58.626572] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-10T18:06:58.689362] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-10T18:06:59.489452] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-10T18:06:59.545344] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-10T18:07:00.289393] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-10T18:07:00.829233] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-10T18:07:01.089427] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-10T18:07:01.844356] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-10T18:07:01.889343] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-10T18:07:01.998190] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T18:07:01.999498] [INFO ] [REMOTE ] CMSD: Full fetch complete (12017 records). [2025-10-10T18:07:01.999575] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-10T18:07:02.464479] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-10T18:07:02.464576] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-10T18:07:02.465006] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-10T18:07:02.465082] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-10T18:07:02.465880] [DEBUG] [LOCAL ] CMSD: Trimmed 12017 records to 8081 (keeping 200 days of data) [2025-10-10T18:07:02.518777] [DEBUG] [LOCAL ] CMSD: Primary data saved (8081 records). [2025-10-10T18:07:02.518969] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-10T18:07:02.519086] [INFO ] [MAIN ] Update Progress: 486/2373 symbols completed. CMSD took 31.1s. Estimated remaining: 4h 20m 3s. Rate: 7.3 symbols/min [2025-10-10T18:07:02.702322] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-10T18:07:02.706333] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:07:02.765043] [DEBUG] [LOCAL ] CNC: Loaded 54145 existing records from primary storage. [2025-10-10T18:07:02.765454] [INFO ] [MAIN ] CNC: Loaded 54145 existing records. [2025-10-10T18:07:02.964163] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:07:02.964735] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-10T18:07:02.964840] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-10T18:07:02.965421] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-10T18:07:02.965490] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-10T18:07:03.095330] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-10T18:07:03.375677] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:07:03.489393] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-10T18:07:03.554906] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-10T18:07:04.289396] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-10T18:07:05.089386] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-10T18:07:05.125283] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T18:07:05.195312] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-10T18:07:05.889417] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-10T18:07:06.689388] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-10T18:07:07.299685] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-10T18:07:07.424339] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-10T18:07:07.489351] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-10T18:07:07.742900] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-10T18:07:08.289390] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-10T18:07:09.028351] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-10T18:07:09.089329] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-10T18:07:09.889354] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-10T18:07:10.008887] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T18:07:10.531943] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T18:07:10.535896] [INFO ] [REMOTE ] CMTG: Full fetch complete (53394 records). [2025-10-10T18:07:10.536059] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-10T18:07:10.694585] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-10T18:07:10.953541] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-10T18:07:10.953680] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-10T18:07:10.954602] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-10T18:07:10.954704] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-10T18:07:10.956209] [DEBUG] [LOCAL ] CMTG: Trimmed 53394 records to 36633 (keeping 200 days of data) [2025-10-10T18:07:11.177272] [DEBUG] [LOCAL ] CMTG: Primary data saved (36633 records). [2025-10-10T18:07:11.177472] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-10T18:07:11.177588] [INFO ] [MAIN ] Update Progress: 487/2373 symbols completed. CMTG took 36.3s. Estimated remaining: 4h 19m 56s. Rate: 7.3 symbols/min [2025-10-10T18:07:11.353842] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:07:11.394507] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T18:07:11.411998] [DEBUG] [LOCAL ] CNF: Loaded 10597 existing records from primary storage. [2025-10-10T18:07:11.412355] [INFO ] [MAIN ] CNF: Loaded 10597 existing records. [2025-10-10T18:07:11.494504] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-10T18:07:11.606859] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:07:11.607181] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-10T18:07:11.607233] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-10T18:07:11.607482] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-10T18:07:11.607540] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-10T18:07:11.990751] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:07:12.033160] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-10T18:07:12.052499] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-10T18:07:12.289427] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-10T18:07:13.089416] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-10T18:07:13.889400] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-10T18:07:13.914459] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-10T18:07:13.942597] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-10T18:07:14.689372] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-10T18:07:14.739880] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-10T18:07:15.489441] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-10T18:07:15.919109] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-10T18:07:16.062377] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-10T18:07:16.289381] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-10T18:07:17.089428] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-10T18:07:17.573825] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T18:07:17.577634] [INFO ] [REMOTE ] CNA: Full fetch complete (45564 records). [2025-10-10T18:07:17.577787] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-10T18:07:17.578478] [FATAL] [VALIDATOR ] CNA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:07:17.578565] [FATAL] [MAIN ] CNA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:07:17.578607] [WARN ] [MAIN ] CNA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:07:17.578669] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-10T18:07:17.578766] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-10-10T18:07:17.578821] [INFO ] [LOCAL ] CNA: Starting deletion of derivative data. [2025-10-10T18:07:17.579171] [DEBUG] [LOCAL ] CNA: Deleted derivative data file. [2025-10-10T18:07:17.579266] [INFO ] [MAIN ] Update Progress: 488/2373 symbols completed. CNA took 25.0s. Estimated remaining: 4h 19m 40s. Rate: 7.3 symbols/min [2025-10-10T18:07:17.756614] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:07:17.764607] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-10T18:07:17.824096] [DEBUG] [LOCAL ] CNH: Loaded 53941 existing records from primary storage. [2025-10-10T18:07:17.824500] [INFO ] [MAIN ] CNH: Loaded 53941 existing records. [2025-10-10T18:07:17.894538] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-10T18:07:18.030609] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:07:18.030901] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-10T18:07:18.030953] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-10T18:07:18.031529] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-10T18:07:18.031588] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-10T18:07:18.408856] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:07:18.586377] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-10T18:07:18.689379] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-10T18:07:19.109353] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-10T18:07:19.489398] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-10T18:07:20.262126] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-10T18:07:20.289394] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-10T18:07:21.089407] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-10T18:07:21.889360] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-10T18:07:22.468579] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-10T18:07:22.472816] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-10T18:07:22.689385] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-10T18:07:23.130356] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-10T18:07:23.489410] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-10T18:07:24.289404] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-10T18:07:24.515278] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-10T18:07:24.701631] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-10T18:07:25.089411] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-10T18:07:25.869314] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-10T18:07:25.889334] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-10T18:07:26.689428] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-10T18:07:27.043913] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T18:07:27.063259] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-10T18:07:27.408005] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-10T18:07:27.489394] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-10T18:07:28.289362] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-10T18:07:28.495736] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-10T18:07:29.089390] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-10T18:07:29.096553] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T18:07:29.097535] [INFO ] [REMOTE ] CMU: Full fetch complete (9578 records). [2025-10-10T18:07:29.097610] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-10T18:07:29.468254] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-10T18:07:29.468345] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-10T18:07:29.468719] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-10T18:07:29.468786] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-10T18:07:29.469299] [DEBUG] [LOCAL ] CMU: Trimmed 9578 records to 6399 (keeping 200 days of data) [2025-10-10T18:07:29.509321] [DEBUG] [LOCAL ] CMU: Primary data saved (6399 records). [2025-10-10T18:07:29.509489] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-10T18:07:29.509592] [INFO ] [MAIN ] Update Progress: 489/2373 symbols completed. CMU took 41.6s. Estimated remaining: 4h 19m 46s. Rate: 7.3 symbols/min [2025-10-10T18:07:29.679245] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:07:29.735619] [DEBUG] [LOCAL ] CNI: Loaded 52058 existing records from primary storage. [2025-10-10T18:07:29.736084] [INFO ] [MAIN ] CNI: Loaded 52058 existing records. [2025-10-10T18:07:29.891224] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-10T18:07:29.917144] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:07:29.917519] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-10T18:07:29.917606] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-10T18:07:29.918069] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-10T18:07:29.918126] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-10T18:07:30.295149] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-10T18:07:30.302258] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:07:30.689385] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-10T18:07:31.489407] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-10T18:07:32.037005] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T18:07:32.289408] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-10T18:07:32.418200] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-10T18:07:32.726080] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-10T18:07:33.089401] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-10T18:07:33.889378] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-10T18:07:34.100757] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T18:07:34.689362] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-10T18:07:35.050467] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T18:07:35.489424] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-10T18:07:35.571594] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T18:07:36.130914] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-10T18:07:36.289400] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-10T18:07:36.842629] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T18:07:37.089392] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-10T18:07:37.461219] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T18:07:37.889385] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-10T18:07:38.626840] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-10T18:07:38.689372] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-10T18:07:38.824821] [DEBUG] [REMOTE ] CNH: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-10T18:07:38.825241] [WARN ] [REMOTE ] CNH: No data returned for month 2025-06 [2025-10-10T18:07:38.825353] [FATAL] [REMOTE ] CNH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:07:38.825456] [FATAL] [MAIN ] CNH: Failed to fetch primary data. [2025-10-10T18:07:38.825520] [WARN ] [MAIN ] CNH: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:07:38.825599] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-10T18:07:38.825693] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-10T18:07:38.825749] [INFO ] [LOCAL ] CNH: Starting deletion of derivative data. [2025-10-10T18:07:38.825959] [DEBUG] [LOCAL ] CNH: Deleted derivative data file. [2025-10-10T18:07:38.826607] [INFO ] [MAIN ] Update Progress: 490/2373 symbols completed. CNH took 21.2s. Estimated remaining: 4h 19m 42s. Rate: 7.3 symbols/min [2025-10-10T18:07:39.003601] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:07:39.003899] [DEBUG] [LOCAL ] CNK: No existing data file found in primary storage. [2025-10-10T18:07:39.003981] [WARN ] [MAIN ] CNK: No existing data found, performing full refresh instead. [2025-10-10T18:07:39.004294] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-10T18:07:39.004429] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-10T18:07:39.004486] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-10T18:07:39.004523] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-10T18:07:39.122677] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-10T18:07:39.414745] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:07:39.489401] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-10T18:07:40.289360] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-10T18:07:40.389717] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T18:07:40.391497] [INFO ] [REMOTE ] CNF: Full fetch complete (13218 records). [2025-10-10T18:07:40.391610] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-10T18:07:40.786293] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-10T18:07:40.786383] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-10T18:07:40.786780] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-10T18:07:40.786845] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-10T18:07:40.787380] [DEBUG] [LOCAL ] CNF: Trimmed 13218 records to 10690 (keeping 200 days of data) [2025-10-10T18:07:40.851351] [DEBUG] [LOCAL ] CNF: Primary data saved (10690 records). [2025-10-10T18:07:40.851539] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-10T18:07:40.851665] [INFO ] [MAIN ] Update Progress: 491/2373 symbols completed. CNF took 29.7s. Estimated remaining: 4h 19m 10s. Rate: 7.3 symbols/min [2025-10-10T18:07:41.024501] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:07:41.078824] [DEBUG] [LOCAL ] CNM: Loaded 51430 existing records from primary storage. [2025-10-10T18:07:41.079213] [INFO ] [MAIN ] CNM: Loaded 51430 existing records. [2025-10-10T18:07:41.094602] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-10T18:07:41.273473] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:07:41.273799] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-10T18:07:41.273855] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-10T18:07:41.274244] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-10T18:07:41.274304] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-10T18:07:41.655986] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:07:41.761812] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-10T18:07:41.889405] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-10T18:07:42.689414] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-10T18:07:43.074511] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T18:07:43.302584] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T18:07:43.489409] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-10T18:07:44.289412] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-10T18:07:44.700487] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T18:07:45.089447] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-10T18:07:45.475773] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T18:07:45.629996] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T18:07:45.889430] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-10T18:07:46.689406] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-10T18:07:46.958088] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T18:07:47.489402] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-10T18:07:48.265634] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T18:07:48.289331] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-10T18:07:48.948228] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-10-10T18:07:49.089430] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-10T18:07:49.303823] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T18:07:49.889391] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-10T18:07:50.292221] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T18:07:50.689392] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-10T18:07:50.784385] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-10T18:07:51.489371] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-10T18:07:52.294518] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-10T18:07:52.312097] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-10T18:07:52.377597] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T18:07:52.854904] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T18:07:53.089400] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-10T18:07:53.889447] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-10T18:07:54.361801] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-10T18:07:54.491587] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-10T18:07:54.689417] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-10T18:07:55.489383] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-10T18:07:55.878986] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T18:07:56.006853] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T18:07:56.289436] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-10T18:07:57.089358] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-10T18:07:57.648809] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-10T18:07:57.889391] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-10T18:07:58.201113] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-10T18:07:58.689398] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-10T18:07:59.489408] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-10T18:07:59.562089] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-10T18:08:00.251809] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-10T18:08:00.256948] [INFO ] [REMOTE ] CNI: Full fetch complete (74584 records). [2025-10-10T18:08:00.257108] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-10T18:08:00.300266] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-10T18:08:00.692472] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-10T18:08:00.693224] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-10T18:08:00.696011] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-10T18:08:00.696101] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-10T18:08:00.694823] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T18:08:00.708631] [DEBUG] [LOCAL ] CNI: Trimmed 74584 records to 52437 (keeping 200 days of data) [2025-10-10T18:08:01.046822] [DEBUG] [LOCAL ] CNI: Primary data saved (52437 records). [2025-10-10T18:08:01.046979] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-10T18:08:01.047955] [INFO ] [MAIN ] Update Progress: 492/2373 symbols completed. CNI took 31.5s. Estimated remaining: 4h 19m 47s. Rate: 7.2 symbols/min [2025-10-10T18:08:01.111259] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-10T18:08:01.217317] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:08:01.251840] [DEBUG] [LOCAL ] CNMD: Loaded 32304 existing records from primary storage. [2025-10-10T18:08:01.252130] [INFO ] [MAIN ] CNMD: Loaded 32304 existing records. [2025-10-10T18:08:01.425416] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:08:01.425700] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-10T18:08:01.425784] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-10T18:08:01.426033] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-10T18:08:01.426089] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-10T18:08:01.799188] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:08:01.839828] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-10T18:08:01.889372] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-10T18:08:02.689401] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-10T18:08:02.794428] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-10T18:08:02.799687] [INFO ] [REMOTE ] CNC: Full fetch complete (77285 records). [2025-10-10T18:08:02.799896] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-10T18:08:02.801072] [FATAL] [VALIDATOR ] CNC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:08:02.801192] [FATAL] [MAIN ] CNC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:08:02.801237] [WARN ] [MAIN ] CNC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:08:02.801313] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-10T18:08:02.801386] [DEBUG] [LOCAL ] CNC: No primary data file found to delete. [2025-10-10T18:08:02.801424] [INFO ] [LOCAL ] CNC: Starting deletion of derivative data. [2025-10-10T18:08:02.801575] [DEBUG] [LOCAL ] CNC: Deleted derivative data file. [2025-10-10T18:08:02.801692] [INFO ] [MAIN ] Update Progress: 493/2373 symbols completed. CNC took 1m 0s. Estimated remaining: 4h 19m 14s. Rate: 7.3 symbols/min [2025-10-10T18:08:02.984912] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T18:08:03.032814] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:08:03.074572] [DEBUG] [LOCAL ] CNNE: Loaded 36507 existing records from primary storage. [2025-10-10T18:08:03.074967] [INFO ] [MAIN ] CNNE: Loaded 36507 existing records. [2025-10-10T18:08:03.263584] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:08:03.263880] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-10T18:08:03.263933] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-10T18:08:03.264314] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-10T18:08:03.264394] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-10T18:08:03.494682] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-10T18:08:03.684310] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:08:03.720996] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-10T18:08:04.127788] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-10T18:08:04.289420] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-10T18:08:05.089447] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-10T18:08:05.142884] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T18:08:05.713957] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T18:08:05.889412] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-10T18:08:06.689377] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-10T18:08:06.847316] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-10T18:08:07.243931] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-10T18:08:07.489402] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-10T18:08:08.289398] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-10T18:08:08.682904] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-10T18:08:08.731121] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-10T18:08:09.089375] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-10T18:08:09.889367] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-10T18:08:09.921163] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T18:08:10.608019] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T18:08:10.689366] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-10T18:08:11.243411] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T18:08:11.489475] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-10T18:08:12.289512] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-10T18:08:12.608441] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-10T18:08:12.616824] [INFO ] [REMOTE ] CNM: Full fetch complete (73600 records). [2025-10-10T18:08:12.617156] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-10T18:08:13.041909] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-10T18:08:13.042025] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-10T18:08:13.043145] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-10T18:08:13.043214] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-10T18:08:13.045020] [DEBUG] [LOCAL ] CNM: Trimmed 73600 records to 51806 (keeping 200 days of data) [2025-10-10T18:08:13.095426] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-10T18:08:13.375835] [DEBUG] [LOCAL ] CNM: Primary data saved (51806 records). [2025-10-10T18:08:13.376036] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-10T18:08:13.376378] [INFO ] [MAIN ] Update Progress: 494/2373 symbols completed. CNM took 32.5s. Estimated remaining: 4h 19m 14s. Rate: 7.2 symbols/min [2025-10-10T18:08:13.587406] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:08:13.589577] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-10T18:08:13.644955] [DEBUG] [LOCAL ] CNO: Loaded 41137 existing records from primary storage. [2025-10-10T18:08:13.645451] [INFO ] [MAIN ] CNO: Loaded 41137 existing records. [2025-10-10T18:08:13.844973] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:08:13.845448] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-10T18:08:13.845533] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-10T18:08:13.846139] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-10T18:08:13.846202] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-10T18:08:13.893625] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-10T18:08:14.027277] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-10T18:08:14.266105] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:08:14.689421] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-10T18:08:15.072189] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-10T18:08:15.077765] [INFO ] [REMOTE ] CNK: Full fetch complete (75480 records). [2025-10-10T18:08:15.077968] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-10T18:08:15.079473] [FATAL] [VALIDATOR ] CNK: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:08:15.079619] [FATAL] [MAIN ] CNK: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:08:15.079710] [WARN ] [MAIN ] CNK: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:08:15.079807] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-10T18:08:15.079883] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-10T18:08:15.079921] [INFO ] [LOCAL ] CNK: Starting deletion of derivative data. [2025-10-10T18:08:15.079961] [DEBUG] [LOCAL ] CNK: No derivative data file found to delete. [2025-10-10T18:08:15.080031] [INFO ] [MAIN ] Update Progress: 495/2373 symbols completed. CNK took 36.3s. Estimated remaining: 4h 18m 41s. Rate: 7.3 symbols/min [2025-10-10T18:08:15.264980] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:08:15.320254] [DEBUG] [LOCAL ] CNP: Loaded 53863 existing records from primary storage. [2025-10-10T18:08:15.320665] [INFO ] [MAIN ] CNP: Loaded 53863 existing records. [2025-10-10T18:08:15.494211] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-10T18:08:15.498596] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:08:15.500177] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-10T18:08:15.500234] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-10T18:08:15.500500] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-10T18:08:15.500558] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-10T18:08:15.896273] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:08:15.919115] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T18:08:16.289365] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-10T18:08:16.604319] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T18:08:17.089432] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-10T18:08:17.455674] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-10T18:08:17.867060] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-10T18:08:17.889354] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-10T18:08:18.689374] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-10T18:08:19.240071] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-10T18:08:19.485686] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-10T18:08:19.493334] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-10T18:08:20.289411] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-10T18:08:20.424846] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-10T18:08:21.089420] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-10T18:08:21.471783] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T18:08:21.889359] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-10T18:08:21.924424] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T18:08:22.689352] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-10T18:08:22.898809] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T18:08:23.489396] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-10T18:08:23.862402] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-10T18:08:24.157818] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-10T18:08:24.289434] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-10T18:08:25.089363] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-10T18:08:25.310993] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T18:08:25.889377] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-10T18:08:25.972714] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T18:08:26.689357] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-10T18:08:27.240367] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T18:08:27.456991] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T18:08:27.489338] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-10T18:08:28.264049] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T18:08:28.289374] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-10T18:08:29.089541] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-10T18:08:29.089912] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T18:08:29.094990] [INFO ] [REMOTE ] CNNE: Full fetch complete (50249 records). [2025-10-10T18:08:29.095109] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-10T18:08:29.474807] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-10T18:08:29.474968] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-10T18:08:29.475812] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-10T18:08:29.476004] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-10T18:08:29.477364] [DEBUG] [LOCAL ] CNNE: Trimmed 50249 records to 36726 (keeping 200 days of data) [2025-10-10T18:08:29.709826] [DEBUG] [LOCAL ] CNNE: Primary data saved (36726 records). [2025-10-10T18:08:29.709977] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-10T18:08:29.710074] [INFO ] [MAIN ] Update Progress: 496/2373 symbols completed. CNNE took 26.9s. Estimated remaining: 4h 18m 57s. Rate: 7.2 symbols/min [2025-10-10T18:08:29.890050] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-10T18:08:29.891216] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:08:29.918825] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T18:08:29.979615] [DEBUG] [LOCAL ] CNQ: Loaded 53967 existing records from primary storage. [2025-10-10T18:08:29.980110] [INFO ] [MAIN ] CNQ: Loaded 53967 existing records. [2025-10-10T18:08:30.161589] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:08:30.161946] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-10T18:08:30.162033] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-10T18:08:30.162610] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-10T18:08:30.162715] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-10T18:08:30.535405] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:08:30.689397] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-10T18:08:31.115859] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T18:08:31.489383] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-10T18:08:31.766569] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T18:08:32.079022] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-10T18:08:32.289398] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-10T18:08:33.089469] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-10T18:08:33.210557] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T18:08:33.889380] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-10T18:08:34.303089] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T18:08:34.689382] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-10T18:08:35.069804] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T18:08:35.489403] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-10T18:08:35.648877] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T18:08:36.251453] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-10T18:08:36.289395] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-10T18:08:37.084419] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-10T18:08:37.094909] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-10T18:08:37.889399] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-10T18:08:38.087917] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-10T18:08:38.689371] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-10T18:08:39.109678] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-10T18:08:39.489403] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-10T18:08:39.813021] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-10T18:08:40.021073] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-10T18:08:40.289401] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-10T18:08:41.089381] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-10T18:08:41.147144] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-10T18:08:41.674168] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T18:08:41.677147] [INFO ] [REMOTE ] CNMD: Full fetch complete (46985 records). [2025-10-10T18:08:41.677389] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-10T18:08:41.678222] [FATAL] [VALIDATOR ] CNMD: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:08:41.678311] [FATAL] [MAIN ] CNMD: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:08:41.678355] [WARN ] [MAIN ] CNMD: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:08:41.678396] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-10T18:08:41.678478] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-10-10T18:08:41.678537] [INFO ] [LOCAL ] CNMD: Starting deletion of derivative data. [2025-10-10T18:08:41.678734] [DEBUG] [LOCAL ] CNMD: Deleted derivative data file. [2025-10-10T18:08:41.678831] [INFO ] [MAIN ] Update Progress: 497/2373 symbols completed. CNMD took 40.6s. Estimated remaining: 4h 19m 3s. Rate: 7.2 symbols/min [2025-10-10T18:08:41.849965] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:08:41.850203] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-10T18:08:41.850241] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-10T18:08:41.850359] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-10T18:08:41.850400] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-10T18:08:41.850447] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-10T18:08:41.850538] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-10T18:08:41.894590] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-10T18:08:42.211008] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:08:42.689368] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-10T18:08:42.909370] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T18:08:42.918980] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T18:08:42.919855] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-10T18:08:42.919961] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:08:42.920015] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-10T18:08:42.920716] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:08:42.920801] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-10T18:08:42.920876] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-10T18:08:42.920918] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-10T18:08:42.920965] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-10T18:08:42.921023] [INFO ] [MAIN ] Update Progress: 498/2373 symbols completed. CNR took 1.2s. Estimated remaining: 4h 18m 28s. Rate: 7.3 symbols/min [2025-10-10T18:08:43.111070] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:08:43.133950] [DEBUG] [LOCAL ] CNS: Loaded 20993 existing records from primary storage. [2025-10-10T18:08:43.134307] [INFO ] [MAIN ] CNS: Loaded 20993 existing records. [2025-10-10T18:08:43.325153] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:08:43.325448] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-10T18:08:43.325500] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-10T18:08:43.325798] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-10T18:08:43.325875] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-10T18:08:43.494695] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-10T18:08:43.745856] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:08:44.119169] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-10T18:08:44.289414] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-10T18:08:44.750855] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T18:08:44.755127] [INFO ] [REMOTE ] CNO: Full fetch complete (60610 records). [2025-10-10T18:08:44.755253] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-10T18:08:45.104957] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-10T18:08:45.165315] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-10T18:08:45.165415] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-10T18:08:45.166421] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-10T18:08:45.166490] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-10T18:08:45.168098] [DEBUG] [LOCAL ] CNO: Trimmed 60610 records to 41472 (keeping 200 days of data) [2025-10-10T18:08:45.434962] [DEBUG] [LOCAL ] CNO: Primary data saved (41472 records). [2025-10-10T18:08:45.435157] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-10T18:08:45.435330] [INFO ] [MAIN ] Update Progress: 499/2373 symbols completed. CNO took 32.1s. Estimated remaining: 4h 17m 58s. Rate: 7.3 symbols/min [2025-10-10T18:08:45.631996] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:08:45.685633] [DEBUG] [LOCAL ] CNX: Loaded 51694 existing records from primary storage. [2025-10-10T18:08:45.686110] [INFO ] [MAIN ] CNX: Loaded 51694 existing records. [2025-10-10T18:08:45.884923] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:08:45.885186] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-10T18:08:45.885239] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-10T18:08:45.885487] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-10T18:08:45.885546] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-10T18:08:45.917959] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-10T18:08:46.255949] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:08:46.392312] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T18:08:46.689385] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-10T18:08:46.735102] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-10T18:08:47.384891] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-10T18:08:47.489390] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-10T18:08:48.289361] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-10T18:08:48.774050] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-10T18:08:49.089339] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-10T18:08:49.634996] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-10T18:08:49.658815] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T18:08:49.889391] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-10T18:08:50.689369] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-10T18:08:50.870595] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T18:08:51.077044] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T18:08:51.489486] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-10T18:08:52.289346] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-10T18:08:52.670175] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-10T18:08:52.765810] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-10T18:08:53.089471] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-10T18:08:53.889482] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-10T18:08:54.452102] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-10T18:08:54.689416] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-10T18:08:54.917863] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-10T18:08:55.301239] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-10T18:08:55.306708] [INFO ] [REMOTE ] CNP: Full fetch complete (77362 records). [2025-10-10T18:08:55.306900] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-10T18:08:55.494589] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-10T18:08:55.760894] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-10T18:08:55.761017] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-10T18:08:55.761997] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-10T18:08:55.762064] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-10T18:08:55.765268] [DEBUG] [LOCAL ] CNP: Trimmed 77362 records to 54250 (keeping 200 days of data) [2025-10-10T18:08:56.027354] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-10T18:08:56.148875] [DEBUG] [LOCAL ] CNP: Primary data saved (54250 records). [2025-10-10T18:08:56.149080] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-10T18:08:56.150030] [INFO ] [MAIN ] Update Progress: 500/2373 symbols completed. CNP took 41.1s. Estimated remaining: 4h 17m 59s. Rate: 7.3 symbols/min [2025-10-10T18:08:56.303509] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-10T18:08:56.340440] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:08:56.388116] [DEBUG] [LOCAL ] CODI: Loaded 40992 existing records from primary storage. [2025-10-10T18:08:56.388479] [INFO ] [MAIN ] CODI: Loaded 40992 existing records. [2025-10-10T18:08:56.587725] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:08:56.588131] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-10T18:08:56.588196] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-10T18:08:56.589076] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-10T18:08:56.589139] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-10T18:08:56.966150] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:08:57.089376] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-10T18:08:57.479194] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-10T18:08:57.889357] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-10T18:08:57.981243] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-10T18:08:58.422886] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-10T18:08:58.689417] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-10T18:08:59.489439] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-10T18:08:59.683858] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-10T18:08:59.826851] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T18:09:00.289393] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-10T18:09:01.089367] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-10T18:09:01.179139] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T18:09:01.646088] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-10T18:09:01.889441] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-10T18:09:01.932605] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-10T18:09:02.689392] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-10T18:09:03.489369] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-10T18:09:03.942003] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-10T18:09:04.024065] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-10T18:09:04.289403] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-10T18:09:05.089349] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-10T18:09:05.525534] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-10T18:09:05.530957] [INFO ] [REMOTE ] CNQ: Full fetch complete (77554 records). [2025-10-10T18:09:05.531085] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-10T18:09:05.895790] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-10T18:09:05.978913] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T18:09:05.977502] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-10T18:09:05.985750] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-10T18:09:05.988224] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-10T18:09:05.988307] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-10T18:09:05.990411] [DEBUG] [LOCAL ] CNQ: Trimmed 77554 records to 54357 (keeping 200 days of data) [2025-10-10T18:09:06.345280] [DEBUG] [LOCAL ] CNQ: Primary data saved (54357 records). [2025-10-10T18:09:06.345468] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-10T18:09:06.345578] [INFO ] [MAIN ] Update Progress: 501/2373 symbols completed. CNQ took 36.6s. Estimated remaining: 4h 17m 58s. Rate: 7.3 symbols/min [2025-10-10T18:09:06.525548] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:09:06.580261] [DEBUG] [LOCAL ] COF: Loaded 54002 existing records from primary storage. [2025-10-10T18:09:06.580694] [INFO ] [MAIN ] COF: Loaded 54002 existing records. [2025-10-10T18:09:06.689426] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-10T18:09:06.816771] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T18:09:06.821303] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:09:06.833482] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-10T18:09:06.833587] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-10T18:09:06.834630] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-10T18:09:06.834825] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-10T18:09:07.214541] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:09:07.285366] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-10T18:09:07.489396] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-10T18:09:08.289388] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-10T18:09:08.322724] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T18:09:08.781803] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T18:09:09.089418] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-10T18:09:09.889395] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-10T18:09:10.141236] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T18:09:10.329068] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T18:09:10.689430] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-10T18:09:11.489411] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-10T18:09:11.560939] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T18:09:11.563683] [INFO ] [REMOTE ] CNS: Full fetch complete (30222 records). [2025-10-10T18:09:11.563764] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-10T18:09:11.564254] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:09:11.564340] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:09:11.564385] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:09:11.564430] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-10T18:09:11.564492] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-10T18:09:11.564531] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-10-10T18:09:11.564741] [DEBUG] [LOCAL ] CNS: Deleted derivative data file. [2025-10-10T18:09:11.564836] [INFO ] [MAIN ] Update Progress: 502/2373 symbols completed. CNS took 28.6s. Estimated remaining: 4h 17m 38s. Rate: 7.3 symbols/min [2025-10-10T18:09:11.744549] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:09:11.808889] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T18:09:11.844210] [DEBUG] [LOCAL ] COHR: Loaded 53761 existing records from primary storage. [2025-10-10T18:09:11.844769] [INFO ] [MAIN ] COHR: Loaded 53761 existing records. [2025-10-10T18:09:12.039847] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:09:12.042055] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-10T18:09:12.042121] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-10T18:09:12.043546] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-10T18:09:12.043608] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-10T18:09:12.294570] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-10T18:09:12.412421] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:09:13.089390] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-10T18:09:13.216902] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T18:09:13.889401] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-10T18:09:14.421233] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-10T18:09:14.689373] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-10T18:09:14.811331] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T18:09:15.351384] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T18:09:15.489410] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-10T18:09:16.289451] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-10T18:09:16.659272] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T18:09:16.863122] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T18:09:17.089420] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-10T18:09:17.889391] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-10T18:09:17.996868] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T18:09:18.689394] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-10T18:09:18.949303] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T18:09:19.489376] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-10T18:09:19.833979] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T18:09:20.289394] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-10T18:09:20.891979] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-10T18:09:21.089417] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-10T18:09:21.408231] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T18:09:21.542250] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-10T18:09:21.547467] [INFO ] [REMOTE ] CNX: Full fetch complete (74708 records). [2025-10-10T18:09:21.547615] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-10T18:09:21.894488] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-10T18:09:21.952858] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-10T18:09:21.952940] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-10T18:09:21.953988] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-10T18:09:21.954058] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-10T18:09:21.956239] [DEBUG] [LOCAL ] CNX: Trimmed 74708 records to 52074 (keeping 200 days of data) [2025-10-10T18:09:22.289862] [DEBUG] [LOCAL ] CNX: Primary data saved (52074 records). [2025-10-10T18:09:22.290055] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-10T18:09:22.290493] [INFO ] [MAIN ] Update Progress: 503/2373 symbols completed. CNX took 36.9s. Estimated remaining: 4h 17m 39s. Rate: 7.3 symbols/min [2025-10-10T18:09:22.476000] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:09:22.537788] [DEBUG] [LOCAL ] COLD: Loaded 52638 existing records from primary storage. [2025-10-10T18:09:22.538250] [INFO ] [MAIN ] COLD: Loaded 52638 existing records. [2025-10-10T18:09:22.702293] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-10T18:09:22.742565] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:09:22.744099] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-10T18:09:22.744273] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-10T18:09:22.745011] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-10T18:09:22.745087] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-10T18:09:23.164106] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-10T18:09:23.180996] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:09:23.489354] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-10T18:09:24.070063] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T18:09:24.129813] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-10T18:09:24.289426] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-10T18:09:25.089389] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-10T18:09:25.790245] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-10T18:09:25.889420] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-10T18:09:26.039259] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T18:09:26.689395] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-10T18:09:26.975592] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T18:09:27.489357] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-10T18:09:27.896105] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-10T18:09:27.900807] [INFO ] [REMOTE ] CODI: Full fetch complete (51882 records). [2025-10-10T18:09:27.900942] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-10T18:09:28.291187] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-10T18:09:28.355131] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-10T18:09:28.355451] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-10T18:09:28.356498] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-10T18:09:28.356591] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-10T18:09:28.391220] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-10T18:09:28.403602] [DEBUG] [LOCAL ] CODI: Trimmed 51882 records to 41380 (keeping 200 days of data) [2025-10-10T18:09:28.658737] [DEBUG] [LOCAL ] CODI: Primary data saved (41380 records). [2025-10-10T18:09:28.658892] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-10T18:09:28.658995] [INFO ] [MAIN ] Update Progress: 504/2373 symbols completed. CODI took 32.5s. Estimated remaining: 4h 17m 24s. Rate: 7.3 symbols/min [2025-10-10T18:09:28.825709] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:09:28.882567] [DEBUG] [LOCAL ] COMP: Loaded 53792 existing records from primary storage. [2025-10-10T18:09:28.882942] [INFO ] [MAIN ] COMP: Loaded 53792 existing records. [2025-10-10T18:09:29.060537] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:09:29.060814] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-10T18:09:29.060863] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-10T18:09:29.061193] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-10T18:09:29.061250] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-10T18:09:29.092490] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-10T18:09:29.436590] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:09:29.474067] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T18:09:29.513708] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-10T18:09:29.889404] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-10T18:09:30.689368] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-10T18:09:30.766689] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T18:09:31.489367] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-10T18:09:32.190892] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-10T18:09:32.222300] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-10T18:09:32.289382] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-10T18:09:33.089361] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-10T18:09:33.859380] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-10T18:09:33.889349] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-10T18:09:34.472241] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-10T18:09:34.574727] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-10T18:09:34.689398] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-10T18:09:35.489365] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-10T18:09:36.168568] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-10T18:09:36.289358] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-10T18:09:36.608992] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T18:09:37.089367] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-10T18:09:37.879225] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-10T18:09:37.890705] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-10T18:09:38.172726] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T18:09:38.689405] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-10T18:09:39.210509] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-10T18:09:39.489379] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-10T18:09:39.619493] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T18:09:40.289419] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-10T18:09:40.537374] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T18:09:41.089410] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-10T18:09:41.504428] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T18:09:41.889410] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-10T18:09:42.070035] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T18:09:42.075398] [INFO ] [REMOTE ] COF: Full fetch complete (77447 records). [2025-10-10T18:09:42.075531] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-10T18:09:42.489230] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-10T18:09:42.489354] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-10T18:09:42.490364] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-10T18:09:42.490438] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-10T18:09:42.492105] [DEBUG] [LOCAL ] COF: Trimmed 77447 records to 54392 (keeping 200 days of data) [2025-10-10T18:09:42.694078] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-10T18:09:42.856191] [DEBUG] [LOCAL ] COF: Primary data saved (54392 records). [2025-10-10T18:09:42.856396] [INFO ] [MAIN ] COF: Full history saved. [2025-10-10T18:09:42.856512] [INFO ] [MAIN ] Update Progress: 505/2373 symbols completed. COF took 36.5s. Estimated remaining: 4h 17m 38s. Rate: 7.3 symbols/min [2025-10-10T18:09:43.038695] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:09:43.077712] [DEBUG] [LOCAL ] CON: Loaded 39099 existing records from primary storage. [2025-10-10T18:09:43.078088] [INFO ] [MAIN ] CON: Loaded 39099 existing records. [2025-10-10T18:09:43.263059] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:09:43.263540] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-10T18:09:43.263675] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-10T18:09:43.263973] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-10T18:09:43.264031] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-10T18:09:43.687860] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-10T18:09:43.683781] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:09:43.700428] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-10T18:09:43.737677] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T18:09:44.289406] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-10T18:09:44.705030] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T18:09:45.089453] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-10T18:09:45.502833] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T18:09:45.889557] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-10T18:09:46.635213] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-10T18:09:46.689369] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-10T18:09:46.921854] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T18:09:47.489419] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-10T18:09:47.659022] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T18:09:48.137972] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-10T18:09:48.289417] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-10T18:09:49.089446] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-10T18:09:49.521900] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-10T18:09:49.889418] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-10T18:09:50.138156] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-10T18:09:50.555463] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-10T18:09:50.561216] [INFO ] [REMOTE ] COHR: Full fetch complete (77193 records). [2025-10-10T18:09:50.561383] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-10T18:09:50.694543] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-10T18:09:50.976926] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-10T18:09:50.977032] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-10T18:09:50.978153] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-10T18:09:50.978221] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-10T18:09:50.980021] [DEBUG] [LOCAL ] COHR: Trimmed 77193 records to 54151 (keeping 200 days of data) [2025-10-10T18:09:51.334714] [DEBUG] [LOCAL ] COHR: Primary data saved (54151 records). [2025-10-10T18:09:51.334911] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-10T18:09:51.335052] [INFO ] [MAIN ] Update Progress: 506/2373 symbols completed. COHR took 39.8s. Estimated remaining: 4h 17m 30s. Rate: 7.3 symbols/min [2025-10-10T18:09:51.495150] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-10T18:09:51.518614] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:09:51.546797] [DEBUG] [LOCAL ] COOK: Loaded 24658 existing records from primary storage. [2025-10-10T18:09:51.547290] [INFO ] [MAIN ] COOK: Loaded 24658 existing records. [2025-10-10T18:09:51.736414] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:09:51.736736] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-10T18:09:51.736797] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-10T18:09:51.737103] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-10T18:09:51.737163] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-10T18:09:52.154988] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-10T18:09:52.158975] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:09:52.211047] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T18:09:52.289377] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-10T18:09:53.089420] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-10T18:09:53.140685] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-10T18:09:53.889437] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-10T18:09:54.402352] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T18:09:54.634352] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T18:09:54.689352] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-10T18:09:55.489360] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-10T18:09:56.060695] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-10T18:09:56.289392] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-10T18:09:56.617982] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T18:09:56.675979] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-10T18:09:57.089408] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-10T18:09:57.602054] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T18:09:57.708667] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-10T18:09:57.889399] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-10T18:09:58.689395] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-10T18:09:59.489390] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-10T18:10:00.047073] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-10T18:10:00.124038] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-10T18:10:00.289382] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-10T18:10:01.089372] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-10T18:10:01.576218] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-10T18:10:01.581450] [INFO ] [REMOTE ] COMP: Full fetch complete (76807 records). [2025-10-10T18:10:01.581669] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-10T18:10:01.582563] [FATAL] [VALIDATOR ] COMP: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:10:01.582687] [FATAL] [MAIN ] COMP: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:10:01.582742] [WARN ] [MAIN ] COMP: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:10:01.582789] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-10T18:10:01.582854] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-10T18:10:01.582892] [INFO ] [LOCAL ] COMP: Starting deletion of derivative data. [2025-10-10T18:10:01.583170] [DEBUG] [LOCAL ] COMP: Deleted derivative data file. [2025-10-10T18:10:01.584003] [INFO ] [MAIN ] Update Progress: 507/2373 symbols completed. COMP took 32.9s. Estimated remaining: 4h 17m 29s. Rate: 7.2 symbols/min [2025-10-10T18:10:01.775523] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:10:01.843497] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-10-10T18:10:01.843990] [INFO ] [MAIN ] COP: Loaded 54117 existing records. [2025-10-10T18:10:01.899950] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-10T18:10:02.062214] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:10:02.062480] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-10T18:10:02.062532] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-10T18:10:02.062880] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-10T18:10:02.062941] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-10T18:10:02.480771] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-10T18:10:02.489094] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:10:02.494614] [INFO ] [REMOTE ] COLD: Full fetch complete (74099 records). [2025-10-10T18:10:02.514947] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-10T18:10:02.520406] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-10T18:10:02.520726] [FATAL] [VALIDATOR ] COLD: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:10:02.529374] [FATAL] [MAIN ] COLD: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:10:02.529983] [WARN ] [MAIN ] COLD: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:10:02.530256] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-10T18:10:02.530361] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-10T18:10:02.530421] [INFO ] [LOCAL ] COLD: Starting deletion of derivative data. [2025-10-10T18:10:02.531051] [DEBUG] [LOCAL ] COLD: Deleted derivative data file. [2025-10-10T18:10:02.531161] [INFO ] [MAIN ] Update Progress: 508/2373 symbols completed. COLD took 40.2s. Estimated remaining: 4h 16m 54s. Rate: 7.3 symbols/min [2025-10-10T18:10:02.694463] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-10T18:10:02.723127] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:10:02.783767] [DEBUG] [LOCAL ] COR: Loaded 47111 existing records from primary storage. [2025-10-10T18:10:02.784162] [INFO ] [MAIN ] COR: Loaded 47111 existing records. [2025-10-10T18:10:02.980036] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:10:02.980293] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-10T18:10:02.980344] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-10T18:10:02.980819] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-10T18:10:02.980877] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-10T18:10:03.369110] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:10:03.388264] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-10T18:10:03.489380] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-10T18:10:04.289426] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-10T18:10:04.432570] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T18:10:05.094562] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-10T18:10:05.110794] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-10T18:10:05.889438] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-10T18:10:06.258502] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T18:10:06.406386] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-10T18:10:06.689467] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-10T18:10:07.368062] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-10T18:10:07.489400] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-10T18:10:08.289410] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-10T18:10:08.639815] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-10T18:10:08.891380] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-10T18:10:09.089400] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-10T18:10:09.889362] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-10T18:10:10.234598] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T18:10:10.693680] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-10T18:10:10.699683] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-10T18:10:11.489426] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-10T18:10:12.102229] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T18:10:12.222229] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-10T18:10:12.289398] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-10T18:10:13.089379] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-10T18:10:13.131443] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-10T18:10:13.137843] [INFO ] [REMOTE ] CON: Full fetch complete (56700 records). [2025-10-10T18:10:13.138045] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-10T18:10:13.364568] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-10T18:10:13.584121] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-10T18:10:13.584606] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-10T18:10:13.585886] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-10T18:10:13.585956] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-10T18:10:13.587705] [DEBUG] [LOCAL ] CON: Trimmed 56700 records to 39376 (keeping 200 days of data) [2025-10-10T18:10:13.847179] [DEBUG] [LOCAL ] CON: Primary data saved (39376 records). [2025-10-10T18:10:13.847358] [INFO ] [MAIN ] CON: Full history saved. [2025-10-10T18:10:13.847464] [INFO ] [MAIN ] Update Progress: 509/2373 symbols completed. CON took 31.0s. Estimated remaining: 4h 16m 57s. Rate: 7.3 symbols/min [2025-10-10T18:10:13.894519] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-10T18:10:14.032572] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:10:14.085780] [DEBUG] [LOCAL ] COTY: Loaded 53632 existing records from primary storage. [2025-10-10T18:10:14.086176] [INFO ] [MAIN ] COTY: Loaded 53632 existing records. [2025-10-10T18:10:14.280599] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:10:14.280886] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-10T18:10:14.280961] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-10T18:10:14.281264] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-10T18:10:14.281320] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-10T18:10:14.672774] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:10:14.689384] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-10T18:10:15.232260] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-10T18:10:15.489428] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-10T18:10:15.906818] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-10T18:10:16.289401] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-10T18:10:16.301027] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-10T18:10:16.303907] [INFO ] [REMOTE ] COOK: Full fetch complete (32794 records). [2025-10-10T18:10:16.303991] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-10T18:10:16.721094] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-10T18:10:16.721210] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-10T18:10:16.722156] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-10T18:10:16.722226] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-10T18:10:16.723343] [DEBUG] [LOCAL ] COOK: Trimmed 32794 records to 24888 (keeping 200 days of data) [2025-10-10T18:10:16.865664] [DEBUG] [LOCAL ] COOK: Primary data saved (24888 records). [2025-10-10T18:10:16.865846] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-10T18:10:16.865953] [INFO ] [MAIN ] Update Progress: 510/2373 symbols completed. COOK took 25.5s. Estimated remaining: 4h 16m 29s. Rate: 7.3 symbols/min [2025-10-10T18:10:17.044278] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:10:17.092926] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-10T18:10:17.095268] [DEBUG] [LOCAL ] COUR: Loaded 49416 existing records from primary storage. [2025-10-10T18:10:17.095831] [INFO ] [MAIN ] COUR: Loaded 49416 existing records. [2025-10-10T18:10:17.299868] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:10:17.300311] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-10T18:10:17.300485] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-10T18:10:17.300894] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-10T18:10:17.301023] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-10T18:10:17.531569] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-10T18:10:17.781384] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:10:17.889344] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-10T18:10:18.562045] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-10T18:10:18.689399] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-10T18:10:19.241544] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T18:10:19.489372] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-10T18:10:19.925557] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T18:10:20.289410] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-10T18:10:20.686738] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T18:10:21.015561] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T18:10:21.089383] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-10T18:10:21.889371] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-10T18:10:22.689351] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-10T18:10:22.738038] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-10T18:10:23.018213] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-10T18:10:23.275092] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-10T18:10:23.489411] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-10T18:10:24.289439] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-10T18:10:24.519197] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-10T18:10:25.089383] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-10T18:10:25.777867] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-10T18:10:25.889349] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-10T18:10:26.179889] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T18:10:26.689374] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-10T18:10:26.986559] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T18:10:27.489453] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-10T18:10:27.682937] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T18:10:28.289385] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-10T18:10:28.492520] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T18:10:29.089418] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-10T18:10:29.697882] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-10T18:10:29.889402] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-10T18:10:30.454245] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-10T18:10:30.689368] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-10T18:10:31.031351] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-10T18:10:31.489367] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-10T18:10:31.881616] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T18:10:32.289415] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-10T18:10:32.695890] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-10T18:10:32.819576] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T18:10:33.089401] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-10T18:10:33.889405] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-10T18:10:34.583861] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-10T18:10:34.689384] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-10T18:10:34.899729] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T18:10:35.489363] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-10T18:10:35.844422] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T18:10:36.289382] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-10T18:10:36.928053] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-10T18:10:37.089468] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-10T18:10:37.225610] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T18:10:37.230197] [INFO ] [REMOTE ] COR: Full fetch complete (68570 records). [2025-10-10T18:10:37.230354] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-10T18:10:37.718059] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-10T18:10:37.718186] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-10T18:10:37.719476] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-10T18:10:37.719564] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-10T18:10:37.721526] [DEBUG] [LOCAL ] COR: Trimmed 68570 records to 47440 (keeping 200 days of data) [2025-10-10T18:10:37.889550] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-10T18:10:38.174083] [DEBUG] [LOCAL ] COR: Primary data saved (47440 records). [2025-10-10T18:10:38.174303] [INFO ] [MAIN ] COR: Full history saved. [2025-10-10T18:10:38.175462] [INFO ] [MAIN ] Update Progress: 511/2373 symbols completed. COR took 35.6s. Estimated remaining: 4h 17m 9s. Rate: 7.2 symbols/min [2025-10-10T18:10:38.464244] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:10:38.523921] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-10T18:10:38.605222] [DEBUG] [LOCAL ] CP: Loaded 53653 existing records from primary storage. [2025-10-10T18:10:38.605733] [INFO ] [MAIN ] CP: Loaded 53653 existing records. [2025-10-10T18:10:38.689981] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-10T18:10:38.787367] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-10T18:10:38.859173] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:10:38.859806] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-10T18:10:38.859866] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-10T18:10:38.860248] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-10T18:10:38.860308] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-10T18:10:39.254037] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:10:39.289970] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-10T18:10:39.489397] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-10T18:10:40.289460] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-10T18:10:41.089419] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-10T18:10:41.129886] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-10T18:10:41.167857] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T18:10:41.173975] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-10-10T18:10:41.174156] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-10T18:10:41.615329] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-10T18:10:41.615527] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-10T18:10:41.617017] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-10T18:10:41.617326] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-10T18:10:41.651235] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-10T18:10:41.651459] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 54507 (keeping 200 days of data) [2025-10-10T18:10:41.889715] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-10T18:10:42.015254] [DEBUG] [LOCAL ] COP: Primary data saved (54507 records). [2025-10-10T18:10:42.015436] [INFO ] [MAIN ] COP: Full history saved. [2025-10-10T18:10:42.016353] [INFO ] [MAIN ] Update Progress: 512/2373 symbols completed. COP took 40.4s. Estimated remaining: 4h 16m 44s. Rate: 7.2 symbols/min [2025-10-10T18:10:42.183687] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:10:42.215021] [DEBUG] [LOCAL ] CPA: Loaded 28446 existing records from primary storage. [2025-10-10T18:10:42.215360] [INFO ] [MAIN ] CPA: Loaded 28446 existing records. [2025-10-10T18:10:42.397929] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:10:42.398252] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-10T18:10:42.398313] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-10T18:10:42.398621] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-10T18:10:42.398717] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-10T18:10:42.694520] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-10T18:10:42.759069] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:10:42.986509] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T18:10:43.489474] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-10T18:10:44.098314] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-10T18:10:44.211299] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-10T18:10:44.289408] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-10T18:10:44.964201] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-10T18:10:45.089385] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-10T18:10:45.889386] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-10T18:10:46.234519] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T18:10:46.506545] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-10T18:10:46.689380] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-10T18:10:47.184890] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-10T18:10:47.489390] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-10T18:10:48.187998] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-10T18:10:48.289348] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-10T18:10:49.089403] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-10T18:10:49.536604] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-10T18:10:49.637036] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-10T18:10:49.889427] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-10T18:10:50.689366] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-10T18:10:51.154980] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-10T18:10:51.380751] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-10T18:10:51.489407] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-10T18:10:52.071100] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-10T18:10:52.289414] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-10T18:10:53.089409] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-10T18:10:53.122079] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T18:10:53.889400] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-10T18:10:54.415187] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-10T18:10:54.694640] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-10T18:10:54.708971] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-10T18:10:55.410810] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T18:10:55.489410] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-10T18:10:56.289387] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-10T18:10:56.779763] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-10T18:10:56.784828] [INFO ] [REMOTE ] COUR: Full fetch complete (70858 records). [2025-10-10T18:10:56.784979] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-10T18:10:57.094537] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-10T18:10:57.141049] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T18:10:57.244758] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-10T18:10:57.244888] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-10T18:10:57.246168] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-10T18:10:57.246247] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-10T18:10:57.248013] [DEBUG] [LOCAL ] COUR: Trimmed 70858 records to 49778 (keeping 200 days of data) [2025-10-10T18:10:57.564583] [DEBUG] [LOCAL ] COUR: Primary data saved (49778 records). [2025-10-10T18:10:57.564787] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-10T18:10:57.564911] [INFO ] [MAIN ] Update Progress: 513/2373 symbols completed. COUR took 40.7s. Estimated remaining: 4h 17m 2s. Rate: 7.2 symbols/min [2025-10-10T18:10:57.755476] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:10:57.755743] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-10T18:10:57.755822] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-10T18:10:57.755955] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-10T18:10:57.755999] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-10T18:10:57.756042] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-10T18:10:57.756076] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-10T18:10:57.892498] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-10T18:10:58.152828] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:10:58.256226] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T18:10:58.653971] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-10T18:10:58.658976] [INFO ] [REMOTE ] COTY: Full fetch complete (76726 records). [2025-10-10T18:10:58.659133] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-10T18:10:58.660198] [FATAL] [VALIDATOR ] COTY: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:10:58.660321] [FATAL] [MAIN ] COTY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:10:58.660365] [WARN ] [MAIN ] COTY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:10:58.660408] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-10T18:10:58.660529] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-10T18:10:58.660587] [INFO ] [LOCAL ] COTY: Starting deletion of derivative data. [2025-10-10T18:10:58.661617] [DEBUG] [LOCAL ] COTY: Deleted derivative data file. [2025-10-10T18:10:58.661748] [INFO ] [MAIN ] Update Progress: 514/2373 symbols completed. COTY took 44.8s. Estimated remaining: 4h 16m 28s. Rate: 7.2 symbols/min [2025-10-10T18:10:58.697345] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-10T18:10:58.853534] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:10:58.891015] [DEBUG] [LOCAL ] CPAY: Loaded 30592 existing records from primary storage. [2025-10-10T18:10:58.891492] [INFO ] [MAIN ] CPAY: Loaded 30592 existing records. [2025-10-10T18:10:59.078381] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:10:59.078865] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-10T18:10:59.079018] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-10T18:10:59.086382] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-10T18:10:59.096944] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-10T18:10:59.128387] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-10T18:10:59.489689] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-10T18:10:59.489495] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:11:00.289426] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-10T18:11:00.994255] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-10T18:11:01.071408] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-10T18:11:01.089345] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-10T18:11:01.889413] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-10T18:11:02.189073] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T18:11:02.515192] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-10T18:11:02.689381] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-10T18:11:03.114488] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-10T18:11:03.259394] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T18:11:03.489395] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-10T18:11:04.289459] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-10T18:11:04.697421] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-10T18:11:05.089357] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-10T18:11:05.270322] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T18:11:05.493721] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-10T18:11:05.889402] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-10T18:11:06.689421] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-10T18:11:07.187718] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-10T18:11:07.257245] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-10T18:11:07.260396] [INFO ] [REMOTE ] CPA: Full fetch complete (41431 records). [2025-10-10T18:11:07.260483] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-10T18:11:07.496694] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-10T18:11:07.635097] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-10T18:11:07.635198] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-10T18:11:07.635937] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-10T18:11:07.636003] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-10T18:11:07.637145] [DEBUG] [LOCAL ] CPA: Trimmed 41431 records to 28742 (keeping 200 days of data) [2025-10-10T18:11:07.820240] [DEBUG] [LOCAL ] CPA: Primary data saved (28742 records). [2025-10-10T18:11:07.820410] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-10T18:11:07.820503] [INFO ] [MAIN ] Update Progress: 515/2373 symbols completed. CPA took 25.8s. Estimated remaining: 4h 16m 23s. Rate: 7.2 symbols/min [2025-10-10T18:11:07.985801] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:11:08.002305] [DEBUG] [LOCAL ] CPF: Loaded 15320 existing records from primary storage. [2025-10-10T18:11:08.002607] [INFO ] [MAIN ] CPF: Loaded 15320 existing records. [2025-10-10T18:11:08.177510] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:11:08.177782] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-10T18:11:08.177835] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-10T18:11:08.178070] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-10T18:11:08.178127] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-10T18:11:08.281279] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-10T18:11:08.294492] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-10T18:11:08.543176] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:11:09.089390] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-10T18:11:09.515574] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-10T18:11:09.889379] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-10T18:11:10.346376] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T18:11:10.434376] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-10T18:11:10.689393] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-10T18:11:11.489360] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-10T18:11:11.762979] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-10T18:11:12.289379] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-10T18:11:13.089402] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-10T18:11:13.342771] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-10T18:11:13.348262] [INFO ] [REMOTE ] CP: Full fetch complete (77126 records). [2025-10-10T18:11:13.348456] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-10T18:11:13.682709] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-10T18:11:13.730121] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T18:11:13.811188] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-10T18:11:13.811278] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-10T18:11:13.812206] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-10T18:11:13.812272] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-10T18:11:13.813875] [DEBUG] [LOCAL ] CP: Trimmed 77126 records to 54043 (keeping 200 days of data) [2025-10-10T18:11:13.906414] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-10T18:11:14.165804] [DEBUG] [LOCAL ] CP: Primary data saved (54043 records). [2025-10-10T18:11:14.165914] [INFO ] [MAIN ] CP: Full history saved. [2025-10-10T18:11:14.166422] [INFO ] [MAIN ] Update Progress: 516/2373 symbols completed. CP took 36.0s. Estimated remaining: 4h 16m 8s. Rate: 7.3 symbols/min [2025-10-10T18:11:14.333598] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:11:14.350870] [DEBUG] [LOCAL ] CPK: Loaded 13753 existing records from primary storage. [2025-10-10T18:11:14.351154] [INFO ] [MAIN ] CPK: Loaded 13753 existing records. [2025-10-10T18:11:14.540001] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:11:14.540184] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-10T18:11:14.540233] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-10T18:11:14.540483] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-10T18:11:14.540542] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-10T18:11:14.694521] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-10T18:11:14.892961] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:11:15.176554] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-10T18:11:15.271994] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T18:11:15.489372] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-10T18:11:16.289348] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-10T18:11:16.649707] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-10T18:11:16.912175] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T18:11:16.913029] [INFO ] [REMOTE ] CPAC: Full fetch complete (1863 records). [2025-10-10T18:11:16.913097] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-10T18:11:17.096188] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-10T18:11:17.102454] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T18:11:17.103736] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:11:17.103823] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:11:17.103898] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-10T18:11:17.103964] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-10T18:11:17.104007] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-10T18:11:17.104047] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-10T18:11:17.104125] [INFO ] [MAIN ] Update Progress: 517/2373 symbols completed. CPAC took 19.5s. Estimated remaining: 4h 15m 40s. Rate: 7.3 symbols/min [2025-10-10T18:11:17.889357] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-10T18:11:18.087749] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-10T18:11:18.689386] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-10T18:11:18.952029] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-10T18:11:19.489343] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-10T18:11:19.798790] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T18:11:20.289394] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-10T18:11:20.607265] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-10T18:11:21.089416] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-10T18:11:21.406295] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-10T18:11:21.889388] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-10T18:11:22.187067] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-10T18:11:22.689350] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-10T18:11:23.133913] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-10T18:11:23.489391] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-10T18:11:24.297752] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-10T18:11:24.302176] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-10T18:11:24.318837] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-10T18:11:25.089434] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-10T18:11:25.532553] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T18:11:25.889371] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-10T18:11:26.608613] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T18:11:26.689351] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-10T18:11:26.965139] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-10T18:11:27.489396] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-10T18:11:27.790959] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-10T18:11:28.289403] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-10T18:11:28.607796] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-10T18:11:29.089427] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-10T18:11:29.725154] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T18:11:29.889407] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-10T18:11:30.294063] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-10T18:11:30.689450] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-10T18:11:31.338630] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-10T18:11:31.489464] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-10T18:11:32.119027] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-10T18:11:32.289401] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-10T18:11:32.865534] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T18:11:32.872246] [INFO ] [REMOTE ] CPAY: Full fetch complete (44764 records). [2025-10-10T18:11:32.872448] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-10T18:11:33.105468] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-10T18:11:33.275743] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-10T18:11:33.275867] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-10T18:11:33.276624] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-10T18:11:33.276702] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-10T18:11:33.277956] [DEBUG] [LOCAL ] CPAY: Trimmed 44764 records to 30808 (keeping 200 days of data) [2025-10-10T18:11:33.401044] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-10T18:11:33.512042] [DEBUG] [LOCAL ] CPAY: Primary data saved (30808 records). [2025-10-10T18:11:33.512233] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-10T18:11:33.512370] [INFO ] [MAIN ] Update Progress: 518/2373 symbols completed. CPAY took 34.9s. Estimated remaining: 4h 16m 1s. Rate: 7.2 symbols/min [2025-10-10T18:11:33.889403] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-10T18:11:34.431946] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T18:11:34.689377] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-10T18:11:35.026979] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T18:11:35.489403] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-10T18:11:35.885825] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T18:11:36.289406] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-10T18:11:36.600928] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-10T18:11:37.089375] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-10T18:11:37.119581] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T18:11:37.121744] [INFO ] [REMOTE ] CPF: Full fetch complete (23695 records). [2025-10-10T18:11:37.121840] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-10T18:11:37.513981] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-10T18:11:37.514083] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-10T18:11:37.514627] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-10T18:11:37.514733] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-10T18:11:37.515871] [DEBUG] [LOCAL ] CPF: Trimmed 23695 records to 15445 (keeping 200 days of data) [2025-10-10T18:11:37.638982] [DEBUG] [LOCAL ] CPF: Primary data saved (15445 records). [2025-10-10T18:11:37.639967] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-10T18:11:37.640084] [INFO ] [MAIN ] Update Progress: 519/2373 symbols completed. CPF took 29.8s. Estimated remaining: 4h 15m 38s. Rate: 7.3 symbols/min [2025-10-10T18:11:38.083091] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-10T18:11:38.087541] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-10T18:11:39.212106] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T18:11:39.216385] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-10T18:11:40.488891] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-10T18:11:40.491110] [INFO ] [REMOTE ] CPK: Full fetch complete (18132 records). [2025-10-10T18:11:40.491187] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-10T18:11:40.885310] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-10T18:11:40.885430] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-10T18:11:40.885994] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-10T18:11:40.886060] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-10T18:11:40.886568] [DEBUG] [LOCAL ] CPK: Trimmed 18132 records to 13880 (keeping 200 days of data) [2025-10-10T18:11:40.973222] [DEBUG] [LOCAL ] CPK: Primary data saved (13880 records). [2025-10-10T18:11:40.973377] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-10T18:11:40.973460] [INFO ] [MAIN ] Update Progress: 520/2373 symbols completed. CPK took 26.8s. Estimated remaining: 4h 15m 12s. Rate: 7.3 symbols/min [2025-10-10T18:11:41.625672] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:11:41.721869] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:11:41.718512] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:11:41.722304] [DEBUG] [LOCAL ] CPRI: No existing data file found in primary storage. [2025-10-10T18:11:41.679269] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:11:41.722921] [WARN ] [MAIN ] CPRI: No existing data found, performing full refresh instead. [2025-10-10T18:11:41.723048] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-10T18:11:41.723117] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-10T18:11:41.723179] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-10-10T18:11:41.723245] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-10T18:11:42.042807] [DEBUG] [LOCAL ] CPS: Loaded 25661 existing records from primary storage. [2025-10-10T18:11:42.071981] [INFO ] [MAIN ] CPS: Loaded 25661 existing records. [2025-10-10T18:11:42.098967] [DEBUG] [LOCAL ] CPT: Loaded 44728 existing records from primary storage. [2025-10-10T18:11:42.140531] [DEBUG] [LOCAL ] CPNG: Loaded 54060 existing records from primary storage. [2025-10-10T18:11:42.146103] [INFO ] [MAIN ] CPT: Loaded 44728 existing records. [2025-10-10T18:11:42.197706] [INFO ] [MAIN ] CPNG: Loaded 54060 existing records. [2025-10-10T18:11:42.332270] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:11:42.440374] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-10T18:11:42.664737] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:11:42.676218] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:11:42.701206] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-10T18:11:42.711554] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-10T18:11:42.717906] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-10T18:11:42.718005] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-10T18:11:42.741890] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:11:42.742145] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-10T18:11:42.742193] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-10T18:11:42.742259] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-10T18:11:42.742360] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-10T18:11:42.742438] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-10T18:11:42.742622] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-10T18:11:42.768305] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-10T18:11:42.783507] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-10T18:11:43.826633] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:11:43.881529] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-10T18:11:43.874500] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:11:43.894581] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-10T18:11:43.894198] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:11:43.896337] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-10T18:11:44.509556] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-10T18:11:44.520461] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-10T18:11:45.173850] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T18:11:45.178589] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-10T18:11:45.389632] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-10T18:11:45.398047] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-10T18:11:45.913847] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-10T18:11:45.919023] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-10T18:11:45.992545] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-10T18:11:46.003133] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-10T18:11:46.542319] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-10T18:11:46.603139] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-10T18:11:46.689343] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-10T18:11:47.136723] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-10T18:11:47.489339] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-10T18:11:47.847124] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T18:11:48.206412] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-10T18:11:48.289399] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-10T18:11:48.939342] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-10T18:11:49.089413] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-10T18:11:49.756979] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-10T18:11:49.889426] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-10T18:11:50.689368] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-10T18:11:51.478157] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-10T18:11:51.493253] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-10T18:11:51.824115] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-10T18:11:52.099314] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-10T18:11:52.289389] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-10T18:11:52.987567] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-10T18:11:53.089419] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-10T18:11:53.889465] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-10T18:11:54.161257] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-10T18:11:54.571758] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-10T18:11:54.689426] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-10T18:11:55.489455] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-10T18:11:55.928615] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T18:11:56.154672] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-10T18:11:56.289397] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-10T18:11:57.073563] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T18:11:57.089326] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-10T18:11:57.889408] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-10T18:11:58.055071] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T18:11:58.689416] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-10T18:11:59.042801] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T18:11:59.489373] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-10T18:12:00.289401] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-10T18:12:00.490451] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-10T18:12:00.534405] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T18:12:00.614971] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-10T18:12:01.089413] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-10T18:12:01.889401] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-10T18:12:02.281021] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T18:12:02.689362] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-10T18:12:02.933383] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T18:12:03.489395] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-10T18:12:03.945884] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-10T18:12:04.050506] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-10T18:12:04.289347] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-10T18:12:04.763325] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-10T18:12:05.089394] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-10T18:12:05.577339] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-10T18:12:05.582921] [INFO ] [REMOTE ] CPT: Full fetch complete (64022 records). [2025-10-10T18:12:05.583144] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-10T18:12:05.894692] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-10T18:12:05.980948] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-10T18:12:05.981147] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-10T18:12:05.982072] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-10T18:12:05.982146] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-10T18:12:05.983774] [DEBUG] [LOCAL ] CPT: Trimmed 64022 records to 45033 (keeping 200 days of data) [2025-10-10T18:12:06.288215] [DEBUG] [LOCAL ] CPT: Primary data saved (45033 records). [2025-10-10T18:12:06.288385] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-10T18:12:06.288490] [INFO ] [MAIN ] Update Progress: 521/2373 symbols completed. CPT took 25.3s. Estimated remaining: 4h 16m 4s. Rate: 7.2 symbols/min [2025-10-10T18:12:06.461745] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:12:06.484083] [DEBUG] [LOCAL ] CQP: Loaded 19005 existing records from primary storage. [2025-10-10T18:12:06.484391] [INFO ] [MAIN ] CQP: Loaded 19005 existing records. [2025-10-10T18:12:06.666718] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:12:06.667049] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-10T18:12:06.667103] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-10T18:12:06.667425] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-10T18:12:06.667487] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-10T18:12:06.698769] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-10T18:12:07.039417] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:12:07.076319] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T18:12:07.281412] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-10T18:12:07.489373] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-10T18:12:08.289368] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-10T18:12:08.734954] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T18:12:09.025957] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-10T18:12:09.089345] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-10T18:12:09.889376] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-10T18:12:09.921876] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T18:12:09.924198] [INFO ] [REMOTE ] CPS: Full fetch complete (36186 records). [2025-10-10T18:12:09.924280] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-10T18:12:09.924832] [FATAL] [VALIDATOR ] CPS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:12:09.924920] [FATAL] [MAIN ] CPS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:12:09.924964] [WARN ] [MAIN ] CPS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:12:09.925042] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-10T18:12:09.925110] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-10-10T18:12:09.925148] [INFO ] [LOCAL ] CPS: Starting deletion of derivative data. [2025-10-10T18:12:09.925619] [DEBUG] [LOCAL ] CPS: Deleted derivative data file. [2025-10-10T18:12:09.926061] [INFO ] [MAIN ] Update Progress: 522/2373 symbols completed. CPS took 29.0s. Estimated remaining: 4h 15m 40s. Rate: 7.2 symbols/min [2025-10-10T18:12:10.128240] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:12:10.154549] [DEBUG] [LOCAL ] CR: Loaded 24272 existing records from primary storage. [2025-10-10T18:12:10.154863] [INFO ] [MAIN ] CR: Loaded 24272 existing records. [2025-10-10T18:12:10.353816] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:12:10.354274] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-10T18:12:10.354357] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-10T18:12:10.354908] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-10T18:12:10.354971] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-10T18:12:10.690212] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-10T18:12:10.709103] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-10T18:12:10.780430] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:12:10.827453] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-10T18:12:11.489413] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-10T18:12:12.289407] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-10T18:12:12.793338] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-10T18:12:12.834009] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T18:12:13.089417] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-10T18:12:13.706198] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T18:12:13.889399] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-10T18:12:14.689385] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-10T18:12:15.116741] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-10T18:12:15.489410] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-10T18:12:15.645063] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-10T18:12:16.289375] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-10T18:12:16.607407] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-10T18:12:16.612899] [INFO ] [REMOTE ] CPRI: Full fetch complete (76089 records). [2025-10-10T18:12:16.613082] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-10T18:12:17.029209] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-10T18:12:17.029713] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-10T18:12:17.031067] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-10T18:12:17.031150] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-10T18:12:17.034692] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-10T18:12:17.042128] [DEBUG] [LOCAL ] CPRI: Trimmed 76089 records to 53277 (keeping 200 days of data) [2025-10-10T18:12:17.095287] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-10T18:12:17.398803] [DEBUG] [LOCAL ] CPRI: Primary data saved (53277 records). [2025-10-10T18:12:17.398991] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-10T18:12:17.399142] [INFO ] [MAIN ] Update Progress: 523/2373 symbols completed. CPRI took 36.4s. Estimated remaining: 4h 15m 28s. Rate: 7.2 symbols/min [2025-10-10T18:12:17.585660] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:12:17.601601] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T18:12:17.615883] [DEBUG] [LOCAL ] CRBD: Loaded 9076 existing records from primary storage. [2025-10-10T18:12:17.616194] [INFO ] [MAIN ] CRBD: Loaded 9076 existing records. [2025-10-10T18:12:17.803310] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:12:17.803618] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-10T18:12:17.803704] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-10T18:12:17.803937] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-10T18:12:17.803997] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-10T18:12:17.896860] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-10T18:12:18.182082] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:12:18.390229] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T18:12:18.689401] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-10T18:12:19.489425] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-10T18:12:20.164240] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-10T18:12:20.289406] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-10T18:12:20.566424] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-10T18:12:20.822631] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T18:12:21.089407] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-10T18:12:21.232680] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-10T18:12:21.889426] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-10T18:12:22.014986] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-10T18:12:22.689410] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-10T18:12:23.203465] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-10T18:12:23.489399] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-10T18:12:24.289517] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-10T18:12:24.689023] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-10T18:12:24.843088] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-10T18:12:25.089466] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-10T18:12:25.152705] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-10T18:12:25.889418] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-10T18:12:26.459850] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-10T18:12:26.689409] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-10T18:12:27.489372] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-10T18:12:27.528971] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-10T18:12:27.719812] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-10T18:12:27.725850] [INFO ] [REMOTE ] CPNG: Full fetch complete (77676 records). [2025-10-10T18:12:27.726040] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-10T18:12:28.139093] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-10T18:12:28.139196] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-10T18:12:28.140422] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-10T18:12:28.140491] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-10T18:12:28.142308] [DEBUG] [LOCAL ] CPNG: Trimmed 77676 records to 54450 (keeping 200 days of data) [2025-10-10T18:12:28.327421] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-10T18:12:28.387535] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-10T18:12:28.522007] [DEBUG] [LOCAL ] CPNG: Primary data saved (54450 records). [2025-10-10T18:12:28.522197] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-10T18:12:28.522330] [INFO ] [MAIN ] Update Progress: 524/2373 symbols completed. CPNG took 47.5s. Estimated remaining: 4h 15m 30s. Rate: 7.2 symbols/min [2025-10-10T18:12:28.700332] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:12:28.751868] [DEBUG] [LOCAL ] CRBG: Loaded 52836 existing records from primary storage. [2025-10-10T18:12:28.752250] [INFO ] [MAIN ] CRBG: Loaded 52836 existing records. [2025-10-10T18:12:28.943914] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:12:28.944168] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-10T18:12:28.944218] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-10T18:12:28.944466] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-10T18:12:28.944533] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-10T18:12:29.094557] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-10T18:12:29.326123] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:12:29.626157] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T18:12:29.889391] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-10T18:12:29.938739] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-10T18:12:30.689405] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-10T18:12:31.489382] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-10T18:12:31.729904] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T18:12:32.057090] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T18:12:32.148635] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-10T18:12:32.289452] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-10T18:12:33.089427] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-10T18:12:33.559899] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-10T18:12:33.889392] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-10T18:12:34.341747] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T18:12:34.689429] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-10T18:12:35.489421] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-10T18:12:35.685381] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T18:12:36.238771] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T18:12:36.289357] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-10T18:12:36.391567] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-10T18:12:37.089409] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-10T18:12:37.705193] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-10T18:12:37.889393] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-10T18:12:38.041066] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T18:12:38.043958] [INFO ] [REMOTE ] CR: Full fetch complete (34616 records). [2025-10-10T18:12:38.044050] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-10T18:12:38.445121] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-10T18:12:38.445231] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-10T18:12:38.445979] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-10T18:12:38.446049] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-10T18:12:38.447408] [DEBUG] [LOCAL ] CR: Trimmed 34616 records to 24473 (keeping 200 days of data) [2025-10-10T18:12:38.639791] [DEBUG] [LOCAL ] CR: Primary data saved (24473 records). [2025-10-10T18:12:38.639981] [INFO ] [MAIN ] CR: Full history saved. [2025-10-10T18:12:38.640140] [INFO ] [MAIN ] Update Progress: 525/2373 symbols completed. CR took 28.7s. Estimated remaining: 4h 15m 28s. Rate: 7.2 symbols/min [2025-10-10T18:12:38.698874] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-10T18:12:38.846080] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:12:38.904065] [DEBUG] [LOCAL ] CRC: Loaded 44150 existing records from primary storage. [2025-10-10T18:12:38.904621] [INFO ] [MAIN ] CRC: Loaded 44150 existing records. [2025-10-10T18:12:39.232148] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:12:39.234278] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T18:12:39.234529] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-10T18:12:39.234802] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-10T18:12:39.245431] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-10T18:12:39.246414] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-10T18:12:39.492919] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-10T18:12:39.743307] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:12:40.289367] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-10T18:12:40.508841] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-10T18:12:40.560114] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T18:12:40.846021] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-10T18:12:41.089393] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-10T18:12:41.889357] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-10T18:12:42.098409] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-10T18:12:42.100236] [INFO ] [REMOTE ] CQP: Full fetch complete (30170 records). [2025-10-10T18:12:42.100311] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-10T18:12:42.501583] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-10T18:12:42.501776] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-10T18:12:42.502434] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-10T18:12:42.502534] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-10T18:12:42.503895] [DEBUG] [LOCAL ] CQP: Trimmed 30170 records to 19096 (keeping 200 days of data) [2025-10-10T18:12:42.647283] [DEBUG] [LOCAL ] CQP: Primary data saved (19096 records). [2025-10-10T18:12:42.647497] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-10T18:12:42.647607] [INFO ] [MAIN ] Update Progress: 526/2373 symbols completed. CQP took 36.4s. Estimated remaining: 4h 15m 5s. Rate: 7.2 symbols/min [2025-10-10T18:12:42.694519] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-10T18:12:42.771764] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-10T18:12:42.848941] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:12:42.849164] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-10T18:12:42.849205] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-10T18:12:42.849324] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-10T18:12:42.849368] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-10T18:12:42.849411] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-10T18:12:42.849445] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-10T18:12:43.211788] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:12:43.489441] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-10T18:12:44.289445] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-10T18:12:44.529125] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T18:12:44.531197] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T18:12:44.531283] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-10T18:12:44.534553] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:12:44.540243] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-10T18:12:44.540315] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:12:44.540367] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-10T18:12:44.540438] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-10T18:12:44.540476] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-10T18:12:44.540522] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-10T18:12:44.540586] [INFO ] [MAIN ] Update Progress: 527/2373 symbols completed. CRCL took 1.9s. Estimated remaining: 4h 14m 34s. Rate: 7.3 symbols/min [2025-10-10T18:12:44.722374] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:12:44.778588] [DEBUG] [LOCAL ] CRGY: Loaded 52852 existing records from primary storage. [2025-10-10T18:12:44.779035] [INFO ] [MAIN ] CRGY: Loaded 52852 existing records. [2025-10-10T18:12:44.961780] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:12:44.962120] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-10T18:12:44.962181] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-10T18:12:44.962519] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-10T18:12:44.962576] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-10T18:12:45.094560] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-10T18:12:45.343831] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:12:45.889428] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-10T18:12:46.653357] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T18:12:46.655015] [INFO ] [REMOTE ] CRBD: Full fetch complete (13672 records). [2025-10-10T18:12:46.655105] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-10T18:12:46.693582] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-10T18:12:46.775083] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-10T18:12:47.143249] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (3.65 seconds). [2025-10-10T18:12:47.162423] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-10T18:12:47.163049] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-10T18:12:47.163695] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-10T18:12:47.163779] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-10T18:12:47.165011] [DEBUG] [LOCAL ] CRBD: Trimmed 13672 records to 9109 (keeping 200 days of data) [2025-10-10T18:12:47.225594] [DEBUG] [LOCAL ] CRBD: Primary data saved (9109 records). [2025-10-10T18:12:47.226005] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-10T18:12:47.226268] [INFO ] [MAIN ] Update Progress: 528/2373 symbols completed. CRBD took 29.8s. Estimated remaining: 4h 14m 6s. Rate: 7.3 symbols/min [2025-10-10T18:12:47.406393] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:12:47.461223] [DEBUG] [LOCAL ] CRH: Loaded 53841 existing records from primary storage. [2025-10-10T18:12:47.461635] [INFO ] [MAIN ] CRH: Loaded 53841 existing records. [2025-10-10T18:12:47.494600] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-10T18:12:47.649287] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:12:47.649566] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-10T18:12:47.649617] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-10T18:12:47.649976] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-10T18:12:47.650034] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-10T18:12:48.038419] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:12:48.289393] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-10T18:12:48.749708] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-10T18:12:49.089396] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-10T18:12:49.153457] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-10T18:12:49.889398] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-10T18:12:50.523014] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-10T18:12:50.689391] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-10T18:12:51.101790] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T18:12:51.489411] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-10T18:12:51.762221] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T18:12:52.289389] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-10T18:12:53.089340] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-10T18:12:53.091518] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-10T18:12:53.379152] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-10T18:12:53.889363] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-10T18:12:54.084256] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T18:12:54.689411] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-10T18:12:55.048627] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T18:12:55.489409] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-10T18:12:55.958010] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-10T18:12:56.289405] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-10T18:12:56.764916] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-10T18:12:57.089360] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-10T18:12:57.226075] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T18:12:57.889416] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-10T18:12:58.380830] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T18:12:58.689360] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-10T18:12:59.394373] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-10T18:12:59.489401] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-10T18:13:00.165268] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-10T18:13:00.209252] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-10T18:13:00.289360] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-10T18:13:01.089391] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-10T18:13:01.404419] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T18:13:01.889397] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-10T18:13:02.091175] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-10T18:13:02.689373] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-10T18:13:02.745638] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T18:13:03.489397] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-10T18:13:04.023593] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T18:13:04.289403] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-10T18:13:04.540059] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-10T18:13:05.089392] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-10T18:13:05.163874] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-10T18:13:05.889379] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-10T18:13:05.930444] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T18:13:06.485672] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-10T18:13:06.689395] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-10T18:13:07.489394] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-10T18:13:07.867695] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T18:13:08.289366] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-10T18:13:08.633278] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T18:13:08.930027] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T18:13:08.935783] [INFO ] [REMOTE ] CRBG: Full fetch complete (75768 records). [2025-10-10T18:13:08.935942] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-10T18:13:09.095565] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-10T18:13:09.372110] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-10T18:13:09.372207] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-10T18:13:09.373260] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-10T18:13:09.373328] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-10T18:13:09.375219] [DEBUG] [LOCAL ] CRBG: Trimmed 75768 records to 53226 (keeping 200 days of data) [2025-10-10T18:13:09.745401] [DEBUG] [LOCAL ] CRBG: Primary data saved (53226 records). [2025-10-10T18:13:09.745759] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-10T18:13:09.745904] [INFO ] [MAIN ] Update Progress: 529/2373 symbols completed. CRBG took 41.2s. Estimated remaining: 4h 14m 48s. Rate: 7.2 symbols/min [2025-10-10T18:13:09.817422] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-10T18:13:09.898999] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-10T18:13:09.932314] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:13:09.978933] [DEBUG] [LOCAL ] CRI: Loaded 50079 existing records from primary storage. [2025-10-10T18:13:09.979301] [INFO ] [MAIN ] CRI: Loaded 50079 existing records. [2025-10-10T18:13:10.163516] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:13:10.163809] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-10T18:13:10.163859] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-10T18:13:10.164264] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-10T18:13:10.164324] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-10T18:13:10.587717] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:13:10.689409] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-10T18:13:10.890564] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T18:13:11.489398] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-10T18:13:12.047762] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T18:13:12.289396] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-10T18:13:12.377020] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-10T18:13:12.381830] [INFO ] [REMOTE ] CRC: Full fetch complete (62603 records). [2025-10-10T18:13:12.382002] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-10T18:13:12.781209] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-10T18:13:12.781303] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-10T18:13:12.782246] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-10T18:13:12.782313] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-10T18:13:12.783920] [DEBUG] [LOCAL ] CRC: Trimmed 62603 records to 44489 (keeping 200 days of data) [2025-10-10T18:13:13.079042] [DEBUG] [LOCAL ] CRC: Primary data saved (44489 records). [2025-10-10T18:13:13.079231] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-10T18:13:13.079348] [INFO ] [MAIN ] Update Progress: 530/2373 symbols completed. CRC took 34.4s. Estimated remaining: 4h 14m 22s. Rate: 7.2 symbols/min [2025-10-10T18:13:13.094565] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-10T18:13:13.260318] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:13:13.301670] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T18:13:13.368620] [DEBUG] [LOCAL ] CRK: Loaded 52593 existing records from primary storage. [2025-10-10T18:13:13.369100] [INFO ] [MAIN ] CRK: Loaded 52593 existing records. [2025-10-10T18:13:13.559232] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:13:13.559426] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-10T18:13:13.559474] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-10T18:13:13.559778] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-10T18:13:13.559839] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-10T18:13:13.894680] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-10T18:13:13.907070] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:13:14.310059] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T18:13:14.689389] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-10T18:13:15.405789] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-10T18:13:15.489379] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-10T18:13:15.550523] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-10T18:13:16.289365] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-10T18:13:16.561049] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T18:13:17.050333] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-10T18:13:17.089332] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-10T18:13:17.889390] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-10T18:13:18.552534] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-10T18:13:18.689408] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-10T18:13:19.157163] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-10T18:13:19.162769] [INFO ] [REMOTE ] CRGY: Full fetch complete (75934 records). [2025-10-10T18:13:19.162943] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-10T18:13:19.494777] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-10T18:13:19.583398] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-10T18:13:19.583602] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-10T18:13:19.584806] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-10T18:13:19.584932] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-10T18:13:19.587001] [DEBUG] [LOCAL ] CRGY: Trimmed 75934 records to 53242 (keeping 200 days of data) [2025-10-10T18:13:19.723670] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T18:13:19.980343] [DEBUG] [LOCAL ] CRGY: Primary data saved (53242 records). [2025-10-10T18:13:19.980606] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-10T18:13:19.981251] [INFO ] [MAIN ] Update Progress: 531/2373 symbols completed. CRGY took 35.4s. Estimated remaining: 4h 14m 9s. Rate: 7.2 symbols/min [2025-10-10T18:13:20.167843] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:13:20.228750] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T18:13:20.254981] [DEBUG] [LOCAL ] CRL: Loaded 43158 existing records from primary storage. [2025-10-10T18:13:20.255332] [INFO ] [MAIN ] CRL: Loaded 43158 existing records. [2025-10-10T18:13:20.294532] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-10T18:13:20.463724] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:13:20.464050] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-10T18:13:20.464129] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-10T18:13:20.464871] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-10T18:13:20.464948] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-10T18:13:20.852976] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:13:21.089406] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-10T18:13:21.649211] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-10T18:13:21.654539] [INFO ] [REMOTE ] CRH: Full fetch complete (77294 records). [2025-10-10T18:13:21.654719] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-10T18:13:21.901135] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-10T18:13:22.071727] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-10T18:13:22.071850] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-10T18:13:22.072912] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-10T18:13:22.072979] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-10T18:13:22.074895] [DEBUG] [LOCAL ] CRH: Trimmed 77294 records to 54229 (keeping 200 days of data) [2025-10-10T18:13:22.448558] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-10T18:13:22.485768] [DEBUG] [LOCAL ] CRH: Primary data saved (54229 records). [2025-10-10T18:13:22.485965] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-10T18:13:22.486074] [INFO ] [MAIN ] Update Progress: 532/2373 symbols completed. CRH took 35.3s. Estimated remaining: 4h 13m 41s. Rate: 7.3 symbols/min [2025-10-10T18:13:22.667760] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:13:22.699459] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-10T18:13:22.727590] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-10-10T18:13:22.728046] [INFO ] [MAIN ] CRM: Loaded 54160 existing records. [2025-10-10T18:13:22.926882] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:13:22.927291] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-10T18:13:22.927365] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-10T18:13:22.927779] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-10T18:13:22.927844] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-10T18:13:23.048704] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-10T18:13:23.329387] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:13:23.363897] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-10T18:13:23.489407] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-10T18:13:24.058184] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-10T18:13:24.289405] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-10T18:13:25.089418] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-10T18:13:25.331906] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T18:13:25.889406] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-10T18:13:26.696326] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-10T18:13:26.727843] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-10T18:13:27.045824] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-10-10T18:13:27.489392] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-10T18:13:27.787315] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T18:13:28.289400] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-10T18:13:28.820081] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-10T18:13:29.089394] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-10T18:13:29.436129] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T18:13:29.778316] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-10T18:13:29.889430] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-10T18:13:30.689397] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-10T18:13:31.039072] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T18:13:31.296234] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-10T18:13:31.489417] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-10T18:13:32.289414] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-10T18:13:32.825284] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-10T18:13:33.089377] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-10T18:13:33.320471] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T18:13:33.889389] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-10T18:13:34.485953] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-10T18:13:34.689387] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-10T18:13:34.875594] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-10T18:13:35.489408] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-10T18:13:35.808551] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T18:13:36.289445] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-10T18:13:36.600973] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T18:13:37.089420] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-10T18:13:37.889424] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-10T18:13:37.961830] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-10T18:13:38.006665] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T18:13:38.689403] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-10T18:13:39.162632] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-10T18:13:39.489375] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-10T18:13:39.987887] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T18:13:40.289407] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-10T18:13:40.458995] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T18:13:41.089431] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-10T18:13:41.346668] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T18:13:41.889377] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-10T18:13:41.938107] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-10T18:13:42.689475] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-10T18:13:42.848522] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-10T18:13:43.489409] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-10T18:13:43.628179] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T18:13:43.633144] [INFO ] [REMOTE ] CRI: Full fetch complete (70787 records). [2025-10-10T18:13:43.633319] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-10T18:13:44.037352] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-10T18:13:44.037445] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-10T18:13:44.038381] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-10T18:13:44.038447] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-10T18:13:44.040046] [DEBUG] [LOCAL ] CRI: Trimmed 70787 records to 50425 (keeping 200 days of data) [2025-10-10T18:13:44.292082] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-10T18:13:44.374989] [DEBUG] [LOCAL ] CRI: Primary data saved (50425 records). [2025-10-10T18:13:44.375451] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-10T18:13:44.375593] [INFO ] [MAIN ] Update Progress: 533/2373 symbols completed. CRI took 34.6s. Estimated remaining: 4h 14m 20s. Rate: 7.2 symbols/min [2025-10-10T18:13:44.554765] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T18:13:44.612520] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:13:44.657802] [DEBUG] [LOCAL ] CRS: Loaded 43462 existing records from primary storage. [2025-10-10T18:13:44.658154] [INFO ] [MAIN ] CRS: Loaded 43462 existing records. [2025-10-10T18:13:44.842584] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:13:44.842876] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-10T18:13:44.842928] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-10T18:13:44.843178] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-10T18:13:44.843236] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-10T18:13:45.095025] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-10T18:13:45.214839] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:13:45.646758] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-10T18:13:45.889373] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-10T18:13:46.148959] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T18:13:46.689361] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-10T18:13:46.749379] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-10T18:13:46.755530] [INFO ] [REMOTE ] CRK: Full fetch complete (75625 records). [2025-10-10T18:13:46.755765] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-10T18:13:47.182367] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-10T18:13:47.182465] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-10T18:13:47.183499] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-10T18:13:47.183565] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-10T18:13:47.185717] [DEBUG] [LOCAL ] CRK: Trimmed 75625 records to 52981 (keeping 200 days of data) [2025-10-10T18:13:47.492261] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-10T18:13:47.514540] [DEBUG] [LOCAL ] CRK: Primary data saved (52981 records). [2025-10-10T18:13:47.514633] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-10T18:13:47.515968] [INFO ] [MAIN ] Update Progress: 534/2373 symbols completed. CRK took 34.4s. Estimated remaining: 4h 13m 54s. Rate: 7.2 symbols/min [2025-10-10T18:13:47.689730] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:13:47.700367] [DEBUG] [LOCAL ] CRT: Loaded 4999 existing records from primary storage. [2025-10-10T18:13:47.700676] [INFO ] [MAIN ] CRT: Loaded 4999 existing records. [2025-10-10T18:13:47.877895] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:13:47.878164] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-10T18:13:47.878214] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-10T18:13:47.878701] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-10T18:13:47.878961] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-10T18:13:48.248836] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:13:48.289344] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-10T18:13:48.470627] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T18:13:48.475467] [INFO ] [REMOTE ] CRL: Full fetch complete (63300 records). [2025-10-10T18:13:48.475674] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-10T18:13:48.921963] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-10T18:13:48.921456] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (3.03 seconds). [2025-10-10T18:13:48.922216] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-10T18:13:48.934534] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-10T18:13:48.934998] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-10T18:13:48.937355] [DEBUG] [LOCAL ] CRL: Trimmed 63300 records to 43459 (keeping 200 days of data) [2025-10-10T18:13:49.119015] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-10T18:13:49.223200] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-10T18:13:49.232060] [DEBUG] [LOCAL ] CRL: Primary data saved (43459 records). [2025-10-10T18:13:49.232173] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-10T18:13:49.232265] [INFO ] [MAIN ] Update Progress: 535/2373 symbols completed. CRL took 29.3s. Estimated remaining: 4h 13m 23s. Rate: 7.3 symbols/min [2025-10-10T18:13:49.421857] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:13:49.451889] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-10T18:13:49.499724] [DEBUG] [LOCAL ] CSAN: Loaded 42377 existing records from primary storage. [2025-10-10T18:13:49.500104] [INFO ] [MAIN ] CSAN: Loaded 42377 existing records. [2025-10-10T18:13:49.691016] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:13:49.691266] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-10T18:13:49.691318] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-10T18:13:49.691628] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-10T18:13:49.691731] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-10T18:13:49.899571] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-10T18:13:50.067920] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:13:50.689380] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-10T18:13:50.784099] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-10T18:13:51.489392] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-10T18:13:51.632440] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-10T18:13:52.235961] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-10T18:13:52.289367] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-10T18:13:52.542540] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T18:13:52.705258] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-10T18:13:53.089390] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-10T18:13:53.889404] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-10T18:13:54.689366] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-10T18:13:54.797370] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T18:13:55.489404] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-10T18:13:55.894983] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-10T18:13:56.253343] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-10T18:13:56.289356] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-10T18:13:56.448595] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-10T18:13:57.089401] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-10T18:13:57.889410] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-10T18:13:57.931453] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T18:13:58.475279] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-10T18:13:58.689401] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-10T18:13:58.935915] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T18:13:59.489389] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-10T18:13:59.517988] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-10T18:14:00.289441] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-10T18:14:01.089399] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-10T18:14:01.694362] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-10T18:14:01.818063] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-10T18:14:01.889436] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-10T18:14:02.651536] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T18:14:02.689346] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-10T18:14:02.842193] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-10T18:14:03.168918] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-10T18:14:03.489403] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-10T18:14:04.289407] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-10T18:14:05.089354] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-10T18:14:05.331265] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T18:14:05.878997] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-10T18:14:05.880070] [INFO ] [REMOTE ] CRT: Full fetch complete (7440 records). [2025-10-10T18:14:05.880143] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-10T18:14:05.894517] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-10T18:14:06.234046] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-10T18:14:06.234149] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-10T18:14:06.234459] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-10T18:14:06.234498] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-10T18:14:06.234997] [DEBUG] [LOCAL ] CRT: Trimmed 7440 records to 5025 (keeping 200 days of data) [2025-10-10T18:14:06.265182] [DEBUG] [LOCAL ] CRT: Primary data saved (5025 records). [2025-10-10T18:14:06.265331] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-10T18:14:06.265417] [INFO ] [MAIN ] Update Progress: 536/2373 symbols completed. CRT took 18.7s. Estimated remaining: 4h 13m 45s. Rate: 7.2 symbols/min [2025-10-10T18:14:06.430348] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:14:06.473521] [DEBUG] [LOCAL ] CSL: Loaded 31693 existing records from primary storage. [2025-10-10T18:14:06.473868] [INFO ] [MAIN ] CSL: Loaded 31693 existing records. [2025-10-10T18:14:06.661108] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:14:06.661317] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-10T18:14:06.661363] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-10T18:14:06.661876] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-10T18:14:06.661934] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-10T18:14:06.695250] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-10T18:14:07.039229] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:14:07.078866] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-10T18:14:07.489414] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-10T18:14:07.814814] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T18:14:08.235415] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-10T18:14:08.289385] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-10T18:14:08.567327] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-10T18:14:09.089383] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-10T18:14:09.889405] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-10T18:14:10.245306] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T18:14:10.689401] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-10T18:14:11.245550] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-10T18:14:11.489388] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-10T18:14:11.643081] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T18:14:12.289373] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-10T18:14:12.722959] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T18:14:12.763239] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-10T18:14:12.768957] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-10-10T18:14:12.769121] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-10T18:14:13.094497] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-10T18:14:13.216766] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-10T18:14:13.216907] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-10T18:14:13.218158] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-10T18:14:13.218232] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-10T18:14:13.219841] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 54550 (keeping 200 days of data) [2025-10-10T18:14:13.612687] [DEBUG] [LOCAL ] CRM: Primary data saved (54550 records). [2025-10-10T18:14:13.612844] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-10T18:14:13.612957] [INFO ] [MAIN ] Update Progress: 537/2373 symbols completed. CRM took 51.1s. Estimated remaining: 4h 13m 33s. Rate: 7.2 symbols/min [2025-10-10T18:14:13.812145] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:14:13.828565] [DEBUG] [LOCAL ] CSR: Loaded 13088 existing records from primary storage. [2025-10-10T18:14:13.828864] [INFO ] [MAIN ] CSR: Loaded 13088 existing records. [2025-10-10T18:14:13.890310] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-10T18:14:14.021676] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:14:14.030688] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-10T18:14:14.044303] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-10T18:14:14.045710] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T18:14:14.049039] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-10T18:14:14.054784] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-10T18:14:14.470636] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:14:14.689348] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-10T18:14:15.124115] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-10T18:14:15.221190] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T18:14:15.489324] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-10T18:14:15.817558] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T18:14:16.289394] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-10T18:14:17.067255] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T18:14:17.089342] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-10T18:14:17.889412] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-10T18:14:18.281760] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T18:14:18.687603] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T18:14:18.694912] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-10T18:14:18.859238] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T18:14:19.489396] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-10T18:14:20.289418] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-10T18:14:20.392071] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-10T18:14:21.089373] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-10T18:14:21.408172] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-10T18:14:21.440271] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T18:14:21.889358] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-10T18:14:22.391594] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T18:14:22.689415] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-10T18:14:23.489378] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-10T18:14:23.516390] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T18:14:24.289454] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-10T18:14:24.714387] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-10T18:14:24.835169] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T18:14:25.089370] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-10T18:14:25.128421] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-10T18:14:25.889348] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-10T18:14:26.208252] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-10T18:14:26.689448] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-10T18:14:26.924709] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-10T18:14:27.489382] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-10T18:14:28.289415] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-10T18:14:28.504611] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-10T18:14:28.508507] [INFO ] [REMOTE ] CSAN: Full fetch complete (60290 records). [2025-10-10T18:14:28.508607] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-10T18:14:28.928801] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-10T18:14:28.928954] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-10T18:14:28.929888] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-10T18:14:28.929970] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-10T18:14:28.931452] [DEBUG] [LOCAL ] CSAN: Trimmed 60290 records to 42688 (keeping 200 days of data) [2025-10-10T18:14:29.115078] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-10T18:14:29.127664] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-10T18:14:29.221987] [DEBUG] [LOCAL ] CSAN: Primary data saved (42688 records). [2025-10-10T18:14:29.222163] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-10T18:14:29.222275] [INFO ] [MAIN ] Update Progress: 538/2373 symbols completed. CSAN took 40.0s. Estimated remaining: 4h 13m 50s. Rate: 7.2 symbols/min [2025-10-10T18:14:29.400945] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:14:29.455895] [DEBUG] [LOCAL ] CSTM: Loaded 47875 existing records from primary storage. [2025-10-10T18:14:29.456369] [INFO ] [MAIN ] CSTM: Loaded 47875 existing records. [2025-10-10T18:14:29.648383] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:14:29.648795] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-10T18:14:29.648895] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-10T18:14:29.649265] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-10T18:14:29.649324] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-10T18:14:29.902705] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-10T18:14:29.974132] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-10T18:14:30.048446] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:14:30.049069] [INFO ] [REMOTE ] CRS: Full fetch complete (62482 records). [2025-10-10T18:14:30.049173] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-10T18:14:30.473727] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T18:14:30.473109] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-10T18:14:30.477707] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-10T18:14:30.478732] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-10T18:14:30.479674] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-10T18:14:30.481000] [DEBUG] [LOCAL ] CRS: Trimmed 62482 records to 43725 (keeping 200 days of data) [2025-10-10T18:14:30.710311] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-10T18:14:30.779555] [DEBUG] [LOCAL ] CRS: Primary data saved (43725 records). [2025-10-10T18:14:30.779762] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-10T18:14:30.780510] [INFO ] [MAIN ] Update Progress: 539/2373 symbols completed. CRS took 46.4s. Estimated remaining: 4h 13m 19s. Rate: 7.2 symbols/min [2025-10-10T18:14:30.965722] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:14:30.982607] [DEBUG] [LOCAL ] CSV: Loaded 12804 existing records from primary storage. [2025-10-10T18:14:30.982939] [INFO ] [MAIN ] CSV: Loaded 12804 existing records. [2025-10-10T18:14:31.166154] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:14:31.166410] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-10T18:14:31.166462] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-10T18:14:31.166747] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-10T18:14:31.166806] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-10T18:14:31.494496] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-10T18:14:31.560215] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:14:31.681285] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-10T18:14:31.711167] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T18:14:32.289378] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-10T18:14:33.089418] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-10T18:14:33.223072] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-10T18:14:33.256036] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T18:14:33.889358] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-10T18:14:34.220493] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T18:14:34.689404] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-10T18:14:35.489441] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-10T18:14:35.902542] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-10T18:14:36.118080] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-10T18:14:36.289392] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-10T18:14:36.331252] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-10T18:14:36.334528] [INFO ] [REMOTE ] CSL: Full fetch complete (45335 records). [2025-10-10T18:14:36.334605] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-10T18:14:36.708209] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-10T18:14:36.708298] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-10T18:14:36.709350] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-10T18:14:36.709412] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-10T18:14:36.710473] [DEBUG] [LOCAL ] CSL: Trimmed 45335 records to 31969 (keeping 200 days of data) [2025-10-10T18:14:36.913870] [DEBUG] [LOCAL ] CSL: Primary data saved (31969 records). [2025-10-10T18:14:36.914031] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-10T18:14:36.914132] [INFO ] [MAIN ] Update Progress: 540/2373 symbols completed. CSL took 30.6s. Estimated remaining: 4h 13m 3s. Rate: 7.2 symbols/min [2025-10-10T18:14:37.086168] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:14:37.086415] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-10T18:14:37.086468] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-10T18:14:37.086618] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-10T18:14:37.086697] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-10T18:14:37.086752] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-10T18:14:37.086786] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-10T18:14:37.097825] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-10T18:14:37.451757] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:14:37.783003] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T18:14:37.889376] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-10T18:14:38.157930] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T18:14:38.158284] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-10T18:14:38.158373] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:14:38.158423] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-10T18:14:38.158485] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:14:38.158561] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-10T18:14:38.158626] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-10T18:14:38.158732] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-10T18:14:38.158798] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-10T18:14:38.158849] [INFO ] [MAIN ] Update Progress: 541/2373 symbols completed. CSW took 1.2s. Estimated remaining: 4h 12m 31s. Rate: 7.3 symbols/min [2025-10-10T18:14:38.324536] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:14:38.334542] [DEBUG] [LOCAL ] CTBB: Loaded 7084 existing records from primary storage. [2025-10-10T18:14:38.334820] [INFO ] [MAIN ] CTBB: Loaded 7084 existing records. [2025-10-10T18:14:38.512030] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:14:38.512308] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-10T18:14:38.512357] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-10T18:14:38.512585] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-10T18:14:38.512678] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-10T18:14:38.678601] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-10T18:14:38.695154] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-10T18:14:38.881491] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:14:39.489462] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-10T18:14:39.807907] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T18:14:40.289364] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-10T18:14:40.583933] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-10T18:14:41.089351] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-10T18:14:41.495202] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-10T18:14:41.889350] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-10T18:14:42.397253] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-10T18:14:42.689404] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-10T18:14:42.709718] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-10T18:14:43.489419] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-10T18:14:43.621163] [DEBUG] [REMOTE ] CSR: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-10T18:14:43.621513] [WARN ] [REMOTE ] CSR: No data returned for month 2025-09 [2025-10-10T18:14:43.621605] [FATAL] [REMOTE ] CSR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:14:43.621714] [FATAL] [MAIN ] CSR: Failed to fetch primary data. [2025-10-10T18:14:43.621769] [WARN ] [MAIN ] CSR: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:14:43.621834] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-10T18:14:43.621898] [DEBUG] [LOCAL ] CSR: No primary data file found to delete. [2025-10-10T18:14:43.621942] [INFO ] [LOCAL ] CSR: Starting deletion of derivative data. [2025-10-10T18:14:43.622131] [DEBUG] [LOCAL ] CSR: Deleted derivative data file. [2025-10-10T18:14:43.622214] [INFO ] [MAIN ] Update Progress: 542/2373 symbols completed. CSR took 30.0s. Estimated remaining: 4h 12m 13s. Rate: 7.3 symbols/min [2025-10-10T18:14:43.799546] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:14:43.808161] [DEBUG] [LOCAL ] CTDD: Loaded 5834 existing records from primary storage. [2025-10-10T18:14:43.808442] [INFO ] [MAIN ] CTDD: Loaded 5834 existing records. [2025-10-10T18:14:43.998203] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:14:43.998598] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-10T18:14:43.998695] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-10T18:14:43.998965] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-10T18:14:43.999037] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-10T18:14:44.291003] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-10T18:14:44.364795] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:14:44.413137] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T18:14:45.070984] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-10T18:14:45.089334] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-10T18:14:45.889387] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-10T18:14:46.689368] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-10T18:14:46.894227] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T18:14:47.241591] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-10T18:14:47.489371] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-10T18:14:48.018929] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-10T18:14:48.205029] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-10T18:14:48.289417] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-10T18:14:49.089385] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-10T18:14:49.889454] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-10T18:14:50.054024] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T18:14:50.065092] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-10T18:14:50.689367] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-10T18:14:50.882371] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-10T18:14:51.489457] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-10T18:14:52.197761] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T18:14:52.289365] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-10T18:14:52.491960] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-10T18:14:53.089426] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-10T18:14:53.158827] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-10T18:14:53.889347] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-10T18:14:54.078218] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-10T18:14:54.689346] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-10T18:14:54.757625] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T18:14:55.489402] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-10T18:14:55.993572] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T18:14:56.289412] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-10T18:14:56.384493] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-10T18:14:57.089405] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-10T18:14:57.728032] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T18:14:57.855473] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-10T18:14:57.889405] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-10T18:14:58.689383] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-10T18:14:59.094190] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T18:14:59.489438] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-10T18:14:59.913478] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T18:15:00.289450] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-10T18:15:00.353268] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-10T18:15:01.089390] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-10T18:15:01.889413] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-10T18:15:02.071545] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T18:15:02.196592] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-10T18:15:02.202993] [INFO ] [REMOTE ] CSTM: Full fetch complete (68993 records). [2025-10-10T18:15:02.203247] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-10T18:15:02.204866] [FATAL] [VALIDATOR ] CSTM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:15:02.205162] [FATAL] [MAIN ] CSTM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:15:02.205326] [WARN ] [MAIN ] CSTM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:15:02.205425] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-10T18:15:02.205549] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-10-10T18:15:02.205634] [INFO ] [LOCAL ] CSTM: Starting deletion of derivative data. [2025-10-10T18:15:02.206288] [DEBUG] [LOCAL ] CSTM: Deleted derivative data file. [2025-10-10T18:15:02.206895] [INFO ] [MAIN ] Update Progress: 543/2373 symbols completed. CSTM took 33.0s. Estimated remaining: 4h 12m 40s. Rate: 7.2 symbols/min [2025-10-10T18:15:02.393311] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:15:02.393522] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-10-10T18:15:02.393561] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-10-10T18:15:02.393715] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-10-10T18:15:02.393768] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-10T18:15:02.393811] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-10T18:15:02.393845] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-10-10T18:15:02.689771] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-10T18:15:02.798894] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:15:02.997847] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-10T18:15:03.489372] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-10T18:15:03.580220] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-10T18:15:04.289409] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-10-10T18:15:04.398854] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-10T18:15:04.814604] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T18:15:04.815020] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-10-10T18:15:04.815118] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:15:04.815170] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-10-10T18:15:04.815228] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:15:04.815332] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-10T18:15:04.815421] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-10T18:15:04.815459] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-10-10T18:15:04.815500] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-10-10T18:15:04.815552] [INFO ] [MAIN ] Update Progress: 544/2373 symbols completed. CTEST took 2.6s. Estimated remaining: 4h 12m 12s. Rate: 7.3 symbols/min [2025-10-10T18:15:04.992213] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:15:04.992431] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-10T18:15:04.992470] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-10T18:15:04.992628] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-10T18:15:04.992709] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-10T18:15:04.992762] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-10T18:15:04.992798] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-10T18:15:05.094556] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-10T18:15:05.382907] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:15:05.889396] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-10T18:15:06.159263] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-10T18:15:06.689362] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-10T18:15:06.771032] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-10T18:15:07.468683] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-10T18:15:07.489326] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-10T18:15:08.254723] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T18:15:08.255864] [INFO ] [REMOTE ] CTDD: Full fetch complete (8222 records). [2025-10-10T18:15:08.255936] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-10T18:15:08.294692] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-10T18:15:08.592109] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T18:15:08.622688] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-10T18:15:08.622997] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:15:08.623161] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-10T18:15:08.623322] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-10T18:15:08.623462] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-10T18:15:08.623884] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-10T18:15:08.623568] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:15:08.624075] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-10T18:15:08.624174] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-10T18:15:08.624440] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-10T18:15:08.624876] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-10T18:15:08.625255] [DEBUG] [LOCAL ] CTDD: Trimmed 8222 records to 5856 (keeping 200 days of data) [2025-10-10T18:15:08.625167] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-10T18:15:08.625967] [INFO ] [MAIN ] Update Progress: 545/2373 symbols completed. CTEV took 3.8s. Estimated remaining: 4h 11m 49s. Rate: 7.3 symbols/min [2025-10-10T18:15:08.814356] [DEBUG] [LOCAL ] CTDD: Primary data saved (5856 records). [2025-10-10T18:15:08.821516] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-10T18:15:08.821714] [INFO ] [MAIN ] Update Progress: 546/2373 symbols completed. CTDD took 25.2s. Estimated remaining: 4h 11m 14s. Rate: 7.3 symbols/min [2025-10-10T18:15:08.896521] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:15:09.033936] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:15:09.034272] [DEBUG] [LOCAL ] CTOS: No existing data file found in primary storage. [2025-10-10T18:15:09.034327] [WARN ] [MAIN ] CTOS: No existing data found, performing full refresh instead. [2025-10-10T18:15:09.034448] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-10T18:15:09.034490] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-10T18:15:09.034531] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-10T18:15:09.034565] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-10T18:15:09.095347] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-10T18:15:09.215436] [DEBUG] [LOCAL ] CTO: Loaded 28051 existing records from primary storage. [2025-10-10T18:15:09.231781] [INFO ] [MAIN ] CTO: Loaded 28051 existing records. [2025-10-10T18:15:09.595452] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:15:09.620379] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:15:09.621199] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-10T18:15:09.621267] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-10T18:15:09.621626] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-10T18:15:09.621734] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-10T18:15:09.899442] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-10T18:15:09.994886] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:15:10.023149] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T18:15:10.689414] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-10T18:15:11.489400] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-10T18:15:11.652982] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-10T18:15:12.221515] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-10T18:15:12.289360] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-10T18:15:12.427802] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-10T18:15:13.089377] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-10T18:15:13.117075] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T18:15:13.118617] [INFO ] [REMOTE ] CTBB: Full fetch complete (10489 records). [2025-10-10T18:15:13.118726] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-10T18:15:13.480216] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-10T18:15:13.480300] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-10T18:15:13.480568] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-10T18:15:13.480606] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-10T18:15:13.481038] [DEBUG] [LOCAL ] CTBB: Trimmed 10489 records to 7130 (keeping 200 days of data) [2025-10-10T18:15:13.524426] [DEBUG] [LOCAL ] CTBB: Primary data saved (7130 records). [2025-10-10T18:15:13.524573] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-10T18:15:13.524686] [INFO ] [MAIN ] Update Progress: 547/2373 symbols completed. CTBB took 35.4s. Estimated remaining: 4h 10m 54s. Rate: 7.3 symbols/min [2025-10-10T18:15:13.689448] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:15:13.742421] [DEBUG] [LOCAL ] CTRA: Loaded 54036 existing records from primary storage. [2025-10-10T18:15:13.742804] [INFO ] [MAIN ] CTRA: Loaded 54036 existing records. [2025-10-10T18:15:13.894486] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-10T18:15:13.923507] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:15:13.923875] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-10T18:15:13.923932] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-10T18:15:13.924212] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-10T18:15:13.924268] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-10T18:15:14.276501] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:15:14.555473] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-10T18:15:14.689341] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-10T18:15:14.713616] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T18:15:15.489450] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-10T18:15:15.710379] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T18:15:15.712243] [INFO ] [REMOTE ] CSV: Full fetch complete (19264 records). [2025-10-10T18:15:15.712349] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-10T18:15:16.269837] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-10T18:15:16.269979] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-10T18:15:16.271154] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-10T18:15:16.271240] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-10T18:15:16.272418] [DEBUG] [LOCAL ] CSV: Trimmed 19264 records to 12872 (keeping 200 days of data) [2025-10-10T18:15:16.325596] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-10T18:15:16.406405] [DEBUG] [LOCAL ] CSV: Primary data saved (12872 records). [2025-10-10T18:15:16.406632] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-10T18:15:16.406812] [INFO ] [MAIN ] Update Progress: 548/2373 symbols completed. CSV took 45.6s. Estimated remaining: 4h 10m 28s. Rate: 7.3 symbols/min [2025-10-10T18:15:16.644220] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:15:16.644431] [DEBUG] [LOCAL ] CTRE: No existing data file found in primary storage. [2025-10-10T18:15:16.644469] [WARN ] [MAIN ] CTRE: No existing data found, performing full refresh instead. [2025-10-10T18:15:16.644587] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-10T18:15:16.644630] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-10T18:15:16.644742] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-10T18:15:16.644815] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-10T18:15:17.062776] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:15:17.089352] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-10T18:15:17.689461] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-10T18:15:17.803370] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-10T18:15:17.889390] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-10T18:15:18.689390] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-10T18:15:19.119899] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-10T18:15:19.255007] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T18:15:19.489409] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-10T18:15:20.289399] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-10T18:15:20.948860] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-10T18:15:21.089399] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-10T18:15:21.465350] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T18:15:21.503427] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-10T18:15:21.889432] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-10T18:15:22.689397] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-10T18:15:23.143606] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-10T18:15:23.391397] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-10T18:15:23.489484] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-10T18:15:24.155553] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-10T18:15:24.289372] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-10T18:15:25.089366] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-10T18:15:25.222009] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T18:15:25.889430] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-10T18:15:26.144150] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T18:15:26.689453] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-10T18:15:26.842178] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T18:15:27.489416] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-10T18:15:27.659221] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T18:15:28.253155] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T18:15:28.289330] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-10T18:15:28.620767] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T18:15:29.089372] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-10T18:15:29.548328] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T18:15:29.889398] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-10T18:15:30.689384] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-10T18:15:31.257168] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-10T18:15:31.402032] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-10T18:15:31.489335] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-10T18:15:32.289352] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-10T18:15:32.404216] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T18:15:33.011836] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T18:15:33.089433] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-10T18:15:33.889352] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-10T18:15:33.942285] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T18:15:34.632970] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-10T18:15:34.689376] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-10T18:15:35.226030] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T18:15:35.489387] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-10T18:15:35.860122] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-10T18:15:36.289431] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-10T18:15:37.089352] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-10T18:15:37.668224] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-10T18:15:37.707603] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-10T18:15:37.889422] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-10T18:15:38.629965] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-10T18:15:38.689415] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-10T18:15:39.255121] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T18:15:39.489436] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-10T18:15:40.188876] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-10T18:15:40.289402] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-10T18:15:41.089926] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-10T18:15:41.094785] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-10T18:15:41.707491] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-10T18:15:41.710748] [INFO ] [REMOTE ] CTO: Full fetch complete (41404 records). [2025-10-10T18:15:41.710834] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-10T18:15:41.711342] [FATAL] [VALIDATOR ] CTO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:15:41.711429] [FATAL] [MAIN ] CTO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:15:41.711472] [WARN ] [MAIN ] CTO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:15:41.711513] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-10T18:15:41.711599] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-10-10T18:15:41.711701] [INFO ] [LOCAL ] CTO: Starting deletion of derivative data. [2025-10-10T18:15:41.711924] [DEBUG] [LOCAL ] CTO: Deleted derivative data file. [2025-10-10T18:15:41.712026] [INFO ] [MAIN ] Update Progress: 549/2373 symbols completed. CTO took 33.1s. Estimated remaining: 4h 11m 16s. Rate: 7.3 symbols/min [2025-10-10T18:15:41.881277] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:15:41.881514] [DEBUG] [LOCAL ] CTRI: No existing data file found in primary storage. [2025-10-10T18:15:41.881553] [WARN ] [MAIN ] CTRI: No existing data found, performing full refresh instead. [2025-10-10T18:15:41.881703] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-10T18:15:41.881757] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-10T18:15:41.881836] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-10T18:15:41.881892] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-10T18:15:41.894703] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-10T18:15:42.236812] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:15:42.639774] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-10T18:15:42.643492] [INFO ] [REMOTE ] CTOS: Full fetch complete (53293 records). [2025-10-10T18:15:42.643712] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-10T18:15:42.644326] [FATAL] [VALIDATOR ] CTOS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:15:42.644421] [FATAL] [MAIN ] CTOS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:15:42.644465] [WARN ] [MAIN ] CTOS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:15:42.644504] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-10T18:15:42.644562] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-10T18:15:42.644596] [INFO ] [LOCAL ] CTOS: Starting deletion of derivative data. [2025-10-10T18:15:42.644674] [DEBUG] [LOCAL ] CTOS: No derivative data file found to delete. [2025-10-10T18:15:42.644756] [INFO ] [MAIN ] Update Progress: 550/2373 symbols completed. CTOS took 33.8s. Estimated remaining: 4h 10m 43s. Rate: 7.3 symbols/min [2025-10-10T18:15:42.699239] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-10T18:15:42.818562] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:15:42.838906] [DEBUG] [LOCAL ] CTS: Loaded 19505 existing records from primary storage. [2025-10-10T18:15:42.839215] [INFO ] [MAIN ] CTS: Loaded 19505 existing records. [2025-10-10T18:15:43.012032] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:15:43.012315] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-10T18:15:43.012366] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-10T18:15:43.012618] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-10T18:15:43.012712] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-10T18:15:43.369523] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:15:43.489430] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-10T18:15:43.545276] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-10T18:15:44.289493] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-10T18:15:44.849377] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-10T18:15:45.089438] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-10T18:15:45.153936] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-10T18:15:45.486731] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-10T18:15:45.889382] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-10T18:15:46.689419] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-10T18:15:46.751609] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T18:15:46.845500] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-10T18:15:47.489437] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-10T18:15:47.763442] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-10T18:15:48.289343] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-10T18:15:48.446038] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T18:15:49.089402] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-10T18:15:49.889330] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-10T18:15:50.108416] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-10T18:15:50.114022] [INFO ] [REMOTE ] CTRE: Full fetch complete (71148 records). [2025-10-10T18:15:50.114150] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-10T18:15:50.501948] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-10T18:15:50.502053] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-10T18:15:50.503011] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-10T18:15:50.503078] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-10T18:15:50.504818] [DEBUG] [LOCAL ] CTRE: Trimmed 71148 records to 50027 (keeping 200 days of data) [2025-10-10T18:15:50.616428] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-10T18:15:50.715008] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-10T18:15:50.854084] [DEBUG] [LOCAL ] CTRE: Primary data saved (50027 records). [2025-10-10T18:15:50.854248] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-10T18:15:50.854327] [INFO ] [MAIN ] Update Progress: 551/2373 symbols completed. CTRE took 34.4s. Estimated remaining: 4h 10m 35s. Rate: 7.3 symbols/min [2025-10-10T18:15:51.023174] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:15:51.042882] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-10T18:15:51.086071] [DEBUG] [LOCAL ] CTVA: Loaded 53653 existing records from primary storage. [2025-10-10T18:15:51.086451] [INFO ] [MAIN ] CTVA: Loaded 53653 existing records. [2025-10-10T18:15:51.259829] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:15:51.260073] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-10T18:15:51.260127] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-10T18:15:51.260353] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-10T18:15:51.260391] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-10T18:15:51.494611] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-10T18:15:51.606294] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:15:52.289358] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-10T18:15:52.317128] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-10T18:15:52.961840] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-10T18:15:53.089404] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-10T18:15:53.812456] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-10T18:15:53.889439] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-10T18:15:54.689357] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-10T18:15:54.930390] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T18:15:55.489424] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-10T18:15:55.677376] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T18:15:56.043721] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T18:15:56.289389] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-10T18:15:57.089352] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-10T18:15:57.783066] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T18:15:57.874983] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-10T18:15:57.889322] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-10T18:15:58.294530] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-10T18:15:58.689386] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-10T18:15:59.489439] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-10T18:15:59.951778] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-10T18:16:00.115269] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-10T18:16:00.289400] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-10T18:16:01.089357] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-10T18:16:01.214840] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-10T18:16:01.889360] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-10T18:16:02.280278] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-10T18:16:02.411046] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-10T18:16:02.416175] [INFO ] [REMOTE ] CTRA: Full fetch complete (77271 records). [2025-10-10T18:16:02.416357] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-10T18:16:02.417221] [FATAL] [VALIDATOR ] CTRA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:16:02.417323] [FATAL] [MAIN ] CTRA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:16:02.417366] [WARN ] [MAIN ] CTRA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:16:02.417407] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-10T18:16:02.417465] [DEBUG] [LOCAL ] CTRA: No primary data file found to delete. [2025-10-10T18:16:02.417501] [INFO ] [LOCAL ] CTRA: Starting deletion of derivative data. [2025-10-10T18:16:02.417909] [DEBUG] [LOCAL ] CTRA: Deleted derivative data file. [2025-10-10T18:16:02.419107] [INFO ] [MAIN ] Update Progress: 552/2373 symbols completed. CTRA took 48.9s. Estimated remaining: 4h 10m 38s. Rate: 7.3 symbols/min [2025-10-10T18:16:02.611459] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:16:02.613163] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-10T18:16:02.613265] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-10T18:16:02.613468] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-10T18:16:02.613517] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-10T18:16:02.613563] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-10T18:16:02.613599] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-10T18:16:02.697275] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-10T18:16:03.002030] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:16:03.489385] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-10T18:16:03.690561] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T18:16:04.289386] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-10T18:16:04.530694] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-10T18:16:04.571933] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-10T18:16:05.089372] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-10T18:16:05.889387] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-10T18:16:06.238031] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T18:16:06.276801] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-10T18:16:06.427546] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-10T18:16:06.689428] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-10T18:16:07.073882] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-10T18:16:07.489379] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-10T18:16:08.289385] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-10T18:16:09.089414] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-10T18:16:09.466999] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-10T18:16:09.595316] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-10T18:16:09.666951] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T18:16:09.671268] [INFO ] [REMOTE ] CTRI: Full fetch complete (52384 records). [2025-10-10T18:16:09.671362] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-10T18:16:09.672119] [FATAL] [VALIDATOR ] CTRI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:16:09.672230] [FATAL] [MAIN ] CTRI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:16:09.672306] [WARN ] [MAIN ] CTRI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:16:09.672377] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-10T18:16:09.672441] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-10T18:16:09.672477] [INFO ] [LOCAL ] CTRI: Starting deletion of derivative data. [2025-10-10T18:16:09.672517] [DEBUG] [LOCAL ] CTRI: No derivative data file found to delete. [2025-10-10T18:16:09.672572] [INFO ] [MAIN ] Update Progress: 553/2373 symbols completed. CTRI took 28.0s. Estimated remaining: 4h 10m 26s. Rate: 7.3 symbols/min [2025-10-10T18:16:09.839738] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:16:09.887974] [DEBUG] [LOCAL ] CUBE: Loaded 51139 existing records from primary storage. [2025-10-10T18:16:09.888317] [INFO ] [MAIN ] CUBE: Loaded 51139 existing records. [2025-10-10T18:16:09.899237] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-10T18:16:10.068457] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:16:10.068723] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-10T18:16:10.068782] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-10T18:16:10.068974] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-10T18:16:10.069014] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-10T18:16:10.422908] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-10T18:16:10.426491] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:16:10.689363] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-10T18:16:11.117238] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-10T18:16:11.489384] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-10T18:16:11.716440] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-10T18:16:12.289374] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-10T18:16:13.089384] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-10T18:16:13.551229] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-10T18:16:13.889378] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-10T18:16:14.689362] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-10T18:16:14.780432] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T18:16:15.188192] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-10T18:16:15.489346] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-10T18:16:15.839608] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T18:16:16.289376] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-10T18:16:17.089352] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-10T18:16:17.402902] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T18:16:17.568875] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T18:16:17.889363] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-10T18:16:18.689416] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-10T18:16:18.836420] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T18:16:18.838704] [INFO ] [REMOTE ] CTS: Full fetch complete (26729 records). [2025-10-10T18:16:18.838780] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-10T18:16:19.207308] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-10T18:16:19.207427] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-10T18:16:19.208234] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-10T18:16:19.208348] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-10T18:16:19.220359] [DEBUG] [LOCAL ] CTS: Trimmed 26729 records to 19662 (keeping 200 days of data) [2025-10-10T18:16:19.239597] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-10T18:16:19.370202] [DEBUG] [LOCAL ] CTS: Primary data saved (19662 records). [2025-10-10T18:16:19.370367] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-10T18:16:19.370453] [INFO ] [MAIN ] Update Progress: 554/2373 symbols completed. CTS took 36.7s. Estimated remaining: 4h 10m 23s. Rate: 7.3 symbols/min [2025-10-10T18:16:19.494545] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-10T18:16:19.540188] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:16:19.568250] [DEBUG] [LOCAL ] CUBI: Loaded 27184 existing records from primary storage. [2025-10-10T18:16:19.568551] [INFO ] [MAIN ] CUBI: Loaded 27184 existing records. [2025-10-10T18:16:19.750004] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:16:19.750442] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-10T18:16:19.750504] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-10T18:16:19.750823] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-10T18:16:19.750883] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-10T18:16:19.843685] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-10T18:16:20.112046] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:16:20.136933] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-10T18:16:20.289340] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-10T18:16:21.089377] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-10T18:16:21.830093] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T18:16:21.889378] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-10T18:16:22.689357] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-10T18:16:23.028528] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T18:16:23.436481] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-10T18:16:23.489379] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-10T18:16:24.289381] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-10T18:16:24.641542] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T18:16:24.774110] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T18:16:25.089416] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-10T18:16:25.644499] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-10T18:16:25.889472] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-10T18:16:26.262452] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-10T18:16:26.263367] [INFO ] [REMOTE ] CUBB: Full fetch complete (918 records). [2025-10-10T18:16:26.263436] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-10T18:16:26.264026] [FATAL] [VALIDATOR ] CUBB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:16:26.264265] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:16:26.264375] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:16:26.264510] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-10T18:16:26.264722] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-10T18:16:26.264783] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-10T18:16:26.264846] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-10T18:16:26.264943] [INFO ] [MAIN ] Update Progress: 555/2373 symbols completed. CUBB took 23.8s. Estimated remaining: 4h 10m 10s. Rate: 7.3 symbols/min [2025-10-10T18:16:26.454763] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:16:26.455262] [DEBUG] [LOCAL ] CUK: No existing data file found in primary storage. [2025-10-10T18:16:26.455323] [WARN ] [MAIN ] CUK: No existing data found, performing full refresh instead. [2025-10-10T18:16:26.466067] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-10T18:16:26.471284] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-10T18:16:26.484610] [DEBUG] [LOCAL ] CUK: No primary data file found to delete. [2025-10-10T18:16:26.484780] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-10T18:16:26.550946] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-10T18:16:26.697075] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-10T18:16:26.858229] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:16:27.489383] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-10T18:16:28.289394] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-10T18:16:28.954848] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-10T18:16:29.089438] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-10T18:16:29.614401] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-10T18:16:29.657539] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-10T18:16:29.889407] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-10T18:16:30.689410] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-10T18:16:31.054695] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T18:16:31.489443] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-10T18:16:31.915434] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T18:16:32.289401] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-10T18:16:32.395137] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T18:16:33.089435] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-10T18:16:33.464814] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T18:16:33.889406] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-10T18:16:34.184998] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T18:16:34.689345] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-10T18:16:35.158021] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-10T18:16:35.489461] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-10T18:16:35.674189] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T18:16:36.159676] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-10T18:16:36.289390] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-10T18:16:37.089406] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-10T18:16:37.600734] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-10T18:16:37.889353] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-10T18:16:38.222212] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T18:16:38.689371] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-10T18:16:38.947020] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T18:16:38.951952] [INFO ] [REMOTE ] CTVA: Full fetch complete (76611 records). [2025-10-10T18:16:38.952131] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-10T18:16:38.953136] [FATAL] [VALIDATOR ] CTVA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:16:38.953230] [FATAL] [MAIN ] CTVA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:16:38.953274] [WARN ] [MAIN ] CTVA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:16:38.953313] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-10T18:16:38.953370] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-10T18:16:38.953405] [INFO ] [LOCAL ] CTVA: Starting deletion of derivative data. [2025-10-10T18:16:38.953632] [DEBUG] [LOCAL ] CTVA: Deleted derivative data file. [2025-10-10T18:16:38.953788] [INFO ] [MAIN ] Update Progress: 556/2373 symbols completed. CTVA took 48.1s. Estimated remaining: 4h 10m 16s. Rate: 7.3 symbols/min [2025-10-10T18:16:39.129963] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:16:39.135831] [DEBUG] [LOCAL ] CULP: Loaded 2897 existing records from primary storage. [2025-10-10T18:16:39.136102] [INFO ] [MAIN ] CULP: Loaded 2897 existing records. [2025-10-10T18:16:39.315980] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:16:39.316228] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-10T18:16:39.316276] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-10T18:16:39.316431] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-10T18:16:39.316486] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-10T18:16:39.498422] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-10T18:16:39.662574] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:16:40.195877] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-10T18:16:40.289339] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-10T18:16:40.324193] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T18:16:40.978732] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-10T18:16:41.089384] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-10T18:16:41.889418] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-10T18:16:42.454669] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-10T18:16:42.480297] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T18:16:42.689398] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-10T18:16:42.740484] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-10T18:16:43.489406] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-10T18:16:44.074894] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-10T18:16:44.289348] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-10T18:16:44.547171] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-10T18:16:45.089558] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-10T18:16:45.427975] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-10T18:16:45.889426] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-10T18:16:46.688994] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T18:16:46.693826] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-10T18:16:46.694855] [INFO ] [REMOTE ] CUBE: Full fetch complete (73036 records). [2025-10-10T18:16:46.694948] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-10T18:16:47.081495] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-10T18:16:47.081584] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-10T18:16:47.082522] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-10T18:16:47.082586] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-10T18:16:47.084186] [DEBUG] [LOCAL ] CUBE: Trimmed 73036 records to 51520 (keeping 200 days of data) [2025-10-10T18:16:47.417313] [DEBUG] [LOCAL ] CUBE: Primary data saved (51520 records). [2025-10-10T18:16:47.417508] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-10T18:16:47.418072] [INFO ] [MAIN ] Update Progress: 557/2373 symbols completed. CUBE took 37.7s. Estimated remaining: 4h 10m 9s. Rate: 7.3 symbols/min [2025-10-10T18:16:47.489341] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-10T18:16:48.075421] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-10T18:16:48.075950] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-10T18:16:48.108997] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-10T18:16:48.289384] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-10T18:16:49.019458] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-10T18:16:49.089404] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-10T18:16:49.655337] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-10T18:16:49.889425] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-10T18:16:50.503810] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-10T18:16:50.689395] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-10T18:16:51.293227] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-10T18:16:51.489396] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-10T18:16:52.199390] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-10T18:16:52.289356] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-10T18:16:52.983128] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-10T18:16:53.089380] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-10T18:16:53.799222] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-10T18:16:53.889383] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-10T18:16:54.464380] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-10T18:16:54.465242] [INFO ] [REMOTE ] CULP: Full fetch complete (4603 records). [2025-10-10T18:16:54.465311] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-10T18:16:54.699392] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-10T18:16:54.823424] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-10T18:16:54.823512] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-10T18:16:54.823711] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-10T18:16:54.823798] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-10T18:16:54.824181] [DEBUG] [LOCAL ] CULP: Trimmed 4603 records to 2919 (keeping 200 days of data) [2025-10-10T18:16:54.840417] [DEBUG] [LOCAL ] CULP: Primary data saved (2919 records). [2025-10-10T18:16:54.840490] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-10T18:16:54.840582] [INFO ] [MAIN ] Update Progress: 558/2373 symbols completed. CULP took 15.9s. Estimated remaining: 4h 9m 58s. Rate: 7.3 symbols/min [2025-10-10T18:16:55.489398] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-10T18:16:56.903623] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-10T18:16:56.914911] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-10T18:16:57.155629] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-10T18:16:57.162413] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-10T18:16:58.408226] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-10T18:16:58.410959] [INFO ] [REMOTE ] CUBI: Full fetch complete (39062 records). [2025-10-10T18:16:58.411037] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-10T18:16:58.803592] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-10T18:16:58.803717] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-10T18:16:58.804395] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-10T18:16:58.804446] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-10T18:16:58.805282] [DEBUG] [LOCAL ] CUBI: Trimmed 39062 records to 27426 (keeping 200 days of data) [2025-10-10T18:16:58.965234] [DEBUG] [LOCAL ] CUBI: Primary data saved (27426 records). [2025-10-10T18:16:58.965436] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-10T18:16:58.965595] [INFO ] [MAIN ] Update Progress: 559/2373 symbols completed. CUBI took 39.6s. Estimated remaining: 4h 9m 36s. Rate: 7.3 symbols/min [2025-10-10T18:16:58.996293] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T18:16:59.007722] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-10T18:17:01.239134] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-10T18:17:01.244290] [INFO ] [REMOTE ] CUK: Full fetch complete (74069 records). [2025-10-10T18:17:01.244451] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-10T18:17:01.647929] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-10T18:17:01.648034] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-10T18:17:01.649037] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-10T18:17:01.649122] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-10T18:17:01.651629] [DEBUG] [LOCAL ] CUK: Trimmed 74069 records to 51722 (keeping 200 days of data) [2025-10-10T18:17:01.990553] [DEBUG] [LOCAL ] CUK: Primary data saved (51722 records). [2025-10-10T18:17:01.990914] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-10T18:17:01.991009] [INFO ] [MAIN ] Update Progress: 560/2373 symbols completed. CUK took 35.7s. Estimated remaining: 4h 9m 11s. Rate: 7.3 symbols/min [2025-10-10T18:17:02.607299] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:17:02.683780] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:17:02.733049] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:17:02.751073] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:17:02.751906] [DEBUG] [LOCAL ] CURB: No existing data file found in primary storage. [2025-10-10T18:17:02.751965] [WARN ] [MAIN ] CURB: No existing data found, performing full refresh instead. [2025-10-10T18:17:02.752352] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-10T18:17:02.752411] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-10T18:17:02.752480] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-10T18:17:02.752523] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-10T18:17:02.979864] [DEBUG] [LOCAL ] CURV: Loaded 27028 existing records from primary storage. [2025-10-10T18:17:03.012867] [INFO ] [MAIN ] CURV: Loaded 27028 existing records. [2025-10-10T18:17:03.086051] [DEBUG] [LOCAL ] CUZ: Loaded 49781 existing records from primary storage. [2025-10-10T18:17:03.135686] [INFO ] [MAIN ] CUZ: Loaded 49781 existing records. [2025-10-10T18:17:03.209105] [DEBUG] [LOCAL ] CVE: Loaded 53949 existing records from primary storage. [2025-10-10T18:17:03.269158] [INFO ] [MAIN ] CVE: Loaded 53949 existing records. [2025-10-10T18:17:03.556776] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:17:03.572249] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-10T18:17:03.752271] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:17:03.840529] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-10T18:17:03.867474] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-10T18:17:03.873166] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:17:03.834548] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:17:03.873692] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-10T18:17:03.874062] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-10T18:17:03.874563] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-10T18:17:03.874437] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-10T18:17:03.874873] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-10T18:17:03.873834] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-10T18:17:03.895260] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-10T18:17:03.910277] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-10T18:17:03.895207] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-10T18:17:03.937131] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-10T18:17:04.959860] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:17:05.002787] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:17:04.992991] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-10T18:17:05.009153] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-10T18:17:05.084639] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:17:05.086000] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-10T18:17:05.329729] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T18:17:05.337086] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-10T18:17:06.713771] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T18:17:06.725931] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-10T18:17:06.751333] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-10T18:17:06.760549] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-10T18:17:06.802816] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T18:17:06.813726] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-10T18:17:06.904617] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-10T18:17:06.912217] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-10T18:17:08.042261] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T18:17:08.048846] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-10T18:17:08.349041] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-10T18:17:08.356245] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-10T18:17:08.525466] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T18:17:08.535929] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-10T18:17:08.609484] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-10T18:17:08.623841] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-10T18:17:09.310510] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T18:17:09.316062] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-10T18:17:09.517213] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-10T18:17:09.889396] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-10T18:17:10.211280] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-10T18:17:10.576938] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T18:17:10.689408] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-10T18:17:10.719214] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-10T18:17:11.294090] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-10T18:17:11.489382] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-10T18:17:12.023160] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-10T18:17:12.289399] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-10T18:17:12.623104] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T18:17:13.089434] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-10T18:17:13.818666] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-10T18:17:13.889391] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-10T18:17:14.394940] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-10T18:17:14.689365] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-10T18:17:15.489367] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-10T18:17:15.563739] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T18:17:16.289449] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-10T18:17:16.670304] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T18:17:17.089362] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-10T18:17:17.454825] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T18:17:17.878528] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T18:17:17.889459] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-10T18:17:18.689408] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-10T18:17:19.322908] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-10T18:17:19.489352] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-10T18:17:19.587892] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T18:17:19.787032] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T18:17:20.289391] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-10T18:17:21.089441] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-10T18:17:21.271675] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T18:17:21.889381] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-10T18:17:22.255019] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-10T18:17:22.689408] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-10T18:17:23.270330] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-10T18:17:23.307943] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-10T18:17:23.489451] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-10T18:17:24.289386] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-10T18:17:24.604073] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T18:17:25.089406] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-10T18:17:25.140975] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-10T18:17:25.889400] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-10T18:17:26.212945] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-10T18:17:26.622143] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-10T18:17:26.689369] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-10T18:17:27.449485] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-10T18:17:27.452721] [INFO ] [REMOTE ] CURB: Full fetch complete (46847 records). [2025-10-10T18:17:27.452818] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-10T18:17:27.453475] [FATAL] [VALIDATOR ] CURB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:17:27.453561] [FATAL] [MAIN ] CURB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:17:27.453604] [WARN ] [MAIN ] CURB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:17:27.453664] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-10T18:17:27.453746] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-10T18:17:27.453784] [INFO ] [LOCAL ] CURB: Starting deletion of derivative data. [2025-10-10T18:17:27.453822] [DEBUG] [LOCAL ] CURB: No derivative data file found to delete. [2025-10-10T18:17:27.453877] [INFO ] [MAIN ] Update Progress: 561/2373 symbols completed. CURB took 25.5s. Estimated remaining: 4h 9m 58s. Rate: 7.2 symbols/min [2025-10-10T18:17:27.494963] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-10T18:17:27.654159] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:17:27.654443] [DEBUG] [LOCAL ] CVEO: No existing data file found in primary storage. [2025-10-10T18:17:27.654491] [WARN ] [MAIN ] CVEO: No existing data found, performing full refresh instead. [2025-10-10T18:17:27.655011] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-10T18:17:27.655166] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-10T18:17:27.655225] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-10T18:17:27.655260] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-10T18:17:28.016867] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:17:28.145288] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-10T18:17:28.289392] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-10T18:17:29.012414] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T18:17:29.089412] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-10T18:17:29.864258] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T18:17:29.889347] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-10T18:17:30.689379] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-10T18:17:30.761175] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T18:17:30.945952] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-10T18:17:30.949499] [INFO ] [REMOTE ] CURV: Full fetch complete (38924 records). [2025-10-10T18:17:30.949581] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-10T18:17:31.348460] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-10T18:17:31.348577] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-10T18:17:31.349688] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-10T18:17:31.349776] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-10T18:17:31.351363] [DEBUG] [LOCAL ] CURV: Trimmed 38924 records to 27271 (keeping 200 days of data) [2025-10-10T18:17:31.501718] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-10T18:17:31.532633] [DEBUG] [LOCAL ] CURV: Primary data saved (27271 records). [2025-10-10T18:17:31.532913] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-10T18:17:31.533055] [INFO ] [MAIN ] Update Progress: 562/2373 symbols completed. CURV took 29.5s. Estimated remaining: 4h 9m 36s. Rate: 7.3 symbols/min [2025-10-10T18:17:31.740430] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:17:31.740686] [DEBUG] [LOCAL ] CVI: No existing data file found in primary storage. [2025-10-10T18:17:31.740743] [WARN ] [MAIN ] CVI: No existing data found, performing full refresh instead. [2025-10-10T18:17:31.740872] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-10T18:17:31.740937] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-10T18:17:31.740986] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-10T18:17:31.741020] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-10T18:17:31.997896] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-10T18:17:32.133188] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:17:32.289392] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-10T18:17:33.089421] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-10T18:17:33.305544] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T18:17:33.889368] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-10T18:17:34.019912] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-10T18:17:34.146717] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T18:17:34.689401] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-10T18:17:35.489390] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-10T18:17:35.943220] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T18:17:36.289475] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-10T18:17:36.397384] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T18:17:36.892961] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-10T18:17:36.897866] [INFO ] [REMOTE ] CUZ: Full fetch complete (70694 records). [2025-10-10T18:17:36.898029] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-10T18:17:37.095603] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-10T18:17:37.269056] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T18:17:37.319936] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-10T18:17:37.320029] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-10T18:17:37.321028] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-10T18:17:37.321094] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-10T18:17:37.322461] [DEBUG] [LOCAL ] CUZ: Trimmed 70694 records to 50127 (keeping 200 days of data) [2025-10-10T18:17:37.640132] [DEBUG] [LOCAL ] CUZ: Primary data saved (50127 records). [2025-10-10T18:17:37.640299] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-10T18:17:37.640389] [INFO ] [MAIN ] Update Progress: 563/2373 symbols completed. CUZ took 35.6s. Estimated remaining: 4h 9m 21s. Rate: 7.3 symbols/min [2025-10-10T18:17:37.813669] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:17:37.830440] [DEBUG] [LOCAL ] CVLG: Loaded 15601 existing records from primary storage. [2025-10-10T18:17:37.830734] [INFO ] [MAIN ] CVLG: Loaded 15601 existing records. [2025-10-10T18:17:37.894523] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-10T18:17:38.009987] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:17:38.010279] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-10T18:17:38.010326] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-10T18:17:38.010618] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-10T18:17:38.010714] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-10T18:17:38.353930] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:17:38.689351] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-10T18:17:39.002475] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-10T18:17:39.088152] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-10T18:17:39.489420] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-10T18:17:39.717270] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-10T18:17:40.289378] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-10T18:17:41.089425] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-10T18:17:41.382305] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T18:17:41.436630] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-10T18:17:41.889363] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-10T18:17:42.355427] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-10T18:17:42.689363] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-10T18:17:43.489416] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-10T18:17:43.639855] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-10T18:17:43.860064] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-10T18:17:43.865567] [INFO ] [REMOTE ] CVE: Full fetch complete (77561 records). [2025-10-10T18:17:43.865760] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-10T18:17:44.250266] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-10T18:17:44.250364] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-10T18:17:44.251315] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-10T18:17:44.251381] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-10T18:17:44.255905] [DEBUG] [LOCAL ] CVE: Trimmed 77561 records to 54339 (keeping 200 days of data) [2025-10-10T18:17:44.316551] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-10T18:17:44.607586] [DEBUG] [LOCAL ] CVE: Primary data saved (54339 records). [2025-10-10T18:17:44.607819] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-10T18:17:44.607910] [INFO ] [MAIN ] Update Progress: 564/2373 symbols completed. CVE took 42.6s. Estimated remaining: 4h 9m 9s. Rate: 7.3 symbols/min [2025-10-10T18:17:44.774864] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T18:17:44.805771] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:17:44.859050] [DEBUG] [LOCAL ] CVNA: Loaded 53280 existing records from primary storage. [2025-10-10T18:17:44.859379] [INFO ] [MAIN ] CVNA: Loaded 53280 existing records. [2025-10-10T18:17:45.042813] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:17:45.043092] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-10T18:17:45.043159] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-10T18:17:45.043554] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-10T18:17:45.043614] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-10T18:17:45.094622] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-10T18:17:45.422893] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:17:45.889441] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-10T18:17:46.190321] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T18:17:46.261889] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-10T18:17:46.689440] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-10T18:17:47.445043] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-10T18:17:47.489362] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-10T18:17:47.592770] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T18:17:48.289338] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-10T18:17:48.586787] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-10T18:17:49.089335] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-10T18:17:49.583971] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-10T18:17:49.889334] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-10T18:17:50.202865] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-10T18:17:50.689366] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-10T18:17:51.180266] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T18:17:51.489398] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-10T18:17:51.668997] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T18:17:52.289399] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-10T18:17:52.769952] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T18:17:53.089387] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-10T18:17:53.645477] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-10T18:17:53.647846] [INFO ] [REMOTE ] CVEO: Full fetch complete (20662 records). [2025-10-10T18:17:53.647919] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-10T18:17:53.895364] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-10T18:17:53.949784] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-10T18:17:54.034917] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-10T18:17:54.035019] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-10T18:17:54.035658] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-10T18:17:54.035725] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-10T18:17:54.036323] [DEBUG] [LOCAL ] CVEO: Trimmed 20662 records to 15540 (keeping 200 days of data) [2025-10-10T18:17:54.126309] [DEBUG] [LOCAL ] CVEO: Primary data saved (15540 records). [2025-10-10T18:17:54.126446] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-10T18:17:54.126525] [INFO ] [MAIN ] Update Progress: 565/2373 symbols completed. CVEO took 26.7s. Estimated remaining: 4h 9m 4s. Rate: 7.3 symbols/min [2025-10-10T18:17:54.293639] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:17:54.345556] [DEBUG] [LOCAL ] CVS: Loaded 54084 existing records from primary storage. [2025-10-10T18:17:54.346039] [INFO ] [MAIN ] CVS: Loaded 54084 existing records. [2025-10-10T18:17:54.527503] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:17:54.527784] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-10T18:17:54.527837] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-10T18:17:54.528113] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-10T18:17:54.528170] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-10T18:17:54.690462] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-10T18:17:54.903899] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:17:55.489426] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-10T18:17:55.595084] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T18:17:56.289359] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-10T18:17:56.479838] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-10T18:17:57.025062] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-10T18:17:57.089336] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-10T18:17:57.889385] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-10T18:17:58.689374] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-10T18:17:58.784254] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-10T18:17:58.920021] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T18:17:59.345433] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-10T18:17:59.489348] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-10T18:17:59.655802] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T18:18:00.289376] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-10T18:18:01.089367] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-10T18:18:01.889418] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-10T18:18:01.892380] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-10T18:18:02.689397] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-10T18:18:02.887108] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-10T18:18:02.994360] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T18:18:03.060996] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-10T18:18:03.062625] [INFO ] [REMOTE ] CVLG: Full fetch complete (21096 records). [2025-10-10T18:18:03.062722] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-10T18:18:03.063172] [FATAL] [VALIDATOR ] CVLG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:18:03.063352] [FATAL] [MAIN ] CVLG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:18:03.063394] [WARN ] [MAIN ] CVLG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:18:03.063461] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-10T18:18:03.063525] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-10T18:18:03.063559] [INFO ] [LOCAL ] CVLG: Starting deletion of derivative data. [2025-10-10T18:18:03.063745] [DEBUG] [LOCAL ] CVLG: Deleted derivative data file. [2025-10-10T18:18:03.063836] [INFO ] [MAIN ] Update Progress: 566/2373 symbols completed. CVLG took 25.4s. Estimated remaining: 4h 8m 58s. Rate: 7.3 symbols/min [2025-10-10T18:18:03.226440] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:18:03.280992] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-10-10T18:18:03.281395] [INFO ] [MAIN ] CVX: Loaded 54150 existing records. [2025-10-10T18:18:03.461149] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:18:03.461419] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-10T18:18:03.461472] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-10T18:18:03.461788] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-10T18:18:03.461855] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-10T18:18:03.494619] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-10T18:18:03.814674] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:18:04.289346] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-10T18:18:04.829973] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-10T18:18:05.089386] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-10T18:18:05.889410] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-10T18:18:06.321935] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-10T18:18:06.689373] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-10T18:18:07.097473] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-10-10T18:18:07.314023] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-10T18:18:07.365121] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-10T18:18:07.489391] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-10T18:18:08.289420] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-10T18:18:09.095829] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-10T18:18:09.120231] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-10T18:18:09.901868] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-10T18:18:09.938443] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-10T18:18:10.689475] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-10T18:18:10.764147] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-10T18:18:11.375041] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-10T18:18:11.489471] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-10T18:18:12.287357] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-10T18:18:12.298230] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-10T18:18:13.089397] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-10T18:18:13.186017] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-10T18:18:13.889438] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-10T18:18:13.975184] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-10T18:18:14.267620] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-10T18:18:14.272405] [INFO ] [REMOTE ] CVI: Full fetch complete (67271 records). [2025-10-10T18:18:14.272512] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-10T18:18:14.653576] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-10T18:18:14.653688] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-10T18:18:14.654523] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-10T18:18:14.654567] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-10T18:18:14.656042] [DEBUG] [LOCAL ] CVI: Trimmed 67271 records to 47237 (keeping 200 days of data) [2025-10-10T18:18:14.706828] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-10T18:18:14.938923] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-10T18:18:15.019327] [DEBUG] [LOCAL ] CVI: Primary data saved (47237 records). [2025-10-10T18:18:15.019577] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-10T18:18:15.019727] [INFO ] [MAIN ] Update Progress: 567/2373 symbols completed. CVI took 43.5s. Estimated remaining: 4h 9m 2s. Rate: 7.3 symbols/min [2025-10-10T18:18:15.200541] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:18:15.224947] [DEBUG] [LOCAL ] CW: Loaded 22352 existing records from primary storage. [2025-10-10T18:18:15.225279] [INFO ] [MAIN ] CW: Loaded 22352 existing records. [2025-10-10T18:18:15.420555] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:18:15.420902] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-10T18:18:15.420968] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-10T18:18:15.421234] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-10T18:18:15.421297] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-10T18:18:15.495989] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-10T18:18:15.852639] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:18:16.289434] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-10T18:18:16.598877] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-10T18:18:16.970553] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-10T18:18:17.089466] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-10T18:18:17.254087] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-10T18:18:17.722943] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-10T18:18:17.889446] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-10T18:18:18.689428] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-10T18:18:18.863220] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T18:18:19.206273] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-10T18:18:19.489386] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-10T18:18:20.289448] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-10T18:18:20.981705] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-10T18:18:21.089380] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-10T18:18:21.322633] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T18:18:21.889375] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-10T18:18:22.514312] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-10T18:18:22.689455] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-10T18:18:23.085789] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T18:18:23.254935] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-10T18:18:23.489344] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-10T18:18:24.289373] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-10T18:18:24.868027] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-10T18:18:25.087625] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-10T18:18:25.092168] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-10T18:18:25.093892] [INFO ] [REMOTE ] CVNA: Full fetch complete (76653 records). [2025-10-10T18:18:25.093988] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-10T18:18:25.511686] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-10T18:18:25.511841] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-10T18:18:25.513006] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-10T18:18:25.513081] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-10T18:18:25.515369] [DEBUG] [LOCAL ] CVNA: Trimmed 76653 records to 53666 (keeping 200 days of data) [2025-10-10T18:18:25.875839] [DEBUG] [LOCAL ] CVNA: Primary data saved (53666 records). [2025-10-10T18:18:25.876031] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-10T18:18:25.876989] [INFO ] [MAIN ] Update Progress: 568/2373 symbols completed. CVNA took 41.3s. Estimated remaining: 4h 9m 2s. Rate: 7.2 symbols/min [2025-10-10T18:18:25.912903] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-10T18:18:26.073139] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:18:26.134947] [DEBUG] [LOCAL ] CWAN: Loaded 52841 existing records from primary storage. [2025-10-10T18:18:26.135368] [INFO ] [MAIN ] CWAN: Loaded 52841 existing records. [2025-10-10T18:18:26.339630] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:18:26.340117] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-10T18:18:26.340243] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-10T18:18:26.340547] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-10T18:18:26.340608] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-10T18:18:26.723392] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:18:26.731766] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-10T18:18:26.735924] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T18:18:26.773980] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-10T18:18:27.489376] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-10T18:18:28.267236] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-10T18:18:28.289359] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-10T18:18:28.729710] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T18:18:29.089407] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-10T18:18:29.679511] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-10T18:18:29.889469] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-10T18:18:30.538202] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-10T18:18:30.567246] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-10T18:18:30.689365] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-10T18:18:31.489354] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-10T18:18:31.574381] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-10T18:18:31.579505] [INFO ] [REMOTE ] CVS: Full fetch complete (77811 records). [2025-10-10T18:18:31.579630] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-10T18:18:31.971103] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-10T18:18:31.971297] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-10T18:18:31.972299] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-10T18:18:31.972363] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-10T18:18:31.973921] [DEBUG] [LOCAL ] CVS: Trimmed 77811 records to 54474 (keeping 200 days of data) [2025-10-10T18:18:32.293451] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-10T18:18:32.330870] [DEBUG] [LOCAL ] CVS: Primary data saved (54474 records). [2025-10-10T18:18:32.331118] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-10T18:18:32.331782] [INFO ] [MAIN ] Update Progress: 569/2373 symbols completed. CVS took 38.2s. Estimated remaining: 4h 8m 48s. Rate: 7.3 symbols/min [2025-10-10T18:18:32.507266] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-10T18:18:32.587886] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:18:32.588118] [DEBUG] [LOCAL ] CWEN: No existing data file found in primary storage. [2025-10-10T18:18:32.588158] [WARN ] [MAIN ] CWEN: No existing data found, performing full refresh instead. [2025-10-10T18:18:32.588322] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-10T18:18:32.588381] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-10T18:18:32.588432] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-10T18:18:32.588467] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-10T18:18:32.964912] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:18:33.089339] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-10T18:18:33.119854] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T18:18:33.584296] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T18:18:33.889426] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-10T18:18:34.689351] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-10T18:18:35.183019] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T18:18:35.489361] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-10T18:18:35.575358] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-10T18:18:36.289377] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-10T18:18:36.472286] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T18:18:36.983576] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-10T18:18:37.089404] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-10T18:18:37.361703] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T18:18:37.889404] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-10T18:18:38.366292] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T18:18:38.368820] [INFO ] [REMOTE ] CW: Full fetch complete (33021 records). [2025-10-10T18:18:38.368918] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-10T18:18:38.694718] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-10T18:18:38.766697] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-10T18:18:38.766798] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-10T18:18:38.767562] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-10T18:18:38.767604] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-10T18:18:38.768548] [DEBUG] [LOCAL ] CW: Trimmed 33021 records to 22494 (keeping 200 days of data) [2025-10-10T18:18:38.909437] [DEBUG] [LOCAL ] CW: Primary data saved (22494 records). [2025-10-10T18:18:38.909581] [INFO ] [MAIN ] CW: Full history saved. [2025-10-10T18:18:38.909687] [INFO ] [MAIN ] Update Progress: 570/2373 symbols completed. CW took 23.9s. Estimated remaining: 4h 8m 34s. Rate: 7.3 symbols/min [2025-10-10T18:18:39.074239] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:18:39.128733] [DEBUG] [LOCAL ] CWH: Loaded 51673 existing records from primary storage. [2025-10-10T18:18:39.129120] [INFO ] [MAIN ] CWH: Loaded 51673 existing records. [2025-10-10T18:18:39.313231] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:18:39.313567] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-10T18:18:39.313631] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-10T18:18:39.314069] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-10T18:18:39.314124] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-10T18:18:39.497213] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-10T18:18:39.677069] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:18:39.756309] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T18:18:39.894010] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-10T18:18:40.289493] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-10T18:18:41.089377] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-10T18:18:41.612845] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T18:18:41.889346] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-10T18:18:41.965740] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-10T18:18:41.970942] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-10-10T18:18:41.971073] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-10T18:18:42.365495] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-10T18:18:42.365584] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-10T18:18:42.366508] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-10T18:18:42.366574] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-10T18:18:42.368046] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 54540 (keeping 200 days of data) [2025-10-10T18:18:42.697236] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-10T18:18:42.726378] [DEBUG] [LOCAL ] CVX: Primary data saved (54540 records). [2025-10-10T18:18:42.726543] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-10T18:18:42.727058] [INFO ] [MAIN ] Update Progress: 571/2373 symbols completed. CVX took 39.7s. Estimated remaining: 4h 8m 12s. Rate: 7.3 symbols/min [2025-10-10T18:18:42.902085] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:18:42.927243] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T18:18:42.977412] [DEBUG] [LOCAL ] CWK: Loaded 49798 existing records from primary storage. [2025-10-10T18:18:42.977775] [INFO ] [MAIN ] CWK: Loaded 49798 existing records. [2025-10-10T18:18:43.153216] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:18:43.153466] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-10T18:18:43.153514] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-10T18:18:43.153800] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-10T18:18:43.153858] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-10T18:18:43.496867] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-10T18:18:43.501362] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:18:43.768533] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T18:18:44.289376] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-10T18:18:44.376764] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T18:18:44.839518] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-10T18:18:45.089397] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-10T18:18:45.709992] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T18:18:45.889392] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-10T18:18:46.689435] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-10T18:18:46.821624] [DEBUG] [REMOTE ] CWH: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-10T18:18:46.822126] [WARN ] [REMOTE ] CWH: No data returned for month 2025-01 [2025-10-10T18:18:46.822257] [FATAL] [REMOTE ] CWH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:18:46.822367] [FATAL] [MAIN ] CWH: Failed to fetch primary data. [2025-10-10T18:18:46.822513] [WARN ] [MAIN ] CWH: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:18:46.822626] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-10T18:18:46.822785] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-10T18:18:46.822904] [INFO ] [LOCAL ] CWH: Starting deletion of derivative data. [2025-10-10T18:18:46.823165] [DEBUG] [LOCAL ] CWH: Deleted derivative data file. [2025-10-10T18:18:46.823321] [INFO ] [MAIN ] Update Progress: 572/2373 symbols completed. CWH took 7.9s. Estimated remaining: 4h 7m 50s. Rate: 7.3 symbols/min [2025-10-10T18:18:47.014983] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:18:47.045130] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T18:18:47.080394] [DEBUG] [LOCAL ] CWT: Loaded 28221 existing records from primary storage. [2025-10-10T18:18:47.080857] [INFO ] [MAIN ] CWT: Loaded 28221 existing records. [2025-10-10T18:18:47.265978] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:18:47.266313] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-10T18:18:47.266396] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-10T18:18:47.266760] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-10T18:18:47.266825] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-10T18:18:47.489446] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-10T18:18:47.666065] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:18:47.693240] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T18:18:48.289439] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-10T18:18:48.994349] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-10T18:18:49.089409] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-10T18:18:49.162218] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-10T18:18:49.889452] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-10T18:18:50.689379] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-10T18:18:50.765474] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-10T18:18:51.489476] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-10T18:18:51.754457] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T18:18:52.242892] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-10T18:18:52.289341] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-10T18:18:53.089353] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-10T18:18:53.303958] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T18:18:53.889409] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-10T18:18:54.462443] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T18:18:54.689439] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-10T18:18:54.845059] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T18:18:55.241217] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-10T18:18:55.489408] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-10T18:18:56.060625] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T18:18:56.289412] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-10T18:18:57.089405] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-10T18:18:57.171940] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T18:18:57.889401] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-10T18:18:58.094157] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T18:18:58.689356] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-10T18:18:58.912515] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T18:18:59.386560] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-10T18:18:59.489456] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-10T18:19:00.289377] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-10T18:19:00.529663] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-10T18:19:00.535623] [INFO ] [REMOTE ] CWEN: Full fetch complete (65025 records). [2025-10-10T18:19:00.535856] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-10T18:19:00.879887] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-10T18:19:00.983554] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-10T18:19:00.983697] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-10T18:19:00.984692] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-10T18:19:00.984759] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-10T18:19:00.986317] [DEBUG] [LOCAL ] CWEN: Trimmed 65025 records to 45951 (keeping 200 days of data) [2025-10-10T18:19:01.090406] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-10T18:19:01.282495] [DEBUG] [LOCAL ] CWEN: Primary data saved (45951 records). [2025-10-10T18:19:01.282687] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-10T18:19:01.282807] [INFO ] [MAIN ] Update Progress: 573/2373 symbols completed. CWEN took 29.0s. Estimated remaining: 4h 8m 1s. Rate: 7.3 symbols/min [2025-10-10T18:19:01.453982] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:19:01.514616] [DEBUG] [LOCAL ] CX: Loaded 53201 existing records from primary storage. [2025-10-10T18:19:01.515032] [INFO ] [MAIN ] CX: Loaded 53201 existing records. [2025-10-10T18:19:01.691814] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:19:01.692107] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-10T18:19:01.692155] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-10T18:19:01.692438] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-10T18:19:01.692496] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-10T18:19:01.896029] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-10T18:19:02.068562] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:19:02.307870] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-10T18:19:02.315403] [INFO ] [REMOTE ] CWAN: Full fetch complete (75191 records). [2025-10-10T18:19:02.315750] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-10T18:19:02.697315] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-10T18:19:02.876122] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-10T18:19:02.876285] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-10T18:19:02.878267] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-10T18:19:02.878598] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-10T18:19:02.882676] [DEBUG] [LOCAL ] CWAN: Trimmed 75191 records to 53226 (keeping 200 days of data) [2025-10-10T18:19:03.113038] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T18:19:03.413013] [DEBUG] [LOCAL ] CWAN: Primary data saved (53226 records). [2025-10-10T18:19:03.413203] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-10T18:19:03.414023] [INFO ] [MAIN ] Update Progress: 574/2373 symbols completed. CWAN took 37.5s. Estimated remaining: 4h 7m 34s. Rate: 7.3 symbols/min [2025-10-10T18:19:03.492027] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-10T18:19:03.598153] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:19:03.628035] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T18:19:03.643483] [DEBUG] [LOCAL ] CXE: Loaded 6217 existing records from primary storage. [2025-10-10T18:19:03.644429] [INFO ] [MAIN ] CXE: Loaded 6217 existing records. [2025-10-10T18:19:03.825482] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:19:03.825789] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-10T18:19:03.825848] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-10T18:19:03.826381] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-10T18:19:03.826440] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-10T18:19:04.175284] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:19:04.289379] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-10T18:19:04.352292] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-10T18:19:05.089407] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-10T18:19:05.317583] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-10T18:19:05.462580] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T18:19:05.889396] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-10T18:19:06.458426] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-10T18:19:06.689354] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-10T18:19:07.238766] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-10T18:19:07.489396] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-10T18:19:07.653605] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T18:19:08.289382] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-10T18:19:09.089366] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-10T18:19:09.698705] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-10T18:19:09.744930] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-10T18:19:09.889376] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-10T18:19:10.028472] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-10T18:19:10.689434] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-10T18:19:11.489387] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-10T18:19:11.991533] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T18:19:12.289365] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-10T18:19:12.605005] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T18:19:12.943302] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-10T18:19:13.089407] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-10T18:19:13.729895] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T18:19:13.889378] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-10T18:19:14.689342] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-10T18:19:15.311948] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-10T18:19:15.341402] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T18:19:15.489405] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-10T18:19:15.597807] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-10T18:19:16.289435] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-10T18:19:16.851285] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-10T18:19:17.089428] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-10T18:19:17.889384] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-10T18:19:18.428330] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T18:19:18.466453] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-10T18:19:18.511108] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-10T18:19:18.689391] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-10T18:19:19.489401] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-10T18:19:20.086931] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-10T18:19:20.205214] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-10T18:19:20.289425] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-10T18:19:21.089417] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-10T18:19:21.889390] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-10T18:19:22.178480] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-10T18:19:22.183326] [INFO ] [REMOTE ] CWK: Full fetch complete (71019 records). [2025-10-10T18:19:22.183438] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-10T18:19:22.558037] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-10T18:19:22.607580] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-10T18:19:22.607714] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-10T18:19:22.608847] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-10T18:19:22.608938] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-10T18:19:22.610628] [DEBUG] [LOCAL ] CWK: Trimmed 71019 records to 50175 (keeping 200 days of data) [2025-10-10T18:19:22.697390] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-10T18:19:22.905044] [DEBUG] [LOCAL ] CWK: Primary data saved (50175 records). [2025-10-10T18:19:22.905196] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-10T18:19:22.905279] [INFO ] [MAIN ] Update Progress: 575/2373 symbols completed. CWK took 40.2s. Estimated remaining: 4h 8m 1s. Rate: 7.2 symbols/min [2025-10-10T18:19:23.071249] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:19:23.078203] [DEBUG] [LOCAL ] CXH: Loaded 4438 existing records from primary storage. [2025-10-10T18:19:23.078407] [INFO ] [MAIN ] CXH: Loaded 4438 existing records. [2025-10-10T18:19:23.251935] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:19:23.252212] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-10T18:19:23.252258] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-10T18:19:23.252462] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-10T18:19:23.252519] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-10T18:19:23.490028] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-10T18:19:23.629920] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:19:23.716017] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T18:19:24.230569] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-10T18:19:24.233891] [INFO ] [REMOTE ] CWT: Full fetch complete (40811 records). [2025-10-10T18:19:24.234220] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-10T18:19:24.296432] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-10T18:19:24.342930] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-10T18:19:24.666686] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-10T18:19:24.666796] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-10T18:19:24.667685] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-10T18:19:24.667751] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-10T18:19:24.668912] [DEBUG] [LOCAL ] CWT: Trimmed 40811 records to 28469 (keeping 200 days of data) [2025-10-10T18:19:24.843961] [DEBUG] [LOCAL ] CWT: Primary data saved (28469 records). [2025-10-10T18:19:24.844118] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-10T18:19:24.844207] [INFO ] [MAIN ] Update Progress: 576/2373 symbols completed. CWT took 38.0s. Estimated remaining: 4h 7m 33s. Rate: 7.3 symbols/min [2025-10-10T18:19:25.012104] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:19:25.054719] [DEBUG] [LOCAL ] CXM: Loaded 47926 existing records from primary storage. [2025-10-10T18:19:25.055094] [INFO ] [MAIN ] CXM: Loaded 47926 existing records. [2025-10-10T18:19:25.095530] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-10T18:19:25.105333] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-10T18:19:25.237073] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:19:25.237356] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-10T18:19:25.237406] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-10T18:19:25.237626] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-10T18:19:25.237712] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-10T18:19:25.586597] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:19:25.889381] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-10T18:19:26.689426] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-10T18:19:27.359689] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-10T18:19:27.489360] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-10T18:19:27.546177] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-10T18:19:27.637031] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-10T18:19:28.289443] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-10T18:19:28.852984] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-10T18:19:29.089358] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-10T18:19:29.383732] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T18:19:29.889412] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-10T18:19:30.689340] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-10T18:19:30.822619] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-10T18:19:30.822407] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T18:19:31.489415] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-10T18:19:32.289402] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-10T18:19:32.695162] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T18:19:33.089452] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-10T18:19:33.109418] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-10T18:19:33.142737] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-10T18:19:33.889365] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-10T18:19:34.689428] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-10T18:19:34.924668] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-10T18:19:34.929877] [INFO ] [REMOTE ] CX: Full fetch complete (76378 records). [2025-10-10T18:19:34.930027] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-10T18:19:35.285635] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-10T18:19:35.353624] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-10T18:19:35.353792] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-10T18:19:35.355134] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-10T18:19:35.355220] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-10T18:19:35.385938] [DEBUG] [LOCAL ] CX: Trimmed 76378 records to 53583 (keeping 200 days of data) [2025-10-10T18:19:35.387576] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T18:19:35.502186] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-10T18:19:35.724452] [DEBUG] [LOCAL ] CX: Primary data saved (53583 records). [2025-10-10T18:19:35.724627] [INFO ] [MAIN ] CX: Full history saved. [2025-10-10T18:19:35.725607] [INFO ] [MAIN ] Update Progress: 577/2373 symbols completed. CX took 34.4s. Estimated remaining: 4h 7m 33s. Rate: 7.3 symbols/min [2025-10-10T18:19:35.898487] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:19:35.936997] [DEBUG] [LOCAL ] CXT: Loaded 31255 existing records from primary storage. [2025-10-10T18:19:35.937340] [INFO ] [MAIN ] CXT: Loaded 31255 existing records. [2025-10-10T18:19:36.110270] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:19:36.110542] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-10T18:19:36.110590] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-10T18:19:36.110917] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-10T18:19:36.110976] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-10T18:19:36.295771] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-10T18:19:36.461388] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:19:37.089419] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-10T18:19:37.356946] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-10T18:19:37.358870] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T18:19:37.889405] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-10T18:19:38.519315] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T18:19:38.520672] [INFO ] [REMOTE ] CXE: Full fetch complete (11580 records). [2025-10-10T18:19:38.520749] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-10T18:19:38.690529] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-10T18:19:38.918396] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-10T18:19:38.918583] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-10T18:19:38.919073] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-10T18:19:38.919956] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-10T18:19:38.920886] [DEBUG] [LOCAL ] CXE: Trimmed 11580 records to 6249 (keeping 200 days of data) [2025-10-10T18:19:38.963921] [DEBUG] [LOCAL ] CXE: Primary data saved (6249 records). [2025-10-10T18:19:38.964113] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-10T18:19:38.964225] [INFO ] [MAIN ] Update Progress: 578/2373 symbols completed. CXE took 35.6s. Estimated remaining: 4h 7m 9s. Rate: 7.3 symbols/min [2025-10-10T18:19:39.152068] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:19:39.201505] [DEBUG] [LOCAL ] CXW: Loaded 44278 existing records from primary storage. [2025-10-10T18:19:39.201878] [INFO ] [MAIN ] CXW: Loaded 44278 existing records. [2025-10-10T18:19:39.392841] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:19:39.393117] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-10T18:19:39.393168] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-10T18:19:39.393562] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-10T18:19:39.393622] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-10T18:19:39.494555] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-10T18:19:39.811217] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:19:39.817673] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-10T18:19:40.265010] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-10T18:19:40.289340] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-10T18:19:40.361272] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-10T18:19:41.001684] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-10T18:19:41.089381] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-10T18:19:41.889397] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-10T18:19:42.015098] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-10T18:19:42.689401] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-10T18:19:43.374102] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-10T18:19:43.483109] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T18:19:43.490601] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-10T18:19:44.289415] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-10T18:19:45.089403] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-10T18:19:45.277680] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T18:19:45.879623] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T18:19:45.889348] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-10T18:19:46.689383] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-10T18:19:46.769086] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T18:19:47.489420] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-10T18:19:47.731041] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-10T18:19:48.289366] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-10T18:19:48.380073] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T18:19:49.089408] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-10T18:19:49.315811] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-10T18:19:49.486019] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T18:19:49.889388] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-10T18:19:49.954971] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-10T18:19:50.689422] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-10T18:19:51.185374] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T18:19:51.489413] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-10T18:19:52.289395] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-10T18:19:52.503812] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T18:19:52.726029] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-10T18:19:52.727057] [INFO ] [REMOTE ] CXH: Full fetch complete (5361 records). [2025-10-10T18:19:52.727128] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-10T18:19:53.096235] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-10T18:19:53.090415] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-10T18:19:53.097564] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-10T18:19:53.097907] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-10T18:19:53.097973] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-10T18:19:53.098587] [DEBUG] [LOCAL ] CXH: Trimmed 5361 records to 4448 (keeping 200 days of data) [2025-10-10T18:19:53.127938] [DEBUG] [LOCAL ] CXH: Primary data saved (4448 records). [2025-10-10T18:19:53.128088] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-10T18:19:53.128197] [INFO ] [MAIN ] Update Progress: 579/2373 symbols completed. CXH took 30.2s. Estimated remaining: 4h 7m 19s. Rate: 7.3 symbols/min [2025-10-10T18:19:53.301083] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T18:19:53.327086] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:19:53.333826] [DEBUG] [LOCAL ] CYD: No existing data file found in primary storage. [2025-10-10T18:19:53.334102] [WARN ] [MAIN ] CYD: No existing data found, performing full refresh instead. [2025-10-10T18:19:53.334321] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-10T18:19:53.334368] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-10T18:19:53.334698] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-10T18:19:53.334746] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-10T18:19:53.696356] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:19:53.889401] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-10T18:19:54.654525] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-10T18:19:54.689353] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-10T18:19:54.833208] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-10T18:19:55.489390] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-10T18:19:56.237946] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-10T18:19:56.289373] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-10T18:19:56.706121] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T18:19:57.089405] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-10T18:19:57.832430] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-10T18:19:57.889402] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-10T18:19:58.689366] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-10T18:19:59.017990] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-10T18:19:59.281727] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T18:19:59.489382] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-10T18:20:00.073039] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T18:20:00.079132] [INFO ] [REMOTE ] CXM: Full fetch complete (68599 records). [2025-10-10T18:20:00.079340] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-10T18:20:00.299202] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-10T18:20:00.504819] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-10T18:20:00.504954] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-10T18:20:00.506163] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-10T18:20:00.506316] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-10T18:20:00.508337] [DEBUG] [LOCAL ] CXM: Trimmed 68599 records to 48285 (keeping 200 days of data) [2025-10-10T18:20:00.797403] [DEBUG] [LOCAL ] CXM: Primary data saved (48285 records). [2025-10-10T18:20:00.797561] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-10T18:20:00.797684] [INFO ] [MAIN ] Update Progress: 580/2373 symbols completed. CXM took 36.0s. Estimated remaining: 4h 7m 9s. Rate: 7.3 symbols/min [2025-10-10T18:20:00.978800] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:20:01.025361] [DEBUG] [LOCAL ] CYH: Loaded 47995 existing records from primary storage. [2025-10-10T18:20:01.025823] [INFO ] [MAIN ] CYH: Loaded 47995 existing records. [2025-10-10T18:20:01.092127] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-10T18:20:01.233398] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:20:01.244539] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-10T18:20:01.244626] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-10T18:20:01.246276] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-10T18:20:01.246198] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-10T18:20:01.246495] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-10T18:20:01.624554] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:20:01.722487] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-10T18:20:01.889386] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-10T18:20:02.471599] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T18:20:02.689414] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-10T18:20:03.328316] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-10T18:20:03.489422] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-10T18:20:04.289408] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-10T18:20:04.326586] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-10T18:20:05.089393] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-10T18:20:05.389687] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T18:20:05.733025] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-10T18:20:05.889401] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-10T18:20:06.689392] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-10T18:20:06.818830] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T18:20:07.114121] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T18:20:07.489390] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-10T18:20:08.289355] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-10T18:20:08.415706] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T18:20:09.089390] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-10T18:20:09.136202] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-10T18:20:09.709514] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-10T18:20:09.889381] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-10T18:20:10.689401] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-10T18:20:10.924795] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T18:20:11.328400] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T18:20:11.332616] [INFO ] [REMOTE ] CXT: Full fetch complete (45382 records). [2025-10-10T18:20:11.332936] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-10T18:20:11.490922] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-10T18:20:11.835664] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-10T18:20:11.835829] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-10T18:20:11.836969] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-10T18:20:11.837059] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-10T18:20:11.838726] [DEBUG] [LOCAL ] CXT: Trimmed 45382 records to 31466 (keeping 200 days of data) [2025-10-10T18:20:12.052433] [DEBUG] [LOCAL ] CXT: Primary data saved (31466 records). [2025-10-10T18:20:12.052622] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-10T18:20:12.052768] [INFO ] [MAIN ] Update Progress: 581/2373 symbols completed. CXT took 36.3s. Estimated remaining: 4h 7m 10s. Rate: 7.3 symbols/min [2025-10-10T18:20:12.244213] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:20:12.297703] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-10T18:20:12.302191] [DEBUG] [LOCAL ] D: Loaded 54037 existing records from primary storage. [2025-10-10T18:20:12.302753] [INFO ] [MAIN ] D: Loaded 54037 existing records. [2025-10-10T18:20:12.489087] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-10T18:20:12.522455] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:20:12.526760] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-10T18:20:12.526823] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-10T18:20:12.527228] [INFO ] [REMOTE ] CXW: Full fetch complete (64875 records). [2025-10-10T18:20:12.527316] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-10T18:20:12.533194] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-10T18:20:12.571259] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-10T18:20:13.332916] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:20:13.363369] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T18:20:13.365514] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-10T18:20:13.394451] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-10T18:20:13.395011] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-10T18:20:13.396142] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-10T18:20:13.396306] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-10T18:20:13.398430] [DEBUG] [LOCAL ] CXW: Trimmed 64875 records to 44569 (keeping 200 days of data) [2025-10-10T18:20:13.697529] [DEBUG] [LOCAL ] CXW: Primary data saved (44569 records). [2025-10-10T18:20:13.697720] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-10T18:20:13.697825] [INFO ] [MAIN ] Update Progress: 582/2373 symbols completed. CXW took 34.7s. Estimated remaining: 4h 6m 41s. Rate: 7.3 symbols/min [2025-10-10T18:20:13.865968] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:20:13.882559] [DEBUG] [LOCAL ] DAC: Loaded 12658 existing records from primary storage. [2025-10-10T18:20:13.882863] [INFO ] [MAIN ] DAC: Loaded 12658 existing records. [2025-10-10T18:20:13.907026] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-10T18:20:14.083821] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:20:14.084136] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-10T18:20:14.084239] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-10T18:20:14.084561] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-10T18:20:14.084619] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-10T18:20:14.503732] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:20:14.507336] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-10T18:20:14.689433] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-10T18:20:15.399570] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-10T18:20:15.489372] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-10T18:20:15.631185] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-10T18:20:16.083638] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-10T18:20:16.289389] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-10T18:20:17.071191] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-10T18:20:17.089332] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-10T18:20:17.597969] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-10T18:20:17.889430] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-10T18:20:18.169524] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-10T18:20:18.565083] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-10T18:20:18.689393] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-10T18:20:19.489426] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-10T18:20:20.289402] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-10T18:20:20.573136] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T18:20:20.645488] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T18:20:21.089441] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-10T18:20:21.609633] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T18:20:21.612777] [INFO ] [REMOTE ] CYD: Full fetch complete (34448 records). [2025-10-10T18:20:21.612868] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-10T18:20:21.898584] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-10T18:20:22.074019] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-10T18:20:22.074151] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-10T18:20:22.075016] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-10T18:20:22.075100] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-10T18:20:22.076694] [DEBUG] [LOCAL ] CYD: Trimmed 34448 records to 26901 (keeping 200 days of data) [2025-10-10T18:20:22.256338] [DEBUG] [LOCAL ] CYD: Primary data saved (26901 records). [2025-10-10T18:20:22.256506] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-10T18:20:22.256588] [INFO ] [MAIN ] Update Progress: 583/2373 symbols completed. CYD took 29.1s. Estimated remaining: 4h 6m 34s. Rate: 7.3 symbols/min [2025-10-10T18:20:22.435421] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:20:22.499365] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-10-10T18:20:22.499779] [INFO ] [MAIN ] DAL: Loaded 54143 existing records. [2025-10-10T18:20:22.693547] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-10T18:20:22.697585] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:20:22.699233] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-10T18:20:22.699290] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-10T18:20:22.699538] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-10T18:20:22.699597] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-10T18:20:23.070548] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:20:23.489397] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-10T18:20:23.799723] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-10T18:20:24.110709] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-10T18:20:24.289380] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-10T18:20:25.089386] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-10T18:20:25.282970] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T18:20:25.496908] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T18:20:25.889418] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-10T18:20:26.185467] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (5.10 seconds). [2025-10-10T18:20:26.689389] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-10T18:20:27.151231] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-10T18:20:27.489566] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-10T18:20:27.489434] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-10T18:20:28.289347] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-10T18:20:28.347371] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-10T18:20:29.059410] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T18:20:29.089339] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-10T18:20:29.477492] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-10T18:20:29.889396] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-10T18:20:30.689400] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-10T18:20:31.215226] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T18:20:31.489460] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-10T18:20:32.005562] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-10T18:20:32.289432] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-10T18:20:32.435238] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-10T18:20:32.727590] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T18:20:33.089422] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-10T18:20:33.889374] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-10T18:20:34.251756] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T18:20:34.462101] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-10T18:20:34.689347] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-10T18:20:35.489410] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-10T18:20:36.068955] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-10T18:20:36.289360] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-10T18:20:36.739785] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-10T18:20:36.823851] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T18:20:37.089401] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-10T18:20:37.889399] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-10T18:20:38.689419] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-10T18:20:38.945902] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T18:20:38.987193] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-10T18:20:39.467540] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-10T18:20:39.499288] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-10T18:20:39.507489] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-10T18:20:40.289355] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-10T18:20:40.430878] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T18:20:40.432853] [INFO ] [REMOTE ] DAC: Full fetch complete (19368 records). [2025-10-10T18:20:40.432927] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-10T18:20:40.820868] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-10T18:20:40.820960] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-10T18:20:40.821675] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-10T18:20:40.821740] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-10T18:20:40.822406] [DEBUG] [LOCAL ] DAC: Trimmed 19368 records to 12754 (keeping 200 days of data) [2025-10-10T18:20:40.906636] [DEBUG] [LOCAL ] DAC: Primary data saved (12754 records). [2025-10-10T18:20:40.906874] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-10T18:20:40.906981] [INFO ] [MAIN ] Update Progress: 584/2373 symbols completed. DAC took 27.2s. Estimated remaining: 4h 6m 57s. Rate: 7.2 symbols/min [2025-10-10T18:20:41.079405] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:20:41.089440] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-10T18:20:41.141537] [DEBUG] [LOCAL ] DAN: Loaded 49495 existing records from primary storage. [2025-10-10T18:20:41.142085] [INFO ] [MAIN ] DAN: Loaded 49495 existing records. [2025-10-10T18:20:41.328007] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:20:41.328259] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-10T18:20:41.328323] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-10T18:20:41.328711] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-10T18:20:41.328769] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-10T18:20:41.708704] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:20:41.889400] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-10T18:20:42.689358] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-10T18:20:42.774512] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-10T18:20:43.246081] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-10T18:20:43.489420] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-10T18:20:43.922904] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-10T18:20:44.289457] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-10T18:20:44.513779] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-10T18:20:44.518271] [INFO ] [REMOTE ] CYH: Full fetch complete (69768 records). [2025-10-10T18:20:44.518391] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-10T18:20:44.896910] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-10T18:20:44.896994] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-10T18:20:44.897851] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-10T18:20:44.897920] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-10T18:20:44.899241] [DEBUG] [LOCAL ] CYH: Trimmed 69768 records to 48319 (keeping 200 days of data) [2025-10-10T18:20:45.094897] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-10T18:20:45.179324] [DEBUG] [LOCAL ] CYH: Primary data saved (48319 records). [2025-10-10T18:20:45.179498] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-10T18:20:45.179618] [INFO ] [MAIN ] Update Progress: 585/2373 symbols completed. CYH took 44.4s. Estimated remaining: 4h 6m 37s. Rate: 7.3 symbols/min [2025-10-10T18:20:45.349846] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:20:45.370947] [DEBUG] [LOCAL ] DAO: Loaded 20161 existing records from primary storage. [2025-10-10T18:20:45.371304] [INFO ] [MAIN ] DAO: Loaded 20161 existing records. [2025-10-10T18:20:45.548233] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:20:45.548775] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-10T18:20:45.548950] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-10T18:20:45.549385] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-10T18:20:45.549485] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-10T18:20:45.950277] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-10T18:20:45.953464] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:20:45.964830] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-10T18:20:46.038831] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T18:20:46.689431] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-10T18:20:47.098231] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-10T18:20:47.308944] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T18:20:47.489393] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-10T18:20:48.289365] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-10T18:20:48.385889] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-10T18:20:48.736043] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T18:20:49.089410] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-10T18:20:49.889419] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-10T18:20:50.684070] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T18:20:50.690446] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-10T18:20:50.740927] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-10T18:20:51.489434] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-10T18:20:51.957399] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-10T18:20:52.075000] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-10T18:20:52.080138] [INFO ] [REMOTE ] D: Full fetch complete (77657 records). [2025-10-10T18:20:52.080281] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-10T18:20:52.294883] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-10T18:20:52.472950] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-10T18:20:52.473125] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-10T18:20:52.474217] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-10T18:20:52.474347] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-10T18:20:52.497868] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-10T18:20:52.498047] [DEBUG] [LOCAL ] D: Trimmed 77657 records to 54427 (keeping 200 days of data) [2025-10-10T18:20:52.841404] [DEBUG] [LOCAL ] D: Primary data saved (54427 records). [2025-10-10T18:20:52.841550] [INFO ] [MAIN ] D: Full history saved. [2025-10-10T18:20:52.842135] [INFO ] [MAIN ] Update Progress: 586/2373 symbols completed. D took 40.8s. Estimated remaining: 4h 6m 26s. Rate: 7.3 symbols/min [2025-10-10T18:20:53.008567] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:20:53.060914] [DEBUG] [LOCAL ] DAR: Loaded 52249 existing records from primary storage. [2025-10-10T18:20:53.061258] [INFO ] [MAIN ] DAR: Loaded 52249 existing records. [2025-10-10T18:20:53.094496] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-10T18:20:53.236870] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:20:53.237130] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-10T18:20:53.237183] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-10T18:20:53.237568] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-10T18:20:53.237623] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-10T18:20:53.583961] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:20:53.889347] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-10T18:20:54.366230] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-10T18:20:54.689339] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-10T18:20:55.468639] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-10T18:20:55.494571] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-10T18:20:55.525412] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-10T18:20:56.289355] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-10T18:20:56.659075] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T18:20:56.983906] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-10T18:20:57.089335] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-10T18:20:57.889369] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-10T18:20:58.386373] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T18:20:58.649037] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-10T18:20:58.689372] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-10T18:20:59.251076] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T18:20:59.489364] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-10T18:21:00.289390] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-10T18:21:01.089406] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-10T18:21:01.308248] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-10T18:21:01.314910] [INFO ] [REMOTE ] DAL: Full fetch complete (77824 records). [2025-10-10T18:21:01.315143] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-10T18:21:01.598866] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T18:21:01.827919] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-10T18:21:01.885357] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-10T18:21:01.885513] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-10T18:21:01.887296] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-10T18:21:01.887374] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-10T18:21:01.889337] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-10T18:21:01.889597] [DEBUG] [LOCAL ] DAL: Trimmed 77824 records to 54533 (keeping 200 days of data) [2025-10-10T18:21:02.245945] [DEBUG] [LOCAL ] DAL: Primary data saved (54533 records). [2025-10-10T18:21:02.246217] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-10T18:21:02.246336] [INFO ] [MAIN ] Update Progress: 587/2373 symbols completed. DAL took 40.0s. Estimated remaining: 4h 6m 22s. Rate: 7.2 symbols/min [2025-10-10T18:21:02.424046] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:21:02.475706] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-10T18:21:02.500141] [DEBUG] [LOCAL ] DAVA: Loaded 41762 existing records from primary storage. [2025-10-10T18:21:02.500495] [INFO ] [MAIN ] DAVA: Loaded 41762 existing records. [2025-10-10T18:21:02.684332] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:21:02.684668] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-10T18:21:02.684732] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-10T18:21:02.685187] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-10T18:21:02.685247] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-10T18:21:02.696943] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-10T18:21:03.054455] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:21:03.489376] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-10T18:21:03.794754] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T18:21:03.871714] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-10T18:21:04.289370] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-10T18:21:04.954426] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-10T18:21:05.089446] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-10T18:21:05.889373] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-10T18:21:06.306318] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T18:21:06.347826] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-10T18:21:06.689443] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-10T18:21:07.489425] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-10T18:21:07.825788] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T18:21:08.095024] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-10T18:21:08.289403] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-10T18:21:09.089367] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-10T18:21:09.405483] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T18:21:09.732565] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-10T18:21:09.889444] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-10T18:21:10.430349] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-10T18:21:10.689347] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-10T18:21:10.967538] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T18:21:10.969100] [INFO ] [REMOTE ] DAO: Full fetch complete (31986 records). [2025-10-10T18:21:10.969172] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-10T18:21:10.969596] [FATAL] [VALIDATOR ] DAO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:21:10.969698] [FATAL] [MAIN ] DAO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:21:10.969745] [WARN ] [MAIN ] DAO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:21:10.969784] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-10T18:21:10.969838] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-10T18:21:10.969876] [INFO ] [LOCAL ] DAO: Starting deletion of derivative data. [2025-10-10T18:21:10.970125] [DEBUG] [LOCAL ] DAO: Deleted derivative data file. [2025-10-10T18:21:10.970260] [INFO ] [MAIN ] Update Progress: 588/2373 symbols completed. DAO took 25.8s. Estimated remaining: 4h 6m 15s. Rate: 7.2 symbols/min [2025-10-10T18:21:11.160693] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:21:11.207693] [DEBUG] [LOCAL ] DAY: Loaded 49556 existing records from primary storage. [2025-10-10T18:21:11.208126] [INFO ] [MAIN ] DAY: Loaded 49556 existing records. [2025-10-10T18:21:11.401786] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:21:11.402088] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-10T18:21:11.402140] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-10T18:21:11.402452] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-10T18:21:11.402509] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-10T18:21:11.494581] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-10T18:21:11.797268] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:21:12.289400] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-10T18:21:12.525600] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-10T18:21:12.532928] [INFO ] [REMOTE ] DAN: Full fetch complete (70910 records). [2025-10-10T18:21:12.533257] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-10T18:21:12.925943] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-10T18:21:12.926063] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-10T18:21:12.927095] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-10T18:21:12.927161] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-10T18:21:12.928766] [DEBUG] [LOCAL ] DAN: Trimmed 70910 records to 49881 (keeping 200 days of data) [2025-10-10T18:21:13.102435] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-10T18:21:13.158805] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-10T18:21:13.253934] [DEBUG] [LOCAL ] DAN: Primary data saved (49881 records). [2025-10-10T18:21:13.254079] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-10T18:21:13.254790] [INFO ] [MAIN ] Update Progress: 589/2373 symbols completed. DAN took 32.3s. Estimated remaining: 4h 5m 48s. Rate: 7.3 symbols/min [2025-10-10T18:21:13.425237] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:21:13.483447] [DEBUG] [LOCAL ] DB: Loaded 52889 existing records from primary storage. [2025-10-10T18:21:13.483833] [INFO ] [MAIN ] DB: Loaded 52889 existing records. [2025-10-10T18:21:13.660964] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:21:13.661315] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-10T18:21:13.661533] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-10T18:21:13.661957] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-10T18:21:13.662019] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-10T18:21:13.913353] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-10T18:21:14.026305] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:21:14.055536] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T18:21:14.689345] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-10T18:21:15.070711] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T18:21:15.489469] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-10T18:21:15.676242] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T18:21:16.115038] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T18:21:16.289376] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-10T18:21:17.089343] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-10T18:21:17.417005] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-10T18:21:17.889379] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-10T18:21:18.245217] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T18:21:18.689350] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-10T18:21:18.719276] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T18:21:19.231821] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-10T18:21:19.489373] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-10T18:21:20.289365] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-10T18:21:20.507344] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-10T18:21:21.089407] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-10T18:21:21.303743] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T18:21:21.889398] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-10T18:21:22.171515] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T18:21:22.689367] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-10T18:21:22.940077] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T18:21:23.040878] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-10T18:21:23.489388] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-10T18:21:24.289427] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-10T18:21:24.814480] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-10T18:21:25.089380] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-10T18:21:25.446725] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T18:21:25.889439] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-10T18:21:26.253957] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T18:21:26.312006] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-10T18:21:26.689397] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-10T18:21:27.489426] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-10T18:21:27.633574] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T18:21:28.022245] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-10T18:21:28.289454] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-10T18:21:29.089418] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-10T18:21:29.885673] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-10T18:21:29.896669] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-10T18:21:30.320186] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T18:21:30.689417] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-10T18:21:31.051162] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T18:21:31.179086] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T18:21:31.489404] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-10T18:21:32.289400] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-10T18:21:32.851454] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T18:21:33.089441] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-10T18:21:33.300459] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-10T18:21:33.807718] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T18:21:33.889345] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-10T18:21:34.694508] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-10T18:21:34.710413] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-10T18:21:35.489398] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-10T18:21:35.667076] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T18:21:36.289372] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-10T18:21:36.601967] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-10T18:21:36.607184] [INFO ] [REMOTE ] DAR: Full fetch complete (74630 records). [2025-10-10T18:21:36.607372] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-10T18:21:37.000499] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-10T18:21:37.000591] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-10T18:21:37.001510] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-10T18:21:37.001571] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-10T18:21:37.003033] [DEBUG] [LOCAL ] DAR: Trimmed 74630 records to 52630 (keeping 200 days of data) [2025-10-10T18:21:37.091578] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-10T18:21:37.320125] [DEBUG] [LOCAL ] DAR: Primary data saved (52630 records). [2025-10-10T18:21:37.320287] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-10T18:21:37.320821] [INFO ] [MAIN ] Update Progress: 590/2373 symbols completed. DAR took 44.5s. Estimated remaining: 4h 6m 28s. Rate: 7.2 symbols/min [2025-10-10T18:21:37.491733] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:21:37.492094] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-10T18:21:37.492238] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-10T18:21:37.492489] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-10T18:21:37.492563] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-10T18:21:37.492697] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-10T18:21:37.492765] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-10T18:21:37.873750] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:21:37.875390] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-10T18:21:37.889329] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-10T18:21:38.391311] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-10T18:21:38.689373] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-10T18:21:39.032746] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-10T18:21:39.037449] [INFO ] [REMOTE ] DAVA: Full fetch complete (56600 records). [2025-10-10T18:21:39.037548] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-10T18:21:39.431540] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-10T18:21:39.431752] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-10T18:21:39.432838] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-10T18:21:39.432903] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-10T18:21:39.434243] [DEBUG] [LOCAL ] DAVA: Trimmed 56600 records to 42130 (keeping 200 days of data) [2025-10-10T18:21:39.493131] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-10T18:21:39.708291] [DEBUG] [LOCAL ] DAVA: Primary data saved (42130 records). [2025-10-10T18:21:39.708443] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-10T18:21:39.708526] [INFO ] [MAIN ] Update Progress: 591/2373 symbols completed. DAVA took 37.5s. Estimated remaining: 4h 6m 2s. Rate: 7.2 symbols/min [2025-10-10T18:21:39.940812] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:21:39.953062] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T18:21:40.000048] [DEBUG] [LOCAL ] DBI: Loaded 44574 existing records from primary storage. [2025-10-10T18:21:40.000484] [INFO ] [MAIN ] DBI: Loaded 44574 existing records. [2025-10-10T18:21:40.195408] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:21:40.195970] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-10T18:21:40.196049] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-10T18:21:40.208041] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-10T18:21:40.228399] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-10T18:21:40.292319] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-10T18:21:40.304077] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-10T18:21:40.629123] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:21:41.089372] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-10T18:21:41.321277] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-10T18:21:41.354769] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T18:21:41.889408] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-10T18:21:42.689414] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-10T18:21:42.773960] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T18:21:43.489357] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-10T18:21:43.600362] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-10T18:21:43.605670] [INFO ] [REMOTE ] DAY: Full fetch complete (71482 records). [2025-10-10T18:21:43.605890] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-10T18:21:43.912828] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-10T18:21:44.018508] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-10T18:21:44.018601] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-10T18:21:44.019533] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-10T18:21:44.019595] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-10T18:21:44.021105] [DEBUG] [LOCAL ] DAY: Trimmed 71482 records to 49936 (keeping 200 days of data) [2025-10-10T18:21:44.290320] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-10T18:21:44.309392] [DEBUG] [LOCAL ] DAY: Primary data saved (49936 records). [2025-10-10T18:21:44.309521] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-10T18:21:44.309607] [INFO ] [MAIN ] Update Progress: 592/2373 symbols completed. DAY took 33.3s. Estimated remaining: 4h 5m 42s. Rate: 7.2 symbols/min [2025-10-10T18:21:44.481774] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:21:44.481930] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-10-10T18:21:44.481968] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-10-10T18:21:44.482108] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-10T18:21:44.482171] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-10T18:21:44.482220] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-10T18:21:44.482254] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-10T18:21:44.836773] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:21:45.089357] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-10T18:21:45.199219] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T18:21:45.537817] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-10T18:21:45.889355] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-10T18:21:46.427914] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T18:21:46.689370] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-10T18:21:47.489450] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-10T18:21:47.516330] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-10T18:21:47.706115] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T18:21:48.289426] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-10T18:21:48.903586] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-10T18:21:49.089438] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-10T18:21:49.754509] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-10T18:21:49.889337] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-10T18:21:50.689369] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-10T18:21:51.030802] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-10T18:21:51.035985] [INFO ] [REMOTE ] DB: Full fetch complete (74860 records). [2025-10-10T18:21:51.036168] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-10T18:21:51.335750] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-10T18:21:51.471378] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-10T18:21:51.471468] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-10T18:21:51.472710] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-10T18:21:51.472781] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-10T18:21:51.474617] [DEBUG] [LOCAL ] DB: Trimmed 74860 records to 53277 (keeping 200 days of data) [2025-10-10T18:21:51.529293] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-10T18:21:51.800777] [DEBUG] [LOCAL ] DB: Primary data saved (53277 records). [2025-10-10T18:21:51.800937] [INFO ] [MAIN ] DB: Full history saved. [2025-10-10T18:21:51.801829] [INFO ] [MAIN ] Update Progress: 593/2373 symbols completed. DB took 38.5s. Estimated remaining: 4h 5m 32s. Rate: 7.2 symbols/min [2025-10-10T18:21:51.970565] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:21:52.017258] [DEBUG] [LOCAL ] DBRG: Loaded 50140 existing records from primary storage. [2025-10-10T18:21:52.017583] [INFO ] [MAIN ] DBRG: Loaded 50140 existing records. [2025-10-10T18:21:52.201194] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:21:52.201479] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-10T18:21:52.201533] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-10T18:21:52.201838] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-10T18:21:52.201897] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-10T18:21:52.299128] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-10T18:21:52.562837] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:21:52.590064] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T18:21:52.613003] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-10T18:21:53.082630] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-10T18:21:53.089327] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-10T18:21:53.889393] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-10T18:21:54.460219] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T18:21:54.689398] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-10T18:21:55.489365] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-10T18:21:55.790772] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T18:21:56.120203] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-10T18:21:56.280072] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-10T18:21:56.289322] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-10T18:21:57.089448] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-10T18:21:57.273162] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-10T18:21:57.889409] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-10T18:21:58.681001] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T18:21:58.695220] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-10T18:21:59.489397] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-10T18:21:59.704412] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T18:21:59.862457] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T18:22:00.289381] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-10T18:22:01.089357] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-10T18:22:01.331082] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T18:22:01.889362] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-10T18:22:02.325276] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T18:22:02.371170] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T18:22:02.689431] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-10T18:22:02.776278] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-10T18:22:03.489457] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-10T18:22:03.907205] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-10T18:22:03.909619] [INFO ] [REMOTE ] DBD: Full fetch complete (31140 records). [2025-10-10T18:22:03.909750] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-10T18:22:03.910221] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:22:03.910438] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:22:03.910527] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:22:03.910595] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-10T18:22:03.910709] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-10T18:22:03.910766] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-10T18:22:03.910811] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-10T18:22:03.910867] [INFO ] [MAIN ] Update Progress: 594/2373 symbols completed. DBD took 26.6s. Estimated remaining: 4h 5m 35s. Rate: 7.2 symbols/min [2025-10-10T18:22:04.082814] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:22:04.121115] [DEBUG] [LOCAL ] DCI: Loaded 37295 existing records from primary storage. [2025-10-10T18:22:04.121435] [INFO ] [MAIN ] DCI: Loaded 37295 existing records. [2025-10-10T18:22:04.238876] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-10T18:22:04.290244] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-10T18:22:04.331795] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:22:04.332103] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-10T18:22:04.332173] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-10T18:22:04.332470] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-10T18:22:04.332548] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-10T18:22:04.690803] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:22:05.089386] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-10T18:22:05.889438] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-10T18:22:06.293878] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-10T18:22:06.479618] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-10T18:22:06.514763] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T18:22:06.689392] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-10T18:22:07.489376] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-10T18:22:08.289412] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-10T18:22:08.341892] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T18:22:09.089456] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-10T18:22:09.200856] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T18:22:09.227258] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T18:22:09.889390] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-10T18:22:10.689341] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-10T18:22:11.160927] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-10T18:22:11.489466] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-10T18:22:11.517675] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T18:22:11.534038] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-10T18:22:12.289404] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-10T18:22:13.089418] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-10T18:22:13.349405] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T18:22:13.889373] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-10T18:22:13.931883] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T18:22:13.933218] [INFO ] [REMOTE ] DBL: Full fetch complete (12475 records). [2025-10-10T18:22:13.933293] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-10T18:22:13.933739] [FATAL] [VALIDATOR ] DBL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:22:13.933824] [FATAL] [MAIN ] DBL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:22:13.933890] [WARN ] [MAIN ] DBL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:22:13.933965] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-10T18:22:13.934035] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-10T18:22:13.934073] [INFO ] [LOCAL ] DBL: Starting deletion of derivative data. [2025-10-10T18:22:13.934114] [DEBUG] [LOCAL ] DBL: No derivative data file found to delete. [2025-10-10T18:22:13.934182] [INFO ] [MAIN ] Update Progress: 595/2373 symbols completed. DBL took 29.6s. Estimated remaining: 4h 5m 32s. Rate: 7.2 symbols/min [2025-10-10T18:22:14.160598] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:22:14.162807] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T18:22:14.188128] [DEBUG] [LOCAL ] DCO: Loaded 14031 existing records from primary storage. [2025-10-10T18:22:14.188412] [INFO ] [MAIN ] DCO: Loaded 14031 existing records. [2025-10-10T18:22:14.385733] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:22:14.386055] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-10T18:22:14.386111] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-10T18:22:14.386319] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-10T18:22:14.386361] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-10T18:22:14.696415] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-10T18:22:14.784904] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:22:15.489390] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-10T18:22:15.767037] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T18:22:16.289370] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-10T18:22:16.718358] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-10T18:22:16.785713] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T18:22:17.089372] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-10T18:22:17.889399] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-10T18:22:18.150039] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T18:22:18.154229] [INFO ] [REMOTE ] DBI: Full fetch complete (65430 records). [2025-10-10T18:22:18.154375] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-10T18:22:18.599547] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-10T18:22:18.599678] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-10T18:22:18.600555] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-10T18:22:18.600600] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-10T18:22:18.601906] [DEBUG] [LOCAL ] DBI: Trimmed 65430 records to 44863 (keeping 200 days of data) [2025-10-10T18:22:18.689988] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-10T18:22:18.835004] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T18:22:18.897459] [DEBUG] [LOCAL ] DBI: Primary data saved (44863 records). [2025-10-10T18:22:18.897610] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-10T18:22:18.897737] [INFO ] [MAIN ] Update Progress: 596/2373 symbols completed. DBI took 39.2s. Estimated remaining: 4h 5m 14s. Rate: 7.2 symbols/min [2025-10-10T18:22:19.063060] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:22:19.111192] [DEBUG] [LOCAL ] DD: Loaded 53236 existing records from primary storage. [2025-10-10T18:22:19.111531] [INFO ] [MAIN ] DD: Loaded 53236 existing records. [2025-10-10T18:22:19.286105] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:22:19.286434] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-10T18:22:19.286513] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-10T18:22:19.286882] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-10T18:22:19.287009] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-10T18:22:19.492501] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-10T18:22:19.627910] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T18:22:19.729118] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:22:20.006023] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T18:22:20.289375] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-10T18:22:20.816363] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-10T18:22:21.089378] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-10T18:22:21.889377] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-10T18:22:22.328693] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-10T18:22:22.654883] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T18:22:22.689336] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-10T18:22:23.489372] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-10T18:22:23.934036] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-10T18:22:24.289351] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-10T18:22:24.382280] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T18:22:24.827293] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T18:22:25.089387] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-10T18:22:25.889387] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-10T18:22:26.122063] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-10T18:22:26.224296] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T18:22:26.689428] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-10T18:22:27.489369] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-10T18:22:27.683178] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-10T18:22:27.903313] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-10T18:22:28.289386] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-10T18:22:29.089370] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-10T18:22:29.258890] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T18:22:29.334501] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T18:22:29.889370] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-10T18:22:30.689381] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-10T18:22:30.859999] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-10T18:22:30.865164] [INFO ] [REMOTE ] DBRG: Full fetch complete (72303 records). [2025-10-10T18:22:30.865325] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-10T18:22:30.970092] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-10T18:22:31.259408] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-10T18:22:31.259502] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-10T18:22:31.260450] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-10T18:22:31.260516] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-10T18:22:31.262186] [DEBUG] [LOCAL ] DBRG: Trimmed 72303 records to 50515 (keeping 200 days of data) [2025-10-10T18:22:31.496124] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-10T18:22:31.574297] [DEBUG] [LOCAL ] DBRG: Primary data saved (50515 records). [2025-10-10T18:22:31.574424] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-10T18:22:31.575094] [INFO ] [MAIN ] Update Progress: 597/2373 symbols completed. DBRG took 39.8s. Estimated remaining: 4h 5m 18s. Rate: 7.2 symbols/min [2025-10-10T18:22:32.185439] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T18:22:32.188928] [INFO ] [REMOTE ] DCI: Full fetch complete (53541 records). [2025-10-10T18:22:32.189044] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-10T18:22:32.291716] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-10T18:22:32.573968] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-10T18:22:32.574145] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-10T18:22:32.582063] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-10T18:22:32.581826] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-10T18:22:32.585072] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-10T18:22:32.586831] [DEBUG] [LOCAL ] DCI: Trimmed 53541 records to 37528 (keeping 200 days of data) [2025-10-10T18:22:32.811918] [DEBUG] [LOCAL ] DCI: Primary data saved (37528 records). [2025-10-10T18:22:32.812060] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-10T18:22:32.812156] [INFO ] [MAIN ] Update Progress: 598/2373 symbols completed. DCI took 28.9s. Estimated remaining: 4h 4m 49s. Rate: 7.3 symbols/min [2025-10-10T18:22:33.089366] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-10T18:22:34.031967] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T18:22:34.034850] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-10T18:22:34.436210] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T18:22:34.689468] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-10T18:22:35.165965] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-10T18:22:35.489370] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-10T18:22:36.679044] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T18:22:36.683570] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-10T18:22:36.955448] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-10T18:22:37.089418] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-10T18:22:37.893978] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T18:22:37.898316] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-10T18:22:39.216029] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-10T18:22:39.220261] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-10T18:22:39.762552] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-10T18:22:39.773904] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-10T18:22:39.912696] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T18:22:39.914470] [INFO ] [REMOTE ] DCO: Full fetch complete (19153 records). [2025-10-10T18:22:39.914542] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-10T18:22:40.287217] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-10T18:22:40.287341] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-10T18:22:40.287958] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-10T18:22:40.288038] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-10T18:22:40.288712] [DEBUG] [LOCAL ] DCO: Trimmed 19153 records to 14259 (keeping 200 days of data) [2025-10-10T18:22:40.376976] [DEBUG] [LOCAL ] DCO: Primary data saved (14259 records). [2025-10-10T18:22:40.377162] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-10T18:22:40.377270] [INFO ] [MAIN ] Update Progress: 599/2373 symbols completed. DCO took 26.4s. Estimated remaining: 4h 4m 39s. Rate: 7.3 symbols/min [2025-10-10T18:22:41.782500] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-10T18:22:41.793884] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-10T18:22:43.959765] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T18:22:43.971825] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-10T18:22:46.154664] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-10T18:22:46.166481] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-10T18:22:48.144557] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T18:22:48.158370] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-10T18:22:50.179864] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-10T18:22:50.185397] [INFO ] [REMOTE ] DD: Full fetch complete (76372 records). [2025-10-10T18:22:50.185614] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-10T18:22:50.611509] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-10T18:22:50.611609] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-10T18:22:50.612544] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-10T18:22:50.612621] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-10T18:22:50.614221] [DEBUG] [LOCAL ] DD: Trimmed 76372 records to 53623 (keeping 200 days of data) [2025-10-10T18:22:50.938672] [DEBUG] [LOCAL ] DD: Primary data saved (53623 records). [2025-10-10T18:22:50.938826] [INFO ] [MAIN ] DD: Full history saved. [2025-10-10T18:22:50.938912] [INFO ] [MAIN ] Update Progress: 600/2373 symbols completed. DD took 32.0s. Estimated remaining: 4h 4m 37s. Rate: 7.2 symbols/min [2025-10-10T18:22:51.620959] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:22:51.617763] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:22:51.592178] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:22:51.704735] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:22:51.722668] [DEBUG] [LOCAL ] DDT: Loaded 2096 existing records from primary storage. [2025-10-10T18:22:51.719958] [DEBUG] [LOCAL ] DDS: Loaded 12885 existing records from primary storage. [2025-10-10T18:22:51.723343] [INFO ] [MAIN ] DDT: Loaded 2096 existing records. [2025-10-10T18:22:51.734123] [INFO ] [MAIN ] DDS: Loaded 12885 existing records. [2025-10-10T18:22:51.975406] [DEBUG] [LOCAL ] DDL: Loaded 37060 existing records from primary storage. [2025-10-10T18:22:52.027629] [INFO ] [MAIN ] DDL: Loaded 37060 existing records. [2025-10-10T18:22:52.017731] [DEBUG] [LOCAL ] DDD: Loaded 51305 existing records from primary storage. [2025-10-10T18:22:52.054713] [INFO ] [MAIN ] DDD: Loaded 51305 existing records. [2025-10-10T18:22:52.301512] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:22:52.400921] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-10T18:22:52.376258] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:22:52.417369] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-10T18:22:52.417597] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-10T18:22:52.423741] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-10T18:22:52.423667] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-10T18:22:52.460591] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-10T18:22:52.485555] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-10T18:22:52.524798] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-10T18:22:52.640793] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:22:52.625555] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:22:52.701691] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-10T18:22:52.674769] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-10T18:22:52.739230] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-10T18:22:52.744555] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-10T18:22:52.771393] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-10T18:22:52.787402] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-10T18:22:52.793357] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-10T18:22:52.868713] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-10T18:22:53.994460] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:22:54.021719] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:22:54.035446] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-10T18:22:54.048481] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-10T18:22:54.099183] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:22:54.105318] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-10T18:22:54.171049] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:22:54.171439] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-10T18:23:06.567600] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (12.53 seconds). [2025-10-10T18:23:06.568902] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-10T18:23:07.284265] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (13.24 seconds). [2025-10-10T18:23:07.287770] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-10T18:23:07.907755] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T18:23:07.909079] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-10T18:23:07.971327] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (13.87 seconds). [2025-10-10T18:23:07.992843] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-10T18:23:08.010995] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (13.84 seconds). [2025-10-10T18:23:08.020843] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-10T18:23:08.436728] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-10T18:23:08.438098] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-10T18:23:08.525450] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T18:23:08.528560] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-10T18:23:09.080123] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-10T18:23:09.081476] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-10T18:23:09.401586] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-10T18:23:09.405195] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-10T18:23:09.525110] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-10T18:23:09.532597] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-10T18:23:09.647221] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T18:23:09.657577] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-10T18:23:09.784869] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-10T18:23:09.786494] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-10T18:23:10.084068] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-10T18:23:10.088089] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-10T18:23:10.337104] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-10T18:23:10.338237] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-10T18:23:10.894893] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-10T18:23:10.900193] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T18:23:10.900911] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-10T18:23:10.910401] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-10T18:23:10.926999] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-10T18:23:10.931832] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-10T18:23:11.054423] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-10T18:23:11.064499] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-10T18:23:11.487170] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-10T18:23:11.489095] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-10T18:23:12.110441] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-10T18:23:12.111903] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-10T18:23:12.124628] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-10T18:23:12.129391] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-10T18:23:12.427294] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-10T18:23:12.436384] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-10T18:23:12.642831] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-10T18:23:12.654000] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-10T18:23:12.685798] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-10T18:23:12.686943] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-10T18:23:13.125385] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-10T18:23:13.128538] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-10T18:23:13.154351] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-10T18:23:13.155018] [INFO ] [REMOTE ] DDT: Full fetch complete (2852 records). [2025-10-10T18:23:13.155084] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-10T18:23:13.495211] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-10T18:23:13.495288] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-10T18:23:13.495370] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-10T18:23:13.495409] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-10T18:23:13.495769] [DEBUG] [LOCAL ] DDT: Trimmed 2852 records to 2119 (keeping 200 days of data) [2025-10-10T18:23:13.509198] [DEBUG] [LOCAL ] DDT: Primary data saved (2119 records). [2025-10-10T18:23:13.509257] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-10T18:23:13.509324] [INFO ] [MAIN ] Update Progress: 601/2373 symbols completed. DDT took 22.6s. Estimated remaining: 4h 5m 11s. Rate: 7.2 symbols/min [2025-10-10T18:23:13.669884] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:23:13.712369] [DEBUG] [LOCAL ] DE: Loaded 47889 existing records from primary storage. [2025-10-10T18:23:13.712801] [INFO ] [MAIN ] DE: Loaded 47889 existing records. [2025-10-10T18:23:13.890843] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:23:13.891053] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-10T18:23:13.891099] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-10T18:23:13.891552] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-10T18:23:13.891609] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-10T18:23:14.274386] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:23:14.279242] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-10T18:23:14.283811] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T18:23:14.287810] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-10T18:23:14.403189] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T18:23:14.413916] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-10T18:23:14.673528] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T18:23:14.684538] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-10T18:23:15.112303] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-10T18:23:15.115917] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-10T18:23:16.215837] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-10T18:23:16.225518] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-10T18:23:16.285927] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T18:23:16.286278] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-10T18:23:16.300107] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-10T18:23:16.300893] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-10T18:23:16.769820] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-10T18:23:16.781614] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-10T18:23:17.226182] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T18:23:17.227739] [INFO ] [REMOTE ] DDS: Full fetch complete (18715 records). [2025-10-10T18:23:17.227817] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-10T18:23:17.228274] [FATAL] [VALIDATOR ] DDS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:23:17.228361] [FATAL] [MAIN ] DDS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:23:17.228406] [WARN ] [MAIN ] DDS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:23:17.228446] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-10T18:23:17.228511] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-10T18:23:17.228553] [INFO ] [LOCAL ] DDS: Starting deletion of derivative data. [2025-10-10T18:23:17.228918] [DEBUG] [LOCAL ] DDS: Deleted derivative data file. [2025-10-10T18:23:17.229022] [INFO ] [MAIN ] Update Progress: 602/2373 symbols completed. DDS took 26.3s. Estimated remaining: 4h 4m 49s. Rate: 7.2 symbols/min [2025-10-10T18:23:17.416841] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:23:17.417094] [DEBUG] [LOCAL ] DEA: No existing data file found in primary storage. [2025-10-10T18:23:17.417141] [WARN ] [MAIN ] DEA: No existing data found, performing full refresh instead. [2025-10-10T18:23:17.417307] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-10T18:23:17.417357] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-10T18:23:17.417401] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-10T18:23:17.417434] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-10T18:23:17.788527] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-10T18:23:17.822913] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-10T18:23:17.882735] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:23:17.883161] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-10T18:23:17.921457] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T18:23:17.932134] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-10T18:23:18.840539] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-10T18:23:18.851953] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-10T18:23:19.419504] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-10T18:23:19.426666] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-10T18:23:19.917442] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-10T18:23:19.927707] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-10T18:23:20.099018] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-10T18:23:20.109190] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-10T18:23:20.899955] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-10T18:23:20.904776] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-10T18:23:20.923031] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-10T18:23:20.925918] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-10T18:23:21.193741] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-10T18:23:21.203316] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-10T18:23:21.760910] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-10T18:23:21.889363] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-10T18:23:22.664945] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-10T18:23:22.689382] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-10T18:23:22.964622] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-10T18:23:23.007217] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T18:23:23.489383] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-10T18:23:23.905246] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T18:23:23.928801] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-10T18:23:23.933154] [INFO ] [REMOTE ] DDL: Full fetch complete (52880 records). [2025-10-10T18:23:23.933325] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-10T18:23:23.934140] [FATAL] [VALIDATOR ] DDL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:23:23.934235] [FATAL] [MAIN ] DDL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:23:23.934279] [WARN ] [MAIN ] DDL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:23:23.934321] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-10T18:23:23.934382] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-10-10T18:23:23.934466] [INFO ] [LOCAL ] DDL: Starting deletion of derivative data. [2025-10-10T18:23:23.934726] [DEBUG] [LOCAL ] DDL: Deleted derivative data file. [2025-10-10T18:23:23.934826] [INFO ] [MAIN ] Update Progress: 603/2373 symbols completed. DDL took 33.0s. Estimated remaining: 4h 4m 36s. Rate: 7.2 symbols/min [2025-10-10T18:23:24.100858] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:23:24.134811] [DEBUG] [LOCAL ] DEC: Loaded 30645 existing records from primary storage. [2025-10-10T18:23:24.135102] [INFO ] [MAIN ] DEC: Loaded 30645 existing records. [2025-10-10T18:23:24.302071] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-10T18:23:24.307023] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:23:24.308541] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-10T18:23:24.308595] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-10T18:23:24.309055] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-10T18:23:24.309113] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-10T18:23:24.653537] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:23:25.089402] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-10T18:23:25.362493] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T18:23:25.889411] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-10T18:23:26.346192] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-10T18:23:26.689411] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-10T18:23:27.123091] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T18:23:27.259125] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T18:23:27.489437] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-10T18:23:28.267852] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T18:23:28.289341] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-10T18:23:29.089385] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-10T18:23:29.155467] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-10T18:23:29.160841] [INFO ] [REMOTE ] DDD: Full fetch complete (73750 records). [2025-10-10T18:23:29.160993] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-10T18:23:29.593051] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-10T18:23:29.593165] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-10T18:23:29.594198] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-10T18:23:29.594272] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-10T18:23:29.596128] [DEBUG] [LOCAL ] DDD: Trimmed 73750 records to 51691 (keeping 200 days of data) [2025-10-10T18:23:29.901614] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-10T18:23:29.925092] [DEBUG] [LOCAL ] DDD: Primary data saved (51691 records). [2025-10-10T18:23:29.925285] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-10T18:23:29.925413] [INFO ] [MAIN ] Update Progress: 604/2373 symbols completed. DDD took 39.0s. Estimated remaining: 4h 4m 21s. Rate: 7.2 symbols/min [2025-10-10T18:23:30.107198] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:23:30.107536] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-10-10T18:23:30.107619] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-10-10T18:23:30.129890] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-10T18:23:30.130121] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-10T18:23:30.131807] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T18:23:30.131964] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-10T18:23:30.141005] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-10T18:23:30.489600] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:23:30.689342] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-10T18:23:30.845331] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T18:23:30.923469] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-10T18:23:31.489451] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-10T18:23:31.925764] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T18:23:32.289398] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-10T18:23:33.089385] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-10T18:23:33.483701] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T18:23:33.673992] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T18:23:33.889379] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-10T18:23:34.689353] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-10T18:23:34.874716] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T18:23:35.489414] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-10T18:23:36.141248] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-10T18:23:36.289450] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-10T18:23:36.774241] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T18:23:37.089409] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-10T18:23:37.175160] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T18:23:37.889363] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-10T18:23:38.314252] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T18:23:38.689397] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-10T18:23:38.889632] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T18:23:38.985381] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-10T18:23:39.489426] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-10T18:23:40.289400] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-10T18:23:40.941432] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-10T18:23:41.013458] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-10T18:23:41.089333] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-10T18:23:41.889360] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-10T18:23:42.310201] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-10T18:23:42.314969] [INFO ] [REMOTE ] DE: Full fetch complete (69470 records). [2025-10-10T18:23:42.315145] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-10T18:23:42.691791] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-10T18:23:42.714867] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-10T18:23:42.715024] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-10T18:23:42.715972] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-10T18:23:42.716091] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-10T18:23:42.736750] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T18:23:42.743879] [DEBUG] [LOCAL ] DE: Trimmed 69470 records to 48254 (keeping 200 days of data) [2025-10-10T18:23:43.098001] [DEBUG] [LOCAL ] DE: Primary data saved (48254 records). [2025-10-10T18:23:43.098233] [INFO ] [MAIN ] DE: Full history saved. [2025-10-10T18:23:43.098388] [INFO ] [MAIN ] Update Progress: 605/2373 symbols completed. DE took 29.6s. Estimated remaining: 4h 4m 27s. Rate: 7.2 symbols/min [2025-10-10T18:23:43.280023] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:23:43.280271] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-10-10T18:23:43.280309] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-10-10T18:23:43.280435] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-10T18:23:43.280476] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-10T18:23:43.280520] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-10T18:23:43.280553] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-10T18:23:43.503855] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-10T18:23:43.649145] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:23:44.183717] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-10T18:23:44.289403] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-10T18:23:44.548620] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T18:23:45.061394] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-10T18:23:45.089346] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-10T18:23:45.889416] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-10T18:23:46.459264] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T18:23:46.698124] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-10T18:23:46.725706] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-10T18:23:47.489414] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-10T18:23:47.577922] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T18:23:48.250075] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-10T18:23:48.289351] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-10T18:23:49.089397] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-10T18:23:49.421694] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T18:23:49.889411] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-10T18:23:49.934676] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-10T18:23:49.938734] [INFO ] [REMOTE ] DEC: Full fetch complete (43885 records). [2025-10-10T18:23:49.938917] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-10T18:23:50.359027] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-10T18:23:50.359144] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-10T18:23:50.359936] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-10T18:23:50.360000] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-10T18:23:50.361131] [DEBUG] [LOCAL ] DEC: Trimmed 43885 records to 30887 (keeping 200 days of data) [2025-10-10T18:23:50.565686] [DEBUG] [LOCAL ] DEC: Primary data saved (30887 records). [2025-10-10T18:23:50.565921] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-10T18:23:50.566046] [INFO ] [MAIN ] Update Progress: 606/2373 symbols completed. DEC took 26.6s. Estimated remaining: 4h 4m 17s. Rate: 7.2 symbols/min [2025-10-10T18:23:50.694486] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-10T18:23:50.755701] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:23:50.768341] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-10T18:23:50.773174] [INFO ] [REMOTE ] DEA: Full fetch complete (62037 records). [2025-10-10T18:23:50.773377] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-10T18:23:51.199495] [DEBUG] [LOCAL ] DELL: Loaded 54126 existing records from primary storage. [2025-10-10T18:23:51.244890] [INFO ] [MAIN ] DELL: Loaded 54126 existing records. [2025-10-10T18:23:51.308869] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-10T18:23:51.338138] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-10T18:23:51.357023] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-10T18:23:51.364956] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-10T18:23:51.401905] [DEBUG] [LOCAL ] DEA: Trimmed 62037 records to 41091 (keeping 200 days of data) [2025-10-10T18:23:51.527887] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:23:51.565491] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-10T18:23:51.567003] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-10T18:23:51.576881] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-10T18:23:51.577046] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-10T18:23:51.723830] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-10T18:23:51.776776] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-10T18:23:52.019858] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:23:52.174801] [DEBUG] [LOCAL ] DEA: Primary data saved (41091 records). [2025-10-10T18:23:52.174961] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-10T18:23:52.175063] [INFO ] [MAIN ] Update Progress: 607/2373 symbols completed. DEA took 34.9s. Estimated remaining: 4h 3m 49s. Rate: 7.2 symbols/min [2025-10-10T18:23:52.294615] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-10T18:23:52.350920] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:23:52.399568] [DEBUG] [LOCAL ] DEO: Loaded 49498 existing records from primary storage. [2025-10-10T18:23:52.399987] [INFO ] [MAIN ] DEO: Loaded 49498 existing records. [2025-10-10T18:23:52.591978] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:23:52.592220] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-10T18:23:52.592269] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-10T18:23:52.592726] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-10T18:23:52.592782] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-10T18:23:52.978114] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:23:53.096048] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-10T18:23:53.117258] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-10T18:23:53.547880] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T18:23:53.889393] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-10T18:23:54.689394] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-10T18:23:55.143882] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-10-10T18:23:55.334583] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-10T18:23:55.489367] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-10T18:23:56.112430] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-10T18:23:56.289346] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-10T18:23:56.622681] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-10T18:23:57.089358] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-10T18:23:57.815111] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-10T18:23:57.889478] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-10T18:23:58.374808] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-10T18:23:58.689351] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-10T18:23:58.871376] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-10T18:23:59.489366] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-10T18:23:59.917573] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-10T18:24:00.289387] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-10T18:24:00.741181] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T18:24:01.089403] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-10T18:24:01.744833] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-10T18:24:01.889449] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-10T18:24:02.689372] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-10T18:24:02.962993] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T18:24:03.170805] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-10-10T18:24:03.489385] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-10T18:24:03.492241] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-10T18:24:04.289409] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-10T18:24:04.646338] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T18:24:05.089384] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-10T18:24:05.889455] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-10T18:24:06.147765] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-10T18:24:06.306199] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T18:24:06.536420] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T18:24:06.541010] [INFO ] [REMOTE ] DECK: Full fetch complete (76413 records). [2025-10-10T18:24:06.541142] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-10T18:24:06.541866] [FATAL] [VALIDATOR ] DECK: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:24:06.541957] [FATAL] [MAIN ] DECK: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:24:06.542001] [WARN ] [MAIN ] DECK: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:24:06.542041] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-10T18:24:06.542549] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-10T18:24:06.542631] [INFO ] [LOCAL ] DECK: Starting deletion of derivative data. [2025-10-10T18:24:06.542741] [DEBUG] [LOCAL ] DECK: No derivative data file found to delete. [2025-10-10T18:24:06.542813] [INFO ] [MAIN ] Update Progress: 608/2373 symbols completed. DECK took 36.6s. Estimated remaining: 4h 3m 58s. Rate: 7.2 symbols/min [2025-10-10T18:24:06.691390] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-10T18:24:06.714189] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:24:06.714391] [DEBUG] [LOCAL ] DFH: No existing data file found in primary storage. [2025-10-10T18:24:06.714461] [WARN ] [MAIN ] DFH: No existing data found, performing full refresh instead. [2025-10-10T18:24:06.715357] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-10T18:24:06.715402] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-10T18:24:06.715444] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-10T18:24:06.715476] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-10T18:24:07.083293] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:24:07.489401] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-10T18:24:07.990227] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-10T18:24:08.289425] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-10T18:24:08.854726] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T18:24:09.089373] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-10T18:24:09.158252] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-10T18:24:09.889481] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-10T18:24:10.063125] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T18:24:10.689401] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-10T18:24:11.452259] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-10T18:24:11.495016] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-10T18:24:11.508310] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T18:24:12.205272] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T18:24:12.289415] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-10T18:24:13.089384] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-10T18:24:13.889386] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-10T18:24:14.020463] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T18:24:14.100067] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-10T18:24:14.689418] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-10T18:24:14.776548] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-10T18:24:14.781198] [INFO ] [REMOTE ] DEI: Full fetch complete (69709 records). [2025-10-10T18:24:14.781326] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-10T18:24:15.163787] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-10T18:24:15.163892] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-10T18:24:15.164759] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-10T18:24:15.164823] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-10T18:24:15.166279] [DEBUG] [LOCAL ] DEI: Trimmed 69709 records to 49010 (keeping 200 days of data) [2025-10-10T18:24:15.471742] [DEBUG] [LOCAL ] DEI: Primary data saved (49010 records). [2025-10-10T18:24:15.471893] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-10T18:24:15.471993] [INFO ] [MAIN ] Update Progress: 609/2373 symbols completed. DEI took 32.4s. Estimated remaining: 4h 3m 52s. Rate: 7.2 symbols/min [2025-10-10T18:24:15.503606] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-10T18:24:15.643933] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:24:15.644271] [DEBUG] [LOCAL ] DFIN: No existing data file found in primary storage. [2025-10-10T18:24:15.644392] [WARN ] [MAIN ] DFIN: No existing data found, performing full refresh instead. [2025-10-10T18:24:15.644599] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-10T18:24:15.644685] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-10T18:24:15.644748] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-10-10T18:24:15.644782] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-10T18:24:15.999864] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:24:16.030525] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T18:24:16.060387] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-10T18:24:16.289368] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-10T18:24:17.089402] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-10T18:24:17.889435] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-10T18:24:18.031838] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T18:24:18.218038] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-10T18:24:18.696036] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-10T18:24:18.715610] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T18:24:18.846944] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-10T18:24:19.489465] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-10T18:24:20.249973] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-10T18:24:20.289390] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-10T18:24:21.089447] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-10T18:24:21.344627] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T18:24:21.863482] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T18:24:21.889357] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-10T18:24:22.689408] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-10T18:24:23.413510] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-10T18:24:23.489336] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-10T18:24:23.530693] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T18:24:24.289411] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-10T18:24:24.577794] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T18:24:25.089385] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-10T18:24:25.698606] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-10T18:24:25.704367] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-10-10T18:24:25.704559] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-10T18:24:25.891431] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-10T18:24:26.054569] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T18:24:26.169512] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-10T18:24:26.169683] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-10T18:24:26.171023] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-10T18:24:26.171101] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-10T18:24:26.173222] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 54516 (keeping 200 days of data) [2025-10-10T18:24:26.548605] [DEBUG] [LOCAL ] DELL: Primary data saved (54516 records). [2025-10-10T18:24:26.548821] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-10T18:24:26.549428] [INFO ] [MAIN ] Update Progress: 610/2373 symbols completed. DELL took 36.0s. Estimated remaining: 4h 3m 52s. Rate: 7.2 symbols/min [2025-10-10T18:24:26.694532] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-10T18:24:26.743771] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:24:26.759984] [DEBUG] [LOCAL ] DFP: Loaded 11365 existing records from primary storage. [2025-10-10T18:24:26.760308] [INFO ] [MAIN ] DFP: Loaded 11365 existing records. [2025-10-10T18:24:26.954887] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:24:26.955267] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-10T18:24:26.955336] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-10T18:24:26.956052] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-10T18:24:26.956158] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-10T18:24:27.347331] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:24:27.360582] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-10T18:24:27.398211] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-10T18:24:27.489434] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-10T18:24:27.728031] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-10T18:24:28.267809] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-10T18:24:28.289359] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-10T18:24:29.089480] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-10T18:24:29.792191] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T18:24:29.889407] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-10T18:24:30.689361] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-10T18:24:30.821203] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-10T18:24:31.101258] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-10T18:24:31.104684] [INFO ] [REMOTE ] DFH: Full fetch complete (48127 records). [2025-10-10T18:24:31.104787] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-10T18:24:31.496260] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-10T18:24:31.500613] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-10T18:24:31.500772] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-10T18:24:31.501817] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-10T18:24:31.501891] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-10T18:24:31.503745] [DEBUG] [LOCAL ] DFH: Trimmed 48127 records to 32600 (keeping 200 days of data) [2025-10-10T18:24:31.707614] [DEBUG] [LOCAL ] DFH: Primary data saved (32600 records). [2025-10-10T18:24:31.707837] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-10T18:24:31.707948] [INFO ] [MAIN ] Update Progress: 611/2373 symbols completed. DFH took 25.2s. Estimated remaining: 4h 3m 34s. Rate: 7.2 symbols/min [2025-10-10T18:24:31.897360] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:24:31.960564] [DEBUG] [LOCAL ] DG: Loaded 53670 existing records from primary storage. [2025-10-10T18:24:31.961205] [INFO ] [MAIN ] DG: Loaded 53670 existing records. [2025-10-10T18:24:32.157858] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:24:32.158392] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-10T18:24:32.158524] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-10T18:24:32.159028] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-10T18:24:32.159152] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-10T18:24:32.298578] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-10T18:24:32.327579] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T18:24:32.598002] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:24:32.607263] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-10T18:24:33.089403] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-10T18:24:33.889373] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-10T18:24:34.368603] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-10T18:24:34.689356] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-10T18:24:34.797891] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-10T18:24:34.884983] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T18:24:35.489363] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-10T18:24:35.937670] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-10T18:24:36.289374] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-10T18:24:36.441791] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-10T18:24:37.089383] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-10T18:24:37.889420] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-10T18:24:38.262482] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-10T18:24:38.267548] [INFO ] [REMOTE ] DEO: Full fetch complete (71153 records). [2025-10-10T18:24:38.267741] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-10T18:24:38.268685] [FATAL] [VALIDATOR ] DEO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:24:38.268773] [FATAL] [MAIN ] DEO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:24:38.268840] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:24:38.268928] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-10T18:24:38.269013] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-10T18:24:38.269071] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-10-10T18:24:38.269335] [DEBUG] [LOCAL ] DEO: Deleted derivative data file. [2025-10-10T18:24:38.269473] [INFO ] [MAIN ] Update Progress: 612/2373 symbols completed. DEO took 46.1s. Estimated remaining: 4h 3m 21s. Rate: 7.2 symbols/min [2025-10-10T18:24:38.449306] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:24:38.449514] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-10-10T18:24:38.449559] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-10-10T18:24:38.449728] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-10T18:24:38.449778] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-10T18:24:38.449822] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-10T18:24:38.449857] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-10T18:24:38.700692] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-10T18:24:38.831253] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:24:38.879326] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-10T18:24:38.882850] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T18:24:39.489385] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-10T18:24:40.131233] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-10T18:24:40.289417] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-10T18:24:41.089394] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-10T18:24:41.472804] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-10T18:24:41.508221] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T18:24:41.889398] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-10T18:24:42.689387] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-10T18:24:42.944097] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T18:24:43.489396] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-10T18:24:43.910028] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T18:24:44.158722] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-10T18:24:44.289404] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-10T18:24:45.089428] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-10T18:24:45.146180] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-10T18:24:45.889376] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-10T18:24:46.178504] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-10T18:24:46.689392] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-10T18:24:46.760356] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-10T18:24:47.489410] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-10T18:24:47.630942] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T18:24:47.695369] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T18:24:48.289391] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-10T18:24:49.089462] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-10T18:24:49.398447] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T18:24:49.579351] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T18:24:49.889494] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-10T18:24:50.071254] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T18:24:50.689401] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-10T18:24:51.489366] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-10T18:24:51.641214] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-10T18:24:51.742767] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T18:24:52.289378] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-10T18:24:53.089422] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-10T18:24:53.671309] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-10T18:24:53.889361] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-10T18:24:54.375475] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-10T18:24:54.595932] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-10T18:24:54.598307] [INFO ] [REMOTE ] DFIN: Full fetch complete (33433 records). [2025-10-10T18:24:54.598426] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-10T18:24:54.698126] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-10T18:24:54.972228] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-10T18:24:54.972314] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-10T18:24:54.972893] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-10T18:24:54.972954] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-10T18:24:54.973662] [DEBUG] [LOCAL ] DFIN: Trimmed 33433 records to 23143 (keeping 200 days of data) [2025-10-10T18:24:55.111634] [DEBUG] [LOCAL ] DFIN: Primary data saved (23143 records). [2025-10-10T18:24:55.111818] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-10T18:24:55.111914] [INFO ] [MAIN ] Update Progress: 613/2373 symbols completed. DFIN took 39.6s. Estimated remaining: 4h 3m 37s. Rate: 7.2 symbols/min [2025-10-10T18:24:55.283790] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:24:55.305460] [DEBUG] [LOCAL ] DHF: Loaded 21395 existing records from primary storage. [2025-10-10T18:24:55.305789] [INFO ] [MAIN ] DHF: Loaded 21395 existing records. [2025-10-10T18:24:55.483923] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:24:55.484221] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-10T18:24:55.484272] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-10T18:24:55.484544] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-10T18:24:55.484604] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-10T18:24:55.516519] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-10T18:24:55.842396] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:24:56.117924] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-10T18:24:56.289352] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-10T18:24:56.651736] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T18:24:56.678352] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-10T18:24:57.089381] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-10T18:24:57.889405] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-10T18:24:58.287979] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-10T18:24:58.388603] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-10T18:24:58.689350] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-10T18:24:58.954947] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-10T18:24:59.489394] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-10T18:25:00.289400] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-10T18:25:00.941266] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-10T18:25:00.977247] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T18:25:01.089377] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-10T18:25:01.339502] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T18:25:01.340785] [INFO ] [REMOTE ] DFP: Full fetch complete (15860 records). [2025-10-10T18:25:01.340855] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-10T18:25:01.341260] [FATAL] [VALIDATOR ] DFP: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:25:01.341342] [FATAL] [MAIN ] DFP: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:25:01.341385] [WARN ] [MAIN ] DFP: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:25:01.341424] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-10T18:25:01.341479] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-10-10T18:25:01.341513] [INFO ] [LOCAL ] DFP: Starting deletion of derivative data. [2025-10-10T18:25:01.341721] [DEBUG] [LOCAL ] DFP: Deleted derivative data file. [2025-10-10T18:25:01.341812] [INFO ] [MAIN ] Update Progress: 614/2373 symbols completed. DFP took 34.8s. Estimated remaining: 4h 3m 23s. Rate: 7.2 symbols/min [2025-10-10T18:25:01.530899] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:25:01.531147] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-10-10T18:25:01.531222] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-10-10T18:25:01.531354] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-10T18:25:01.531439] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-10T18:25:01.531493] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-10T18:25:01.531532] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-10T18:25:01.900838] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-10T18:25:01.953450] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:25:02.689452] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-10T18:25:03.153035] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-10T18:25:03.158075] [INFO ] [REMOTE ] DG: Full fetch complete (76819 records). [2025-10-10T18:25:03.158238] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-10T18:25:03.159285] [FATAL] [VALIDATOR ] DG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:25:03.159422] [FATAL] [MAIN ] DG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:25:03.159467] [WARN ] [MAIN ] DG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:25:03.159543] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-10T18:25:03.159638] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-10T18:25:03.159749] [INFO ] [LOCAL ] DG: Starting deletion of derivative data. [2025-10-10T18:25:03.160132] [DEBUG] [LOCAL ] DG: Deleted derivative data file. [2025-10-10T18:25:03.160244] [INFO ] [MAIN ] Update Progress: 615/2373 symbols completed. DG took 31.5s. Estimated remaining: 4h 2m 56s. Rate: 7.2 symbols/min [2025-10-10T18:25:03.350230] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:25:03.413983] [DEBUG] [LOCAL ] DHR: Loaded 53763 existing records from primary storage. [2025-10-10T18:25:03.414412] [INFO ] [MAIN ] DHR: Loaded 53763 existing records. [2025-10-10T18:25:03.499104] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-10T18:25:03.684158] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:25:03.685998] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-10T18:25:03.686715] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-10T18:25:03.686872] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-10T18:25:03.692434] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-10T18:25:03.692615] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-10T18:25:04.021241] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-10T18:25:04.116843] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:25:04.289481] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-10T18:25:05.089372] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-10T18:25:05.331300] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T18:25:05.889375] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-10T18:25:06.485284] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-10T18:25:06.605244] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T18:25:06.689378] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-10T18:25:07.111991] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-10T18:25:07.489384] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-10T18:25:08.289355] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-10T18:25:08.705138] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T18:25:08.874182] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-10T18:25:09.089443] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-10T18:25:09.889375] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-10T18:25:09.961373] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T18:25:10.580537] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T18:25:10.689342] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-10T18:25:11.489396] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-10T18:25:12.289412] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-10T18:25:12.820840] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (2.93 seconds). [2025-10-10T18:25:12.865575] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-10T18:25:12.977881] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-10T18:25:13.089363] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-10T18:25:13.889416] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-10T18:25:14.105391] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T18:25:14.689365] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-10T18:25:15.186734] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T18:25:15.332290] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-10T18:25:15.489367] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-10T18:25:16.269259] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T18:25:16.273243] [INFO ] [REMOTE ] DGX: Full fetch complete (64783 records). [2025-10-10T18:25:16.273372] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-10T18:25:16.274100] [FATAL] [VALIDATOR ] DGX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:25:16.274189] [FATAL] [MAIN ] DGX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:25:16.274233] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:25:16.274273] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-10T18:25:16.274331] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-10T18:25:16.274367] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-10-10T18:25:16.274407] [DEBUG] [LOCAL ] DGX: No derivative data file found to delete. [2025-10-10T18:25:16.274463] [INFO ] [MAIN ] Update Progress: 616/2373 symbols completed. DGX took 38.0s. Estimated remaining: 4h 3m 2s. Rate: 7.2 symbols/min [2025-10-10T18:25:16.295308] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-10T18:25:16.444275] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:25:16.489223] [DEBUG] [LOCAL ] DHT: Loaded 48239 existing records from primary storage. [2025-10-10T18:25:16.489582] [INFO ] [MAIN ] DHT: Loaded 48239 existing records. [2025-10-10T18:25:16.670455] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:25:16.670740] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-10T18:25:16.670793] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-10T18:25:16.671054] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-10T18:25:16.671111] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-10T18:25:17.036767] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:25:17.089404] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-10T18:25:17.635507] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T18:25:17.709511] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T18:25:17.889409] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-10T18:25:18.689351] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-10T18:25:19.048615] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-10T18:25:19.489400] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-10T18:25:20.044533] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-10T18:25:20.289369] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-10T18:25:20.812354] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T18:25:20.850067] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T18:25:21.089387] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-10T18:25:21.889406] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-10T18:25:22.268551] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T18:25:22.344249] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-10T18:25:22.689417] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-10T18:25:23.489403] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-10T18:25:23.921123] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T18:25:24.289418] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-10T18:25:24.752216] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-10T18:25:25.089373] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-10T18:25:25.380094] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T18:25:25.889409] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-10T18:25:26.263168] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-10T18:25:26.536390] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-10T18:25:26.689435] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-10T18:25:27.489423] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-10T18:25:27.553383] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T18:25:27.887906] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T18:25:27.890528] [INFO ] [REMOTE ] DHF: Full fetch complete (30101 records). [2025-10-10T18:25:27.890622] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-10T18:25:28.258588] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-10T18:25:28.258700] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-10T18:25:28.259259] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-10T18:25:28.259301] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-10T18:25:28.260055] [DEBUG] [LOCAL ] DHF: Trimmed 30101 records to 21463 (keeping 200 days of data) [2025-10-10T18:25:28.310742] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-10T18:25:28.389873] [DEBUG] [LOCAL ] DHF: Primary data saved (21463 records). [2025-10-10T18:25:28.389999] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-10T18:25:28.390078] [INFO ] [MAIN ] Update Progress: 617/2373 symbols completed. DHF took 33.3s. Estimated remaining: 4h 3m 4s. Rate: 7.2 symbols/min [2025-10-10T18:25:28.562023] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:25:28.576935] [DEBUG] [LOCAL ] DHX: Loaded 13158 existing records from primary storage. [2025-10-10T18:25:28.577192] [INFO ] [MAIN ] DHX: Loaded 13158 existing records. [2025-10-10T18:25:28.753688] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:25:28.753932] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-10T18:25:28.753978] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-10T18:25:28.754170] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-10T18:25:28.754227] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-10T18:25:29.110379] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:25:29.110439] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-10T18:25:29.597786] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-10T18:25:29.889464] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-10T18:25:30.558064] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-10T18:25:30.558511] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-10T18:25:30.689350] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-10T18:25:31.250981] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-10T18:25:31.489441] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-10T18:25:31.836177] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-10T18:25:32.289385] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-10T18:25:33.089359] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-10T18:25:33.606674] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-10T18:25:33.620685] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T18:25:33.889391] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-10T18:25:34.689407] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-10T18:25:35.010980] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T18:25:35.489415] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-10T18:25:35.816869] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-10T18:25:36.050364] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-10T18:25:36.289428] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-10T18:25:37.089442] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-10T18:25:37.389546] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T18:25:37.489055] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-10T18:25:37.889381] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-10T18:25:38.689392] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-10T18:25:39.139354] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T18:25:39.489375] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-10T18:25:39.695805] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T18:25:39.897006] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-10T18:25:39.902395] [INFO ] [REMOTE ] DHR: Full fetch complete (77265 records). [2025-10-10T18:25:39.902551] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-10T18:25:40.295878] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-10T18:25:40.322585] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-10T18:25:40.322721] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-10T18:25:40.323699] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-10T18:25:40.323763] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-10T18:25:40.325485] [DEBUG] [LOCAL ] DHR: Trimmed 77265 records to 54151 (keeping 200 days of data) [2025-10-10T18:25:40.675250] [DEBUG] [LOCAL ] DHR: Primary data saved (54151 records). [2025-10-10T18:25:40.675392] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-10T18:25:40.676530] [INFO ] [MAIN ] Update Progress: 618/2373 symbols completed. DHR took 37.5s. Estimated remaining: 4h 3m 7s. Rate: 7.2 symbols/min [2025-10-10T18:25:40.847055] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:25:40.866249] [DEBUG] [LOCAL ] DIAX: Loaded 13228 existing records from primary storage. [2025-10-10T18:25:40.866538] [INFO ] [MAIN ] DIAX: Loaded 13228 existing records. [2025-10-10T18:25:41.091801] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-10T18:25:41.091712] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:25:41.092869] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-10T18:25:41.093051] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-10T18:25:41.093373] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-10T18:25:41.093506] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-10T18:25:41.255220] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-10T18:25:41.557444] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:25:41.889394] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-10T18:25:42.132797] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-10T18:25:42.315998] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-10T18:25:42.689382] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-10T18:25:42.968192] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-10T18:25:43.489377] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-10T18:25:44.289403] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-10T18:25:44.410064] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-10T18:25:44.847277] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-10T18:25:44.852890] [INFO ] [REMOTE ] DHI: Full fetch complete (77209 records). [2025-10-10T18:25:44.853020] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-10T18:25:45.095513] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-10T18:25:45.239730] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-10T18:25:45.239817] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-10T18:25:45.240752] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-10T18:25:45.240840] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-10T18:25:45.242234] [DEBUG] [LOCAL ] DHI: Trimmed 77209 records to 54122 (keeping 200 days of data) [2025-10-10T18:25:45.343826] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-10T18:25:45.599297] [DEBUG] [LOCAL ] DHI: Primary data saved (54122 records). [2025-10-10T18:25:45.599453] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-10T18:25:45.599548] [INFO ] [MAIN ] Update Progress: 619/2373 symbols completed. DHI took 44.3s. Estimated remaining: 4h 2m 49s. Rate: 7.2 symbols/min [2025-10-10T18:25:45.766009] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:25:45.766222] [DEBUG] [LOCAL ] DIN: No existing data file found in primary storage. [2025-10-10T18:25:45.766260] [WARN ] [MAIN ] DIN: No existing data found, performing full refresh instead. [2025-10-10T18:25:45.766387] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-10T18:25:45.766439] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-10T18:25:45.766483] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-10-10T18:25:45.766517] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-10T18:25:45.904623] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-10T18:25:46.120588] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:25:46.689371] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-10T18:25:46.988567] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T18:25:47.002559] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-10T18:25:47.489406] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-10T18:25:48.289348] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-10T18:25:48.468510] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-10T18:25:48.624950] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T18:25:48.757817] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-10T18:25:49.089373] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-10T18:25:49.889383] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-10T18:25:50.181634] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-10T18:25:50.689403] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-10T18:25:51.489411] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-10T18:25:51.634918] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T18:25:51.645193] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T18:25:52.289385] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-10T18:25:53.089357] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-10T18:25:53.318540] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-10T18:25:53.323545] [INFO ] [REMOTE ] DHT: Full fetch complete (69947 records). [2025-10-10T18:25:53.323711] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-10T18:25:53.720457] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-10T18:25:53.720548] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-10T18:25:53.721687] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-10T18:25:53.721751] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-10T18:25:53.723368] [DEBUG] [LOCAL ] DHT: Trimmed 69947 records to 48622 (keeping 200 days of data) [2025-10-10T18:25:53.854200] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-10T18:25:53.926499] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-10T18:25:54.053252] [DEBUG] [LOCAL ] DHT: Primary data saved (48622 records). [2025-10-10T18:25:54.053453] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-10T18:25:54.053545] [INFO ] [MAIN ] Update Progress: 620/2373 symbols completed. DHT took 37.8s. Estimated remaining: 4h 2m 41s. Rate: 7.2 symbols/min [2025-10-10T18:25:54.226697] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:25:54.235690] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-10T18:25:54.290065] [DEBUG] [LOCAL ] DINO: Loaded 53271 existing records from primary storage. [2025-10-10T18:25:54.290474] [INFO ] [MAIN ] DINO: Loaded 53271 existing records. [2025-10-10T18:25:54.476797] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:25:54.477063] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-10T18:25:54.477117] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-10T18:25:54.477478] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-10T18:25:54.477534] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-10T18:25:54.694536] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-10T18:25:54.858080] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:25:55.082626] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-10T18:25:55.489494] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-10T18:25:56.289402] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-10T18:25:56.451144] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T18:25:57.089348] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-10T18:25:57.419522] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-10T18:25:57.665001] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-10T18:25:57.889359] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-10T18:25:58.575486] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-10T18:25:58.689332] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-10T18:25:59.489423] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-10T18:25:59.757783] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T18:25:59.859983] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T18:26:00.289378] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-10T18:26:00.616385] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T18:26:01.089391] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-10T18:26:01.889410] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-10T18:26:02.015819] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T18:26:02.038199] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-10T18:26:02.689442] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-10T18:26:02.896983] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-10T18:26:02.899114] [INFO ] [REMOTE ] DHX: Full fetch complete (21009 records). [2025-10-10T18:26:02.899188] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-10T18:26:03.290185] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-10T18:26:03.290328] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-10T18:26:03.291205] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-10T18:26:03.291277] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-10T18:26:03.292248] [DEBUG] [LOCAL ] DHX: Trimmed 21009 records to 13393 (keeping 200 days of data) [2025-10-10T18:26:03.377551] [DEBUG] [LOCAL ] DHX: Primary data saved (13393 records). [2025-10-10T18:26:03.377784] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-10T18:26:03.377900] [INFO ] [MAIN ] Update Progress: 621/2373 symbols completed. DHX took 35.0s. Estimated remaining: 4h 2m 36s. Rate: 7.2 symbols/min [2025-10-10T18:26:03.490329] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-10T18:26:03.567695] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:26:03.638179] [DEBUG] [LOCAL ] DIS: Loaded 54178 existing records from primary storage. [2025-10-10T18:26:03.638767] [INFO ] [MAIN ] DIS: Loaded 54178 existing records. [2025-10-10T18:26:03.772745] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-10T18:26:03.861594] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:26:03.861909] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-10T18:26:03.861964] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-10T18:26:03.862480] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-10T18:26:03.862544] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-10T18:26:04.290572] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:26:04.290753] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-10T18:26:05.064748] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T18:26:05.089334] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-10T18:26:05.474847] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-10T18:26:05.476737] [INFO ] [REMOTE ] DIAX: Full fetch complete (17793 records). [2025-10-10T18:26:05.476812] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-10T18:26:05.829401] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-10T18:26:05.829487] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-10T18:26:05.829950] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-10T18:26:05.830012] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-10T18:26:05.830549] [DEBUG] [LOCAL ] DIAX: Trimmed 17793 records to 13282 (keeping 200 days of data) [2025-10-10T18:26:05.890115] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-10T18:26:05.914569] [DEBUG] [LOCAL ] DIAX: Primary data saved (13282 records). [2025-10-10T18:26:05.914699] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-10T18:26:05.914791] [INFO ] [MAIN ] Update Progress: 622/2373 symbols completed. DIAX took 25.2s. Estimated remaining: 4h 2m 11s. Rate: 7.2 symbols/min [2025-10-10T18:26:06.078694] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:26:06.078883] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-10T18:26:06.078921] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-10T18:26:06.079032] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-10T18:26:06.079072] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-10T18:26:06.079111] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-10T18:26:06.079145] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-10T18:26:06.430392] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:26:06.689348] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-10T18:26:06.740689] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-10T18:26:07.104333] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-10T18:26:07.409973] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-10T18:26:07.489349] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-10T18:26:08.230930] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-10T18:26:08.289349] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-10T18:26:08.719485] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-10T18:26:09.089381] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-10T18:26:09.889364] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-10T18:26:10.689358] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-10T18:26:10.935049] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T18:26:11.351183] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-10T18:26:11.489386] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-10T18:26:12.289379] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-10T18:26:13.089448] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-10T18:26:13.366871] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-10T18:26:13.478841] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-10T18:26:13.483160] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T18:26:13.889363] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-10T18:26:14.145086] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T18:26:14.150387] [INFO ] [REMOTE ] DIN: Full fetch complete (55223 records). [2025-10-10T18:26:14.150540] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-10T18:26:14.543113] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-10T18:26:14.543200] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-10T18:26:14.543975] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-10T18:26:14.544040] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-10T18:26:14.545189] [DEBUG] [LOCAL ] DIN: Trimmed 55223 records to 37849 (keeping 200 days of data) [2025-10-10T18:26:14.710170] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-10T18:26:14.779522] [DEBUG] [LOCAL ] DIN: Primary data saved (37849 records). [2025-10-10T18:26:14.779889] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-10T18:26:14.779995] [INFO ] [MAIN ] Update Progress: 623/2373 symbols completed. DIN took 29.2s. Estimated remaining: 4h 2m 5s. Rate: 7.2 symbols/min [2025-10-10T18:26:14.944436] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:26:14.995373] [DEBUG] [LOCAL ] DK: Loaded 49695 existing records from primary storage. [2025-10-10T18:26:14.995845] [INFO ] [MAIN ] DK: Loaded 49695 existing records. [2025-10-10T18:26:15.165258] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:26:15.165527] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-10T18:26:15.165575] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-10T18:26:15.166593] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-10T18:26:15.166699] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-10T18:26:15.494201] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-10T18:26:15.517835] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:26:15.895669] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T18:26:16.052959] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-10T18:26:16.289431] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-10T18:26:16.707041] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-10T18:26:17.089390] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-10T18:26:17.419830] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-10-10T18:26:17.597354] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-10T18:26:17.889436] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-10T18:26:18.689461] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-10T18:26:19.489361] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-10T18:26:19.894289] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-10T18:26:20.289385] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-10T18:26:20.690854] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-10T18:26:20.758907] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-10T18:26:20.866429] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T18:26:21.089423] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-10T18:26:21.889365] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-10T18:26:22.689392] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-10T18:26:22.889152] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T18:26:23.191716] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T18:26:23.489397] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-10T18:26:24.289452] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-10T18:26:24.692875] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-10T18:26:25.076413] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-10T18:26:25.089340] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-10T18:26:25.498017] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T18:26:25.500976] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-10T18:26:25.889377] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-10T18:26:26.689410] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-10T18:26:27.489441] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-10T18:26:27.938220] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T18:26:28.289345] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-10T18:26:28.438238] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-10T18:26:29.089395] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-10T18:26:29.588625] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-10T18:26:29.589384] [INFO ] [REMOTE ] DIVY: Full fetch complete (1700 records). [2025-10-10T18:26:29.589457] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-10T18:26:29.782061] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-10T18:26:29.782277] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:26:29.782344] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:26:29.782393] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-10T18:26:29.782450] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-10T18:26:29.782484] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-10T18:26:29.782524] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-10T18:26:29.782581] [INFO ] [MAIN ] Update Progress: 624/2373 symbols completed. DIVY took 23.9s. Estimated remaining: 4h 2m 15s. Rate: 7.2 symbols/min [2025-10-10T18:26:29.896926] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-10T18:26:29.971881] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:26:29.993424] [DEBUG] [LOCAL ] DKL: Loaded 18052 existing records from primary storage. [2025-10-10T18:26:29.993708] [INFO ] [MAIN ] DKL: Loaded 18052 existing records. [2025-10-10T18:26:30.174098] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:26:30.174796] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-10T18:26:30.174871] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-10T18:26:30.175096] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-10T18:26:30.175156] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-10T18:26:30.294803] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-10T18:26:30.390225] [INFO ] [REMOTE ] DINO: Full fetch complete (76231 records). [2025-10-10T18:26:30.400346] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-10T18:26:30.453455] [FATAL] [VALIDATOR ] DINO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:26:30.502387] [FATAL] [MAIN ] DINO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:26:30.526355] [WARN ] [MAIN ] DINO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:26:30.542456] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-10T18:26:30.549028] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-10T18:26:30.551684] [INFO ] [LOCAL ] DINO: Starting deletion of derivative data. [2025-10-10T18:26:30.551537] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (3.06 seconds). [2025-10-10T18:26:30.590839] [DEBUG] [LOCAL ] DINO: Deleted derivative data file. [2025-10-10T18:26:30.596827] [INFO ] [MAIN ] Update Progress: 625/2373 symbols completed. DINO took 36.5s. Estimated remaining: 4h 1m 46s. Rate: 7.2 symbols/min [2025-10-10T18:26:30.687408] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:26:30.695155] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-10T18:26:30.834614] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:26:30.894680] [DEBUG] [LOCAL ] DKS: Loaded 50059 existing records from primary storage. [2025-10-10T18:26:30.895111] [INFO ] [MAIN ] DKS: Loaded 50059 existing records. [2025-10-10T18:26:31.082744] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:26:31.082994] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-10T18:26:31.083045] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-10T18:26:31.083623] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-10T18:26:31.083720] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-10T18:26:31.469108] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:26:31.489400] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-10T18:26:31.847833] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T18:26:32.289382] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-10T18:26:32.926110] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-10T18:26:33.089343] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-10T18:26:33.139862] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-10T18:26:33.558803] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-10T18:26:33.889425] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-10T18:26:34.689408] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-10T18:26:35.488790] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-10T18:26:35.500414] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-10T18:26:35.806040] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T18:26:36.289414] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-10T18:26:36.719239] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T18:26:36.923176] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T18:26:37.089406] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-10T18:26:37.889432] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-10T18:26:38.052474] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T18:26:38.689415] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-10T18:26:39.353796] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-10T18:26:39.489378] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-10T18:26:39.766749] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T18:26:40.289358] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-10T18:26:40.778019] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-10T18:26:41.089393] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-10T18:26:41.864298] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T18:26:41.889338] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-10T18:26:42.121422] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-10T18:26:42.689400] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-10T18:26:43.489530] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-10T18:26:43.550382] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-10T18:26:44.210122] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-10T18:26:44.289341] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-10T18:26:44.662435] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T18:26:45.089424] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-10T18:26:45.414216] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-10-10T18:26:45.889396] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-10T18:26:46.502579] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-10T18:26:46.689358] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-10T18:26:46.928388] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T18:26:47.489401] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-10T18:26:48.289367] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-10T18:26:48.376486] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-10T18:26:48.382632] [INFO ] [REMOTE ] DIS: Full fetch complete (77945 records). [2025-10-10T18:26:48.382869] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-10T18:26:48.882506] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-10T18:26:48.895066] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-10T18:26:48.898526] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-10T18:26:48.898723] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-10T18:26:48.900888] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-10T18:26:48.940372] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-10T18:26:48.937715] [DEBUG] [LOCAL ] DIS: Trimmed 77945 records to 54568 (keeping 200 days of data) [2025-10-10T18:26:49.092160] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-10T18:26:49.326831] [DEBUG] [LOCAL ] DIS: Primary data saved (54568 records). [2025-10-10T18:26:49.327082] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-10T18:26:49.327260] [INFO ] [MAIN ] Update Progress: 626/2373 symbols completed. DIS took 45.9s. Estimated remaining: 4h 2m 7s. Rate: 7.2 symbols/min [2025-10-10T18:26:49.508307] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:26:49.542908] [DEBUG] [LOCAL ] DLB: Loaded 32314 existing records from primary storage. [2025-10-10T18:26:49.543281] [INFO ] [MAIN ] DLB: Loaded 32314 existing records. [2025-10-10T18:26:49.734500] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:26:49.735118] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-10T18:26:49.735302] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-10T18:26:49.735581] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-10T18:26:49.735662] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-10T18:26:49.893402] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-10T18:26:49.980378] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-10T18:26:50.053476] [INFO ] [REMOTE ] DK: Full fetch complete (70865 records). [2025-10-10T18:26:50.066989] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-10T18:26:50.290251] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:26:50.575117] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-10T18:26:50.663353] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-10T18:26:50.663468] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-10T18:26:50.664715] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-10T18:26:50.664800] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-10T18:26:50.666891] [DEBUG] [LOCAL ] DK: Trimmed 70865 records to 50055 (keeping 200 days of data) [2025-10-10T18:26:50.725141] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-10T18:26:50.996841] [DEBUG] [LOCAL ] DK: Primary data saved (50055 records). [2025-10-10T18:26:50.997030] [INFO ] [MAIN ] DK: Full history saved. [2025-10-10T18:26:50.997384] [INFO ] [MAIN ] Update Progress: 627/2373 symbols completed. DK took 36.2s. Estimated remaining: 4h 1m 40s. Rate: 7.2 symbols/min [2025-10-10T18:26:51.176887] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:26:51.177818] [DEBUG] [LOCAL ] DLNG: No existing data file found in primary storage. [2025-10-10T18:26:51.177875] [WARN ] [MAIN ] DLNG: No existing data found, performing full refresh instead. [2025-10-10T18:26:51.178113] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-10T18:26:51.178168] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-10T18:26:51.178212] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-10-10T18:26:51.178245] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-10T18:26:51.494554] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-10T18:26:51.553703] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:26:51.900161] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-10T18:26:52.289379] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-10T18:26:52.452199] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T18:26:52.530975] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-10T18:26:53.089427] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-10T18:26:53.889357] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-10T18:26:54.006768] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-10T18:26:54.032685] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T18:26:54.689398] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-10T18:26:54.906043] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T18:26:55.489367] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-10T18:26:56.278059] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T18:26:56.289340] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-10T18:26:56.651362] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-10T18:26:57.089417] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-10T18:26:57.874318] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T18:26:57.889333] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-10T18:26:58.015304] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-10T18:26:58.689407] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-10T18:26:59.162341] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-10T18:26:59.489396] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-10T18:27:00.289403] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-10T18:27:00.713405] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-10T18:27:00.773628] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-10T18:27:00.872900] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T18:27:01.089443] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-10T18:27:01.889392] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-10T18:27:02.689427] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-10T18:27:02.731262] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T18:27:03.489454] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-10T18:27:03.605336] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-10T18:27:03.876353] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-10T18:27:03.882064] [INFO ] [REMOTE ] DKS: Full fetch complete (71661 records). [2025-10-10T18:27:03.882298] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-10T18:27:04.288861] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-10T18:27:04.289001] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-10T18:27:04.290298] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-10T18:27:04.290626] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-10T18:27:04.290457] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-10T18:27:04.294097] [DEBUG] [LOCAL ] DKS: Trimmed 71661 records to 50431 (keeping 200 days of data) [2025-10-10T18:27:04.644459] [DEBUG] [LOCAL ] DKS: Primary data saved (50431 records). [2025-10-10T18:27:04.644662] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-10T18:27:04.644841] [INFO ] [MAIN ] Update Progress: 628/2373 symbols completed. DKS took 34.0s. Estimated remaining: 4h 1m 46s. Rate: 7.2 symbols/min [2025-10-10T18:27:04.840719] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:27:04.902196] [DEBUG] [LOCAL ] DLR: Loaded 51205 existing records from primary storage. [2025-10-10T18:27:04.902598] [INFO ] [MAIN ] DLR: Loaded 51205 existing records. [2025-10-10T18:27:05.092713] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-10T18:27:05.097049] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:27:05.098627] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-10T18:27:05.098817] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-10T18:27:05.099350] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-10T18:27:05.099415] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-10T18:27:05.357013] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-10T18:27:05.553342] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-10T18:27:05.560147] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:27:05.889427] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-10T18:27:06.221086] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T18:27:06.689399] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-10T18:27:07.489411] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-10T18:27:08.049495] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-10T18:27:08.165360] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-10T18:27:08.233792] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-10T18:27:08.289387] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-10T18:27:09.089417] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-10T18:27:09.791626] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T18:27:09.889375] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-10T18:27:10.689420] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-10T18:27:11.097912] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-10T18:27:11.428463] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-10T18:27:11.451488] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T18:27:11.489347] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-10T18:27:12.289388] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-10T18:27:12.685598] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-10T18:27:13.089395] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-10T18:27:13.889390] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-10T18:27:14.281886] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-10T18:27:14.371935] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T18:27:14.645746] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T18:27:14.689382] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-10T18:27:15.411893] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-10T18:27:15.489406] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-10T18:27:16.289368] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-10T18:27:16.945926] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-10T18:27:16.949617] [INFO ] [REMOTE ] DLB: Full fetch complete (46800 records). [2025-10-10T18:27:16.949773] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-10T18:27:16.950582] [FATAL] [VALIDATOR ] DLB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:27:16.950699] [FATAL] [MAIN ] DLB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:27:16.950751] [WARN ] [MAIN ] DLB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:27:16.950803] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-10T18:27:16.950866] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-10-10T18:27:16.950903] [INFO ] [LOCAL ] DLB: Starting deletion of derivative data. [2025-10-10T18:27:16.951239] [DEBUG] [LOCAL ] DLB: Deleted derivative data file. [2025-10-10T18:27:16.951343] [INFO ] [MAIN ] Update Progress: 629/2373 symbols completed. DLB took 27.6s. Estimated remaining: 4h 1m 49s. Rate: 7.2 symbols/min [2025-10-10T18:27:17.101730] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-10T18:27:17.138864] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:27:17.173442] [DEBUG] [LOCAL ] DLX: Loaded 28604 existing records from primary storage. [2025-10-10T18:27:17.173801] [INFO ] [MAIN ] DLX: Loaded 28604 existing records. [2025-10-10T18:27:17.367281] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:27:17.367698] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-10T18:27:17.367899] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-10T18:27:17.379629] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-10T18:27:17.380214] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-10T18:27:17.380299] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-10T18:27:17.749718] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:27:17.835846] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T18:27:17.837133] [INFO ] [REMOTE ] DLNG: Full fetch complete (11885 records). [2025-10-10T18:27:17.837216] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-10T18:27:17.894491] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-10T18:27:18.207636] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-10T18:27:18.207800] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-10T18:27:18.208206] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-10T18:27:18.208250] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-10T18:27:18.208862] [DEBUG] [LOCAL ] DLNG: Trimmed 11885 records to 6234 (keeping 200 days of data) [2025-10-10T18:27:18.249207] [DEBUG] [LOCAL ] DLNG: Primary data saved (6234 records). [2025-10-10T18:27:18.249379] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-10T18:27:18.249471] [INFO ] [MAIN ] Update Progress: 630/2373 symbols completed. DLNG took 27.3s. Estimated remaining: 4h 1m 21s. Rate: 7.2 symbols/min [2025-10-10T18:27:18.431986] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:27:18.458872] [DEBUG] [LOCAL ] DLY: Loaded 20448 existing records from primary storage. [2025-10-10T18:27:18.459219] [INFO ] [MAIN ] DLY: Loaded 20448 existing records. [2025-10-10T18:27:18.647986] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:27:18.648272] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-10T18:27:18.648327] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-10T18:27:18.648589] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-10T18:27:18.648682] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-10T18:27:18.694617] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-10T18:27:19.022329] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:27:19.245610] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T18:27:19.489368] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-10T18:27:19.706481] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-10T18:27:19.708177] [INFO ] [REMOTE ] DKL: Full fetch complete (27796 records). [2025-10-10T18:27:19.708252] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-10T18:27:19.708787] [FATAL] [VALIDATOR ] DKL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:27:19.708873] [FATAL] [MAIN ] DKL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:27:19.708940] [WARN ] [MAIN ] DKL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:27:19.708983] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-10T18:27:19.709045] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-10-10T18:27:19.709081] [INFO ] [LOCAL ] DKL: Starting deletion of derivative data. [2025-10-10T18:27:19.709235] [DEBUG] [LOCAL ] DKL: Deleted derivative data file. [2025-10-10T18:27:19.709332] [INFO ] [MAIN ] Update Progress: 631/2373 symbols completed. DKL took 49.9s. Estimated remaining: 4h 0m 54s. Rate: 7.2 symbols/min [2025-10-10T18:27:19.891799] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:27:19.899584] [DEBUG] [LOCAL ] DMA: Loaded 4708 existing records from primary storage. [2025-10-10T18:27:19.899851] [INFO ] [MAIN ] DMA: Loaded 4708 existing records. [2025-10-10T18:27:20.092257] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:27:20.092597] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-10T18:27:20.092681] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-10T18:27:20.092909] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-10T18:27:20.092966] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-10T18:27:20.295567] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-10T18:27:20.458222] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:27:21.089417] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-10T18:27:21.391567] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-10T18:27:21.677385] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-10T18:27:21.678561] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-10T18:27:21.889391] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-10T18:27:22.689380] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-10T18:27:23.489399] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-10T18:27:23.998889] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T18:27:24.027721] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T18:27:24.289423] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-10T18:27:24.649035] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-10T18:27:25.089416] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-10T18:27:25.889404] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-10T18:27:26.221265] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-10T18:27:26.272290] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-10T18:27:26.609016] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-10T18:27:26.689417] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-10T18:27:27.489413] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-10T18:27:28.289417] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-10T18:27:28.586135] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T18:27:28.960586] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-10T18:27:29.078506] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T18:27:29.089340] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-10T18:27:29.889394] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-10T18:27:30.689421] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-10T18:27:31.133502] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-10T18:27:31.199698] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-10T18:27:31.489436] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-10T18:27:32.222060] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-10T18:27:32.289424] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-10T18:27:33.089371] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-10T18:27:33.150684] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-10T18:27:33.498596] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T18:27:33.889391] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-10T18:27:34.434177] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-10T18:27:34.472936] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-10T18:27:34.689367] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-10T18:27:35.489390] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-10T18:27:35.521366] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-10T18:27:36.289391] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-10T18:27:37.089365] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-10T18:27:37.193462] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-10T18:27:37.657422] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-10T18:27:37.889363] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-10T18:27:38.237441] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T18:27:38.689363] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-10T18:27:39.006308] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-10T18:27:39.489410] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-10T18:27:40.289413] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-10T18:27:40.714133] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-10T18:27:40.719723] [INFO ] [REMOTE ] DLR: Full fetch complete (73984 records). [2025-10-10T18:27:40.719901] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-10T18:27:40.863092] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T18:27:41.036428] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-10T18:27:41.094432] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-10T18:27:41.168005] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-10T18:27:41.168111] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-10T18:27:41.169612] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-10T18:27:41.169727] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-10T18:27:41.172145] [DEBUG] [LOCAL ] DLR: Trimmed 73984 records to 51583 (keeping 200 days of data) [2025-10-10T18:27:41.539702] [DEBUG] [LOCAL ] DLR: Primary data saved (51583 records). [2025-10-10T18:27:41.539876] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-10T18:27:41.539992] [INFO ] [MAIN ] Update Progress: 632/2373 symbols completed. DLR took 36.9s. Estimated remaining: 4h 1m 23s. Rate: 7.2 symbols/min [2025-10-10T18:27:41.715467] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:27:41.729082] [DEBUG] [LOCAL ] DMB: Loaded 10302 existing records from primary storage. [2025-10-10T18:27:41.729427] [INFO ] [MAIN ] DMB: Loaded 10302 existing records. [2025-10-10T18:27:41.908667] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-10T18:27:41.914140] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:27:41.915545] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-10T18:27:41.915609] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-10T18:27:41.915951] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-10T18:27:41.916018] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-10T18:27:42.291451] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:27:42.689411] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-10T18:27:42.799378] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T18:27:42.832600] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-10T18:27:43.489411] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-10T18:27:43.675383] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-10T18:27:44.289406] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-10T18:27:44.872742] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-10T18:27:45.089365] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-10T18:27:45.197687] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T18:27:45.889383] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-10T18:27:46.535924] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-10T18:27:46.685194] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-10T18:27:46.689328] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-10T18:27:47.457955] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T18:27:47.459272] [INFO ] [REMOTE ] DMA: Full fetch complete (6748 records). [2025-10-10T18:27:47.459399] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-10T18:27:47.494545] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-10T18:27:47.844120] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-10T18:27:47.844223] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-10T18:27:47.844487] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-10T18:27:47.844536] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-10T18:27:47.845233] [DEBUG] [LOCAL ] DMA: Trimmed 6748 records to 4760 (keeping 200 days of data) [2025-10-10T18:27:47.878299] [DEBUG] [LOCAL ] DMA: Primary data saved (4760 records). [2025-10-10T18:27:47.878458] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-10T18:27:47.878569] [INFO ] [MAIN ] Update Progress: 633/2373 symbols completed. DMA took 28.2s. Estimated remaining: 4h 1m 9s. Rate: 7.2 symbols/min [2025-10-10T18:27:48.060679] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:27:48.076427] [DEBUG] [LOCAL ] DMO: Loaded 10036 existing records from primary storage. [2025-10-10T18:27:48.076739] [INFO ] [MAIN ] DMO: Loaded 10036 existing records. [2025-10-10T18:27:48.254925] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:27:48.255178] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-10T18:27:48.255228] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-10T18:27:48.255431] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-10T18:27:48.255482] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-10T18:27:48.297291] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-10T18:27:48.663986] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:27:48.867168] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-10T18:27:49.089420] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-10T18:27:49.359881] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-10T18:27:49.889374] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-10T18:27:50.108346] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T18:27:50.689427] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-10T18:27:51.179261] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-10T18:27:51.182440] [INFO ] [REMOTE ] DLY: Full fetch complete (28313 records). [2025-10-10T18:27:51.182521] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-10T18:27:51.494478] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-10T18:27:51.567078] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-10T18:27:51.567295] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-10T18:27:51.568271] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-10T18:27:51.568360] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-10T18:27:51.576811] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-10T18:27:51.580044] [DEBUG] [LOCAL ] DLY: Trimmed 28313 records to 20638 (keeping 200 days of data) [2025-10-10T18:27:51.715999] [DEBUG] [LOCAL ] DLY: Primary data saved (20638 records). [2025-10-10T18:27:51.716184] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-10T18:27:51.716310] [INFO ] [MAIN ] Update Progress: 634/2373 symbols completed. DLY took 33.5s. Estimated remaining: 4h 0m 49s. Rate: 7.2 symbols/min [2025-10-10T18:27:51.884917] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:27:51.934598] [DEBUG] [LOCAL ] DNA: Loaded 48858 existing records from primary storage. [2025-10-10T18:27:51.935016] [INFO ] [MAIN ] DNA: Loaded 48858 existing records. [2025-10-10T18:27:52.111594] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:27:52.111874] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-10T18:27:52.111924] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-10T18:27:52.112199] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-10T18:27:52.112256] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-10T18:27:52.291746] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-10T18:27:52.491883] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:27:53.089357] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-10T18:27:53.134767] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T18:27:53.265784] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-10T18:27:53.889420] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-10T18:27:54.689417] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-10T18:27:55.104816] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T18:27:55.454184] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T18:27:55.489342] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-10T18:27:55.734519] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-10T18:27:56.289382] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-10T18:27:56.804969] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-10T18:27:57.089427] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-10T18:27:57.204167] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-10T18:27:57.889382] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-10T18:27:58.332962] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-10T18:27:58.335966] [INFO ] [REMOTE ] DLX: Full fetch complete (41053 records). [2025-10-10T18:27:58.336102] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-10T18:27:58.336927] [FATAL] [VALIDATOR ] DLX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:27:58.337033] [FATAL] [MAIN ] DLX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:27:58.337083] [WARN ] [MAIN ] DLX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:27:58.337154] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-10T18:27:58.337278] [DEBUG] [LOCAL ] DLX: No primary data file found to delete. [2025-10-10T18:27:58.337354] [INFO ] [LOCAL ] DLX: Starting deletion of derivative data. [2025-10-10T18:27:58.337638] [DEBUG] [LOCAL ] DLX: Deleted derivative data file. [2025-10-10T18:27:58.337834] [INFO ] [MAIN ] Update Progress: 635/2373 symbols completed. DLX took 41.4s. Estimated remaining: 4h 0m 36s. Rate: 7.2 symbols/min [2025-10-10T18:27:58.527620] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:27:58.575568] [DEBUG] [LOCAL ] DNOW: Loaded 43943 existing records from primary storage. [2025-10-10T18:27:58.575964] [INFO ] [MAIN ] DNOW: Loaded 43943 existing records. [2025-10-10T18:27:58.694545] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-10T18:27:58.777201] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:27:58.777517] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-10T18:27:58.777583] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-10T18:27:58.777965] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-10T18:27:58.778030] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-10T18:27:58.897528] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-10T18:27:59.175038] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:27:59.489364] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-10T18:27:59.692552] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-10T18:28:00.289424] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-10T18:28:01.089440] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-10T18:28:01.449189] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-10T18:28:01.889367] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-10T18:28:02.163332] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-10T18:28:02.423613] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-10T18:28:02.689393] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-10T18:28:03.359985] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-10T18:28:03.489412] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-10T18:28:04.289398] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-10T18:28:04.682703] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-10T18:28:05.089386] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-10T18:28:05.236601] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-10T18:28:05.246533] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-10T18:28:05.889382] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-10T18:28:06.689409] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-10T18:28:06.847813] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-10T18:28:07.199447] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-10T18:28:07.489408] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-10T18:28:08.289400] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-10T18:28:08.371385] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T18:28:09.089402] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-10T18:28:09.332717] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-10T18:28:09.530934] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T18:28:09.889385] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-10T18:28:10.004059] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-10T18:28:10.689384] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-10T18:28:11.489360] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-10T18:28:11.565359] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-10T18:28:11.617408] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-10T18:28:12.289416] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-10T18:28:12.424963] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-10T18:28:13.089393] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-10T18:28:13.302671] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-10T18:28:13.866047] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T18:28:13.867406] [INFO ] [REMOTE ] DMB: Full fetch complete (14741 records). [2025-10-10T18:28:13.867480] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-10T18:28:13.898217] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-10T18:28:14.237304] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-10T18:28:14.237431] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-10T18:28:14.237912] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-10T18:28:14.237976] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-10T18:28:14.238553] [DEBUG] [LOCAL ] DMB: Trimmed 14741 records to 10356 (keeping 200 days of data) [2025-10-10T18:28:14.307437] [DEBUG] [LOCAL ] DMB: Primary data saved (10356 records). [2025-10-10T18:28:14.307618] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-10T18:28:14.307754] [INFO ] [MAIN ] Update Progress: 636/2373 symbols completed. DMB took 32.8s. Estimated remaining: 4h 0m 48s. Rate: 7.2 symbols/min [2025-10-10T18:28:14.486517] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:28:14.520026] [DEBUG] [LOCAL ] DNP: Loaded 33468 existing records from primary storage. [2025-10-10T18:28:14.520356] [INFO ] [MAIN ] DNP: Loaded 33468 existing records. [2025-10-10T18:28:14.691065] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:28:14.691240] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-10T18:28:14.692900] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-10T18:28:14.692964] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-10T18:28:14.693300] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-10T18:28:14.693359] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-10T18:28:15.077889] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:28:15.489409] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-10T18:28:15.766287] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-10T18:28:16.039717] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-10T18:28:16.289398] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-10T18:28:17.089368] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-10T18:28:17.411419] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T18:28:17.847696] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-10T18:28:17.889360] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-10T18:28:18.073442] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-10T18:28:18.689380] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-10T18:28:19.489383] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-10T18:28:20.083347] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-10T18:28:20.289439] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-10T18:28:20.440826] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T18:28:20.462902] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-10T18:28:21.089427] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-10T18:28:21.889400] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-10T18:28:21.974000] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T18:28:21.975662] [INFO ] [REMOTE ] DMO: Full fetch complete (14478 records). [2025-10-10T18:28:21.975787] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-10T18:28:22.398617] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-10T18:28:22.398771] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-10T18:28:22.399180] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-10T18:28:22.399259] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-10T18:28:22.400445] [DEBUG] [LOCAL ] DMO: Trimmed 14478 records to 10068 (keeping 200 days of data) [2025-10-10T18:28:22.460197] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-10T18:28:22.504686] [DEBUG] [LOCAL ] DMO: Primary data saved (10068 records). [2025-10-10T18:28:22.504853] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-10T18:28:22.504948] [INFO ] [MAIN ] Update Progress: 637/2373 symbols completed. DMO took 34.6s. Estimated remaining: 4h 0m 40s. Rate: 7.2 symbols/min [2025-10-10T18:28:22.689456] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-10T18:28:22.949809] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-10T18:28:23.489419] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-10T18:28:24.289470] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-10T18:28:24.807114] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-10T18:28:24.908002] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-10T18:28:25.089379] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-10T18:28:25.832312] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-10T18:28:25.889361] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-10T18:28:26.542747] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T18:28:26.689378] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-10T18:28:27.489403] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-10T18:28:27.617017] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T18:28:28.289419] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-10T18:28:28.456457] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T18:28:29.089373] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-10T18:28:29.659281] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-10T18:28:29.664380] [INFO ] [REMOTE ] DNA: Full fetch complete (71060 records). [2025-10-10T18:28:29.664539] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-10T18:28:30.034269] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T18:28:30.079139] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-10T18:28:30.117727] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-10T18:28:30.117834] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-10T18:28:30.118784] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-10T18:28:30.118850] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-10T18:28:30.120369] [DEBUG] [LOCAL ] DNA: Trimmed 71060 records to 49242 (keeping 200 days of data) [2025-10-10T18:28:30.404200] [DEBUG] [LOCAL ] DNA: Primary data saved (49242 records). [2025-10-10T18:28:30.404375] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-10T18:28:30.404669] [INFO ] [MAIN ] Update Progress: 638/2373 symbols completed. DNA took 38.7s. Estimated remaining: 4h 0m 30s. Rate: 7.2 symbols/min [2025-10-10T18:28:30.846450] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T18:28:30.856188] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-10T18:28:31.698822] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-10T18:28:31.706806] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-10T18:28:32.268439] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-10T18:28:32.273118] [INFO ] [REMOTE ] DNOW: Full fetch complete (62884 records). [2025-10-10T18:28:32.273350] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-10T18:28:32.718549] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-10T18:28:32.731695] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-10T18:28:32.733930] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-10T18:28:32.732499] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-10T18:28:32.734197] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-10T18:28:32.743682] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-10T18:28:32.745441] [DEBUG] [LOCAL ] DNOW: Trimmed 62884 records to 44295 (keeping 200 days of data) [2025-10-10T18:28:33.038067] [DEBUG] [LOCAL ] DNOW: Primary data saved (44295 records). [2025-10-10T18:28:33.038243] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-10T18:28:33.038346] [INFO ] [MAIN ] Update Progress: 639/2373 symbols completed. DNOW took 34.7s. Estimated remaining: 4h 0m 7s. Rate: 7.2 symbols/min [2025-10-10T18:28:34.391856] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T18:28:34.399739] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-10T18:28:35.900165] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-10T18:28:35.912040] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-10T18:28:37.431993] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T18:28:37.439571] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-10T18:28:39.021482] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T18:28:39.024789] [INFO ] [REMOTE ] DNP: Full fetch complete (48860 records). [2025-10-10T18:28:39.024919] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-10T18:28:39.401585] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-10T18:28:39.401748] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-10T18:28:39.402470] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-10T18:28:39.402510] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-10T18:28:39.403620] [DEBUG] [LOCAL ] DNP: Trimmed 48860 records to 33717 (keeping 200 days of data) [2025-10-10T18:28:39.601290] [DEBUG] [LOCAL ] DNP: Primary data saved (33717 records). [2025-10-10T18:28:39.601431] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-10T18:28:39.601582] [INFO ] [MAIN ] Update Progress: 640/2373 symbols completed. DNP took 25.3s. Estimated remaining: 3h 59m 54s. Rate: 7.2 symbols/min [2025-10-10T18:28:40.292625] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:28:40.295244] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:28:40.296748] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:28:40.330456] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:28:40.419376] [DEBUG] [LOCAL ] DOCS: Loaded 51323 existing records from primary storage. [2025-10-10T18:28:40.448381] [DEBUG] [LOCAL ] DOCN: Loaded 51170 existing records from primary storage. [2025-10-10T18:28:40.434311] [INFO ] [MAIN ] DOCS: Loaded 51323 existing records. [2025-10-10T18:28:40.482758] [INFO ] [MAIN ] DOCN: Loaded 51170 existing records. [2025-10-10T18:28:40.503781] [DEBUG] [LOCAL ] DOC: Loaded 53937 existing records from primary storage. [2025-10-10T18:28:40.483796] [DEBUG] [LOCAL ] DOLE: Loaded 39185 existing records from primary storage. [2025-10-10T18:28:40.518435] [INFO ] [MAIN ] DOC: Loaded 53937 existing records. [2025-10-10T18:28:40.574081] [INFO ] [MAIN ] DOLE: Loaded 39185 existing records. [2025-10-10T18:28:40.975980] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:28:41.026528] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:28:41.047773] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-10T18:28:41.053168] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-10T18:28:41.053244] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-10T18:28:41.086607] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-10T18:28:41.116193] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-10T18:28:41.128766] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-10T18:28:41.128901] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-10T18:28:41.128707] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-10T18:28:41.160401] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:28:41.226893] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:28:41.222305] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-10T18:28:41.256937] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-10T18:28:41.251709] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-10T18:28:41.267417] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-10T18:28:41.297561] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-10T18:28:41.312746] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-10T18:28:41.312682] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-10T18:28:41.318360] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-10T18:28:42.584212] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:28:42.636734] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:28:42.683519] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-10T18:28:42.683787] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-10T18:28:42.689787] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:28:42.691550] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-10T18:28:42.659099] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:28:42.692773] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-10T18:28:44.313436] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T18:28:44.320739] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-10T18:28:44.537926] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T18:28:44.546721] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-10T18:28:44.663190] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T18:28:44.674251] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-10T18:28:44.799551] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-10T18:28:44.810476] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-10T18:28:45.355486] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-10T18:28:45.363568] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-10T18:28:46.000829] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-10T18:28:46.012192] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-10T18:28:46.123350] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T18:28:46.133496] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-10T18:28:46.547884] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T18:28:46.558966] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-10T18:28:46.907402] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-10T18:28:46.914012] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-10T18:28:47.799208] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T18:28:47.811370] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-10T18:28:47.898802] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-10T18:28:47.906922] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-10T18:28:48.239638] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-10T18:28:48.250013] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-10T18:28:48.283214] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T18:28:48.293444] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-10T18:28:49.179581] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-10T18:28:49.190154] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-10T18:28:49.560023] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T18:28:49.889390] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-10T18:28:50.376747] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T18:28:50.415856] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-10T18:28:50.689367] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-10T18:28:51.211009] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T18:28:51.489413] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-10T18:28:51.527940] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T18:28:52.289455] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-10T18:28:52.655065] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T18:28:53.089368] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-10T18:28:53.210002] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-10T18:28:53.889370] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-10T18:28:54.238245] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T18:28:54.689337] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-10T18:28:54.818471] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T18:28:55.489371] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-10T18:28:56.050964] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T18:28:56.289404] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-10T18:28:56.767771] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-10T18:28:57.089428] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-10T18:28:57.118546] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T18:28:57.889381] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-10T18:28:58.275457] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T18:28:58.653093] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-10T18:28:58.689344] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-10T18:28:59.490816] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T18:28:59.489955] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-10T18:29:00.289412] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-10T18:29:00.885303] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-10T18:29:01.089442] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-10T18:29:01.629435] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-10T18:29:01.889389] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-10T18:29:02.346936] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-10T18:29:02.689407] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-10T18:29:03.047289] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T18:29:03.489388] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-10T18:29:04.079969] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-10T18:29:04.289428] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-10T18:29:04.387043] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-10T18:29:04.392304] [INFO ] [REMOTE ] DOLE: Full fetch complete (54475 records). [2025-10-10T18:29:04.392518] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-10T18:29:04.787323] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-10T18:29:04.787426] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-10T18:29:04.788361] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-10T18:29:04.788431] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-10T18:29:04.789917] [DEBUG] [LOCAL ] DOLE: Trimmed 54475 records to 39510 (keeping 200 days of data) [2025-10-10T18:29:05.037740] [DEBUG] [LOCAL ] DOLE: Primary data saved (39510 records). [2025-10-10T18:29:05.037986] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-10T18:29:05.038133] [INFO ] [MAIN ] Update Progress: 641/2373 symbols completed. DOLE took 25.4s. Estimated remaining: 4h 0m 32s. Rate: 7.2 symbols/min [2025-10-10T18:29:05.093151] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-10T18:29:05.252803] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:29:05.288979] [DEBUG] [LOCAL ] DOUG: Loaded 34675 existing records from primary storage. [2025-10-10T18:29:05.289347] [INFO ] [MAIN ] DOUG: Loaded 34675 existing records. [2025-10-10T18:29:05.476306] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:29:05.476570] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-10T18:29:05.476622] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-10T18:29:05.477068] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-10T18:29:05.477128] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-10T18:29:05.684221] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-10T18:29:05.780553] [INFO ] [REMOTE ] DOCN: Full fetch complete (72129 records). [2025-10-10T18:29:05.801881] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-10T18:29:05.938889] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:29:05.983209] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-10T18:29:06.240561] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T18:29:06.340822] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-10T18:29:06.340925] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-10T18:29:06.342100] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-10T18:29:06.342172] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-10T18:29:06.343988] [DEBUG] [LOCAL ] DOCN: Trimmed 72129 records to 51555 (keeping 200 days of data) [2025-10-10T18:29:06.670378] [DEBUG] [LOCAL ] DOCN: Primary data saved (51555 records). [2025-10-10T18:29:06.670620] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-10T18:29:06.671210] [INFO ] [MAIN ] Update Progress: 642/2373 symbols completed. DOCN took 27.0s. Estimated remaining: 4h 0m 5s. Rate: 7.2 symbols/min [2025-10-10T18:29:06.704111] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-10T18:29:06.851400] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:29:06.905352] [DEBUG] [LOCAL ] DOV: Loaded 45846 existing records from primary storage. [2025-10-10T18:29:06.905814] [INFO ] [MAIN ] DOV: Loaded 45846 existing records. [2025-10-10T18:29:07.110240] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:29:07.110582] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-10T18:29:07.110635] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-10T18:29:07.110913] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-10T18:29:07.110968] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-10T18:29:07.492218] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:29:07.492861] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-10T18:29:07.531609] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-10T18:29:07.818595] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T18:29:08.289369] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-10T18:29:08.697073] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T18:29:09.089361] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-10T18:29:09.458556] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T18:29:09.887679] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-10T18:29:09.895029] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-10T18:29:10.689413] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-10T18:29:11.020187] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T18:29:11.489367] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-10T18:29:12.035386] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T18:29:12.269170] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T18:29:12.289333] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-10T18:29:12.988074] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-10T18:29:13.089368] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-10T18:29:13.821201] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-10T18:29:13.889393] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-10T18:29:14.689402] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-10T18:29:14.945302] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T18:29:14.949992] [INFO ] [REMOTE ] DOCS: Full fetch complete (73710 records). [2025-10-10T18:29:14.950125] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-10T18:29:14.951114] [FATAL] [VALIDATOR ] DOCS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:29:14.951290] [FATAL] [MAIN ] DOCS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:29:14.951336] [WARN ] [MAIN ] DOCS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:29:14.951380] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-10T18:29:14.951492] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-10T18:29:14.951546] [INFO ] [LOCAL ] DOCS: Starting deletion of derivative data. [2025-10-10T18:29:14.951918] [DEBUG] [LOCAL ] DOCS: Deleted derivative data file. [2025-10-10T18:29:14.952025] [INFO ] [MAIN ] Update Progress: 643/2373 symbols completed. DOCS took 35.3s. Estimated remaining: 3h 59m 57s. Rate: 7.2 symbols/min [2025-10-10T18:29:15.130308] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:29:15.191178] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-10-10T18:29:15.191588] [INFO ] [MAIN ] DOW: Loaded 54123 existing records. [2025-10-10T18:29:15.376833] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:29:15.377126] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-10T18:29:15.377220] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-10T18:29:15.377727] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-10T18:29:15.377784] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-10T18:29:15.494475] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-10T18:29:15.678203] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T18:29:15.761188] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:29:16.289403] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-10T18:29:16.828886] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-10T18:29:16.834026] [INFO ] [REMOTE ] DOC: Full fetch complete (77386 records). [2025-10-10T18:29:16.834150] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-10T18:29:17.094481] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-10T18:29:17.227519] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-10T18:29:17.227639] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-10T18:29:17.228716] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-10T18:29:17.228938] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-10T18:29:17.230604] [DEBUG] [LOCAL ] DOC: Trimmed 77386 records to 54327 (keeping 200 days of data) [2025-10-10T18:29:17.480961] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-10T18:29:17.608858] [DEBUG] [LOCAL ] DOC: Primary data saved (54327 records). [2025-10-10T18:29:17.609019] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-10T18:29:17.609122] [INFO ] [MAIN ] Update Progress: 644/2373 symbols completed. DOC took 38.0s. Estimated remaining: 3h 59m 33s. Rate: 7.2 symbols/min [2025-10-10T18:29:17.779731] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:29:17.797167] [DEBUG] [LOCAL ] DPG: Loaded 13621 existing records from primary storage. [2025-10-10T18:29:17.797410] [INFO ] [MAIN ] DPG: Loaded 13621 existing records. [2025-10-10T18:29:17.895105] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-10T18:29:17.977998] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:29:17.978314] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-10T18:29:17.978375] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-10T18:29:17.978939] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-10T18:29:17.978998] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-10T18:29:18.330680] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:29:18.689456] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-10T18:29:18.961387] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-10T18:29:18.997638] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T18:29:19.489419] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-10T18:29:19.805271] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-10T18:29:19.805741] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-10T18:29:20.289400] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-10T18:29:21.089482] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-10T18:29:21.250375] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-10T18:29:21.724214] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-10T18:29:21.743234] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-10T18:29:21.889391] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-10T18:29:22.689408] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-10T18:29:23.444352] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-10T18:29:23.489458] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-10T18:29:24.289413] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-10T18:29:24.430684] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-10T18:29:24.476661] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T18:29:25.089419] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-10T18:29:25.889399] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-10T18:29:26.423841] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-10T18:29:26.567537] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-10T18:29:26.689360] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-10T18:29:27.435314] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T18:29:27.489419] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-10T18:29:28.289409] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-10T18:29:28.411959] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-10T18:29:28.666028] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T18:29:29.089398] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-10T18:29:29.369034] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-10T18:29:29.889417] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-10T18:29:30.413919] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T18:29:30.689393] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-10T18:29:31.489386] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-10T18:29:32.289412] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-10T18:29:32.628507] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-10T18:29:32.884955] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (3.00 seconds). [2025-10-10T18:29:33.071276] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-10T18:29:33.089330] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-10T18:29:33.599026] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-10T18:29:33.602825] [INFO ] [REMOTE ] DOUG: Full fetch complete (50734 records). [2025-10-10T18:29:33.602960] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-10T18:29:33.895498] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-10T18:29:34.002662] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-10T18:29:34.002773] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-10T18:29:34.003683] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-10T18:29:34.003748] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-10T18:29:34.005168] [DEBUG] [LOCAL ] DOUG: Trimmed 50734 records to 34887 (keeping 200 days of data) [2025-10-10T18:29:34.217422] [DEBUG] [LOCAL ] DOUG: Primary data saved (34887 records). [2025-10-10T18:29:34.217619] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-10T18:29:34.217770] [INFO ] [MAIN ] Update Progress: 645/2373 symbols completed. DOUG took 29.2s. Estimated remaining: 3h 59m 47s. Rate: 7.2 symbols/min [2025-10-10T18:29:34.397002] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:29:34.440881] [DEBUG] [LOCAL ] DQ: Loaded 43865 existing records from primary storage. [2025-10-10T18:29:34.441271] [INFO ] [MAIN ] DQ: Loaded 43865 existing records. [2025-10-10T18:29:34.628632] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:29:34.628978] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-10T18:29:34.629179] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-10T18:29:34.629473] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-10T18:29:34.629529] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-10T18:29:34.692930] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-10T18:29:34.983343] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T18:29:35.026213] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:29:35.051183] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T18:29:35.489373] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-10T18:29:36.289401] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-10T18:29:36.632391] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-10T18:29:37.089377] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-10T18:29:37.155990] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-10T18:29:37.889389] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-10T18:29:38.234056] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-10T18:29:38.689359] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-10T18:29:39.196252] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-10T18:29:39.489425] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-10T18:29:40.052731] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-10T18:29:40.289330] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-10T18:29:40.505495] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T18:29:40.723209] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-10T18:29:41.089372] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-10T18:29:41.889443] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-10T18:29:42.689466] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-10T18:29:42.847663] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-10T18:29:42.871629] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T18:29:42.905165] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T18:29:43.489395] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-10T18:29:44.289407] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-10T18:29:44.487087] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T18:29:45.089375] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-10T18:29:45.897357] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-10T18:29:45.916725] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-10T18:29:45.991453] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-10T18:29:45.997046] [INFO ] [REMOTE ] DOV: Full fetch complete (65329 records). [2025-10-10T18:29:45.997234] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-10T18:29:46.381765] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-10T18:29:46.381861] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-10T18:29:46.382862] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-10T18:29:46.382926] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-10T18:29:46.384284] [DEBUG] [LOCAL ] DOV: Trimmed 65329 records to 46220 (keeping 200 days of data) [2025-10-10T18:29:46.675077] [DEBUG] [LOCAL ] DOV: Primary data saved (46220 records). [2025-10-10T18:29:46.675237] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-10T18:29:46.675764] [INFO ] [MAIN ] Update Progress: 646/2373 symbols completed. DOV took 40.0s. Estimated remaining: 3h 59m 50s. Rate: 7.2 symbols/min [2025-10-10T18:29:46.697101] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-10T18:29:46.860505] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:29:46.890565] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T18:29:46.893633] [INFO ] [REMOTE ] DPG: Full fetch complete (19004 records). [2025-10-10T18:29:46.893741] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-10T18:29:47.015282] [DEBUG] [LOCAL ] DRD: Loaded 37578 existing records from primary storage. [2025-10-10T18:29:47.037695] [INFO ] [MAIN ] DRD: Loaded 37578 existing records. [2025-10-10T18:29:47.531916] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:29:47.534837] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-10T18:29:47.535204] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-10T18:29:47.535314] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-10T18:29:47.545015] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-10T18:29:47.544252] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-10T18:29:47.545703] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-10T18:29:47.546286] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-10T18:29:47.546398] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-10T18:29:47.547941] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-10T18:29:47.548160] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-10T18:29:47.548061] [DEBUG] [LOCAL ] DPG: Trimmed 19004 records to 13769 (keeping 200 days of data) [2025-10-10T18:29:48.001866] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:29:48.009236] [DEBUG] [LOCAL ] DPG: Primary data saved (13769 records). [2025-10-10T18:29:48.009341] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-10T18:29:48.009415] [INFO ] [MAIN ] Update Progress: 647/2373 symbols completed. DPG took 30.4s. Estimated remaining: 3h 59m 23s. Rate: 7.2 symbols/min [2025-10-10T18:29:48.173460] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:29:48.224116] [DEBUG] [LOCAL ] DRH: Loaded 50811 existing records from primary storage. [2025-10-10T18:29:48.224450] [INFO ] [MAIN ] DRH: Loaded 50811 existing records. [2025-10-10T18:29:48.296939] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-10T18:29:48.402512] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:29:48.402783] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-10T18:29:48.402833] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-10T18:29:48.403086] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-10T18:29:48.403142] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-10T18:29:48.783736] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:29:49.089397] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-10T18:29:49.130771] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-10T18:29:49.521632] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T18:29:49.726018] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T18:29:49.889447] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-10T18:29:50.689372] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-10T18:29:51.036252] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T18:29:51.239581] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-10T18:29:51.489396] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-10T18:29:52.289412] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-10T18:29:52.675069] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-10T18:29:52.680491] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-10-10T18:29:52.680705] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-10T18:29:53.100880] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-10T18:29:53.104980] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-10T18:29:53.106183] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-10T18:29:53.107413] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-10T18:29:53.107510] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-10T18:29:53.109708] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 54513 (keeping 200 days of data) [2025-10-10T18:29:53.405206] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T18:29:53.517546] [DEBUG] [LOCAL ] DOW: Primary data saved (54513 records). [2025-10-10T18:29:53.517800] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-10T18:29:53.517922] [INFO ] [MAIN ] Update Progress: 648/2373 symbols completed. DOW took 38.6s. Estimated remaining: 3h 59m 7s. Rate: 7.2 symbols/min [2025-10-10T18:29:53.710145] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:29:53.710458] [DEBUG] [LOCAL ] DRI: No existing data file found in primary storage. [2025-10-10T18:29:53.710536] [WARN ] [MAIN ] DRI: No existing data found, performing full refresh instead. [2025-10-10T18:29:53.710741] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-10T18:29:53.710917] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-10T18:29:53.711081] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-10T18:29:53.711137] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-10T18:29:53.900037] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-10T18:29:54.096675] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:29:54.128189] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T18:29:54.534154] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-10T18:29:54.689405] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-10T18:29:55.489421] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-10T18:29:55.579267] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T18:29:56.289385] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-10T18:29:56.361877] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-10T18:29:57.089424] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-10T18:29:57.218070] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T18:29:57.889375] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-10T18:29:58.102899] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T18:29:58.689395] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-10T18:29:58.953268] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T18:29:59.489401] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-10T18:29:59.657110] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T18:29:59.867790] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T18:30:00.289430] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-10T18:30:01.089444] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-10T18:30:01.415407] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T18:30:01.889369] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-10T18:30:02.520626] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-10T18:30:02.689362] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-10T18:30:02.799267] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T18:30:03.489399] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-10T18:30:03.757507] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-10T18:30:04.289399] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-10T18:30:04.649255] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T18:30:04.800332] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T18:30:05.089448] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-10T18:30:05.889394] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-10T18:30:06.345784] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-10T18:30:06.498916] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-10T18:30:06.689393] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-10T18:30:07.489403] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-10T18:30:07.755160] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T18:30:08.294503] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-10T18:30:08.307014] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T18:30:09.089413] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-10T18:30:09.284705] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T18:30:09.822992] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T18:30:09.889379] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-10T18:30:10.544278] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-10T18:30:10.689396] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-10T18:30:11.489379] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-10T18:30:11.878502] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T18:30:12.289379] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-10T18:30:12.674375] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T18:30:13.089466] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-10T18:30:13.889422] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-10T18:30:14.015036] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T18:30:14.361177] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (2.87 seconds). [2025-10-10T18:30:14.441906] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T18:30:14.446692] [INFO ] [REMOTE ] DQ: Full fetch complete (62917 records). [2025-10-10T18:30:14.446869] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-10T18:30:14.447624] [FATAL] [VALIDATOR ] DQ: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:30:14.447738] [FATAL] [MAIN ] DQ: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:30:14.447787] [WARN ] [MAIN ] DQ: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:30:14.447832] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-10T18:30:14.447929] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-10-10T18:30:14.447987] [INFO ] [LOCAL ] DQ: Starting deletion of derivative data. [2025-10-10T18:30:14.448178] [DEBUG] [LOCAL ] DQ: Deleted derivative data file. [2025-10-10T18:30:14.448285] [INFO ] [MAIN ] Update Progress: 649/2373 symbols completed. DQ took 40.2s. Estimated remaining: 3h 59m 32s. Rate: 7.2 symbols/min [2025-10-10T18:30:14.642003] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:30:14.654412] [DEBUG] [LOCAL ] DRLL: Loaded 9351 existing records from primary storage. [2025-10-10T18:30:14.654724] [INFO ] [MAIN ] DRLL: Loaded 9351 existing records. [2025-10-10T18:30:14.698184] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-10T18:30:14.841955] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:30:14.842250] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-10T18:30:14.842299] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-10T18:30:14.842576] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-10T18:30:14.842683] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-10T18:30:15.210941] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:30:15.489429] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-10T18:30:16.289441] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-10T18:30:16.850610] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-10T18:30:16.856475] [INFO ] [REMOTE ] DRD: Full fetch complete (50729 records). [2025-10-10T18:30:16.856717] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-10T18:30:17.211794] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (3.32 seconds). [2025-10-10T18:30:17.255507] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-10T18:30:17.328873] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-10T18:30:17.329065] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-10T18:30:17.329984] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-10T18:30:17.330052] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-10T18:30:17.331439] [DEBUG] [LOCAL ] DRD: Trimmed 50729 records to 37897 (keeping 200 days of data) [2025-10-10T18:30:17.585821] [DEBUG] [LOCAL ] DRD: Primary data saved (37897 records). [2025-10-10T18:30:17.586022] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-10T18:30:17.586137] [INFO ] [MAIN ] Update Progress: 650/2373 symbols completed. DRD took 30.9s. Estimated remaining: 3h 59m 10s. Rate: 7.2 symbols/min [2025-10-10T18:30:17.753374] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-10T18:30:17.847138] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:30:17.882916] [DEBUG] [LOCAL ] DSL: Loaded 28765 existing records from primary storage. [2025-10-10T18:30:17.883296] [INFO ] [MAIN ] DSL: Loaded 28765 existing records. [2025-10-10T18:30:17.901681] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-10T18:30:18.094000] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:30:18.094270] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-10T18:30:18.094324] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-10T18:30:18.094691] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-10T18:30:18.094751] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-10T18:30:18.491737] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:30:18.501113] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-10T18:30:18.689376] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-10T18:30:19.105961] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T18:30:19.489356] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-10T18:30:19.652879] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-10T18:30:19.936013] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T18:30:20.289423] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-10T18:30:21.089408] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-10T18:30:21.298423] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-10T18:30:21.383555] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T18:30:21.889440] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-10T18:30:22.177499] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-10T18:30:22.689405] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-10T18:30:23.489409] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-10T18:30:23.640504] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T18:30:23.645106] [INFO ] [REMOTE ] DRH: Full fetch complete (71520 records). [2025-10-10T18:30:23.645223] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-10T18:30:23.646059] [FATAL] [VALIDATOR ] DRH: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:30:23.646154] [FATAL] [MAIN ] DRH: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:30:23.646197] [WARN ] [MAIN ] DRH: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:30:23.646268] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-10T18:30:23.646371] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-10T18:30:23.646429] [INFO ] [LOCAL ] DRH: Starting deletion of derivative data. [2025-10-10T18:30:23.646660] [DEBUG] [LOCAL ] DRH: Deleted derivative data file. [2025-10-10T18:30:23.647617] [INFO ] [MAIN ] Update Progress: 651/2373 symbols completed. DRH took 35.6s. Estimated remaining: 3h 58m 56s. Rate: 7.2 symbols/min [2025-10-10T18:30:23.858425] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:30:23.859757] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T18:30:23.886886] [DEBUG] [LOCAL ] DSM: Loaded 14667 existing records from primary storage. [2025-10-10T18:30:23.887244] [INFO ] [MAIN ] DSM: Loaded 14667 existing records. [2025-10-10T18:30:24.123936] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:30:24.124222] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-10T18:30:24.124293] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-10T18:30:24.124573] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-10T18:30:24.124630] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-10T18:30:24.298826] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-10T18:30:24.527102] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:30:25.089359] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-10T18:30:25.573241] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T18:30:25.639256] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-10T18:30:25.889422] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-10T18:30:26.616388] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-10T18:30:26.689399] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-10T18:30:26.885066] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-10T18:30:27.489417] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-10T18:30:28.289394] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-10T18:30:28.537361] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-10T18:30:28.542230] [INFO ] [REMOTE ] DRI: Full fetch complete (69402 records). [2025-10-10T18:30:28.542339] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-10T18:30:28.905617] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T18:30:28.953837] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-10T18:30:28.953936] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-10T18:30:28.954948] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-10T18:30:28.955014] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-10T18:30:28.956497] [DEBUG] [LOCAL ] DRI: Trimmed 69402 records to 48366 (keeping 200 days of data) [2025-10-10T18:30:29.135551] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-10T18:30:29.258746] [DEBUG] [LOCAL ] DRI: Primary data saved (48366 records). [2025-10-10T18:30:29.258923] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-10T18:30:29.259017] [INFO ] [MAIN ] Update Progress: 652/2373 symbols completed. DRI took 35.7s. Estimated remaining: 3h 58m 40s. Rate: 7.2 symbols/min [2025-10-10T18:30:29.430124] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:30:29.434566] [DEBUG] [LOCAL ] DSMC: Loaded 1848 existing records from primary storage. [2025-10-10T18:30:29.434748] [INFO ] [MAIN ] DSMC: Loaded 1848 existing records. [2025-10-10T18:30:29.612472] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:30:29.612760] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-10T18:30:29.612826] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-10T18:30:29.613010] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-10T18:30:29.613067] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-10T18:30:29.849361] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-10T18:30:29.896872] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-10T18:30:30.057009] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:30:30.200191] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-10T18:30:30.689402] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-10T18:30:31.108523] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-10T18:30:31.489423] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-10T18:30:32.106020] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-10T18:30:32.185297] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-10T18:30:32.289373] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-10T18:30:33.089352] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-10T18:30:33.706159] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-10T18:30:33.889356] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-10T18:30:34.069122] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T18:30:34.438885] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-10T18:30:34.689377] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-10T18:30:35.489348] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-10T18:30:36.041691] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T18:30:36.289361] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-10T18:30:36.468018] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T18:30:36.825971] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-10T18:30:37.089423] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-10T18:30:37.889393] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-10T18:30:37.969671] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-10T18:30:38.689417] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-10T18:30:39.261696] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-10T18:30:39.317910] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-10T18:30:39.489439] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-10T18:30:40.289398] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-10T18:30:40.949927] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-10T18:30:41.089468] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-10T18:30:41.269777] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T18:30:41.889444] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-10T18:30:42.319002] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T18:30:42.328616] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-10T18:30:42.689398] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-10T18:30:43.433411] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-10T18:30:43.489383] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-10T18:30:44.231502] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T18:30:44.232820] [INFO ] [REMOTE ] DRLL: Full fetch complete (14922 records). [2025-10-10T18:30:44.232890] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-10T18:30:44.299153] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-10T18:30:44.645425] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-10T18:30:44.645553] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-10T18:30:44.646293] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-10T18:30:44.646362] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-10T18:30:44.647057] [DEBUG] [LOCAL ] DRLL: Trimmed 14922 records to 9406 (keeping 200 days of data) [2025-10-10T18:30:44.707394] [DEBUG] [LOCAL ] DRLL: Primary data saved (9406 records). [2025-10-10T18:30:44.707584] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-10T18:30:44.707712] [INFO ] [MAIN ] Update Progress: 653/2373 symbols completed. DRLL took 30.3s. Estimated remaining: 3h 58m 51s. Rate: 7.2 symbols/min [2025-10-10T18:30:44.884237] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:30:44.909897] [DEBUG] [LOCAL ] DSU: Loaded 23027 existing records from primary storage. [2025-10-10T18:30:44.910215] [INFO ] [MAIN ] DSU: Loaded 23027 existing records. [2025-10-10T18:30:45.091061] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-10T18:30:45.090926] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:30:45.092621] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-10T18:30:45.092720] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-10T18:30:45.093002] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-10T18:30:45.093064] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-10T18:30:45.483425] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:30:45.889380] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-10T18:30:46.036172] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-10T18:30:46.051802] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T18:30:46.689357] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-10T18:30:47.230065] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T18:30:47.489402] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-10T18:30:47.850026] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-10T18:30:48.289383] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-10T18:30:48.864130] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T18:30:49.089394] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-10T18:30:49.801672] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T18:30:49.889404] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-10T18:30:50.051348] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-10T18:30:50.689366] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-10T18:30:51.336886] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-10T18:30:51.489384] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-10T18:30:51.736178] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-10T18:30:51.896520] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-10T18:30:52.289424] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-10T18:30:53.089386] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-10T18:30:53.621944] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T18:30:53.625348] [INFO ] [REMOTE ] DSL: Full fetch complete (41509 records). [2025-10-10T18:30:53.625445] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-10T18:30:53.697754] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-10T18:30:53.894567] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-10T18:30:53.999926] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-10T18:30:54.000013] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-10T18:30:54.000723] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-10T18:30:54.000786] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-10T18:30:54.001909] [DEBUG] [LOCAL ] DSL: Trimmed 41509 records to 29051 (keeping 200 days of data) [2025-10-10T18:30:54.183333] [DEBUG] [LOCAL ] DSL: Primary data saved (29051 records). [2025-10-10T18:30:54.183554] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-10T18:30:54.183688] [INFO ] [MAIN ] Update Progress: 654/2373 symbols completed. DSL took 36.6s. Estimated remaining: 3h 58m 45s. Rate: 7.2 symbols/min [2025-10-10T18:30:54.348594] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:30:54.371105] [DEBUG] [LOCAL ] DSX: Loaded 24199 existing records from primary storage. [2025-10-10T18:30:54.371365] [INFO ] [MAIN ] DSX: Loaded 24199 existing records. [2025-10-10T18:30:54.543068] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:30:54.543242] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-10T18:30:54.543289] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-10T18:30:54.543788] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-10T18:30:54.543847] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-10T18:30:54.694000] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-10T18:30:54.895284] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:30:55.225749] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-10T18:30:55.239071] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T18:30:55.489431] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-10T18:30:56.289420] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-10T18:30:56.608236] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T18:30:56.783882] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-10T18:30:57.089427] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-10T18:30:57.621334] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-10T18:30:57.622117] [INFO ] [REMOTE ] DSMC: Full fetch complete (2842 records). [2025-10-10T18:30:57.622184] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-10T18:30:57.894580] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-10T18:30:57.980898] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-10T18:30:57.980982] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-10T18:30:57.981090] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-10T18:30:57.981170] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-10T18:30:57.981533] [DEBUG] [LOCAL ] DSMC: Trimmed 2842 records to 1870 (keeping 200 days of data) [2025-10-10T18:30:57.993044] [DEBUG] [LOCAL ] DSMC: Primary data saved (1870 records). [2025-10-10T18:30:57.993102] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-10T18:30:57.993189] [INFO ] [MAIN ] Update Progress: 655/2373 symbols completed. DSMC took 28.7s. Estimated remaining: 3h 58m 25s. Rate: 7.2 symbols/min [2025-10-10T18:30:58.163785] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:30:58.212560] [DEBUG] [LOCAL ] DT: Loaded 53326 existing records from primary storage. [2025-10-10T18:30:58.212946] [INFO ] [MAIN ] DT: Loaded 53326 existing records. [2025-10-10T18:30:58.400951] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:30:58.401271] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-10T18:30:58.401326] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-10T18:30:58.402331] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-10T18:30:58.402395] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-10T18:30:58.694635] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-10T18:30:58.769981] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:30:59.189771] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T18:30:59.489375] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-10T18:31:00.289358] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-10T18:31:00.499671] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T18:31:00.901331] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-10T18:31:01.089345] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-10T18:31:01.419274] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-10T18:31:01.421033] [INFO ] [REMOTE ] DSM: Full fetch complete (24025 records). [2025-10-10T18:31:01.421107] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-10T18:31:01.860099] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-10T18:31:01.860192] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-10T18:31:01.860820] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-10T18:31:01.860881] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-10T18:31:01.861479] [DEBUG] [LOCAL ] DSM: Trimmed 24025 records to 14743 (keeping 200 days of data) [2025-10-10T18:31:01.898158] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-10T18:31:01.952220] [DEBUG] [LOCAL ] DSM: Primary data saved (14743 records). [2025-10-10T18:31:01.952382] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-10T18:31:01.952470] [INFO ] [MAIN ] Update Progress: 656/2373 symbols completed. DSM took 38.3s. Estimated remaining: 3h 58m 5s. Rate: 7.2 symbols/min [2025-10-10T18:31:02.117270] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:31:02.124205] [DEBUG] [LOCAL ] DTB: Loaded 5053 existing records from primary storage. [2025-10-10T18:31:02.124411] [INFO ] [MAIN ] DTB: Loaded 5053 existing records. [2025-10-10T18:31:02.301054] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:31:02.301327] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-10T18:31:02.301375] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-10T18:31:02.301749] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-10T18:31:02.301817] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-10T18:31:02.595027] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T18:31:02.689114] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:31:02.689481] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-10T18:31:03.149323] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-10T18:31:03.489392] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-10T18:31:03.761627] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-10T18:31:04.289456] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-10T18:31:04.946166] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T18:31:05.026407] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-10T18:31:05.089400] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-10T18:31:05.776575] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-10T18:31:05.889411] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-10T18:31:06.689384] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-10T18:31:07.336850] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-10T18:31:07.489409] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-10T18:31:07.777870] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T18:31:08.289356] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-10T18:31:08.859237] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T18:31:09.089407] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-10T18:31:09.889399] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-10T18:31:09.947885] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-10T18:31:10.585821] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-10T18:31:10.623775] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-10T18:31:10.689435] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-10T18:31:11.489388] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-10T18:31:11.912317] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T18:31:12.168442] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-10T18:31:12.289421] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-10T18:31:13.089408] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-10T18:31:13.778426] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T18:31:13.889413] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-10T18:31:14.056826] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-10T18:31:14.689386] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-10T18:31:15.221725] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T18:31:15.489382] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-10T18:31:16.130705] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T18:31:16.133969] [INFO ] [REMOTE ] DSU: Full fetch complete (32927 records). [2025-10-10T18:31:16.134083] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-10T18:31:16.298568] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-10T18:31:16.539691] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-10T18:31:16.539842] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-10T18:31:16.540695] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-10T18:31:16.540871] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-10T18:31:16.542108] [DEBUG] [LOCAL ] DSU: Trimmed 32927 records to 23217 (keeping 200 days of data) [2025-10-10T18:31:16.673344] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-10T18:31:16.718632] [DEBUG] [LOCAL ] DSU: Primary data saved (23217 records). [2025-10-10T18:31:16.718820] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-10T18:31:16.718921] [INFO ] [MAIN ] Update Progress: 657/2373 symbols completed. DSU took 32.0s. Estimated remaining: 3h 58m 14s. Rate: 7.2 symbols/min [2025-10-10T18:31:16.898056] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:31:16.898368] [DEBUG] [LOCAL ] DTE: No existing data file found in primary storage. [2025-10-10T18:31:16.898415] [WARN ] [MAIN ] DTE: No existing data found, performing full refresh instead. [2025-10-10T18:31:16.898586] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-10T18:31:16.898666] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-10T18:31:16.898744] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-10T18:31:16.898783] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-10T18:31:17.094681] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-10T18:31:17.279104] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:31:17.889395] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-10T18:31:18.158746] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T18:31:18.552708] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-10T18:31:18.642148] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-10T18:31:18.689377] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-10T18:31:19.489417] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-10T18:31:19.983600] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T18:31:20.289409] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-10T18:31:21.021505] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-10T18:31:21.064841] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T18:31:21.089420] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-10T18:31:21.889383] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-10T18:31:21.927905] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-10T18:31:22.689381] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-10T18:31:23.311411] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-10T18:31:23.489453] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-10T18:31:23.509074] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T18:31:23.510775] [INFO ] [REMOTE ] DTB: Full fetch complete (6803 records). [2025-10-10T18:31:23.510877] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-10T18:31:23.511488] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:31:23.511595] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:31:23.511692] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:31:23.511787] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-10T18:31:23.511894] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-10T18:31:23.511970] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-10-10T18:31:23.512279] [DEBUG] [LOCAL ] DTB: Deleted derivative data file. [2025-10-10T18:31:23.512408] [INFO ] [MAIN ] Update Progress: 658/2373 symbols completed. DTB took 21.6s. Estimated remaining: 3h 58m 2s. Rate: 7.2 symbols/min [2025-10-10T18:31:23.788068] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:31:23.788315] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-10T18:31:23.788382] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-10T18:31:23.788543] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-10T18:31:23.788609] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-10T18:31:23.788689] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-10T18:31:23.788742] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-10T18:31:24.194399] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:31:24.289394] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-10T18:31:24.911297] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-10T18:31:25.089390] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-10T18:31:25.889413] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-10T18:31:26.332829] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-10T18:31:26.689422] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-10T18:31:26.716485] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-10T18:31:26.933755] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T18:31:27.489350] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-10T18:31:27.907884] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-10T18:31:28.290040] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-10T18:31:28.763232] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-10T18:31:29.089401] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-10T18:31:29.512106] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-10T18:31:29.889387] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-10T18:31:30.064964] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T18:31:30.439240] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-10T18:31:30.689394] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-10T18:31:31.489421] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-10T18:31:32.289397] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-10T18:31:32.549102] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T18:31:32.605316] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-10T18:31:33.089383] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-10T18:31:33.545040] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-10T18:31:33.622917] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-10T18:31:33.889409] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-10T18:31:34.689395] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-10T18:31:35.096748] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-10T18:31:35.489457] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-10T18:31:35.896592] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T18:31:36.289435] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-10T18:31:37.023301] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-10T18:31:37.089437] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-10T18:31:37.889432] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-10T18:31:38.374262] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-10T18:31:38.377913] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-10T18:31:38.689386] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-10T18:31:39.122490] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-10T18:31:39.210436] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-10T18:31:39.489452] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-10T18:31:40.289399] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-10T18:31:40.897482] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-10T18:31:41.089351] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-10T18:31:41.425945] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-10T18:31:41.431064] [INFO ] [REMOTE ] DT: Full fetch complete (76655 records). [2025-10-10T18:31:41.431193] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-10T18:31:41.629637] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-10T18:31:41.676024] [INFO ] [REMOTE ] DTF: Full fetch complete (1887 records). [2025-10-10T18:31:41.723143] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-10T18:31:41.900095] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-10T18:31:41.981836] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-10T18:31:41.997759] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-10T18:31:42.014402] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-10T18:31:42.032545] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-10T18:31:42.069269] [DEBUG] [LOCAL ] DT: Trimmed 76655 records to 53704 (keeping 200 days of data) [2025-10-10T18:31:42.075502] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-10T18:31:42.076161] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:31:42.076263] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:31:42.076559] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-10T18:31:42.076633] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-10T18:31:42.076742] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-10T18:31:42.076819] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-10T18:31:42.076893] [INFO ] [MAIN ] Update Progress: 659/2373 symbols completed. DTF took 18.6s. Estimated remaining: 3h 58m 20s. Rate: 7.2 symbols/min [2025-10-10T18:31:42.335382] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:31:42.347889] [DEBUG] [LOCAL ] DTG: Loaded 5881 existing records from primary storage. [2025-10-10T18:31:42.348758] [INFO ] [MAIN ] DTG: Loaded 5881 existing records. [2025-10-10T18:31:42.534170] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:31:42.535161] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-10T18:31:42.535549] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-10T18:31:42.536845] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-10T18:31:42.537475] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-10T18:31:42.693308] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-10T18:31:43.008333] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:31:43.130503] [DEBUG] [LOCAL ] DT: Primary data saved (53704 records). [2025-10-10T18:31:43.130728] [INFO ] [MAIN ] DT: Full history saved. [2025-10-10T18:31:43.130854] [INFO ] [MAIN ] Update Progress: 660/2373 symbols completed. DT took 45.1s. Estimated remaining: 3h 57m 53s. Rate: 7.2 symbols/min [2025-10-10T18:31:43.317390] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:31:43.317770] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-10T18:31:43.317830] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-10T18:31:43.317971] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-10T18:31:43.318015] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-10T18:31:43.318060] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-10T18:31:43.318094] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-10T18:31:43.481553] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-10T18:31:43.502158] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-10T18:31:43.733869] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:31:44.289424] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-10T18:31:44.523240] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T18:31:44.523624] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-10T18:31:44.523743] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:31:44.523797] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-10T18:31:44.523834] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:31:44.523905] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-10T18:31:44.523976] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-10T18:31:44.524016] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-10T18:31:44.524091] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-10T18:31:44.524169] [INFO ] [MAIN ] Update Progress: 661/2373 symbols completed. DTK took 1.4s. Estimated remaining: 3h 57m 26s. Rate: 7.2 symbols/min [2025-10-10T18:31:44.711989] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:31:44.712346] [DEBUG] [LOCAL ] DTM: No existing data file found in primary storage. [2025-10-10T18:31:44.712412] [WARN ] [MAIN ] DTM: No existing data found, performing full refresh instead. [2025-10-10T18:31:44.712735] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-10T18:31:44.712853] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-10T18:31:44.712975] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-10T18:31:44.713032] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-10T18:31:44.829324] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T18:31:44.939599] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-10T18:31:45.094472] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-10T18:31:45.165031] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:31:45.889373] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-10T18:31:46.469476] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T18:31:46.689668] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-10T18:31:46.689355] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-10T18:31:47.489354] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-10T18:31:47.890400] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T18:31:47.893211] [INFO ] [REMOTE ] DSX: Full fetch complete (35944 records). [2025-10-10T18:31:47.893295] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-10T18:31:48.284496] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-10T18:31:48.284814] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-10T18:31:48.285113] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-10T18:31:48.287834] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-10T18:31:48.288942] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-10T18:31:48.289709] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-10T18:31:48.291353] [DEBUG] [LOCAL ] DSX: Trimmed 35944 records to 24407 (keeping 200 days of data) [2025-10-10T18:31:48.432339] [DEBUG] [LOCAL ] DSX: Primary data saved (24407 records). [2025-10-10T18:31:48.432477] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-10T18:31:48.432559] [INFO ] [MAIN ] Update Progress: 662/2373 symbols completed. DSX took 54.2s. Estimated remaining: 3h 57m 7s. Rate: 7.2 symbols/min [2025-10-10T18:31:48.600787] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:31:48.608430] [DEBUG] [LOCAL ] DTW: Loaded 4922 existing records from primary storage. [2025-10-10T18:31:48.608640] [INFO ] [MAIN ] DTW: Loaded 4922 existing records. [2025-10-10T18:31:48.789378] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:31:48.789617] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-10T18:31:48.789695] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-10T18:31:48.789900] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-10T18:31:48.789958] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-10T18:31:49.096866] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-10T18:31:49.192991] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:31:49.889340] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-10T18:31:50.131860] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T18:31:50.689558] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-10T18:31:50.735755] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-10T18:31:51.165935] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-10T18:31:51.489370] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-10T18:31:52.289392] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-10T18:31:52.667193] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T18:31:53.089369] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-10T18:31:53.281580] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T18:31:53.344993] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-10T18:31:53.889380] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-10T18:31:54.692119] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-10T18:31:54.693685] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-10T18:31:55.066011] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T18:31:55.489380] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-10T18:31:56.213255] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-10T18:31:56.289365] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-10T18:31:56.570095] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T18:31:57.004149] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-10T18:31:57.089417] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-10T18:31:57.889415] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-10T18:31:58.689475] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-10T18:31:59.142179] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T18:31:59.489368] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-10T18:31:59.574385] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-10T18:31:59.937475] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T18:32:00.289410] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-10T18:32:01.089383] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-10T18:32:01.144364] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-10T18:32:01.357965] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T18:32:01.363335] [INFO ] [REMOTE ] DTE: Full fetch complete (68779 records). [2025-10-10T18:32:01.363532] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-10T18:32:01.764628] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-10T18:32:01.764779] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-10T18:32:01.765782] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-10T18:32:01.765851] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-10T18:32:01.767715] [DEBUG] [LOCAL ] DTE: Trimmed 68779 records to 48226 (keeping 200 days of data) [2025-10-10T18:32:01.889557] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-10T18:32:02.016941] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-10T18:32:02.104184] [DEBUG] [LOCAL ] DTE: Primary data saved (48226 records). [2025-10-10T18:32:02.104382] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-10T18:32:02.104523] [INFO ] [MAIN ] Update Progress: 663/2373 symbols completed. DTE took 45.4s. Estimated remaining: 3h 57m 12s. Rate: 7.2 symbols/min [2025-10-10T18:32:02.268360] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:32:02.323411] [DEBUG] [LOCAL ] DUK: Loaded 53830 existing records from primary storage. [2025-10-10T18:32:02.323759] [INFO ] [MAIN ] DUK: Loaded 53830 existing records. [2025-10-10T18:32:02.483387] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-10T18:32:02.503917] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:32:02.506525] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-10T18:32:02.506620] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-10T18:32:02.506334] [INFO ] [REMOTE ] DTG: Full fetch complete (8921 records). [2025-10-10T18:32:02.506878] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-10T18:32:02.542179] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-10T18:32:02.576182] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-10T18:32:02.693019] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-10T18:32:03.338341] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-10T18:32:03.362349] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-10T18:32:03.369932] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:32:03.370638] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-10T18:32:03.370757] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-10T18:32:03.371631] [DEBUG] [LOCAL ] DTG: Trimmed 8921 records to 5919 (keeping 200 days of data) [2025-10-10T18:32:03.413800] [DEBUG] [LOCAL ] DTG: Primary data saved (5919 records). [2025-10-10T18:32:03.414300] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-10T18:32:03.414446] [INFO ] [MAIN ] Update Progress: 664/2373 symbols completed. DTG took 21.3s. Estimated remaining: 3h 56m 46s. Rate: 7.2 symbols/min [2025-10-10T18:32:03.494455] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-10T18:32:03.551036] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-10T18:32:03.621151] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:32:03.632036] [DEBUG] [LOCAL ] DUKB: Loaded 6397 existing records from primary storage. [2025-10-10T18:32:03.632313] [INFO ] [MAIN ] DUKB: Loaded 6397 existing records. [2025-10-10T18:32:03.818769] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:32:03.819013] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-10T18:32:03.819064] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-10T18:32:03.819255] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-10T18:32:03.819318] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-10T18:32:04.220748] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:32:04.289434] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-10T18:32:05.089401] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-10T18:32:05.288498] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T18:32:05.479057] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T18:32:05.801878] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T18:32:05.889405] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-10T18:32:06.689411] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-10T18:32:07.489388] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-10T18:32:07.582815] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T18:32:07.643146] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T18:32:08.186459] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-10T18:32:08.289422] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-10T18:32:09.068596] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-10T18:32:09.089381] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-10T18:32:09.221698] [DEBUG] [REMOTE ] DTM: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-10T18:32:09.222139] [WARN ] [REMOTE ] DTM: No data returned for month 2025-06 [2025-10-10T18:32:09.222265] [FATAL] [REMOTE ] DTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:32:09.222401] [FATAL] [MAIN ] DTM: Failed to fetch primary data. [2025-10-10T18:32:09.222492] [WARN ] [MAIN ] DTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:32:09.222604] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-10T18:32:09.222760] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-10T18:32:09.222839] [INFO ] [LOCAL ] DTM: Starting deletion of derivative data. [2025-10-10T18:32:09.222938] [DEBUG] [LOCAL ] DTM: No derivative data file found to delete. [2025-10-10T18:32:09.223036] [INFO ] [MAIN ] Update Progress: 665/2373 symbols completed. DTM took 24.7s. Estimated remaining: 3h 56m 31s. Rate: 7.2 symbols/min [2025-10-10T18:32:09.409363] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:32:09.463948] [DEBUG] [LOCAL ] DV: Loaded 51658 existing records from primary storage. [2025-10-10T18:32:09.464325] [INFO ] [MAIN ] DV: Loaded 51658 existing records. [2025-10-10T18:32:09.647272] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:32:09.647547] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-10T18:32:09.647602] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-10T18:32:09.647919] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-10T18:32:09.647977] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-10T18:32:09.898027] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-10T18:32:10.030162] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:32:10.653507] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-10T18:32:10.689396] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-10T18:32:11.489419] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-10T18:32:11.636909] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-10T18:32:12.111439] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-10T18:32:12.289392] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-10T18:32:13.017904] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-10T18:32:13.089389] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-10T18:32:13.889407] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-10T18:32:13.889474] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-10T18:32:14.689378] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-10T18:32:15.489394] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-10T18:32:15.591442] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-10T18:32:16.184622] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-10T18:32:16.219092] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-10T18:32:16.289409] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-10T18:32:17.089408] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-10T18:32:17.151413] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-10T18:32:17.889422] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-10T18:32:18.689422] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-10T18:32:18.759732] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-10T18:32:19.090701] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T18:32:19.489457] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-10T18:32:19.738342] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-10T18:32:20.204303] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-10T18:32:20.289396] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-10T18:32:21.089477] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-10T18:32:21.881728] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-10T18:32:21.889331] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-10T18:32:22.528575] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-10T18:32:22.689435] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-10T18:32:22.760091] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T18:32:22.761302] [INFO ] [REMOTE ] DTW: Full fetch complete (7311 records). [2025-10-10T18:32:22.761381] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-10T18:32:23.173186] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-10T18:32:23.173275] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-10T18:32:23.173545] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-10T18:32:23.173588] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-10T18:32:23.174058] [DEBUG] [LOCAL ] DTW: Trimmed 7311 records to 4937 (keeping 200 days of data) [2025-10-10T18:32:23.208705] [DEBUG] [LOCAL ] DTW: Primary data saved (4937 records). [2025-10-10T18:32:23.208884] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-10T18:32:23.208993] [INFO ] [MAIN ] Update Progress: 666/2373 symbols completed. DTW took 34.8s. Estimated remaining: 3h 56m 37s. Rate: 7.2 symbols/min [2025-10-10T18:32:23.394164] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:32:23.430936] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-10T18:32:23.451360] [DEBUG] [LOCAL ] DVA: Loaded 41299 existing records from primary storage. [2025-10-10T18:32:23.451786] [INFO ] [MAIN ] DVA: Loaded 41299 existing records. [2025-10-10T18:32:23.494607] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-10T18:32:23.642571] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:32:23.642919] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-10T18:32:23.643002] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-10T18:32:23.643221] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-10T18:32:23.643279] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-10T18:32:24.050232] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:32:24.289390] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-10T18:32:24.294149] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-10T18:32:24.295253] [INFO ] [REMOTE ] DUKB: Full fetch complete (9312 records). [2025-10-10T18:32:24.295331] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-10T18:32:24.295842] [FATAL] [VALIDATOR ] DUKB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:32:24.295927] [FATAL] [MAIN ] DUKB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:32:24.295970] [WARN ] [MAIN ] DUKB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:32:24.296039] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-10T18:32:24.296106] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-10T18:32:24.296151] [INFO ] [LOCAL ] DUKB: Starting deletion of derivative data. [2025-10-10T18:32:24.296306] [DEBUG] [LOCAL ] DUKB: Deleted derivative data file. [2025-10-10T18:32:24.296404] [INFO ] [MAIN ] Update Progress: 667/2373 symbols completed. DUKB took 20.9s. Estimated remaining: 3h 56m 10s. Rate: 7.2 symbols/min [2025-10-10T18:32:24.488380] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:32:24.547208] [DEBUG] [LOCAL ] DVN: Loaded 54089 existing records from primary storage. [2025-10-10T18:32:24.547630] [INFO ] [MAIN ] DVN: Loaded 54089 existing records. [2025-10-10T18:32:24.745186] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:32:24.745466] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-10T18:32:24.745519] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-10T18:32:24.745791] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-10T18:32:24.745847] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-10T18:32:25.099292] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-10T18:32:25.106156] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:32:25.818669] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-10T18:32:25.889412] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-10T18:32:26.689392] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-10T18:32:27.224341] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-10T18:32:27.489392] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-10T18:32:28.289387] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-10T18:32:28.454158] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-10T18:32:28.491406] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T18:32:29.089414] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-10T18:32:29.271709] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-10T18:32:29.889361] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-10T18:32:30.149509] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T18:32:30.689349] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-10T18:32:31.054458] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-10T18:32:31.489496] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-10T18:32:31.942363] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-10T18:32:32.289380] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-10T18:32:32.617223] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-10T18:32:33.089339] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-10T18:32:33.308432] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T18:32:33.889455] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-10T18:32:34.585248] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-10T18:32:34.689373] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-10T18:32:34.924230] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T18:32:35.271198] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-10T18:32:35.489379] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-10T18:32:35.982737] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T18:32:36.289396] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-10T18:32:37.089359] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-10T18:32:37.480746] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T18:32:37.889371] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-10T18:32:38.246163] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T18:32:38.689378] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-10T18:32:39.294490] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-10T18:32:39.345287] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-10T18:32:39.489402] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-10T18:32:40.289369] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-10T18:32:40.549195] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T18:32:41.089425] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-10T18:32:41.889515] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-10T18:32:42.674491] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (3.19 seconds). [2025-10-10T18:32:42.689326] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-10T18:32:42.718951] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-10T18:32:43.129568] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T18:32:43.489364] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-10T18:32:43.575864] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T18:32:44.289398] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-10T18:32:44.859622] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-10T18:32:45.089358] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-10T18:32:45.692431] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-10T18:32:45.889404] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-10T18:32:46.081740] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T18:32:46.689404] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-10T18:32:46.797584] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-10T18:32:47.489381] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-10T18:32:48.096972] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-10T18:32:48.289376] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-10T18:32:48.576261] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T18:32:49.089394] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-10T18:32:49.525223] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-10T18:32:49.889436] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-10T18:32:50.480532] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-10T18:32:50.576121] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-10T18:32:50.689440] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-10T18:32:51.486129] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T18:32:51.496768] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-10T18:32:52.289343] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-10T18:32:52.664262] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T18:32:53.089457] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-10T18:32:53.680361] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-10T18:32:53.709191] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-10T18:32:53.714917] [INFO ] [REMOTE ] DUK: Full fetch complete (77390 records). [2025-10-10T18:32:53.715123] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-10T18:32:53.889995] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-10T18:32:54.165007] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-10T18:32:54.165119] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-10T18:32:54.166435] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-10T18:32:54.166502] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-10T18:32:54.168516] [DEBUG] [LOCAL ] DUK: Trimmed 77390 records to 54219 (keeping 200 days of data) [2025-10-10T18:32:54.522478] [DEBUG] [LOCAL ] DUK: Primary data saved (54219 records). [2025-10-10T18:32:54.522665] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-10T18:32:54.522807] [INFO ] [MAIN ] Update Progress: 668/2373 symbols completed. DUK took 52.4s. Estimated remaining: 3h 56m 58s. Rate: 7.2 symbols/min [2025-10-10T18:32:54.694152] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:32:54.692448] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-10T18:32:54.750217] [DEBUG] [LOCAL ] DX: Loaded 52858 existing records from primary storage. [2025-10-10T18:32:54.750614] [INFO ] [MAIN ] DX: Loaded 52858 existing records. [2025-10-10T18:32:54.938208] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:32:54.938621] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-10T18:32:54.938718] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-10T18:32:54.938980] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-10T18:32:54.939039] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-10T18:32:55.329483] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:32:55.370266] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-10T18:32:55.489371] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-10T18:32:56.168213] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-10T18:32:56.289413] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-10T18:32:56.313788] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-10T18:32:56.317706] [INFO ] [REMOTE ] DVA: Full fetch complete (59685 records). [2025-10-10T18:32:56.317812] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-10T18:32:56.740587] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-10T18:32:56.740697] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-10T18:32:56.741494] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-10T18:32:56.741537] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-10T18:32:56.742639] [DEBUG] [LOCAL ] DVA: Trimmed 59685 records to 41566 (keeping 200 days of data) [2025-10-10T18:32:57.007591] [DEBUG] [LOCAL ] DVA: Primary data saved (41566 records). [2025-10-10T18:32:57.007771] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-10T18:32:57.007870] [INFO ] [MAIN ] Update Progress: 669/2373 symbols completed. DVA took 33.8s. Estimated remaining: 3h 56m 35s. Rate: 7.2 symbols/min [2025-10-10T18:32:57.096860] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-10T18:32:57.179383] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:32:57.179567] [DEBUG] [LOCAL ] DXC: No existing data file found in primary storage. [2025-10-10T18:32:57.179604] [WARN ] [MAIN ] DXC: No existing data found, performing full refresh instead. [2025-10-10T18:32:57.179747] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-10T18:32:57.179791] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-10T18:32:57.179833] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-10T18:32:57.179865] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-10T18:32:57.540457] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:32:57.724048] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-10T18:32:57.729890] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-10-10T18:32:57.730095] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-10T18:32:57.903008] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-10T18:32:58.133176] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-10T18:32:58.133266] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-10T18:32:58.134269] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-10T18:32:58.134358] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-10T18:32:58.136373] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 54479 (keeping 200 days of data) [2025-10-10T18:32:58.248318] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-10T18:32:58.257227] [INFO ] [REMOTE ] DV: Full fetch complete (73576 records). [2025-10-10T18:32:58.258079] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-10T18:32:58.765162] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-10T18:32:58.765603] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-10T18:32:58.767023] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-10T18:32:58.793892] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-10T18:32:58.816916] [DEBUG] [LOCAL ] DV: Trimmed 73576 records to 52041 (keeping 200 days of data) [2025-10-10T18:32:59.036569] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T18:32:59.053726] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-10T18:32:59.133156] [DEBUG] [LOCAL ] DVN: Primary data saved (54479 records). [2025-10-10T18:32:59.142854] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-10T18:32:59.143337] [INFO ] [MAIN ] Update Progress: 670/2373 symbols completed. DVN took 34.8s. Estimated remaining: 3h 56m 11s. Rate: 7.2 symbols/min [2025-10-10T18:32:59.431504] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:32:59.456730] [DEBUG] [LOCAL ] DV: Primary data saved (52041 records). [2025-10-10T18:32:59.457023] [INFO ] [MAIN ] DV: Full history saved. [2025-10-10T18:32:59.457165] [INFO ] [MAIN ] Update Progress: 671/2373 symbols completed. DV took 50.2s. Estimated remaining: 3h 55m 42s. Rate: 7.2 symbols/min [2025-10-10T18:32:59.652974] [DEBUG] [LOCAL ] DXYZ: Loaded 37365 existing records from primary storage. [2025-10-10T18:32:59.673543] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:32:59.673963] [INFO ] [MAIN ] DXYZ: Loaded 37365 existing records. [2025-10-10T18:32:59.887408] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:32:59.896626] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-10T18:32:59.896999] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-10T18:32:59.898309] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T18:32:59.899002] [DEBUG] [LOCAL ] DY: Loaded 28668 existing records from primary storage. [2025-10-10T18:32:59.899129] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-10T18:32:59.907958] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-10T18:32:59.908074] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-10T18:32:59.920381] [INFO ] [MAIN ] DY: Loaded 28668 existing records. [2025-10-10T18:33:00.268390] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:33:00.319492] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-10T18:33:00.331458] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-10T18:33:00.368425] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-10T18:33:00.386861] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-10T18:33:00.632579] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:33:00.635721] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-10T18:33:00.833245] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:33:01.089342] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-10T18:33:01.375972] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-10T18:33:01.737077] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-10T18:33:01.889376] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-10T18:33:02.689418] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-10T18:33:02.958389] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T18:33:03.489356] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-10T18:33:03.594084] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-10T18:33:03.631480] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (3.00 seconds). [2025-10-10T18:33:04.289347] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-10T18:33:04.644392] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T18:33:05.010531] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-10T18:33:05.089332] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-10T18:33:05.889429] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-10T18:33:06.440936] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T18:33:06.580550] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-10T18:33:06.689388] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-10T18:33:07.489405] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-10T18:33:07.965684] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T18:33:08.289388] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-10T18:33:08.999906] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-10T18:33:09.089333] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-10T18:33:09.240838] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T18:33:09.889379] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-10T18:33:09.991529] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-10T18:33:10.689388] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-10T18:33:11.212411] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-10T18:33:11.324458] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-10T18:33:11.489408] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-10T18:33:12.289471] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-10T18:33:12.856915] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-10T18:33:13.089428] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-10T18:33:13.637385] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-10T18:33:13.735879] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-10T18:33:13.889388] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-10T18:33:14.689388] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-10T18:33:15.051548] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T18:33:15.489467] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-10T18:33:16.157688] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-10T18:33:16.289389] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-10T18:33:16.715698] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T18:33:17.089389] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-10T18:33:17.166972] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T18:33:17.889441] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-10T18:33:18.427356] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-10T18:33:18.689381] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-10T18:33:19.296463] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-10T18:33:19.489373] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-10T18:33:19.773077] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T18:33:20.289406] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-10T18:33:21.082617] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-10T18:33:21.090576] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-10T18:33:21.515203] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T18:33:21.889339] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-10T18:33:22.308810] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T18:33:22.335547] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T18:33:22.689377] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-10T18:33:23.489408] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-10T18:33:24.134406] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-10T18:33:24.289385] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-10T18:33:24.368538] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T18:33:25.089346] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-10T18:33:25.524291] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T18:33:25.889379] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-10T18:33:26.019417] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-10T18:33:26.025088] [INFO ] [REMOTE ] DX: Full fetch complete (75180 records). [2025-10-10T18:33:26.025295] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-10T18:33:26.026158] [FATAL] [VALIDATOR ] DX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:33:26.026297] [FATAL] [MAIN ] DX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:33:26.026343] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:33:26.026382] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-10T18:33:26.026446] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-10T18:33:26.026483] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-10-10T18:33:26.026817] [DEBUG] [LOCAL ] DX: Deleted derivative data file. [2025-10-10T18:33:26.026932] [INFO ] [MAIN ] Update Progress: 672/2373 symbols completed. DX took 31.5s. Estimated remaining: 3h 56m 20s. Rate: 7.2 symbols/min [2025-10-10T18:33:26.227082] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:33:26.243604] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-10T18:33:26.279908] [DEBUG] [LOCAL ] E: Loaded 33374 existing records from primary storage. [2025-10-10T18:33:26.280252] [INFO ] [MAIN ] E: Loaded 33374 existing records. [2025-10-10T18:33:26.459727] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:33:26.459981] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-10T18:33:26.460030] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-10T18:33:26.460305] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-10T18:33:26.460344] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-10T18:33:26.699040] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-10T18:33:26.850199] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:33:27.489398] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-10T18:33:27.693250] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T18:33:28.289416] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-10T18:33:28.885866] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-10T18:33:28.989251] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-10T18:33:29.089387] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-10T18:33:29.889360] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-10T18:33:30.318073] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T18:33:30.582404] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T18:33:30.689364] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-10T18:33:31.489353] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-10T18:33:31.593546] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T18:33:31.977886] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-10T18:33:31.980429] [INFO ] [REMOTE ] DY: Full fetch complete (43472 records). [2025-10-10T18:33:31.980547] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-10T18:33:31.981204] [FATAL] [VALIDATOR ] DY: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:33:31.981294] [FATAL] [MAIN ] DY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:33:31.981347] [WARN ] [MAIN ] DY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:33:31.981390] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-10T18:33:31.981455] [DEBUG] [LOCAL ] DY: No primary data file found to delete. [2025-10-10T18:33:31.981494] [INFO ] [LOCAL ] DY: Starting deletion of derivative data. [2025-10-10T18:33:31.981868] [DEBUG] [LOCAL ] DY: Deleted derivative data file. [2025-10-10T18:33:31.982158] [INFO ] [MAIN ] Update Progress: 673/2373 symbols completed. DY took 32.5s. Estimated remaining: 3h 56m 6s. Rate: 7.2 symbols/min [2025-10-10T18:33:32.150385] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:33:32.190406] [DEBUG] [LOCAL ] EAF: Loaded 42401 existing records from primary storage. [2025-10-10T18:33:32.190807] [INFO ] [MAIN ] EAF: Loaded 42401 existing records. [2025-10-10T18:33:32.290383] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-10T18:33:32.369344] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:33:32.369564] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-10T18:33:32.369612] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-10T18:33:32.369881] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-10T18:33:32.369938] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-10T18:33:32.724374] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:33:33.089355] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-10T18:33:33.411689] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-10T18:33:33.420179] [INFO ] [REMOTE ] DXC: Full fetch complete (69714 records). [2025-10-10T18:33:33.420359] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-10T18:33:33.831017] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-10T18:33:33.831113] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-10T18:33:33.832024] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-10T18:33:33.832088] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-10T18:33:33.833445] [DEBUG] [LOCAL ] DXC: Trimmed 69714 records to 50583 (keeping 200 days of data) [2025-10-10T18:33:33.896875] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-10T18:33:34.134433] [DEBUG] [LOCAL ] DXC: Primary data saved (50583 records). [2025-10-10T18:33:34.134568] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-10T18:33:34.134689] [INFO ] [MAIN ] Update Progress: 674/2373 symbols completed. DXC took 37.1s. Estimated remaining: 3h 55m 42s. Rate: 7.2 symbols/min [2025-10-10T18:33:34.304039] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:33:34.310748] [DEBUG] [LOCAL ] EAI: Loaded 4026 existing records from primary storage. [2025-10-10T18:33:34.310952] [INFO ] [MAIN ] EAI: Loaded 4026 existing records. [2025-10-10T18:33:34.485518] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:33:34.485737] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-10T18:33:34.485806] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-10T18:33:34.485961] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-10T18:33:34.485999] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-10T18:33:34.785860] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-10T18:33:34.865759] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57447 records). [2025-10-10T18:33:34.870753] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:33:34.871278] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-10T18:33:34.871627] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-10T18:33:34.928189] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T18:33:35.311756] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-10T18:33:35.311863] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-10T18:33:35.312824] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-10T18:33:35.312895] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-10T18:33:35.315912] [DEBUG] [LOCAL ] DXYZ: Trimmed 57447 records to 37713 (keeping 200 days of data) [2025-10-10T18:33:35.493989] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-10T18:33:35.552595] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37713 records). [2025-10-10T18:33:35.552838] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-10T18:33:35.552977] [INFO ] [MAIN ] Update Progress: 675/2373 symbols completed. DXYZ took 36.4s. Estimated remaining: 3h 55m 16s. Rate: 7.2 symbols/min [2025-10-10T18:33:35.731778] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:33:35.772961] [DEBUG] [LOCAL ] EARN: Loaded 29315 existing records from primary storage. [2025-10-10T18:33:35.773368] [INFO ] [MAIN ] EARN: Loaded 29315 existing records. [2025-10-10T18:33:35.819548] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-10T18:33:35.969090] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:33:35.969452] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-10T18:33:35.978920] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-10T18:33:35.994064] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-10T18:33:35.994202] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-10T18:33:36.065551] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T18:33:36.294526] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-10T18:33:36.363008] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:33:37.006887] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-10T18:33:37.019306] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-10T18:33:37.089381] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-10T18:33:37.807498] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-10T18:33:37.889398] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-10T18:33:38.689409] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-10T18:33:39.489454] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-10T18:33:39.943768] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T18:33:40.256617] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T18:33:40.289350] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-10T18:33:40.804929] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T18:33:41.089449] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-10T18:33:41.889371] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-10T18:33:42.230301] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T18:33:42.611845] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-10T18:33:42.689418] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-10T18:33:42.837929] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T18:33:43.489378] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-10T18:33:44.289408] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-10T18:33:44.352754] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-10T18:33:45.089352] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-10T18:33:45.223329] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T18:33:45.415174] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T18:33:45.889379] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-10T18:33:46.689405] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-10T18:33:46.809711] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-10T18:33:47.244896] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-10T18:33:47.489401] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-10T18:33:48.289399] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-10T18:33:48.680317] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T18:33:49.089441] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-10T18:33:49.279290] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T18:33:49.349455] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-10T18:33:49.889405] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-10T18:33:50.689434] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-10T18:33:50.969992] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T18:33:51.371001] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-10T18:33:51.489359] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-10T18:33:51.770536] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T18:33:51.881258] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-10T18:33:52.289378] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-10T18:33:52.970359] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-10T18:33:53.089402] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-10T18:33:53.740184] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-10T18:33:53.741186] [INFO ] [REMOTE ] EAI: Full fetch complete (6095 records). [2025-10-10T18:33:53.741255] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-10T18:33:53.891581] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-10T18:33:54.099128] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-10T18:33:54.099218] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-10T18:33:54.099443] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-10T18:33:54.099483] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-10T18:33:54.099874] [DEBUG] [LOCAL ] EAI: Trimmed 6095 records to 4046 (keeping 200 days of data) [2025-10-10T18:33:54.124196] [DEBUG] [LOCAL ] EAI: Primary data saved (4046 records). [2025-10-10T18:33:54.124308] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-10T18:33:54.124388] [INFO ] [MAIN ] Update Progress: 676/2373 symbols completed. EAI took 20.0s. Estimated remaining: 3h 55m 34s. Rate: 7.2 symbols/min [2025-10-10T18:33:54.292414] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:33:54.339861] [DEBUG] [LOCAL ] EAT: Loaded 50205 existing records from primary storage. [2025-10-10T18:33:54.340197] [INFO ] [MAIN ] EAT: Loaded 50205 existing records. [2025-10-10T18:33:54.527817] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:33:54.528049] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-10T18:33:54.528097] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-10T18:33:54.528339] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-10T18:33:54.528397] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-10T18:33:54.691722] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-10T18:33:54.901612] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:33:55.489356] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-10T18:33:55.966086] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T18:33:56.289398] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-10T18:33:56.506863] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T18:33:56.565546] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-10T18:33:57.089419] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-10T18:33:57.889355] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-10T18:33:58.136319] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T18:33:58.689385] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-10T18:33:58.774210] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T18:33:59.489394] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-10T18:33:59.523407] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T18:34:00.289419] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-10T18:34:00.658677] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-10T18:34:01.089406] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-10T18:34:01.127376] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-10T18:34:01.889402] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-10T18:34:02.068000] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T18:34:02.689410] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-10T18:34:03.059368] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T18:34:03.403745] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T18:34:03.489407] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-10T18:34:03.683442] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-10T18:34:04.289429] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-10T18:34:04.514854] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-10T18:34:05.089470] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-10T18:34:05.810800] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T18:34:05.889391] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-10T18:34:06.689387] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-10T18:34:07.030590] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-10T18:34:07.112833] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T18:34:07.489446] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-10T18:34:08.185365] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T18:34:08.189105] [INFO ] [REMOTE ] EAF: Full fetch complete (63005 records). [2025-10-10T18:34:08.189246] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-10T18:34:08.295414] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-10T18:34:08.630288] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-10T18:34:08.630388] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-10T18:34:08.631417] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-10T18:34:08.631483] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-10T18:34:08.632833] [DEBUG] [LOCAL ] EAF: Trimmed 63005 records to 42686 (keeping 200 days of data) [2025-10-10T18:34:08.899280] [DEBUG] [LOCAL ] EAF: Primary data saved (42686 records). [2025-10-10T18:34:08.899428] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-10T18:34:08.899512] [INFO ] [MAIN ] Update Progress: 677/2373 symbols completed. EAF took 36.9s. Estimated remaining: 3h 55m 41s. Rate: 7.2 symbols/min [2025-10-10T18:34:09.089416] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-10T18:34:09.663869] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-10T18:34:09.736994] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T18:34:09.740461] [INFO ] [REMOTE ] E: Full fetch complete (47882 records). [2025-10-10T18:34:09.740554] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-10T18:34:09.896715] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-10T18:34:10.116115] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-10T18:34:10.176826] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-10T18:34:10.176930] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-10T18:34:10.177786] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-10T18:34:10.177851] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-10T18:34:10.180136] [DEBUG] [LOCAL ] E: Trimmed 47882 records to 33622 (keeping 200 days of data) [2025-10-10T18:34:10.382478] [DEBUG] [LOCAL ] E: Primary data saved (33622 records). [2025-10-10T18:34:10.382667] [INFO ] [MAIN ] E: Full history saved. [2025-10-10T18:34:10.382782] [INFO ] [MAIN ] Update Progress: 678/2373 symbols completed. E took 44.4s. Estimated remaining: 3h 55m 16s. Rate: 7.2 symbols/min [2025-10-10T18:34:10.689393] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-10T18:34:12.329309] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-10T18:34:12.340439] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-10T18:34:12.475536] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-10T18:34:12.479288] [INFO ] [REMOTE ] EARN: Full fetch complete (45658 records). [2025-10-10T18:34:12.479487] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-10T18:34:12.886536] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-10T18:34:12.886633] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-10T18:34:12.887348] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-10T18:34:12.887394] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-10T18:34:12.888321] [DEBUG] [LOCAL ] EARN: Trimmed 45658 records to 29576 (keeping 200 days of data) [2025-10-10T18:34:13.061082] [DEBUG] [LOCAL ] EARN: Primary data saved (29576 records). [2025-10-10T18:34:13.061244] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-10T18:34:13.061342] [INFO ] [MAIN ] Update Progress: 679/2373 symbols completed. EARN took 37.5s. Estimated remaining: 3h 54m 53s. Rate: 7.2 symbols/min [2025-10-10T18:34:14.496711] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T18:34:14.508347] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-10T18:34:16.569328] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-10T18:34:16.580003] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-10T18:34:18.574871] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T18:34:18.586032] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-10T18:34:20.791184] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-10T18:34:20.801823] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-10T18:34:22.785175] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T18:34:22.796204] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-10T18:34:24.815337] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-10T18:34:24.820408] [INFO ] [REMOTE ] EAT: Full fetch complete (72102 records). [2025-10-10T18:34:24.820554] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-10T18:34:25.197506] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-10T18:34:25.197597] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-10T18:34:25.198530] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-10T18:34:25.198595] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-10T18:34:25.200011] [DEBUG] [LOCAL ] EAT: Trimmed 72102 records to 50552 (keeping 200 days of data) [2025-10-10T18:34:25.497106] [DEBUG] [LOCAL ] EAT: Primary data saved (50552 records). [2025-10-10T18:34:25.497307] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-10T18:34:25.497676] [INFO ] [MAIN ] Update Progress: 680/2373 symbols completed. EAT took 31.4s. Estimated remaining: 3h 54m 55s. Rate: 7.2 symbols/min [2025-10-10T18:34:26.071393] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:34:26.153896] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:34:26.195621] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:34:26.215233] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:34:26.269912] [DEBUG] [LOCAL ] EBF: Loaded 19184 existing records from primary storage. [2025-10-10T18:34:26.270296] [INFO ] [MAIN ] EBF: Loaded 19184 existing records. [2025-10-10T18:34:26.362559] [DEBUG] [LOCAL ] EB: Loaded 37092 existing records from primary storage. [2025-10-10T18:34:26.409548] [INFO ] [MAIN ] EB: Loaded 37092 existing records. [2025-10-10T18:34:26.414140] [DEBUG] [LOCAL ] EBS: Loaded 47100 existing records from primary storage. [2025-10-10T18:34:26.419987] [DEBUG] [LOCAL ] EBR: Loaded 43463 existing records from primary storage. [2025-10-10T18:34:26.437451] [INFO ] [MAIN ] EBS: Loaded 47100 existing records. [2025-10-10T18:34:26.442806] [INFO ] [MAIN ] EBR: Loaded 43463 existing records. [2025-10-10T18:34:26.706748] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:34:26.780021] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-10T18:34:26.808965] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-10T18:34:26.865177] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-10T18:34:26.983122] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-10T18:34:27.027367] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:34:27.050491] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:34:27.061894] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-10T18:34:27.061996] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-10T18:34:27.084042] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-10T18:34:27.083880] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:34:27.089355] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-10T18:34:27.089434] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-10T18:34:27.094702] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-10T18:34:27.094756] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-10T18:34:27.108423] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-10T18:34:27.122448] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-10T18:34:27.148968] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-10T18:34:27.171762] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-10T18:34:27.217346] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-10T18:34:28.449107] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:34:28.429559] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:34:28.465721] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-10T18:34:28.465343] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:34:28.466895] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-10T18:34:28.471493] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-10T18:34:28.554122] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:34:28.554534] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-10T18:34:30.007871] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T18:34:30.011712] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-10T18:34:30.489406] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T18:34:30.498852] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-10T18:34:30.831720] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-10T18:34:30.842279] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-10T18:34:31.089846] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-10T18:34:31.099409] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-10T18:34:31.196082] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-10T18:34:31.200071] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-10T18:34:32.163196] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T18:34:32.173277] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-10T18:34:32.209747] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T18:34:32.220797] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-10T18:34:32.454450] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T18:34:32.459328] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-10T18:34:32.682551] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-10T18:34:32.692131] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-10T18:34:33.801541] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T18:34:33.810371] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-10T18:34:33.896577] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-10T18:34:33.902886] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-10T18:34:33.943417] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T18:34:33.951920] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-10T18:34:34.541969] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T18:34:34.554548] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-10T18:34:35.155778] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T18:34:35.161088] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-10T18:34:35.227269] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T18:34:35.237498] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-10T18:34:35.517265] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T18:34:35.527330] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-10T18:34:35.829611] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-10T18:34:35.834206] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-10T18:34:35.897469] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-10T18:34:35.907798] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-10T18:34:36.689548] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-10T18:34:36.698895] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-10T18:34:37.031668] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T18:34:37.041718] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-10T18:34:37.094961] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T18:34:37.099951] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-10T18:34:37.329960] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-10T18:34:37.340035] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-10T18:34:38.300513] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-10T18:34:38.309088] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-10T18:34:38.338838] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T18:34:38.343899] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-10T18:34:38.801484] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T18:34:38.810901] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-10T18:34:38.925882] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-10T18:34:39.489408] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-10T18:34:39.557766] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T18:34:39.841508] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T18:34:40.048356] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T18:34:40.289394] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-10T18:34:41.089353] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-10T18:34:41.178771] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T18:34:41.412729] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-10T18:34:41.889454] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-10T18:34:42.334836] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T18:34:42.689444] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-10T18:34:43.370482] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-10T18:34:43.489350] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-10T18:34:44.289404] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-10T18:34:44.704326] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-10T18:34:45.089364] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-10T18:34:45.310498] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T18:34:45.834801] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-10T18:34:45.841441] [INFO ] [REMOTE ] EBF: Full fetch complete (27674 records). [2025-10-10T18:34:45.841685] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-10T18:34:45.895972] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-10T18:34:46.164974] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-10T18:34:46.277488] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-10T18:34:46.277577] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-10T18:34:46.278212] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-10T18:34:46.278275] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-10T18:34:46.278990] [DEBUG] [LOCAL ] EBF: Trimmed 27674 records to 19352 (keeping 200 days of data) [2025-10-10T18:34:46.395568] [DEBUG] [LOCAL ] EBF: Primary data saved (19352 records). [2025-10-10T18:34:46.395767] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-10T18:34:46.395860] [INFO ] [MAIN ] Update Progress: 681/2373 symbols completed. EBF took 20.9s. Estimated remaining: 3h 55m 18s. Rate: 7.2 symbols/min [2025-10-10T18:34:46.578341] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:34:46.578583] [DEBUG] [LOCAL ] EC: No existing data file found in primary storage. [2025-10-10T18:34:46.578625] [WARN ] [MAIN ] EC: No existing data found, performing full refresh instead. [2025-10-10T18:34:46.578759] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-10T18:34:46.578799] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-10T18:34:46.578864] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-10T18:34:46.578897] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-10T18:34:46.695403] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-10T18:34:46.983524] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:34:47.489417] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-10T18:34:47.881751] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T18:34:48.297129] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-10T18:34:48.299828] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-10T18:34:49.089410] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-10T18:34:49.635582] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-10T18:34:49.889355] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-10T18:34:50.176902] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T18:34:50.288690] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T18:34:50.689437] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-10T18:34:51.259132] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-10T18:34:51.262950] [INFO ] [REMOTE ] EB: Full fetch complete (55635 records). [2025-10-10T18:34:51.263063] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-10T18:34:51.496775] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-10T18:34:51.663047] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-10T18:34:51.663149] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-10T18:34:51.664177] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-10T18:34:51.664247] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-10T18:34:51.665864] [DEBUG] [LOCAL ] EB: Trimmed 55635 records to 37311 (keeping 200 days of data) [2025-10-10T18:34:51.885156] [DEBUG] [LOCAL ] EB: Primary data saved (37311 records). [2025-10-10T18:34:51.885315] [INFO ] [MAIN ] EB: Full history saved. [2025-10-10T18:34:51.885403] [INFO ] [MAIN ] Update Progress: 682/2373 symbols completed. EB took 26.4s. Estimated remaining: 3h 55m 3s. Rate: 7.2 symbols/min [2025-10-10T18:34:52.049687] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:34:52.081322] [DEBUG] [LOCAL ] ECAT: Loaded 29593 existing records from primary storage. [2025-10-10T18:34:52.081743] [INFO ] [MAIN ] ECAT: Loaded 29593 existing records. [2025-10-10T18:34:52.257188] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:34:52.257437] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-10T18:34:52.257485] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-10T18:34:52.257792] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-10T18:34:52.257850] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-10T18:34:52.299759] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-10T18:34:52.646003] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:34:52.657949] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-10T18:34:52.662319] [INFO ] [REMOTE ] EBS: Full fetch complete (67000 records). [2025-10-10T18:34:52.662508] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-10T18:34:52.664144] [FATAL] [VALIDATOR ] EBS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:34:52.664276] [FATAL] [MAIN ] EBS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:34:52.664346] [WARN ] [MAIN ] EBS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:34:52.664426] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-10T18:34:52.664504] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-10T18:34:52.664557] [INFO ] [LOCAL ] EBS: Starting deletion of derivative data. [2025-10-10T18:34:52.664807] [DEBUG] [LOCAL ] EBS: Deleted derivative data file. [2025-10-10T18:34:52.664971] [INFO ] [MAIN ] Update Progress: 683/2373 symbols completed. EBS took 27.2s. Estimated remaining: 3h 54m 36s. Rate: 7.2 symbols/min [2025-10-10T18:34:52.839592] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:34:52.883045] [DEBUG] [LOCAL ] ECC: Loaded 43399 existing records from primary storage. [2025-10-10T18:34:52.883372] [INFO ] [MAIN ] ECC: Loaded 43399 existing records. [2025-10-10T18:34:53.088284] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:34:53.092367] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-10T18:34:53.094319] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-10T18:34:53.094461] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-10T18:34:53.095081] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T18:34:53.099583] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-10T18:34:53.099821] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-10T18:34:53.112691] [INFO ] [REMOTE ] EBR: Full fetch complete (62482 records). [2025-10-10T18:34:53.149166] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-10T18:34:53.888922] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:34:53.927945] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-10T18:34:53.928151] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-10T18:34:53.929249] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-10T18:34:53.930215] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-10T18:34:53.931556] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-10T18:34:53.933190] [DEBUG] [LOCAL ] EBR: Trimmed 62482 records to 43824 (keeping 200 days of data) [2025-10-10T18:34:54.209400] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T18:34:54.231162] [DEBUG] [LOCAL ] EBR: Primary data saved (43824 records). [2025-10-10T18:34:54.232064] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-10T18:34:54.232593] [INFO ] [MAIN ] Update Progress: 684/2373 symbols completed. EBR took 28.7s. Estimated remaining: 3h 54m 11s. Rate: 7.2 symbols/min [2025-10-10T18:34:54.395985] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:34:54.396252] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-10T18:34:54.396295] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-10T18:34:54.396423] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-10T18:34:54.396464] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-10T18:34:54.396504] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-10T18:34:54.396540] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-10T18:34:54.703731] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-10T18:34:54.747181] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:34:55.273461] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-10T18:34:55.489356] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-10T18:34:55.628837] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T18:34:56.151253] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-10T18:34:56.289367] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-10T18:34:56.675456] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-10T18:34:56.717219] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-10T18:34:57.089411] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-10T18:34:57.889384] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-10T18:34:58.344601] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-10T18:34:58.689396] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-10T18:34:59.067106] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T18:34:59.489394] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-10T18:35:00.289394] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-10T18:35:00.400043] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T18:35:00.709099] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-10T18:35:01.089370] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-10T18:35:01.889409] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-10T18:35:02.286556] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-10-10T18:35:02.689400] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-10T18:35:02.762832] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-10T18:35:03.118672] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-10T18:35:03.378257] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-10T18:35:03.489337] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-10T18:35:04.289525] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-10T18:35:04.943356] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-10T18:35:05.089408] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-10T18:35:05.611730] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-10T18:35:05.889395] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-10T18:35:06.419981] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-10T18:35:06.422727] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-10T18:35:06.689369] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-10T18:35:07.072553] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-10T18:35:07.489453] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-10T18:35:08.289406] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-10T18:35:08.685256] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-10T18:35:09.089395] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-10T18:35:09.490324] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-10T18:35:09.527450] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T18:35:09.889395] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-10T18:35:10.368232] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-10T18:35:10.369261] [INFO ] [REMOTE ] ECCC: Full fetch complete (1302 records). [2025-10-10T18:35:10.369348] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-10T18:35:10.369905] [FATAL] [VALIDATOR ] ECCC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:35:10.370005] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:35:10.370063] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:35:10.370119] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-10T18:35:10.370196] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-10T18:35:10.370248] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-10T18:35:10.370306] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-10T18:35:10.370378] [INFO ] [MAIN ] Update Progress: 685/2373 symbols completed. ECCC took 16.1s. Estimated remaining: 3h 54m 22s. Rate: 7.2 symbols/min [2025-10-10T18:35:10.556927] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:35:10.562049] [DEBUG] [LOCAL ] ECCU: Loaded 2264 existing records from primary storage. [2025-10-10T18:35:10.562227] [INFO ] [MAIN ] ECCU: Loaded 2264 existing records. [2025-10-10T18:35:10.698885] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-10T18:35:10.741063] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:35:10.741302] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-10T18:35:10.741350] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-10T18:35:10.741512] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-10T18:35:10.741567] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-10T18:35:11.106861] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:35:11.489381] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-10T18:35:12.289437] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-10T18:35:13.089368] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-10T18:35:13.204499] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-10T18:35:13.506191] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T18:35:13.570759] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-10T18:35:13.814029] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-10T18:35:13.889469] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-10T18:35:14.689584] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-10T18:35:15.450632] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T18:35:15.489334] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-10T18:35:16.289455] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-10T18:35:16.708749] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T18:35:16.893023] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-10T18:35:17.089366] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-10T18:35:17.505579] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-10T18:35:17.889346] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-10T18:35:18.248204] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T18:35:18.576557] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-10T18:35:18.689394] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-10T18:35:19.489370] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-10T18:35:19.524996] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-10T18:35:20.289424] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-10T18:35:21.089384] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-10T18:35:21.734150] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-10T18:35:21.889377] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-10T18:35:22.343024] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-10T18:35:22.547746] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T18:35:22.689399] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-10T18:35:23.489357] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-10T18:35:23.524557] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T18:35:24.289441] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-10T18:35:24.327802] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-10T18:35:24.475525] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-10T18:35:25.089422] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-10T18:35:25.889406] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-10T18:35:26.319928] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-10T18:35:26.689365] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-10T18:35:26.771055] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-10T18:35:27.489391] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-10T18:35:27.545852] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-10T18:35:27.550221] [INFO ] [REMOTE ] EC: Full fetch complete (71462 records). [2025-10-10T18:35:27.550387] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-10T18:35:27.551426] [FATAL] [VALIDATOR ] EC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:35:27.551527] [FATAL] [MAIN ] EC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:35:27.551675] [WARN ] [MAIN ] EC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:35:27.551765] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-10T18:35:27.551850] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-10T18:35:27.551886] [INFO ] [LOCAL ] EC: Starting deletion of derivative data. [2025-10-10T18:35:27.551926] [DEBUG] [LOCAL ] EC: No derivative data file found to delete. [2025-10-10T18:35:27.551994] [INFO ] [MAIN ] Update Progress: 686/2373 symbols completed. EC took 41.2s. Estimated remaining: 3h 54m 35s. Rate: 7.2 symbols/min [2025-10-10T18:35:27.725301] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:35:27.725538] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-10T18:35:27.725637] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-10T18:35:27.725806] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-10T18:35:27.725847] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-10T18:35:27.725914] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-10T18:35:27.725948] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-10T18:35:28.018133] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-10T18:35:28.096454] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:35:28.289382] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-10T18:35:28.439562] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T18:35:28.890459] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-10T18:35:29.089356] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-10T18:35:29.716332] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-10T18:35:29.889404] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-10T18:35:30.424033] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-10T18:35:30.689414] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-10T18:35:31.049234] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-10T18:35:31.489386] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-10T18:35:31.900239] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-10T18:35:32.289392] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-10T18:35:32.702570] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-10T18:35:33.089439] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-10T18:35:33.576320] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-10T18:35:33.889384] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-10T18:35:34.689384] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-10T18:35:35.276286] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-10T18:35:35.490661] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-10T18:35:35.492803] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T18:35:36.022608] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-10T18:35:36.289385] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-10T18:35:37.089429] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-10T18:35:37.474958] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-10T18:35:37.889369] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-10T18:35:38.139081] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T18:35:38.275853] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-10T18:35:38.689433] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-10T18:35:39.489390] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-10T18:35:40.289457] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-10T18:35:40.427344] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-10T18:35:40.449606] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T18:35:40.716560] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-10T18:35:40.717478] [INFO ] [REMOTE ] ECCU: Full fetch complete (4419 records). [2025-10-10T18:35:40.717554] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-10T18:35:41.089270] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-10T18:35:41.089432] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-10T18:35:41.089715] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-10T18:35:41.090605] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-10T18:35:41.091511] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-10T18:35:41.092289] [DEBUG] [LOCAL ] ECCU: Trimmed 4419 records to 2271 (keeping 200 days of data) [2025-10-10T18:35:41.107967] [DEBUG] [LOCAL ] ECCU: Primary data saved (2271 records). [2025-10-10T18:35:41.108082] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-10T18:35:41.108180] [INFO ] [MAIN ] Update Progress: 687/2373 symbols completed. ECCU took 30.7s. Estimated remaining: 3h 54m 40s. Rate: 7.2 symbols/min [2025-10-10T18:35:41.286972] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:35:41.287249] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-10T18:35:41.287300] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-10T18:35:41.287484] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-10T18:35:41.287533] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-10T18:35:41.287588] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-10T18:35:41.287632] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-10T18:35:41.674906] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:35:41.889394] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-10T18:35:42.536202] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T18:35:42.539404] [INFO ] [REMOTE ] ECAT: Full fetch complete (42914 records). [2025-10-10T18:35:42.539489] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-10T18:35:42.694609] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-10T18:35:42.934580] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-10T18:35:42.934958] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-10T18:35:42.935713] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-10T18:35:42.935775] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-10T18:35:42.936826] [DEBUG] [LOCAL ] ECAT: Trimmed 42914 records to 29861 (keeping 200 days of data) [2025-10-10T18:35:43.118857] [DEBUG] [LOCAL ] ECAT: Primary data saved (29861 records). [2025-10-10T18:35:43.119020] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-10T18:35:43.119127] [INFO ] [MAIN ] Update Progress: 688/2373 symbols completed. ECAT took 51.2s. Estimated remaining: 3h 54m 16s. Rate: 7.2 symbols/min [2025-10-10T18:35:43.221295] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-10T18:35:43.291529] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:35:43.291764] [DEBUG] [LOCAL ] ECG: No existing data file found in primary storage. [2025-10-10T18:35:43.291815] [WARN ] [MAIN ] ECG: No existing data found, performing full refresh instead. [2025-10-10T18:35:43.292008] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-10T18:35:43.292073] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-10T18:35:43.292114] [DEBUG] [LOCAL ] ECG: No primary data file found to delete. [2025-10-10T18:35:43.292152] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-10T18:35:43.496719] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-10T18:35:43.649146] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:35:43.665903] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T18:35:43.670492] [INFO ] [REMOTE ] ECC: Full fetch complete (61060 records). [2025-10-10T18:35:43.670664] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-10T18:35:43.962681] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-10T18:35:43.974046] [INFO ] [REMOTE ] ECCW: Full fetch complete (1427 records). [2025-10-10T18:35:43.979256] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-10T18:35:44.164483] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-10T18:35:44.174845] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-10T18:35:44.203482] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-10T18:35:44.230500] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-10T18:35:44.236973] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-10T18:35:44.237474] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:35:44.237677] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:35:44.237846] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-10T18:35:44.237982] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-10T18:35:44.238129] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-10T18:35:44.238227] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-10T18:35:44.238465] [INFO ] [MAIN ] Update Progress: 689/2373 symbols completed. ECCW took 16.7s. Estimated remaining: 3h 53m 50s. Rate: 7.2 symbols/min [2025-10-10T18:35:44.249829] [DEBUG] [LOCAL ] ECC: Trimmed 61060 records to 43742 (keeping 200 days of data) [2025-10-10T18:35:44.294623] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-10T18:35:44.525144] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:35:44.682044] [DEBUG] [LOCAL ] ECC: Primary data saved (43742 records). [2025-10-10T18:35:44.682200] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-10T18:35:44.682287] [INFO ] [MAIN ] Update Progress: 690/2373 symbols completed. ECC took 52.0s. Estimated remaining: 3h 53m 22s. Rate: 7.2 symbols/min [2025-10-10T18:35:44.815043] [DEBUG] [LOCAL ] ECL: Loaded 46987 existing records from primary storage. [2025-10-10T18:35:44.839486] [INFO ] [MAIN ] ECL: Loaded 46987 existing records. [2025-10-10T18:35:44.952629] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:35:44.976603] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-10T18:35:45.060180] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:35:45.060447] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-10T18:35:45.060496] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-10T18:35:45.061246] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-10T18:35:45.061317] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-10T18:35:45.095348] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-10T18:35:45.139831] [DEBUG] [LOCAL ] ECO: Loaded 18474 existing records from primary storage. [2025-10-10T18:35:45.173493] [INFO ] [MAIN ] ECO: Loaded 18474 existing records. [2025-10-10T18:35:45.546205] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:35:45.573916] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-10T18:35:45.598821] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-10T18:35:45.605467] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:35:45.607836] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-10T18:35:45.608929] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-10T18:35:45.609005] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-10T18:35:45.894575] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-10T18:35:45.966045] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:35:46.299201] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-10T18:35:46.689389] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-10T18:35:47.217129] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-10T18:35:47.489359] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-10T18:35:47.902972] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-10T18:35:48.289429] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-10T18:35:49.089390] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-10T18:35:49.889399] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-10T18:35:50.123629] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T18:35:50.279024] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-10T18:35:50.689379] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-10T18:35:50.776596] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T18:35:51.066239] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-10T18:35:51.489366] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-10T18:35:52.062663] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-10T18:35:52.289409] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-10T18:35:53.089381] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-10T18:35:53.747720] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T18:35:53.889447] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-10T18:35:54.681307] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T18:35:54.689325] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-10T18:35:55.239779] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T18:35:55.489379] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-10T18:35:56.289383] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-10T18:35:56.382311] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T18:35:57.089405] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-10T18:35:57.282038] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-10T18:35:57.330438] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T18:35:57.889362] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-10T18:35:58.379372] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T18:35:58.412611] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-10T18:35:58.689406] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-10T18:35:59.489388] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-10T18:35:59.911797] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-10T18:35:59.912614] [INFO ] [REMOTE ] ECCX: Full fetch complete (1444 records). [2025-10-10T18:35:59.912729] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-10T18:36:00.098047] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-10T18:36:00.098291] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:36:00.098364] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:36:00.098441] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-10T18:36:00.098514] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-10T18:36:00.098552] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-10T18:36:00.098592] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-10T18:36:00.098682] [INFO ] [MAIN ] Update Progress: 691/2373 symbols completed. ECCX took 19.0s. Estimated remaining: 3h 53m 31s. Rate: 7.2 symbols/min [2025-10-10T18:36:00.283330] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:36:00.289398] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-10T18:36:00.335027] [DEBUG] [LOCAL ] ECVT: Loaded 43520 existing records from primary storage. [2025-10-10T18:36:00.335483] [INFO ] [MAIN ] ECVT: Loaded 43520 existing records. [2025-10-10T18:36:00.530776] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:36:00.531133] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-10T18:36:00.531254] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-10T18:36:00.532147] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-10T18:36:00.532218] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-10T18:36:00.932970] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-10T18:36:01.005274] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:36:01.089439] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-10T18:36:01.889433] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-10T18:36:02.298496] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-10T18:36:02.689386] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-10T18:36:02.929371] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T18:36:03.344589] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-10T18:36:03.489389] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-10T18:36:04.289446] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-10T18:36:04.413177] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-10T18:36:04.970973] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-10T18:36:05.089396] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-10T18:36:05.889444] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-10T18:36:06.258187] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T18:36:06.689456] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-10T18:36:07.088711] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T18:36:07.153925] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T18:36:07.489388] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-10T18:36:08.156745] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-10T18:36:08.289343] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-10T18:36:09.089354] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-10T18:36:09.220427] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T18:36:09.881048] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T18:36:09.889388] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-10T18:36:10.689418] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-10T18:36:11.178141] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-10T18:36:11.489387] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-10T18:36:11.734487] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T18:36:12.295563] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-10T18:36:12.299268] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-10T18:36:12.560827] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-10T18:36:13.089406] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-10T18:36:13.221923] [DEBUG] [REMOTE ] ECG: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-10T18:36:13.222264] [WARN ] [REMOTE ] ECG: No data returned for month 2025-07 [2025-10-10T18:36:13.222360] [FATAL] [REMOTE ] ECG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:36:13.222438] [FATAL] [MAIN ] ECG: Failed to fetch primary data. [2025-10-10T18:36:13.222501] [WARN ] [MAIN ] ECG: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:36:13.222570] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-10T18:36:13.222635] [DEBUG] [LOCAL ] ECG: No primary data file found to delete. [2025-10-10T18:36:13.222712] [INFO ] [LOCAL ] ECG: Starting deletion of derivative data. [2025-10-10T18:36:13.222761] [DEBUG] [LOCAL ] ECG: No derivative data file found to delete. [2025-10-10T18:36:13.222810] [INFO ] [MAIN ] Update Progress: 692/2373 symbols completed. ECG took 30.1s. Estimated remaining: 3h 53m 34s. Rate: 7.2 symbols/min [2025-10-10T18:36:13.428909] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:36:13.482295] [DEBUG] [LOCAL ] ED: Loaded 53094 existing records from primary storage. [2025-10-10T18:36:13.482818] [INFO ] [MAIN ] ED: Loaded 53094 existing records. [2025-10-10T18:36:13.660385] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:36:13.660694] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-10T18:36:13.660911] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-10T18:36:13.669786] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-10T18:36:13.683993] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-10T18:36:13.750325] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-10T18:36:13.895949] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-10T18:36:14.058730] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:36:14.689355] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-10T18:36:15.391615] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T18:36:15.489414] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-10T18:36:16.289393] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-10T18:36:16.594957] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T18:36:17.089390] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-10T18:36:17.441873] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-10T18:36:17.889448] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-10T18:36:18.444000] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-10T18:36:18.689354] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-10T18:36:18.831224] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T18:36:19.133979] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-10T18:36:19.489418] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-10T18:36:20.289354] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-10T18:36:20.633109] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T18:36:20.667551] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T18:36:21.089411] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-10T18:36:21.889434] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-10T18:36:22.277040] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T18:36:22.689360] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-10T18:36:22.895352] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T18:36:23.489432] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-10T18:36:23.882466] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-10T18:36:23.952721] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T18:36:24.289398] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-10T18:36:25.089382] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-10T18:36:25.450197] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T18:36:25.836057] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-10T18:36:25.838152] [INFO ] [REMOTE ] ECO: Full fetch complete (28585 records). [2025-10-10T18:36:25.838225] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-10T18:36:25.901479] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-10T18:36:26.204608] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-10T18:36:26.204729] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-10T18:36:26.205316] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-10T18:36:26.205360] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-10T18:36:26.206261] [DEBUG] [LOCAL ] ECO: Trimmed 28585 records to 18639 (keeping 200 days of data) [2025-10-10T18:36:26.332368] [DEBUG] [LOCAL ] ECO: Primary data saved (18639 records). [2025-10-10T18:36:26.332539] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-10T18:36:26.332627] [INFO ] [MAIN ] Update Progress: 693/2373 symbols completed. ECO took 41.7s. Estimated remaining: 3h 53m 38s. Rate: 7.2 symbols/min [2025-10-10T18:36:26.507297] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:36:26.535021] [DEBUG] [LOCAL ] EDD: Loaded 27133 existing records from primary storage. [2025-10-10T18:36:26.535315] [INFO ] [MAIN ] EDD: Loaded 27133 existing records. [2025-10-10T18:36:26.694526] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-10T18:36:26.722705] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:36:26.723869] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-10T18:36:26.723982] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-10T18:36:26.724264] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-10T18:36:26.724331] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-10T18:36:27.117730] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:36:27.223115] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-10T18:36:27.489388] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-10T18:36:27.750347] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-10T18:36:27.755468] [INFO ] [REMOTE ] ECL: Full fetch complete (68021 records). [2025-10-10T18:36:27.755692] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-10T18:36:28.165503] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-10T18:36:28.165612] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-10T18:36:28.166623] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-10T18:36:28.166706] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-10T18:36:28.168608] [DEBUG] [LOCAL ] ECL: Trimmed 68021 records to 47324 (keeping 200 days of data) [2025-10-10T18:36:28.290519] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-10T18:36:28.470331] [DEBUG] [LOCAL ] ECL: Primary data saved (47324 records). [2025-10-10T18:36:28.470538] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-10T18:36:28.470724] [INFO ] [MAIN ] Update Progress: 694/2373 symbols completed. ECL took 44.2s. Estimated remaining: 3h 53m 14s. Rate: 7.2 symbols/min [2025-10-10T18:36:28.639540] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:36:28.658142] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-10T18:36:28.673994] [DEBUG] [LOCAL ] EDF: Loaded 13313 existing records from primary storage. [2025-10-10T18:36:28.674228] [INFO ] [MAIN ] EDF: Loaded 13313 existing records. [2025-10-10T18:36:28.884610] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-10T18:36:28.882692] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:36:28.893507] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-10T18:36:28.894123] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-10T18:36:28.894551] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-10T18:36:28.894900] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-10T18:36:29.098227] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-10T18:36:29.294993] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:36:29.889357] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-10T18:36:30.551987] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-10T18:36:30.689445] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-10T18:36:30.868842] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T18:36:31.367550] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T18:36:31.489366] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-10T18:36:32.289414] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-10T18:36:32.675873] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-10T18:36:32.746343] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-10T18:36:33.089387] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-10T18:36:33.510768] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-10T18:36:33.889349] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-10T18:36:34.220298] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-10T18:36:34.689395] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-10T18:36:35.226671] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T18:36:35.230631] [INFO ] [REMOTE ] ECVT: Full fetch complete (59790 records). [2025-10-10T18:36:35.230793] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-10T18:36:35.231388] [FATAL] [VALIDATOR ] ECVT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:36:35.231479] [FATAL] [MAIN ] ECVT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:36:35.231521] [WARN ] [MAIN ] ECVT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:36:35.231559] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-10T18:36:35.231614] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-10T18:36:35.231676] [INFO ] [LOCAL ] ECVT: Starting deletion of derivative data. [2025-10-10T18:36:35.231876] [DEBUG] [LOCAL ] ECVT: Deleted derivative data file. [2025-10-10T18:36:35.231966] [INFO ] [MAIN ] Update Progress: 695/2373 symbols completed. ECVT took 35.1s. Estimated remaining: 3h 53m 2s. Rate: 7.2 symbols/min [2025-10-10T18:36:35.401167] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:36:35.423157] [DEBUG] [LOCAL ] EDN: Loaded 18533 existing records from primary storage. [2025-10-10T18:36:35.423444] [INFO ] [MAIN ] EDN: Loaded 18533 existing records. [2025-10-10T18:36:35.495009] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-10T18:36:35.613350] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:36:35.613580] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-10T18:36:35.613630] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-10T18:36:35.613888] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-10T18:36:35.613948] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-10T18:36:35.981893] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:36:36.289424] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-10T18:36:36.691718] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-10T18:36:37.055171] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-10T18:36:37.089344] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-10T18:36:37.399002] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-10T18:36:37.889390] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-10T18:36:38.374585] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T18:36:38.689369] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-10T18:36:39.489403] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-10T18:36:39.653768] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T18:36:40.281221] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-10T18:36:40.289330] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-10T18:36:40.664083] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-10T18:36:41.089366] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-10T18:36:41.301155] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-10T18:36:41.889370] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-10T18:36:42.689426] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-10T18:36:42.726027] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T18:36:43.148702] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T18:36:43.489390] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-10T18:36:44.133817] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-10T18:36:44.289355] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-10T18:36:44.490372] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-10T18:36:45.089387] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-10T18:36:45.871283] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-10T18:36:45.889337] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-10T18:36:46.083940] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-10T18:36:46.689389] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-10T18:36:47.242726] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-10T18:36:47.489388] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-10T18:36:48.289402] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-10T18:36:48.753717] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T18:36:49.067324] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-10T18:36:49.089331] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-10T18:36:49.580561] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T18:36:49.889409] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-10T18:36:50.689381] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-10T18:36:51.121425] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T18:36:51.184388] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T18:36:51.489378] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-10T18:36:52.044232] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T18:36:52.047282] [INFO ] [REMOTE ] EDD: Full fetch complete (38404 records). [2025-10-10T18:36:52.047362] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-10T18:36:52.297919] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-10T18:36:52.436445] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-10T18:36:52.436549] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-10T18:36:52.437290] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-10T18:36:52.437352] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-10T18:36:52.438191] [DEBUG] [LOCAL ] EDD: Trimmed 38404 records to 27263 (keeping 200 days of data) [2025-10-10T18:36:52.606732] [DEBUG] [LOCAL ] EDD: Primary data saved (27263 records). [2025-10-10T18:36:52.606920] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-10T18:36:52.607021] [INFO ] [MAIN ] Update Progress: 696/2373 symbols completed. EDD took 26.3s. Estimated remaining: 3h 53m 16s. Rate: 7.2 symbols/min [2025-10-10T18:36:52.775273] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:36:52.795988] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T18:36:52.840310] [DEBUG] [LOCAL ] EDU: Loaded 45177 existing records from primary storage. [2025-10-10T18:36:52.840728] [INFO ] [MAIN ] EDU: Loaded 45177 existing records. [2025-10-10T18:36:53.018512] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:36:53.018814] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-10T18:36:53.018872] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-10T18:36:53.019206] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-10T18:36:53.019264] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-10T18:36:53.094488] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-10T18:36:53.374952] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:36:53.384877] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-10T18:36:53.889400] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-10T18:36:54.689354] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-10T18:36:54.911538] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-10T18:36:55.136089] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-10T18:36:55.489347] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-10T18:36:55.934238] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-10T18:36:56.289392] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-10T18:36:57.089372] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-10T18:36:57.217523] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-10T18:36:57.222903] [INFO ] [REMOTE ] ED: Full fetch complete (76281 records). [2025-10-10T18:36:57.223072] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-10T18:36:57.545690] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T18:36:57.656991] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-10T18:36:57.657097] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-10T18:36:57.658295] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-10T18:36:57.658366] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-10T18:36:57.660520] [DEBUG] [LOCAL ] ED: Trimmed 76281 records to 53462 (keeping 200 days of data) [2025-10-10T18:36:57.892764] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-10T18:36:58.039537] [DEBUG] [LOCAL ] ED: Primary data saved (53462 records). [2025-10-10T18:36:58.039726] [INFO ] [MAIN ] ED: Full history saved. [2025-10-10T18:36:58.039824] [INFO ] [MAIN ] Update Progress: 697/2373 symbols completed. ED took 44.8s. Estimated remaining: 3h 53m 0s. Rate: 7.2 symbols/min [2025-10-10T18:36:58.204597] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:36:58.237668] [DEBUG] [LOCAL ] EE: Loaded 33129 existing records from primary storage. [2025-10-10T18:36:58.237996] [INFO ] [MAIN ] EE: Loaded 33129 existing records. [2025-10-10T18:36:58.413186] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:36:58.413438] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-10T18:36:58.413486] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-10T18:36:58.413934] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-10T18:36:58.413991] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-10T18:36:58.702202] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-10T18:36:58.891957] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:36:58.897965] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-10T18:36:58.900817] [INFO ] [REMOTE ] EDF: Full fetch complete (20526 records). [2025-10-10T18:36:58.901091] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-10T18:36:59.278172] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-10T18:36:59.482479] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-10T18:36:59.482573] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-10T18:36:59.483188] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-10T18:36:59.483254] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-10T18:36:59.484041] [DEBUG] [LOCAL ] EDF: Trimmed 20526 records to 13415 (keeping 200 days of data) [2025-10-10T18:36:59.517393] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-10T18:36:59.572600] [DEBUG] [LOCAL ] EDF: Primary data saved (13415 records). [2025-10-10T18:36:59.572893] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-10T18:36:59.573001] [INFO ] [MAIN ] Update Progress: 698/2373 symbols completed. EDF took 31.1s. Estimated remaining: 3h 52m 36s. Rate: 7.2 symbols/min [2025-10-10T18:36:59.745288] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:36:59.745502] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-10T18:36:59.745540] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-10T18:36:59.745711] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-10T18:36:59.745767] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-10T18:36:59.745811] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-10T18:36:59.745845] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-10T18:37:00.025967] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T18:37:00.143168] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:37:00.289400] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-10T18:37:01.089482] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-10T18:37:01.284873] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T18:37:01.359051] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T18:37:01.889378] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-10T18:37:02.572154] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-10T18:37:02.574357] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-10T18:37:02.689376] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-10T18:37:03.489469] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-10T18:37:04.289404] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-10T18:37:04.504578] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T18:37:04.569168] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T18:37:04.879180] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-10T18:37:05.089391] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-10T18:37:05.830114] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-10T18:37:05.889486] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-10T18:37:06.689384] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-10T18:37:07.489398] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-10T18:37:07.496534] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-10T18:37:07.954728] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-10T18:37:08.289400] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-10T18:37:08.736636] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-10T18:37:09.089367] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-10T18:37:09.889387] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-10T18:37:10.016805] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T18:37:10.519249] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-10T18:37:10.519398] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-10T18:37:10.689414] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-10T18:37:11.475861] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-10T18:37:11.489328] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-10T18:37:12.174581] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-10T18:37:12.289371] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-10T18:37:13.089395] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-10T18:37:13.587976] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T18:37:13.707939] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-10T18:37:13.889386] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-10T18:37:14.689401] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-10T18:37:15.241052] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-10T18:37:15.422637] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-10T18:37:15.489354] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-10T18:37:16.289393] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-10T18:37:17.089426] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-10T18:37:17.245490] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T18:37:17.590946] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-10T18:37:17.591991] [INFO ] [REMOTE ] EEA: Full fetch complete (3873 records). [2025-10-10T18:37:17.592352] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-10T18:37:17.769222] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T18:37:17.769578] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:37:17.769744] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:37:17.769821] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-10T18:37:17.769889] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-10T18:37:17.769925] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-10T18:37:17.769963] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-10T18:37:17.770025] [INFO ] [MAIN ] Update Progress: 699/2373 symbols completed. EEA took 18.2s. Estimated remaining: 3h 52m 51s. Rate: 7.2 symbols/min [2025-10-10T18:37:17.906508] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-10T18:37:17.968354] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:37:18.007190] [DEBUG] [LOCAL ] EEX: Loaded 10865 existing records from primary storage. [2025-10-10T18:37:18.008022] [INFO ] [MAIN ] EEX: Loaded 10865 existing records. [2025-10-10T18:37:18.041134] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T18:37:18.201717] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:37:18.202039] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-10T18:37:18.202103] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-10T18:37:18.202316] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-10T18:37:18.202373] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-10T18:37:18.544847] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:37:18.689414] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-10T18:37:19.489429] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-10T18:37:19.514281] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-10T18:37:20.209126] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-10T18:37:20.211875] [INFO ] [REMOTE ] EDN: Full fetch complete (29598 records). [2025-10-10T18:37:20.211957] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-10T18:37:20.294543] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-10T18:37:20.599530] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-10T18:37:20.599625] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-10T18:37:20.600341] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-10T18:37:20.600395] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-10T18:37:20.601304] [DEBUG] [LOCAL ] EDN: Trimmed 29598 records to 18681 (keeping 200 days of data) [2025-10-10T18:37:20.721336] [DEBUG] [LOCAL ] EDN: Primary data saved (18681 records). [2025-10-10T18:37:20.721519] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-10T18:37:20.721639] [INFO ] [MAIN ] Update Progress: 700/2373 symbols completed. EDN took 45.5s. Estimated remaining: 3h 52m 30s. Rate: 7.2 symbols/min [2025-10-10T18:37:20.910352] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:37:20.916426] [DEBUG] [LOCAL ] EFC: No existing data file found in primary storage. [2025-10-10T18:37:20.916929] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T18:37:20.921406] [WARN ] [MAIN ] EFC: No existing data found, performing full refresh instead. [2025-10-10T18:37:20.921538] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-10T18:37:20.921584] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-10T18:37:20.921627] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-10T18:37:20.921698] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-10T18:37:21.092163] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-10T18:37:21.310506] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:37:21.889405] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-10T18:37:21.936428] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-10T18:37:22.645478] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T18:37:22.689342] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-10T18:37:23.063382] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T18:37:23.489408] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-10T18:37:24.289460] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-10T18:37:24.672584] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T18:37:25.089360] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-10T18:37:25.199749] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-10T18:37:25.396059] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T18:37:25.889395] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-10T18:37:26.526885] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T18:37:26.689386] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-10T18:37:27.136455] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-10T18:37:27.489418] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-10T18:37:27.994384] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T18:37:28.289373] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-10T18:37:28.434363] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-10T18:37:29.089385] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-10T18:37:29.898598] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-10T18:37:29.914750] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-10T18:37:29.933606] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-10T18:37:30.689441] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-10T18:37:31.489364] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-10T18:37:31.688876] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-10T18:37:31.693600] [INFO ] [REMOTE ] EDU: Full fetch complete (66590 records). [2025-10-10T18:37:31.693761] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-10T18:37:32.091412] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-10T18:37:32.091514] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-10T18:37:32.092597] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-10T18:37:32.092715] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-10T18:37:32.094476] [DEBUG] [LOCAL ] EDU: Trimmed 66590 records to 45535 (keeping 200 days of data) [2025-10-10T18:37:32.303443] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-10T18:37:32.377069] [DEBUG] [LOCAL ] EDU: Primary data saved (45535 records). [2025-10-10T18:37:32.377252] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-10T18:37:32.377548] [INFO ] [MAIN ] Update Progress: 701/2373 symbols completed. EDU took 39.8s. Estimated remaining: 3h 52m 29s. Rate: 7.2 symbols/min [2025-10-10T18:37:32.562436] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:37:32.573460] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-10T18:37:32.596355] [DEBUG] [LOCAL ] EFR: Loaded 15071 existing records from primary storage. [2025-10-10T18:37:32.596707] [INFO ] [MAIN ] EFR: Loaded 15071 existing records. [2025-10-10T18:37:32.792879] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:37:32.793284] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-10T18:37:32.793459] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-10T18:37:32.793768] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-10T18:37:32.793920] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-10T18:37:32.943250] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-10T18:37:33.094563] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-10T18:37:33.215511] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:37:33.752688] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-10T18:37:33.889393] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-10T18:37:34.689441] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-10T18:37:34.907155] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T18:37:35.489392] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-10T18:37:35.565379] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-10T18:37:35.569581] [INFO ] [REMOTE ] EE: Full fetch complete (43986 records). [2025-10-10T18:37:35.569806] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-10T18:37:35.968813] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-10T18:37:35.968911] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-10T18:37:35.969939] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-10T18:37:35.970009] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-10T18:37:35.971308] [DEBUG] [LOCAL ] EE: Trimmed 43986 records to 33445 (keeping 200 days of data) [2025-10-10T18:37:36.075026] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T18:37:36.199388] [DEBUG] [LOCAL ] EE: Primary data saved (33445 records). [2025-10-10T18:37:36.199570] [INFO ] [MAIN ] EE: Full history saved. [2025-10-10T18:37:36.199707] [INFO ] [MAIN ] Update Progress: 702/2373 symbols completed. EE took 38.2s. Estimated remaining: 3h 52m 10s. Rate: 7.2 symbols/min [2025-10-10T18:37:36.301070] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-10T18:37:36.381254] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:37:36.390564] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-10T18:37:36.407015] [DEBUG] [LOCAL ] EFT: Loaded 13215 existing records from primary storage. [2025-10-10T18:37:36.407326] [INFO ] [MAIN ] EFT: Loaded 13215 existing records. [2025-10-10T18:37:36.593838] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:37:36.594155] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-10T18:37:36.594208] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-10T18:37:36.594439] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-10T18:37:36.594502] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-10T18:37:36.957043] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:37:37.089384] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-10T18:37:37.257515] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-10T18:37:37.889373] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-10T18:37:38.002512] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T18:37:38.689352] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-10T18:37:38.790357] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T18:37:39.489390] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-10T18:37:40.001550] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-10T18:37:40.111534] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-10T18:37:40.289403] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-10T18:37:41.089432] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-10T18:37:41.433945] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-10T18:37:41.850892] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-10T18:37:41.889351] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-10T18:37:42.689449] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-10T18:37:42.825472] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T18:37:43.489405] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-10T18:37:44.289496] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-10T18:37:44.622329] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T18:37:44.627302] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-10T18:37:44.744682] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-10T18:37:45.089382] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-10T18:37:45.889411] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-10T18:37:46.030484] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-10T18:37:46.661282] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T18:37:46.662680] [INFO ] [REMOTE ] EEX: Full fetch complete (18743 records). [2025-10-10T18:37:46.662758] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-10T18:37:46.694632] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-10T18:37:47.055508] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-10T18:37:47.055617] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-10T18:37:47.056285] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-10T18:37:47.056347] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-10T18:37:47.057336] [DEBUG] [LOCAL ] EEX: Trimmed 18743 records to 10898 (keeping 200 days of data) [2025-10-10T18:37:47.124528] [DEBUG] [LOCAL ] EEX: Primary data saved (10898 records). [2025-10-10T18:37:47.124739] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-10T18:37:47.124875] [INFO ] [MAIN ] Update Progress: 703/2373 symbols completed. EEX took 29.4s. Estimated remaining: 3h 52m 8s. Rate: 7.2 symbols/min [2025-10-10T18:37:47.302633] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:37:47.351879] [DEBUG] [LOCAL ] EFX: Loaded 44924 existing records from primary storage. [2025-10-10T18:37:47.352248] [INFO ] [MAIN ] EFX: Loaded 44924 existing records. [2025-10-10T18:37:47.499382] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-10T18:37:47.544518] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:37:47.544911] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-10T18:37:47.544979] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-10T18:37:47.545975] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-10T18:37:47.546051] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-10T18:37:47.907096] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:37:48.289460] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-10T18:37:48.668708] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-10T18:37:48.895145] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-10T18:37:49.089405] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-10T18:37:49.889412] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-10T18:37:50.191981] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T18:37:50.262265] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T18:37:50.689475] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-10T18:37:51.067146] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T18:37:51.489436] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-10T18:37:52.090811] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-10T18:37:52.289388] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-10T18:37:52.519351] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-10T18:37:53.089406] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-10T18:37:53.374437] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T18:37:53.889395] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-10T18:37:54.689419] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-10T18:37:55.047038] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-10T18:37:55.146740] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-10T18:37:55.489433] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-10T18:37:55.757702] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-10T18:37:56.289390] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-10T18:37:56.663837] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-10T18:37:57.089355] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-10T18:37:57.231881] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-10T18:37:57.889430] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-10T18:37:58.216010] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-10T18:37:58.218261] [INFO ] [REMOTE ] EFR: Full fetch complete (19228 records). [2025-10-10T18:37:58.218330] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-10T18:37:58.577356] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-10T18:37:58.577448] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-10T18:37:58.577954] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-10T18:37:58.578016] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-10T18:37:58.578676] [DEBUG] [LOCAL ] EFR: Trimmed 19228 records to 15218 (keeping 200 days of data) [2025-10-10T18:37:58.671285] [DEBUG] [LOCAL ] EFR: Primary data saved (15218 records). [2025-10-10T18:37:58.671447] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-10T18:37:58.671613] [INFO ] [MAIN ] Update Progress: 704/2373 symbols completed. EFR took 26.3s. Estimated remaining: 3h 52m 7s. Rate: 7.2 symbols/min [2025-10-10T18:37:58.694550] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-10T18:37:58.843525] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:37:58.873119] [DEBUG] [LOCAL ] EFXT: Loaded 29630 existing records from primary storage. [2025-10-10T18:37:58.873424] [INFO ] [MAIN ] EFXT: Loaded 29630 existing records. [2025-10-10T18:37:59.044928] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:37:59.045161] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-10T18:37:59.045207] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-10T18:37:59.045415] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-10T18:37:59.045470] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-10T18:37:59.426204] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:37:59.489388] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-10T18:37:59.651586] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T18:38:00.289382] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-10T18:38:00.356071] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-10T18:38:00.537007] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-10T18:38:01.089386] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-10T18:38:01.889412] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-10T18:38:02.078469] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T18:38:02.112045] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T18:38:02.114012] [INFO ] [REMOTE ] EFT: Full fetch complete (17894 records). [2025-10-10T18:38:02.114119] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-10T18:38:02.114741] [FATAL] [VALIDATOR ] EFT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:38:02.114830] [FATAL] [MAIN ] EFT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:38:02.114874] [WARN ] [MAIN ] EFT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:38:02.114915] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-10T18:38:02.114978] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-10-10T18:38:02.115015] [INFO ] [LOCAL ] EFT: Starting deletion of derivative data. [2025-10-10T18:38:02.115187] [DEBUG] [LOCAL ] EFT: Deleted derivative data file. [2025-10-10T18:38:02.115319] [INFO ] [MAIN ] Update Progress: 705/2373 symbols completed. EFT took 25.9s. Estimated remaining: 3h 51m 47s. Rate: 7.2 symbols/min [2025-10-10T18:38:02.314140] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:38:02.347531] [DEBUG] [LOCAL ] EG: Loaded 28013 existing records from primary storage. [2025-10-10T18:38:02.347943] [INFO ] [MAIN ] EG: Loaded 28013 existing records. [2025-10-10T18:38:02.544137] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:38:02.544925] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-10T18:38:02.545897] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-10T18:38:02.546199] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-10T18:38:02.546246] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-10T18:38:02.694732] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-10T18:38:02.897321] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:38:03.489388] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-10T18:38:03.693899] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T18:38:04.289408] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-10T18:38:04.712216] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T18:38:05.089460] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-10T18:38:05.340778] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T18:38:05.835631] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-10T18:38:05.889389] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-10T18:38:06.689384] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-10T18:38:07.059903] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T18:38:07.171786] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T18:38:07.489380] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-10T18:38:07.983133] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T18:38:08.289377] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-10T18:38:09.089379] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-10T18:38:09.580701] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-10T18:38:09.682997] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-10T18:38:09.889419] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-10T18:38:10.112237] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-10T18:38:10.689386] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-10T18:38:11.411018] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T18:38:11.489356] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-10T18:38:12.289382] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-10T18:38:12.355690] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T18:38:13.089378] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-10T18:38:13.394994] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-10T18:38:13.429398] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-10T18:38:13.434161] [INFO ] [REMOTE ] EFC: Full fetch complete (66612 records). [2025-10-10T18:38:13.434286] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-10T18:38:13.822523] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-10T18:38:13.822625] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-10T18:38:13.823713] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-10T18:38:13.823780] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-10T18:38:13.825293] [DEBUG] [LOCAL ] EFC: Trimmed 66612 records to 47108 (keeping 200 days of data) [2025-10-10T18:38:13.890689] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-10T18:38:14.114259] [DEBUG] [LOCAL ] EFC: Primary data saved (47108 records). [2025-10-10T18:38:14.114398] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-10T18:38:14.114473] [INFO ] [MAIN ] Update Progress: 706/2373 symbols completed. EFC took 53.4s. Estimated remaining: 3h 51m 48s. Rate: 7.2 symbols/min [2025-10-10T18:38:14.281731] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:38:14.336563] [DEBUG] [LOCAL ] EGO: Loaded 52063 existing records from primary storage. [2025-10-10T18:38:14.336962] [INFO ] [MAIN ] EGO: Loaded 52063 existing records. [2025-10-10T18:38:14.547840] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:38:14.548104] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-10T18:38:14.548152] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-10T18:38:14.548443] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-10T18:38:14.548499] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-10T18:38:14.698076] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-10T18:38:14.906028] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:38:14.931936] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T18:38:15.489350] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-10T18:38:15.641956] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T18:38:16.020464] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T18:38:16.289499] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-10T18:38:17.089374] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-10T18:38:17.750120] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-10T18:38:17.885084] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-10T18:38:17.890787] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-10T18:38:18.689347] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-10T18:38:18.806635] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T18:38:19.489451] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-10T18:38:19.616733] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T18:38:20.142066] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-10T18:38:20.289449] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-10T18:38:21.089413] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-10T18:38:21.461576] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-10T18:38:21.889379] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-10T18:38:22.435009] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-10T18:38:22.465440] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-10T18:38:22.689451] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-10T18:38:23.204596] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-10T18:38:23.489373] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-10T18:38:23.799537] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-10T18:38:24.289458] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-10T18:38:25.089435] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-10T18:38:25.305979] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T18:38:25.889425] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-10T18:38:25.929204] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T18:38:26.694715] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-10T18:38:26.710686] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-10T18:38:27.489350] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-10T18:38:27.851148] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T18:38:27.944400] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-10T18:38:28.289390] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-10T18:38:29.089364] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-10T18:38:29.425623] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T18:38:29.560035] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T18:38:29.889450] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-10T18:38:30.543826] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T18:38:30.547590] [INFO ] [REMOTE ] EFXT: Full fetch complete (44068 records). [2025-10-10T18:38:30.547740] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-10T18:38:30.698382] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-10T18:38:30.981379] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-10T18:38:30.981486] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-10T18:38:30.982438] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-10T18:38:30.982507] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-10T18:38:30.983813] [DEBUG] [LOCAL ] EFXT: Trimmed 44068 records to 29929 (keeping 200 days of data) [2025-10-10T18:38:31.168575] [DEBUG] [LOCAL ] EFXT: Primary data saved (29929 records). [2025-10-10T18:38:31.168974] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-10T18:38:31.169092] [INFO ] [MAIN ] Update Progress: 707/2373 symbols completed. EFXT took 32.5s. Estimated remaining: 3h 51m 60s. Rate: 7.2 symbols/min [2025-10-10T18:38:31.349478] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:38:31.389600] [DEBUG] [LOCAL ] EGP: Loaded 30837 existing records from primary storage. [2025-10-10T18:38:31.389975] [INFO ] [MAIN ] EGP: Loaded 30837 existing records. [2025-10-10T18:38:31.490322] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-10T18:38:31.579236] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:38:31.579494] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-10T18:38:31.579548] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-10T18:38:31.579854] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-10T18:38:31.579912] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-10T18:38:31.907759] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-10T18:38:31.956323] [INFO ] [REMOTE ] EFX: Full fetch complete (64514 records). [2025-10-10T18:38:32.002560] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:38:32.002974] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-10T18:38:32.293064] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-10T18:38:32.431205] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-10T18:38:32.431994] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-10T18:38:32.432750] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T18:38:32.434109] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-10T18:38:32.440238] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-10T18:38:32.442458] [DEBUG] [LOCAL ] EFX: Trimmed 64514 records to 45270 (keeping 200 days of data) [2025-10-10T18:38:32.724006] [DEBUG] [LOCAL ] EFX: Primary data saved (45270 records). [2025-10-10T18:38:32.724148] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-10T18:38:32.724231] [INFO ] [MAIN ] Update Progress: 708/2373 symbols completed. EFX took 45.6s. Estimated remaining: 3h 51m 35s. Rate: 7.2 symbols/min [2025-10-10T18:38:32.897457] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:38:32.935385] [DEBUG] [LOCAL ] EGY: Loaded 42030 existing records from primary storage. [2025-10-10T18:38:32.935733] [INFO ] [MAIN ] EGY: Loaded 42030 existing records. [2025-10-10T18:38:33.092748] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-10T18:38:33.125145] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:38:33.127329] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-10T18:38:33.127540] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-10T18:38:33.128121] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-10T18:38:33.128420] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-10T18:38:33.286144] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T18:38:33.543324] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:38:33.889419] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-10T18:38:34.190485] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T18:38:34.424976] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T18:38:34.428263] [INFO ] [REMOTE ] EG: Full fetch complete (43172 records). [2025-10-10T18:38:34.428368] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-10T18:38:34.694748] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-10T18:38:34.861116] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-10T18:38:34.861212] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-10T18:38:34.861998] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-10T18:38:34.862083] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-10T18:38:34.863474] [DEBUG] [LOCAL ] EG: Trimmed 43172 records to 28194 (keeping 200 days of data) [2025-10-10T18:38:35.057688] [DEBUG] [LOCAL ] EG: Primary data saved (28194 records). [2025-10-10T18:38:35.057906] [INFO ] [MAIN ] EG: Full history saved. [2025-10-10T18:38:35.058025] [INFO ] [MAIN ] Update Progress: 709/2373 symbols completed. EG took 32.9s. Estimated remaining: 3h 51m 13s. Rate: 7.2 symbols/min [2025-10-10T18:38:35.236298] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:38:35.268432] [DEBUG] [LOCAL ] EHAB: Loaded 29479 existing records from primary storage. [2025-10-10T18:38:35.268841] [INFO ] [MAIN ] EHAB: Loaded 29479 existing records. [2025-10-10T18:38:35.451496] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:38:35.451777] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-10T18:38:35.451828] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-10T18:38:35.452088] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-10T18:38:35.452145] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-10T18:38:35.496310] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-10T18:38:35.815502] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:38:35.855892] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T18:38:36.219089] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T18:38:36.289410] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-10T18:38:36.771714] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T18:38:37.089425] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-10T18:38:37.889399] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-10T18:38:38.058477] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T18:38:38.689377] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-10T18:38:39.069517] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-10T18:38:39.489382] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-10T18:38:39.518616] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T18:38:39.993572] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T18:38:40.289383] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-10T18:38:41.089462] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-10T18:38:41.715627] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-10T18:38:41.905094] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-10T18:38:41.908146] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T18:38:42.314330] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-10T18:38:42.689383] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-10T18:38:43.489370] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-10T18:38:43.587171] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T18:38:44.289385] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-10T18:38:44.586389] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T18:38:44.762459] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-10T18:38:45.089395] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-10T18:38:45.889413] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-10T18:38:46.224995] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T18:38:46.566489] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-10T18:38:46.689340] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-10T18:38:47.489348] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-10T18:38:47.827000] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T18:38:48.254213] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T18:38:48.289329] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-10T18:38:48.967236] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T18:38:49.089328] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-10T18:38:49.126543] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-10T18:38:49.889424] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-10T18:38:50.689331] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-10T18:38:50.997207] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-10T18:38:51.002204] [INFO ] [REMOTE ] EGO: Full fetch complete (73979 records). [2025-10-10T18:38:51.002320] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-10T18:38:51.416400] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-10T18:38:51.416528] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-10T18:38:51.418666] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-10T18:38:51.418748] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-10T18:38:51.421946] [DEBUG] [LOCAL ] EGO: Trimmed 73979 records to 52453 (keeping 200 days of data) [2025-10-10T18:38:51.511991] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-10T18:38:51.543625] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T18:38:51.692944] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-10T18:38:51.800844] [DEBUG] [LOCAL ] EGO: Primary data saved (52453 records). [2025-10-10T18:38:51.800995] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-10T18:38:51.801084] [INFO ] [MAIN ] Update Progress: 710/2373 symbols completed. EGO took 37.7s. Estimated remaining: 3h 51m 24s. Rate: 7.2 symbols/min [2025-10-10T18:38:51.982755] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:38:52.028751] [DEBUG] [LOCAL ] EHC: Loaded 41416 existing records from primary storage. [2025-10-10T18:38:52.029146] [INFO ] [MAIN ] EHC: Loaded 41416 existing records. [2025-10-10T18:38:52.207487] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:38:52.207758] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-10T18:38:52.207815] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-10T18:38:52.208546] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-10T18:38:52.208602] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-10T18:38:52.297320] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-10T18:38:52.584782] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:38:52.604688] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-10T18:38:53.089447] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-10T18:38:53.889382] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-10T18:38:54.182664] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-10T18:38:54.495327] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T18:38:54.689406] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-10T18:38:55.485152] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-10T18:38:55.493776] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-10T18:38:56.289359] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-10T18:38:56.487315] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-10T18:38:57.089395] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-10T18:38:57.162037] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T18:38:57.865306] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-10T18:38:57.889348] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-10T18:38:58.689440] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-10T18:38:58.862201] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T18:38:59.316311] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-10T18:38:59.489428] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-10T18:39:00.084140] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-10T18:39:00.289398] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-10T18:39:01.089405] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-10T18:39:01.195140] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T18:39:01.855120] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T18:39:01.889341] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-10T18:39:02.308072] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-10T18:39:02.311006] [INFO ] [REMOTE ] EHAB: Full fetch complete (40915 records). [2025-10-10T18:39:02.311103] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-10T18:39:02.693634] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-10T18:39:02.694185] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-10T18:39:02.695370] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-10T18:39:02.696360] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-10T18:39:02.696541] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-10T18:39:02.698012] [DEBUG] [LOCAL ] EHAB: Trimmed 40915 records to 29667 (keeping 200 days of data) [2025-10-10T18:39:02.875806] [DEBUG] [LOCAL ] EHAB: Primary data saved (29667 records). [2025-10-10T18:39:02.875990] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-10T18:39:02.876097] [INFO ] [MAIN ] Update Progress: 711/2373 symbols completed. EHAB took 27.8s. Estimated remaining: 3h 51m 22s. Rate: 7.2 symbols/min [2025-10-10T18:39:03.060035] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:39:03.074250] [DEBUG] [LOCAL ] EHI: Loaded 10769 existing records from primary storage. [2025-10-10T18:39:03.074523] [INFO ] [MAIN ] EHI: Loaded 10769 existing records. [2025-10-10T18:39:03.260869] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:39:03.268697] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-10T18:39:03.268834] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-10T18:39:03.269940] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-10T18:39:03.269868] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T18:39:03.270161] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-10T18:39:03.341153] [INFO ] [REMOTE ] EGP: Full fetch complete (45270 records). [2025-10-10T18:39:03.353014] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-10T18:39:03.490741] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-10T18:39:03.946371] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:39:04.089118] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-10T18:39:04.089367] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-10T18:39:04.090451] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-10T18:39:04.090729] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-10T18:39:04.113078] [DEBUG] [LOCAL ] EGP: Trimmed 45270 records to 31009 (keeping 200 days of data) [2025-10-10T18:39:04.114808] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T18:39:04.297248] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-10T18:39:04.321591] [DEBUG] [LOCAL ] EGP: Primary data saved (31009 records). [2025-10-10T18:39:04.321824] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-10T18:39:04.321927] [INFO ] [MAIN ] Update Progress: 712/2373 symbols completed. EGP took 33.2s. Estimated remaining: 3h 50m 58s. Rate: 7.2 symbols/min [2025-10-10T18:39:04.498609] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:39:04.524139] [DEBUG] [LOCAL ] EIC: Loaded 23193 existing records from primary storage. [2025-10-10T18:39:04.524464] [INFO ] [MAIN ] EIC: Loaded 23193 existing records. [2025-10-10T18:39:04.704946] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:39:04.705332] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-10T18:39:04.705388] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-10T18:39:04.705622] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-10T18:39:04.705734] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-10T18:39:05.069811] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:39:05.089420] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-10T18:39:05.458067] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-10T18:39:05.889350] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-10T18:39:05.902620] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-10T18:39:06.288115] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-10T18:39:06.689393] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-10T18:39:07.489458] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-10T18:39:07.668742] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T18:39:08.044487] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T18:39:08.289399] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-10T18:39:08.427259] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-10T18:39:09.089402] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-10T18:39:09.889345] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-10T18:39:10.079074] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T18:39:10.689392] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-10T18:39:10.942062] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T18:39:11.125615] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T18:39:11.489403] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-10T18:39:11.670945] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T18:39:12.289403] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-10T18:39:13.089359] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-10T18:39:13.254904] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-10T18:39:13.259262] [INFO ] [REMOTE ] EGY: Full fetch complete (61061 records). [2025-10-10T18:39:13.259396] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-10T18:39:13.651556] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-10T18:39:13.651687] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-10T18:39:13.652790] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-10T18:39:13.652857] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-10T18:39:13.654548] [DEBUG] [LOCAL ] EGY: Trimmed 61061 records to 42345 (keeping 200 days of data) [2025-10-10T18:39:13.889148] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T18:39:13.890011] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-10T18:39:13.952287] [DEBUG] [LOCAL ] EGY: Primary data saved (42345 records). [2025-10-10T18:39:13.952527] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-10T18:39:13.952677] [INFO ] [MAIN ] Update Progress: 713/2373 symbols completed. EGY took 41.2s. Estimated remaining: 3h 50m 53s. Rate: 7.2 symbols/min [2025-10-10T18:39:14.140133] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:39:14.140355] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-10T18:39:14.140396] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-10T18:39:14.140521] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-10T18:39:14.140565] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-10T18:39:14.140607] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-10T18:39:14.140713] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-10T18:39:14.530791] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:39:14.689400] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-10T18:39:14.945475] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T18:39:14.989075] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-10T18:39:15.179574] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-10T18:39:15.489395] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-10T18:39:16.018627] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-10T18:39:16.289402] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-10T18:39:17.089395] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-10T18:39:17.682013] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T18:39:17.889403] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-10T18:39:18.689454] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-10T18:39:18.864934] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-10T18:39:19.002383] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T18:39:19.060476] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-10T18:39:19.489395] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-10T18:39:20.289394] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-10T18:39:21.089370] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-10T18:39:21.246381] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T18:39:21.306927] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-10T18:39:21.547570] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-10T18:39:21.889358] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-10T18:39:22.298743] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-10T18:39:22.689383] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-10T18:39:23.489460] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-10T18:39:23.911213] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-10T18:39:24.289450] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-10T18:39:24.310745] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-10T18:39:24.689395] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-10T18:39:25.089407] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-10T18:39:25.889399] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-10T18:39:26.381935] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-10T18:39:26.689367] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-10T18:39:26.922963] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T18:39:27.489365] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-10T18:39:27.993428] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T18:39:28.289368] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-10T18:39:28.472465] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T18:39:29.089384] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-10T18:39:29.760310] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-10T18:39:29.889401] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-10T18:39:30.563226] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-10T18:39:30.689388] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-10T18:39:30.857810] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-10T18:39:31.489414] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-10T18:39:32.289423] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-10T18:39:32.499394] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T18:39:32.961246] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-10T18:39:32.976612] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-10T18:39:33.089401] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-10T18:39:33.889366] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-10T18:39:33.999625] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T18:39:34.001339] [INFO ] [REMOTE ] EHI: Full fetch complete (16203 records). [2025-10-10T18:39:34.001420] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-10T18:39:34.233468] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-10T18:39:34.392835] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-10T18:39:34.392938] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-10T18:39:34.393527] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-10T18:39:34.393573] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-10T18:39:34.394278] [DEBUG] [LOCAL ] EHI: Trimmed 16203 records to 10815 (keeping 200 days of data) [2025-10-10T18:39:34.460975] [DEBUG] [LOCAL ] EHI: Primary data saved (10815 records). [2025-10-10T18:39:34.461158] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-10T18:39:34.461276] [INFO ] [MAIN ] Update Progress: 714/2373 symbols completed. EHI took 31.6s. Estimated remaining: 3h 51m 12s. Rate: 7.2 symbols/min [2025-10-10T18:39:34.654890] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:39:34.655113] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-10T18:39:34.655154] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-10T18:39:34.655301] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-10T18:39:34.655347] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-10T18:39:34.655391] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-10T18:39:34.655427] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-10T18:39:34.694530] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-10T18:39:35.073454] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:39:35.191789] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-10T18:39:35.489388] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-10T18:39:35.950004] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-10T18:39:35.950839] [INFO ] [REMOTE ] EICA: Full fetch complete (1281 records). [2025-10-10T18:39:35.950910] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-10T18:39:36.140325] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-10T18:39:36.140571] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:39:36.140624] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:39:36.140744] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-10T18:39:36.140841] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-10T18:39:36.140916] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-10T18:39:36.141002] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-10T18:39:36.141099] [INFO ] [MAIN ] Update Progress: 715/2373 symbols completed. EICA took 22.2s. Estimated remaining: 3h 50m 49s. Rate: 7.2 symbols/min [2025-10-10T18:39:36.291137] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-10T18:39:36.316989] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:39:36.318687] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-10T18:39:36.318750] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-10T18:39:36.318878] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-10T18:39:36.318934] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-10T18:39:36.319024] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-10T18:39:36.319082] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-10T18:39:36.728663] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:39:37.089405] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-10T18:39:37.137231] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-10T18:39:37.889444] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-10T18:39:37.921142] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-10T18:39:38.689394] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-10T18:39:39.308848] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-10T18:39:39.357469] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-10T18:39:39.489475] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-10T18:39:40.009821] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-10T18:39:40.289367] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-10T18:39:41.089391] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-10T18:39:41.789324] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T18:39:41.889400] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-10T18:39:41.941174] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-10T18:39:41.945909] [INFO ] [REMOTE ] EHC: Full fetch complete (58695 records). [2025-10-10T18:39:41.946127] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-10T18:39:42.357375] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-10T18:39:42.357501] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-10T18:39:42.358508] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-10T18:39:42.358575] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-10T18:39:42.360261] [DEBUG] [LOCAL ] EHC: Trimmed 58695 records to 41702 (keeping 200 days of data) [2025-10-10T18:39:42.643292] [DEBUG] [LOCAL ] EHC: Primary data saved (41702 records). [2025-10-10T18:39:42.643445] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-10T18:39:42.643542] [INFO ] [MAIN ] Update Progress: 716/2373 symbols completed. EHC took 50.8s. Estimated remaining: 3h 50m 36s. Rate: 7.2 symbols/min [2025-10-10T18:39:42.708471] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-10T18:39:42.736811] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-10T18:39:42.840838] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:39:42.865300] [DEBUG] [LOCAL ] EIG: Loaded 20377 existing records from primary storage. [2025-10-10T18:39:42.865742] [INFO ] [MAIN ] EIG: Loaded 20377 existing records. [2025-10-10T18:39:43.056175] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:39:43.056446] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-10T18:39:43.056508] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-10T18:39:43.056752] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-10T18:39:43.056810] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-10T18:39:43.297797] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-10T18:39:43.430423] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:39:43.489372] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-10T18:39:44.229895] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-10T18:39:44.289408] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-10T18:39:45.089432] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-10T18:39:45.483263] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T18:39:45.714092] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-10T18:39:45.889403] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-10T18:39:46.689394] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-10T18:39:47.028441] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-10T18:39:47.463356] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-10T18:39:47.489342] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-10T18:39:48.261763] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-10T18:39:48.289345] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-10T18:39:48.965808] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-10T18:39:49.089373] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-10T18:39:49.889362] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-10T18:39:49.957360] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-10T18:39:50.689400] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-10T18:39:51.046703] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-10T18:39:51.049009] [INFO ] [REMOTE ] EIC: Full fetch complete (34447 records). [2025-10-10T18:39:51.049089] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-10T18:39:51.448702] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-10T18:39:51.448835] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-10T18:39:51.449767] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-10T18:39:51.449839] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-10T18:39:51.451280] [DEBUG] [LOCAL ] EIC: Trimmed 34447 records to 23309 (keeping 200 days of data) [2025-10-10T18:39:51.504936] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-10T18:39:51.605080] [DEBUG] [LOCAL ] EIC: Primary data saved (23309 records). [2025-10-10T18:39:51.605266] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-10T18:39:51.605444] [INFO ] [MAIN ] Update Progress: 717/2373 symbols completed. EIC took 47.3s. Estimated remaining: 3h 50m 29s. Rate: 7.2 symbols/min [2025-10-10T18:39:51.877335] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-10T18:39:51.973466] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-10T18:39:52.289464] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-10T18:39:52.803627] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-10T18:39:53.089478] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-10T18:39:53.675620] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-10T18:39:53.889415] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-10T18:39:54.428078] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-10T18:39:54.689402] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-10T18:39:55.218350] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-10T18:39:55.489389] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-10T18:39:56.036954] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-10T18:39:56.037747] [INFO ] [REMOTE ] EICB: Full fetch complete (2690 records). [2025-10-10T18:39:56.037814] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-10T18:39:56.211511] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-10T18:39:56.211820] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:39:56.211870] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:39:56.211913] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-10T18:39:56.211968] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-10T18:39:56.212051] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-10T18:39:56.212102] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-10T18:39:56.212160] [INFO ] [MAIN ] Update Progress: 718/2373 symbols completed. EICB took 21.8s. Estimated remaining: 3h 50m 12s. Rate: 7.2 symbols/min [2025-10-10T18:39:56.289404] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-10T18:39:56.989056] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-10T18:39:57.089370] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-10T18:39:57.889421] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-10T18:39:57.926346] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-10T18:39:58.689400] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-10T18:39:59.175525] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T18:39:59.387115] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-10T18:39:59.388338] [INFO ] [REMOTE ] EICC: Full fetch complete (8378 records). [2025-10-10T18:39:59.388411] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-10T18:39:59.388815] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:39:59.388901] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:39:59.388947] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:39:59.388986] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-10T18:39:59.389043] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-10T18:39:59.389080] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-10T18:39:59.389167] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-10T18:39:59.389241] [INFO ] [MAIN ] Update Progress: 719/2373 symbols completed. EICC took 23.2s. Estimated remaining: 3h 49m 52s. Rate: 7.2 symbols/min [2025-10-10T18:39:59.489405] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-10T18:40:00.678831] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-10T18:40:00.683365] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-10T18:40:02.190486] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-10T18:40:02.195569] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-10T18:40:03.433238] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-10T18:40:03.440388] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-10T18:40:04.610294] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-10T18:40:04.617523] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-10T18:40:05.838145] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T18:40:05.843398] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-10T18:40:07.348896] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T18:40:07.354984] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-10T18:40:08.582415] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-10T18:40:08.588272] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-10T18:40:09.763617] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-10T18:40:09.765879] [INFO ] [REMOTE ] EIG: Full fetch complete (27009 records). [2025-10-10T18:40:09.765964] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-10T18:40:10.150938] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-10T18:40:10.151072] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-10T18:40:10.151848] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-10T18:40:10.151912] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-10T18:40:10.152738] [DEBUG] [LOCAL ] EIG: Trimmed 27009 records to 20468 (keeping 200 days of data) [2025-10-10T18:40:10.283088] [DEBUG] [LOCAL ] EIG: Primary data saved (20468 records). [2025-10-10T18:40:10.283262] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-10T18:40:10.283408] [INFO ] [MAIN ] Update Progress: 720/2373 symbols completed. EIG took 27.6s. Estimated remaining: 3h 49m 49s. Rate: 7.2 symbols/min [2025-10-10T18:40:10.875005] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:40:10.948164] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:40:10.997345] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:40:11.028447] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:40:11.029047] [DEBUG] [LOCAL ] EIX: No existing data file found in primary storage. [2025-10-10T18:40:11.029281] [WARN ] [MAIN ] EIX: No existing data found, performing full refresh instead. [2025-10-10T18:40:11.032828] [DEBUG] [LOCAL ] ELC: Loaded 3524 existing records from primary storage. [2025-10-10T18:40:11.032964] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-10T18:40:11.033405] [INFO ] [MAIN ] ELC: Loaded 3524 existing records. [2025-10-10T18:40:11.033179] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-10T18:40:11.033695] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-10-10T18:40:11.045230] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-10T18:40:11.409038] [DEBUG] [LOCAL ] ELAN: Loaded 53679 existing records from primary storage. [2025-10-10T18:40:11.457776] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:40:11.529193] [DEBUG] [LOCAL ] EL: Loaded 53760 existing records from primary storage. [2025-10-10T18:40:11.509711] [INFO ] [MAIN ] ELAN: Loaded 53679 existing records. [2025-10-10T18:40:11.546630] [INFO ] [MAIN ] EL: Loaded 53760 existing records. [2025-10-10T18:40:11.584328] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-10T18:40:11.645886] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-10T18:40:11.671912] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-10T18:40:11.687104] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-10T18:40:12.262700] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:40:12.258939] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:40:12.272937] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:40:12.316088] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-10T18:40:12.325501] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-10T18:40:12.331142] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-10T18:40:12.325866] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-10T18:40:12.341797] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-10T18:40:12.386040] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-10T18:40:12.385900] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-10T18:40:12.396984] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-10T18:40:12.396866] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-10T18:40:12.779083] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:40:12.810163] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-10T18:40:13.287779] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:40:13.326223] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-10T18:40:13.332532] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:40:13.334249] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-10T18:40:14.030825] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T18:40:14.033313] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-10T18:40:14.509401] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-10T18:40:14.520157] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-10T18:40:14.558736] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-10T18:40:14.560268] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-10T18:40:15.127900] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T18:40:15.139860] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-10T18:40:15.247119] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-10T18:40:15.248440] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-10T18:40:16.371896] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-10T18:40:16.373296] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-10T18:40:16.475098] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (3.14 seconds). [2025-10-10T18:40:16.487161] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-10T18:40:16.824672] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-10T18:40:16.845026] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-10T18:40:16.864284] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-10T18:40:16.876298] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-10T18:40:16.963852] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-10T18:40:16.974757] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-10T18:40:17.557863] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-10T18:40:17.559341] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-10T18:40:18.250744] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-10T18:40:18.252252] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-10T18:40:18.632169] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-10T18:40:18.689367] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-10T18:40:18.747074] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-10T18:40:18.788095] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T18:40:18.877440] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-10T18:40:19.489407] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-10T18:40:20.289411] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-10T18:40:20.899109] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-10T18:40:21.035109] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-10T18:40:21.089384] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-10T18:40:21.524574] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T18:40:21.769286] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-10T18:40:21.889370] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-10T18:40:22.502483] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-10T18:40:22.503462] [INFO ] [REMOTE ] ELC: Full fetch complete (5060 records). [2025-10-10T18:40:22.503534] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-10T18:40:22.696258] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-10T18:40:22.897436] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-10T18:40:22.897527] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-10T18:40:22.897746] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-10T18:40:22.897808] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-10T18:40:22.898171] [DEBUG] [LOCAL ] ELC: Trimmed 5060 records to 3552 (keeping 200 days of data) [2025-10-10T18:40:22.920134] [DEBUG] [LOCAL ] ELC: Primary data saved (3552 records). [2025-10-10T18:40:22.920229] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-10T18:40:22.920306] [INFO ] [MAIN ] Update Progress: 721/2373 symbols completed. ELC took 12.6s. Estimated remaining: 3h 49m 51s. Rate: 7.2 symbols/min [2025-10-10T18:40:23.090724] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:40:23.145516] [DEBUG] [LOCAL ] ELF: Loaded 52403 existing records from primary storage. [2025-10-10T18:40:23.146014] [INFO ] [MAIN ] ELF: Loaded 52403 existing records. [2025-10-10T18:40:23.319292] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:40:23.319533] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-10T18:40:23.319580] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-10T18:40:23.319861] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-10T18:40:23.319918] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-10T18:40:23.492050] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-10T18:40:23.675159] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:40:24.289438] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-10T18:40:25.047316] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-10T18:40:25.089395] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-10T18:40:25.854714] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-10T18:40:25.898322] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-10T18:40:25.922422] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T18:40:26.689349] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-10T18:40:27.351048] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-10T18:40:27.489349] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-10T18:40:27.965390] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T18:40:28.289374] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-10T18:40:28.485848] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T18:40:29.089416] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-10T18:40:29.882035] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-10T18:40:29.893110] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-10T18:40:30.322310] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T18:40:30.689354] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-10T18:40:31.061585] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T18:40:31.489342] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-10T18:40:32.055502] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-10T18:40:32.289472] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-10T18:40:33.094599] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-10T18:40:33.113109] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-10T18:40:33.686049] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-10T18:40:33.889384] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-10T18:40:34.463319] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T18:40:34.575391] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-10T18:40:34.689347] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-10T18:40:35.489406] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-10T18:40:35.870225] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T18:40:36.289372] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-10T18:40:36.920520] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-10T18:40:37.089409] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-10T18:40:37.387482] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T18:40:37.889448] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-10T18:40:38.427753] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-10T18:40:38.689396] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-10T18:40:39.430737] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-10T18:40:39.489344] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-10T18:40:39.770681] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T18:40:40.294569] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-10T18:40:40.324859] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T18:40:41.089334] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-10T18:40:41.541434] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T18:40:41.889427] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-10T18:40:42.689410] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-10T18:40:42.741007] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-10T18:40:43.178047] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-10T18:40:43.183936] [INFO ] [REMOTE ] EIX: Full fetch complete (77113 records). [2025-10-10T18:40:43.184222] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-10T18:40:43.493872] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-10T18:40:43.603518] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-10T18:40:43.603667] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-10T18:40:43.605110] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-10T18:40:43.605185] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-10T18:40:43.607382] [DEBUG] [LOCAL ] EIX: Trimmed 77113 records to 54125 (keeping 200 days of data) [2025-10-10T18:40:43.971586] [DEBUG] [LOCAL ] EIX: Primary data saved (54125 records). [2025-10-10T18:40:43.971866] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-10T18:40:43.972013] [INFO ] [MAIN ] Update Progress: 722/2373 symbols completed. EIX took 33.7s. Estimated remaining: 3h 50m 12s. Rate: 7.2 symbols/min [2025-10-10T18:40:44.163975] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:40:44.195880] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-10T18:40:44.272453] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-10T18:40:44.270392] [DEBUG] [LOCAL ] ELME: Loaded 39587 existing records from primary storage. [2025-10-10T18:40:44.283909] [INFO ] [MAIN ] ELME: Loaded 39587 existing records. [2025-10-10T18:40:44.295460] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-10T18:40:44.481114] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:40:44.481434] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-10T18:40:44.481492] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-10T18:40:44.481748] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-10T18:40:44.481809] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-10T18:40:44.971354] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:40:45.089484] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-10T18:40:45.455373] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T18:40:45.889345] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-10T18:40:46.623842] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-10T18:40:46.689344] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-10T18:40:46.998532] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-10T18:40:47.489483] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-10T18:40:47.885301] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-10T18:40:47.890475] [INFO ] [REMOTE ] EL: Full fetch complete (77271 records). [2025-10-10T18:40:47.890622] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-10T18:40:48.270388] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-10T18:40:48.270475] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-10T18:40:48.271463] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-10T18:40:48.271527] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-10T18:40:48.272993] [DEBUG] [LOCAL ] EL: Trimmed 77271 records to 54147 (keeping 200 days of data) [2025-10-10T18:40:48.334403] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-10T18:40:48.615218] [DEBUG] [LOCAL ] EL: Primary data saved (54147 records). [2025-10-10T18:40:48.615387] [INFO ] [MAIN ] EL: Full history saved. [2025-10-10T18:40:48.615475] [INFO ] [MAIN ] Update Progress: 723/2373 symbols completed. EL took 38.3s. Estimated remaining: 3h 49m 55s. Rate: 7.2 symbols/min [2025-10-10T18:40:48.788021] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:40:48.812883] [DEBUG] [LOCAL ] ELP: Loaded 25781 existing records from primary storage. [2025-10-10T18:40:48.813169] [INFO ] [MAIN ] ELP: Loaded 25781 existing records. [2025-10-10T18:40:48.990398] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:40:48.990767] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-10T18:40:48.990850] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-10T18:40:48.991130] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-10T18:40:48.991187] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-10T18:40:49.152975] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-10T18:40:49.277417] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-10T18:40:49.404109] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:40:49.492961] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-10T18:40:49.500592] [INFO ] [REMOTE ] ELAN: Full fetch complete (76873 records). [2025-10-10T18:40:49.500953] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-10T18:40:49.890806] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-10T18:40:49.923071] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-10T18:40:49.923209] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-10T18:40:49.924549] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-10T18:40:49.924675] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-10T18:40:49.927131] [DEBUG] [LOCAL ] ELAN: Trimmed 76873 records to 54069 (keeping 200 days of data) [2025-10-10T18:40:50.180369] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T18:40:50.309360] [DEBUG] [LOCAL ] ELAN: Primary data saved (54069 records). [2025-10-10T18:40:50.309558] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-10T18:40:50.309707] [INFO ] [MAIN ] Update Progress: 724/2373 symbols completed. ELAN took 40.0s. Estimated remaining: 3h 49m 31s. Rate: 7.2 symbols/min [2025-10-10T18:40:50.496778] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:40:50.497033] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-10T18:40:50.497073] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-10T18:40:50.497195] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-10T18:40:50.497236] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-10T18:40:50.497277] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-10T18:40:50.497309] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-10T18:40:50.699725] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-10T18:40:50.857445] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:40:51.359498] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-10T18:40:51.489380] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-10T18:40:51.554775] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-10T18:40:51.894795] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-10T18:40:52.289395] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-10T18:40:52.421479] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-10T18:40:53.089387] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-10T18:40:53.889417] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-10T18:40:54.384300] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-10T18:40:54.389196] [INFO ] [REMOTE ] ELF: Full fetch complete (75276 records). [2025-10-10T18:40:54.389319] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-10T18:40:54.493304] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-10T18:40:54.693076] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-10T18:40:54.816868] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-10T18:40:54.818085] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-10T18:40:54.819295] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-10T18:40:54.817983] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T18:40:54.819448] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-10T18:40:54.831035] [DEBUG] [LOCAL ] ELF: Trimmed 75276 records to 52787 (keeping 200 days of data) [2025-10-10T18:40:55.144445] [DEBUG] [LOCAL ] ELF: Primary data saved (52787 records). [2025-10-10T18:40:55.144590] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-10T18:40:55.144706] [INFO ] [MAIN ] Update Progress: 725/2373 symbols completed. ELF took 32.2s. Estimated remaining: 3h 49m 15s. Rate: 7.2 symbols/min [2025-10-10T18:40:55.313195] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:40:55.363461] [DEBUG] [LOCAL ] ELS: Loaded 50144 existing records from primary storage. [2025-10-10T18:40:55.363835] [INFO ] [MAIN ] ELS: Loaded 50144 existing records. [2025-10-10T18:40:55.495413] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-10T18:40:55.574088] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:40:55.574366] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-10T18:40:55.574415] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-10T18:40:55.574684] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-10T18:40:55.574739] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-10T18:40:55.932956] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:40:56.012060] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-10T18:40:56.289411] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-10T18:40:57.089421] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-10T18:40:57.243049] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T18:40:57.568162] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T18:40:57.889405] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-10T18:40:58.689378] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-10T18:40:59.062346] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T18:40:59.489348] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-10T18:40:59.615453] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T18:41:00.125852] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-10T18:41:00.210224] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-10T18:41:00.289369] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-10T18:41:01.089395] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-10T18:41:01.889349] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-10T18:41:02.289948] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-10T18:41:02.291318] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T18:41:02.689398] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-10T18:41:02.909540] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T18:41:02.979606] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-10T18:41:03.489435] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-10T18:41:04.289397] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-10T18:41:04.969224] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-10T18:41:05.089380] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-10T18:41:05.157947] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T18:41:05.391776] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-10T18:41:05.889384] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-10T18:41:06.689350] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-10T18:41:07.324233] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-10T18:41:07.489405] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-10T18:41:08.289418] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-10T18:41:08.451084] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-10T18:41:08.837211] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T18:41:08.917470] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-10T18:41:09.089423] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-10T18:41:09.889395] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-10T18:41:10.361016] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-10T18:41:10.380337] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T18:41:10.689406] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-10T18:41:11.489410] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-10T18:41:12.289352] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-10T18:41:12.528846] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T18:41:12.700519] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-10T18:41:12.959043] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-10T18:41:13.089391] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-10T18:41:13.375919] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-10T18:41:13.889385] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-10T18:41:14.689404] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-10T18:41:15.145383] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-10T18:41:15.146133] [INFO ] [REMOTE ] ELPC: Full fetch complete (1408 records). [2025-10-10T18:41:15.146203] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-10T18:41:15.146543] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:41:15.146627] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:41:15.146704] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:41:15.146773] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-10T18:41:15.146835] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-10T18:41:15.146872] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-10T18:41:15.146910] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-10T18:41:15.146963] [INFO ] [MAIN ] Update Progress: 726/2373 symbols completed. ELPC took 24.8s. Estimated remaining: 3h 49m 33s. Rate: 7.2 symbols/min [2025-10-10T18:41:15.317810] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:41:15.375857] [DEBUG] [LOCAL ] ELV: Loaded 50963 existing records from primary storage. [2025-10-10T18:41:15.376245] [INFO ] [MAIN ] ELV: Loaded 50963 existing records. [2025-10-10T18:41:15.492244] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-10T18:41:15.565550] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:41:15.566196] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-10T18:41:15.566254] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-10T18:41:15.566507] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-10T18:41:15.566572] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-10T18:41:15.776176] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T18:41:15.977133] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:41:16.289450] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-10T18:41:16.779282] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T18:41:17.025945] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-10T18:41:17.089393] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-10T18:41:17.889391] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-10T18:41:18.479932] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-10T18:41:18.482591] [INFO ] [REMOTE ] ELP: Full fetch complete (36798 records). [2025-10-10T18:41:18.482703] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-10T18:41:18.689407] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-10T18:41:18.849974] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-10T18:41:18.850065] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-10T18:41:18.850690] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-10T18:41:18.850752] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-10T18:41:18.851633] [DEBUG] [LOCAL ] ELP: Trimmed 36798 records to 25987 (keeping 200 days of data) [2025-10-10T18:41:19.001055] [DEBUG] [LOCAL ] ELP: Primary data saved (25987 records). [2025-10-10T18:41:19.001213] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-10T18:41:19.001296] [INFO ] [MAIN ] Update Progress: 727/2373 symbols completed. ELP took 30.4s. Estimated remaining: 3h 49m 14s. Rate: 7.2 symbols/min [2025-10-10T18:41:19.188401] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:41:19.188610] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-10T18:41:19.188716] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-10T18:41:19.188842] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-10T18:41:19.188885] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-10T18:41:19.188949] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-10T18:41:19.188983] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-10T18:41:19.490819] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-10T18:41:19.578996] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:41:20.029219] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-10T18:41:20.289416] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-10T18:41:20.454497] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-10T18:41:20.459526] [INFO ] [REMOTE ] ELME: Full fetch complete (55716 records). [2025-10-10T18:41:20.459855] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-10T18:41:20.460873] [FATAL] [VALIDATOR ] ELME: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:41:20.460973] [FATAL] [MAIN ] ELME: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:41:20.461017] [WARN ] [MAIN ] ELME: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:41:20.461058] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-10T18:41:20.461119] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-10T18:41:20.461154] [INFO ] [LOCAL ] ELME: Starting deletion of derivative data. [2025-10-10T18:41:20.461334] [DEBUG] [LOCAL ] ELME: Deleted derivative data file. [2025-10-10T18:41:20.461441] [INFO ] [MAIN ] Update Progress: 728/2373 symbols completed. ELME took 36.5s. Estimated remaining: 3h 48m 50s. Rate: 7.2 symbols/min [2025-10-10T18:41:20.526322] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T18:41:20.543380] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-10T18:41:20.562351] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:41:20.564836] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-10T18:41:20.564989] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:41:20.565425] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-10T18:41:20.571086] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-10T18:41:20.586702] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-10T18:41:20.604395] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-10T18:41:20.610875] [INFO ] [MAIN ] Update Progress: 729/2373 symbols completed. EMA took 1.6s. Estimated remaining: 3h 48m 24s. Rate: 7.2 symbols/min [2025-10-10T18:41:20.636522] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:41:20.818282] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:41:20.826994] [DEBUG] [LOCAL ] EMD: Loaded 21300 existing records from primary storage. [2025-10-10T18:41:20.827304] [INFO ] [MAIN ] EMD: Loaded 21300 existing records. [2025-10-10T18:41:21.020480] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:41:21.020937] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-10T18:41:21.021011] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-10T18:41:21.021533] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-10T18:41:21.021687] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-10T18:41:21.098197] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-10T18:41:21.161599] [DEBUG] [LOCAL ] EME: Loaded 31359 existing records from primary storage. [2025-10-10T18:41:21.210193] [INFO ] [MAIN ] EME: Loaded 31359 existing records. [2025-10-10T18:41:21.297678] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T18:41:21.653080] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:41:21.660219] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:41:21.661098] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-10T18:41:21.661217] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-10T18:41:21.661468] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-10T18:41:21.661528] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-10T18:41:21.895227] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-10T18:41:22.034539] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:41:22.689448] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-10T18:41:23.205854] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-10T18:41:23.489499] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-10T18:41:23.877381] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T18:41:24.289895] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-10T18:41:24.289751] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T18:41:25.089434] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-10T18:41:25.406021] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T18:41:25.803297] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T18:41:25.889350] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-10T18:41:26.689351] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-10T18:41:27.160186] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T18:41:27.263069] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T18:41:27.489408] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-10T18:41:28.222221] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-10T18:41:28.289397] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-10T18:41:29.089384] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-10T18:41:29.280888] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T18:41:29.889434] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-10T18:41:30.092549] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-10T18:41:30.368311] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T18:41:30.689372] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-10T18:41:31.089494] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-10T18:41:31.481023] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-10T18:41:31.489329] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-10T18:41:32.289429] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-10T18:41:32.699540] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-10T18:41:33.089386] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-10T18:41:33.889411] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-10T18:41:34.382187] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T18:41:34.472098] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T18:41:34.689386] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-10T18:41:35.264637] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T18:41:35.489374] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-10T18:41:35.990941] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T18:41:36.289418] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-10T18:41:37.090617] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-10T18:41:37.550447] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-10T18:41:37.591456] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T18:41:37.889368] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-10T18:41:38.689338] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-10T18:41:39.280447] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-10T18:41:39.430410] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-10T18:41:39.489378] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-10T18:41:39.800445] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-10T18:41:40.289424] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-10T18:41:41.089389] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-10T18:41:41.487886] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T18:41:41.889426] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-10T18:41:42.146559] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T18:41:42.349098] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T18:41:42.351997] [INFO ] [REMOTE ] EMD: Full fetch complete (32297 records). [2025-10-10T18:41:42.352079] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-10T18:41:42.694615] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-10T18:41:42.792716] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-10T18:41:42.792812] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-10T18:41:42.793471] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-10T18:41:42.793533] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-10T18:41:42.794310] [DEBUG] [LOCAL ] EMD: Trimmed 32297 records to 21449 (keeping 200 days of data) [2025-10-10T18:41:42.922721] [DEBUG] [LOCAL ] EMD: Primary data saved (21449 records). [2025-10-10T18:41:42.922881] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-10T18:41:42.922985] [INFO ] [MAIN ] Update Progress: 730/2373 symbols completed. EMD took 22.5s. Estimated remaining: 3h 48m 47s. Rate: 7.2 symbols/min [2025-10-10T18:41:43.101263] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:41:43.107707] [DEBUG] [LOCAL ] EMF: Loaded 3301 existing records from primary storage. [2025-10-10T18:41:43.107889] [INFO ] [MAIN ] EMF: Loaded 3301 existing records. [2025-10-10T18:41:43.288008] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:41:43.288460] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-10T18:41:43.288511] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-10T18:41:43.288722] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-10T18:41:43.288786] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-10T18:41:43.501766] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-10T18:41:43.662099] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:41:43.890181] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-10T18:41:44.289378] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-10T18:41:44.508827] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T18:41:44.942040] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-10T18:41:45.089391] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-10T18:41:45.889431] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-10T18:41:46.197808] [DEBUG] [REMOTE ] EME: Error fetching primary data for 2025-06: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-10-10T18:41:46.198040] [WARN ] [REMOTE ] EME: No data returned for month 2025-06 [2025-10-10T18:41:46.198165] [FATAL] [REMOTE ] EME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:41:46.198217] [FATAL] [MAIN ] EME: Failed to fetch primary data. [2025-10-10T18:41:46.198250] [WARN ] [MAIN ] EME: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:41:46.198286] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-10T18:41:46.198341] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-10-10T18:41:46.198377] [INFO ] [LOCAL ] EME: Starting deletion of derivative data. [2025-10-10T18:41:46.198539] [DEBUG] [LOCAL ] EME: Deleted derivative data file. [2025-10-10T18:41:46.198610] [INFO ] [MAIN ] Update Progress: 731/2373 symbols completed. EME took 25.6s. Estimated remaining: 3h 48m 27s. Rate: 7.2 symbols/min [2025-10-10T18:41:46.391787] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:41:46.441813] [DEBUG] [LOCAL ] EMN: Loaded 50972 existing records from primary storage. [2025-10-10T18:41:46.442190] [INFO ] [MAIN ] EMN: Loaded 50972 existing records. [2025-10-10T18:41:46.621436] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:41:46.621869] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-10T18:41:46.621921] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-10T18:41:46.622312] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-10T18:41:46.622369] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-10T18:41:46.705610] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-10T18:41:46.851032] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-10T18:41:47.057688] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:41:47.071382] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-10T18:41:47.076535] [INFO ] [REMOTE ] ELS: Full fetch complete (70982 records). [2025-10-10T18:41:47.076696] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-10T18:41:47.461245] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-10T18:41:47.461337] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-10T18:41:47.462372] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-10T18:41:47.462436] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-10T18:41:47.464422] [DEBUG] [LOCAL ] ELS: Trimmed 70982 records to 50519 (keeping 200 days of data) [2025-10-10T18:41:47.520716] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-10T18:41:47.789847] [DEBUG] [LOCAL ] ELS: Primary data saved (50519 records). [2025-10-10T18:41:47.790075] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-10T18:41:47.790206] [INFO ] [MAIN ] Update Progress: 732/2373 symbols completed. ELS took 52.6s. Estimated remaining: 3h 48m 3s. Rate: 7.2 symbols/min [2025-10-10T18:41:47.915603] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-10T18:41:47.971077] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:41:47.985982] [DEBUG] [LOCAL ] EMO: Loaded 13052 existing records from primary storage. [2025-10-10T18:41:47.986322] [INFO ] [MAIN ] EMO: Loaded 13052 existing records. [2025-10-10T18:41:48.159621] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:41:48.159878] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-10T18:41:48.159926] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-10T18:41:48.160137] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-10T18:41:48.160196] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-10T18:41:48.297572] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-10T18:41:48.519160] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:41:49.089428] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-10T18:41:49.867413] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-10T18:41:49.889356] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-10T18:41:49.958199] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-10T18:41:50.283292] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T18:41:50.381390] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-10T18:41:50.689391] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-10T18:41:51.489387] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-10T18:41:52.289370] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-10T18:41:52.740631] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T18:41:53.089352] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-10T18:41:53.105071] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-10T18:41:53.323472] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-10T18:41:53.889377] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-10T18:41:54.689379] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-10T18:41:54.859215] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T18:41:55.079526] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-10T18:41:55.084606] [INFO ] [REMOTE ] ELV: Full fetch complete (73082 records). [2025-10-10T18:41:55.084820] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-10T18:41:55.460945] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-10T18:41:55.461035] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-10T18:41:55.461994] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-10T18:41:55.462084] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-10T18:41:55.463772] [DEBUG] [LOCAL ] ELV: Trimmed 73082 records to 51348 (keeping 200 days of data) [2025-10-10T18:41:55.521516] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-10T18:41:55.789764] [DEBUG] [LOCAL ] ELV: Primary data saved (51348 records). [2025-10-10T18:41:55.789897] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-10T18:41:55.790001] [INFO ] [MAIN ] Update Progress: 733/2373 symbols completed. ELV took 40.6s. Estimated remaining: 3h 47m 54s. Rate: 7.2 symbols/min [2025-10-10T18:41:55.962720] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:41:55.968781] [DEBUG] [LOCAL ] EMP: Loaded 3098 existing records from primary storage. [2025-10-10T18:41:55.968963] [INFO ] [MAIN ] EMP: Loaded 3098 existing records. [2025-10-10T18:41:56.150621] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:41:56.173762] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-10T18:41:56.174040] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-10T18:41:56.175532] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T18:41:56.175604] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-10T18:41:56.175910] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-10T18:41:56.295051] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-10T18:41:56.492938] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T18:41:56.572006] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:41:57.089378] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-10T18:41:57.218142] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-10T18:41:57.888715] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-10T18:41:57.889901] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-10T18:41:58.689348] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-10T18:41:58.709868] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-10T18:41:59.392384] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-10T18:41:59.489332] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-10T18:42:00.052889] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-10T18:42:00.289342] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-10T18:42:00.908674] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-10T18:42:01.089400] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-10T18:42:01.889410] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-10T18:42:02.505612] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-10T18:42:02.689462] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-10T18:42:03.139923] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T18:42:03.489359] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-10T18:42:03.881436] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-10T18:42:04.077069] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-10T18:42:04.289394] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-10T18:42:04.858112] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-10T18:42:05.089384] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-10T18:42:05.838476] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-10T18:42:05.889350] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-10T18:42:06.520763] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-10T18:42:06.689447] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-10T18:42:07.489387] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-10T18:42:08.289380] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-10T18:42:08.689332] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T18:42:08.737882] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-10T18:42:09.090584] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-10T18:42:09.092458] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-10T18:42:09.836995] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-10T18:42:09.889343] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-10T18:42:10.584044] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-10T18:42:10.689419] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-10T18:42:11.489402] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-10T18:42:11.588516] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T18:42:12.289399] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-10T18:42:12.981972] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-10T18:42:13.089407] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-10T18:42:13.318566] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T18:42:13.889367] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-10T18:42:14.332883] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T18:42:14.493547] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-10T18:42:14.494741] [INFO ] [REMOTE ] EMF: Full fetch complete (6723 records). [2025-10-10T18:42:14.494832] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-10T18:42:14.689563] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-10T18:42:14.909787] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-10T18:42:14.910011] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-10T18:42:14.910289] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-10T18:42:14.910353] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-10T18:42:14.910817] [DEBUG] [LOCAL ] EMF: Trimmed 6723 records to 3314 (keeping 200 days of data) [2025-10-10T18:42:14.932730] [DEBUG] [LOCAL ] EMF: Primary data saved (3314 records). [2025-10-10T18:42:14.932845] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-10T18:42:14.932935] [INFO ] [MAIN ] Update Progress: 734/2373 symbols completed. EMF took 32.0s. Estimated remaining: 3h 48m 10s. Rate: 7.2 symbols/min [2025-10-10T18:42:15.104777] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:42:15.166676] [DEBUG] [LOCAL ] EMR: Loaded 53610 existing records from primary storage. [2025-10-10T18:42:15.167188] [INFO ] [MAIN ] EMR: Loaded 53610 existing records. [2025-10-10T18:42:15.368088] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:42:15.368483] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-10T18:42:15.368575] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-10T18:42:15.369679] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-10T18:42:15.369756] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-10T18:42:15.494497] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-10T18:42:15.510164] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-10T18:42:15.763787] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:42:16.289441] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-10T18:42:17.089434] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-10T18:42:17.157097] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-10T18:42:17.428854] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T18:42:17.633229] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-10T18:42:17.889397] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-10T18:42:18.632440] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-10T18:42:18.689441] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-10T18:42:19.489431] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-10T18:42:19.657122] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-10T18:42:20.289412] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-10T18:42:21.089413] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-10T18:42:21.608890] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-10T18:42:21.896725] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-10T18:42:21.903339] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-10T18:42:22.247234] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-10T18:42:22.249709] [INFO ] [REMOTE ] EMO: Full fetch complete (17614 records). [2025-10-10T18:42:22.249953] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-10T18:42:22.616881] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-10T18:42:22.635287] [INFO ] [REMOTE ] EMP: Full fetch complete (4264 records). [2025-10-10T18:42:22.645683] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-10T18:42:22.645426] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-10T18:42:22.645869] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-10T18:42:22.652565] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-10T18:42:22.680780] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-10T18:42:22.692233] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-10T18:42:22.748863] [DEBUG] [LOCAL ] EMO: Trimmed 17614 records to 13185 (keeping 200 days of data) [2025-10-10T18:42:23.091306] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-10T18:42:23.092052] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-10T18:42:23.092708] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-10T18:42:23.092792] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-10T18:42:23.093285] [DEBUG] [LOCAL ] EMP: Trimmed 4264 records to 3112 (keeping 200 days of data) [2025-10-10T18:42:23.116818] [DEBUG] [LOCAL ] EMP: Primary data saved (3112 records). [2025-10-10T18:42:23.116935] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-10T18:42:23.117438] [INFO ] [MAIN ] Update Progress: 735/2373 symbols completed. EMP took 27.3s. Estimated remaining: 3h 48m 1s. Rate: 7.2 symbols/min [2025-10-10T18:42:23.226243] [DEBUG] [LOCAL ] EMO: Primary data saved (13185 records). [2025-10-10T18:42:23.231821] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-10T18:42:23.237104] [INFO ] [MAIN ] Update Progress: 736/2373 symbols completed. EMO took 35.4s. Estimated remaining: 3h 47m 35s. Rate: 7.2 symbols/min [2025-10-10T18:42:23.399895] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:42:23.470710] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:42:23.478619] [DEBUG] [LOCAL ] ENFY: Loaded 3256 existing records from primary storage. [2025-10-10T18:42:23.478982] [INFO ] [MAIN ] ENFY: Loaded 3256 existing records. [2025-10-10T18:42:23.510114] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-10T18:42:23.691239] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:42:23.692615] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-10-10T18:42:23.692716] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-10T18:42:23.693512] [DEBUG] [LOCAL ] ENB: Loaded 53900 existing records from primary storage. [2025-10-10T18:42:23.693805] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-10-10T18:42:23.694017] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-10-10T18:42:23.693959] [INFO ] [MAIN ] ENB: Loaded 53900 existing records. [2025-10-10T18:42:24.124523] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:42:24.179485] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-10T18:42:24.181625] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-10T18:42:24.187432] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-10T18:42:24.187530] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-10T18:42:24.404549] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:42:24.411134] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-10-10T18:42:24.668956] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:42:24.996540] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-10T18:42:25.089381] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-10T18:42:25.556792] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-10T18:42:25.612022] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-10T18:42:25.889395] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-10T18:42:26.689357] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-10-10T18:42:27.174162] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-10T18:42:27.273484] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T18:42:27.489351] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-10T18:42:27.593357] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-10T18:42:28.289379] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-10T18:42:29.095328] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-10-10T18:42:29.114907] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T18:42:29.858319] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-10T18:42:29.889344] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-10T18:42:30.374667] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T18:42:30.689428] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-10T18:42:31.489360] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-10-10T18:42:32.007380] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-10T18:42:32.020788] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-10T18:42:32.289377] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-10T18:42:32.823077] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T18:42:33.089382] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-10T18:42:33.889372] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-10-10T18:42:34.384302] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-10T18:42:34.508135] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-10T18:42:34.689354] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-10T18:42:35.224455] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-10T18:42:35.489411] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-10T18:42:36.289387] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-10T18:42:36.871043] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-10T18:42:37.089478] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-10T18:42:37.775105] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-10T18:42:37.889445] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-10T18:42:38.212854] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-10T18:42:38.689398] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-10T18:42:38.929748] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-10T18:42:38.934609] [INFO ] [REMOTE ] EMN: Full fetch complete (72097 records). [2025-10-10T18:42:38.934778] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-10T18:42:39.320700] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-10T18:42:39.320877] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-10T18:42:39.321918] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-10T18:42:39.322029] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-10T18:42:39.323521] [DEBUG] [LOCAL ] EMN: Trimmed 72097 records to 51344 (keeping 200 days of data) [2025-10-10T18:42:39.501346] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-10-10T18:42:39.585412] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T18:42:39.678763] [DEBUG] [LOCAL ] EMN: Primary data saved (51344 records). [2025-10-10T18:42:39.678907] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-10T18:42:39.678991] [INFO ] [MAIN ] Update Progress: 737/2373 symbols completed. EMN took 53.5s. Estimated remaining: 3h 47m 44s. Rate: 7.2 symbols/min [2025-10-10T18:42:39.845341] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:42:39.879755] [DEBUG] [LOCAL ] ENIC: Loaded 36571 existing records from primary storage. [2025-10-10T18:42:39.880081] [INFO ] [MAIN ] ENIC: Loaded 36571 existing records. [2025-10-10T18:42:40.057148] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:42:40.057398] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-10T18:42:40.057448] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-10T18:42:40.057793] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-10T18:42:40.057851] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-10T18:42:40.289393] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-10T18:42:40.401112] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-10T18:42:40.427688] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:42:40.819800] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-10T18:42:41.089392] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-10T18:42:41.889418] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-10T18:42:42.247512] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T18:42:42.689396] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-10T18:42:42.805689] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T18:42:43.489395] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-10T18:42:44.037510] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-10T18:42:44.289430] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-10T18:42:44.904995] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-10T18:42:45.059541] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-10T18:42:45.089452] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-10T18:42:45.889476] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-10-10T18:42:46.316958] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T18:42:46.570743] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-10T18:42:46.689415] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-10-10T18:42:47.033321] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T18:42:47.489366] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-10T18:42:47.579828] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-10T18:42:48.289388] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-10T18:42:49.089405] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-10-10T18:42:49.615702] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-10T18:42:49.648077] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-10T18:42:49.889412] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-10T18:42:50.357939] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-10T18:42:50.363467] [INFO ] [REMOTE ] EMR: Full fetch complete (77076 records). [2025-10-10T18:42:50.363615] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-10T18:42:50.694474] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-10-10T18:42:50.830147] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-10T18:42:50.830272] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-10T18:42:50.831511] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-10T18:42:50.831585] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-10T18:42:50.833331] [DEBUG] [LOCAL ] EMR: Trimmed 77076 records to 53997 (keeping 200 days of data) [2025-10-10T18:42:51.207070] [DEBUG] [LOCAL ] EMR: Primary data saved (53997 records). [2025-10-10T18:42:51.207237] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-10T18:42:51.207694] [INFO ] [MAIN ] Update Progress: 738/2373 symbols completed. EMR took 36.3s. Estimated remaining: 3h 47m 43s. Rate: 7.2 symbols/min [2025-10-10T18:42:51.405515] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:42:51.412607] [DEBUG] [LOCAL ] ENO: Loaded 1899 existing records from primary storage. [2025-10-10T18:42:51.412961] [INFO ] [MAIN ] ENO: Loaded 1899 existing records. [2025-10-10T18:42:51.493789] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-10T18:42:51.518317] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-10T18:42:51.607574] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:42:51.607908] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-10T18:42:51.607966] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-10T18:42:51.608270] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-10T18:42:51.608330] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-10T18:42:51.978039] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:42:51.988274] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-10T18:42:51.995499] [INFO ] [REMOTE ] ENB: Full fetch complete (77487 records). [2025-10-10T18:42:51.995794] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-10T18:42:52.294518] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-10. [2025-10-10T18:42:52.411926] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-10T18:42:52.412914] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-10T18:42:52.414353] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-10T18:42:52.414435] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-10T18:42:52.416722] [DEBUG] [LOCAL ] ENB: Trimmed 77487 records to 54289 (keeping 200 days of data) [2025-10-10T18:42:52.771693] [DEBUG] [LOCAL ] ENB: Primary data saved (54289 records). [2025-10-10T18:42:52.771879] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-10T18:42:52.771982] [INFO ] [MAIN ] Update Progress: 739/2373 symbols completed. ENB took 29.7s. Estimated remaining: 3h 47m 20s. Rate: 7.2 symbols/min [2025-10-10T18:42:52.953175] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:42:52.979799] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T18:42:53.026802] [DEBUG] [LOCAL ] ENOV: Loaded 45067 existing records from primary storage. [2025-10-10T18:42:53.027203] [INFO ] [MAIN ] ENOV: Loaded 45067 existing records. [2025-10-10T18:42:53.094506] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-10T18:42:53.138039] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T18:42:53.144051] [INFO ] [REMOTE ] ENFY: Full fetch complete (5621 records). [2025-10-10T18:42:53.170764] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-10-10T18:42:53.320837] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:42:53.343895] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-10T18:42:53.344084] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-10T18:42:53.344462] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-10T18:42:53.350069] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-10T18:42:53.893097] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-10T18:42:54.004740] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-10-10T18:42:54.015460] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-10-10T18:42:54.026697] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-10-10T18:42:54.031940] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-10-10T18:42:54.071931] [DEBUG] [LOCAL ] ENFY: Trimmed 5621 records to 3344 (keeping 200 days of data) [2025-10-10T18:42:54.104266] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:42:54.129037] [DEBUG] [LOCAL ] ENFY: Primary data saved (3344 records). [2025-10-10T18:42:54.129201] [INFO ] [MAIN ] ENFY: Full history saved. [2025-10-10T18:42:54.129330] [INFO ] [MAIN ] Update Progress: 740/2373 symbols completed. ENFY took 30.9s. Estimated remaining: 3h 46m 56s. Rate: 7.2 symbols/min [2025-10-10T18:42:54.368520] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:42:54.422479] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-10T18:42:54.446699] [DEBUG] [LOCAL ] ENR: Loaded 43536 existing records from primary storage. [2025-10-10T18:42:54.447180] [INFO ] [MAIN ] ENR: Loaded 43536 existing records. [2025-10-10T18:42:54.642933] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:42:54.643220] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-10T18:42:54.643274] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-10T18:42:54.643952] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-10T18:42:54.644013] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-10T18:42:54.694526] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-10T18:42:54.923187] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-10T18:42:55.037629] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:42:55.489400] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-10T18:42:56.079002] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-10T18:42:56.289396] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-10T18:42:56.438709] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T18:42:56.850221] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-10T18:42:57.089390] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-10T18:42:57.636531] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-10T18:42:57.889405] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-10T18:42:58.689439] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-10T18:42:59.489403] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-10T18:42:59.720573] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T18:43:00.240970] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-10T18:43:00.289384] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-10T18:43:00.369326] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T18:43:00.861199] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-10T18:43:01.089400] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-10T18:43:01.889430] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-10T18:43:02.689375] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-10T18:43:02.794311] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T18:43:03.489395] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-10T18:43:03.723283] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T18:43:04.072073] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-10T18:43:04.289404] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-10T18:43:04.451132] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-10T18:43:04.920983] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-10T18:43:05.089398] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-10T18:43:05.889362] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-10T18:43:06.685593] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-10T18:43:06.694140] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-10T18:43:07.491355] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-10T18:43:07.495045] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-10T18:43:07.870634] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-10T18:43:08.289364] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-10T18:43:08.382157] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T18:43:09.089452] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-10T18:43:09.877543] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T18:43:09.889324] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-10T18:43:10.689446] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-10T18:43:11.157556] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-10T18:43:11.212840] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-10T18:43:11.477788] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-10T18:43:11.489324] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-10T18:43:12.289394] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-10T18:43:12.916543] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-10T18:43:12.917366] [INFO ] [REMOTE ] ENO: Full fetch complete (3084 records). [2025-10-10T18:43:12.917435] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-10T18:43:13.094434] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-10T18:43:13.286185] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-10T18:43:13.286402] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-10T18:43:13.286713] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-10T18:43:13.287169] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-10T18:43:13.288388] [DEBUG] [LOCAL ] ENO: Trimmed 3084 records to 1913 (keeping 200 days of data) [2025-10-10T18:43:13.301278] [DEBUG] [LOCAL ] ENO: Primary data saved (1913 records). [2025-10-10T18:43:13.301344] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-10T18:43:13.301435] [INFO ] [MAIN ] Update Progress: 741/2373 symbols completed. ENO took 22.1s. Estimated remaining: 3h 47m 11s. Rate: 7.2 symbols/min [2025-10-10T18:43:13.521663] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T18:43:13.528971] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:43:13.573847] [DEBUG] [LOCAL ] ENS: Loaded 29440 existing records from primary storage. [2025-10-10T18:43:13.574222] [INFO ] [MAIN ] ENS: Loaded 29440 existing records. [2025-10-10T18:43:13.765080] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:43:13.765406] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-10T18:43:13.765471] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-10T18:43:13.765792] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-10T18:43:13.765851] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-10T18:43:13.894567] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-10T18:43:14.142777] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:43:14.640264] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-10T18:43:14.689404] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-10T18:43:15.489462] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-10T18:43:15.791880] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T18:43:15.954354] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T18:43:16.289394] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-10T18:43:17.089402] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-10T18:43:17.372814] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T18:43:17.726797] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-10T18:43:17.889683] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-10T18:43:17.894387] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-10T18:43:18.689399] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-10T18:43:19.489402] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-10T18:43:19.727637] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-10T18:43:19.840556] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-10T18:43:20.289396] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-10T18:43:21.089393] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-10T18:43:21.145084] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-10T18:43:21.521165] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-10T18:43:21.889397] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-10T18:43:22.630797] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-10T18:43:22.689417] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-10T18:43:23.489389] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-10T18:43:23.772127] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T18:43:24.289392] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-10T18:43:24.449223] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-10T18:43:24.518384] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-10T18:43:25.089416] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-10T18:43:25.293269] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-10T18:43:25.889413] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-10T18:43:26.689395] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-10T18:43:26.817389] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-10T18:43:26.822031] [INFO ] [REMOTE ] ENR: Full fetch complete (59053 records). [2025-10-10T18:43:26.822156] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-10T18:43:27.240148] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T18:43:27.243567] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-10T18:43:27.246861] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-10T18:43:27.248220] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-10T18:43:27.248310] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-10T18:43:27.248446] [INFO ] [REMOTE ] ENIC: Full fetch complete (51433 records). [2025-10-10T18:43:27.248889] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-10T18:43:27.353451] [DEBUG] [LOCAL ] ENR: Trimmed 59053 records to 43873 (keeping 200 days of data) [2025-10-10T18:43:27.495676] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-10T18:43:27.775023] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-10T18:43:27.775973] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-10T18:43:27.777309] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-10T18:43:27.777921] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-10T18:43:27.797404] [DEBUG] [LOCAL ] ENIC: Trimmed 51433 records to 36820 (keeping 200 days of data) [2025-10-10T18:43:28.114298] [DEBUG] [LOCAL ] ENIC: Primary data saved (36820 records). [2025-10-10T18:43:28.116504] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-10T18:43:28.117021] [INFO ] [MAIN ] Update Progress: 742/2373 symbols completed. ENIC took 48.4s. Estimated remaining: 3h 47m 17s. Rate: 7.2 symbols/min [2025-10-10T18:43:28.376847] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:43:28.384640] [DEBUG] [LOCAL ] ENR: Primary data saved (43873 records). [2025-10-10T18:43:28.384970] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-10T18:43:28.385114] [INFO ] [MAIN ] Update Progress: 743/2373 symbols completed. ENR took 34.3s. Estimated remaining: 3h 46m 51s. Rate: 7.2 symbols/min [2025-10-10T18:43:28.592824] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:43:28.594822] [DEBUG] [LOCAL ] ENVA: Loaded 25478 existing records from primary storage. [2025-10-10T18:43:28.595206] [INFO ] [MAIN ] ENVA: Loaded 25478 existing records. [2025-10-10T18:43:28.749009] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-10T18:43:28.814706] [DEBUG] [LOCAL ] EOD: Loaded 14933 existing records from primary storage. [2025-10-10T18:43:28.820923] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-10T18:43:28.822382] [INFO ] [MAIN ] EOD: Loaded 14933 existing records. [2025-10-10T18:43:28.915614] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:43:28.947290] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-10T18:43:28.958900] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-10T18:43:28.976671] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-10T18:43:28.976933] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-10T18:43:29.146699] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:43:29.152362] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-10T18:43:29.159036] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-10T18:43:29.171056] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-10T18:43:29.176434] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-10T18:43:29.497117] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T18:43:29.587480] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-10T18:43:29.762850] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:43:29.877556] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:43:29.889397] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-10T18:43:30.633621] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-10T18:43:30.689333] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-10T18:43:31.361119] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T18:43:31.494464] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-10T18:43:31.505721] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T18:43:32.289388] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-10T18:43:32.442735] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T18:43:33.071905] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-10T18:43:33.089332] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-10T18:43:33.889449] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-10T18:43:34.034994] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T18:43:34.576966] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-10T18:43:34.689383] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-10T18:43:34.950576] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-10T18:43:35.489405] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-10T18:43:36.172059] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T18:43:36.289378] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-10T18:43:36.586187] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-10T18:43:37.089394] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-10T18:43:37.685989] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-10T18:43:37.691492] [INFO ] [REMOTE ] ENS: Full fetch complete (42051 records). [2025-10-10T18:43:37.691773] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-10T18:43:37.894731] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-10T18:43:38.270763] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-10T18:43:38.270868] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-10T18:43:38.271534] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-10T18:43:38.271575] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-10T18:43:38.272684] [DEBUG] [LOCAL ] ENS: Trimmed 42051 records to 29670 (keeping 200 days of data) [2025-10-10T18:43:38.468878] [DEBUG] [LOCAL ] ENS: Primary data saved (29670 records). [2025-10-10T18:43:38.469239] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-10T18:43:38.469448] [INFO ] [MAIN ] Update Progress: 744/2373 symbols completed. ENS took 25.2s. Estimated remaining: 3h 46m 47s. Rate: 7.2 symbols/min [2025-10-10T18:43:38.640387] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:43:38.693764] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-10T18:43:38.693671] [DEBUG] [LOCAL ] EOG: Loaded 53734 existing records from primary storage. [2025-10-10T18:43:38.696243] [INFO ] [MAIN ] EOG: Loaded 53734 existing records. [2025-10-10T18:43:38.884266] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:43:38.889980] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-10T18:43:38.895704] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-10T18:43:38.897378] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-10T18:43:38.897490] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-10T18:43:38.897293] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-10T18:43:38.958234] [INFO ] [REMOTE ] ENOV: Full fetch complete (63318 records). [2025-10-10T18:43:38.979005] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-10T18:43:39.021125] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-10T18:43:39.500841] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-10T18:43:39.544884] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:43:39.708332] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-10T18:43:39.708432] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-10T18:43:39.709326] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-10T18:43:39.709391] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-10T18:43:39.710880] [DEBUG] [LOCAL ] ENOV: Trimmed 63318 records to 45382 (keeping 200 days of data) [2025-10-10T18:43:39.971152] [DEBUG] [LOCAL ] ENOV: Primary data saved (45382 records). [2025-10-10T18:43:39.971305] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-10T18:43:39.971391] [INFO ] [MAIN ] Update Progress: 745/2373 symbols completed. ENOV took 47.2s. Estimated remaining: 3h 46m 23s. Rate: 7.2 symbols/min [2025-10-10T18:43:40.134929] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:43:40.152160] [DEBUG] [LOCAL ] EOI: Loaded 10887 existing records from primary storage. [2025-10-10T18:43:40.152448] [INFO ] [MAIN ] EOI: Loaded 10887 existing records. [2025-10-10T18:43:40.301802] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-10T18:43:40.329071] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:43:40.346714] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-10T18:43:40.347677] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-10T18:43:40.349035] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-10T18:43:40.356342] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-10T18:43:40.356904] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-10T18:43:40.450473] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-10T18:43:40.755282] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:43:41.089368] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-10T18:43:41.889361] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-10T18:43:42.503521] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-10T18:43:42.529471] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-10T18:43:42.689345] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-10T18:43:42.912758] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-10T18:43:43.489431] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-10T18:43:44.289386] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-10T18:43:44.602964] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-10T18:43:44.780923] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-10T18:43:45.089377] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-10T18:43:45.811037] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-10T18:43:45.889387] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-10T18:43:46.060248] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T18:43:46.689367] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-10T18:43:46.938131] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-10T18:43:47.489429] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-10T18:43:48.289342] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-10T18:43:48.567101] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T18:43:48.824534] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T18:43:49.089425] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-10T18:43:49.271482] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T18:43:49.889389] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-10T18:43:50.689402] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-10T18:43:51.145231] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-10T18:43:51.169122] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T18:43:51.489392] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-10T18:43:51.988608] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-10T18:43:52.289385] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-10T18:43:52.525264] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-10T18:43:53.089410] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-10T18:43:53.889349] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-10T18:43:54.240969] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T18:43:54.351980] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-10T18:43:54.689352] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-10T18:43:54.791233] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-10T18:43:55.489395] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-10T18:43:56.289388] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-10T18:43:56.484564] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-10T18:43:56.637784] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-10T18:43:57.089439] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-10T18:43:57.424516] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-10T18:43:57.720113] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-10T18:43:57.889405] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-10T18:43:58.689411] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-10T18:43:59.028372] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-10T18:43:59.489393] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-10T18:43:59.802515] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-10T18:43:59.805205] [INFO ] [REMOTE ] EOD: Full fetch complete (20855 records). [2025-10-10T18:43:59.805290] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-10T18:44:00.186637] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-10T18:44:00.186783] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-10T18:44:00.187424] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-10T18:44:00.187470] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-10T18:44:00.188552] [DEBUG] [LOCAL ] EOD: Trimmed 20855 records to 15098 (keeping 200 days of data) [2025-10-10T18:44:00.278958] [DEBUG] [LOCAL ] EOD: Primary data saved (15098 records). [2025-10-10T18:44:00.279147] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-10T18:44:00.279251] [INFO ] [MAIN ] Update Progress: 746/2373 symbols completed. EOD took 31.9s. Estimated remaining: 3h 46m 41s. Rate: 7.2 symbols/min [2025-10-10T18:44:00.294509] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-10T18:44:00.466622] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:44:00.485411] [DEBUG] [LOCAL ] EOS: Loaded 15505 existing records from primary storage. [2025-10-10T18:44:00.485796] [INFO ] [MAIN ] EOS: Loaded 15505 existing records. [2025-10-10T18:44:00.665096] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:44:00.665352] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-10T18:44:00.665405] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-10T18:44:00.665590] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-10T18:44:00.665688] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-10T18:44:01.040919] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:44:01.089367] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-10T18:44:01.485914] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-10T18:44:01.699579] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T18:44:01.889407] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-10T18:44:02.431947] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T18:44:02.689411] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-10T18:44:03.234048] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-10T18:44:03.489384] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-10T18:44:04.056593] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-10T18:44:04.289392] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-10T18:44:04.832131] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-10T18:44:04.873067] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-10T18:44:05.089388] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-10T18:44:05.889392] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-10T18:44:05.958271] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-10T18:44:06.689404] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-10T18:44:07.239625] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T18:44:07.242297] [INFO ] [REMOTE ] ENVA: Full fetch complete (36710 records). [2025-10-10T18:44:07.242378] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-10T18:44:07.497368] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-10T18:44:07.686737] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-10T18:44:07.691206] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-10T18:44:07.691525] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-10T18:44:07.692889] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-10T18:44:07.692959] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-10T18:44:07.694245] [DEBUG] [LOCAL ] ENVA: Trimmed 36710 records to 25677 (keeping 200 days of data) [2025-10-10T18:44:07.842281] [DEBUG] [LOCAL ] ENVA: Primary data saved (25677 records). [2025-10-10T18:44:07.842427] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-10T18:44:07.842557] [INFO ] [MAIN ] Update Progress: 747/2373 symbols completed. ENVA took 39.7s. Estimated remaining: 3h 46m 31s. Rate: 7.2 symbols/min [2025-10-10T18:44:08.027141] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:44:08.038725] [DEBUG] [LOCAL ] EOT: Loaded 6841 existing records from primary storage. [2025-10-10T18:44:08.039053] [INFO ] [MAIN ] EOT: Loaded 6841 existing records. [2025-10-10T18:44:08.225467] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:44:08.226040] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-10T18:44:08.226139] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-10T18:44:08.226453] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-10T18:44:08.226525] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-10T18:44:08.294535] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-10T18:44:08.472388] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-10T18:44:08.631963] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:44:09.089406] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-10T18:44:09.889453] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-10T18:44:10.044219] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-10T18:44:10.462760] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-10T18:44:10.689397] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-10T18:44:11.245498] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-10T18:44:11.489375] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-10T18:44:11.578074] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T18:44:12.289366] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-10T18:44:12.578191] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T18:44:12.579982] [INFO ] [REMOTE ] EOI: Full fetch complete (16222 records). [2025-10-10T18:44:12.580056] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-10T18:44:12.976179] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-10T18:44:12.976292] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-10T18:44:12.976863] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-10T18:44:12.976928] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-10T18:44:12.977489] [DEBUG] [LOCAL ] EOI: Trimmed 16222 records to 10972 (keeping 200 days of data) [2025-10-10T18:44:13.047499] [DEBUG] [LOCAL ] EOI: Primary data saved (10972 records). [2025-10-10T18:44:13.047696] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-10T18:44:13.047809] [INFO ] [MAIN ] Update Progress: 748/2373 symbols completed. EOI took 33.1s. Estimated remaining: 3h 46m 16s. Rate: 7.2 symbols/min [2025-10-10T18:44:13.094482] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-10T18:44:13.237579] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:44:13.267065] [DEBUG] [LOCAL ] EPAC: Loaded 26880 existing records from primary storage. [2025-10-10T18:44:13.267411] [INFO ] [MAIN ] EPAC: Loaded 26880 existing records. [2025-10-10T18:44:13.474940] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:44:13.475215] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-10T18:44:13.475265] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-10T18:44:13.475705] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-10T18:44:13.475765] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-10T18:44:13.683299] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-10T18:44:13.872504] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:44:13.889337] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-10T18:44:14.689418] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-10T18:44:15.385869] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-10T18:44:15.437207] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-10T18:44:15.446799] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-10T18:44:15.489397] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-10T18:44:16.289400] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-10T18:44:16.895787] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-10T18:44:17.089379] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-10T18:44:17.226182] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-10T18:44:17.889417] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-10T18:44:18.275755] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-10T18:44:18.689392] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-10T18:44:19.157226] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-10T18:44:19.489439] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-10T18:44:19.535021] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-10T18:44:20.162822] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-10T18:44:20.289410] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-10T18:44:21.089390] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-10T18:44:21.889385] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-10T18:44:21.955936] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-10T18:44:22.331024] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-10T18:44:22.336873] [INFO ] [REMOTE ] EOG: Full fetch complete (77279 records). [2025-10-10T18:44:22.337066] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-10T18:44:22.696871] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-10T18:44:22.751580] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-10T18:44:22.751724] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-10T18:44:22.753003] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-10T18:44:22.753078] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-10T18:44:22.755079] [DEBUG] [LOCAL ] EOG: Trimmed 77279 records to 54124 (keeping 200 days of data) [2025-10-10T18:44:23.123454] [DEBUG] [LOCAL ] EOG: Primary data saved (54124 records). [2025-10-10T18:44:23.123766] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-10T18:44:23.124320] [INFO ] [MAIN ] Update Progress: 749/2373 symbols completed. EOG took 44.7s. Estimated remaining: 3h 46m 11s. Rate: 7.2 symbols/min [2025-10-10T18:44:23.303754] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:44:23.303946] [DEBUG] [LOCAL ] EPAM: No existing data file found in primary storage. [2025-10-10T18:44:23.303985] [WARN ] [MAIN ] EPAM: No existing data found, performing full refresh instead. [2025-10-10T18:44:23.304108] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-10T18:44:23.304150] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-10T18:44:23.304192] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-10T18:44:23.304227] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-10T18:44:23.431706] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-10T18:44:23.490179] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-10T18:44:23.564717] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-10T18:44:23.723853] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:44:24.289440] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-10T18:44:25.089409] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-10T18:44:25.217562] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T18:44:25.671008] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T18:44:25.889430] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-10T18:44:26.007869] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-10T18:44:26.689392] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-10T18:44:27.489418] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-10T18:44:27.583694] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T18:44:27.843725] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-10T18:44:28.289359] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-10T18:44:28.816008] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-10T18:44:29.089414] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-10T18:44:29.889389] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-10T18:44:30.087023] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T18:44:30.169770] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-10T18:44:30.689451] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-10T18:44:31.140832] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-10T18:44:31.489435] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-10T18:44:32.110867] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-10T18:44:32.289459] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-10T18:44:32.427474] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-10T18:44:33.089382] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-10T18:44:33.889375] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-10T18:44:34.161084] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T18:44:34.218004] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T18:44:34.689355] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-10T18:44:35.085060] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T18:44:35.489407] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-10T18:44:36.289401] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-10T18:44:36.555452] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T18:44:36.618829] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-10T18:44:36.621225] [INFO ] [REMOTE ] EOS: Full fetch complete (23329 records). [2025-10-10T18:44:36.621312] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-10T18:44:37.009070] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-10T18:44:37.009164] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-10T18:44:37.009849] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-10T18:44:37.009910] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-10T18:44:37.010665] [DEBUG] [LOCAL ] EOS: Trimmed 23329 records to 15639 (keeping 200 days of data) [2025-10-10T18:44:37.112284] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-10T18:44:37.116458] [DEBUG] [LOCAL ] EOS: Primary data saved (15639 records). [2025-10-10T18:44:37.116688] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-10T18:44:37.116817] [INFO ] [MAIN ] Update Progress: 750/2373 symbols completed. EOS took 36.8s. Estimated remaining: 3h 46m 15s. Rate: 7.2 symbols/min [2025-10-10T18:44:37.297429] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:44:37.345404] [DEBUG] [LOCAL ] EPC: Loaded 40043 existing records from primary storage. [2025-10-10T18:44:37.345827] [INFO ] [MAIN ] EPC: Loaded 40043 existing records. [2025-10-10T18:44:37.544719] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:44:37.544988] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-10T18:44:37.545041] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-10T18:44:37.545550] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-10T18:44:37.545618] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-10T18:44:37.897692] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-10T18:44:37.913780] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-10T18:44:38.016705] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:44:38.689377] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-10T18:44:39.016921] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-10T18:44:39.059012] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T18:44:39.489383] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-10T18:44:40.050508] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-10T18:44:40.053910] [INFO ] [REMOTE ] EPAC: Full fetch complete (38703 records). [2025-10-10T18:44:40.054049] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-10T18:44:40.295453] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-10T18:44:40.417752] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-10T18:44:40.417856] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-10T18:44:40.418745] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-10T18:44:40.418808] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-10T18:44:40.419758] [DEBUG] [LOCAL ] EPAC: Trimmed 38703 records to 27074 (keeping 200 days of data) [2025-10-10T18:44:40.586950] [DEBUG] [LOCAL ] EPAC: Primary data saved (27074 records). [2025-10-10T18:44:40.587117] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-10T18:44:40.587209] [INFO ] [MAIN ] Update Progress: 751/2373 symbols completed. EPAC took 27.5s. Estimated remaining: 3h 45m 56s. Rate: 7.2 symbols/min [2025-10-10T18:44:40.751679] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:44:40.802604] [DEBUG] [LOCAL ] EPD: Loaded 54001 existing records from primary storage. [2025-10-10T18:44:40.803004] [INFO ] [MAIN ] EPD: Loaded 54001 existing records. [2025-10-10T18:44:40.989340] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:44:40.990074] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-10T18:44:40.990163] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-10T18:44:40.990601] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-10T18:44:40.990698] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-10T18:44:41.091835] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-10T18:44:41.309152] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T18:44:41.399799] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:44:41.889451] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-10T18:44:41.967126] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-10T18:44:42.493825] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-10T18:44:42.689381] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-10T18:44:43.489415] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-10T18:44:43.534827] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T18:44:44.208079] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-10T18:44:44.209471] [INFO ] [REMOTE ] EOT: Full fetch complete (10641 records). [2025-10-10T18:44:44.209544] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-10T18:44:44.293092] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-10T18:44:44.360800] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T18:44:44.632870] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-10T18:44:44.632967] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-10T18:44:44.633466] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-10T18:44:44.633509] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-10T18:44:44.634025] [DEBUG] [LOCAL ] EOT: Trimmed 10641 records to 6907 (keeping 200 days of data) [2025-10-10T18:44:44.677767] [DEBUG] [LOCAL ] EOT: Primary data saved (6907 records). [2025-10-10T18:44:44.677948] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-10T18:44:44.678061] [INFO ] [MAIN ] Update Progress: 752/2373 symbols completed. EOT took 36.8s. Estimated remaining: 3h 45m 38s. Rate: 7.2 symbols/min [2025-10-10T18:44:44.854767] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:44:44.900555] [DEBUG] [LOCAL ] EPR: Loaded 44256 existing records from primary storage. [2025-10-10T18:44:44.900931] [INFO ] [MAIN ] EPR: Loaded 44256 existing records. [2025-10-10T18:44:45.089516] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:44:45.089720] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-10T18:44:45.090177] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-10T18:44:45.090416] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-10T18:44:45.091590] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-10T18:44:45.091696] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-10T18:44:45.484800] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:44:45.889365] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-10T18:44:45.957277] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-10T18:44:46.689437] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-10T18:44:47.266110] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T18:44:47.397517] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-10T18:44:47.489397] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-10T18:44:48.289356] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-10T18:44:48.589780] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T18:44:49.089388] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-10T18:44:49.647492] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-10T18:44:49.889362] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-10T18:44:49.959418] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-10T18:44:50.689384] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-10T18:44:50.812989] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-10T18:44:50.817190] [INFO ] [REMOTE ] EPAM: Full fetch complete (55950 records). [2025-10-10T18:44:50.817314] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-10T18:44:51.224867] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-10T18:44:51.224988] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-10T18:44:51.226383] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-10T18:44:51.226483] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-10T18:44:51.228263] [DEBUG] [LOCAL ] EPAM: Trimmed 55950 records to 39938 (keeping 200 days of data) [2025-10-10T18:44:51.488907] [DEBUG] [LOCAL ] EPAM: Primary data saved (39938 records). [2025-10-10T18:44:51.489323] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-10T18:44:51.489430] [INFO ] [MAIN ] Update Progress: 753/2373 symbols completed. EPAM took 28.4s. Estimated remaining: 3h 45m 27s. Rate: 7.2 symbols/min [2025-10-10T18:44:51.494929] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-10T18:44:51.609342] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T18:44:51.722960] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:44:51.775980] [DEBUG] [LOCAL ] EPRT: Loaded 48787 existing records from primary storage. [2025-10-10T18:44:51.776435] [INFO ] [MAIN ] EPRT: Loaded 48787 existing records. [2025-10-10T18:44:51.972884] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:44:51.973391] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-10T18:44:51.973480] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-10T18:44:51.983373] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-10T18:44:51.988858] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-10T18:44:52.064812] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-10T18:44:52.294627] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-10T18:44:52.380827] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:44:53.089389] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-10T18:44:53.275608] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-10T18:44:53.889405] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-10T18:44:53.946494] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-10T18:44:54.689368] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-10T18:44:54.798845] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T18:44:55.466853] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-10T18:44:55.489359] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-10T18:44:56.014337] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-10T18:44:56.289401] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-10T18:44:57.089389] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-10T18:44:57.239822] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-10T18:44:57.889405] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-10T18:44:58.183096] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-10T18:44:58.689390] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-10T18:44:58.908500] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-10T18:44:59.489405] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-10T18:44:59.785720] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T18:44:59.892172] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-10T18:45:00.289396] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-10T18:45:01.089371] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-10T18:45:01.889429] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-10T18:45:02.044930] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-10T18:45:02.168919] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T18:45:02.443245] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-10T18:45:02.689398] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-10T18:45:03.489360] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-10T18:45:03.633137] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T18:45:04.289427] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-10T18:45:04.524990] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T18:45:05.089387] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-10T18:45:05.641177] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-10T18:45:05.889398] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-10T18:45:06.061932] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T18:45:06.689416] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-10T18:45:07.058878] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T18:45:07.489448] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-10T18:45:07.794712] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T18:45:07.946917] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T18:45:07.951210] [INFO ] [REMOTE ] EPC: Full fetch complete (57050 records). [2025-10-10T18:45:07.951358] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-10T18:45:08.301560] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-10T18:45:08.358021] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-10T18:45:08.358121] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-10T18:45:08.359177] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-10T18:45:08.359250] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-10T18:45:08.360795] [DEBUG] [LOCAL ] EPC: Trimmed 57050 records to 40337 (keeping 200 days of data) [2025-10-10T18:45:08.677109] [DEBUG] [LOCAL ] EPC: Primary data saved (40337 records). [2025-10-10T18:45:08.677328] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-10T18:45:08.677485] [INFO ] [MAIN ] Update Progress: 754/2373 symbols completed. EPC took 31.6s. Estimated remaining: 3h 45m 37s. Rate: 7.2 symbols/min [2025-10-10T18:45:08.884526] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:45:08.900334] [DEBUG] [LOCAL ] EQBK: Loaded 11036 existing records from primary storage. [2025-10-10T18:45:08.900612] [INFO ] [MAIN ] EQBK: Loaded 11036 existing records. [2025-10-10T18:45:09.083840] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:45:09.084086] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-10T18:45:09.084136] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-10T18:45:09.084323] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-10T18:45:09.084382] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-10T18:45:09.118759] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-10T18:45:09.508589] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:45:09.611268] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-10T18:45:09.889372] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-10T18:45:10.689391] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-10T18:45:10.846395] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-10T18:45:11.019296] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T18:45:11.083917] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-10T18:45:11.489397] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-10T18:45:11.744697] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-10T18:45:12.289468] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-10T18:45:13.089371] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-10T18:45:13.655563] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T18:45:13.889478] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-10T18:45:14.051507] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T18:45:14.124023] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-10T18:45:14.689403] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-10T18:45:15.489362] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-10T18:45:16.042530] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-10T18:45:16.289387] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-10T18:45:16.612841] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T18:45:16.743018] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-10T18:45:17.089328] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-10T18:45:17.889416] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-10T18:45:18.028050] [DEBUG] [REMOTE ] EQBK: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-10T18:45:18.028466] [WARN ] [REMOTE ] EQBK: No data returned for month 2025-02 [2025-10-10T18:45:18.028569] [FATAL] [REMOTE ] EQBK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:45:18.028687] [FATAL] [MAIN ] EQBK: Failed to fetch primary data. [2025-10-10T18:45:18.028761] [WARN ] [MAIN ] EQBK: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:45:18.028838] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-10T18:45:18.028910] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-10T18:45:18.028950] [INFO ] [LOCAL ] EQBK: Starting deletion of derivative data. [2025-10-10T18:45:18.029204] [DEBUG] [LOCAL ] EQBK: Deleted derivative data file. [2025-10-10T18:45:18.029305] [INFO ] [MAIN ] Update Progress: 755/2373 symbols completed. EQBK took 9.4s. Estimated remaining: 3h 45m 31s. Rate: 7.2 symbols/min [2025-10-10T18:45:18.233079] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:45:18.248739] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T18:45:18.320395] [DEBUG] [LOCAL ] EQH: Loaded 53036 existing records from primary storage. [2025-10-10T18:45:18.320887] [INFO ] [MAIN ] EQH: Loaded 53036 existing records. [2025-10-10T18:45:18.511280] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:45:18.511925] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-10T18:45:18.512002] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-10T18:45:18.512360] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-10T18:45:18.512430] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-10T18:45:18.703285] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-10T18:45:18.903860] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:45:18.932822] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T18:45:19.489386] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-10T18:45:20.289414] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-10T18:45:20.692994] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-10T18:45:21.089365] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-10T18:45:21.529176] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-10T18:45:21.534030] [INFO ] [REMOTE ] EPD: Full fetch complete (77251 records). [2025-10-10T18:45:21.534186] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-10T18:45:21.534932] [FATAL] [VALIDATOR ] EPD: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:45:21.535029] [FATAL] [MAIN ] EPD: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:45:21.535072] [WARN ] [MAIN ] EPD: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:45:21.535111] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-10T18:45:21.535167] [DEBUG] [LOCAL ] EPD: No primary data file found to delete. [2025-10-10T18:45:21.535207] [INFO ] [LOCAL ] EPD: Starting deletion of derivative data. [2025-10-10T18:45:21.535377] [DEBUG] [LOCAL ] EPD: Deleted derivative data file. [2025-10-10T18:45:21.535468] [INFO ] [MAIN ] Update Progress: 756/2373 symbols completed. EPD took 40.9s. Estimated remaining: 3h 45m 12s. Rate: 7.2 symbols/min [2025-10-10T18:45:21.703019] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:45:21.753301] [DEBUG] [LOCAL ] EQNR: Loaded 53406 existing records from primary storage. [2025-10-10T18:45:21.753691] [INFO ] [MAIN ] EQNR: Loaded 53406 existing records. [2025-10-10T18:45:21.894315] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-10T18:45:21.935787] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:45:21.937119] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-10T18:45:21.937378] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-10T18:45:21.937843] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-10T18:45:21.937908] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-10T18:45:22.311798] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:45:22.365264] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-10T18:45:22.689710] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-10T18:45:22.861124] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-10T18:45:22.870732] [INFO ] [REMOTE ] EPR: Full fetch complete (63042 records). [2025-10-10T18:45:22.870995] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-10T18:45:23.413732] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-10T18:45:23.413857] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-10T18:45:23.414823] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-10T18:45:23.414890] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-10T18:45:23.416457] [DEBUG] [LOCAL ] EPR: Trimmed 63042 records to 44579 (keeping 200 days of data) [2025-10-10T18:45:23.493403] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-10T18:45:23.738059] [DEBUG] [LOCAL ] EPR: Primary data saved (44579 records). [2025-10-10T18:45:23.738225] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-10T18:45:23.738316] [INFO ] [MAIN ] Update Progress: 757/2373 symbols completed. EPR took 39.1s. Estimated remaining: 3h 44m 51s. Rate: 7.2 symbols/min [2025-10-10T18:45:23.937525] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-10T18:45:24.289360] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-10T18:45:24.498091] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T18:45:25.089366] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-10T18:45:25.833202] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-10T18:45:25.889360] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-10T18:45:25.997358] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-10T18:45:26.002107] [INFO ] [REMOTE ] EPRT: Full fetch complete (68999 records). [2025-10-10T18:45:26.002217] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-10T18:45:26.400932] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-10T18:45:26.401028] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-10T18:45:26.401970] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-10T18:45:26.402033] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-10T18:45:26.403344] [DEBUG] [LOCAL ] EPRT: Trimmed 68999 records to 49155 (keeping 200 days of data) [2025-10-10T18:45:26.704579] [DEBUG] [LOCAL ] EPRT: Primary data saved (49155 records). [2025-10-10T18:45:26.704856] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-10T18:45:26.705260] [INFO ] [MAIN ] Update Progress: 758/2373 symbols completed. EPRT took 35.2s. Estimated remaining: 3h 44m 31s. Rate: 7.2 symbols/min [2025-10-10T18:45:27.070974] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-10T18:45:27.081826] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-10T18:45:27.432441] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-10T18:45:27.489354] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-10T18:45:29.051025] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T18:45:29.062481] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-10T18:45:29.557939] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-10T18:45:29.568370] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-10T18:45:31.022438] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T18:45:31.033878] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-10T18:45:31.731188] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-10T18:45:31.742560] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-10T18:45:33.113440] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-10T18:45:33.125192] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-10T18:45:33.961878] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-10T18:45:33.974870] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-10T18:45:34.969188] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T18:45:34.982590] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-10T18:45:35.676347] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T18:45:35.687946] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-10T18:45:36.916208] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T18:45:36.928778] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-10T18:45:37.180799] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T18:45:37.191750] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-10T18:45:38.778779] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T18:45:38.791485] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-10T18:45:39.480883] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-10T18:45:39.493991] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-10T18:45:40.677939] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T18:45:40.690603] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-10T18:45:41.530416] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-10T18:45:41.543397] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-10T18:45:42.514070] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-10T18:45:42.519381] [INFO ] [REMOTE ] EQH: Full fetch complete (76392 records). [2025-10-10T18:45:42.519513] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-10T18:45:42.917559] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-10T18:45:42.917688] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-10T18:45:42.918711] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-10T18:45:42.918776] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-10T18:45:42.920472] [DEBUG] [LOCAL ] EQH: Trimmed 76392 records to 53424 (keeping 200 days of data) [2025-10-10T18:45:43.247890] [DEBUG] [LOCAL ] EQH: Primary data saved (53424 records). [2025-10-10T18:45:43.248058] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-10T18:45:43.248145] [INFO ] [MAIN ] Update Progress: 759/2373 symbols completed. EQH took 25.2s. Estimated remaining: 3h 44m 40s. Rate: 7.2 symbols/min [2025-10-10T18:45:43.668072] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-10T18:45:43.679839] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-10T18:45:45.718688] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-10T18:45:45.724705] [INFO ] [REMOTE ] EQNR: Full fetch complete (76422 records). [2025-10-10T18:45:45.724958] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-10T18:45:45.725914] [FATAL] [VALIDATOR ] EQNR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T18:45:45.726423] [FATAL] [MAIN ] EQNR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:45:45.726540] [WARN ] [MAIN ] EQNR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:45:45.726635] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-10T18:45:45.726825] [DEBUG] [LOCAL ] EQNR: No primary data file found to delete. [2025-10-10T18:45:45.726888] [INFO ] [LOCAL ] EQNR: Starting deletion of derivative data. [2025-10-10T18:45:45.727038] [DEBUG] [LOCAL ] EQNR: Deleted derivative data file. [2025-10-10T18:45:45.727157] [INFO ] [MAIN ] Update Progress: 760/2373 symbols completed. EQNR took 24.2s. Estimated remaining: 3h 44m 19s. Rate: 7.2 symbols/min [2025-10-10T18:45:46.333792] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:45:46.412027] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-10T18:45:46.398293] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:45:46.459437] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-10T18:45:46.478664] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:45:46.479095] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-10T18:45:46.480673] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-10T18:45:46.482484] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-10T18:45:46.482542] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-10T18:45:46.482277] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:45:46.596979] [DEBUG] [LOCAL ] EQV: Loaded 2713 existing records from primary storage. [2025-10-10T18:45:46.597593] [INFO ] [MAIN ] EQV: Loaded 2713 existing records. [2025-10-10T18:45:46.976177] [DEBUG] [LOCAL ] EQT: Loaded 54072 existing records from primary storage. [2025-10-10T18:45:47.022474] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:45:47.065774] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-10T18:45:47.071207] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-10T18:45:47.045478] [DEBUG] [LOCAL ] EQR: Loaded 51995 existing records from primary storage. [2025-10-10T18:45:47.076934] [INFO ] [MAIN ] EQT: Loaded 54072 existing records. [2025-10-10T18:45:47.095930] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-10T18:45:47.088994] [INFO ] [MAIN ] EQR: Loaded 51995 existing records. [2025-10-10T18:45:47.150276] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-10T18:45:47.110606] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:45:47.420076] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-10T18:45:47.720842] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:45:47.733439] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-10T18:45:47.664979] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:45:47.760330] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-10T18:45:47.746363] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-10T18:45:47.791155] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-10T18:45:47.794913] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-10T18:45:47.795032] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-10T18:45:47.851306] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-10T18:45:47.881210] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-10T18:45:47.963903] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:45:48.027238] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-10T18:45:48.505798] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-10T18:45:48.517920] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-10T18:45:48.601695] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:45:48.602241] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-10T18:45:48.674249] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:45:48.675594] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-10T18:45:49.074737] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-10T18:45:49.081972] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-10T18:45:49.083064] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-10T18:45:49.086205] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-10T18:45:49.470968] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-10T18:45:49.471883] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-10T18:45:49.905555] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-10T18:45:49.906541] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-10T18:45:50.060586] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T18:45:50.062943] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-10T18:45:50.182571] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-10T18:45:50.183845] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-10T18:45:50.613994] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T18:45:50.624396] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-10T18:45:50.686712] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-10T18:45:50.687756] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-10T18:45:50.755158] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-10T18:45:50.766304] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-10T18:45:50.788766] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-10T18:45:51.008447] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-10T18:45:51.489413] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-10T18:45:52.121080] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-10T18:45:52.289369] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-10T18:45:52.580896] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T18:45:52.694507] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-10T18:45:52.695614] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T18:45:53.089375] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-10T18:45:53.807868] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-10T18:45:53.889390] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-10T18:45:54.689375] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-10T18:45:55.379747] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-10T18:45:55.489439] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-10T18:45:55.934628] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-10T18:45:55.935411] [INFO ] [REMOTE ] EQS: Full fetch complete (2490 records). [2025-10-10T18:45:55.935478] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-10T18:45:56.113009] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-10T18:45:56.113292] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:45:56.113520] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:45:56.113674] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-10T18:45:56.113862] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-10T18:45:56.113908] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-10T18:45:56.113950] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-10T18:45:56.124168] [INFO ] [MAIN ] Update Progress: 761/2373 symbols completed. EQS took 10.4s. Estimated remaining: 3h 44m 15s. Rate: 7.2 symbols/min [2025-10-10T18:45:56.256241] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-10T18:45:56.294564] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-10T18:45:56.346943] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:45:56.396302] [DEBUG] [LOCAL ] ERJ: Loaded 50781 existing records from primary storage. [2025-10-10T18:45:56.396742] [INFO ] [MAIN ] ERJ: Loaded 50781 existing records. [2025-10-10T18:45:56.572406] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:45:56.572795] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-10T18:45:56.572853] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-10T18:45:56.573125] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-10T18:45:56.573180] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-10T18:45:56.914336] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:45:57.089386] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-10T18:45:57.889356] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-10T18:45:58.345356] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-10T18:45:58.548308] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-10T18:45:58.689331] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-10T18:45:59.014973] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T18:45:59.489366] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-10T18:46:00.289452] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-10T18:46:00.885296] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-10T18:46:00.924015] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-10T18:46:00.965580] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-10T18:46:01.089359] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-10T18:46:01.889456] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-10T18:46:02.652735] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-10T18:46:02.689334] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-10T18:46:03.233691] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-10T18:46:03.408187] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-10T18:46:03.489391] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-10T18:46:04.289379] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-10T18:46:05.089375] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-10T18:46:05.320281] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T18:46:05.889453] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-10T18:46:05.953298] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T18:46:06.689389] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-10T18:46:06.979029] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T18:46:07.489352] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-10T18:46:07.801571] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-10T18:46:07.860249] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T18:46:08.289386] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-10T18:46:09.089404] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-10T18:46:09.521695] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T18:46:09.889352] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-10T18:46:10.276092] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T18:46:10.689357] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-10T18:46:10.813718] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T18:46:11.489492] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-10T18:46:11.899639] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T18:46:12.289359] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-10T18:46:12.532383] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T18:46:13.089462] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-10T18:46:13.613173] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-10T18:46:13.707619] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-10T18:46:13.889414] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-10T18:46:14.237564] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T18:46:14.467675] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-10T18:46:14.468448] [INFO ] [REMOTE ] EQV: Full fetch complete (5734 records). [2025-10-10T18:46:14.468524] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-10T18:46:14.694553] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-10T18:46:14.840034] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-10T18:46:14.840121] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-10T18:46:14.840328] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-10T18:46:14.840368] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-10T18:46:14.840769] [DEBUG] [LOCAL ] EQV: Trimmed 5734 records to 2727 (keeping 200 days of data) [2025-10-10T18:46:14.856876] [DEBUG] [LOCAL ] EQV: Primary data saved (2727 records). [2025-10-10T18:46:14.856942] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-10T18:46:14.857012] [INFO ] [MAIN ] Update Progress: 762/2373 symbols completed. EQV took 29.1s. Estimated remaining: 3h 44m 29s. Rate: 7.2 symbols/min [2025-10-10T18:46:15.038373] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:46:15.079681] [DEBUG] [LOCAL ] ERO: Loaded 41893 existing records from primary storage. [2025-10-10T18:46:15.080031] [INFO ] [MAIN ] ERO: Loaded 41893 existing records. [2025-10-10T18:46:15.254854] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:46:15.255107] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-10T18:46:15.255154] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-10T18:46:15.255431] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-10T18:46:15.255489] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-10T18:46:15.494626] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-10T18:46:15.618814] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:46:16.289431] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-10T18:46:16.594213] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T18:46:17.089374] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-10T18:46:17.840988] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-10T18:46:17.889404] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-10T18:46:18.206109] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-10T18:46:18.639458] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-10T18:46:18.689352] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-10T18:46:19.489380] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-10T18:46:20.073185] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-10T18:46:20.080217] [INFO ] [REMOTE ] EQT: Full fetch complete (77694 records). [2025-10-10T18:46:20.080408] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-10T18:46:20.289670] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-10T18:46:20.496770] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-10T18:46:20.496942] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-10T18:46:20.498081] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-10T18:46:20.498225] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-10T18:46:20.501927] [DEBUG] [LOCAL ] EQT: Trimmed 77694 records to 54462 (keeping 200 days of data) [2025-10-10T18:46:20.648574] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T18:46:20.814305] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T18:46:20.926402] [DEBUG] [LOCAL ] EQT: Primary data saved (54462 records). [2025-10-10T18:46:20.926583] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-10T18:46:20.926698] [INFO ] [MAIN ] Update Progress: 763/2373 symbols completed. EQT took 35.2s. Estimated remaining: 3h 44m 16s. Rate: 7.2 symbols/min [2025-10-10T18:46:21.090306] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-10T18:46:21.090196] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:46:21.143450] [DEBUG] [LOCAL ] ES: Loaded 53014 existing records from primary storage. [2025-10-10T18:46:21.143871] [INFO ] [MAIN ] ES: Loaded 53014 existing records. [2025-10-10T18:46:21.343696] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:46:21.343947] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-10T18:46:21.343995] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-10T18:46:21.344509] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-10T18:46:21.344568] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-10T18:46:21.693808] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:46:21.889354] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-10T18:46:22.299341] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-10T18:46:22.689353] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-10T18:46:22.717700] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T18:46:23.489357] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-10T18:46:23.769632] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T18:46:24.289428] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-10T18:46:24.454023] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T18:46:24.577769] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-10T18:46:25.089382] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-10T18:46:25.889350] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-10T18:46:26.246570] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T18:46:26.599562] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-10T18:46:26.604295] [INFO ] [REMOTE ] ERJ: Full fetch complete (72368 records). [2025-10-10T18:46:26.604421] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-10T18:46:26.699104] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-10T18:46:26.990214] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-10T18:46:26.990304] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-10T18:46:26.991375] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-10T18:46:26.991441] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-10T18:46:26.992945] [DEBUG] [LOCAL ] ERJ: Trimmed 72368 records to 51129 (keeping 200 days of data) [2025-10-10T18:46:27.303459] [DEBUG] [LOCAL ] ERJ: Primary data saved (51129 records). [2025-10-10T18:46:27.303606] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-10T18:46:27.303725] [INFO ] [MAIN ] Update Progress: 764/2373 symbols completed. ERJ took 31.2s. Estimated remaining: 3h 44m 3s. Rate: 7.2 symbols/min [2025-10-10T18:46:27.477447] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:46:27.492553] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-10T18:46:27.509308] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-10T18:46:27.544550] [DEBUG] [LOCAL ] ESAB: Loaded 26259 existing records from primary storage. [2025-10-10T18:46:27.544865] [INFO ] [MAIN ] ESAB: Loaded 26259 existing records. [2025-10-10T18:46:27.718600] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:46:27.718869] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-10T18:46:27.718918] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-10T18:46:27.719130] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-10T18:46:27.719185] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-10T18:46:28.082011] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:46:28.289356] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-10T18:46:28.445222] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T18:46:29.089414] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-10T18:46:29.413458] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T18:46:29.498866] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-10T18:46:29.889376] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-10T18:46:30.689480] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-10T18:46:31.008169] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T18:46:31.135132] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T18:46:31.489383] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-10T18:46:32.046990] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T18:46:32.289380] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-10T18:46:32.700494] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T18:46:33.089379] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-10T18:46:33.889414] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-10T18:46:34.186475] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T18:46:34.191488] [INFO ] [REMOTE ] EQR: Full fetch complete (74131 records). [2025-10-10T18:46:34.191614] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-10T18:46:34.584497] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-10T18:46:34.584601] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-10T18:46:34.585595] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-10T18:46:34.585701] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-10T18:46:34.587143] [DEBUG] [LOCAL ] EQR: Trimmed 74131 records to 52374 (keeping 200 days of data) [2025-10-10T18:46:34.694143] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-10T18:46:34.925297] [DEBUG] [LOCAL ] EQR: Primary data saved (52374 records). [2025-10-10T18:46:34.926095] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-10T18:46:34.926267] [INFO ] [MAIN ] Update Progress: 765/2373 symbols completed. EQR took 49.2s. Estimated remaining: 3h 43m 53s. Rate: 7.2 symbols/min [2025-10-10T18:46:35.098295] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:46:35.130093] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T18:46:35.154985] [DEBUG] [LOCAL ] ESE: Loaded 16664 existing records from primary storage. [2025-10-10T18:46:35.155246] [INFO ] [MAIN ] ESE: Loaded 16664 existing records. [2025-10-10T18:46:35.335456] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:46:35.335826] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-10T18:46:35.335970] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-10T18:46:35.336302] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-10T18:46:35.336450] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-10T18:46:35.437942] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T18:46:35.494574] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-10T18:46:35.719021] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:46:35.933777] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-10T18:46:36.289377] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-10T18:46:37.090944] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-10T18:46:37.091085] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-10T18:46:37.233053] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-10T18:46:37.889390] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-10T18:46:38.689402] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-10T18:46:39.059255] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T18:46:39.125782] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T18:46:39.489395] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-10T18:46:40.289415] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-10T18:46:40.380026] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T18:46:40.788561] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T18:46:40.891611] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-10T18:46:41.089373] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-10T18:46:41.889406] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-10T18:46:42.284097] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-10T18:46:42.689404] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-10T18:46:42.882409] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-10T18:46:43.489392] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-10T18:46:44.289377] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-10T18:46:44.741960] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T18:46:44.810336] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-10T18:46:45.089378] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-10T18:46:45.889368] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-10T18:46:46.072448] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T18:46:46.439478] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T18:46:46.689366] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-10T18:46:47.489363] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-10T18:46:47.830501] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T18:46:47.855043] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T18:46:48.289400] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-10T18:46:49.094523] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-10T18:46:49.117531] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-10T18:46:49.499415] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-10T18:46:49.889403] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-10T18:46:50.181859] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-10T18:46:50.689411] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-10T18:46:51.489417] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-10T18:46:51.738427] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T18:46:52.289373] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-10T18:46:52.500072] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-10T18:46:52.618412] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T18:46:53.089434] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-10T18:46:53.889460] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-10T18:46:54.090886] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-10T18:46:54.095756] [INFO ] [REMOTE ] ERO: Full fetch complete (59860 records). [2025-10-10T18:46:54.095918] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-10T18:46:54.433450] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T18:46:54.472872] [INFO ] [REMOTE ] ESAB: Full fetch complete (35760 records). [2025-10-10T18:46:54.492837] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-10T18:46:54.508249] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-10T18:46:54.519773] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-10T18:46:54.552803] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-10T18:46:54.585286] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-10T18:46:54.633260] [DEBUG] [LOCAL ] ERO: Trimmed 59860 records to 42268 (keeping 200 days of data) [2025-10-10T18:46:54.734168] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-10T18:46:55.015539] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-10T18:46:55.016024] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-10T18:46:55.017022] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-10T18:46:55.070096] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-10T18:46:55.117094] [DEBUG] [LOCAL ] ESAB: Trimmed 35760 records to 26416 (keeping 200 days of data) [2025-10-10T18:46:55.132980] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T18:46:55.337978] [DEBUG] [LOCAL ] ERO: Primary data saved (42268 records). [2025-10-10T18:46:55.346801] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-10T18:46:55.346981] [INFO ] [MAIN ] Update Progress: 766/2373 symbols completed. ERO took 40.5s. Estimated remaining: 3h 44m 10s. Rate: 7.2 symbols/min [2025-10-10T18:46:55.489755] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-10T18:46:55.505073] [DEBUG] [LOCAL ] ESAB: Primary data saved (26416 records). [2025-10-10T18:46:55.533755] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-10T18:46:55.554159] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:46:55.554576] [INFO ] [MAIN ] Update Progress: 767/2373 symbols completed. ESAB took 28.3s. Estimated remaining: 3h 43m 45s. Rate: 7.2 symbols/min [2025-10-10T18:46:55.732106] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:46:55.771828] [DEBUG] [LOCAL ] ESI: Loaded 51049 existing records from primary storage. [2025-10-10T18:46:55.772198] [INFO ] [MAIN ] ESI: Loaded 51049 existing records. [2025-10-10T18:46:55.980389] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:46:55.980705] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-10T18:46:55.982969] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-10T18:46:55.982797] [DEBUG] [LOCAL ] ESNT: Loaded 38557 existing records from primary storage. [2025-10-10T18:46:55.983476] [INFO ] [MAIN ] ESNT: Loaded 38557 existing records. [2025-10-10T18:46:55.983321] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-10T18:46:55.983636] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-10T18:46:56.336930] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:46:56.354850] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-10T18:46:56.355228] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-10T18:46:56.418030] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-10T18:46:56.418257] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-10T18:46:56.744208] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:46:56.745037] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-10T18:46:56.829171] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T18:46:57.003638] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:46:57.034708] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-10T18:46:57.089360] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-10T18:46:57.889427] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-10T18:46:58.542092] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T18:46:58.689338] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-10T18:46:58.970215] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T18:46:59.026566] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-10T18:46:59.489432] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-10T18:47:00.127796] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T18:47:00.289386] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-10T18:47:01.089356] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-10T18:47:01.356424] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T18:47:01.362009] [INFO ] [REMOTE ] ES: Full fetch complete (76227 records). [2025-10-10T18:47:01.362193] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-10T18:47:01.775445] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-10T18:47:01.775532] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-10T18:47:01.777194] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-10T18:47:01.777267] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-10T18:47:01.779156] [DEBUG] [LOCAL ] ES: Trimmed 76227 records to 53386 (keeping 200 days of data) [2025-10-10T18:47:01.889513] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-10T18:47:02.133964] [DEBUG] [LOCAL ] ES: Primary data saved (53386 records). [2025-10-10T18:47:02.134152] [INFO ] [MAIN ] ES: Full history saved. [2025-10-10T18:47:02.134253] [INFO ] [MAIN ] Update Progress: 768/2373 symbols completed. ES took 41.2s. Estimated remaining: 3h 43m 33s. Rate: 7.2 symbols/min [2025-10-10T18:47:02.319622] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:47:02.359539] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-10T18:47:02.411669] [DEBUG] [LOCAL ] ESRT: Loaded 46673 existing records from primary storage. [2025-10-10T18:47:02.412042] [INFO ] [MAIN ] ESRT: Loaded 46673 existing records. [2025-10-10T18:47:02.613542] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:47:02.613823] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-10T18:47:02.613881] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-10T18:47:02.614380] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-10T18:47:02.614439] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-10T18:47:02.691811] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-10T18:47:03.003233] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:47:03.036067] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T18:47:03.232197] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-10T18:47:03.489380] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-10T18:47:04.289341] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-10T18:47:04.669478] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T18:47:05.089433] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-10T18:47:05.229157] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T18:47:05.231472] [INFO ] [REMOTE ] ESE: Full fetch complete (22439 records). [2025-10-10T18:47:05.231605] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-10T18:47:05.337906] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T18:47:05.664887] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-10T18:47:05.664991] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-10T18:47:05.665970] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-10T18:47:05.666035] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-10T18:47:05.666796] [DEBUG] [LOCAL ] ESE: Trimmed 22439 records to 16766 (keeping 200 days of data) [2025-10-10T18:47:05.783544] [DEBUG] [LOCAL ] ESE: Primary data saved (16766 records). [2025-10-10T18:47:05.783753] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-10T18:47:05.783866] [INFO ] [MAIN ] Update Progress: 769/2373 symbols completed. ESE took 30.9s. Estimated remaining: 3h 43m 15s. Rate: 7.2 symbols/min [2025-10-10T18:47:05.891226] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-10T18:47:05.971079] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:47:06.006886] [DEBUG] [LOCAL ] ESS: Loaded 29941 existing records from primary storage. [2025-10-10T18:47:06.007234] [INFO ] [MAIN ] ESS: Loaded 29941 existing records. [2025-10-10T18:47:06.209207] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:47:06.209612] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-10T18:47:06.209716] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-10T18:47:06.210150] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-10T18:47:06.210222] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-10T18:47:06.581205] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:47:06.689426] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-10T18:47:06.806044] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T18:47:07.489420] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-10T18:47:07.671194] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T18:47:08.087007] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T18:47:08.289398] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-10T18:47:08.805467] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T18:47:09.089408] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-10T18:47:09.889459] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-10T18:47:10.325994] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T18:47:10.437883] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T18:47:10.689372] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-10T18:47:11.489388] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-10T18:47:11.514796] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T18:47:11.863591] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T18:47:12.289365] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-10T18:47:13.089404] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-10T18:47:13.203419] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T18:47:13.886767] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-10T18:47:13.896413] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-10T18:47:14.689348] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-10T18:47:14.799714] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-10T18:47:14.906829] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-10T18:47:15.489378] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-10T18:47:16.289350] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-10T18:47:16.545143] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T18:47:17.089349] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-10T18:47:17.195348] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-10T18:47:17.534772] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-10T18:47:17.889408] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-10T18:47:18.689343] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-10T18:47:19.296302] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-10T18:47:19.489363] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-10T18:47:19.841267] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-10T18:47:20.289373] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-10T18:47:20.397349] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T18:47:21.089385] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-10T18:47:21.365788] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T18:47:21.455805] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-10T18:47:21.889428] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-10T18:47:22.692871] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-10T18:47:22.694165] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-10T18:47:23.062719] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-10T18:47:23.489485] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-10T18:47:24.289444] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-10T18:47:24.495233] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T18:47:25.089409] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-10T18:47:25.266139] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T18:47:25.889423] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-10T18:47:26.067891] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T18:47:26.689371] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-10T18:47:26.845557] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-10T18:47:26.849773] [INFO ] [REMOTE ] ESNT: Full fetch complete (57108 records). [2025-10-10T18:47:26.849884] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-10T18:47:27.244735] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-10T18:47:27.244836] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-10T18:47:27.246745] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-10T18:47:27.246813] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-10T18:47:27.248304] [DEBUG] [LOCAL ] ESNT: Trimmed 57108 records to 38858 (keeping 200 days of data) [2025-10-10T18:47:27.489579] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-10T18:47:27.509045] [DEBUG] [LOCAL ] ESNT: Primary data saved (38858 records). [2025-10-10T18:47:27.509383] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-10T18:47:27.509575] [INFO ] [MAIN ] Update Progress: 770/2373 symbols completed. ESNT took 32.0s. Estimated remaining: 3h 43m 34s. Rate: 7.2 symbols/min [2025-10-10T18:47:27.719748] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:47:27.722058] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-10T18:47:27.778838] [DEBUG] [LOCAL ] ESTC: Loaded 50479 existing records from primary storage. [2025-10-10T18:47:27.779238] [INFO ] [MAIN ] ESTC: Loaded 50479 existing records. [2025-10-10T18:47:27.963780] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:47:27.964205] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-10T18:47:27.964375] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-10T18:47:27.964860] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-10T18:47:27.964923] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-10T18:47:28.174406] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-10T18:47:28.295573] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-10T18:47:28.390740] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:47:29.089340] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-10T18:47:29.335490] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T18:47:29.822703] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T18:47:29.889352] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-10T18:47:30.689423] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-10T18:47:30.729016] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T18:47:31.489380] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-10T18:47:31.558098] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T18:47:32.289359] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-10T18:47:32.387459] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-10T18:47:32.392802] [INFO ] [REMOTE ] ESI: Full fetch complete (72872 records). [2025-10-10T18:47:32.392982] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-10T18:47:32.799457] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-10T18:47:32.799605] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-10T18:47:32.800939] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-10T18:47:32.801008] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-10T18:47:32.802610] [DEBUG] [LOCAL ] ESI: Trimmed 72872 records to 51434 (keeping 200 days of data) [2025-10-10T18:47:32.922978] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T18:47:32.951843] [INFO ] [REMOTE ] ESRT: Full fetch complete (66451 records). [2025-10-10T18:47:32.956950] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-10T18:47:33.091952] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-10T18:47:33.516449] [DEBUG] [LOCAL ] ESI: Primary data saved (51434 records). [2025-10-10T18:47:33.526689] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-10T18:47:33.529213] [INFO ] [MAIN ] Update Progress: 771/2373 symbols completed. ESI took 38.2s. Estimated remaining: 3h 43m 21s. Rate: 7.2 symbols/min [2025-10-10T18:47:33.669548] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-10T18:47:33.669839] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-10T18:47:33.687943] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-10T18:47:33.688157] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-10T18:47:33.743217] [DEBUG] [LOCAL ] ESRT: Trimmed 66451 records to 46989 (keeping 200 days of data) [2025-10-10T18:47:33.796210] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:47:33.801523] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T18:47:33.899928] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-10T18:47:34.111619] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-10-10T18:47:34.125452] [INFO ] [MAIN ] ET: Loaded 54179 existing records. [2025-10-10T18:47:34.172276] [DEBUG] [LOCAL ] ESRT: Primary data saved (46989 records). [2025-10-10T18:47:34.214073] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-10T18:47:34.214226] [INFO ] [MAIN ] Update Progress: 772/2373 symbols completed. ESRT took 32.1s. Estimated remaining: 3h 42m 57s. Rate: 7.2 symbols/min [2025-10-10T18:47:34.481245] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:47:34.494951] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-10T18:47:34.511769] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-10T18:47:34.513350] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-10T18:47:34.513287] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:47:34.513503] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-10T18:47:34.714528] [DEBUG] [LOCAL ] ETB: Loaded 12264 existing records from primary storage. [2025-10-10T18:47:34.780549] [INFO ] [MAIN ] ETB: Loaded 12264 existing records. [2025-10-10T18:47:35.014437] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:47:35.077458] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-10T18:47:35.099348] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:47:35.100753] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-10T18:47:35.100929] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-10T18:47:35.101187] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-10T18:47:35.101245] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-10T18:47:35.321427] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-10T18:47:35.520208] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-10T18:47:35.584825] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T18:47:35.631212] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:47:36.289404] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-10T18:47:37.089361] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-10T18:47:37.506911] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-10T18:47:37.553154] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-10T18:47:37.573858] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T18:47:37.889408] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-10T18:47:38.415394] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T18:47:38.418741] [INFO ] [REMOTE ] ESS: Full fetch complete (43233 records). [2025-10-10T18:47:38.418839] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-10T18:47:38.694608] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-10T18:47:38.828114] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-10T18:47:38.828231] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-10T18:47:38.829257] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-10T18:47:38.829330] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-10T18:47:38.831062] [DEBUG] [LOCAL ] ESS: Trimmed 43233 records to 30192 (keeping 200 days of data) [2025-10-10T18:47:39.062043] [DEBUG] [LOCAL ] ESS: Primary data saved (30192 records). [2025-10-10T18:47:39.062211] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-10T18:47:39.062357] [INFO ] [MAIN ] Update Progress: 773/2373 symbols completed. ESS took 33.3s. Estimated remaining: 3h 42m 41s. Rate: 7.2 symbols/min [2025-10-10T18:47:39.244798] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:47:39.275251] [DEBUG] [LOCAL ] ETD: Loaded 27570 existing records from primary storage. [2025-10-10T18:47:39.275566] [INFO ] [MAIN ] ETD: Loaded 27570 existing records. [2025-10-10T18:47:39.461964] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:47:39.462348] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-10T18:47:39.462400] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-10T18:47:39.462739] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-10T18:47:39.462798] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-10T18:47:39.496290] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-10T18:47:39.757124] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-10T18:47:39.903446] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:47:40.289388] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-10T18:47:40.377837] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-10T18:47:41.089357] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-10T18:47:41.336893] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T18:47:41.414085] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-10T18:47:41.889388] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-10T18:47:42.689413] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-10T18:47:43.392808] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-10T18:47:43.489388] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-10T18:47:43.524205] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T18:47:43.564211] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-10T18:47:44.185580] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-10T18:47:44.289398] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-10T18:47:45.089414] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-10T18:47:45.889409] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-10T18:47:46.239920] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T18:47:46.276048] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T18:47:46.689399] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-10T18:47:47.489454] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-10T18:47:48.289416] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-10T18:47:48.699507] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T18:47:48.771131] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T18:47:48.928548] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (3.04 seconds). [2025-10-10T18:47:49.089343] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-10T18:47:49.399574] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-10T18:47:49.889380] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-10T18:47:50.689402] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-10T18:47:51.416286] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-10T18:47:51.489382] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-10T18:47:52.224622] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (3.14 seconds). [2025-10-10T18:47:52.289376] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-10T18:47:52.636033] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T18:47:52.853522] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-10T18:47:53.089416] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-10T18:47:53.889438] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-10T18:47:54.689387] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-10T18:47:54.715473] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T18:47:54.731104] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-10T18:47:54.872129] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-10T18:47:55.489398] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-10T18:47:56.289375] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-10T18:47:56.675780] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T18:47:56.951750] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-10T18:47:57.089447] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-10T18:47:57.889386] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-10T18:47:57.998161] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-10T18:47:58.689403] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-10T18:47:58.810727] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-10T18:47:59.112432] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.82 seconds). [2025-10-10T18:47:59.222374] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-10T18:47:59.489390] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-10T18:48:00.289413] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-10T18:48:01.089388] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-10T18:48:01.414547] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T18:48:01.889361] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-10T18:48:02.012901] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-10T18:48:02.689404] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-10T18:48:03.098444] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T18:48:03.142388] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-10T18:48:03.144407] [INFO ] [REMOTE ] ETB: Full fetch complete (18339 records). [2025-10-10T18:48:03.144481] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-10T18:48:03.516943] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-10T18:48:03.526944] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-10T18:48:03.527099] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-10T18:48:03.528861] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-10T18:48:03.528933] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-10T18:48:03.529569] [DEBUG] [LOCAL ] ETB: Trimmed 18339 records to 12334 (keeping 200 days of data) [2025-10-10T18:48:03.613395] [DEBUG] [LOCAL ] ETB: Primary data saved (12334 records). [2025-10-10T18:48:03.613570] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-10T18:48:03.613703] [INFO ] [MAIN ] Update Progress: 774/2373 symbols completed. ETB took 29.4s. Estimated remaining: 3h 43m 6s. Rate: 7.2 symbols/min [2025-10-10T18:48:03.798660] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:48:03.819627] [DEBUG] [LOCAL ] ETG: Loaded 16668 existing records from primary storage. [2025-10-10T18:48:03.819964] [INFO ] [MAIN ] ETG: Loaded 16668 existing records. [2025-10-10T18:48:04.022423] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:48:04.023001] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-10T18:48:04.023087] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-10T18:48:04.023567] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-10T18:48:04.023629] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-10T18:48:04.239420] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-10T18:48:04.298402] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-10T18:48:04.444289] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:48:05.089376] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-10T18:48:05.191200] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-10T18:48:05.889403] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-10T18:48:06.047585] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-10T18:48:06.689411] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-10T18:48:06.894509] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-10T18:48:07.489400] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-10T18:48:07.751399] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T18:48:07.756701] [INFO ] [REMOTE ] ESTC: Full fetch complete (72133 records). [2025-10-10T18:48:07.756832] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-10T18:48:08.160253] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-10T18:48:08.183845] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-10T18:48:08.183960] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-10T18:48:08.185283] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-10T18:48:08.185363] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-10T18:48:08.187362] [DEBUG] [LOCAL ] ESTC: Trimmed 72133 records to 50869 (keeping 200 days of data) [2025-10-10T18:48:08.289451] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-10T18:48:08.505565] [DEBUG] [LOCAL ] ESTC: Primary data saved (50869 records). [2025-10-10T18:48:08.505828] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-10T18:48:08.506189] [INFO ] [MAIN ] Update Progress: 775/2373 symbols completed. ESTC took 41.0s. Estimated remaining: 3h 42m 51s. Rate: 7.2 symbols/min [2025-10-10T18:48:08.715356] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:48:08.737199] [DEBUG] [LOCAL ] ETJ: Loaded 17098 existing records from primary storage. [2025-10-10T18:48:08.737628] [INFO ] [MAIN ] ETJ: Loaded 17098 existing records. [2025-10-10T18:48:08.934517] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:48:08.935081] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-10T18:48:08.935163] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-10T18:48:08.953186] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T18:48:08.952381] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-10T18:48:08.959184] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-10T18:48:09.094614] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-10T18:48:09.336771] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:48:09.889478] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-10T18:48:10.443879] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-10T18:48:10.648517] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-10T18:48:10.689372] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-10T18:48:10.708696] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-10T18:48:11.489391] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-10T18:48:11.892387] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-10T18:48:12.289399] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-10T18:48:12.668809] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-10T18:48:13.089428] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-10T18:48:13.597239] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-10T18:48:13.600156] [INFO ] [REMOTE ] ETD: Full fetch complete (38451 records). [2025-10-10T18:48:13.600250] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-10T18:48:13.894472] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-10T18:48:13.985744] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-10T18:48:13.985842] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-10T18:48:13.986682] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-10T18:48:13.986746] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-10T18:48:13.987785] [DEBUG] [LOCAL ] ETD: Trimmed 38451 records to 27732 (keeping 200 days of data) [2025-10-10T18:48:14.175535] [DEBUG] [LOCAL ] ETD: Primary data saved (27732 records). [2025-10-10T18:48:14.175726] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-10T18:48:14.175824] [INFO ] [MAIN ] Update Progress: 776/2373 symbols completed. ETD took 35.1s. Estimated remaining: 3h 42m 37s. Rate: 7.2 symbols/min [2025-10-10T18:48:14.384981] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:48:14.391831] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T18:48:14.448087] [DEBUG] [LOCAL ] ETN: Loaded 53075 existing records from primary storage. [2025-10-10T18:48:14.448516] [INFO ] [MAIN ] ETN: Loaded 53075 existing records. [2025-10-10T18:48:14.661397] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:48:14.661866] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-10T18:48:14.661946] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-10T18:48:14.667506] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-10T18:48:14.672352] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-10T18:48:14.678547] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-10T18:48:14.696009] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-10T18:48:15.034094] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:48:15.489407] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-10T18:48:16.289460] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-10T18:48:16.768633] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-10T18:48:17.020388] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-10T18:48:17.089430] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-10T18:48:17.120922] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-10T18:48:17.128234] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-10-10T18:48:17.128498] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-10T18:48:17.584958] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-10T18:48:17.585097] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-10T18:48:17.586595] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-10T18:48:17.586692] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-10T18:48:17.588997] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 54569 (keeping 200 days of data) [2025-10-10T18:48:17.902700] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-10T18:48:17.963336] [DEBUG] [LOCAL ] ET: Primary data saved (54569 records). [2025-10-10T18:48:17.963536] [INFO ] [MAIN ] ET: Full history saved. [2025-10-10T18:48:17.963674] [INFO ] [MAIN ] Update Progress: 777/2373 symbols completed. ET took 44.4s. Estimated remaining: 3h 42m 19s. Rate: 7.2 symbols/min [2025-10-10T18:48:18.159634] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:48:18.170464] [DEBUG] [LOCAL ] ETO: Loaded 6884 existing records from primary storage. [2025-10-10T18:48:18.170830] [INFO ] [MAIN ] ETO: Loaded 6884 existing records. [2025-10-10T18:48:18.365928] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:48:18.377094] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-10T18:48:18.376848] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T18:48:18.377214] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-10T18:48:18.383021] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-10T18:48:18.383109] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-10T18:48:18.694560] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-10T18:48:18.767716] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:48:19.489427] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-10T18:48:19.808031] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-10T18:48:19.836617] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-10T18:48:20.289378] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-10T18:48:20.748340] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T18:48:21.089433] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-10T18:48:21.889412] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-10T18:48:22.007841] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-10T18:48:22.505616] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-10T18:48:22.689365] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-10T18:48:23.092804] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-10T18:48:23.489420] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-10T18:48:24.289404] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-10T18:48:24.338329] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-10T18:48:24.830828] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-10T18:48:24.882965] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-10T18:48:25.089428] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-10T18:48:25.889384] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-10T18:48:26.127858] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-10T18:48:26.620700] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-10T18:48:26.689406] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-10T18:48:27.489428] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-10T18:48:27.764918] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-10T18:48:28.289394] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-10T18:48:28.441250] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T18:48:28.443185] [INFO ] [REMOTE ] ETG: Full fetch complete (24711 records). [2025-10-10T18:48:28.443257] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-10T18:48:28.795824] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-10T18:48:28.795911] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-10T18:48:28.796412] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-10T18:48:28.796509] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-10T18:48:28.797189] [DEBUG] [LOCAL ] ETG: Trimmed 24711 records to 16762 (keeping 200 days of data) [2025-10-10T18:48:28.902395] [DEBUG] [LOCAL ] ETG: Primary data saved (16762 records). [2025-10-10T18:48:28.902545] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-10T18:48:28.902631] [INFO ] [MAIN ] Update Progress: 778/2373 symbols completed. ETG took 25.3s. Estimated remaining: 3h 42m 16s. Rate: 7.2 symbols/min [2025-10-10T18:48:29.082083] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-10T18:48:29.084289] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:48:29.089360] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-10T18:48:29.140120] [DEBUG] [LOCAL ] ETR: Loaded 53610 existing records from primary storage. [2025-10-10T18:48:29.140516] [INFO ] [MAIN ] ETR: Loaded 53610 existing records. [2025-10-10T18:48:29.328932] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:48:29.329202] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-10T18:48:29.329248] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-10T18:48:29.329704] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-10T18:48:29.329762] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-10T18:48:29.689086] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:48:29.886374] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-10T18:48:29.889344] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-10T18:48:30.689375] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-10T18:48:31.489375] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-10T18:48:31.559514] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T18:48:31.939978] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T18:48:32.151532] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-10T18:48:32.289374] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-10T18:48:33.089362] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-10T18:48:33.423332] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-10T18:48:33.889383] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-10T18:48:34.689389] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-10T18:48:35.060009] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-10T18:48:35.106899] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T18:48:35.489355] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-10T18:48:35.563761] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-10T18:48:36.289350] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-10T18:48:36.653972] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-10T18:48:36.656411] [INFO ] [REMOTE ] ETJ: Full fetch complete (25559 records). [2025-10-10T18:48:36.656498] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-10T18:48:37.027949] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-10T18:48:37.028044] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-10T18:48:37.028554] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-10T18:48:37.028594] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-10T18:48:37.029278] [DEBUG] [LOCAL ] ETJ: Trimmed 25559 records to 17190 (keeping 200 days of data) [2025-10-10T18:48:37.101610] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-10T18:48:37.132333] [DEBUG] [LOCAL ] ETJ: Primary data saved (17190 records). [2025-10-10T18:48:37.132451] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-10T18:48:37.132530] [INFO ] [MAIN ] Update Progress: 779/2373 symbols completed. ETJ took 28.6s. Estimated remaining: 3h 42m 7s. Rate: 7.2 symbols/min [2025-10-10T18:48:37.239584] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-10T18:48:37.313389] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:48:37.313615] [DEBUG] [LOCAL ] ETV: No existing data file found in primary storage. [2025-10-10T18:48:37.313688] [WARN ] [MAIN ] ETV: No existing data found, performing full refresh instead. [2025-10-10T18:48:37.313819] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-10T18:48:37.313863] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-10T18:48:37.313907] [DEBUG] [LOCAL ] ETV: No primary data file found to delete. [2025-10-10T18:48:37.313943] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-10T18:48:37.680235] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:48:37.889475] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-10T18:48:38.689422] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-10T18:48:39.153431] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T18:48:39.428772] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-10T18:48:39.489352] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-10T18:48:40.289370] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-10T18:48:40.612951] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T18:48:41.089371] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-10T18:48:41.179233] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-10T18:48:41.767051] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-10T18:48:41.889391] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-10T18:48:42.657884] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-10T18:48:42.696082] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-10T18:48:42.717798] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T18:48:43.489416] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-10T18:48:43.496041] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-10T18:48:44.289354] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-10T18:48:45.089399] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-10T18:48:45.563774] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-10T18:48:45.677213] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-10T18:48:45.889390] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-10T18:48:46.689439] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-10T18:48:47.191602] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T18:48:47.256795] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T18:48:47.489368] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-10T18:48:48.289353] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-10T18:48:48.675334] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T18:48:48.810863] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T18:48:48.985750] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-10T18:48:48.987549] [INFO ] [REMOTE ] ETO: Full fetch complete (9693 records). [2025-10-10T18:48:48.987626] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-10T18:48:49.094606] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-10T18:48:49.361719] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-10T18:48:49.361813] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-10T18:48:49.362013] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-10T18:48:49.362052] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-10T18:48:49.362478] [DEBUG] [LOCAL ] ETO: Trimmed 9693 records to 6988 (keeping 200 days of data) [2025-10-10T18:48:49.404176] [DEBUG] [LOCAL ] ETO: Primary data saved (6988 records). [2025-10-10T18:48:49.404291] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-10T18:48:49.404376] [INFO ] [MAIN ] Update Progress: 780/2373 symbols completed. ETO took 31.4s. Estimated remaining: 3h 42m 7s. Rate: 7.2 symbols/min [2025-10-10T18:48:49.567771] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:48:49.597083] [DEBUG] [LOCAL ] ETW: Loaded 25618 existing records from primary storage. [2025-10-10T18:48:49.597426] [INFO ] [MAIN ] ETW: Loaded 25618 existing records. [2025-10-10T18:48:49.767832] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:48:49.768085] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-10T18:48:49.768131] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-10T18:48:49.768345] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-10T18:48:49.768401] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-10T18:48:49.894595] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-10T18:48:50.119404] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:48:50.479151] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-10T18:48:50.689351] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-10T18:48:51.489450] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-10T18:48:52.289424] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-10T18:48:52.403583] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-10T18:48:52.507303] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T18:48:52.534701] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-10T18:48:53.089370] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-10T18:48:53.398283] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-10T18:48:53.889379] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-10T18:48:54.689430] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-10T18:48:55.050712] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-10T18:48:55.152082] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-10T18:48:55.489374] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-10T18:48:56.289389] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-10T18:48:57.089389] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-10T18:48:57.286782] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-10T18:48:57.618425] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-10T18:48:57.646543] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-10T18:48:57.889391] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-10T18:48:58.039878] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-10T18:48:58.689422] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-10T18:48:59.166104] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T18:48:59.489395] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-10T18:49:00.289414] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-10T18:49:00.969244] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T18:49:01.089364] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-10T18:49:01.310971] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-10T18:49:01.889763] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-10T18:49:02.329581] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-10T18:49:02.351693] [INFO ] [REMOTE ] ETV: Full fetch complete (32399 records). [2025-10-10T18:49:02.365535] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-10T18:49:02.367452] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T18:49:02.699000] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-10T18:49:02.792251] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-10T18:49:02.792349] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-10T18:49:02.793215] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-10T18:49:02.793287] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-10T18:49:02.794360] [DEBUG] [LOCAL ] ETV: Trimmed 32399 records to 22566 (keeping 200 days of data) [2025-10-10T18:49:02.938846] [DEBUG] [LOCAL ] ETV: Primary data saved (22566 records). [2025-10-10T18:49:02.939014] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-10T18:49:02.939101] [INFO ] [MAIN ] Update Progress: 781/2373 symbols completed. ETV took 25.8s. Estimated remaining: 3h 42m 9s. Rate: 7.2 symbols/min [2025-10-10T18:49:03.120132] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:49:03.129291] [DEBUG] [LOCAL ] ETX: Loaded 5243 existing records from primary storage. [2025-10-10T18:49:03.129530] [INFO ] [MAIN ] ETX: Loaded 5243 existing records. [2025-10-10T18:49:03.323876] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:49:03.324448] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-10T18:49:03.324602] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-10T18:49:03.330413] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-10T18:49:03.338866] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-10T18:49:03.368603] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-10T18:49:03.495277] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-10T18:49:03.742960] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:49:04.289440] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-10T18:49:04.781223] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T18:49:04.851916] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-10T18:49:05.002167] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-10T18:49:05.089383] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-10T18:49:05.889399] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-10T18:49:06.689408] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-10T18:49:07.241391] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-10T18:49:07.246983] [INFO ] [REMOTE ] ETN: Full fetch complete (76519 records). [2025-10-10T18:49:07.247175] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-10T18:49:07.491800] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-10T18:49:07.639917] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T18:49:07.717394] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-10T18:49:07.717495] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-10T18:49:07.718953] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-10T18:49:07.719032] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-10T18:49:07.721005] [DEBUG] [LOCAL ] ETN: Trimmed 76519 records to 53462 (keeping 200 days of data) [2025-10-10T18:49:08.087806] [DEBUG] [LOCAL ] ETN: Primary data saved (53462 records). [2025-10-10T18:49:08.088033] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-10T18:49:08.088179] [INFO ] [MAIN ] Update Progress: 782/2373 symbols completed. ETN took 53.9s. Estimated remaining: 3h 41m 54s. Rate: 7.2 symbols/min [2025-10-10T18:49:08.299146] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-10T18:49:08.306982] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:49:08.331962] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-10T18:49:08.348148] [DEBUG] [LOCAL ] ETY: Loaded 23191 existing records from primary storage. [2025-10-10T18:49:08.348580] [INFO ] [MAIN ] ETY: Loaded 23191 existing records. [2025-10-10T18:49:08.593636] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:49:08.593967] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-10T18:49:08.594284] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-10T18:49:08.594723] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-10T18:49:08.594862] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-10T18:49:08.811185] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-10T18:49:08.842365] [INFO ] [REMOTE ] ETR: Full fetch complete (77086 records). [2025-10-10T18:49:08.864021] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-10T18:49:09.094508] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-10T18:49:09.546127] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:49:09.735553] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-10T18:49:09.737405] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-10T18:49:09.737742] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-10T18:49:09.744958] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-10T18:49:09.745217] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-10T18:49:09.747161] [DEBUG] [LOCAL ] ETR: Trimmed 77086 records to 53997 (keeping 200 days of data) [2025-10-10T18:49:09.933954] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-10T18:49:09.978790] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-10T18:49:10.105786] [DEBUG] [LOCAL ] ETR: Primary data saved (53997 records). [2025-10-10T18:49:10.106010] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-10T18:49:10.106169] [INFO ] [MAIN ] Update Progress: 783/2373 symbols completed. ETR took 41.2s. Estimated remaining: 3h 41m 33s. Rate: 7.2 symbols/min [2025-10-10T18:49:10.282123] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:49:10.303951] [DEBUG] [LOCAL ] EVC: Loaded 18310 existing records from primary storage. [2025-10-10T18:49:10.304276] [INFO ] [MAIN ] EVC: Loaded 18310 existing records. [2025-10-10T18:49:10.484158] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:49:10.484416] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-10T18:49:10.484470] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-10T18:49:10.484712] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-10T18:49:10.484771] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-10T18:49:10.694524] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-10T18:49:10.864381] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:49:11.286804] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T18:49:11.475947] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-10T18:49:11.489332] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-10T18:49:12.289415] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-10T18:49:12.968841] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-10T18:49:13.089410] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-10T18:49:13.848861] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-10T18:49:13.889374] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-10T18:49:14.390824] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T18:49:14.689415] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-10T18:49:15.231945] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T18:49:15.489381] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-10T18:49:16.007190] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T18:49:16.280747] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-10T18:49:16.289330] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-10T18:49:17.089406] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-10T18:49:17.757624] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-10T18:49:17.889367] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-10T18:49:18.302904] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T18:49:18.604897] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-10T18:49:18.689386] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-10T18:49:19.489416] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-10T18:49:19.920452] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-10T18:49:19.924024] [INFO ] [REMOTE ] ETW: Full fetch complete (36752 records). [2025-10-10T18:49:19.924110] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-10T18:49:20.296480] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-10T18:49:20.312738] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-10T18:49:20.312819] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-10T18:49:20.313566] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-10T18:49:20.313610] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-10T18:49:20.314946] [DEBUG] [LOCAL ] ETW: Trimmed 36752 records to 25898 (keeping 200 days of data) [2025-10-10T18:49:20.424009] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T18:49:20.493758] [DEBUG] [LOCAL ] ETW: Primary data saved (25898 records). [2025-10-10T18:49:20.493903] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-10T18:49:20.494006] [INFO ] [MAIN ] Update Progress: 784/2373 symbols completed. ETW took 31.1s. Estimated remaining: 3h 41m 29s. Rate: 7.2 symbols/min [2025-10-10T18:49:20.675466] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:49:20.710302] [DEBUG] [LOCAL ] EVEX: Loaded 31707 existing records from primary storage. [2025-10-10T18:49:20.710705] [INFO ] [MAIN ] EVEX: Loaded 31707 existing records. [2025-10-10T18:49:20.899470] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:49:20.899796] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-10T18:49:20.899853] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-10T18:49:20.900086] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-10T18:49:20.900143] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-10T18:49:21.097725] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-10T18:49:21.279891] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:49:21.730661] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-10T18:49:21.808323] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-10T18:49:21.889448] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-10T18:49:22.689439] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-10T18:49:23.489417] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-10T18:49:23.546976] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-10T18:49:24.010835] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T18:49:24.289401] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-10T18:49:24.811807] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T18:49:25.089397] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-10T18:49:25.271286] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-10T18:49:25.889402] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-10T18:49:26.423339] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-10T18:49:26.655007] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-10T18:49:26.689373] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-10T18:49:27.489404] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-10T18:49:27.860510] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-10T18:49:28.289417] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-10T18:49:28.690224] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-10T18:49:29.089415] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-10T18:49:29.501523] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T18:49:29.889400] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-10T18:49:30.281702] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T18:49:30.568690] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-10T18:49:30.689388] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-10T18:49:31.345923] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-10T18:49:31.489398] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-10T18:49:32.289400] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-10T18:49:32.813937] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T18:49:33.089428] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-10T18:49:33.473786] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T18:49:33.889391] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-10T18:49:33.950462] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-10T18:49:34.689376] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-10T18:49:34.877181] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T18:49:34.879065] [INFO ] [REMOTE ] EVC: Full fetch complete (29192 records). [2025-10-10T18:49:34.879152] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-10T18:49:35.269037] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-10T18:49:35.269296] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-10T18:49:35.270227] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-10T18:49:35.270317] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-10T18:49:35.271224] [DEBUG] [LOCAL ] EVC: Trimmed 29192 records to 18400 (keeping 200 days of data) [2025-10-10T18:49:35.382128] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-10T18:49:35.398903] [DEBUG] [LOCAL ] EVC: Primary data saved (18400 records). [2025-10-10T18:49:35.399143] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-10T18:49:35.399300] [INFO ] [MAIN ] Update Progress: 785/2373 symbols completed. EVC took 25.3s. Estimated remaining: 3h 41m 33s. Rate: 7.2 symbols/min [2025-10-10T18:49:35.494540] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-10T18:49:35.607506] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:49:35.620691] [DEBUG] [LOCAL ] EVF: Loaded 9843 existing records from primary storage. [2025-10-10T18:49:35.621080] [INFO ] [MAIN ] EVF: Loaded 9843 existing records. [2025-10-10T18:49:35.800436] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:49:35.800713] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-10T18:49:35.800802] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-10T18:49:35.800964] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-10T18:49:35.801002] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-10T18:49:36.163613] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:49:36.289393] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-10T18:49:36.783783] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-10T18:49:37.008415] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-10T18:49:37.089388] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-10T18:49:37.889383] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-10T18:49:38.369201] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-10T18:49:38.689356] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-10T18:49:39.192986] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T18:49:39.286634] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-10T18:49:39.489394] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-10T18:49:40.289392] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-10T18:49:40.525420] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-10T18:49:41.089394] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-10T18:49:41.496377] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T18:49:41.889522] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-10T18:49:42.689365] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-10T18:49:42.854870] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T18:49:42.851981] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-10T18:49:43.489392] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-10T18:49:43.876860] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-10T18:49:44.010901] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-10T18:49:44.289401] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-10T18:49:45.089363] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-10T18:49:45.408996] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-10T18:49:45.412204] [INFO ] [REMOTE ] ETY: Full fetch complete (34322 records). [2025-10-10T18:49:45.412286] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-10T18:49:45.808085] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-10T18:49:45.808178] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-10T18:49:45.808890] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-10T18:49:45.808954] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-10T18:49:45.809869] [DEBUG] [LOCAL ] ETY: Trimmed 34322 records to 23411 (keeping 200 days of data) [2025-10-10T18:49:45.897687] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-10T18:49:45.956383] [DEBUG] [LOCAL ] ETY: Primary data saved (23411 records). [2025-10-10T18:49:45.956542] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-10T18:49:45.956664] [INFO ] [MAIN ] Update Progress: 786/2373 symbols completed. ETY took 37.9s. Estimated remaining: 3h 41m 29s. Rate: 7.2 symbols/min [2025-10-10T18:49:46.074373] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-10T18:49:46.149018] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:49:46.158471] [DEBUG] [LOCAL ] EVG: Loaded 6026 existing records from primary storage. [2025-10-10T18:49:46.158715] [INFO ] [MAIN ] EVG: Loaded 6026 existing records. [2025-10-10T18:49:46.340621] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:49:46.340939] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-10T18:49:46.340987] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-10T18:49:46.341225] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-10T18:49:46.341283] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-10T18:49:46.689424] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-10T18:49:46.710829] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:49:47.324221] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-10T18:49:47.496713] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-10T18:49:47.513217] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-10T18:49:48.289376] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-10T18:49:48.513318] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-10T18:49:49.089397] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-10T18:49:49.851348] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-10T18:49:49.889414] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-10T18:49:50.089039] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T18:49:50.610380] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-10T18:49:50.689425] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-10T18:49:51.465170] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T18:49:51.466436] [INFO ] [REMOTE ] ETX: Full fetch complete (6989 records). [2025-10-10T18:49:51.466508] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-10T18:49:51.496732] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-10T18:49:51.841490] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-10T18:49:51.841849] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-10T18:49:51.842185] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-10T18:49:51.842231] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-10T18:49:51.842755] [DEBUG] [LOCAL ] ETX: Trimmed 6989 records to 5251 (keeping 200 days of data) [2025-10-10T18:49:51.876802] [DEBUG] [LOCAL ] ETX: Primary data saved (5251 records). [2025-10-10T18:49:51.876962] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-10T18:49:51.877066] [INFO ] [MAIN ] Update Progress: 787/2373 symbols completed. ETX took 48.9s. Estimated remaining: 3h 41m 16s. Rate: 7.2 symbols/min [2025-10-10T18:49:52.049378] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:49:52.104092] [DEBUG] [LOCAL ] EVH: Loaded 49927 existing records from primary storage. [2025-10-10T18:49:52.104520] [INFO ] [MAIN ] EVH: Loaded 49927 existing records. [2025-10-10T18:49:52.294979] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-10T18:49:52.300574] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:49:52.301277] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-10T18:49:52.302245] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-10T18:49:52.302867] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-10T18:49:52.302932] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-10T18:49:52.664879] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:49:53.089408] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-10T18:49:53.118287] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-10T18:49:53.361744] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T18:49:53.366717] [INFO ] [REMOTE ] EVEX: Full fetch complete (42910 records). [2025-10-10T18:49:53.366821] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-10T18:49:53.751708] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-10T18:49:53.751808] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-10T18:49:53.752617] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-10T18:49:53.752693] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-10T18:49:53.753845] [DEBUG] [LOCAL ] EVEX: Trimmed 42910 records to 32070 (keeping 200 days of data) [2025-10-10T18:49:53.899951] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-10T18:49:53.952060] [DEBUG] [LOCAL ] EVEX: Primary data saved (32070 records). [2025-10-10T18:49:53.952257] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-10T18:49:53.952365] [INFO ] [MAIN ] Update Progress: 788/2373 symbols completed. EVEX took 33.5s. Estimated remaining: 3h 40m 55s. Rate: 7.2 symbols/min [2025-10-10T18:49:54.126353] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:49:54.142525] [DEBUG] [LOCAL ] EVN: Loaded 11172 existing records from primary storage. [2025-10-10T18:49:54.142822] [INFO ] [MAIN ] EVN: Loaded 11172 existing records. [2025-10-10T18:49:54.330460] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:49:54.330777] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-10T18:49:54.330836] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-10T18:49:54.331051] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-10T18:49:54.331111] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-10T18:49:54.689484] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-10T18:49:54.714778] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:49:54.831333] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-10T18:49:55.060856] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T18:49:55.099804] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-10T18:49:55.489415] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-10T18:49:56.224053] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-10T18:49:56.289397] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-10T18:49:57.089412] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-10T18:49:57.889399] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-10T18:49:58.088404] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T18:49:58.220235] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T18:49:58.689406] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-10T18:49:58.920376] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-10T18:49:59.118496] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-10T18:49:59.489378] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-10T18:50:00.226139] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-10T18:50:00.289435] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-10T18:50:01.079840] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-10T18:50:01.089323] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-10T18:50:01.889435] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-10T18:50:02.093239] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-10T18:50:02.689397] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-10T18:50:03.141549] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T18:50:03.489407] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-10T18:50:03.682850] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-10T18:50:04.031311] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-10T18:50:04.289399] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-10T18:50:05.089418] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-10T18:50:05.232489] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-10T18:50:05.889374] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-10T18:50:06.651926] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-10T18:50:06.689368] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-10T18:50:06.887005] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T18:50:07.489376] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-10T18:50:07.744760] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-10T18:50:08.289481] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-10T18:50:08.524266] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-10T18:50:08.526430] [INFO ] [REMOTE ] EVF: Full fetch complete (12846 records). [2025-10-10T18:50:08.526514] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-10T18:50:08.902764] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-10T18:50:08.902859] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-10T18:50:08.903279] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-10T18:50:08.903320] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-10T18:50:08.903824] [DEBUG] [LOCAL ] EVF: Trimmed 12846 records to 10057 (keeping 200 days of data) [2025-10-10T18:50:08.963622] [DEBUG] [LOCAL ] EVF: Primary data saved (10057 records). [2025-10-10T18:50:08.963798] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-10T18:50:08.963885] [INFO ] [MAIN ] Update Progress: 789/2373 symbols completed. EVF took 33.6s. Estimated remaining: 3h 41m 0s. Rate: 7.2 symbols/min [2025-10-10T18:50:09.101280] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-10T18:50:09.134359] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:50:09.172884] [DEBUG] [LOCAL ] EVR: Loaded 34827 existing records from primary storage. [2025-10-10T18:50:09.173277] [INFO ] [MAIN ] EVR: Loaded 34827 existing records. [2025-10-10T18:50:09.361605] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:50:09.364410] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-10T18:50:09.364238] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-10T18:50:09.364589] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-10T18:50:09.368064] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-10T18:50:09.368409] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-10T18:50:09.723046] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:50:09.889379] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-10T18:50:10.689362] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-10T18:50:11.244151] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T18:50:11.461057] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-10T18:50:11.489337] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-10T18:50:11.782931] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-10T18:50:12.289364] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-10T18:50:13.017115] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T18:50:13.018335] [INFO ] [REMOTE ] EVG: Full fetch complete (8150 records). [2025-10-10T18:50:13.018404] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-10T18:50:13.091554] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-10T18:50:13.400805] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T18:50:13.399852] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-10T18:50:13.403176] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-10T18:50:13.407863] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-10T18:50:13.408182] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-10T18:50:13.408601] [DEBUG] [LOCAL ] EVG: Trimmed 8150 records to 6047 (keeping 200 days of data) [2025-10-10T18:50:13.444379] [DEBUG] [LOCAL ] EVG: Primary data saved (6047 records). [2025-10-10T18:50:13.444473] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-10T18:50:13.444546] [INFO ] [MAIN ] Update Progress: 790/2373 symbols completed. EVG took 27.5s. Estimated remaining: 3h 40m 44s. Rate: 7.2 symbols/min [2025-10-10T18:50:13.608447] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:50:13.626421] [DEBUG] [LOCAL ] EVT: Loaded 16976 existing records from primary storage. [2025-10-10T18:50:13.626732] [INFO ] [MAIN ] EVT: Loaded 16976 existing records. [2025-10-10T18:50:13.803020] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:50:13.803264] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-10T18:50:13.803310] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-10T18:50:13.803497] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-10T18:50:13.803535] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-10T18:50:13.889496] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-10T18:50:14.105971] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-10T18:50:14.174522] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:50:14.689406] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-10T18:50:15.450230] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-10T18:50:15.489331] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-10T18:50:15.836714] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T18:50:16.289348] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-10T18:50:16.512201] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-10T18:50:17.089491] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-10T18:50:17.581753] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T18:50:17.889382] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-10T18:50:18.689357] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-10T18:50:18.848722] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T18:50:19.084700] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-10T18:50:19.489377] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-10T18:50:20.289411] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-10T18:50:20.510707] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T18:50:21.089411] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-10T18:50:21.315810] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T18:50:21.392620] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-10T18:50:21.844558] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-10T18:50:21.889394] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-10T18:50:22.689406] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-10T18:50:22.876781] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-10T18:50:23.489359] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-10T18:50:23.808267] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-10T18:50:24.289375] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-10T18:50:24.443755] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T18:50:24.445452] [INFO ] [REMOTE ] EVN: Full fetch complete (17582 records). [2025-10-10T18:50:24.445521] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-10T18:50:24.800256] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-10T18:50:24.800348] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-10T18:50:24.800828] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-10T18:50:24.800893] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-10T18:50:24.801457] [DEBUG] [LOCAL ] EVN: Trimmed 17582 records to 11233 (keeping 200 days of data) [2025-10-10T18:50:24.869132] [DEBUG] [LOCAL ] EVN: Primary data saved (11233 records). [2025-10-10T18:50:24.869274] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-10T18:50:24.869355] [INFO ] [MAIN ] Update Progress: 791/2373 symbols completed. EVN took 30.9s. Estimated remaining: 3h 40m 42s. Rate: 7.2 symbols/min [2025-10-10T18:50:25.034693] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:50:25.061623] [DEBUG] [LOCAL ] EVTC: Loaded 26578 existing records from primary storage. [2025-10-10T18:50:25.061932] [INFO ] [MAIN ] EVTC: Loaded 26578 existing records. [2025-10-10T18:50:25.094704] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-10T18:50:25.253589] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:50:25.253939] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-10T18:50:25.253996] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-10T18:50:25.254303] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-10T18:50:25.254361] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-10T18:50:25.576782] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T18:50:25.665972] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:50:25.889397] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-10T18:50:26.689392] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-10T18:50:27.047181] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T18:50:27.114816] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T18:50:27.489415] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-10T18:50:28.289344] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-10T18:50:28.533268] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-10T18:50:28.634793] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-10T18:50:29.089380] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-10T18:50:29.889388] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-10T18:50:30.007981] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T18:50:30.259200] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-10T18:50:30.689364] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-10T18:50:31.228338] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T18:50:31.489397] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-10T18:50:32.289403] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-10T18:50:32.332803] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-10T18:50:33.089401] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-10T18:50:33.327297] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T18:50:33.463856] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-10T18:50:33.889341] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-10T18:50:34.637192] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-10T18:50:34.689368] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-10T18:50:34.847410] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-10T18:50:35.489383] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-10T18:50:35.819481] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T18:50:36.289348] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-10T18:50:37.013810] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T18:50:37.089337] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-10T18:50:37.253204] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T18:50:37.255037] [INFO ] [REMOTE ] EVT: Full fetch complete (25182 records). [2025-10-10T18:50:37.255108] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-10T18:50:37.611304] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-10T18:50:37.611399] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-10T18:50:37.611930] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-10T18:50:37.612019] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-10T18:50:37.612663] [DEBUG] [LOCAL ] EVT: Trimmed 25182 records to 17083 (keeping 200 days of data) [2025-10-10T18:50:37.718292] [DEBUG] [LOCAL ] EVT: Primary data saved (17083 records). [2025-10-10T18:50:37.718444] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-10T18:50:37.718527] [INFO ] [MAIN ] Update Progress: 792/2373 symbols completed. EVT took 24.3s. Estimated remaining: 3h 40m 42s. Rate: 7.2 symbols/min [2025-10-10T18:50:37.882162] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:50:37.889387] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-10T18:50:37.920199] [DEBUG] [LOCAL ] EVTL: Loaded 39616 existing records from primary storage. [2025-10-10T18:50:37.920523] [INFO ] [MAIN ] EVTL: Loaded 39616 existing records. [2025-10-10T18:50:38.097112] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:50:38.097365] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-10T18:50:38.097412] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-10T18:50:38.097628] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-10T18:50:38.097713] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-10T18:50:38.454876] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:50:38.473397] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T18:50:38.689370] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-10T18:50:39.397052] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-10T18:50:39.489370] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-10T18:50:40.020356] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T18:50:40.023518] [INFO ] [REMOTE ] EVR: Full fetch complete (50635 records). [2025-10-10T18:50:40.023613] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-10T18:50:40.294696] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-10T18:50:40.421909] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-10T18:50:40.421997] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-10T18:50:40.422727] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-10T18:50:40.422789] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-10T18:50:40.423954] [DEBUG] [LOCAL ] EVR: Trimmed 50635 records to 35113 (keeping 200 days of data) [2025-10-10T18:50:40.648846] [DEBUG] [LOCAL ] EVR: Primary data saved (35113 records). [2025-10-10T18:50:40.649056] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-10T18:50:40.649218] [INFO ] [MAIN ] Update Progress: 793/2373 symbols completed. EVR took 31.7s. Estimated remaining: 3h 40m 23s. Rate: 7.2 symbols/min [2025-10-10T18:50:40.821307] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:50:40.845487] [DEBUG] [LOCAL ] EVTR: Loaded 24504 existing records from primary storage. [2025-10-10T18:50:40.845856] [INFO ] [MAIN ] EVTR: Loaded 24504 existing records. [2025-10-10T18:50:40.998698] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-10T18:50:41.070052] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:50:41.070320] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-10T18:50:41.070370] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-10T18:50:41.070578] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-10T18:50:41.070636] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-10T18:50:41.100961] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-10T18:50:41.419953] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:50:41.889407] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-10T18:50:42.178361] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-10T18:50:42.183159] [INFO ] [REMOTE ] EVH: Full fetch complete (71739 records). [2025-10-10T18:50:42.183282] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-10T18:50:42.572169] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-10T18:50:42.572253] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-10T18:50:42.573162] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-10T18:50:42.573224] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-10T18:50:42.574548] [DEBUG] [LOCAL ] EVH: Trimmed 71739 records to 50292 (keeping 200 days of data) [2025-10-10T18:50:42.695962] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-10T18:50:42.888735] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T18:50:42.916350] [DEBUG] [LOCAL ] EVH: Primary data saved (50292 records). [2025-10-10T18:50:42.916569] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-10T18:50:42.916957] [INFO ] [MAIN ] Update Progress: 794/2373 symbols completed. EVH took 51.0s. Estimated remaining: 3h 40m 3s. Rate: 7.2 symbols/min [2025-10-10T18:50:43.103472] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:50:43.165978] [DEBUG] [LOCAL ] EW: Loaded 53791 existing records from primary storage. [2025-10-10T18:50:43.166497] [INFO ] [MAIN ] EW: Loaded 53791 existing records. [2025-10-10T18:50:43.345607] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-10T18:50:43.381855] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:50:43.382232] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-10T18:50:43.382298] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-10T18:50:43.382552] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-10T18:50:43.382611] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-10T18:50:43.490688] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-10T18:50:43.718795] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-10T18:50:43.779627] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:50:44.289401] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-10T18:50:44.823909] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T18:50:45.089381] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-10T18:50:45.889481] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-10T18:50:46.188881] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T18:50:46.277796] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-10T18:50:46.689419] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-10T18:50:47.179539] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T18:50:47.489387] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-10T18:50:48.192617] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-10T18:50:48.289394] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-10T18:50:48.377463] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T18:50:49.089374] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-10T18:50:49.438089] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-10T18:50:49.889435] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-10T18:50:50.539690] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-10T18:50:50.562325] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-10T18:50:50.689433] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-10T18:50:51.489382] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-10T18:50:52.045737] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T18:50:52.289395] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-10T18:50:52.667173] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-10T18:50:53.089480] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-10T18:50:53.889397] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-10T18:50:54.264895] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T18:50:54.592684] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-10T18:50:54.689351] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-10T18:50:54.757829] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-10T18:50:55.489369] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-10T18:50:56.289406] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-10T18:50:56.672129] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-10T18:50:56.698986] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-10T18:50:57.089429] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-10T18:50:57.889387] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-10T18:50:57.955011] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T18:50:58.689354] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-10T18:50:59.370086] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-10T18:50:59.469371] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-10T18:50:59.489332] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-10T18:50:59.962037] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T18:51:00.244744] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-10T18:51:00.289356] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-10T18:51:01.089379] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-10T18:51:01.659731] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T18:51:01.889371] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-10T18:51:02.689410] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-10T18:51:03.140307] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-10T18:51:03.239796] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T18:51:03.489353] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-10T18:51:04.289360] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-10T18:51:04.699389] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T18:51:05.089380] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-10T18:51:05.572627] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T18:51:05.659510] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T18:51:05.889387] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-10T18:51:06.568203] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-10T18:51:06.689361] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-10T18:51:07.279607] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-10T18:51:07.282939] [INFO ] [REMOTE ] EVTR: Full fetch complete (32949 records). [2025-10-10T18:51:07.283029] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-10T18:51:07.498216] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-10T18:51:07.655279] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-10T18:51:07.655391] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-10T18:51:07.656073] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-10T18:51:07.656185] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-10T18:51:07.657104] [DEBUG] [LOCAL ] EVTR: Trimmed 32949 records to 24696 (keeping 200 days of data) [2025-10-10T18:51:07.809338] [DEBUG] [LOCAL ] EVTR: Primary data saved (24696 records). [2025-10-10T18:51:07.809487] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-10T18:51:07.809572] [INFO ] [MAIN ] Update Progress: 795/2373 symbols completed. EVTR took 27.2s. Estimated remaining: 3h 40m 27s. Rate: 7.2 symbols/min [2025-10-10T18:51:07.984041] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:51:07.999728] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T18:51:08.036096] [DEBUG] [LOCAL ] EXG: Loaded 34445 existing records from primary storage. [2025-10-10T18:51:08.036470] [INFO ] [MAIN ] EXG: Loaded 34445 existing records. [2025-10-10T18:51:08.207978] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:51:08.208217] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-10T18:51:08.208265] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-10T18:51:08.208595] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-10T18:51:08.208634] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-10T18:51:08.298151] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-10T18:51:08.617477] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:51:09.089492] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-10T18:51:09.511809] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-10T18:51:09.516936] [INFO ] [REMOTE ] EVTL: Full fetch complete (53838 records). [2025-10-10T18:51:09.517049] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-10T18:51:09.896970] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-10T18:51:09.897700] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-10T18:51:09.897777] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-10T18:51:09.899328] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-10T18:51:09.899481] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-10T18:51:09.900664] [DEBUG] [LOCAL ] EVTL: Trimmed 53838 records to 40001 (keeping 200 days of data) [2025-10-10T18:51:10.120461] [DEBUG] [LOCAL ] EVTL: Primary data saved (40001 records). [2025-10-10T18:51:10.120599] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-10T18:51:10.120706] [INFO ] [MAIN ] Update Progress: 796/2373 symbols completed. EVTL took 32.4s. Estimated remaining: 3h 40m 7s. Rate: 7.2 symbols/min [2025-10-10T18:51:10.289842] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:51:10.339251] [DEBUG] [LOCAL ] EXK: Loaded 53532 existing records from primary storage. [2025-10-10T18:51:10.339680] [INFO ] [MAIN ] EXK: Loaded 53532 existing records. [2025-10-10T18:51:10.518522] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:51:10.519134] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-10T18:51:10.519346] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-10T18:51:10.519803] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-10T18:51:10.519981] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-10T18:51:10.654922] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-10T18:51:10.743528] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-10T18:51:10.866363] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T18:51:10.954999] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:51:11.336230] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-10T18:51:11.489397] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-10T18:51:12.289398] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-10T18:51:12.646955] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T18:51:13.089390] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-10T18:51:13.495433] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T18:51:13.592451] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T18:51:13.889437] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-10T18:51:14.689403] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-10T18:51:14.820286] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T18:51:15.489394] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-10T18:51:15.700753] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-10T18:51:15.868021] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T18:51:16.289376] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-10T18:51:16.390000] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-10T18:51:17.089392] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-10T18:51:17.895131] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-10T18:51:17.899338] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T18:51:18.689426] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-10T18:51:19.046373] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-10T18:51:19.221153] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T18:51:19.224521] [INFO ] [REMOTE ] EVTC: Full fetch complete (38082 records). [2025-10-10T18:51:19.224687] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-10T18:51:19.496886] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-10T18:51:19.593449] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-10T18:51:19.593536] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-10T18:51:19.594212] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-10T18:51:19.594303] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-10T18:51:19.595169] [DEBUG] [LOCAL ] EVTC: Trimmed 38082 records to 26811 (keeping 200 days of data) [2025-10-10T18:51:19.760848] [DEBUG] [LOCAL ] EVTC: Primary data saved (26811 records). [2025-10-10T18:51:19.761008] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-10T18:51:19.761100] [INFO ] [MAIN ] Update Progress: 797/2373 symbols completed. EVTC took 54.9s. Estimated remaining: 3h 40m 1s. Rate: 7.2 symbols/min [2025-10-10T18:51:19.897085] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-10T18:51:20.289405] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-10T18:51:21.089450] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-10T18:51:21.364955] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T18:51:21.370197] [INFO ] [REMOTE ] EW: Full fetch complete (77349 records). [2025-10-10T18:51:21.370351] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-10T18:51:21.767840] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-10T18:51:21.768091] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-10T18:51:21.769166] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-10T18:51:21.769238] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-10T18:51:21.770945] [DEBUG] [LOCAL ] EW: Trimmed 77349 records to 54178 (keeping 200 days of data) [2025-10-10T18:51:22.005356] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-10T18:51:22.019969] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-10T18:51:22.123172] [DEBUG] [LOCAL ] EW: Primary data saved (54178 records). [2025-10-10T18:51:22.123319] [INFO ] [MAIN ] EW: Full history saved. [2025-10-10T18:51:22.123569] [INFO ] [MAIN ] Update Progress: 798/2373 symbols completed. EW took 39.2s. Estimated remaining: 3h 39m 40s. Rate: 7.2 symbols/min [2025-10-10T18:51:23.123442] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T18:51:23.134465] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-10T18:51:23.395801] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-10T18:51:23.489376] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-10T18:51:24.903887] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T18:51:24.915766] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-10T18:51:25.144067] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T18:51:25.151849] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-10T18:51:26.679265] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-10T18:51:26.687184] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-10T18:51:26.903835] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T18:51:26.915002] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-10T18:51:28.146461] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-10T18:51:28.153474] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-10T18:51:28.906403] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T18:51:28.918223] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-10T18:51:29.630768] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T18:51:29.637631] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-10T18:51:31.021493] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T18:51:31.024937] [INFO ] [REMOTE ] EXG: Full fetch complete (49774 records). [2025-10-10T18:51:31.025158] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-10T18:51:31.354546] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-10T18:51:31.408177] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-10T18:51:31.461109] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-10T18:51:31.461221] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-10T18:51:31.462022] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-10T18:51:31.462087] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-10T18:51:31.463376] [DEBUG] [LOCAL ] EXG: Trimmed 49774 records to 34701 (keeping 200 days of data) [2025-10-10T18:51:31.682615] [DEBUG] [LOCAL ] EXG: Primary data saved (34701 records). [2025-10-10T18:51:31.682819] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-10T18:51:31.682927] [INFO ] [MAIN ] Update Progress: 799/2373 symbols completed. EXG took 23.9s. Estimated remaining: 3h 39m 34s. Rate: 7.2 symbols/min [2025-10-10T18:51:33.467603] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-10T18:51:33.479474] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-10T18:51:35.627317] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-10T18:51:35.638975] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-10T18:51:37.765858] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-10T18:51:37.770955] [INFO ] [REMOTE ] EXK: Full fetch complete (76590 records). [2025-10-10T18:51:37.771085] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-10T18:51:38.158856] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-10T18:51:38.158948] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-10T18:51:38.159902] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-10T18:51:38.159967] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-10T18:51:38.161507] [DEBUG] [LOCAL ] EXK: Trimmed 76590 records to 53922 (keeping 200 days of data) [2025-10-10T18:51:38.467689] [DEBUG] [LOCAL ] EXK: Primary data saved (53922 records). [2025-10-10T18:51:38.467858] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-10T18:51:38.467978] [INFO ] [MAIN ] Update Progress: 800/2373 symbols completed. EXK took 28.3s. Estimated remaining: 3h 39m 23s. Rate: 7.2 symbols/min [2025-10-10T18:51:39.027532] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:51:39.138190] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:51:39.101215] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:51:39.172443] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:51:39.249705] [DEBUG] [LOCAL ] EXP: Loaded 29811 existing records from primary storage. [2025-10-10T18:51:39.267705] [INFO ] [MAIN ] EXP: Loaded 29811 existing records. [2025-10-10T18:51:39.267435] [DEBUG] [LOCAL ] EXR: Loaded 45561 existing records from primary storage. [2025-10-10T18:51:39.273301] [INFO ] [MAIN ] EXR: Loaded 45561 existing records. [2025-10-10T18:51:39.401520] [DEBUG] [LOCAL ] EXPD: Loaded 48219 existing records from primary storage. [2025-10-10T18:51:39.477966] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-10-10T18:51:39.476346] [INFO ] [MAIN ] EXPD: Loaded 48219 existing records. [2025-10-10T18:51:39.525706] [INFO ] [MAIN ] F: Loaded 54210 existing records. [2025-10-10T18:51:39.696447] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:51:39.755903] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-10T18:51:39.785363] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-10T18:51:39.834768] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-10T18:51:39.840510] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-10T18:51:40.088017] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:51:40.063699] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:51:40.131775] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-10T18:51:40.142231] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-10T18:51:40.156855] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-10T18:51:40.156913] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-10T18:51:40.204512] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-10T18:51:40.204688] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-10T18:51:40.204436] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:51:40.231230] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-10T18:51:40.205031] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-10T18:51:40.252066] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-10T18:51:40.252174] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-10T18:51:40.328028] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-10T18:51:40.347308] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-10T18:51:41.412487] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:51:41.477354] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-10T18:51:41.637372] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:51:41.624032] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:51:41.659330] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-10T18:51:41.658942] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-10T18:51:41.662804] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:51:41.665263] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-10T18:51:43.268273] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T18:51:43.275501] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-10T18:51:43.487238] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T18:51:43.496339] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-10T18:51:43.522714] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T18:51:43.532567] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-10T18:51:44.434812] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-10-10T18:51:44.446564] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-10T18:51:44.785549] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T18:51:44.792031] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-10T18:51:45.332863] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T18:51:45.343575] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-10T18:51:45.375112] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-10T18:51:45.385978] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-10T18:51:45.798576] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-10T18:51:45.804547] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-10T18:51:46.960279] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T18:51:46.969837] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-10T18:51:47.062066] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-10T18:51:47.071325] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-10T18:51:47.095473] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T18:51:47.103072] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-10T18:51:47.296151] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.85 seconds). [2025-10-10T18:51:47.308493] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-10T18:51:48.497777] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T18:51:48.504983] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-10T18:51:48.620260] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-10T18:51:48.630694] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-10T18:51:49.045682] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T18:51:49.055462] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-10T18:51:49.521917] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-10T18:51:49.528798] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-10T18:51:49.901515] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-10T18:51:49.911826] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-10T18:51:50.009259] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-10T18:51:50.019963] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-10T18:51:51.013009] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T18:51:51.042419] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-10T18:51:51.044489] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T18:51:51.052127] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-10T18:51:51.433071] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-10T18:51:51.489352] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-10T18:51:52.092155] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-10T18:51:52.288390] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T18:51:52.295360] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-10T18:51:52.894047] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T18:51:53.089366] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-10T18:51:53.228959] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T18:51:53.889418] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-10T18:51:54.689375] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-10T18:51:54.805753] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-10T18:51:54.872835] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T18:51:55.219299] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T18:51:55.489381] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-10T18:51:56.289416] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-10T18:51:56.693979] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-10T18:51:56.781875] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T18:51:57.089390] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-10T18:51:57.889394] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-10T18:51:58.689394] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-10T18:51:58.946124] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T18:51:59.050485] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-10-10T18:51:59.489376] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-10T18:51:59.775827] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-10T18:52:00.052215] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-10T18:52:00.055669] [INFO ] [REMOTE ] EXP: Full fetch complete (42807 records). [2025-10-10T18:52:00.055785] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-10T18:52:00.301884] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-10T18:52:00.436969] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-10T18:52:00.437060] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-10T18:52:00.437790] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-10T18:52:00.437878] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-10T18:52:00.438848] [DEBUG] [LOCAL ] EXP: Trimmed 42807 records to 30076 (keeping 200 days of data) [2025-10-10T18:52:00.632417] [DEBUG] [LOCAL ] EXP: Primary data saved (30076 records). [2025-10-10T18:52:00.632627] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-10T18:52:00.632787] [INFO ] [MAIN ] Update Progress: 801/2373 symbols completed. EXP took 22.2s. Estimated remaining: 3h 39m 42s. Rate: 7.2 symbols/min [2025-10-10T18:52:00.838725] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:52:00.885174] [DEBUG] [LOCAL ] FAF: Loaded 41815 existing records from primary storage. [2025-10-10T18:52:00.885602] [INFO ] [MAIN ] FAF: Loaded 41815 existing records. [2025-10-10T18:52:01.099456] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-10T18:52:01.144514] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:52:01.145310] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-10T18:52:01.145439] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-10T18:52:01.147020] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-10T18:52:01.147117] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-10T18:52:01.644862] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:52:01.685790] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-10T18:52:01.889399] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-10T18:52:02.689423] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-10T18:52:03.098079] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-10-10T18:52:03.140390] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-10T18:52:03.174913] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-10T18:52:03.179913] [INFO ] [REMOTE ] EXPD: Full fetch complete (69324 records). [2025-10-10T18:52:03.180101] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-10T18:52:03.494624] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-10T18:52:03.568704] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-10T18:52:03.568792] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-10T18:52:03.569756] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-10T18:52:03.569820] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-10T18:52:03.571163] [DEBUG] [LOCAL ] EXPD: Trimmed 69324 records to 48593 (keeping 200 days of data) [2025-10-10T18:52:03.810040] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-10T18:52:03.899838] [DEBUG] [LOCAL ] EXPD: Primary data saved (48593 records). [2025-10-10T18:52:03.900005] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-10T18:52:03.900840] [INFO ] [MAIN ] Update Progress: 802/2373 symbols completed. EXPD took 25.4s. Estimated remaining: 3h 39m 23s. Rate: 7.2 symbols/min [2025-10-10T18:52:04.064233] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:52:04.113362] [DEBUG] [LOCAL ] FBIN: Loaded 50714 existing records from primary storage. [2025-10-10T18:52:04.113754] [INFO ] [MAIN ] FBIN: Loaded 50714 existing records. [2025-10-10T18:52:04.289853] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-10T18:52:04.289735] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:52:04.291253] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-10T18:52:04.291343] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-10T18:52:04.291920] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-10T18:52:04.294039] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-10T18:52:04.638498] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:52:05.089408] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-10T18:52:05.855762] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-10T18:52:05.889329] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-10T18:52:06.021079] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-10T18:52:06.689411] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-10T18:52:06.953564] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T18:52:07.050213] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T18:52:07.489378] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-10T18:52:08.289450] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-10T18:52:09.089440] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-10T18:52:09.357320] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T18:52:09.552246] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-10-10T18:52:09.889349] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-10T18:52:09.944529] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T18:52:10.689437] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-10T18:52:11.030913] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T18:52:11.489439] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-10T18:52:12.289343] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-10T18:52:12.493474] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-10T18:52:12.498614] [INFO ] [REMOTE ] EXR: Full fetch complete (65847 records). [2025-10-10T18:52:12.498882] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-10T18:52:12.878187] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-10T18:52:12.878272] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-10T18:52:12.879171] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-10T18:52:12.879234] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-10T18:52:12.880836] [DEBUG] [LOCAL ] EXR: Trimmed 65847 records to 45888 (keeping 200 days of data) [2025-10-10T18:52:13.168198] [DEBUG] [LOCAL ] EXR: Primary data saved (45888 records). [2025-10-10T18:52:13.168302] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-10T18:52:13.168387] [INFO ] [MAIN ] Update Progress: 803/2373 symbols completed. EXR took 34.7s. Estimated remaining: 3h 39m 17s. Rate: 7.2 symbols/min [2025-10-10T18:52:13.339819] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:52:13.375291] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T18:52:13.387392] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-10T18:52:13.409528] [DEBUG] [LOCAL ] FBK: Loaded 26942 existing records from primary storage. [2025-10-10T18:52:13.410001] [INFO ] [MAIN ] FBK: Loaded 26942 existing records. [2025-10-10T18:52:13.546877] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (3.66 seconds). [2025-10-10T18:52:13.636592] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:52:13.636881] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-10T18:52:13.636933] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-10T18:52:13.637193] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-10T18:52:13.637250] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-10T18:52:13.894592] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-10T18:52:13.983539] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:52:14.096065] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T18:52:14.497550] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-10T18:52:14.502694] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-10-10T18:52:14.502861] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-10T18:52:14.698548] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-10T18:52:14.895877] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-10T18:52:14.895984] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-10T18:52:14.896995] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-10T18:52:14.897123] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-10T18:52:14.898577] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-10-10T18:52:15.248346] [DEBUG] [LOCAL ] F: Primary data saved (54600 records). [2025-10-10T18:52:15.258755] [INFO ] [MAIN ] F: Full history saved. [2025-10-10T18:52:15.258863] [INFO ] [MAIN ] Update Progress: 804/2373 symbols completed. F took 36.8s. Estimated remaining: 3h 38m 56s. Rate: 7.2 symbols/min [2025-10-10T18:52:15.323394] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T18:52:15.441165] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:52:15.483161] [DEBUG] [LOCAL ] FBP: Loaded 46095 existing records from primary storage. [2025-10-10T18:52:15.483479] [INFO ] [MAIN ] FBP: Loaded 46095 existing records. [2025-10-10T18:52:15.494679] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-10T18:52:15.664985] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:52:15.665258] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-10T18:52:15.665306] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-10T18:52:15.665539] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-10T18:52:15.665579] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-10T18:52:16.010022] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:52:16.289353] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-10T18:52:16.618793] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-10T18:52:16.663319] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T18:52:17.089382] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-10T18:52:17.861064] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-10T18:52:17.889331] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-10T18:52:18.307711] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T18:52:18.689406] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-10T18:52:18.988387] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-10T18:52:19.489403] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-10T18:52:20.289401] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-10T18:52:20.441359] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T18:52:21.089339] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-10T18:52:21.211185] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T18:52:21.230637] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-10T18:52:21.889436] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-10T18:52:22.689364] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-10T18:52:22.921876] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T18:52:23.355341] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-10T18:52:23.489347] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-10T18:52:24.289375] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-10T18:52:24.468397] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-10T18:52:24.550716] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T18:52:25.089390] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-10T18:52:25.442131] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-10T18:52:25.889417] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-10T18:52:26.689363] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-10T18:52:26.794686] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T18:52:27.489385] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-10T18:52:27.774752] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-10T18:52:27.864275] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-10T18:52:28.289371] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-10T18:52:29.089357] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-10T18:52:29.334959] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T18:52:29.711037] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-10T18:52:29.889396] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-10T18:52:30.689356] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-10T18:52:30.796238] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T18:52:31.489387] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-10T18:52:31.763833] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T18:52:31.861417] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T18:52:32.289370] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-10T18:52:32.537870] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T18:52:32.541480] [INFO ] [REMOTE ] FAF: Full fetch complete (57695 records). [2025-10-10T18:52:32.541579] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-10T18:52:32.945941] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-10T18:52:32.946064] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-10T18:52:32.946974] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-10T18:52:32.947037] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-10T18:52:32.948371] [DEBUG] [LOCAL ] FAF: Trimmed 57695 records to 42098 (keeping 200 days of data) [2025-10-10T18:52:33.124264] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-10T18:52:33.207803] [DEBUG] [LOCAL ] FAF: Primary data saved (42098 records). [2025-10-10T18:52:33.207960] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-10T18:52:33.208042] [INFO ] [MAIN ] Update Progress: 805/2373 symbols completed. FAF took 32.6s. Estimated remaining: 3h 39m 6s. Rate: 7.2 symbols/min [2025-10-10T18:52:33.374770] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:52:33.411741] [DEBUG] [LOCAL ] FBRT: Loaded 35372 existing records from primary storage. [2025-10-10T18:52:33.412083] [INFO ] [MAIN ] FBRT: Loaded 35372 existing records. [2025-10-10T18:52:33.590665] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:52:33.590898] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-10T18:52:33.590945] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-10T18:52:33.591215] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-10T18:52:33.591272] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-10T18:52:33.892946] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-10T18:52:33.967128] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:52:33.996313] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T18:52:34.689355] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-10T18:52:35.005867] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T18:52:35.089215] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T18:52:35.489391] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-10T18:52:36.294454] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-10T18:52:36.306820] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-10T18:52:37.089346] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-10T18:52:37.337551] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-10T18:52:37.594689] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-10T18:52:37.598156] [INFO ] [REMOTE ] FBK: Full fetch complete (34327 records). [2025-10-10T18:52:37.598234] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-10T18:52:37.894598] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-10T18:52:37.978438] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-10T18:52:37.978544] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-10T18:52:37.979401] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-10T18:52:37.979467] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-10T18:52:37.980371] [DEBUG] [LOCAL ] FBK: Trimmed 34327 records to 27187 (keeping 200 days of data) [2025-10-10T18:52:38.153847] [DEBUG] [LOCAL ] FBK: Primary data saved (27187 records). [2025-10-10T18:52:38.154038] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-10T18:52:38.154146] [INFO ] [MAIN ] Update Progress: 806/2373 symbols completed. FBK took 25.0s. Estimated remaining: 3h 38m 51s. Rate: 7.2 symbols/min [2025-10-10T18:52:38.331556] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:52:38.350736] [DEBUG] [LOCAL ] FC: Loaded 15218 existing records from primary storage. [2025-10-10T18:52:38.351051] [INFO ] [MAIN ] FC: Loaded 15218 existing records. [2025-10-10T18:52:38.543129] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:52:38.543624] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-10T18:52:38.543734] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-10T18:52:38.544054] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-10T18:52:38.544151] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-10T18:52:38.693687] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-10T18:52:38.946980] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T18:52:38.980071] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:52:39.489430] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-10T18:52:39.533848] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-10T18:52:40.246691] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T18:52:40.289423] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-10T18:52:41.089382] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-10T18:52:41.120459] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-10T18:52:41.231872] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-10T18:52:41.889412] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-10T18:52:42.689425] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-10T18:52:42.841173] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T18:52:43.033033] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-10T18:52:43.489375] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-10T18:52:44.289332] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-10T18:52:44.399764] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T18:52:44.420684] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-10T18:52:45.089389] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-10T18:52:45.783379] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-10T18:52:45.788237] [INFO ] [REMOTE ] FBIN: Full fetch complete (72701 records). [2025-10-10T18:52:45.788360] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-10T18:52:45.891234] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-10T18:52:46.284293] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-10T18:52:46.284470] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-10T18:52:46.286267] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-10T18:52:46.286863] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-10T18:52:46.286771] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-10T18:52:46.292803] [DEBUG] [LOCAL ] FBIN: Trimmed 72701 records to 51053 (keeping 200 days of data) [2025-10-10T18:52:46.602436] [DEBUG] [LOCAL ] FBIN: Primary data saved (51053 records). [2025-10-10T18:52:46.602608] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-10T18:52:46.602915] [INFO ] [MAIN ] Update Progress: 807/2373 symbols completed. FBIN took 42.7s. Estimated remaining: 3h 38m 43s. Rate: 7.2 symbols/min [2025-10-10T18:52:46.698430] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-10T18:52:46.771751] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:52:46.812475] [DEBUG] [LOCAL ] FCF: Loaded 39430 existing records from primary storage. [2025-10-10T18:52:46.812847] [INFO ] [MAIN ] FCF: Loaded 39430 existing records. [2025-10-10T18:52:46.985571] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:52:46.985902] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-10T18:52:46.985955] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-10T18:52:46.986252] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-10T18:52:46.986309] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-10T18:52:47.345502] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:52:47.489347] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-10T18:52:47.584213] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-10T18:52:47.588944] [INFO ] [REMOTE ] FBP: Full fetch complete (66360 records). [2025-10-10T18:52:47.589084] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-10T18:52:47.979164] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-10T18:52:47.979265] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-10T18:52:47.980565] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-10T18:52:47.980809] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-10T18:52:47.982431] [DEBUG] [LOCAL ] FBP: Trimmed 66360 records to 46453 (keeping 200 days of data) [2025-10-10T18:52:48.055813] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T18:52:48.288690] [DEBUG] [LOCAL ] FBP: Primary data saved (46453 records). [2025-10-10T18:52:48.288857] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-10T18:52:48.288948] [INFO ] [MAIN ] Update Progress: 808/2373 symbols completed. FBP took 33.0s. Estimated remaining: 3h 38m 22s. Rate: 7.2 symbols/min [2025-10-10T18:52:48.294706] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-10T18:52:48.473226] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:52:48.503909] [DEBUG] [LOCAL ] FCN: Loaded 26164 existing records from primary storage. [2025-10-10T18:52:48.504349] [INFO ] [MAIN ] FCN: Loaded 26164 existing records. [2025-10-10T18:52:48.689028] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:52:48.689629] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-10T18:52:48.689772] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-10T18:52:48.690176] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-10T18:52:48.690241] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-10T18:52:48.833672] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T18:52:49.094701] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-10T18:52:49.125703] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:52:49.338547] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-10T18:52:49.889360] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-10T18:52:50.066166] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-10T18:52:50.689385] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-10T18:52:51.429555] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-10T18:52:51.489335] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-10T18:52:51.674317] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T18:52:52.289403] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-10T18:52:53.028193] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-10T18:52:53.089446] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-10T18:52:53.535784] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-10T18:52:53.889404] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-10T18:52:54.689364] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-10T18:52:54.723198] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T18:52:55.211041] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T18:52:55.489386] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-10T18:52:55.800306] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-10T18:52:56.289395] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-10T18:52:56.876598] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-10T18:52:57.089403] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-10T18:52:57.358476] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-10T18:52:57.889384] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-10T18:52:58.689785] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-10T18:52:58.836924] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T18:52:59.181544] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-10T18:52:59.489369] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-10T18:52:59.641583] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T18:52:59.643335] [INFO ] [REMOTE ] FC: Full fetch complete (21739 records). [2025-10-10T18:52:59.643403] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-10T18:53:00.007424] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-10T18:53:00.007580] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-10T18:53:00.008139] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-10T18:53:00.008202] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-10T18:53:00.008996] [DEBUG] [LOCAL ] FC: Trimmed 21739 records to 15309 (keeping 200 days of data) [2025-10-10T18:53:00.098392] [DEBUG] [LOCAL ] FC: Primary data saved (15309 records). [2025-10-10T18:53:00.098545] [INFO ] [MAIN ] FC: Full history saved. [2025-10-10T18:53:00.098658] [INFO ] [MAIN ] Update Progress: 809/2373 symbols completed. FC took 21.9s. Estimated remaining: 3h 38m 20s. Rate: 7.2 symbols/min [2025-10-10T18:53:00.264609] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:53:00.289443] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-10T18:53:00.303294] [DEBUG] [LOCAL ] FCPT: Loaded 37591 existing records from primary storage. [2025-10-10T18:53:00.303637] [INFO ] [MAIN ] FCPT: Loaded 37591 existing records. [2025-10-10T18:53:00.482741] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:53:00.483062] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-10T18:53:00.483112] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-10T18:53:00.483465] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-10T18:53:00.483530] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-10T18:53:00.833888] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:53:00.906295] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T18:53:01.089441] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-10T18:53:01.889386] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-10T18:53:02.354261] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-10T18:53:02.417910] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-10T18:53:02.689377] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-10T18:53:03.421344] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-10T18:53:03.489354] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-10T18:53:04.289400] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-10T18:53:04.438878] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T18:53:05.011637] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T18:53:05.089345] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-10T18:53:05.889437] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-10T18:53:05.945017] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-10T18:53:06.689420] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-10T18:53:06.744296] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T18:53:07.489352] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-10T18:53:07.562107] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T18:53:08.289444] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-10T18:53:08.600713] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T18:53:09.089406] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-10T18:53:09.189447] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-10T18:53:09.373637] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-10T18:53:09.889407] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-10T18:53:10.122387] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-10T18:53:10.689397] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-10T18:53:11.388542] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-10T18:53:11.489339] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-10T18:53:12.012264] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-10T18:53:12.289423] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-10T18:53:13.068346] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T18:53:13.072479] [INFO ] [REMOTE ] FBRT: Full fetch complete (49300 records). [2025-10-10T18:53:13.072681] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-10T18:53:13.094537] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-10T18:53:13.454331] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-10T18:53:13.454425] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-10T18:53:13.455279] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-10T18:53:13.455345] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-10T18:53:13.456514] [DEBUG] [LOCAL ] FBRT: Trimmed 49300 records to 35702 (keeping 200 days of data) [2025-10-10T18:53:13.677744] [DEBUG] [LOCAL ] FBRT: Primary data saved (35702 records). [2025-10-10T18:53:13.677904] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-10T18:53:13.677992] [INFO ] [MAIN ] Update Progress: 810/2373 symbols completed. FBRT took 40.5s. Estimated remaining: 3h 38m 22s. Rate: 7.2 symbols/min [2025-10-10T18:53:13.810390] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T18:53:13.891609] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:53:13.891735] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-10T18:53:13.892222] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-10T18:53:13.892666] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-10T18:53:13.893616] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-10T18:53:13.893701] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-10T18:53:13.893762] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-10T18:53:13.893798] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-10T18:53:14.271115] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:53:14.695224] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-10T18:53:14.697966] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-10T18:53:15.025696] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-10T18:53:15.037887] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-10T18:53:15.489448] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-10T18:53:15.820789] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-10T18:53:16.289368] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-10T18:53:17.089391] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-10T18:53:17.889359] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-10T18:53:18.105971] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T18:53:18.323417] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-10T18:53:18.338885] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-10T18:53:18.689386] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-10T18:53:19.489385] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-10T18:53:19.949185] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T18:53:20.289431] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-10T18:53:21.089418] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-10T18:53:21.268747] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T18:53:21.602497] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-10T18:53:21.610047] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T18:53:21.612759] [INFO ] [REMOTE ] FCN: Full fetch complete (35691 records). [2025-10-10T18:53:21.612842] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-10T18:53:21.891954] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-10T18:53:21.978183] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-10T18:53:21.978272] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-10T18:53:21.978967] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-10T18:53:21.979028] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-10T18:53:21.979897] [DEBUG] [LOCAL ] FCN: Trimmed 35691 records to 26406 (keeping 200 days of data) [2025-10-10T18:53:22.149057] [DEBUG] [LOCAL ] FCN: Primary data saved (26406 records). [2025-10-10T18:53:22.149211] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-10T18:53:22.149308] [INFO ] [MAIN ] Update Progress: 811/2373 symbols completed. FCN took 33.9s. Estimated remaining: 3h 38m 13s. Rate: 7.2 symbols/min [2025-10-10T18:53:22.321764] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:53:22.338193] [DEBUG] [LOCAL ] FCT: Loaded 14880 existing records from primary storage. [2025-10-10T18:53:22.338463] [INFO ] [MAIN ] FCT: Loaded 14880 existing records. [2025-10-10T18:53:22.492393] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-10T18:53:22.526496] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:53:22.528496] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-10T18:53:22.528588] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-10T18:53:22.528835] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-10T18:53:22.528893] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-10T18:53:22.689439] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-10T18:53:22.881524] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:53:23.489424] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-10T18:53:24.289391] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-10T18:53:24.453783] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T18:53:24.579168] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-10T18:53:25.089364] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-10T18:53:25.153942] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T18:53:25.889379] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-10T18:53:26.214197] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-10T18:53:26.689393] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-10T18:53:27.056928] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-10T18:53:27.367687] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-10T18:53:27.489374] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-10T18:53:28.289379] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-10T18:53:28.539297] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-10T18:53:28.691772] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-10T18:53:29.089414] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-10T18:53:29.889383] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-10T18:53:30.607097] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T18:53:30.689339] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-10T18:53:30.961337] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-10T18:53:31.489404] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-10T18:53:32.168882] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-10T18:53:32.289358] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-10T18:53:32.570488] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-10T18:53:32.570385] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-10T18:53:33.089407] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-10T18:53:33.889409] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-10T18:53:34.695602] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-10T18:53:34.702109] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-10T18:53:34.809884] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-10T18:53:35.489409] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-10T18:53:36.231187] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-10T18:53:36.289381] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-10T18:53:36.664727] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T18:53:37.089408] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-10T18:53:37.889428] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-10T18:53:37.946541] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T18:53:38.296611] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-10T18:53:38.689383] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-10T18:53:38.847051] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-10T18:53:38.851163] [INFO ] [REMOTE ] FCPT: Full fetch complete (53792 records). [2025-10-10T18:53:38.851275] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-10T18:53:39.257788] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-10T18:53:39.257590] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-10T18:53:39.259137] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-10T18:53:39.260202] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-10T18:53:39.260414] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-10T18:53:39.261709] [DEBUG] [LOCAL ] FCPT: Trimmed 53792 records to 37878 (keeping 200 days of data) [2025-10-10T18:53:39.489594] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-10T18:53:39.511099] [DEBUG] [LOCAL ] FCPT: Primary data saved (37878 records). [2025-10-10T18:53:39.511255] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-10T18:53:39.511366] [INFO ] [MAIN ] Update Progress: 812/2373 symbols completed. FCPT took 39.4s. Estimated remaining: 3h 38m 22s. Rate: 7.1 symbols/min [2025-10-10T18:53:39.681216] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:53:39.736091] [DEBUG] [LOCAL ] FCX: Loaded 54090 existing records from primary storage. [2025-10-10T18:53:39.736451] [INFO ] [MAIN ] FCX: Loaded 54090 existing records. [2025-10-10T18:53:39.928185] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:53:39.928797] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-10T18:53:39.928872] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-10T18:53:39.930771] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-10T18:53:39.930833] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-10T18:53:40.290926] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-10T18:53:40.315080] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:53:40.618990] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-10T18:53:41.089461] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-10T18:53:41.820507] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-10T18:53:41.825094] [INFO ] [REMOTE ] FCF: Full fetch complete (58002 records). [2025-10-10T18:53:41.825231] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-10T18:53:41.894744] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-10T18:53:42.217245] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-10T18:53:42.217765] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-10T18:53:42.218599] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-10T18:53:42.218691] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-10T18:53:42.220099] [DEBUG] [LOCAL ] FCF: Trimmed 58002 records to 39746 (keeping 200 days of data) [2025-10-10T18:53:42.459251] [DEBUG] [LOCAL ] FCF: Primary data saved (39746 records). [2025-10-10T18:53:42.459411] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-10T18:53:42.459496] [INFO ] [MAIN ] Update Progress: 813/2373 symbols completed. FCF took 55.9s. Estimated remaining: 3h 38m 3s. Rate: 7.2 symbols/min [2025-10-10T18:53:42.626805] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:53:42.657083] [DEBUG] [LOCAL ] FDP: Loaded 30266 existing records from primary storage. [2025-10-10T18:53:42.657393] [INFO ] [MAIN ] FDP: Loaded 30266 existing records. [2025-10-10T18:53:42.699047] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-10T18:53:42.834775] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:53:42.835043] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-10T18:53:42.835102] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-10T18:53:42.835862] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-10T18:53:42.835921] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-10T18:53:42.960739] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-10T18:53:43.238900] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:53:43.304798] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-10T18:53:43.303677] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-10T18:53:43.316841] [INFO ] [REMOTE ] FCRX: Full fetch complete (1673 records). [2025-10-10T18:53:43.316932] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-10T18:53:43.491034] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-10T18:53:43.495516] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-10T18:53:43.495832] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:53:43.496928] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:53:43.497011] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-10T18:53:43.497081] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-10T18:53:43.497119] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-10T18:53:43.497215] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-10T18:53:43.497285] [INFO ] [MAIN ] Update Progress: 814/2373 symbols completed. FCRX took 29.8s. Estimated remaining: 3h 37m 41s. Rate: 7.2 symbols/min [2025-10-10T18:53:43.669551] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:53:43.704980] [DEBUG] [LOCAL ] FDS: Loaded 27281 existing records from primary storage. [2025-10-10T18:53:43.705374] [INFO ] [MAIN ] FDS: Loaded 27281 existing records. [2025-10-10T18:53:43.881111] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:53:43.881373] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-10T18:53:43.881422] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-10T18:53:43.882267] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-10T18:53:43.882326] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-10T18:53:44.233133] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:53:44.289336] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-10T18:53:44.855597] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T18:53:45.089360] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-10T18:53:45.133039] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-10T18:53:45.889412] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-10T18:53:46.454139] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T18:53:46.689379] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-10T18:53:47.027617] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-10T18:53:47.489416] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-10T18:53:48.289383] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-10T18:53:48.311531] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T18:53:49.089381] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-10T18:53:49.635283] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-10T18:53:49.733509] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T18:53:49.889407] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-10T18:53:50.179826] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T18:53:50.181970] [INFO ] [REMOTE ] FCT: Full fetch complete (21139 records). [2025-10-10T18:53:50.182050] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-10T18:53:50.553242] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-10T18:53:50.553337] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-10T18:53:50.554074] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-10T18:53:50.554139] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-10T18:53:50.554946] [DEBUG] [LOCAL ] FCT: Trimmed 21139 records to 14947 (keeping 200 days of data) [2025-10-10T18:53:50.652903] [DEBUG] [LOCAL ] FCT: Primary data saved (14947 records). [2025-10-10T18:53:50.653077] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-10T18:53:50.653176] [INFO ] [MAIN ] Update Progress: 815/2373 symbols completed. FCT took 28.5s. Estimated remaining: 3h 37m 30s. Rate: 7.2 symbols/min [2025-10-10T18:53:50.696729] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-10T18:53:50.829155] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:53:50.885050] [DEBUG] [LOCAL ] FDX: Loaded 51817 existing records from primary storage. [2025-10-10T18:53:50.885488] [INFO ] [MAIN ] FDX: Loaded 51817 existing records. [2025-10-10T18:53:51.063980] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:53:51.064215] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-10T18:53:51.064266] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-10T18:53:51.065079] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-10T18:53:51.065142] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-10T18:53:51.431571] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:53:51.489409] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-10T18:53:52.150545] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-10T18:53:52.289365] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-10T18:53:52.459136] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T18:53:52.994949] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-10T18:53:53.089380] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-10T18:53:53.889361] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-10T18:53:54.501971] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-10T18:53:54.642599] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-10T18:53:54.689362] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-10T18:53:55.476781] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-10T18:53:55.489340] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-10T18:53:56.289390] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-10T18:53:56.914888] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-10T18:53:57.089408] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-10T18:53:57.126199] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-10T18:53:57.628772] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T18:53:57.889369] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-10T18:53:58.155504] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-10T18:53:58.689391] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-10T18:53:59.489366] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-10T18:54:00.067432] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-10T18:54:00.289374] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-10T18:54:00.534938] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-10T18:54:00.888337] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-10T18:54:01.089394] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-10T18:54:01.889405] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-10T18:54:02.467421] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-10T18:54:02.689497] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-10T18:54:02.794534] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-10T18:54:03.489435] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-10T18:54:04.070555] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-10T18:54:04.211047] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T18:54:04.289379] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-10T18:54:04.810265] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-10T18:54:05.089456] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-10T18:54:05.894484] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-10T18:54:05.906728] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T18:54:06.689394] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-10T18:54:07.489414] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-10T18:54:07.710225] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T18:54:07.764317] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-10T18:54:07.798834] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-10T18:54:08.289424] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-10T18:54:09.089419] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-10T18:54:09.300536] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T18:54:09.889439] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-10T18:54:10.479922] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-10T18:54:10.689389] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-10T18:54:10.741908] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-10T18:54:11.429297] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-10T18:54:11.489402] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-10T18:54:12.289422] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-10T18:54:12.908356] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-10T18:54:13.089435] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-10T18:54:13.353794] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T18:54:13.358319] [INFO ] [REMOTE ] FDS: Full fetch complete (38120 records). [2025-10-10T18:54:13.358478] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-10T18:54:13.772247] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-10T18:54:13.772324] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-10T18:54:13.773000] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-10T18:54:13.773065] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-10T18:54:13.773984] [DEBUG] [LOCAL ] FDS: Trimmed 38120 records to 27620 (keeping 200 days of data) [2025-10-10T18:54:13.889423] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-10T18:54:13.952125] [DEBUG] [LOCAL ] FDS: Primary data saved (27620 records). [2025-10-10T18:54:13.952308] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-10T18:54:13.952404] [INFO ] [MAIN ] Update Progress: 816/2373 symbols completed. FDS took 30.5s. Estimated remaining: 3h 37m 50s. Rate: 7.1 symbols/min [2025-10-10T18:54:14.123266] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:54:14.173209] [DEBUG] [LOCAL ] FE: Loaded 53823 existing records from primary storage. [2025-10-10T18:54:14.173705] [INFO ] [MAIN ] FE: Loaded 53823 existing records. [2025-10-10T18:54:14.352264] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:54:14.352778] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-10T18:54:14.352833] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-10T18:54:14.353909] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-10T18:54:14.353966] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-10T18:54:14.491369] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-10T18:54:14.499438] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-10T18:54:14.524481] [INFO ] [REMOTE ] FDP: Full fetch complete (42729 records). [2025-10-10T18:54:14.600081] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-10T18:54:14.693015] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-10T18:54:14.920169] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:54:15.169762] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-10T18:54:15.169855] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-10T18:54:15.170384] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-10T18:54:15.170425] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-10T18:54:15.171532] [DEBUG] [LOCAL ] FDP: Trimmed 42729 records to 30435 (keeping 200 days of data) [2025-10-10T18:54:15.355088] [DEBUG] [LOCAL ] FDP: Primary data saved (30435 records). [2025-10-10T18:54:15.355244] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-10T18:54:15.355332] [INFO ] [MAIN ] Update Progress: 817/2373 symbols completed. FDP took 32.9s. Estimated remaining: 3h 37m 29s. Rate: 7.2 symbols/min [2025-10-10T18:54:15.496788] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-10T18:54:15.522458] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:54:15.522763] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-10T18:54:15.522811] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-10T18:54:15.522930] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-10T18:54:15.522971] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-10T18:54:15.523012] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-10T18:54:15.523045] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-10T18:54:15.866437] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:54:16.234627] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-10T18:54:16.289337] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-10T18:54:17.089398] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-10T18:54:17.431305] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-10T18:54:17.436706] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-10-10T18:54:17.436886] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-10T18:54:17.537871] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-10T18:54:17.871335] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-10T18:54:17.892071] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-10T18:54:17.928569] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-10T18:54:17.928762] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-10T18:54:17.930255] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-10T18:54:17.930331] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-10T18:54:17.935315] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 54480 (keeping 200 days of data) [2025-10-10T18:54:18.317081] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T18:54:18.339287] [DEBUG] [LOCAL ] FCX: Primary data saved (54480 records). [2025-10-10T18:54:18.339495] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-10T18:54:18.339615] [INFO ] [MAIN ] Update Progress: 818/2373 symbols completed. FCX took 38.8s. Estimated remaining: 3h 37m 10s. Rate: 7.2 symbols/min [2025-10-10T18:54:18.532400] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:54:18.535193] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-10T18:54:18.592887] [DEBUG] [LOCAL ] FERG: Loaded 49116 existing records from primary storage. [2025-10-10T18:54:18.593303] [INFO ] [MAIN ] FERG: Loaded 49116 existing records. [2025-10-10T18:54:18.695094] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-10T18:54:18.777793] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:54:18.778065] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-10T18:54:18.778117] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-10T18:54:18.779490] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-10T18:54:18.779550] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-10T18:54:19.158986] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:54:19.489395] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-10T18:54:20.289386] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-10T18:54:20.846664] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-10T18:54:20.885779] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-10T18:54:21.089398] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-10T18:54:21.537176] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T18:54:21.889437] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-10T18:54:22.391574] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-10T18:54:22.675112] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-10T18:54:22.689347] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-10T18:54:23.489384] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-10T18:54:24.289423] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-10T18:54:24.593465] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T18:54:25.089388] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-10T18:54:25.382572] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-10T18:54:25.889390] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-10T18:54:26.290808] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-10T18:54:26.381933] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T18:54:26.689381] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-10T18:54:27.293751] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-10T18:54:27.489374] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-10T18:54:28.040852] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-10T18:54:28.289370] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-10T18:54:28.769731] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-10T18:54:28.774441] [INFO ] [REMOTE ] FDX: Full fetch complete (74358 records). [2025-10-10T18:54:28.774596] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-10T18:54:29.097520] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-10T18:54:29.197270] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-10T18:54:29.197392] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-10T18:54:29.198358] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-10T18:54:29.198422] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-10T18:54:29.200019] [DEBUG] [LOCAL ] FDX: Trimmed 74358 records to 52203 (keeping 200 days of data) [2025-10-10T18:54:29.530122] [DEBUG] [LOCAL ] FDX: Primary data saved (52203 records). [2025-10-10T18:54:29.530278] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-10T18:54:29.530361] [INFO ] [MAIN ] Update Progress: 819/2373 symbols completed. FDX took 38.9s. Estimated remaining: 3h 37m 7s. Rate: 7.2 symbols/min [2025-10-10T18:54:29.684883] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-10T18:54:29.702813] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:54:29.721099] [DEBUG] [LOCAL ] FET: Loaded 12879 existing records from primary storage. [2025-10-10T18:54:29.721372] [INFO ] [MAIN ] FET: Loaded 12879 existing records. [2025-10-10T18:54:29.896818] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-10T18:54:29.899735] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:54:29.900918] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-10T18:54:29.901092] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-10T18:54:29.901585] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-10T18:54:29.901687] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-10T18:54:30.150871] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T18:54:30.235310] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-10T18:54:30.312628] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:54:30.689364] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-10T18:54:31.489383] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-10T18:54:31.924350] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-10T18:54:32.289353] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-10T18:54:32.499489] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T18:54:32.701669] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-10T18:54:33.089397] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-10T18:54:33.889434] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-10T18:54:34.347897] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-10T18:54:34.689361] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-10T18:54:35.155230] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T18:54:35.489351] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-10T18:54:35.713217] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T18:54:36.289372] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-10T18:54:36.814522] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-10T18:54:36.815273] [INFO ] [REMOTE ] FENG: Full fetch complete (2263 records). [2025-10-10T18:54:36.815342] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-10T18:54:36.991997] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T18:54:36.992223] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T18:54:36.992303] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T18:54:36.992363] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-10T18:54:36.992431] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-10T18:54:36.992476] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-10T18:54:36.992515] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-10T18:54:36.992571] [INFO ] [MAIN ] Update Progress: 820/2373 symbols completed. FENG took 21.6s. Estimated remaining: 3h 36m 57s. Rate: 7.2 symbols/min [2025-10-10T18:54:37.092746] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-10T18:54:37.167324] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:54:37.190069] [DEBUG] [LOCAL ] FF: Loaded 24629 existing records from primary storage. [2025-10-10T18:54:37.190353] [INFO ] [MAIN ] FF: Loaded 24629 existing records. [2025-10-10T18:54:37.369766] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:54:37.370221] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-10T18:54:37.370461] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-10T18:54:37.371419] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-10T18:54:37.371478] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-10T18:54:37.643925] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-10T18:54:37.768811] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:54:37.889371] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-10T18:54:38.689332] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-10T18:54:39.082454] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T18:54:39.219092] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T18:54:39.489391] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-10T18:54:40.180014] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T18:54:40.289356] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-10T18:54:40.811425] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T18:54:41.089399] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-10T18:54:41.889400] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-10T18:54:42.221937] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T18:54:42.434484] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T18:54:42.689347] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-10T18:54:42.858108] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T18:54:43.489411] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-10T18:54:44.243237] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T18:54:44.289341] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-10T18:54:45.089367] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-10T18:54:45.469143] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T18:54:45.837769] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-10T18:54:45.889342] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-10T18:54:45.971161] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-10T18:54:46.689368] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-10T18:54:47.028408] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-10T18:54:47.489408] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-10T18:54:48.289421] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-10T18:54:48.506677] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T18:54:48.922757] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-10T18:54:49.089355] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-10T18:54:49.368935] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T18:54:49.889382] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-10T18:54:50.689392] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-10T18:54:51.072357] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T18:54:51.489350] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-10T18:54:51.690009] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-10T18:54:51.918206] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-10T18:54:52.289452] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-10T18:54:53.089368] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-10T18:54:53.430343] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-10T18:54:53.435579] [INFO ] [REMOTE ] FERG: Full fetch complete (70828 records). [2025-10-10T18:54:53.435807] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-10T18:54:53.784309] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T18:54:53.881108] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-10T18:54:53.881224] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-10T18:54:53.882351] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-10T18:54:53.882429] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-10T18:54:53.885502] [DEBUG] [LOCAL ] FERG: Trimmed 70828 records to 49475 (keeping 200 days of data) [2025-10-10T18:54:53.889360] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-10T18:54:54.121062] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-10T18:54:54.225791] [DEBUG] [LOCAL ] FERG: Primary data saved (49475 records). [2025-10-10T18:54:54.225972] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-10T18:54:54.226064] [INFO ] [MAIN ] Update Progress: 821/2373 symbols completed. FERG took 35.9s. Estimated remaining: 3h 37m 5s. Rate: 7.1 symbols/min [2025-10-10T18:54:54.388777] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:54:54.396861] [DEBUG] [LOCAL ] FFA: Loaded 6118 existing records from primary storage. [2025-10-10T18:54:54.397106] [INFO ] [MAIN ] FFA: Loaded 6118 existing records. [2025-10-10T18:54:54.576090] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:54:54.576357] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-10T18:54:54.576409] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-10T18:54:54.576808] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-10T18:54:54.576867] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-10T18:54:54.694540] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-10T18:54:54.974889] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:54:55.231420] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-10T18:54:55.489419] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-10T18:54:55.779057] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-10T18:54:56.251255] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-10T18:54:56.289337] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-10T18:54:57.089371] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-10T18:54:57.144327] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-10T18:54:57.889358] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-10T18:54:58.158586] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-10T18:54:58.689404] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-10T18:54:59.489417] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-10T18:54:59.814365] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T18:54:59.899795] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T18:55:00.184850] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T18:55:00.289373] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-10T18:55:01.089394] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-10T18:55:01.201957] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-10T18:55:01.889443] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-10T18:55:02.418485] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T18:55:02.689429] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-10T18:55:02.865130] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-10T18:55:03.489379] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-10T18:55:03.842751] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-10T18:55:04.289426] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-10T18:55:05.089371] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-10T18:55:05.441434] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-10T18:55:05.506925] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-10T18:55:05.580337] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-10T18:55:05.889400] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-10T18:55:06.689417] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-10T18:55:07.431189] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-10T18:55:07.489403] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-10T18:55:07.669078] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T18:55:07.674228] [INFO ] [REMOTE ] FE: Full fetch complete (77282 records). [2025-10-10T18:55:07.674351] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-10T18:55:07.984138] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-10T18:55:08.074806] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-10T18:55:08.074922] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-10T18:55:08.076230] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-10T18:55:08.076303] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-10T18:55:08.078348] [DEBUG] [LOCAL ] FE: Trimmed 77282 records to 54212 (keeping 200 days of data) [2025-10-10T18:55:08.306314] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-10T18:55:08.440859] [DEBUG] [LOCAL ] FE: Primary data saved (54212 records). [2025-10-10T18:55:08.441059] [INFO ] [MAIN ] FE: Full history saved. [2025-10-10T18:55:08.441162] [INFO ] [MAIN ] Update Progress: 822/2373 symbols completed. FE took 54.5s. Estimated remaining: 3h 37m 8s. Rate: 7.1 symbols/min [2025-10-10T18:55:08.631257] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:55:08.650841] [DEBUG] [LOCAL ] FFC: Loaded 16860 existing records from primary storage. [2025-10-10T18:55:08.651131] [INFO ] [MAIN ] FFC: Loaded 16860 existing records. [2025-10-10T18:55:08.844172] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:55:08.844413] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-10T18:55:08.844464] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-10T18:55:08.844990] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-10T18:55:08.845050] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-10T18:55:09.094229] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-10T18:55:09.133628] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-10T18:55:09.213761] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:55:09.889367] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-10T18:55:10.207497] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-10T18:55:10.209233] [INFO ] [REMOTE ] FET: Full fetch complete (18260 records). [2025-10-10T18:55:10.209314] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-10T18:55:10.566735] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-10T18:55:10.566834] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-10T18:55:10.567248] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-10T18:55:10.567288] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-10T18:55:10.567824] [DEBUG] [LOCAL ] FET: Trimmed 18260 records to 12967 (keeping 200 days of data) [2025-10-10T18:55:10.642140] [DEBUG] [LOCAL ] FET: Primary data saved (12967 records). [2025-10-10T18:55:10.642292] [INFO ] [MAIN ] FET: Full history saved. [2025-10-10T18:55:10.642377] [INFO ] [MAIN ] Update Progress: 823/2373 symbols completed. FET took 41.1s. Estimated remaining: 3h 36m 48s. Rate: 7.1 symbols/min [2025-10-10T18:55:10.696628] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-10T18:55:10.816286] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:55:10.851171] [DEBUG] [LOCAL ] FFWM: Loaded 36030 existing records from primary storage. [2025-10-10T18:55:10.851493] [INFO ] [MAIN ] FFWM: Loaded 36030 existing records. [2025-10-10T18:55:11.029327] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:55:11.029623] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-10T18:55:11.029712] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-10T18:55:11.030415] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-10T18:55:11.030480] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-10T18:55:11.134303] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-10T18:55:11.147515] [INFO ] [REMOTE ] FF: Full fetch complete (36392 records). [2025-10-10T18:55:11.153443] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-10T18:55:11.489926] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-10T18:55:11.716944] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:55:11.800600] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-10T18:55:11.800717] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-10T18:55:11.801339] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-10T18:55:11.801380] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-10T18:55:11.802228] [DEBUG] [LOCAL ] FF: Trimmed 36392 records to 24777 (keeping 200 days of data) [2025-10-10T18:55:11.941848] [DEBUG] [LOCAL ] FF: Primary data saved (24777 records). [2025-10-10T18:55:11.941999] [INFO ] [MAIN ] FF: Full history saved. [2025-10-10T18:55:11.942087] [INFO ] [MAIN ] Update Progress: 824/2373 symbols completed. FF took 34.9s. Estimated remaining: 3h 36m 26s. Rate: 7.2 symbols/min [2025-10-10T18:55:12.113965] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:55:12.134904] [DEBUG] [LOCAL ] FG: Loaded 22863 existing records from primary storage. [2025-10-10T18:55:12.135177] [INFO ] [MAIN ] FG: Loaded 22863 existing records. [2025-10-10T18:55:12.262962] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-10T18:55:12.291368] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-10T18:55:12.333308] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:55:12.333958] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-10T18:55:12.334100] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-10T18:55:12.339324] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-10T18:55:12.339939] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-10T18:55:12.342110] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-10T18:55:12.680912] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:55:13.089387] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-10T18:55:13.544324] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T18:55:13.889458] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-10T18:55:14.002339] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T18:55:14.003870] [INFO ] [REMOTE ] FFA: Full fetch complete (8772 records). [2025-10-10T18:55:14.003941] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-10T18:55:14.386943] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-10T18:55:14.387051] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-10T18:55:14.387442] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-10T18:55:14.387485] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-10T18:55:14.387993] [DEBUG] [LOCAL ] FFA: Trimmed 8772 records to 6187 (keeping 200 days of data) [2025-10-10T18:55:14.427024] [DEBUG] [LOCAL ] FFA: Primary data saved (6187 records). [2025-10-10T18:55:14.427164] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-10T18:55:14.427265] [INFO ] [MAIN ] Update Progress: 825/2373 symbols completed. FFA took 20.2s. Estimated remaining: 3h 36m 6s. Rate: 7.2 symbols/min [2025-10-10T18:55:14.607688] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:55:14.614592] [DEBUG] [LOCAL ] FGN: Loaded 3810 existing records from primary storage. [2025-10-10T18:55:14.614854] [INFO ] [MAIN ] FGN: Loaded 3810 existing records. [2025-10-10T18:55:14.694554] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-10T18:55:14.802178] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:55:14.802440] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-10T18:55:14.802492] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-10T18:55:14.802757] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-10T18:55:14.802816] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-10T18:55:15.178556] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:55:15.406574] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T18:55:15.489366] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-10T18:55:15.656161] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-10T18:55:16.289448] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-10T18:55:16.735397] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T18:55:16.792190] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-10T18:55:17.089382] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-10T18:55:17.889468] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-10T18:55:18.694499] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-10T18:55:18.717751] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T18:55:18.739178] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-10T18:55:19.489347] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-10T18:55:19.703961] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-10T18:55:20.264771] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-10T18:55:20.289355] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-10T18:55:20.862860] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-10T18:55:21.089395] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-10T18:55:21.889361] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-10T18:55:22.238046] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T18:55:22.689367] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-10T18:55:22.852387] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T18:55:23.404005] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-10T18:55:23.489358] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-10T18:55:24.289386] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-10T18:55:24.741121] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-10T18:55:25.089403] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-10T18:55:25.413844] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-10T18:55:25.889389] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-10T18:55:26.597725] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-10T18:55:26.617854] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-10T18:55:26.689378] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-10T18:55:27.489413] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-10T18:55:28.289420] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-10T18:55:28.464283] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T18:55:28.562829] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-10T18:55:28.914541] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-10T18:55:29.089339] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-10T18:55:29.889405] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-10T18:55:30.359052] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-10T18:55:30.689393] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-10T18:55:31.436185] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-10T18:55:31.489348] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-10T18:55:31.828968] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-10T18:55:32.289447] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-10T18:55:32.631615] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-10T18:55:32.970032] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-10T18:55:33.089422] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-10T18:55:33.889399] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-10T18:55:34.231427] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T18:55:34.273780] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-10T18:55:34.689390] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-10T18:55:35.489412] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-10T18:55:35.939679] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-10T18:55:36.155699] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-10T18:55:36.289404] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-10T18:55:37.030212] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-10T18:55:37.089330] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-10T18:55:37.728697] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-10T18:55:37.889381] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-10T18:55:38.689363] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-10T18:55:39.078902] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T18:55:39.489375] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-10T18:55:40.289386] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-10T18:55:40.331941] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T18:55:40.654348] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-10T18:55:40.920376] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-10T18:55:40.921263] [INFO ] [REMOTE ] FGN: Full fetch complete (5654 records). [2025-10-10T18:55:40.921353] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-10T18:55:41.101421] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-10T18:55:41.285945] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-10T18:55:41.286072] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-10T18:55:41.286290] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-10T18:55:41.286368] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-10T18:55:41.287239] [DEBUG] [LOCAL ] FGN: Trimmed 5654 records to 3821 (keeping 200 days of data) [2025-10-10T18:55:41.310471] [DEBUG] [LOCAL ] FGN: Primary data saved (3821 records). [2025-10-10T18:55:41.310577] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-10T18:55:41.310679] [INFO ] [MAIN ] Update Progress: 826/2373 symbols completed. FGN took 26.9s. Estimated remaining: 3h 36m 33s. Rate: 7.1 symbols/min [2025-10-10T18:55:41.486308] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:55:41.486521] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-10T18:55:41.486561] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-10T18:55:41.486725] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-10T18:55:41.486774] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-10T18:55:41.486817] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-10T18:55:41.486851] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-10T18:55:41.852335] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:55:41.889375] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-10T18:55:42.359209] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-10T18:55:42.689404] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-10T18:55:43.444370] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T18:55:43.489389] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-10T18:55:43.898014] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-10T18:55:43.901288] [INFO ] [REMOTE ] FG: Full fetch complete (28229 records). [2025-10-10T18:55:43.901564] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-10T18:55:44.294715] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-10T18:55:44.348574] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-10T18:55:44.348727] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-10T18:55:44.349444] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-10T18:55:44.349493] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-10T18:55:44.351331] [DEBUG] [LOCAL ] FG: Trimmed 28229 records to 23056 (keeping 200 days of data) [2025-10-10T18:55:44.507398] [DEBUG] [LOCAL ] FG: Primary data saved (23056 records). [2025-10-10T18:55:44.507593] [INFO ] [MAIN ] FG: Full history saved. [2025-10-10T18:55:44.507786] [INFO ] [MAIN ] Update Progress: 827/2373 symbols completed. FG took 32.6s. Estimated remaining: 3h 36m 15s. Rate: 7.1 symbols/min [2025-10-10T18:55:44.693319] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:55:44.738030] [DEBUG] [LOCAL ] FHI: Loaded 40145 existing records from primary storage. [2025-10-10T18:55:44.738420] [INFO ] [MAIN ] FHI: Loaded 40145 existing records. [2025-10-10T18:55:44.937349] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:55:44.938386] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-10T18:55:44.938499] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-10T18:55:44.939618] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-10T18:55:44.939754] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-10T18:55:45.111826] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-10T18:55:45.119012] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T18:55:45.356999] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:55:45.411055] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T18:55:45.411521] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-10T18:55:45.411616] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:55:45.411703] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-10T18:55:45.411774] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:55:45.411872] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-10T18:55:45.411980] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-10T18:55:45.412058] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-10T18:55:45.412147] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-10T18:55:45.412237] [INFO ] [MAIN ] Update Progress: 828/2373 symbols completed. FGSN took 4.1s. Estimated remaining: 3h 35m 52s. Rate: 7.2 symbols/min [2025-10-10T18:55:45.594775] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:55:45.596166] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T18:55:45.651922] [DEBUG] [LOCAL ] FHN: Loaded 53763 existing records from primary storage. [2025-10-10T18:55:45.652266] [INFO ] [MAIN ] FHN: Loaded 53763 existing records. [2025-10-10T18:55:45.824422] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:55:45.824732] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-10T18:55:45.824792] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-10T18:55:45.826250] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-10T18:55:45.826311] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-10T18:55:45.894588] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-10T18:55:46.178964] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:55:46.689403] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-10T18:55:47.146580] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T18:55:47.489464] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-10T18:55:48.156394] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-10T18:55:48.161751] [INFO ] [REMOTE ] FFWM: Full fetch complete (51772 records). [2025-10-10T18:55:48.161970] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-10T18:55:48.296374] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-10T18:55:48.360469] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T18:55:48.458303] [INFO ] [REMOTE ] FFC: Full fetch complete (24652 records). [2025-10-10T18:55:48.474170] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-10T18:55:48.750144] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-10T18:55:48.750498] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-10T18:55:48.752485] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-10T18:55:48.752567] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-10T18:55:48.858725] [DEBUG] [LOCAL ] FFWM: Trimmed 51772 records to 36288 (keeping 200 days of data) [2025-10-10T18:55:49.081823] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-10T18:55:49.085924] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-10T18:55:49.087111] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-10T18:55:49.087245] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-10T18:55:49.122036] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-10T18:55:49.130225] [DEBUG] [LOCAL ] FFC: Trimmed 24652 records to 17022 (keeping 200 days of data) [2025-10-10T18:55:49.261781] [DEBUG] [LOCAL ] FFWM: Primary data saved (36288 records). [2025-10-10T18:55:49.262594] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-10T18:55:49.263702] [INFO ] [MAIN ] Update Progress: 829/2373 symbols completed. FFWM took 38.6s. Estimated remaining: 3h 35m 35s. Rate: 7.2 symbols/min [2025-10-10T18:55:49.483569] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:55:49.489072] [DEBUG] [LOCAL ] FFC: Primary data saved (17022 records). [2025-10-10T18:55:49.489312] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-10T18:55:49.489501] [INFO ] [MAIN ] Update Progress: 830/2373 symbols completed. FFC took 41.0s. Estimated remaining: 3h 35m 12s. Rate: 7.2 symbols/min [2025-10-10T18:55:49.675403] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:55:49.721783] [DEBUG] [LOCAL ] FI: Loaded 53923 existing records from primary storage. [2025-10-10T18:55:49.722170] [INFO ] [MAIN ] FI: Loaded 53923 existing records. [2025-10-10T18:55:49.797837] [DEBUG] [LOCAL ] FICO: Loaded 21632 existing records from primary storage. [2025-10-10T18:55:49.837298] [INFO ] [MAIN ] FICO: Loaded 21632 existing records. [2025-10-10T18:55:50.045182] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:55:50.057111] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-10T18:55:50.092319] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-10T18:55:50.111504] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-10T18:55:50.133456] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-10T18:55:50.133204] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:55:50.156316] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-10T18:55:50.220416] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-10T18:55:50.261772] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-10T18:55:50.268236] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-10T18:55:50.275362] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T18:55:50.316306] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-10T18:55:50.891368] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:55:50.901278] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-10T18:55:50.980451] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:55:51.151246] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-10T18:55:51.489382] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-10T18:55:52.018465] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-10T18:55:52.289456] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-10T18:55:53.073380] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T18:55:53.089346] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-10T18:55:53.348612] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T18:55:53.455957] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-10T18:55:53.889423] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-10T18:55:54.689438] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-10T18:55:54.743165] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T18:55:55.489361] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-10T18:55:55.642556] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T18:55:55.821847] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T18:55:56.289397] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-10T18:55:56.906874] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T18:55:57.089472] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-10T18:55:57.591095] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T18:55:57.889414] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-10T18:55:58.689355] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-10T18:55:58.827769] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T18:55:58.900500] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-10T18:55:59.489382] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-10T18:56:00.289416] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-10T18:56:00.604809] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T18:56:00.719363] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-10T18:56:01.089373] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-10T18:56:01.889355] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-10T18:56:02.067187] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-10T18:56:02.279501] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T18:56:02.689402] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-10T18:56:03.489433] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-10T18:56:03.671733] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-10T18:56:04.289398] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-10T18:56:04.750632] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-10T18:56:04.862605] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T18:56:05.089400] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-10T18:56:05.716035] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-10T18:56:05.889402] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-10T18:56:06.689461] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-10T18:56:07.035312] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T18:56:07.489401] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-10T18:56:07.785425] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-10T18:56:07.994036] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T18:56:08.289381] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-10T18:56:09.089349] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-10T18:56:09.423722] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T18:56:09.889379] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-10T18:56:09.991336] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-10T18:56:10.615751] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-10T18:56:10.689333] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-10T18:56:11.489416] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-10T18:56:11.885207] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-10T18:56:12.289390] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-10T18:56:12.762283] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-10T18:56:13.089385] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-10T18:56:13.205509] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T18:56:13.836417] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T18:56:13.889425] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-10T18:56:14.689412] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-10T18:56:14.762175] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T18:56:15.489400] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-10T18:56:16.289418] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-10T18:56:16.387049] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-10T18:56:16.673573] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T18:56:16.701081] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T18:56:17.089410] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-10T18:56:17.393586] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-10T18:56:17.889358] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-10T18:56:18.689400] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-10T18:56:18.958772] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T18:56:18.964043] [INFO ] [REMOTE ] FHN: Full fetch complete (77294 records). [2025-10-10T18:56:18.964220] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-10T18:56:19.379573] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-10T18:56:19.379828] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-10T18:56:19.380928] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-10T18:56:19.381015] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-10T18:56:19.383916] [DEBUG] [LOCAL ] FHN: Trimmed 77294 records to 54153 (keeping 200 days of data) [2025-10-10T18:56:19.496370] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-10T18:56:19.757001] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-10T18:56:19.790523] [DEBUG] [LOCAL ] FHN: Primary data saved (54153 records). [2025-10-10T18:56:19.790724] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-10T18:56:19.790877] [INFO ] [MAIN ] Update Progress: 831/2373 symbols completed. FHN took 34.4s. Estimated remaining: 3h 35m 44s. Rate: 7.1 symbols/min [2025-10-10T18:56:19.965584] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:56:19.966025] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-10T18:56:19.966080] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-10T18:56:19.966221] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-10T18:56:19.966263] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-10T18:56:19.966303] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-10T18:56:19.966335] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-10T18:56:20.292535] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-10T18:56:20.323329] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:56:20.352469] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T18:56:20.817562] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-10T18:56:21.089358] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-10T18:56:21.476775] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-10T18:56:21.889382] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-10T18:56:22.600615] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-10T18:56:22.689349] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-10T18:56:23.501079] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-10T18:56:23.507421] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-10T18:56:23.511633] [INFO ] [REMOTE ] FICO: Full fetch complete (29522 records). [2025-10-10T18:56:23.511772] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-10T18:56:23.723776] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-10T18:56:23.826016] [INFO ] [REMOTE ] FI: Full fetch complete (77220 records). [2025-10-10T18:56:23.828986] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-10T18:56:23.933875] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-10T18:56:23.998612] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-10T18:56:24.020230] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-10T18:56:24.036802] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-10T18:56:24.049070] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-10T18:56:24.095818] [DEBUG] [LOCAL ] FICO: Trimmed 29522 records to 21793 (keeping 200 days of data) [2025-10-10T18:56:24.294694] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-10T18:56:24.500301] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-10T18:56:24.502692] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-10T18:56:24.504971] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-10T18:56:24.509986] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-10T18:56:24.522247] [DEBUG] [LOCAL ] FI: Trimmed 77220 records to 54313 (keeping 200 days of data) [2025-10-10T18:56:24.522355] [DEBUG] [LOCAL ] FICO: Primary data saved (21793 records). [2025-10-10T18:56:24.522958] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-10T18:56:24.523152] [INFO ] [MAIN ] Update Progress: 832/2373 symbols completed. FICO took 35.0s. Estimated remaining: 3h 35m 29s. Rate: 7.2 symbols/min [2025-10-10T18:56:24.803914] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:56:24.960379] [DEBUG] [LOCAL ] FIGS: Loaded 49061 existing records from primary storage. [2025-10-10T18:56:24.965262] [INFO ] [MAIN ] FIGS: Loaded 49061 existing records. [2025-10-10T18:56:25.092051] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-10T18:56:25.238329] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:56:25.240011] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-10T18:56:25.241051] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-10T18:56:25.241695] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-10T18:56:25.242113] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-10T18:56:25.657305] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:56:25.668389] [DEBUG] [LOCAL ] FI: Primary data saved (54313 records). [2025-10-10T18:56:25.668593] [INFO ] [MAIN ] FI: Full history saved. [2025-10-10T18:56:25.668724] [INFO ] [MAIN ] Update Progress: 833/2373 symbols completed. FI took 36.4s. Estimated remaining: 3h 35m 7s. Rate: 7.2 symbols/min [2025-10-10T18:56:25.858133] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:56:25.889462] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-10T18:56:25.912979] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-10T18:56:25.909714] [DEBUG] [LOCAL ] FIHL: Loaded 39903 existing records from primary storage. [2025-10-10T18:56:25.923714] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T18:56:25.923980] [INFO ] [MAIN ] FIHL: Loaded 39903 existing records. [2025-10-10T18:56:25.960103] [INFO ] [REMOTE ] FHI: Full fetch complete (57461 records). [2025-10-10T18:56:25.985001] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-10T18:56:26.338350] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:56:26.427131] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-10T18:56:26.438910] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-10T18:56:26.463245] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-10T18:56:26.465914] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-10T18:56:26.698575] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-10T18:56:26.736702] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-10T18:56:26.737836] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-10T18:56:26.739009] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-10T18:56:26.739183] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-10T18:56:26.740869] [DEBUG] [LOCAL ] FHI: Trimmed 57461 records to 40451 (keeping 200 days of data) [2025-10-10T18:56:27.078708] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:56:27.209216] [DEBUG] [LOCAL ] FHI: Primary data saved (40451 records). [2025-10-10T18:56:27.209339] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-10T18:56:27.209428] [INFO ] [MAIN ] Update Progress: 834/2373 symbols completed. FHI took 42.7s. Estimated remaining: 3h 34m 46s. Rate: 7.2 symbols/min [2025-10-10T18:56:27.283372] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-10T18:56:27.392926] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:56:27.403052] [DEBUG] [LOCAL ] FINS: Loaded 8357 existing records from primary storage. [2025-10-10T18:56:27.403319] [INFO ] [MAIN ] FINS: Loaded 8357 existing records. [2025-10-10T18:56:27.494480] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-10T18:56:27.588522] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:56:27.588962] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-10T18:56:27.589021] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-10T18:56:27.598768] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-10T18:56:27.615306] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-10T18:56:27.675552] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T18:56:27.980212] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:56:28.289434] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-10T18:56:28.671006] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-10T18:56:29.096737] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-10T18:56:29.101457] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-10T18:56:29.889366] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-10T18:56:30.689356] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-10T18:56:30.878844] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-10T18:56:30.970703] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-10T18:56:30.991064] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-10T18:56:31.489439] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-10T18:56:32.289367] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-10T18:56:32.867311] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-10T18:56:33.089396] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-10T18:56:33.538404] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T18:56:33.606309] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-10T18:56:33.889437] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-10T18:56:34.689414] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-10T18:56:34.909302] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T18:56:34.909690] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-10T18:56:34.909796] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:56:34.909919] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-10T18:56:34.910004] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:56:34.910100] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-10T18:56:34.910181] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-10T18:56:34.910219] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-10T18:56:34.910258] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-10T18:56:34.910306] [INFO ] [MAIN ] Update Progress: 835/2373 symbols completed. FIG took 15.1s. Estimated remaining: 3h 34m 37s. Rate: 7.2 symbols/min [2025-10-10T18:56:35.080430] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:56:35.123588] [DEBUG] [LOCAL ] FINV: Loaded 45581 existing records from primary storage. [2025-10-10T18:56:35.123981] [INFO ] [MAIN ] FINV: Loaded 45581 existing records. [2025-10-10T18:56:35.300855] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:56:35.301142] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-10T18:56:35.301189] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-10T18:56:35.301988] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-10T18:56:35.302047] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-10T18:56:35.495091] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-10T18:56:35.640126] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T18:56:35.711122] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:56:36.289407] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-10T18:56:36.456223] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T18:56:37.089400] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-10T18:56:37.586300] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-10T18:56:37.889348] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-10T18:56:38.055749] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T18:56:38.689361] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-10T18:56:38.759224] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T18:56:39.489385] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-10T18:56:40.289399] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-10T18:56:40.395555] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-10T18:56:40.513579] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T18:56:41.089385] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-10T18:56:41.889395] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-10T18:56:41.940842] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-10T18:56:41.991794] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T18:56:42.689433] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-10T18:56:42.979713] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-10T18:56:43.489503] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-10T18:56:44.294560] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-10T18:56:44.312040] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T18:56:45.089368] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-10T18:56:45.210995] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-10T18:56:45.213268] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T18:56:45.889423] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-10T18:56:46.613705] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-10T18:56:46.689446] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-10T18:56:46.898527] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T18:56:47.489462] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-10T18:56:48.289404] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-10T18:56:48.350004] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-10T18:56:48.447721] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T18:56:49.089451] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-10T18:56:49.889411] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-10T18:56:50.046949] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T18:56:50.689399] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-10T18:56:50.870537] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T18:56:51.331071] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-10T18:56:51.332172] [INFO ] [REMOTE ] FINS: Full fetch complete (11880 records). [2025-10-10T18:56:51.332242] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-10T18:56:51.492304] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-10T18:56:51.508529] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-10T18:56:51.726620] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-10T18:56:51.726733] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-10T18:56:51.727044] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-10T18:56:51.727083] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-10T18:56:51.727505] [DEBUG] [LOCAL ] FINS: Trimmed 11880 records to 8390 (keeping 200 days of data) [2025-10-10T18:56:51.781109] [DEBUG] [LOCAL ] FINS: Primary data saved (8390 records). [2025-10-10T18:56:51.781271] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-10T18:56:51.781363] [INFO ] [MAIN ] Update Progress: 836/2373 symbols completed. FINS took 24.6s. Estimated remaining: 3h 34m 44s. Rate: 7.2 symbols/min [2025-10-10T18:56:51.946482] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:56:51.995983] [DEBUG] [LOCAL ] FIS: Loaded 53737 existing records from primary storage. [2025-10-10T18:56:51.996314] [INFO ] [MAIN ] FIS: Loaded 53737 existing records. [2025-10-10T18:56:52.169279] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:56:52.169511] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-10T18:56:52.169566] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-10T18:56:52.169837] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-10T18:56:52.169893] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-10T18:56:52.294508] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-10T18:56:52.521074] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:56:53.089355] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-10T18:56:53.279347] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T18:56:53.883846] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-10T18:56:53.892182] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-10T18:56:54.689349] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-10T18:56:55.062821] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T18:56:55.489343] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-10T18:56:55.731105] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-10T18:56:56.199434] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-10T18:56:56.289349] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-10T18:56:57.089411] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-10T18:56:57.434960] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-10T18:56:57.595824] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-10T18:56:57.889381] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-10T18:56:58.484832] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-10T18:56:58.689380] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-10T18:56:59.489354] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-10T18:56:59.682312] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-10T18:57:00.289363] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-10T18:57:00.583499] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T18:57:00.731141] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T18:57:01.089374] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-10T18:57:01.889370] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-10T18:57:02.124993] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-10T18:57:02.129950] [INFO ] [REMOTE ] FIGS: Full fetch complete (70799 records). [2025-10-10T18:57:02.130092] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-10T18:57:02.536395] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T18:57:02.577864] [INFO ] [REMOTE ] FIHL: Full fetch complete (56127 records). [2025-10-10T18:57:02.599148] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-10T18:57:02.603002] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-10T18:57:02.603122] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-10T18:57:02.604316] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-10T18:57:02.604769] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-10T18:57:02.693716] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-10T18:57:02.721939] [DEBUG] [LOCAL ] FIGS: Trimmed 70799 records to 49411 (keeping 200 days of data) [2025-10-10T18:57:03.117223] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-10T18:57:03.117745] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-10T18:57:03.119596] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-10T18:57:03.119703] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-10T18:57:03.126568] [DEBUG] [LOCAL ] FIHL: Trimmed 56127 records to 40181 (keeping 200 days of data) [2025-10-10T18:57:03.537814] [DEBUG] [LOCAL ] FIGS: Primary data saved (49411 records). [2025-10-10T18:57:03.540330] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-10T18:57:03.545757] [INFO ] [MAIN ] Update Progress: 837/2373 symbols completed. FIGS took 39.0s. Estimated remaining: 3h 34m 42s. Rate: 7.2 symbols/min [2025-10-10T18:57:03.593595] [DEBUG] [LOCAL ] FIHL: Primary data saved (40181 records). [2025-10-10T18:57:03.594985] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T18:57:03.594247] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-10T18:57:03.602906] [INFO ] [MAIN ] Update Progress: 838/2373 symbols completed. FIHL took 37.9s. Estimated remaining: 3h 34m 18s. Rate: 7.2 symbols/min [2025-10-10T18:57:03.603832] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-10T18:57:04.473388] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T18:57:04.488299] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-10T18:57:05.276482] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T18:57:05.285363] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-10T18:57:06.361215] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T18:57:06.373055] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-10T18:57:07.243978] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T18:57:07.254868] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-10T18:57:08.449442] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-10T18:57:08.462360] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-10T18:57:09.264736] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T18:57:09.276972] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-10T18:57:10.470233] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-10T18:57:10.481969] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-10T18:57:11.098742] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T18:57:11.110481] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-10T18:57:12.520120] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-10T18:57:12.532874] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-10T18:57:13.074439] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-10T18:57:13.081544] [INFO ] [REMOTE ] FINV: Full fetch complete (64140 records). [2025-10-10T18:57:13.081781] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-10T18:57:13.488306] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-10T18:57:13.488416] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-10T18:57:13.489535] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-10T18:57:13.489606] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-10T18:57:13.491835] [DEBUG] [LOCAL ] FINV: Trimmed 64140 records to 45966 (keeping 200 days of data) [2025-10-10T18:57:13.770375] [DEBUG] [LOCAL ] FINV: Primary data saved (45966 records). [2025-10-10T18:57:13.770608] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-10T18:57:13.770787] [INFO ] [MAIN ] Update Progress: 839/2373 symbols completed. FINV took 38.9s. Estimated remaining: 3h 34m 13s. Rate: 7.2 symbols/min [2025-10-10T18:57:14.556018] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-10T18:57:14.569640] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-10T18:57:16.138266] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T18:57:16.150084] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-10T18:57:18.052197] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T18:57:18.057430] [INFO ] [REMOTE ] FIS: Full fetch complete (77175 records). [2025-10-10T18:57:18.057603] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-10T18:57:18.462224] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-10T18:57:18.462329] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-10T18:57:18.463478] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-10T18:57:18.463590] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-10T18:57:18.465915] [DEBUG] [LOCAL ] FIS: Trimmed 77175 records to 54124 (keeping 200 days of data) [2025-10-10T18:57:18.821296] [DEBUG] [LOCAL ] FIS: Primary data saved (54124 records). [2025-10-10T18:57:18.821507] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-10T18:57:18.821862] [INFO ] [MAIN ] Update Progress: 840/2373 symbols completed. FIS took 27.0s. Estimated remaining: 3h 33m 58s. Rate: 7.2 symbols/min [2025-10-10T18:57:19.534762] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:57:19.541050] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:57:19.563119] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:57:19.583861] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:57:19.585508] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-10T18:57:19.586036] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-10T18:57:19.586177] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-10T18:57:19.586222] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-10T18:57:19.586264] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-10T18:57:19.586297] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-10T18:57:19.698686] [DEBUG] [LOCAL ] FLC: Loaded 5406 existing records from primary storage. [2025-10-10T18:57:19.703405] [INFO ] [MAIN ] FLC: Loaded 5406 existing records. [2025-10-10T18:57:20.012359] [DEBUG] [LOCAL ] FIX: Loaded 29455 existing records from primary storage. [2025-10-10T18:57:20.053062] [DEBUG] [LOCAL ] FLG: Loaded 53704 existing records from primary storage. [2025-10-10T18:57:20.085191] [INFO ] [MAIN ] FLG: Loaded 53704 existing records. [2025-10-10T18:57:20.074302] [INFO ] [MAIN ] FIX: Loaded 29455 existing records. [2025-10-10T18:57:20.274728] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:57:20.310830] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-10T18:57:20.321500] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-10T18:57:20.432344] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-10T18:57:20.462255] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:57:20.491845] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-10T18:57:20.467936] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-10T18:57:20.750789] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:57:20.795905] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:57:20.806616] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-10T18:57:20.823614] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-10T18:57:20.819991] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-10T18:57:20.823999] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-10T18:57:20.824170] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-10T18:57:20.824557] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-10T18:57:20.830142] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-10T18:57:20.830021] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-10T18:57:20.899548] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T18:57:20.975966] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-10T18:57:21.128399] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:57:21.176506] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-10T18:57:21.231551] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:57:21.264277] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-10T18:57:21.416694] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-10T18:57:21.467396] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-10T18:57:21.501892] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-10T18:57:21.507323] [INFO ] [MAIN ] Update Progress: 841/2373 symbols completed. FIXT took 2.7s. Estimated remaining: 3h 33m 40s. Rate: 7.2 symbols/min [2025-10-10T18:57:21.624465] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:57:21.749842] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-10T18:57:22.029396] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:57:22.039703] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:57:22.045430] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-10T18:57:22.050975] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-10T18:57:22.117751] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:57:22.155586] [DEBUG] [LOCAL ] FLNG: Loaded 33806 existing records from primary storage. [2025-10-10T18:57:22.155995] [INFO ] [MAIN ] FLNG: Loaded 33806 existing records. [2025-10-10T18:57:22.342740] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:57:22.343096] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-10T18:57:22.343150] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-10T18:57:22.343611] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-10T18:57:22.343712] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-10T18:57:22.735787] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-10T18:57:22.735484] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:57:22.738145] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-10T18:57:22.738497] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-10T18:57:23.463997] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-10T18:57:23.465945] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-10T18:57:23.527030] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T18:57:23.532587] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-10T18:57:23.917694] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T18:57:23.928556] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-10T18:57:24.198006] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-10T18:57:24.199594] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-10T18:57:24.450341] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T18:57:24.458091] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-10T18:57:24.611794] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-10T18:57:24.613789] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-10T18:57:25.262968] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-10T18:57:25.265310] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-10T18:57:25.296785] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-10T18:57:25.308205] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-10T18:57:25.847174] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-10T18:57:25.858102] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-10T18:57:25.905513] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-10T18:57:25.913194] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-10T18:57:26.063238] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-10T18:57:26.065054] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-10T18:57:26.454797] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-10T18:57:26.689393] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-10T18:57:27.107112] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T18:57:27.489336] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-10T18:57:27.603144] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-10T18:57:27.626499] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T18:57:27.758415] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T18:57:28.289380] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-10T18:57:29.089356] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-10T18:57:29.169983] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-10T18:57:29.355713] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T18:57:29.889380] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-10T18:57:30.689425] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-10T18:57:31.201015] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-10T18:57:31.489374] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-10T18:57:31.705545] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T18:57:32.289354] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-10T18:57:32.415523] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T18:57:32.967928] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-10T18:57:33.089385] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-10T18:57:33.572406] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-10T18:57:33.779038] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T18:57:33.780075] [INFO ] [REMOTE ] FLC: Full fetch complete (7833 records). [2025-10-10T18:57:33.780145] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-10T18:57:33.894563] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-10T18:57:34.150578] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-10T18:57:34.150698] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-10T18:57:34.150995] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-10T18:57:34.151037] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-10T18:57:34.151446] [DEBUG] [LOCAL ] FLC: Trimmed 7833 records to 5479 (keeping 200 days of data) [2025-10-10T18:57:34.184502] [DEBUG] [LOCAL ] FLC: Primary data saved (5479 records). [2025-10-10T18:57:34.184618] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-10T18:57:34.184728] [INFO ] [MAIN ] Update Progress: 842/2373 symbols completed. FLC took 15.4s. Estimated remaining: 3h 33m 39s. Rate: 7.2 symbols/min [2025-10-10T18:57:34.350753] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:57:34.403701] [DEBUG] [LOCAL ] FLO: Loaded 52335 existing records from primary storage. [2025-10-10T18:57:34.404065] [INFO ] [MAIN ] FLO: Loaded 52335 existing records. [2025-10-10T18:57:34.577687] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:57:34.577979] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-10T18:57:34.578034] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-10T18:57:34.578449] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-10T18:57:34.578520] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-10T18:57:34.694550] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-10T18:57:34.933406] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:57:35.489365] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-10T18:57:35.630598] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T18:57:36.289425] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-10T18:57:36.311788] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-10T18:57:37.039127] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-10T18:57:37.089329] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-10T18:57:37.665291] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T18:57:37.889430] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-10T18:57:38.689378] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-10T18:57:38.799107] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-10T18:57:39.489365] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-10T18:57:39.723539] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T18:57:40.289394] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-10T18:57:40.366503] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T18:57:40.419504] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-10T18:57:41.089424] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-10T18:57:41.889357] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-10T18:57:42.110015] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-10T18:57:42.689358] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-10T18:57:42.968569] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-10T18:57:43.484479] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T18:57:43.491005] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-10T18:57:43.718350] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-10T18:57:44.289465] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-10T18:57:45.089372] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-10T18:57:45.395980] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T18:57:45.507311] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T18:57:45.889395] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-10T18:57:46.689405] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-10T18:57:47.145456] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-10T18:57:47.226273] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-10T18:57:47.489444] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-10T18:57:48.289451] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-10T18:57:48.691012] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T18:57:49.097615] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-10T18:57:49.101788] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-10T18:57:49.336957] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T18:57:49.341189] [INFO ] [REMOTE ] FIX: Full fetch complete (45226 records). [2025-10-10T18:57:49.341331] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-10T18:57:49.734435] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-10T18:57:49.734543] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-10T18:57:49.735368] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-10T18:57:49.735435] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-10T18:57:49.736593] [DEBUG] [LOCAL ] FIX: Trimmed 45226 records to 29642 (keeping 200 days of data) [2025-10-10T18:57:49.897541] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-10T18:57:49.930455] [DEBUG] [LOCAL ] FIX: Primary data saved (29642 records). [2025-10-10T18:57:49.931148] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-10T18:57:49.931261] [INFO ] [MAIN ] Update Progress: 843/2373 symbols completed. FIX took 31.1s. Estimated remaining: 3h 33m 44s. Rate: 7.2 symbols/min [2025-10-10T18:57:50.095461] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:57:50.095761] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-10T18:57:50.095811] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-10T18:57:50.095925] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-10T18:57:50.095966] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-10T18:57:50.096007] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-10T18:57:50.096040] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-10T18:57:50.448275] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:57:50.689395] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-10T18:57:50.901416] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T18:57:50.901828] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-10T18:57:50.901919] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T18:57:50.901964] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-10T18:57:50.902027] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T18:57:50.902100] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-10T18:57:50.902165] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-10T18:57:50.902201] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-10T18:57:50.902239] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-10T18:57:50.902287] [INFO ] [MAIN ] Update Progress: 844/2373 symbols completed. FLOC took 1.0s. Estimated remaining: 3h 33m 22s. Rate: 7.2 symbols/min [2025-10-10T18:57:51.090383] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:57:51.123984] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T18:57:51.178322] [DEBUG] [LOCAL ] FLR: Loaded 53555 existing records from primary storage. [2025-10-10T18:57:51.178714] [INFO ] [MAIN ] FLR: Loaded 53555 existing records. [2025-10-10T18:57:51.357958] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:57:51.358424] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-10T18:57:51.358485] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-10T18:57:51.358770] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-10T18:57:51.358827] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-10T18:57:51.507114] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-10T18:57:51.699560] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T18:57:51.763285] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:57:52.289427] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-10T18:57:53.089425] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-10T18:57:53.343407] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T18:57:53.889408] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-10T18:57:54.069176] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T18:57:54.073080] [INFO ] [REMOTE ] FLNG: Full fetch complete (50260 records). [2025-10-10T18:57:54.073324] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-10T18:57:54.483264] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-10T18:57:54.538579] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-10T18:57:54.538882] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-10T18:57:54.539788] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-10T18:57:54.539944] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-10T18:57:54.541764] [DEBUG] [LOCAL ] FLNG: Trimmed 50260 records to 34064 (keeping 200 days of data) [2025-10-10T18:57:54.698631] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-10T18:57:54.750431] [DEBUG] [LOCAL ] FLNG: Primary data saved (34064 records). [2025-10-10T18:57:54.750606] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-10T18:57:54.750741] [INFO ] [MAIN ] Update Progress: 845/2373 symbols completed. FLNG took 33.2s. Estimated remaining: 3h 33m 6s. Rate: 7.2 symbols/min [2025-10-10T18:57:54.919967] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:57:54.970295] [DEBUG] [LOCAL ] FLS: Loaded 50642 existing records from primary storage. [2025-10-10T18:57:54.970679] [INFO ] [MAIN ] FLS: Loaded 50642 existing records. [2025-10-10T18:57:55.154251] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:57:55.154633] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-10T18:57:55.154724] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-10T18:57:55.154999] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-10T18:57:55.155039] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-10T18:57:55.490408] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-10T18:57:55.517042] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:57:55.717501] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T18:57:56.203961] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-10T18:57:56.289340] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-10T18:57:57.089423] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-10T18:57:57.133515] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-10T18:57:57.138693] [INFO ] [REMOTE ] FLG: Full fetch complete (77282 records). [2025-10-10T18:57:57.138817] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-10T18:57:57.522235] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-10T18:57:57.522326] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-10T18:57:57.523337] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-10T18:57:57.523404] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-10T18:57:57.525001] [DEBUG] [LOCAL ] FLG: Trimmed 77282 records to 54092 (keeping 200 days of data) [2025-10-10T18:57:57.870064] [DEBUG] [LOCAL ] FLG: Primary data saved (54092 records). [2025-10-10T18:57:57.870222] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-10T18:57:57.870743] [INFO ] [MAIN ] Update Progress: 846/2373 symbols completed. FLG took 39.0s. Estimated remaining: 3h 32m 48s. Rate: 7.2 symbols/min [2025-10-10T18:57:57.894441] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-10T18:57:58.047588] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:57:58.077528] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T18:57:58.130733] [DEBUG] [LOCAL ] FLUT: Loaded 51157 existing records from primary storage. [2025-10-10T18:57:58.131050] [INFO ] [MAIN ] FLUT: Loaded 51157 existing records. [2025-10-10T18:57:58.302899] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:57:58.303192] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-10T18:57:58.303238] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-10T18:57:58.303581] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-10T18:57:58.303703] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-10T18:57:58.646923] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:57:58.689329] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-10T18:57:59.041795] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T18:57:59.489334] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-10T18:57:59.953940] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-10T18:58:00.289414] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-10T18:58:00.597535] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-10T18:58:01.089368] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-10T18:58:01.742982] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-10T18:58:01.889446] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-10T18:58:02.060192] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T18:58:02.451136] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T18:58:02.689375] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-10T18:58:03.489440] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-10T18:58:04.190195] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-10T18:58:04.289352] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-10T18:58:04.679399] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T18:58:05.089431] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-10T18:58:05.284040] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T18:58:05.889371] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-10T18:58:06.073850] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T18:58:06.689378] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-10T18:58:06.985748] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T18:58:07.489347] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-10T18:58:07.799253] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-10T18:58:08.289354] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-10T18:58:08.621682] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T18:58:09.089357] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-10T18:58:09.422704] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-10T18:58:09.889375] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-10T18:58:10.228537] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T18:58:10.689423] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-10T18:58:10.984389] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T18:58:10.989989] [INFO ] [REMOTE ] FLO: Full fetch complete (75073 records). [2025-10-10T18:58:10.990192] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-10T18:58:11.390376] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-10T18:58:11.390466] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-10T18:58:11.391464] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-10T18:58:11.391529] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-10T18:58:11.395994] [DEBUG] [LOCAL ] FLO: Trimmed 75073 records to 52720 (keeping 200 days of data) [2025-10-10T18:58:11.491479] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-10T18:58:11.727675] [DEBUG] [LOCAL ] FLO: Primary data saved (52720 records). [2025-10-10T18:58:11.727839] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-10T18:58:11.737145] [INFO ] [MAIN ] Update Progress: 847/2373 symbols completed. FLO took 37.6s. Estimated remaining: 3h 32m 50s. Rate: 7.2 symbols/min [2025-10-10T18:58:11.831012] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T18:58:11.939666] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:58:11.962797] [DEBUG] [LOCAL ] FLXR: Loaded 20932 existing records from primary storage. [2025-10-10T18:58:11.963120] [INFO ] [MAIN ] FLXR: Loaded 20932 existing records. [2025-10-10T18:58:12.146819] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:58:12.147292] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-10T18:58:12.147417] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-10T18:58:12.147901] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-10T18:58:12.147967] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-10T18:58:12.255902] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-10T18:58:12.301336] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-10T18:58:12.572188] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:58:13.089394] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-10T18:58:13.598773] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-10T18:58:13.889379] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-10T18:58:14.315994] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T18:58:14.509538] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-10T18:58:14.689366] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-10T18:58:15.489365] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-10T18:58:15.568961] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-10T18:58:15.811990] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-10T18:58:16.289376] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-10T18:58:17.034098] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-10T18:58:17.089389] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-10T18:58:17.643048] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-10T18:58:17.889374] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-10T18:58:18.689387] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-10T18:58:18.950468] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T18:58:19.360472] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-10T18:58:19.489390] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-10T18:58:19.614212] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-10T18:58:20.289403] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-10T18:58:21.089420] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-10T18:58:21.512054] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-10T18:58:21.889391] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-10T18:58:22.497140] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-10T18:58:22.689387] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-10T18:58:22.987238] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T18:58:23.489343] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-10T18:58:23.648530] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T18:58:23.860112] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T18:58:24.289471] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-10T18:58:25.089391] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-10T18:58:25.292834] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-10T18:58:25.298588] [INFO ] [REMOTE ] FLS: Full fetch complete (71903 records). [2025-10-10T18:58:25.298785] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-10T18:58:25.489555] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-10T18:58:25.710741] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-10T18:58:25.710850] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-10T18:58:25.711838] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-10T18:58:25.711909] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-10T18:58:25.713737] [DEBUG] [LOCAL ] FLS: Trimmed 71903 records to 51020 (keeping 200 days of data) [2025-10-10T18:58:25.895758] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-10T18:58:26.041044] [DEBUG] [LOCAL ] FLS: Primary data saved (51020 records). [2025-10-10T18:58:26.041222] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-10T18:58:26.041317] [INFO ] [MAIN ] Update Progress: 848/2373 symbols completed. FLS took 31.3s. Estimated remaining: 3h 32m 52s. Rate: 7.2 symbols/min [2025-10-10T18:58:26.218243] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:58:26.271730] [DEBUG] [LOCAL ] FMC: Loaded 52191 existing records from primary storage. [2025-10-10T18:58:26.272111] [INFO ] [MAIN ] FMC: Loaded 52191 existing records. [2025-10-10T18:58:26.476605] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:58:26.476893] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-10T18:58:26.476943] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-10T18:58:26.477302] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-10T18:58:26.477358] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-10T18:58:26.700637] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-10T18:58:26.853322] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:58:26.926533] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T18:58:27.141473] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T18:58:27.489393] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-10T18:58:28.289368] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-10T18:58:28.703600] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-10T18:58:28.708849] [INFO ] [REMOTE ] FLUT: Full fetch complete (73038 records). [2025-10-10T18:58:28.709014] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-10T18:58:29.103502] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-10T18:58:29.104064] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-10T18:58:29.105199] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-10T18:58:29.106443] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-10T18:58:29.106727] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-10T18:58:29.139497] [DEBUG] [LOCAL ] FLUT: Trimmed 73038 records to 51543 (keeping 200 days of data) [2025-10-10T18:58:29.139347] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-10T18:58:29.484988] [DEBUG] [LOCAL ] FLUT: Primary data saved (51543 records). [2025-10-10T18:58:29.485184] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-10T18:58:29.485472] [INFO ] [MAIN ] Update Progress: 849/2373 symbols completed. FLUT took 31.6s. Estimated remaining: 3h 32m 35s. Rate: 7.2 symbols/min [2025-10-10T18:58:29.518391] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-10T18:58:29.660589] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:58:29.669915] [DEBUG] [LOCAL ] FMN: Loaded 5363 existing records from primary storage. [2025-10-10T18:58:29.670171] [INFO ] [MAIN ] FMN: Loaded 5363 existing records. [2025-10-10T18:58:29.894723] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-10T18:58:29.897692] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:58:29.899153] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-10T18:58:29.899239] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-10T18:58:29.899463] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-10T18:58:29.899539] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-10T18:58:30.379197] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:58:30.689379] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-10T18:58:31.192979] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-10T18:58:31.454247] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-10T18:58:31.489333] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-10T18:58:31.903815] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-10T18:58:32.289352] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-10T18:58:33.089338] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-10T18:58:33.427765] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-10T18:58:33.432911] [INFO ] [REMOTE ] FLR: Full fetch complete (76494 records). [2025-10-10T18:58:33.433048] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-10T18:58:33.564730] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T18:58:33.831487] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-10T18:58:33.831595] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-10T18:58:33.832796] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-10T18:58:33.832864] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-10T18:58:33.834402] [DEBUG] [LOCAL ] FLR: Trimmed 76494 records to 53945 (keeping 200 days of data) [2025-10-10T18:58:33.891576] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-10T18:58:34.148397] [DEBUG] [LOCAL ] FLR: Primary data saved (53945 records). [2025-10-10T18:58:34.148598] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-10T18:58:34.148717] [INFO ] [MAIN ] Update Progress: 850/2373 symbols completed. FLR took 43.2s. Estimated remaining: 3h 32m 20s. Rate: 7.2 symbols/min [2025-10-10T18:58:34.312747] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:58:34.342407] [DEBUG] [LOCAL ] FMS: Loaded 30246 existing records from primary storage. [2025-10-10T18:58:34.342725] [INFO ] [MAIN ] FMS: Loaded 30246 existing records. [2025-10-10T18:58:34.514914] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:58:34.515155] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-10T18:58:34.515202] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-10T18:58:34.515427] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-10T18:58:34.515482] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-10T18:58:34.690495] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-10T18:58:34.877866] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:58:34.994922] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-10T18:58:35.209334] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T18:58:35.489364] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-10T18:58:35.606794] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-10T18:58:36.289349] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-10T18:58:37.089409] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-10T18:58:37.172339] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-10T18:58:37.492560] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T18:58:37.889340] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-10T18:58:38.330426] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-10T18:58:38.689408] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-10T18:58:39.311115] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T18:58:39.489385] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-10T18:58:40.289483] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-10T18:58:40.647280] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T18:58:40.827865] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T18:58:41.089384] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-10T18:58:41.691885] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-10T18:58:41.889484] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-10T18:58:42.689382] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-10T18:58:43.044183] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T18:58:43.319816] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T18:58:43.322590] [INFO ] [REMOTE ] FLXR: Full fetch complete (26447 records). [2025-10-10T18:58:43.322690] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-10T18:58:43.494032] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-10T18:58:43.684761] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-10T18:58:43.692141] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-10T18:58:43.691423] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-10T18:58:43.695242] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-10T18:58:43.695878] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-10T18:58:43.696527] [DEBUG] [LOCAL ] FLXR: Trimmed 26447 records to 21118 (keeping 200 days of data) [2025-10-10T18:58:43.821316] [DEBUG] [LOCAL ] FLXR: Primary data saved (21118 records). [2025-10-10T18:58:43.821457] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-10T18:58:43.821533] [INFO ] [MAIN ] Update Progress: 851/2373 symbols completed. FLXR took 32.1s. Estimated remaining: 3h 32m 14s. Rate: 7.2 symbols/min [2025-10-10T18:58:44.020730] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:58:44.065384] [DEBUG] [LOCAL ] FMX: Loaded 40806 existing records from primary storage. [2025-10-10T18:58:44.065772] [INFO ] [MAIN ] FMX: Loaded 40806 existing records. [2025-10-10T18:58:44.239247] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:58:44.239498] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-10T18:58:44.239547] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-10T18:58:44.239809] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-10T18:58:44.239867] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-10T18:58:44.300592] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-10T18:58:44.585857] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:58:45.089353] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-10T18:58:45.471340] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-10T18:58:45.597090] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T18:58:45.605136] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-10T18:58:45.889377] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-10T18:58:46.689434] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-10T18:58:47.429299] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-10T18:58:47.489371] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-10T18:58:48.225299] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-10T18:58:48.227579] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-10T18:58:48.289387] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-10T18:58:49.089359] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-10T18:58:49.789153] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-10T18:58:49.889333] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-10T18:58:50.221387] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T18:58:50.689387] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-10T18:58:51.394683] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-10T18:58:51.460493] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-10T18:58:51.489347] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-10T18:58:52.289373] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-10T18:58:53.075129] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-10T18:58:53.089352] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-10T18:58:53.889375] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-10T18:58:53.920097] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T18:58:54.603166] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-10T18:58:54.603330] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-10T18:58:54.689367] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-10T18:58:55.489371] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-10T18:58:56.281333] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T18:58:56.289333] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-10T18:58:56.871302] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-10T18:58:57.089416] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-10T18:58:57.889342] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-10T18:58:58.190418] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T18:58:58.218037] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-10T18:58:58.295919] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-10T18:58:58.689373] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-10T18:58:59.489397] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-10T18:59:00.159234] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-10T18:59:00.289374] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-10T18:59:01.089355] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-10T18:59:01.443576] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-10T18:59:01.451067] [INFO ] [REMOTE ] FMC: Full fetch complete (75142 records). [2025-10-10T18:59:01.451317] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-10T18:59:01.775479] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-10T18:59:01.823395] [INFO ] [REMOTE ] FMS: Full fetch complete (42383 records). [2025-10-10T18:59:01.843783] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-10T18:59:01.863359] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-10T18:59:01.863522] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-10T18:59:01.864720] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-10T18:59:01.870352] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-10T18:59:01.900664] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-10T18:59:01.981269] [DEBUG] [LOCAL ] FMC: Trimmed 75142 records to 52580 (keeping 200 days of data) [2025-10-10T18:59:02.530206] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-10T18:59:02.534790] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-10T18:59:02.557337] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-10T18:59:02.569306] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-10T18:59:02.675036] [DEBUG] [LOCAL ] FMS: Trimmed 42383 records to 30508 (keeping 200 days of data) [2025-10-10T18:59:02.674769] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T18:59:02.691364] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-10T18:59:02.701506] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-10T18:59:02.711606] [INFO ] [REMOTE ] FMN: Full fetch complete (10021 records). [2025-10-10T18:59:02.711854] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-10T18:59:02.763636] [DEBUG] [LOCAL ] FMC: Primary data saved (52580 records). [2025-10-10T18:59:02.771540] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-10T18:59:02.796825] [INFO ] [MAIN ] Update Progress: 852/2373 symbols completed. FMC took 36.8s. Estimated remaining: 3h 32m 24s. Rate: 7.2 symbols/min [2025-10-10T18:59:03.283787] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:59:03.403844] [DEBUG] [LOCAL ] FMY: Loaded 1393 existing records from primary storage. [2025-10-10T18:59:03.408889] [INFO ] [MAIN ] FMY: Loaded 1393 existing records. [2025-10-10T18:59:03.416462] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-10T18:59:03.456736] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-10T18:59:03.483575] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-10T18:59:03.518704] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-10T18:59:03.562924] [DEBUG] [LOCAL ] FMN: Trimmed 10021 records to 5439 (keeping 200 days of data) [2025-10-10T18:59:03.643886] [DEBUG] [LOCAL ] FMN: Primary data saved (5439 records). [2025-10-10T18:59:03.652070] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-10T18:59:03.654059] [INFO ] [MAIN ] Update Progress: 853/2373 symbols completed. FMN took 34.2s. Estimated remaining: 3h 32m 2s. Rate: 7.2 symbols/min [2025-10-10T18:59:03.746726] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:59:03.768623] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-10T18:59:03.768922] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-10T18:59:03.768798] [DEBUG] [LOCAL ] FMS: Primary data saved (30508 records). [2025-10-10T18:59:03.803245] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-10T18:59:03.797967] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-10T18:59:03.803455] [INFO ] [MAIN ] Update Progress: 854/2373 symbols completed. FMS took 29.7s. Estimated remaining: 3h 31m 39s. Rate: 7.2 symbols/min [2025-10-10T18:59:03.815224] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-10T18:59:04.134171] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:59:04.261150] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:59:04.479473] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:59:04.503602] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-10T18:59:04.503355] [DEBUG] [LOCAL ] FN: Loaded 38337 existing records from primary storage. [2025-10-10T18:59:04.504713] [INFO ] [MAIN ] FN: Loaded 38337 existing records. [2025-10-10T18:59:04.628297] [DEBUG] [LOCAL ] FNB: Loaded 52919 existing records from primary storage. [2025-10-10T18:59:04.662383] [INFO ] [MAIN ] FNB: Loaded 52919 existing records. [2025-10-10T18:59:04.746892] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:59:04.783226] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-10T18:59:04.808134] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-10T18:59:04.820880] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-10T18:59:04.836810] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-10T18:59:04.968617] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:59:04.980622] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-10T18:59:04.993956] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-10T18:59:05.012479] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-10T18:59:04.983408] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-10T18:59:05.023336] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-10T18:59:05.023389] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-10T18:59:05.051515] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-10T18:59:05.095483] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-10T18:59:05.585683] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-10T18:59:05.657889] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:59:05.732225] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:59:05.889417] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-10T18:59:06.689411] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-10T18:59:07.085885] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T18:59:07.489374] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-10T18:59:07.913946] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T18:59:08.018623] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T18:59:08.289385] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-10T18:59:08.734828] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-10T18:59:09.089384] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-10T18:59:09.889404] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-10T18:59:10.411709] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-10T18:59:10.609703] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T18:59:10.689342] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-10T18:59:10.977454] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-10T18:59:11.489378] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-10T18:59:12.021883] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-10T18:59:12.101151] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-10T18:59:12.289369] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-10T18:59:13.089434] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-10T18:59:13.889366] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-10T18:59:14.093704] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T18:59:14.447849] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-10T18:59:14.689347] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-10T18:59:15.089901] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-10T18:59:15.489402] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-10T18:59:16.289359] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-10T18:59:16.418469] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T18:59:16.806487] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-10T18:59:17.089372] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-10T18:59:17.427077] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T18:59:17.889386] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-10T18:59:18.689413] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-10T18:59:18.976364] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T18:59:19.489344] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-10T18:59:19.666328] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T18:59:20.289412] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-10T18:59:20.734061] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-10T18:59:20.767760] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-10T18:59:21.089376] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-10T18:59:21.288890] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T18:59:21.557116] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-10T18:59:21.889413] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-10T18:59:22.689365] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-10T18:59:23.269518] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-10T18:59:23.489397] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-10T18:59:23.587319] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T18:59:24.022983] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-10T18:59:24.289365] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-10T18:59:25.089400] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-10T18:59:25.889357] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-10T18:59:26.146561] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T18:59:26.424868] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-10T18:59:26.669871] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T18:59:26.689351] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-10T18:59:27.489389] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-10T18:59:28.289506] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-10T18:59:28.289437] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-10T18:59:29.089383] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-10T18:59:29.109219] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-10T18:59:29.113431] [INFO ] [REMOTE ] FMX: Full fetch complete (57480 records). [2025-10-10T18:59:29.113582] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-10T18:59:29.502549] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-10T18:59:29.502680] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-10T18:59:29.503626] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-10T18:59:29.503713] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-10T18:59:29.505090] [DEBUG] [LOCAL ] FMX: Trimmed 57480 records to 41027 (keeping 200 days of data) [2025-10-10T18:59:29.757843] [DEBUG] [LOCAL ] FMX: Primary data saved (41027 records). [2025-10-10T18:59:29.757984] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-10T18:59:29.758070] [INFO ] [MAIN ] Update Progress: 855/2373 symbols completed. FMX took 45.9s. Estimated remaining: 3h 32m 2s. Rate: 7.2 symbols/min [2025-10-10T18:59:29.901759] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-10T18:59:29.937264] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:59:29.992276] [DEBUG] [LOCAL ] FND: Loaded 52495 existing records from primary storage. [2025-10-10T18:59:29.992708] [INFO ] [MAIN ] FND: Loaded 52495 existing records. [2025-10-10T18:59:30.215328] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:59:30.215745] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-10T18:59:30.216666] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-10T18:59:30.218138] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-10T18:59:30.218061] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T18:59:30.228530] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-10T18:59:30.363541] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-10T18:59:30.395763] [INFO ] [REMOTE ] FMY: Full fetch complete (1972 records). [2025-10-10T18:59:30.396628] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-10T18:59:30.707020] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-10T18:59:30.840742] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:59:30.978243] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-10T18:59:30.978351] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-10T18:59:30.978472] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-10T18:59:30.978542] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-10T18:59:30.979058] [DEBUG] [LOCAL ] FMY: Trimmed 1972 records to 1408 (keeping 200 days of data) [2025-10-10T18:59:31.010399] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T18:59:31.021494] [DEBUG] [LOCAL ] FMY: Primary data saved (1408 records). [2025-10-10T18:59:31.021841] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-10T18:59:31.022051] [INFO ] [MAIN ] Update Progress: 856/2373 symbols completed. FMY took 28.2s. Estimated remaining: 3h 31m 41s. Rate: 7.2 symbols/min [2025-10-10T18:59:31.184948] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:59:31.230475] [DEBUG] [LOCAL ] FNF: Loaded 49306 existing records from primary storage. [2025-10-10T18:59:31.230827] [INFO ] [MAIN ] FNF: Loaded 49306 existing records. [2025-10-10T18:59:31.403251] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:59:31.403494] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-10T18:59:31.403559] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-10T18:59:31.403782] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-10T18:59:31.403839] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-10T18:59:31.499210] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-10T18:59:31.749599] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:59:32.289415] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-10T18:59:32.943082] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-10T18:59:33.089470] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-10T18:59:33.253605] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T18:59:33.522675] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-10T18:59:33.889378] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-10T18:59:34.689402] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-10T18:59:34.992440] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T18:59:35.397099] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-10T18:59:35.402255] [INFO ] [REMOTE ] FN: Full fetch complete (55992 records). [2025-10-10T18:59:35.402519] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-10T18:59:35.494561] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-10T18:59:35.809700] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-10T18:59:35.809822] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-10T18:59:35.810745] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-10T18:59:35.810811] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-10T18:59:35.812463] [DEBUG] [LOCAL ] FN: Trimmed 55992 records to 38595 (keeping 200 days of data) [2025-10-10T18:59:36.054219] [DEBUG] [LOCAL ] FN: Primary data saved (38595 records). [2025-10-10T18:59:36.054411] [INFO ] [MAIN ] FN: Full history saved. [2025-10-10T18:59:36.054517] [INFO ] [MAIN ] Update Progress: 857/2373 symbols completed. FN took 32.4s. Estimated remaining: 3h 31m 27s. Rate: 7.2 symbols/min [2025-10-10T18:59:36.243341] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:59:36.293971] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-10T18:59:36.296061] [DEBUG] [LOCAL ] FNV: Loaded 46540 existing records from primary storage. [2025-10-10T18:59:36.296362] [INFO ] [MAIN ] FNV: Loaded 46540 existing records. [2025-10-10T18:59:36.494824] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T18:59:36.495285] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-10T18:59:36.495420] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-10T18:59:36.495836] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-10T18:59:36.495959] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-10T18:59:36.706427] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T18:59:36.928594] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:59:37.089415] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-10T18:59:37.459602] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T18:59:37.889365] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-10T18:59:38.043680] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T18:59:38.373066] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T18:59:38.689371] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-10T18:59:39.493815] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-10T18:59:39.500152] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-10T18:59:39.511986] [INFO ] [REMOTE ] FNB: Full fetch complete (75891 records). [2025-10-10T18:59:39.512232] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-10T18:59:39.979479] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-10T18:59:39.979591] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-10T18:59:39.980981] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-10T18:59:39.981054] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-10T18:59:39.983022] [DEBUG] [LOCAL ] FNB: Trimmed 75891 records to 53309 (keeping 200 days of data) [2025-10-10T18:59:40.290870] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-10T18:59:40.346013] [DEBUG] [LOCAL ] FNB: Primary data saved (53309 records). [2025-10-10T18:59:40.346300] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-10T18:59:40.346442] [INFO ] [MAIN ] Update Progress: 858/2373 symbols completed. FNB took 36.5s. Estimated remaining: 3h 31m 11s. Rate: 7.2 symbols/min [2025-10-10T18:59:40.528427] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T18:59:40.528883] [DEBUG] [LOCAL ] FOA: No existing data file found in primary storage. [2025-10-10T18:59:40.528941] [WARN ] [MAIN ] FOA: No existing data found, performing full refresh instead. [2025-10-10T18:59:40.552920] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-10T18:59:40.553355] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-10T18:59:40.553913] [DEBUG] [LOCAL ] FOA: No primary data file found to delete. [2025-10-10T18:59:40.555181] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-10T18:59:40.555082] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-10T18:59:40.931204] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T18:59:41.089349] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-10T18:59:41.265800] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T18:59:41.889375] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-10T18:59:42.111416] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T18:59:42.309710] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T18:59:42.689401] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-10T18:59:43.489425] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-10T18:59:43.592992] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-10T18:59:44.289366] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-10T18:59:44.741960] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T18:59:44.765798] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T18:59:45.089385] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-10T18:59:45.707361] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T18:59:45.889389] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-10T18:59:46.689377] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-10T18:59:46.943178] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T18:59:47.310292] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-10T18:59:47.489350] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-10T18:59:48.289347] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-10T18:59:48.634017] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T18:59:49.089376] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-10T18:59:49.400061] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T18:59:49.567515] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-10T18:59:49.889393] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-10T18:59:50.689350] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-10T18:59:51.064682] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T18:59:51.251620] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T18:59:51.489382] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-10T18:59:52.289359] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-10T18:59:52.535514] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T18:59:52.687554] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-10T18:59:53.089427] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-10T18:59:53.889352] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-10T18:59:54.133738] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T18:59:54.689360] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-10T18:59:54.919818] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T18:59:55.043457] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T18:59:55.489362] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-10T18:59:56.289403] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-10T18:59:56.578481] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T18:59:56.739220] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-10T18:59:57.089373] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-10T18:59:57.232099] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T18:59:57.889388] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-10T18:59:58.689366] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-10T18:59:59.013613] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-10T18:59:59.489355] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-10T18:59:59.897423] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-10T19:00:00.022017] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T19:00:00.289363] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-10T19:00:01.089415] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-10T19:00:01.515547] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-10T19:00:01.889355] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-10T19:00:02.421512] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-10T19:00:02.689374] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-10T19:00:02.768808] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T19:00:03.489396] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-10T19:00:03.768082] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-10T19:00:04.289405] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-10T19:00:04.426291] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-10T19:00:04.708722] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-10T19:00:05.089367] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-10T19:00:05.889426] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-10T19:00:06.068841] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T19:00:06.219262] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T19:00:06.689408] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-10T19:00:07.335118] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T19:00:07.339982] [INFO ] [REMOTE ] FNV: Full fetch complete (66557 records). [2025-10-10T19:00:07.340162] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-10T19:00:07.518553] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-10T19:00:07.756606] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-10T19:00:07.756745] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-10T19:00:07.757792] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-10T19:00:07.757900] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-10T19:00:07.759416] [DEBUG] [LOCAL ] FNV: Trimmed 66557 records to 46876 (keeping 200 days of data) [2025-10-10T19:00:08.061204] [DEBUG] [LOCAL ] FNV: Primary data saved (46876 records). [2025-10-10T19:00:08.061394] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-10T19:00:08.061544] [INFO ] [MAIN ] Update Progress: 859/2373 symbols completed. FNV took 32.0s. Estimated remaining: 3h 31m 37s. Rate: 7.2 symbols/min [2025-10-10T19:00:08.237537] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:00:08.249556] [DEBUG] [LOCAL ] FOF: Loaded 8601 existing records from primary storage. [2025-10-10T19:00:08.249882] [INFO ] [MAIN ] FOF: Loaded 8601 existing records. [2025-10-10T19:00:08.293704] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-10T19:00:08.424413] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-10T19:00:08.440709] [INFO ] [REMOTE ] FND: Full fetch complete (74748 records). [2025-10-10T19:00:08.441755] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-10T19:00:08.473914] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:00:08.556364] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-10T19:00:08.576071] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-10T19:00:08.579035] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-10T19:00:08.589718] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-10T19:00:09.080566] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T19:00:09.137749] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-10T19:00:09.246151] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-10T19:00:09.255112] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-10T19:00:09.259223] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-10T19:00:09.259397] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-10T19:00:09.339861] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:00:09.340111] [DEBUG] [LOCAL ] FND: Trimmed 74748 records to 52882 (keeping 200 days of data) [2025-10-10T19:00:09.672546] [DEBUG] [LOCAL ] FND: Primary data saved (52882 records). [2025-10-10T19:00:09.672750] [INFO ] [MAIN ] FND: Full history saved. [2025-10-10T19:00:09.672863] [INFO ] [MAIN ] Update Progress: 860/2373 symbols completed. FND took 39.9s. Estimated remaining: 3h 31m 17s. Rate: 7.2 symbols/min [2025-10-10T19:00:09.848726] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:00:09.871478] [DEBUG] [LOCAL ] FOR: Loaded 19850 existing records from primary storage. [2025-10-10T19:00:09.871844] [INFO ] [MAIN ] FOR: Loaded 19850 existing records. [2025-10-10T19:00:09.906417] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-10T19:00:10.067333] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:00:10.067700] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-10T19:00:10.067760] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-10T19:00:10.067947] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-10T19:00:10.067987] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-10T19:00:10.213994] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-10T19:00:10.291991] [INFO ] [REMOTE ] FNF: Full fetch complete (69699 records). [2025-10-10T19:00:10.325207] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-10T19:00:10.382544] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T19:00:10.620590] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:00:10.696713] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-10T19:00:10.923561] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-10T19:00:10.924388] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-10T19:00:10.925980] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-10T19:00:10.924742] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T19:00:10.929059] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-10T19:00:10.930878] [DEBUG] [LOCAL ] FNF: Trimmed 69699 records to 49668 (keeping 200 days of data) [2025-10-10T19:00:11.246156] [DEBUG] [LOCAL ] FNF: Primary data saved (49668 records). [2025-10-10T19:00:11.246317] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-10T19:00:11.246402] [INFO ] [MAIN ] Update Progress: 861/2373 symbols completed. FNF took 40.2s. Estimated remaining: 3h 30m 57s. Rate: 7.2 symbols/min [2025-10-10T19:00:11.412790] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:00:11.461974] [DEBUG] [LOCAL ] FOUR: Loaded 49959 existing records from primary storage. [2025-10-10T19:00:11.462311] [INFO ] [MAIN ] FOUR: Loaded 49959 existing records. [2025-10-10T19:00:11.493356] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-10T19:00:11.642866] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:00:11.643157] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-10T19:00:11.643207] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-10T19:00:11.643805] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-10T19:00:11.643864] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-10T19:00:11.987631] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T19:00:12.036251] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:00:12.289397] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-10T19:00:12.458759] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T19:00:13.089361] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-10T19:00:13.292620] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T19:00:13.294763] [INFO ] [REMOTE ] FOA: Full fetch complete (22015 records). [2025-10-10T19:00:13.294894] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-10T19:00:13.688926] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-10T19:00:13.689038] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-10T19:00:13.690072] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-10T19:00:13.690146] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-10T19:00:13.691197] [DEBUG] [LOCAL ] FOA: Trimmed 22015 records to 13275 (keeping 200 days of data) [2025-10-10T19:00:13.767729] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-10T19:00:13.792066] [DEBUG] [LOCAL ] FOA: Primary data saved (13275 records). [2025-10-10T19:00:13.792279] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-10T19:00:13.792383] [INFO ] [MAIN ] Update Progress: 862/2373 symbols completed. FOA took 33.4s. Estimated remaining: 3h 30m 38s. Rate: 7.2 symbols/min [2025-10-10T19:00:13.894609] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-10T19:00:13.976060] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:00:14.003715] [DEBUG] [LOCAL ] FPF: Loaded 18750 existing records from primary storage. [2025-10-10T19:00:14.004056] [INFO ] [MAIN ] FPF: Loaded 18750 existing records. [2025-10-10T19:00:14.187502] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:00:14.187810] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-10T19:00:14.187864] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-10T19:00:14.188104] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-10T19:00:14.188161] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-10T19:00:14.567598] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:00:14.689460] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-10T19:00:15.489417] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-10T19:00:16.020228] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T19:00:16.269855] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-10T19:00:16.289339] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-10T19:00:16.323996] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-10T19:00:17.089390] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-10T19:00:17.889443] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-10T19:00:18.485401] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-10T19:00:18.589109] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-10T19:00:18.689337] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-10T19:00:18.841131] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-10T19:00:19.489408] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-10T19:00:19.948864] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T19:00:20.289405] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-10T19:00:21.089408] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-10T19:00:21.373741] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T19:00:21.589331] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T19:00:21.889440] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-10T19:00:22.021782] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T19:00:22.545860] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-10T19:00:22.689413] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-10T19:00:23.489415] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-10T19:00:23.818324] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-10T19:00:24.289396] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-10T19:00:25.023489] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T19:00:25.089517] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-10T19:00:25.519989] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T19:00:25.889381] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-10T19:00:26.689398] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-10T19:00:26.990860] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-10T19:00:27.059937] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T19:00:27.489407] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-10T19:00:27.570380] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-10T19:00:28.289403] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-10T19:00:28.445951] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T19:00:29.089380] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-10T19:00:29.889387] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-10T19:00:30.199907] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T19:00:30.270078] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T19:00:30.689353] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-10T19:00:31.118919] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T19:00:31.489386] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-10T19:00:32.289403] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-10T19:00:32.547011] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-10T19:00:32.684928] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T19:00:33.089404] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-10T19:00:33.526608] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T19:00:33.806504] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-10T19:00:33.889386] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-10T19:00:34.689450] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-10T19:00:35.077203] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-10T19:00:35.244329] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-10T19:00:35.489439] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-10T19:00:36.289401] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-10T19:00:36.710951] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T19:00:37.089385] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-10T19:00:37.889448] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-10T19:00:37.989390] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-10T19:00:38.303743] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-10T19:00:38.561438] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-10T19:00:38.689402] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-10T19:00:39.489416] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-10T19:00:39.604328] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T19:00:40.289421] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-10T19:00:40.468344] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T19:00:40.471047] [INFO ] [REMOTE ] FPF: Full fetch complete (26697 records). [2025-10-10T19:00:40.471116] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-10T19:00:40.837850] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-10T19:00:40.837945] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-10T19:00:40.838597] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-10T19:00:40.838638] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-10T19:00:40.839446] [DEBUG] [LOCAL ] FPF: Trimmed 26697 records to 18898 (keeping 200 days of data) [2025-10-10T19:00:40.955551] [DEBUG] [LOCAL ] FPF: Primary data saved (18898 records). [2025-10-10T19:00:40.955758] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-10T19:00:40.955851] [INFO ] [MAIN ] Update Progress: 863/2373 symbols completed. FPF took 27.2s. Estimated remaining: 3h 31m 3s. Rate: 7.2 symbols/min [2025-10-10T19:00:41.100331] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-10T19:00:41.125381] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:00:41.145310] [DEBUG] [LOCAL ] FPH: Loaded 19427 existing records from primary storage. [2025-10-10T19:00:41.145573] [INFO ] [MAIN ] FPH: Loaded 19427 existing records. [2025-10-10T19:00:41.323879] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:00:41.324162] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-10T19:00:41.324215] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-10T19:00:41.324411] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-10T19:00:41.324467] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-10T19:00:41.434105] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T19:00:41.479965] [INFO ] [REMOTE ] FOR: Full fetch complete (29761 records). [2025-10-10T19:00:41.489296] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-10T19:00:41.875812] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:00:41.896674] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-10T19:00:42.110101] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-10T19:00:42.110257] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-10T19:00:42.111065] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-10T19:00:42.111180] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-10T19:00:42.119100] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-10T19:00:42.122432] [DEBUG] [LOCAL ] FOR: Trimmed 29761 records to 19970 (keeping 200 days of data) [2025-10-10T19:00:42.247907] [DEBUG] [LOCAL ] FOR: Primary data saved (19970 records). [2025-10-10T19:00:42.248089] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-10T19:00:42.248184] [INFO ] [MAIN ] Update Progress: 864/2373 symbols completed. FOR took 32.6s. Estimated remaining: 3h 30m 42s. Rate: 7.2 symbols/min [2025-10-10T19:00:42.453293] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:00:42.488836] [DEBUG] [LOCAL ] FPI: Loaded 31242 existing records from primary storage. [2025-10-10T19:00:42.489165] [INFO ] [MAIN ] FPI: Loaded 31242 existing records. [2025-10-10T19:00:42.702375] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-10T19:00:42.708545] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:00:42.709980] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-10T19:00:42.710056] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-10T19:00:42.710334] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-10T19:00:42.710393] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-10T19:00:43.068930] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-10T19:00:43.133051] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:00:43.489390] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-10T19:00:43.944482] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-10T19:00:43.945997] [INFO ] [REMOTE ] FOF: Full fetch complete (11895 records). [2025-10-10T19:00:43.946071] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-10T19:00:44.299611] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-10T19:00:44.308725] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-10T19:00:44.308805] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-10T19:00:44.309896] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-10T19:00:44.309960] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-10T19:00:44.310454] [DEBUG] [LOCAL ] FOF: Trimmed 11895 records to 8672 (keeping 200 days of data) [2025-10-10T19:00:44.363703] [DEBUG] [LOCAL ] FOF: Primary data saved (8672 records). [2025-10-10T19:00:44.363853] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-10T19:00:44.363952] [INFO ] [MAIN ] Update Progress: 865/2373 symbols completed. FOF took 36.3s. Estimated remaining: 3h 30m 22s. Rate: 7.2 symbols/min [2025-10-10T19:00:44.533715] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:00:44.576106] [DEBUG] [LOCAL ] FR: Loaded 46701 existing records from primary storage. [2025-10-10T19:00:44.576432] [INFO ] [MAIN ] FR: Loaded 46701 existing records. [2025-10-10T19:00:44.751627] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:00:44.751907] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-10T19:00:44.751956] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-10T19:00:44.752582] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-10T19:00:44.752639] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-10T19:00:45.108133] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:00:45.102688] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-10T19:00:45.347680] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T19:00:45.867988] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-10T19:00:45.889328] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-10T19:00:46.008326] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-10T19:00:46.689361] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-10T19:00:47.210263] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T19:00:47.489396] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-10T19:00:48.073369] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T19:00:48.289396] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-10T19:00:49.089403] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-10T19:00:49.576852] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-10T19:00:49.628029] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T19:00:49.889369] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-10T19:00:50.502998] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T19:00:50.689353] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-10T19:00:51.405962] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-10T19:00:51.489332] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-10T19:00:51.873598] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-10T19:00:52.289364] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-10T19:00:53.089345] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-10T19:00:53.138841] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T19:00:53.580509] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T19:00:53.889361] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-10T19:00:54.524788] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-10T19:00:54.689372] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-10T19:00:55.489343] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-10T19:00:55.869252] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T19:00:56.289363] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-10T19:00:56.599722] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-10T19:00:57.073531] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-10T19:00:57.089352] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-10T19:00:57.547706] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-10T19:00:57.889377] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-10T19:00:58.585257] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-10T19:00:58.604516] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-10T19:00:58.689379] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-10T19:00:59.489400] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-10T19:00:59.787949] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-10T19:01:00.289385] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-10T19:01:01.089430] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-10T19:01:01.593088] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T19:01:01.889478] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-10T19:01:02.407439] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-10T19:01:02.412500] [INFO ] [REMOTE ] FOUR: Full fetch complete (72024 records). [2025-10-10T19:01:02.412694] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-10T19:01:02.616971] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-10T19:01:02.690688] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-10T19:01:02.861437] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-10T19:01:02.861540] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-10T19:01:02.862567] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-10T19:01:02.862632] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-10T19:01:02.864706] [DEBUG] [LOCAL ] FOUR: Trimmed 72024 records to 50337 (keeping 200 days of data) [2025-10-10T19:01:03.188016] [DEBUG] [LOCAL ] FOUR: Primary data saved (50337 records). [2025-10-10T19:01:03.188193] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-10T19:01:03.188287] [INFO ] [MAIN ] Update Progress: 866/2373 symbols completed. FOUR took 51.9s. Estimated remaining: 3h 30m 32s. Rate: 7.2 symbols/min [2025-10-10T19:01:03.356816] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:01:03.373868] [DEBUG] [LOCAL ] FRA: Loaded 14632 existing records from primary storage. [2025-10-10T19:01:03.374137] [INFO ] [MAIN ] FRA: Loaded 14632 existing records. [2025-10-10T19:01:03.492078] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-10T19:01:03.557621] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:01:03.558012] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-10T19:01:03.558118] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-10T19:01:03.558560] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-10T19:01:03.558630] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-10T19:01:03.801173] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T19:01:03.972896] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:01:04.289431] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-10T19:01:04.396957] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-10T19:01:04.423502] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T19:01:05.089377] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-10T19:01:05.255921] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-10T19:01:05.852945] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-10T19:01:05.889384] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-10T19:01:06.689378] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-10T19:01:07.215825] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T19:01:07.489346] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-10T19:01:07.722089] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-10T19:01:08.289394] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-10T19:01:08.677508] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-10T19:01:08.679791] [INFO ] [REMOTE ] FPH: Full fetch complete (31223 records). [2025-10-10T19:01:08.679866] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-10T19:01:09.047589] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-10T19:01:09.047711] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-10T19:01:09.048564] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-10T19:01:09.048630] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-10T19:01:09.049399] [DEBUG] [LOCAL ] FPH: Trimmed 31223 records to 19617 (keeping 200 days of data) [2025-10-10T19:01:09.090531] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-10T19:01:09.159400] [DEBUG] [LOCAL ] FPH: Primary data saved (19617 records). [2025-10-10T19:01:09.159579] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-10T19:01:09.159694] [INFO ] [MAIN ] Update Progress: 867/2373 symbols completed. FPH took 28.2s. Estimated remaining: 3h 30m 20s. Rate: 7.2 symbols/min [2025-10-10T19:01:09.327033] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:01:09.346261] [DEBUG] [LOCAL ] FRGE: Loaded 16985 existing records from primary storage. [2025-10-10T19:01:09.346565] [INFO ] [MAIN ] FRGE: Loaded 16985 existing records. [2025-10-10T19:01:09.533977] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:01:09.534335] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-10T19:01:09.534411] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-10T19:01:09.534628] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-10T19:01:09.534724] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-10T19:01:09.902756] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-10T19:01:09.908097] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:01:10.170616] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T19:01:10.249764] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T19:01:10.689410] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-10T19:01:11.358816] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T19:01:11.462541] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-10T19:01:11.489405] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-10T19:01:12.289418] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-10T19:01:13.089389] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-10T19:01:13.395903] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T19:01:13.626998] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T19:01:13.630814] [INFO ] [REMOTE ] FPI: Full fetch complete (43957 records). [2025-10-10T19:01:13.631111] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-10T19:01:13.897417] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-10T19:01:14.030497] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-10T19:01:14.030603] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-10T19:01:14.031697] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-10T19:01:14.031767] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-10T19:01:14.033155] [DEBUG] [LOCAL ] FPI: Trimmed 43957 records to 31503 (keeping 200 days of data) [2025-10-10T19:01:14.257274] [DEBUG] [LOCAL ] FPI: Primary data saved (31503 records). [2025-10-10T19:01:14.257495] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-10T19:01:14.257630] [INFO ] [MAIN ] Update Progress: 868/2373 symbols completed. FPI took 32.0s. Estimated remaining: 3h 30m 6s. Rate: 7.2 symbols/min [2025-10-10T19:01:14.472899] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:01:14.532752] [DEBUG] [LOCAL ] FRO: Loaded 52062 existing records from primary storage. [2025-10-10T19:01:14.533178] [INFO ] [MAIN ] FRO: Loaded 52062 existing records. [2025-10-10T19:01:14.695391] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-10T19:01:14.737473] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:01:14.738910] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-10T19:01:14.738990] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-10T19:01:14.739386] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-10T19:01:14.739595] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-10T19:01:14.950471] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T19:01:15.147707] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:01:15.489446] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-10T19:01:15.528915] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-10T19:01:16.003193] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T19:01:16.289399] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-10T19:01:17.076379] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-10T19:01:17.089340] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-10T19:01:17.692369] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-10T19:01:17.889416] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-10T19:01:18.284609] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-10T19:01:18.689409] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-10T19:01:19.489425] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-10T19:01:19.775840] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-10T19:01:20.067869] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-10T19:01:20.289388] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-10T19:01:20.810501] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T19:01:21.089372] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-10T19:01:21.889428] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-10T19:01:22.368251] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-10T19:01:22.602290] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-10T19:01:22.689357] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-10T19:01:22.850962] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-10T19:01:23.489382] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-10T19:01:24.289409] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-10T19:01:24.364425] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T19:01:24.691144] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T19:01:25.089459] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-10T19:01:25.889427] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-10T19:01:26.492162] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-10T19:01:26.689422] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-10T19:01:26.735492] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-10T19:01:26.740370] [INFO ] [REMOTE ] FR: Full fetch complete (66655 records). [2025-10-10T19:01:26.740546] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-10T19:01:26.920051] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-10T19:01:27.133234] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-10T19:01:27.133334] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-10T19:01:27.134261] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-10T19:01:27.134331] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-10T19:01:27.135936] [DEBUG] [LOCAL ] FR: Trimmed 66655 records to 47016 (keeping 200 days of data) [2025-10-10T19:01:27.423766] [DEBUG] [LOCAL ] FR: Primary data saved (47016 records). [2025-10-10T19:01:27.423918] [INFO ] [MAIN ] FR: Full history saved. [2025-10-10T19:01:27.424001] [INFO ] [MAIN ] Update Progress: 869/2373 symbols completed. FR took 43.1s. Estimated remaining: 3h 30m 6s. Rate: 7.2 symbols/min [2025-10-10T19:01:27.497638] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-10T19:01:27.593569] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:01:27.633063] [DEBUG] [LOCAL ] FRT: Loaded 42147 existing records from primary storage. [2025-10-10T19:01:27.633386] [INFO ] [MAIN ] FRT: Loaded 42147 existing records. [2025-10-10T19:01:27.805871] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:01:27.806141] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-10T19:01:27.806190] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-10T19:01:27.806449] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-10T19:01:27.806508] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-10T19:01:28.158957] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:01:28.289371] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-10T19:01:28.671801] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T19:01:28.983829] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-10T19:01:29.089432] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-10T19:01:29.877878] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T19:01:29.889336] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-10T19:01:30.378573] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T19:01:30.689393] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-10T19:01:31.489395] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-10T19:01:31.647066] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-10T19:01:31.670091] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T19:01:32.289420] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-10T19:01:32.433979] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T19:01:32.436115] [INFO ] [REMOTE ] FRA: Full fetch complete (23822 records). [2025-10-10T19:01:32.436216] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-10T19:01:32.993999] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-10T19:01:32.994144] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-10T19:01:32.995165] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-10T19:01:32.995252] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-10T19:01:32.996433] [DEBUG] [LOCAL ] FRA: Trimmed 23822 records to 14769 (keeping 200 days of data) [2025-10-10T19:01:33.090000] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-10T19:01:33.093221] [DEBUG] [LOCAL ] FRA: Primary data saved (14769 records). [2025-10-10T19:01:33.094604] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-10T19:01:33.094747] [INFO ] [MAIN ] Update Progress: 870/2373 symbols completed. FRA took 29.9s. Estimated remaining: 3h 29m 52s. Rate: 7.2 symbols/min [2025-10-10T19:01:33.287241] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:01:33.333705] [DEBUG] [LOCAL ] FSCO: Loaded 38325 existing records from primary storage. [2025-10-10T19:01:33.334030] [INFO ] [MAIN ] FSCO: Loaded 38325 existing records. [2025-10-10T19:01:33.546502] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:01:33.546800] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-10T19:01:33.546854] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-10T19:01:33.547086] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-10T19:01:33.547143] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-10T19:01:33.894105] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-10T19:01:33.964534] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:01:34.052132] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T19:01:34.689377] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-10T19:01:35.116915] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T19:01:35.251592] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T19:01:35.489386] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-10T19:01:35.870636] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-10T19:01:36.289426] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-10T19:01:37.089450] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-10T19:01:37.405539] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T19:01:37.889480] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-10T19:01:38.303595] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-10T19:01:38.394120] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-10T19:01:38.579889] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-10T19:01:38.689365] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-10T19:01:39.489434] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-10T19:01:40.289365] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-10T19:01:40.756895] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T19:01:41.089492] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-10T19:01:41.469337] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T19:01:41.595537] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-10T19:01:41.803523] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-10T19:01:41.889355] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-10T19:01:42.689405] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-10T19:01:43.489406] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-10T19:01:43.731313] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T19:01:44.289367] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-10T19:01:44.697875] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T19:01:45.087343] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T19:01:45.090072] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-10T19:01:45.186543] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T19:01:45.188033] [INFO ] [REMOTE ] FRGE: Full fetch complete (31462 records). [2025-10-10T19:01:45.188102] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-10T19:01:45.547575] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-10T19:01:45.547692] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-10T19:01:45.548347] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-10T19:01:45.548389] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-10T19:01:45.549077] [DEBUG] [LOCAL ] FRGE: Trimmed 31462 records to 17061 (keeping 200 days of data) [2025-10-10T19:01:45.649194] [DEBUG] [LOCAL ] FRGE: Primary data saved (17061 records). [2025-10-10T19:01:45.649380] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-10T19:01:45.649519] [INFO ] [MAIN ] Update Progress: 871/2373 symbols completed. FRGE took 36.5s. Estimated remaining: 3h 29m 51s. Rate: 7.2 symbols/min [2025-10-10T19:01:45.814445] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:01:45.860259] [DEBUG] [LOCAL ] FSK: Loaded 49791 existing records from primary storage. [2025-10-10T19:01:45.860576] [INFO ] [MAIN ] FSK: Loaded 49791 existing records. [2025-10-10T19:01:45.894515] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-10T19:01:46.041762] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:01:46.041999] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-10T19:01:46.042046] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-10T19:01:46.042317] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-10T19:01:46.042374] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-10T19:01:46.422317] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:01:46.689341] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-10T19:01:47.168704] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T19:01:47.489356] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-10T19:01:47.701675] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T19:01:48.289350] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-10T19:01:48.521386] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T19:01:49.090678] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-10T19:01:49.097458] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-10T19:01:49.102702] [INFO ] [REMOTE ] FRO: Full fetch complete (75204 records). [2025-10-10T19:01:49.102842] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-10T19:01:49.491008] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-10T19:01:49.491130] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-10T19:01:49.492109] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-10T19:01:49.492176] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-10T19:01:49.494615] [DEBUG] [LOCAL ] FRO: Trimmed 75204 records to 52446 (keeping 200 days of data) [2025-10-10T19:01:49.834037] [DEBUG] [LOCAL ] FRO: Primary data saved (52446 records). [2025-10-10T19:01:49.834233] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-10T19:01:49.834373] [INFO ] [MAIN ] Update Progress: 872/2373 symbols completed. FRO took 35.6s. Estimated remaining: 3h 29m 36s. Rate: 7.2 symbols/min [2025-10-10T19:01:49.892097] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-10T19:01:50.055503] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:01:50.077524] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T19:01:50.131259] [DEBUG] [LOCAL ] FSLY: Loaded 51612 existing records from primary storage. [2025-10-10T19:01:50.131685] [INFO ] [MAIN ] FSLY: Loaded 51612 existing records. [2025-10-10T19:01:50.303296] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:01:50.303539] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-10T19:01:50.303586] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-10T19:01:50.303990] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-10T19:01:50.304047] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-10T19:01:50.670298] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:01:50.689363] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-10T19:01:50.991174] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T19:01:51.098091] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-10T19:01:51.489373] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-10T19:01:52.289403] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-10T19:01:52.456787] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T19:01:53.089392] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-10T19:01:53.661880] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T19:01:53.823246] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T19:01:53.889349] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-10T19:01:54.373610] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T19:01:54.689383] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-10T19:01:55.489717] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-10T19:01:55.500573] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-10T19:01:56.289362] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-10T19:01:56.532090] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T19:01:57.089453] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-10T19:01:57.549391] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-10T19:01:57.889366] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-10T19:01:57.960743] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-10T19:01:58.534392] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T19:01:58.689350] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-10T19:01:59.489343] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-10T19:01:59.860321] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T19:02:00.289449] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-10T19:02:00.710805] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T19:02:01.089417] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-10T19:02:01.359757] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T19:02:01.889376] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-10T19:02:02.101808] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T19:02:02.689416] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-10T19:02:03.114777] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T19:02:03.193340] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-10T19:02:03.197762] [INFO ] [REMOTE ] FSCO: Full fetch complete (54815 records). [2025-10-10T19:02:03.197870] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-10T19:02:03.495549] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-10T19:02:03.589445] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-10T19:02:03.589523] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-10T19:02:03.590303] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-10T19:02:03.590363] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-10T19:02:03.591535] [DEBUG] [LOCAL ] FSCO: Trimmed 54815 records to 38653 (keeping 200 days of data) [2025-10-10T19:02:03.814701] [DEBUG] [LOCAL ] FSCO: Primary data saved (38653 records). [2025-10-10T19:02:03.814861] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-10T19:02:03.814952] [INFO ] [MAIN ] Update Progress: 873/2373 symbols completed. FSCO took 30.7s. Estimated remaining: 3h 29m 37s. Rate: 7.2 symbols/min [2025-10-10T19:02:03.985164] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:02:04.040344] [DEBUG] [LOCAL ] FSM: Loaded 53686 existing records from primary storage. [2025-10-10T19:02:04.040777] [INFO ] [MAIN ] FSM: Loaded 53686 existing records. [2025-10-10T19:02:04.226715] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:02:04.236075] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-10T19:02:04.236236] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-10T19:02:04.237278] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-10T19:02:04.237215] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-10T19:02:04.237488] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-10T19:02:04.303488] [INFO ] [REMOTE ] FRT: Full fetch complete (60274 records). [2025-10-10T19:02:04.308952] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-10T19:02:04.303217] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-10T19:02:05.018674] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:02:05.047317] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-10T19:02:05.047413] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-10T19:02:05.048353] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-10T19:02:05.048418] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-10T19:02:05.049793] [DEBUG] [LOCAL ] FRT: Trimmed 60274 records to 42422 (keeping 200 days of data) [2025-10-10T19:02:05.103630] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-10T19:02:05.312255] [DEBUG] [LOCAL ] FRT: Primary data saved (42422 records). [2025-10-10T19:02:05.312402] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-10T19:02:05.312715] [INFO ] [MAIN ] Update Progress: 874/2373 symbols completed. FRT took 37.9s. Estimated remaining: 3h 29m 17s. Rate: 7.2 symbols/min [2025-10-10T19:02:05.516762] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:02:05.519758] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-10T19:02:05.562796] [DEBUG] [LOCAL ] FSS: Loaded 34059 existing records from primary storage. [2025-10-10T19:02:05.563105] [INFO ] [MAIN ] FSS: Loaded 34059 existing records. [2025-10-10T19:02:05.741700] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:02:05.741954] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-10T19:02:05.742004] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-10T19:02:05.742248] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-10T19:02:05.742304] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-10T19:02:05.897845] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-10T19:02:06.116663] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:02:06.340710] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T19:02:06.541719] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-10T19:02:06.689410] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-10T19:02:07.489387] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-10T19:02:07.777994] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T19:02:08.289420] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-10T19:02:08.464212] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-10T19:02:09.089520] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-10T19:02:09.481039] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-10T19:02:09.730264] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-10T19:02:09.889443] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-10T19:02:10.689477] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-10T19:02:11.045546] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T19:02:11.489444] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-10T19:02:11.936815] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-10T19:02:12.289372] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-10T19:02:12.593946] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T19:02:12.931011] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T19:02:13.089389] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-10T19:02:13.889436] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-10T19:02:14.339466] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-10T19:02:14.689426] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-10T19:02:14.946209] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T19:02:15.489400] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-10T19:02:15.930253] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T19:02:16.289409] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-10T19:02:16.341261] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-10T19:02:17.060668] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T19:02:17.089363] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-10T19:02:17.896532] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-10T19:02:17.924272] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T19:02:18.689501] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-10T19:02:19.294955] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-10T19:02:19.300427] [INFO ] [REMOTE ] FSK: Full fetch complete (71706 records). [2025-10-10T19:02:19.300607] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-10T19:02:19.495887] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-10T19:02:19.692032] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-10T19:02:19.692126] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-10T19:02:19.693303] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-10T19:02:19.693369] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-10T19:02:19.694883] [DEBUG] [LOCAL ] FSK: Trimmed 71706 records to 50179 (keeping 200 days of data) [2025-10-10T19:02:20.024720] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-10T19:02:20.048135] [DEBUG] [LOCAL ] FSK: Primary data saved (50179 records). [2025-10-10T19:02:20.048320] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-10T19:02:20.048433] [INFO ] [MAIN ] Update Progress: 875/2373 symbols completed. FSK took 34.4s. Estimated remaining: 3h 29m 19s. Rate: 7.2 symbols/min [2025-10-10T19:02:20.233127] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:02:20.267809] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-10T19:02:20.271087] [DEBUG] [LOCAL ] FT: Loaded 6755 existing records from primary storage. [2025-10-10T19:02:20.281956] [INFO ] [MAIN ] FT: Loaded 6755 existing records. [2025-10-10T19:02:20.294881] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-10T19:02:20.459627] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:02:20.459833] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-10T19:02:20.459879] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-10T19:02:20.460165] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-10T19:02:20.460221] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-10T19:02:20.809967] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:02:21.089362] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-10T19:02:21.491309] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T19:02:21.889351] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-10T19:02:22.176311] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T19:02:22.550805] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T19:02:22.689385] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-10T19:02:23.489405] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-10T19:02:23.864187] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-10T19:02:24.253136] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-10T19:02:24.258385] [INFO ] [REMOTE ] FSLY: Full fetch complete (74865 records). [2025-10-10T19:02:24.258511] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-10T19:02:24.294766] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-10T19:02:24.662008] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-10T19:02:24.662141] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-10T19:02:24.663722] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-10T19:02:24.663839] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-10T19:02:24.667682] [DEBUG] [LOCAL ] FSLY: Trimmed 74865 records to 52002 (keeping 200 days of data) [2025-10-10T19:02:25.068797] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-10T19:02:25.077727] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-10T19:02:25.090727] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-10T19:02:25.106032] [DEBUG] [LOCAL ] FSLY: Primary data saved (52002 records). [2025-10-10T19:02:25.106295] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-10T19:02:25.106519] [INFO ] [MAIN ] Update Progress: 876/2373 symbols completed. FSLY took 35.3s. Estimated remaining: 3h 29m 5s. Rate: 7.2 symbols/min [2025-10-10T19:02:25.392790] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:02:25.411119] [DEBUG] [LOCAL ] FTHY: Loaded 12386 existing records from primary storage. [2025-10-10T19:02:25.411486] [INFO ] [MAIN ] FTHY: Loaded 12386 existing records. [2025-10-10T19:02:25.649986] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:02:25.650514] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-10T19:02:25.650585] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-10T19:02:25.650856] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-10T19:02:25.650914] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-10T19:02:25.894519] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-10T19:02:25.995590] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-10T19:02:26.088370] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:02:26.689469] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-10T19:02:27.489457] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-10T19:02:27.555506] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T19:02:27.556400] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-10T19:02:28.289408] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-10T19:02:28.606937] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-10T19:02:28.994384] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-10T19:02:29.089368] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-10T19:02:29.889411] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-10T19:02:30.041588] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-10T19:02:30.689400] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-10T19:02:30.905386] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-10T19:02:31.489375] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-10T19:02:31.540366] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-10T19:02:32.289408] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-10T19:02:32.433235] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-10T19:02:33.089428] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-10T19:02:33.889446] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-10T19:02:34.014208] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-10T19:02:34.531746] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-10T19:02:34.689390] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-10T19:02:35.489490] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-10T19:02:35.912495] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T19:02:35.942380] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-10T19:02:36.219086] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-10T19:02:36.289368] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-10T19:02:37.089478] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-10T19:02:37.799176] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-10T19:02:37.889373] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-10T19:02:38.689460] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-10T19:02:38.787280] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-10T19:02:38.887096] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T19:02:38.891188] [INFO ] [REMOTE ] FSS: Full fetch complete (48427 records). [2025-10-10T19:02:38.891343] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-10T19:02:39.346396] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-10T19:02:39.346537] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-10T19:02:39.347832] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-10T19:02:39.347925] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-10T19:02:39.349251] [DEBUG] [LOCAL ] FSS: Trimmed 48427 records to 34290 (keeping 200 days of data) [2025-10-10T19:02:39.527740] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-10T19:02:39.587630] [DEBUG] [LOCAL ] FSS: Primary data saved (34290 records). [2025-10-10T19:02:39.587839] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-10T19:02:39.587930] [INFO ] [MAIN ] Update Progress: 877/2373 symbols completed. FSS took 34.3s. Estimated remaining: 3h 29m 7s. Rate: 7.2 symbols/min [2025-10-10T19:02:39.633285] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T19:02:40.289470] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-10T19:02:40.989662] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-10T19:02:41.089352] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-10T19:02:41.669146] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T19:02:41.889353] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-10T19:02:41.986493] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T19:02:42.427866] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-10T19:02:42.689371] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-10T19:02:43.489386] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-10T19:02:44.289369] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-10T19:02:44.435171] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-10T19:02:44.637527] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-10T19:02:44.643052] [INFO ] [REMOTE ] FSM: Full fetch complete (76855 records). [2025-10-10T19:02:44.643200] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-10T19:02:45.038496] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-10T19:02:45.038586] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-10T19:02:45.039563] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-10T19:02:45.039626] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-10T19:02:45.041322] [DEBUG] [LOCAL ] FSM: Trimmed 76855 records to 54076 (keeping 200 days of data) [2025-10-10T19:02:45.094902] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-10T19:02:45.252401] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-10T19:02:45.370214] [DEBUG] [LOCAL ] FSM: Primary data saved (54076 records). [2025-10-10T19:02:45.370380] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-10T19:02:45.370488] [INFO ] [MAIN ] Update Progress: 878/2373 symbols completed. FSM took 41.6s. Estimated remaining: 3h 28m 54s. Rate: 7.2 symbols/min [2025-10-10T19:02:45.889395] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-10T19:02:46.094675] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-10T19:02:46.689382] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-10T19:02:46.771052] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-10T19:02:47.489508] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-10T19:02:47.603126] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-10T19:02:48.289361] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-10T19:02:48.325184] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T19:02:48.326529] [INFO ] [REMOTE ] FT: Full fetch complete (9255 records). [2025-10-10T19:02:48.326602] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-10T19:02:48.677907] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-10T19:02:48.677992] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-10T19:02:48.678323] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-10T19:02:48.678393] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-10T19:02:48.678993] [DEBUG] [LOCAL ] FT: Trimmed 9255 records to 6823 (keeping 200 days of data) [2025-10-10T19:02:48.719042] [DEBUG] [LOCAL ] FT: Primary data saved (6823 records). [2025-10-10T19:02:48.719145] [INFO ] [MAIN ] FT: Full history saved. [2025-10-10T19:02:48.719224] [INFO ] [MAIN ] Update Progress: 879/2373 symbols completed. FT took 28.7s. Estimated remaining: 3h 28m 37s. Rate: 7.2 symbols/min [2025-10-10T19:02:49.212142] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T19:02:49.213999] [INFO ] [REMOTE ] FTHY: Full fetch complete (17547 records). [2025-10-10T19:02:49.214068] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-10T19:02:49.608243] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-10T19:02:49.608359] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-10T19:02:49.608873] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-10T19:02:49.608935] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-10T19:02:49.609453] [DEBUG] [LOCAL ] FTHY: Trimmed 17547 records to 12479 (keeping 200 days of data) [2025-10-10T19:02:49.702268] [DEBUG] [LOCAL ] FTHY: Primary data saved (12479 records). [2025-10-10T19:02:49.702434] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-10T19:02:49.702519] [INFO ] [MAIN ] Update Progress: 880/2373 symbols completed. FTHY took 24.6s. Estimated remaining: 3h 28m 17s. Rate: 7.2 symbols/min [2025-10-10T19:02:50.304475] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:02:50.307751] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:02:50.434539] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:02:50.437271] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:02:50.497785] [DEBUG] [LOCAL ] FTV: Loaded 53377 existing records from primary storage. [2025-10-10T19:02:50.512407] [DEBUG] [LOCAL ] FTK: Loaded 32796 existing records from primary storage. [2025-10-10T19:02:50.512935] [INFO ] [MAIN ] FTV: Loaded 53377 existing records. [2025-10-10T19:02:50.541912] [INFO ] [MAIN ] FTK: Loaded 32796 existing records. [2025-10-10T19:02:50.753694] [DEBUG] [LOCAL ] FTS: Loaded 42723 existing records from primary storage. [2025-10-10T19:02:50.784015] [INFO ] [MAIN ] FTS: Loaded 42723 existing records. [2025-10-10T19:02:50.747567] [DEBUG] [LOCAL ] FTI: Loaded 53681 existing records from primary storage. [2025-10-10T19:02:50.896520] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:02:50.847530] [INFO ] [MAIN ] FTI: Loaded 53681 existing records. [2025-10-10T19:02:51.031393] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-10T19:02:51.039060] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-10T19:02:51.033743] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:02:51.049945] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-10T19:02:51.058273] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-10T19:02:51.058336] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-10T19:02:51.082008] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-10T19:02:51.161722] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-10T19:02:51.190533] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-10T19:02:51.333522] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:02:51.399280] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-10T19:02:51.445838] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-10T19:02:51.497587] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-10T19:02:51.590267] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:02:51.560189] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-10T19:02:51.643388] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-10T19:02:51.680170] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-10T19:02:51.820678] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-10T19:02:51.880836] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-10T19:02:52.196490] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:02:52.234617] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-10T19:02:52.463245] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:02:52.512991] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-10T19:02:52.721780] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:02:52.732450] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-10T19:02:52.793832] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:02:52.794209] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-10T19:02:53.811324] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-10T19:02:53.816862] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-10T19:02:53.966980] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T19:02:53.977588] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-10T19:02:54.146571] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T19:02:54.157508] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-10T19:02:54.413150] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T19:02:54.689432] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-10T19:02:55.141697] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T19:02:55.489355] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-10T19:02:55.826241] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-10T19:02:55.944502] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-10T19:02:56.146410] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-10T19:02:56.289410] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-10T19:02:56.770094] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T19:02:57.089381] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-10T19:02:57.895869] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-10T19:02:57.897846] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T19:02:58.689366] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-10T19:02:58.783001] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T19:02:59.489358] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-10T19:02:59.812516] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T19:03:00.289343] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-10T19:03:00.671059] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T19:03:01.089425] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-10T19:03:01.226572] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-10T19:03:01.889357] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-10T19:03:02.262923] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T19:03:02.563332] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-10T19:03:02.689381] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-10T19:03:03.206967] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T19:03:03.489450] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-10T19:03:04.289398] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-10T19:03:04.757821] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T19:03:04.787095] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T19:03:05.089404] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-10T19:03:05.587775] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T19:03:05.889399] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-10T19:03:06.689415] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-10T19:03:07.072125] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T19:03:07.489407] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-10T19:03:07.945169] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-10T19:03:08.294517] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-10T19:03:08.308828] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-10T19:03:08.817870] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-10T19:03:09.089440] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-10T19:03:09.889419] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-10T19:03:10.348724] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T19:03:10.689398] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-10T19:03:11.064425] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-10T19:03:11.489355] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-10T19:03:11.540912] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-10T19:03:12.067051] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T19:03:12.289392] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-10T19:03:13.089398] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-10T19:03:13.452110] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T19:03:13.889437] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-10T19:03:14.359128] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T19:03:14.689398] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-10T19:03:14.848779] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-10T19:03:15.489422] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-10T19:03:15.707807] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T19:03:16.289417] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-10T19:03:16.697713] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T19:03:17.089480] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-10T19:03:17.640847] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-10T19:03:17.659596] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T19:03:17.889426] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-10T19:03:18.689348] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-10T19:03:18.753962] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T19:03:19.489413] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-10T19:03:19.593240] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-10T19:03:20.289465] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-10T19:03:20.677442] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-10T19:03:20.682811] [INFO ] [REMOTE ] FTI: Full fetch complete (77124 records). [2025-10-10T19:03:20.682979] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-10T19:03:21.077888] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-10T19:03:21.084473] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-10T19:03:21.095608] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-10T19:03:21.096632] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-10T19:03:21.098142] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-10T19:03:21.098025] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-10T19:03:21.111474] [DEBUG] [LOCAL ] FTI: Trimmed 77124 records to 54071 (keeping 200 days of data) [2025-10-10T19:03:21.493619] [DEBUG] [LOCAL ] FTI: Primary data saved (54071 records). [2025-10-10T19:03:21.493939] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-10T19:03:21.494879] [INFO ] [MAIN ] Update Progress: 881/2373 symbols completed. FTI took 31.8s. Estimated remaining: 3h 28m 48s. Rate: 7.1 symbols/min [2025-10-10T19:03:21.686035] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:03:21.690623] [DEBUG] [LOCAL ] FTWO: Loaded 1903 existing records from primary storage. [2025-10-10T19:03:21.690873] [INFO ] [MAIN ] FTWO: Loaded 1903 existing records. [2025-10-10T19:03:21.867933] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:03:21.868325] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-10T19:03:21.868512] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-10T19:03:21.868873] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-10T19:03:21.869099] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-10T19:03:21.899814] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-10T19:03:22.148283] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T19:03:22.300093] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:03:22.689406] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-10T19:03:22.812873] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-10T19:03:22.817472] [INFO ] [REMOTE ] FTS: Full fetch complete (60268 records). [2025-10-10T19:03:22.817605] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-10T19:03:23.222274] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-10T19:03:23.222379] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-10T19:03:23.223905] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-10T19:03:23.223985] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-10T19:03:23.225777] [DEBUG] [LOCAL ] FTS: Trimmed 60268 records to 43045 (keeping 200 days of data) [2025-10-10T19:03:23.462008] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-10T19:03:23.496673] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-10T19:03:23.515993] [DEBUG] [LOCAL ] FTS: Primary data saved (43045 records). [2025-10-10T19:03:23.516578] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-10T19:03:23.516736] [INFO ] [MAIN ] Update Progress: 882/2373 symbols completed. FTS took 33.8s. Estimated remaining: 3h 28m 29s. Rate: 7.2 symbols/min [2025-10-10T19:03:23.694819] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:03:23.745718] [DEBUG] [LOCAL ] FUBO: Loaded 54095 existing records from primary storage. [2025-10-10T19:03:23.746086] [INFO ] [MAIN ] FUBO: Loaded 54095 existing records. [2025-10-10T19:03:23.932422] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T19:03:23.969278] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:03:23.970077] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-10T19:03:23.970131] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-10T19:03:23.971263] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-10T19:03:23.971323] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-10T19:03:24.298477] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-10T19:03:24.331105] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:03:25.089367] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-10T19:03:25.565126] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-10T19:03:25.571246] [INFO ] [REMOTE ] FTV: Full fetch complete (76405 records). [2025-10-10T19:03:25.571442] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-10T19:03:25.892439] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-10T19:03:25.917973] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-10T19:03:25.995560] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-10T19:03:25.995734] [INFO ] [REMOTE ] FTK: Full fetch complete (43899 records). [2025-10-10T19:03:25.995823] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-10T19:03:25.996944] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-10T19:03:25.997028] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-10T19:03:25.997249] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-10T19:03:26.098753] [DEBUG] [LOCAL ] FTV: Trimmed 76405 records to 53761 (keeping 200 days of data) [2025-10-10T19:03:26.575164] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-10T19:03:26.575247] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-10T19:03:26.576025] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-10T19:03:26.602673] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-10T19:03:26.621469] [DEBUG] [LOCAL ] FTK: Trimmed 43899 records to 33004 (keeping 200 days of data) [2025-10-10T19:03:26.784718] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T19:03:26.789427] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-10T19:03:26.836131] [DEBUG] [LOCAL ] FTV: Primary data saved (53761 records). [2025-10-10T19:03:26.837122] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-10T19:03:26.837526] [INFO ] [MAIN ] Update Progress: 883/2373 symbols completed. FTV took 37.1s. Estimated remaining: 3h 28m 12s. Rate: 7.2 symbols/min [2025-10-10T19:03:27.077165] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:03:27.120418] [DEBUG] [LOCAL ] FTK: Primary data saved (33004 records). [2025-10-10T19:03:27.120806] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-10T19:03:27.120932] [INFO ] [MAIN ] Update Progress: 884/2373 symbols completed. FTK took 37.4s. Estimated remaining: 3h 27m 50s. Rate: 7.2 symbols/min [2025-10-10T19:03:27.294712] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:03:27.338149] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-10T19:03:27.342007] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-10T19:03:27.364442] [DEBUG] [LOCAL ] FUL: Loaded 33056 existing records from primary storage. [2025-10-10T19:03:27.364783] [INFO ] [MAIN ] FUL: Loaded 33056 existing records. [2025-10-10T19:03:27.493479] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-10T19:03:27.558728] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:03:27.573498] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-10T19:03:27.573617] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-10T19:03:27.574369] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-10T19:03:27.574465] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-10T19:03:27.574307] [DEBUG] [LOCAL ] FUN: Loaded 52165 existing records from primary storage. [2025-10-10T19:03:27.636237] [INFO ] [MAIN ] FUN: Loaded 52165 existing records. [2025-10-10T19:03:27.974307] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:03:28.005457] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-10T19:03:28.010694] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-10T19:03:28.028439] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-10T19:03:28.030588] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-10T19:03:28.222736] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:03:28.294616] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-10T19:03:28.455245] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:03:28.904004] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-10T19:03:29.089394] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-10T19:03:29.661272] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-10T19:03:29.889388] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-10T19:03:30.119206] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-10T19:03:30.298981] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-10T19:03:30.689358] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-10T19:03:31.240800] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-10T19:03:31.489367] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-10T19:03:32.289396] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-10T19:03:32.797381] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-10T19:03:32.883829] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T19:03:33.089442] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-10T19:03:33.889515] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-10T19:03:34.457028] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-10T19:03:34.689405] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-10T19:03:35.225430] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-10T19:03:35.489400] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-10T19:03:35.668770] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-10T19:03:36.213869] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-10T19:03:36.214864] [INFO ] [REMOTE ] FTWO: Full fetch complete (3323 records). [2025-10-10T19:03:36.214942] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-10T19:03:36.294510] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-10T19:03:36.608042] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-10T19:03:36.608121] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-10T19:03:36.608280] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-10T19:03:36.608320] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-10T19:03:36.608688] [DEBUG] [LOCAL ] FTWO: Trimmed 3323 records to 1910 (keeping 200 days of data) [2025-10-10T19:03:36.620483] [DEBUG] [LOCAL ] FTWO: Primary data saved (1910 records). [2025-10-10T19:03:36.620546] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-10T19:03:36.620618] [INFO ] [MAIN ] Update Progress: 885/2373 symbols completed. FTWO took 15.1s. Estimated remaining: 3h 27m 43s. Rate: 7.2 symbols/min [2025-10-10T19:03:36.794691] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:03:36.794890] [DEBUG] [LOCAL ] FVR: No existing data file found in primary storage. [2025-10-10T19:03:36.794972] [WARN ] [MAIN ] FVR: No existing data found, performing full refresh instead. [2025-10-10T19:03:36.795107] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-10T19:03:36.795156] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-10T19:03:36.795196] [DEBUG] [LOCAL ] FVR: No primary data file found to delete. [2025-10-10T19:03:36.795227] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-10T19:03:37.104740] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-10T19:03:37.150800] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:03:37.889395] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-10T19:03:37.966866] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T19:03:38.689380] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-10T19:03:39.122674] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-10T19:03:39.494483] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-10T19:03:39.515328] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-10T19:03:40.277518] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T19:03:40.289388] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-10T19:03:40.743505] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T19:03:41.089378] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-10T19:03:41.889336] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-10T19:03:42.585811] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-10T19:03:42.689357] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-10T19:03:42.817338] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T19:03:43.489431] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-10T19:03:43.662427] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T19:03:44.119063] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-10T19:03:44.289395] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-10T19:03:45.089408] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-10T19:03:45.218142] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-10T19:03:45.371635] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T19:03:45.889385] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-10T19:03:46.232477] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-10T19:03:46.689377] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-10T19:03:47.489407] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-10T19:03:47.621257] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T19:03:47.702364] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-10T19:03:48.289383] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-10T19:03:48.983146] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-10T19:03:49.089374] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-10T19:03:49.162323] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T19:03:49.889380] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-10T19:03:50.689409] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-10T19:03:51.384337] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-10T19:03:51.415513] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T19:03:51.489330] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-10T19:03:52.289443] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-10T19:03:52.635826] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T19:03:53.071313] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-10T19:03:53.089330] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-10T19:03:53.292432] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-10T19:03:53.889345] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-10T19:03:54.024932] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-10T19:03:54.689350] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-10T19:03:55.212366] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-10T19:03:55.489396] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-10T19:03:56.289345] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-10T19:03:56.418267] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T19:03:57.099472] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-10T19:03:57.101562] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-10T19:03:57.412218] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T19:03:57.889360] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-10T19:03:58.519496] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-10T19:03:58.522830] [INFO ] [REMOTE ] FUL: Full fetch complete (47751 records). [2025-10-10T19:03:58.522911] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-10T19:03:58.694363] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-10T19:03:58.945990] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-10T19:03:58.946098] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-10T19:03:58.947078] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-10T19:03:58.947173] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-10T19:03:58.948603] [DEBUG] [LOCAL ] FUL: Trimmed 47751 records to 33279 (keeping 200 days of data) [2025-10-10T19:03:59.103182] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T19:03:59.191736] [DEBUG] [LOCAL ] FUL: Primary data saved (33279 records). [2025-10-10T19:03:59.191938] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-10T19:03:59.192069] [INFO ] [MAIN ] Update Progress: 886/2373 symbols completed. FUL took 32.4s. Estimated remaining: 3h 27m 59s. Rate: 7.1 symbols/min [2025-10-10T19:03:59.370932] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:03:59.414194] [DEBUG] [LOCAL ] FVRR: Loaded 40524 existing records from primary storage. [2025-10-10T19:03:59.414556] [INFO ] [MAIN ] FVRR: Loaded 40524 existing records. [2025-10-10T19:03:59.498413] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-10T19:03:59.611049] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:03:59.611498] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-10T19:03:59.611576] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-10T19:03:59.612937] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-10T19:03:59.613010] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-10T19:03:59.982229] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:04:00.289417] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-10T19:04:00.653807] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T19:04:01.089458] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-10T19:04:01.889466] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-10T19:04:02.054457] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T19:04:02.102639] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-10T19:04:02.235901] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-10T19:04:02.689400] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-10T19:04:03.489391] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-10T19:04:03.793307] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T19:04:04.164327] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T19:04:04.166328] [INFO ] [REMOTE ] FVR: Full fetch complete (29500 records). [2025-10-10T19:04:04.166401] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-10T19:04:04.294522] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-10T19:04:04.587530] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T19:04:04.586450] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-10T19:04:04.595455] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-10T19:04:04.596399] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-10T19:04:04.596481] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-10T19:04:04.598030] [DEBUG] [LOCAL ] FVR: Trimmed 29500 records to 21773 (keeping 200 days of data) [2025-10-10T19:04:04.729704] [DEBUG] [LOCAL ] FVR: Primary data saved (21773 records). [2025-10-10T19:04:04.730258] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-10T19:04:04.730359] [INFO ] [MAIN ] Update Progress: 887/2373 symbols completed. FVR took 28.1s. Estimated remaining: 3h 27m 45s. Rate: 7.2 symbols/min [2025-10-10T19:04:04.895180] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:04:04.898052] [DEBUG] [LOCAL ] FXED: Loaded 1259 existing records from primary storage. [2025-10-10T19:04:04.898217] [INFO ] [MAIN ] FXED: Loaded 1259 existing records. [2025-10-10T19:04:05.070186] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:04:05.070434] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-10T19:04:05.070481] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-10T19:04:05.070748] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-10T19:04:05.070807] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-10T19:04:05.100303] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-10T19:04:05.419484] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:04:05.889414] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-10T19:04:06.314959] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-10T19:04:06.689380] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-10T19:04:06.993233] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-10T19:04:07.113075] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-10T19:04:07.189461] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-10T19:04:07.489390] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-10T19:04:07.899803] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-10T19:04:08.289342] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-10T19:04:08.766754] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-10T19:04:09.089434] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-10T19:04:09.889540] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-10T19:04:10.689477] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-10T19:04:11.489405] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-10T19:04:11.530514] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-10T19:04:11.854976] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T19:04:12.042438] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-10T19:04:12.289344] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-10T19:04:12.515586] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T19:04:12.683547] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-10T19:04:13.089415] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-10T19:04:13.889392] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-10T19:04:14.388727] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-10T19:04:14.689360] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-10T19:04:14.892452] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-10T19:04:15.489418] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-10T19:04:16.289421] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-10T19:04:16.802725] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-10T19:04:17.081633] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-10T19:04:17.086787] [INFO ] [REMOTE ] FUBO: Full fetch complete (77771 records). [2025-10-10T19:04:17.086920] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-10T19:04:17.098810] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-10T19:04:17.444782] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T19:04:17.511058] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-10T19:04:17.511146] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-10T19:04:17.512159] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-10T19:04:17.512223] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-10T19:04:17.513809] [DEBUG] [LOCAL ] FUBO: Trimmed 77771 records to 54485 (keeping 200 days of data) [2025-10-10T19:04:17.596336] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-10T19:04:17.819717] [DEBUG] [LOCAL ] FUBO: Primary data saved (54485 records). [2025-10-10T19:04:17.819866] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-10T19:04:17.819960] [INFO ] [MAIN ] Update Progress: 888/2373 symbols completed. FUBO took 54.3s. Estimated remaining: 3h 27m 45s. Rate: 7.1 symbols/min [2025-10-10T19:04:17.894553] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-10T19:04:18.007003] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:04:18.049885] [DEBUG] [LOCAL ] G: Loaded 50363 existing records from primary storage. [2025-10-10T19:04:18.050218] [INFO ] [MAIN ] G: Loaded 50363 existing records. [2025-10-10T19:04:18.241357] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:04:18.241713] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-10T19:04:18.241778] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-10T19:04:18.243636] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-10T19:04:18.243728] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-10T19:04:18.534536] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-10T19:04:18.655028] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:04:18.689406] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-10T19:04:19.489382] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-10T19:04:20.289366] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-10T19:04:20.501988] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T19:04:21.089482] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-10T19:04:21.351524] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T19:04:21.606977] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-10T19:04:21.607774] [INFO ] [REMOTE ] FXED: Full fetch complete (1804 records). [2025-10-10T19:04:21.607842] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-10T19:04:21.894459] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-10T19:04:21.970106] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-10T19:04:21.970201] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-10T19:04:21.970321] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-10T19:04:21.970362] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-10T19:04:21.970709] [DEBUG] [LOCAL ] FXED: Trimmed 1804 records to 1266 (keeping 200 days of data) [2025-10-10T19:04:21.978846] [DEBUG] [LOCAL ] FXED: Primary data saved (1266 records). [2025-10-10T19:04:21.978906] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-10T19:04:21.978976] [INFO ] [MAIN ] Update Progress: 889/2373 symbols completed. FXED took 17.2s. Estimated remaining: 3h 27m 29s. Rate: 7.2 symbols/min [2025-10-10T19:04:22.154116] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:04:22.181158] [DEBUG] [LOCAL ] GAB: Loaded 27889 existing records from primary storage. [2025-10-10T19:04:22.181471] [INFO ] [MAIN ] GAB: Loaded 27889 existing records. [2025-10-10T19:04:22.358185] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:04:22.358536] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-10T19:04:22.358601] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-10T19:04:22.369539] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-10T19:04:22.387120] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-10T19:04:22.457717] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-10T19:04:22.694460] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-10T19:04:22.748962] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:04:23.489407] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-10T19:04:23.552519] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T19:04:24.289350] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-10T19:04:24.427389] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-10T19:04:24.537993] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T19:04:25.089363] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-10T19:04:25.889500] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-10T19:04:26.163132] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-10T19:04:26.255561] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T19:04:26.689368] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-10T19:04:27.489378] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-10T19:04:27.863552] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-10T19:04:27.920931] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-10T19:04:27.927196] [INFO ] [REMOTE ] FUN: Full fetch complete (73048 records). [2025-10-10T19:04:27.927494] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-10T19:04:28.299608] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-10T19:04:28.342617] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-10T19:04:28.342763] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-10T19:04:28.343956] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-10T19:04:28.344026] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-10T19:04:28.346237] [DEBUG] [LOCAL ] FUN: Trimmed 73048 records to 52553 (keeping 200 days of data) [2025-10-10T19:04:28.693168] [DEBUG] [LOCAL ] FUN: Primary data saved (52553 records). [2025-10-10T19:04:28.693356] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-10T19:04:28.693460] [INFO ] [MAIN ] Update Progress: 890/2373 symbols completed. FUN took 1m 2s. Estimated remaining: 3h 27m 18s. Rate: 7.2 symbols/min [2025-10-10T19:04:28.872137] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:04:28.880555] [DEBUG] [LOCAL ] GAM: Loaded 4058 existing records from primary storage. [2025-10-10T19:04:28.881027] [INFO ] [MAIN ] GAM: Loaded 4058 existing records. [2025-10-10T19:04:29.078584] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:04:29.079078] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-10T19:04:29.079197] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-10T19:04:29.079448] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-10T19:04:29.079515] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-10T19:04:29.104335] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-10T19:04:29.191682] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-10T19:04:29.472020] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:04:29.889362] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-10T19:04:30.138770] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T19:04:30.689375] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-10T19:04:30.765617] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T19:04:31.307818] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-10T19:04:31.489382] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-10T19:04:32.289435] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-10T19:04:32.384127] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T19:04:33.010910] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-10T19:04:33.089397] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-10T19:04:33.107443] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-10T19:04:33.889481] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-10T19:04:34.689429] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-10T19:04:34.980628] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-10T19:04:35.489357] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-10T19:04:35.659228] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-10T19:04:35.664178] [INFO ] [REMOTE ] FVRR: Full fetch complete (59226 records). [2025-10-10T19:04:35.664386] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-10T19:04:36.054405] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-10T19:04:36.054671] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-10T19:04:36.056800] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-10T19:04:36.056924] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-10T19:04:36.075002] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-10T19:04:36.082059] [DEBUG] [LOCAL ] FVRR: Trimmed 59226 records to 40837 (keeping 200 days of data) [2025-10-10T19:04:36.275737] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-10T19:04:36.301499] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-10T19:04:36.345462] [DEBUG] [LOCAL ] FVRR: Primary data saved (40837 records). [2025-10-10T19:04:36.345711] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-10T19:04:36.345824] [INFO ] [MAIN ] Update Progress: 891/2373 symbols completed. FVRR took 37.2s. Estimated remaining: 3h 27m 9s. Rate: 7.2 symbols/min [2025-10-10T19:04:36.522743] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:04:36.573728] [DEBUG] [LOCAL ] GAP: Loaded 54042 existing records from primary storage. [2025-10-10T19:04:36.574078] [INFO ] [MAIN ] GAP: Loaded 54042 existing records. [2025-10-10T19:04:36.773320] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:04:36.773587] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-10T19:04:36.773661] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-10T19:04:36.773917] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-10T19:04:36.773962] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-10T19:04:37.101471] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-10T19:04:37.148935] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:04:37.890608] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-10T19:04:37.892912] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-10T19:04:38.206357] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T19:04:38.689383] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-10T19:04:39.207554] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-10T19:04:39.489411] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-10T19:04:40.289417] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-10T19:04:40.440935] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T19:04:40.493453] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-10T19:04:41.089398] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-10T19:04:41.889357] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-10T19:04:42.217951] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-10T19:04:42.362398] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-10T19:04:42.684969] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-10T19:04:42.689324] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-10T19:04:43.427555] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-10T19:04:43.489402] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-10T19:04:44.289400] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-10T19:04:44.797975] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-10T19:04:44.982037] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-10T19:04:45.089432] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-10T19:04:45.801266] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-10T19:04:45.889376] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-10T19:04:46.689418] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-10T19:04:47.490616] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-10T19:04:47.496689] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-10T19:04:47.511535] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-10T19:04:48.289401] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-10T19:04:48.964592] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-10T19:04:49.089367] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-10T19:04:49.352344] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T19:04:49.782047] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T19:04:49.783162] [INFO ] [REMOTE ] GAM: Full fetch complete (6617 records). [2025-10-10T19:04:49.783238] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-10T19:04:49.894552] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-10T19:04:50.161024] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-10T19:04:50.161132] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-10T19:04:50.161386] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-10T19:04:50.161430] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-10T19:04:50.162071] [DEBUG] [LOCAL ] GAM: Trimmed 6617 records to 4102 (keeping 200 days of data) [2025-10-10T19:04:50.192956] [DEBUG] [LOCAL ] GAM: Primary data saved (4102 records). [2025-10-10T19:04:50.193150] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-10T19:04:50.193308] [INFO ] [MAIN ] Update Progress: 892/2373 symbols completed. GAM took 21.5s. Estimated remaining: 3h 27m 9s. Rate: 7.1 symbols/min [2025-10-10T19:04:50.363312] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:04:50.386084] [DEBUG] [LOCAL ] GATX: Loaded 18233 existing records from primary storage. [2025-10-10T19:04:50.386381] [INFO ] [MAIN ] GATX: Loaded 18233 existing records. [2025-10-10T19:04:50.566904] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:04:50.567181] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-10T19:04:50.567232] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-10T19:04:50.567485] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-10T19:04:50.567568] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-10T19:04:50.712237] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-10T19:04:50.982273] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:04:51.489391] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-10T19:04:51.960840] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-10T19:04:52.289357] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-10T19:04:52.765377] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-10T19:04:52.940246] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T19:04:52.943395] [INFO ] [REMOTE ] GAB: Full fetch complete (39378 records). [2025-10-10T19:04:52.943492] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-10T19:04:53.094465] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-10T19:04:53.341460] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-10T19:04:53.341562] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-10T19:04:53.342470] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-10T19:04:53.342552] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-10T19:04:53.343820] [DEBUG] [LOCAL ] GAB: Trimmed 39378 records to 28235 (keeping 200 days of data) [2025-10-10T19:04:53.519730] [DEBUG] [LOCAL ] GAB: Primary data saved (28235 records). [2025-10-10T19:04:53.519903] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-10T19:04:53.520012] [INFO ] [MAIN ] Update Progress: 893/2373 symbols completed. GAB took 31.5s. Estimated remaining: 3h 26m 53s. Rate: 7.2 symbols/min [2025-10-10T19:04:53.711784] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:04:53.729605] [DEBUG] [LOCAL ] GBAB: Loaded 13099 existing records from primary storage. [2025-10-10T19:04:53.729969] [INFO ] [MAIN ] GBAB: Loaded 13099 existing records. [2025-10-10T19:04:53.902799] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-10T19:04:53.917823] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:04:53.918471] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-10T19:04:53.918579] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-10T19:04:53.918963] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-10T19:04:53.919102] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-10T19:04:54.090707] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T19:04:54.382789] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:04:54.689393] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-10T19:04:55.093986] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-10T19:04:55.160257] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T19:04:55.489368] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-10T19:04:55.890250] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-10T19:04:56.289396] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-10T19:04:57.089404] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-10T19:04:57.585047] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-10T19:04:57.889409] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-10T19:04:58.242615] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-10T19:04:58.422109] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-10T19:04:58.427296] [INFO ] [REMOTE ] G: Full fetch complete (71764 records). [2025-10-10T19:04:58.427436] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-10T19:04:58.699932] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-10T19:04:58.835498] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-10T19:04:58.835598] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-10T19:04:58.836864] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-10T19:04:58.836937] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-10T19:04:58.838849] [DEBUG] [LOCAL ] G: Trimmed 71764 records to 50737 (keeping 200 days of data) [2025-10-10T19:04:58.938242] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-10T19:04:59.179124] [DEBUG] [LOCAL ] G: Primary data saved (50737 records). [2025-10-10T19:04:59.179297] [INFO ] [MAIN ] G: Full history saved. [2025-10-10T19:04:59.179398] [INFO ] [MAIN ] Update Progress: 894/2373 symbols completed. G took 41.4s. Estimated remaining: 3h 26m 40s. Rate: 7.2 symbols/min [2025-10-10T19:04:59.355915] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:04:59.398241] [DEBUG] [LOCAL ] GBCI: Loaded 40822 existing records from primary storage. [2025-10-10T19:04:59.398668] [INFO ] [MAIN ] GBCI: Loaded 40822 existing records. [2025-10-10T19:04:59.494574] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-10T19:04:59.606236] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:04:59.606537] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-10T19:04:59.606589] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-10T19:04:59.606830] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-10T19:04:59.606887] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-10T19:04:59.990249] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:05:00.289416] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-10T19:05:00.651954] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T19:05:01.035830] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-10T19:05:01.062565] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-10T19:05:01.089378] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-10T19:05:01.889396] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-10T19:05:02.689363] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-10T19:05:03.215714] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-10T19:05:03.278885] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-10T19:05:03.489368] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-10T19:05:03.517021] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T19:05:04.289398] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-10T19:05:05.089426] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-10T19:05:05.613484] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T19:05:05.897042] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-10T19:05:05.904111] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-10T19:05:06.689392] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-10T19:05:06.883743] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T19:05:07.010773] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-10T19:05:07.489439] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-10T19:05:08.289402] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-10T19:05:08.573983] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T19:05:08.819625] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-10T19:05:09.089435] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-10T19:05:09.891595] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-10T19:05:09.894360] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-10T19:05:10.678195] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-10T19:05:10.689338] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-10T19:05:11.306770] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-10T19:05:11.489375] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-10T19:05:11.915123] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T19:05:12.289390] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-10T19:05:13.089357] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-10T19:05:13.573600] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T19:05:13.896540] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-10T19:05:13.913796] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T19:05:13.994861] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-10T19:05:14.689395] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-10T19:05:15.325312] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-10T19:05:15.489394] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-10T19:05:16.289346] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-10T19:05:16.569294] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T19:05:16.658083] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-10T19:05:16.663247] [INFO ] [REMOTE ] GAP: Full fetch complete (77632 records). [2025-10-10T19:05:16.663429] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-10T19:05:17.043830] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-10T19:05:17.043915] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-10T19:05:17.044969] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-10T19:05:17.045034] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-10T19:05:17.047265] [DEBUG] [LOCAL ] GAP: Trimmed 77632 records to 54432 (keeping 200 days of data) [2025-10-10T19:05:17.101126] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-10T19:05:17.398065] [DEBUG] [LOCAL ] GAP: Primary data saved (54432 records). [2025-10-10T19:05:17.398272] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-10T19:05:17.398388] [INFO ] [MAIN ] Update Progress: 895/2373 symbols completed. GAP took 41.1s. Estimated remaining: 3h 26m 48s. Rate: 7.1 symbols/min [2025-10-10T19:05:17.590148] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:05:17.590368] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-10T19:05:17.590405] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-10T19:05:17.590602] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-10T19:05:17.590686] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-10T19:05:17.590747] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-10T19:05:17.590784] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-10T19:05:17.894612] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-10T19:05:18.068158] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:05:18.204825] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T19:05:18.503875] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-10T19:05:18.689457] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-10T19:05:19.097732] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-10T19:05:19.489401] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-10T19:05:19.768994] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T19:05:19.770866] [INFO ] [REMOTE ] GATX: Full fetch complete (24931 records). [2025-10-10T19:05:19.770940] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-10T19:05:20.161737] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-10T19:05:20.161861] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-10T19:05:20.162669] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-10T19:05:20.162740] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-10T19:05:20.163896] [DEBUG] [LOCAL ] GATX: Trimmed 24931 records to 18334 (keeping 200 days of data) [2025-10-10T19:05:20.287036] [DEBUG] [LOCAL ] GATX: Primary data saved (18334 records). [2025-10-10T19:05:20.287236] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-10T19:05:20.287344] [INFO ] [MAIN ] Update Progress: 896/2373 symbols completed. GATX took 30.1s. Estimated remaining: 3h 26m 30s. Rate: 7.2 symbols/min [2025-10-10T19:05:20.299405] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-10T19:05:20.475838] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:05:20.523197] [DEBUG] [LOCAL ] GBTG: Loaded 40278 existing records from primary storage. [2025-10-10T19:05:20.523854] [INFO ] [MAIN ] GBTG: Loaded 40278 existing records. [2025-10-10T19:05:20.721799] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:05:20.722164] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-10T19:05:20.722220] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-10T19:05:20.722450] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-10T19:05:20.722509] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-10T19:05:20.829967] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-10T19:05:21.092579] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-10T19:05:21.119305] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:05:21.144980] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-10T19:05:21.600900] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-10T19:05:21.889414] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-10T19:05:22.689351] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-10T19:05:23.017085] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-10T19:05:23.489438] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-10T19:05:24.292933] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-10T19:05:24.295180] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-10T19:05:24.526161] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-10T19:05:24.580614] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-10T19:05:25.089405] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-10T19:05:25.889419] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-10T19:05:26.689376] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-10T19:05:26.902251] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T19:05:27.095522] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-10T19:05:27.489430] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-10T19:05:27.532064] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-10T19:05:28.289440] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-10T19:05:29.089414] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-10T19:05:29.197217] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T19:05:29.302893] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-10T19:05:29.889355] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-10T19:05:30.113305] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-10T19:05:30.689370] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-10T19:05:31.406943] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-10T19:05:31.489381] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-10T19:05:32.289540] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-10T19:05:32.451710] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T19:05:32.707245] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-10T19:05:33.089392] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-10T19:05:33.132037] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-10T19:05:33.528904] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-10T19:05:33.889377] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-10T19:05:34.148296] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-10T19:05:34.689371] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-10T19:05:35.489363] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-10T19:05:36.289352] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-10T19:05:36.357219] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T19:05:36.358859] [INFO ] [REMOTE ] GBAB: Full fetch complete (19239 records). [2025-10-10T19:05:36.359031] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-10T19:05:36.544894] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T19:05:36.770663] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-10T19:05:36.770759] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-10T19:05:36.771198] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-10T19:05:36.771237] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-10T19:05:36.771859] [DEBUG] [LOCAL ] GBAB: Trimmed 19239 records to 13161 (keeping 200 days of data) [2025-10-10T19:05:36.849892] [DEBUG] [LOCAL ] GBAB: Primary data saved (13161 records). [2025-10-10T19:05:36.850048] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-10T19:05:36.850155] [INFO ] [MAIN ] Update Progress: 897/2373 symbols completed. GBAB took 43.3s. Estimated remaining: 3h 26m 35s. Rate: 7.1 symbols/min [2025-10-10T19:05:37.017882] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:05:37.047138] [DEBUG] [LOCAL ] GBX: Loaded 29325 existing records from primary storage. [2025-10-10T19:05:37.047410] [INFO ] [MAIN ] GBX: Loaded 29325 existing records. [2025-10-10T19:05:37.094468] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-10T19:05:37.227419] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:05:37.227693] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-10T19:05:37.227753] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-10T19:05:37.228404] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-10T19:05:37.228462] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-10T19:05:37.592742] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:05:37.889366] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-10T19:05:37.937824] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-10T19:05:37.942358] [INFO ] [REMOTE ] GBCI: Full fetch complete (58576 records). [2025-10-10T19:05:37.942455] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-10T19:05:38.220822] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-10T19:05:38.326046] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-10T19:05:38.326134] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-10T19:05:38.326967] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-10T19:05:38.327029] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-10T19:05:38.328174] [DEBUG] [LOCAL ] GBCI: Trimmed 58576 records to 41170 (keeping 200 days of data) [2025-10-10T19:05:38.579629] [DEBUG] [LOCAL ] GBCI: Primary data saved (41170 records). [2025-10-10T19:05:38.579798] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-10T19:05:38.579919] [INFO ] [MAIN ] Update Progress: 898/2373 symbols completed. GBCI took 39.4s. Estimated remaining: 3h 26m 16s. Rate: 7.2 symbols/min [2025-10-10T19:05:38.694559] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-10T19:05:38.760031] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:05:38.799088] [DEBUG] [LOCAL ] GCI: Loaded 44365 existing records from primary storage. [2025-10-10T19:05:38.799404] [INFO ] [MAIN ] GCI: Loaded 44365 existing records. [2025-10-10T19:05:39.011364] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:05:39.005876] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T19:05:39.011627] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-10T19:05:39.011722] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-10T19:05:39.020326] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-10T19:05:39.020503] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-10T19:05:39.394704] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-10T19:05:39.398697] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:05:39.489402] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-10T19:05:40.289447] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-10T19:05:40.794679] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-10T19:05:41.089380] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-10T19:05:41.176364] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T19:05:41.889377] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-10T19:05:42.689437] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-10T19:05:42.723375] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T19:05:43.489382] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-10T19:05:43.539787] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T19:05:43.633738] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-10T19:05:44.289477] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-10T19:05:44.712687] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-10T19:05:44.713695] [INFO ] [REMOTE ] GBLI: Full fetch complete (1310 records). [2025-10-10T19:05:44.713782] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-10T19:05:44.915284] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-10T19:05:44.915617] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T19:05:44.915750] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T19:05:44.915839] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-10T19:05:44.915920] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-10T19:05:44.915971] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-10T19:05:44.916030] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-10T19:05:44.916106] [INFO ] [MAIN ] Update Progress: 899/2373 symbols completed. GBLI took 27.5s. Estimated remaining: 3h 26m 4s. Rate: 7.2 symbols/min [2025-10-10T19:05:45.092196] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-10T19:05:45.093857] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:05:45.133673] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T19:05:45.150269] [DEBUG] [LOCAL ] GCO: Loaded 24160 existing records from primary storage. [2025-10-10T19:05:45.150522] [INFO ] [MAIN ] GCO: Loaded 24160 existing records. [2025-10-10T19:05:45.322147] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:05:45.322395] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-10T19:05:45.322466] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-10T19:05:45.323106] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-10T19:05:45.323172] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-10T19:05:45.693970] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:05:45.889452] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-10T19:05:46.689362] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-10T19:05:46.752509] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-10T19:05:47.434127] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-10T19:05:47.489338] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-10T19:05:47.719106] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-10T19:05:48.289396] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-10T19:05:48.791639] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T19:05:49.089397] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-10T19:05:49.889352] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-10T19:05:49.974244] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T19:05:50.697847] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-10T19:05:50.702474] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T19:05:51.251704] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T19:05:51.489359] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-10T19:05:52.289367] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-10T19:05:52.517071] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-10T19:05:52.521038] [INFO ] [REMOTE ] GBTG: Full fetch complete (56360 records). [2025-10-10T19:05:52.521143] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-10T19:05:52.927441] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-10T19:05:52.927538] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-10T19:05:52.928336] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-10T19:05:52.928399] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-10T19:05:52.929704] [DEBUG] [LOCAL ] GBTG: Trimmed 56360 records to 40575 (keeping 200 days of data) [2025-10-10T19:05:53.097921] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-10T19:05:53.162947] [DEBUG] [LOCAL ] GBTG: Primary data saved (40575 records). [2025-10-10T19:05:53.163080] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-10T19:05:53.163173] [INFO ] [MAIN ] Update Progress: 900/2373 symbols completed. GBTG took 32.9s. Estimated remaining: 3h 25m 55s. Rate: 7.2 symbols/min [2025-10-10T19:05:53.388934] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:05:53.407556] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T19:05:53.434710] [DEBUG] [LOCAL ] GCTS: Loaded 20474 existing records from primary storage. [2025-10-10T19:05:53.434971] [INFO ] [MAIN ] GCTS: Loaded 20474 existing records. [2025-10-10T19:05:53.608554] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:05:53.608794] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-10T19:05:53.608864] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-10T19:05:53.609431] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-10T19:05:53.609492] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-10T19:05:53.899224] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-10T19:05:53.963152] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-10T19:05:53.987340] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:05:54.347621] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T19:05:54.689361] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-10T19:05:55.489351] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-10T19:05:55.697460] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T19:05:56.289412] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-10T19:05:56.360909] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T19:05:56.568088] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-10T19:05:57.089399] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-10T19:05:57.512070] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T19:05:57.889379] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-10T19:05:58.358575] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-10T19:05:58.578347] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-10T19:05:58.689339] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-10T19:05:59.489372] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-10T19:05:59.685119] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-10T19:06:00.289426] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-10T19:06:01.089395] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-10T19:06:01.359258] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-10T19:06:01.402438] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T19:06:01.889441] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-10T19:06:02.466495] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-10T19:06:02.689392] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-10T19:06:03.193937] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T19:06:03.489397] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-10T19:06:04.084024] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T19:06:04.289376] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-10T19:06:04.673899] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T19:06:05.089404] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-10T19:06:05.889403] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-10T19:06:06.274213] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T19:06:06.617377] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T19:06:06.689341] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-10T19:06:07.489370] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-10T19:06:07.541784] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T19:06:08.083429] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-10T19:06:08.289378] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-10T19:06:09.089355] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-10T19:06:09.346145] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T19:06:09.641200] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-10T19:06:09.889373] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-10T19:06:10.335893] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T19:06:10.689355] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-10T19:06:11.130403] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T19:06:11.489403] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-10T19:06:11.746694] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-10T19:06:12.289441] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-10T19:06:12.586113] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-10T19:06:12.589157] [INFO ] [REMOTE ] GBX: Full fetch complete (42673 records). [2025-10-10T19:06:12.589247] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-10T19:06:12.952263] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-10T19:06:12.952354] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-10T19:06:12.953122] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-10T19:06:12.953188] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-10T19:06:12.954262] [DEBUG] [LOCAL ] GBX: Trimmed 42673 records to 29532 (keeping 200 days of data) [2025-10-10T19:06:13.090910] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-10T19:06:13.154222] [DEBUG] [LOCAL ] GBX: Primary data saved (29532 records). [2025-10-10T19:06:13.154360] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-10T19:06:13.154445] [INFO ] [MAIN ] Update Progress: 901/2373 symbols completed. GBX took 36.3s. Estimated remaining: 3h 26m 6s. Rate: 7.1 symbols/min [2025-10-10T19:06:13.319831] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:06:13.328884] [DEBUG] [LOCAL ] GCV: Loaded 7653 existing records from primary storage. [2025-10-10T19:06:13.329113] [INFO ] [MAIN ] GCV: Loaded 7653 existing records. [2025-10-10T19:06:13.500755] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:06:13.501038] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-10T19:06:13.501086] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-10T19:06:13.501941] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-10T19:06:13.502000] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-10T19:06:13.859516] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:06:13.873177] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-10T19:06:13.889347] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-10T19:06:14.645265] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T19:06:14.689399] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-10T19:06:15.489372] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-10T19:06:15.507383] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-10T19:06:15.651162] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T19:06:16.289460] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-10T19:06:16.831931] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-10T19:06:17.089377] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-10T19:06:17.618052] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T19:06:17.889378] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-10T19:06:17.963495] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-10T19:06:18.689387] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-10T19:06:19.369994] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-10T19:06:19.393340] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T19:06:19.397558] [INFO ] [REMOTE ] GCI: Full fetch complete (63203 records). [2025-10-10T19:06:19.397744] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-10T19:06:19.494485] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-10T19:06:19.779197] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-10T19:06:19.779306] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-10T19:06:19.780418] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-10T19:06:19.780481] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-10T19:06:19.781774] [DEBUG] [LOCAL ] GCI: Trimmed 63203 records to 44675 (keeping 200 days of data) [2025-10-10T19:06:20.026384] [DEBUG] [LOCAL ] GCI: Primary data saved (44675 records). [2025-10-10T19:06:20.026526] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-10T19:06:20.026610] [INFO ] [MAIN ] Update Progress: 902/2373 symbols completed. GCI took 41.4s. Estimated remaining: 3h 25m 55s. Rate: 7.1 symbols/min [2025-10-10T19:06:20.190086] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:06:20.234016] [DEBUG] [LOCAL ] GD: Loaded 47158 existing records from primary storage. [2025-10-10T19:06:20.234358] [INFO ] [MAIN ] GD: Loaded 47158 existing records. [2025-10-10T19:06:20.294770] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-10T19:06:20.413222] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:06:20.413473] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-10T19:06:20.413520] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-10T19:06:20.414439] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-10T19:06:20.414497] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-10T19:06:20.770761] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:06:20.771253] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T19:06:20.774168] [INFO ] [REMOTE ] GCO: Full fetch complete (35138 records). [2025-10-10T19:06:20.774315] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-10T19:06:21.094551] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-10T19:06:21.162457] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-10T19:06:21.162551] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-10T19:06:21.163268] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-10T19:06:21.163342] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-10T19:06:21.164200] [DEBUG] [LOCAL ] GCO: Trimmed 35138 records to 24281 (keeping 200 days of data) [2025-10-10T19:06:21.303046] [DEBUG] [LOCAL ] GCO: Primary data saved (24281 records). [2025-10-10T19:06:21.303199] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-10T19:06:21.303287] [INFO ] [MAIN ] Update Progress: 903/2373 symbols completed. GCO took 36.4s. Estimated remaining: 3h 25m 35s. Rate: 7.2 symbols/min [2025-10-10T19:06:21.475435] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:06:21.533501] [DEBUG] [LOCAL ] GDDY: Loaded 50152 existing records from primary storage. [2025-10-10T19:06:21.534097] [INFO ] [MAIN ] GDDY: Loaded 50152 existing records. [2025-10-10T19:06:21.744077] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:06:21.760136] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-10T19:06:21.761173] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-10T19:06:21.761423] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-10T19:06:21.766973] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-10T19:06:21.767241] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-10T19:06:21.893230] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-10T19:06:21.903179] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-10T19:06:22.180820] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:06:22.689372] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-10T19:06:23.342951] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-10T19:06:23.489398] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-10T19:06:23.902777] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T19:06:24.289359] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-10T19:06:24.401804] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-10T19:06:25.089393] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-10T19:06:25.889345] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-10T19:06:26.321437] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T19:06:26.689379] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-10T19:06:26.851185] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T19:06:26.892258] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T19:06:27.489438] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-10T19:06:27.529582] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T19:06:27.532072] [INFO ] [REMOTE ] GCTS: Full fetch complete (26911 records). [2025-10-10T19:06:27.532172] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-10T19:06:27.897583] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-10T19:06:27.897693] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-10T19:06:27.898341] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-10T19:06:27.898383] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-10T19:06:27.899077] [DEBUG] [LOCAL ] GCTS: Trimmed 26911 records to 20601 (keeping 200 days of data) [2025-10-10T19:06:28.011298] [DEBUG] [LOCAL ] GCTS: Primary data saved (20601 records). [2025-10-10T19:06:28.011429] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-10T19:06:28.011522] [INFO ] [MAIN ] Update Progress: 904/2373 symbols completed. GCTS took 34.8s. Estimated remaining: 3h 25m 24s. Rate: 7.2 symbols/min [2025-10-10T19:06:28.176423] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:06:28.182035] [DEBUG] [LOCAL ] GDIV: Loaded 3625 existing records from primary storage. [2025-10-10T19:06:28.182219] [INFO ] [MAIN ] GDIV: Loaded 3625 existing records. [2025-10-10T19:06:28.294632] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-10T19:06:28.362352] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:06:28.362698] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-10T19:06:28.362770] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-10T19:06:28.363014] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-10T19:06:28.363073] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-10T19:06:28.714622] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:06:29.089362] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-10T19:06:29.513316] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T19:06:29.782208] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-10T19:06:29.889398] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-10T19:06:30.305383] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-10T19:06:30.689391] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-10T19:06:31.385582] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-10T19:06:31.489346] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-10T19:06:31.754301] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T19:06:32.189783] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T19:06:32.289383] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-10T19:06:33.022209] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-10T19:06:33.089389] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-10T19:06:33.862558] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-10T19:06:33.889334] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-10T19:06:34.689383] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-10T19:06:34.858897] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-10T19:06:35.489415] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-10T19:06:36.289373] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-10T19:06:36.453347] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-10T19:06:36.787587] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T19:06:37.089378] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-10T19:06:37.780399] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-10T19:06:37.783827] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T19:06:37.889365] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-10T19:06:38.689417] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-10T19:06:38.700439] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-10T19:06:39.489384] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-10T19:06:40.204080] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-10T19:06:40.289413] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-10T19:06:40.790552] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-10T19:06:41.089377] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-10T19:06:41.228626] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T19:06:41.230170] [INFO ] [REMOTE ] GCV: Full fetch complete (9664 records). [2025-10-10T19:06:41.230241] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-10T19:06:41.594610] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-10T19:06:41.594731] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-10T19:06:41.595081] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-10T19:06:41.595123] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-10T19:06:41.595597] [DEBUG] [LOCAL ] GCV: Trimmed 9664 records to 7736 (keeping 200 days of data) [2025-10-10T19:06:41.644939] [DEBUG] [LOCAL ] GCV: Primary data saved (7736 records). [2025-10-10T19:06:41.645118] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-10T19:06:41.645220] [INFO ] [MAIN ] Update Progress: 905/2373 symbols completed. GCV took 28.5s. Estimated remaining: 3h 25m 24s. Rate: 7.1 symbols/min [2025-10-10T19:06:41.815003] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:06:41.820040] [DEBUG] [LOCAL ] GDL: Loaded 2566 existing records from primary storage. [2025-10-10T19:06:41.820248] [INFO ] [MAIN ] GDL: Loaded 2566 existing records. [2025-10-10T19:06:41.894560] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-10T19:06:42.005999] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:06:42.006292] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-10T19:06:42.006342] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-10T19:06:42.006560] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-10T19:06:42.006619] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-10T19:06:42.378179] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:06:42.689387] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-10T19:06:42.935601] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-10T19:06:43.049290] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-10T19:06:43.489421] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-10T19:06:43.947823] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T19:06:44.040160] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-10T19:06:44.289384] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-10T19:06:45.089435] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-10T19:06:45.889387] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-10T19:06:46.162168] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T19:06:46.474896] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-10T19:06:46.689364] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-10T19:06:46.873493] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-10T19:06:47.236587] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-10T19:06:47.489381] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-10T19:06:48.289433] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-10T19:06:48.885477] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-10T19:06:49.089366] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-10T19:06:49.668380] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-10T19:06:49.746190] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-10T19:06:49.889351] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-10T19:06:50.689367] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-10T19:06:51.350984] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-10T19:06:51.489339] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-10T19:06:51.727127] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T19:06:52.102514] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-10T19:06:52.289459] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-10T19:06:53.089384] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-10T19:06:53.670762] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-10T19:06:53.889383] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-10T19:06:54.322311] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-10T19:06:54.518816] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-10T19:06:54.689379] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-10T19:06:55.334778] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-10T19:06:55.489396] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-10T19:06:56.167275] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-10T19:06:56.289410] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-10T19:06:56.817945] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-10T19:06:56.818778] [INFO ] [REMOTE ] GDL: Full fetch complete (3549 records). [2025-10-10T19:06:56.818848] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-10T19:06:57.094678] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-10T19:06:57.192154] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-10T19:06:57.192256] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-10T19:06:57.192429] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-10T19:06:57.192489] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-10T19:06:57.192861] [DEBUG] [LOCAL ] GDL: Trimmed 3549 records to 2585 (keeping 200 days of data) [2025-10-10T19:06:57.208763] [DEBUG] [LOCAL ] GDL: Primary data saved (2585 records). [2025-10-10T19:06:57.208853] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-10T19:06:57.208929] [INFO ] [MAIN ] Update Progress: 906/2373 symbols completed. GDL took 15.6s. Estimated remaining: 3h 25m 27s. Rate: 7.1 symbols/min [2025-10-10T19:06:57.388511] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:06:57.398079] [DEBUG] [LOCAL ] GDO: Loaded 5961 existing records from primary storage. [2025-10-10T19:06:57.398374] [INFO ] [MAIN ] GDO: Loaded 5961 existing records. [2025-10-10T19:06:57.614328] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:06:57.614636] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-10T19:06:57.614745] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-10T19:06:57.614940] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-10T19:06:57.614999] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-10T19:06:57.820771] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-10T19:06:57.894570] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-10T19:06:58.058377] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:06:58.558210] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-10T19:06:58.689386] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-10T19:06:59.489431] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-10T19:07:00.289409] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-10T19:07:00.819347] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-10T19:07:00.863990] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T19:07:00.996514] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T19:07:00.997569] [INFO ] [REMOTE ] GDIV: Full fetch complete (5479 records). [2025-10-10T19:07:00.997673] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-10T19:07:01.096530] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-10T19:07:01.376170] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-10T19:07:01.376294] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-10T19:07:01.376498] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-10T19:07:01.376541] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-10T19:07:01.377151] [DEBUG] [LOCAL ] GDIV: Trimmed 5479 records to 3659 (keeping 200 days of data) [2025-10-10T19:07:01.403199] [DEBUG] [LOCAL ] GDIV: Primary data saved (3659 records). [2025-10-10T19:07:01.403376] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-10T19:07:01.403485] [INFO ] [MAIN ] Update Progress: 907/2373 symbols completed. GDIV took 33.4s. Estimated remaining: 3h 25m 12s. Rate: 7.1 symbols/min [2025-10-10T19:07:01.621405] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:07:01.670984] [DEBUG] [LOCAL ] GDOT: Loaded 38054 existing records from primary storage. [2025-10-10T19:07:01.671353] [INFO ] [MAIN ] GDOT: Loaded 38054 existing records. [2025-10-10T19:07:01.895960] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-10T19:07:01.907496] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:07:01.909039] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-10T19:07:01.909139] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-10T19:07:01.909427] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-10T19:07:01.909498] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-10T19:07:02.360041] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:07:02.689451] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-10T19:07:03.004715] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-10T19:07:03.047788] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-10T19:07:03.489402] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-10T19:07:04.132426] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-10T19:07:04.289461] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-10T19:07:05.089374] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-10T19:07:05.110438] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-10T19:07:05.565297] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T19:07:05.889387] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-10T19:07:06.566537] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-10T19:07:06.668842] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-10T19:07:06.689404] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-10T19:07:07.443572] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-10T19:07:07.489412] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-10T19:07:08.289363] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-10T19:07:08.338359] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-10T19:07:09.089386] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-10T19:07:09.889393] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-10T19:07:10.142871] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-10T19:07:10.147780] [INFO ] [REMOTE ] GD: Full fetch complete (69825 records). [2025-10-10T19:07:10.147937] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-10T19:07:10.594979] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-10T19:07:10.599130] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-10T19:07:10.603679] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-10T19:07:10.605436] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-10T19:07:10.605733] [INFO ] [REMOTE ] GDDY: Full fetch complete (71805 records). [2025-10-10T19:07:10.605957] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-10T19:07:10.606707] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-10T19:07:10.691083] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-10T19:07:10.702768] [DEBUG] [LOCAL ] GD: Trimmed 69825 records to 47478 (keeping 200 days of data) [2025-10-10T19:07:10.786778] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-10T19:07:11.246835] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-10T19:07:11.249382] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-10T19:07:11.251578] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-10T19:07:11.253296] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-10T19:07:11.265888] [DEBUG] [LOCAL ] GDDY: Trimmed 71805 records to 50527 (keeping 200 days of data) [2025-10-10T19:07:11.515101] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-10T19:07:11.554300] [DEBUG] [LOCAL ] GD: Primary data saved (47478 records). [2025-10-10T19:07:11.557533] [INFO ] [MAIN ] GD: Full history saved. [2025-10-10T19:07:11.557714] [INFO ] [MAIN ] Update Progress: 908/2373 symbols completed. GD took 51.5s. Estimated remaining: 3h 25m 7s. Rate: 7.1 symbols/min [2025-10-10T19:07:11.787339] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:07:11.850044] [DEBUG] [LOCAL ] GDDY: Primary data saved (50527 records). [2025-10-10T19:07:11.850567] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-10T19:07:11.850436] [DEBUG] [LOCAL ] GDV: Loaded 19701 existing records from primary storage. [2025-10-10T19:07:11.850730] [INFO ] [MAIN ] Update Progress: 909/2373 symbols completed. GDDY took 50.5s. Estimated remaining: 3h 24m 45s. Rate: 7.2 symbols/min [2025-10-10T19:07:11.856521] [INFO ] [MAIN ] GDV: Loaded 19701 existing records. [2025-10-10T19:07:12.212710] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:07:12.231091] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:07:12.233820] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-10T19:07:12.235057] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-10T19:07:12.235255] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-10T19:07:12.242122] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-10T19:07:12.242323] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-10T19:07:12.290045] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-10T19:07:12.290107] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-10T19:07:12.604754] [DEBUG] [LOCAL ] GE: Loaded 54096 existing records from primary storage. [2025-10-10T19:07:12.639004] [INFO ] [MAIN ] GE: Loaded 54096 existing records. [2025-10-10T19:07:12.692816] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:07:12.851605] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:07:12.851908] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-10T19:07:12.851963] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-10T19:07:12.853306] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-10T19:07:12.853383] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-10T19:07:13.089425] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-10T19:07:13.265881] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:07:13.889342] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-10T19:07:14.110614] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T19:07:14.369064] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T19:07:14.682638] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-10T19:07:14.689356] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-10T19:07:15.489407] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-10T19:07:16.002360] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T19:07:16.289422] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-10T19:07:17.089671] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-10T19:07:17.092576] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-10T19:07:17.540347] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T19:07:17.889451] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-10T19:07:17.943896] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-10T19:07:18.689406] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-10T19:07:19.489390] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-10T19:07:19.558068] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-10T19:07:20.279843] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-10T19:07:20.289323] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-10T19:07:20.986793] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-10T19:07:20.987886] [INFO ] [REMOTE ] GDO: Full fetch complete (8673 records). [2025-10-10T19:07:20.987954] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-10T19:07:21.094463] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-10T19:07:21.374074] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-10T19:07:21.418862] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-10T19:07:21.418956] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-10T19:07:21.419401] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-10T19:07:21.419443] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-10T19:07:21.419901] [DEBUG] [LOCAL ] GDO: Trimmed 8673 records to 5982 (keeping 200 days of data) [2025-10-10T19:07:21.456449] [DEBUG] [LOCAL ] GDO: Primary data saved (5982 records). [2025-10-10T19:07:21.456556] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-10T19:07:21.456704] [INFO ] [MAIN ] Update Progress: 910/2373 symbols completed. GDO took 24.2s. Estimated remaining: 3h 24m 39s. Rate: 7.1 symbols/min [2025-10-10T19:07:21.628699] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:07:21.648782] [DEBUG] [LOCAL ] GEF: Loaded 20821 existing records from primary storage. [2025-10-10T19:07:21.649063] [INFO ] [MAIN ] GEF: Loaded 20821 existing records. [2025-10-10T19:07:21.829026] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:07:21.829315] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-10T19:07:21.829365] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-10T19:07:21.829961] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-10T19:07:21.830020] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-10T19:07:21.894590] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-10T19:07:22.204102] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:07:22.689404] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-10T19:07:22.729462] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T19:07:23.480942] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-10T19:07:23.489325] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-10T19:07:24.256318] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-10T19:07:24.289390] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-10T19:07:24.449109] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-10T19:07:25.089442] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-10T19:07:25.889373] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-10T19:07:26.267980] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-10T19:07:26.453527] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-10T19:07:26.689419] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-10T19:07:27.195529] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-10T19:07:27.400337] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-10T19:07:27.489342] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-10T19:07:28.289407] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-10T19:07:28.759236] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-10T19:07:29.089476] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-10T19:07:29.118934] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-10T19:07:29.889415] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-10T19:07:30.689369] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-10T19:07:30.966986] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-10T19:07:31.489412] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-10T19:07:31.647769] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-10T19:07:32.024769] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T19:07:32.289410] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-10T19:07:33.089365] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-10T19:07:33.289083] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-10T19:07:33.889405] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-10T19:07:34.247989] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-10T19:07:34.690163] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-10T19:07:34.690327] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-10T19:07:35.319402] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-10T19:07:35.489382] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-10T19:07:36.050790] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-10T19:07:36.289405] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-10T19:07:37.089404] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-10T19:07:37.889346] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-10T19:07:37.992179] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-10T19:07:38.022619] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-10T19:07:38.444486] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-10T19:07:38.689349] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-10T19:07:39.226129] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-10T19:07:39.489423] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-10T19:07:40.289415] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-10T19:07:40.837342] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-10T19:07:41.089452] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-10T19:07:41.163720] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-10T19:07:41.167456] [INFO ] [REMOTE ] GDOT: Full fetch complete (53136 records). [2025-10-10T19:07:41.167554] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-10T19:07:41.497902] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T19:07:41.570324] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-10T19:07:41.570407] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-10T19:07:41.571254] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-10T19:07:41.571317] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-10T19:07:41.572540] [DEBUG] [LOCAL ] GDOT: Trimmed 53136 records to 38316 (keeping 200 days of data) [2025-10-10T19:07:41.791410] [DEBUG] [LOCAL ] GDOT: Primary data saved (38316 records). [2025-10-10T19:07:41.791553] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-10T19:07:41.791638] [INFO ] [MAIN ] Update Progress: 911/2373 symbols completed. GDOT took 40.4s. Estimated remaining: 3h 24m 49s. Rate: 7.1 symbols/min [2025-10-10T19:07:41.891693] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-10T19:07:41.963636] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:07:41.999957] [DEBUG] [LOCAL ] GEL: Loaded 32514 existing records from primary storage. [2025-10-10T19:07:42.000272] [INFO ] [MAIN ] GEL: Loaded 32514 existing records. [2025-10-10T19:07:42.196505] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:07:42.196985] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-10T19:07:42.197132] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-10T19:07:42.197442] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-10T19:07:42.197503] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-10T19:07:42.428833] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T19:07:42.583756] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:07:42.689358] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-10T19:07:42.848041] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-10T19:07:43.489396] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-10T19:07:44.030518] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T19:07:44.232491] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T19:07:44.235635] [INFO ] [REMOTE ] GDV: Full fetch complete (28483 records). [2025-10-10T19:07:44.235830] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-10T19:07:44.298450] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-10T19:07:44.663293] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-10T19:07:44.663391] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-10T19:07:44.664120] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-10T19:07:44.664184] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-10T19:07:44.664987] [DEBUG] [LOCAL ] GDV: Trimmed 28483 records to 19886 (keeping 200 days of data) [2025-10-10T19:07:44.782463] [DEBUG] [LOCAL ] GDV: Primary data saved (19886 records). [2025-10-10T19:07:44.782616] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-10T19:07:44.782732] [INFO ] [MAIN ] Update Progress: 912/2373 symbols completed. GDV took 33.2s. Estimated remaining: 3h 24m 32s. Rate: 7.1 symbols/min [2025-10-10T19:07:44.945213] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:07:44.994390] [DEBUG] [LOCAL ] GENI: Loaded 53328 existing records from primary storage. [2025-10-10T19:07:44.994821] [INFO ] [MAIN ] GENI: Loaded 53328 existing records. [2025-10-10T19:07:45.094456] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-10T19:07:45.179311] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:07:45.179747] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-10T19:07:45.179823] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-10T19:07:45.180958] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-10T19:07:45.181022] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-10T19:07:45.324123] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-10T19:07:45.549963] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:07:45.889426] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-10T19:07:46.689346] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-10T19:07:46.752363] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-10T19:07:46.835606] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T19:07:46.837967] [INFO ] [REMOTE ] GEF: Full fetch complete (29303 records). [2025-10-10T19:07:46.838038] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-10T19:07:47.199101] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-10T19:07:47.199188] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-10T19:07:47.199838] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-10T19:07:47.199899] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-10T19:07:47.200636] [DEBUG] [LOCAL ] GEF: Trimmed 29303 records to 20991 (keeping 200 days of data) [2025-10-10T19:07:47.326104] [DEBUG] [LOCAL ] GEF: Primary data saved (20991 records). [2025-10-10T19:07:47.326244] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-10T19:07:47.326335] [INFO ] [MAIN ] Update Progress: 913/2373 symbols completed. GEF took 25.9s. Estimated remaining: 3h 24m 15s. Rate: 7.1 symbols/min [2025-10-10T19:07:47.493678] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-10T19:07:47.493595] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:07:47.544201] [DEBUG] [LOCAL ] GEO: Loaded 52261 existing records from primary storage. [2025-10-10T19:07:47.544547] [INFO ] [MAIN ] GEO: Loaded 52261 existing records. [2025-10-10T19:07:47.718141] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:07:47.718412] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-10T19:07:47.718460] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-10T19:07:47.718986] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-10T19:07:47.719044] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-10T19:07:48.075215] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:07:48.230451] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T19:07:48.289348] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-10T19:07:48.427491] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-10T19:07:49.089374] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-10T19:07:49.889387] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-10T19:07:50.608587] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-10T19:07:50.689340] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-10T19:07:50.785176] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-10T19:07:51.489403] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-10T19:07:51.752033] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T19:07:51.785951] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-10T19:07:52.289389] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-10T19:07:53.089352] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-10T19:07:53.644498] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-10T19:07:53.889390] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-10T19:07:53.956897] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-10T19:07:54.157615] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-10T19:07:54.689448] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-10T19:07:55.489465] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-10T19:07:56.291976] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-10T19:07:56.300837] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-10T19:07:56.995873] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-10T19:07:57.089354] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-10T19:07:57.575118] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-10T19:07:57.889350] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-10T19:07:58.433389] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T19:07:58.689448] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-10T19:07:59.493547] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-10T19:07:59.499692] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-10T19:07:59.933849] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-10T19:08:00.294624] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-10T19:08:00.308512] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T19:08:01.074542] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T19:08:01.089329] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-10T19:08:01.889368] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-10T19:08:02.426189] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-10T19:08:02.689366] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-10T19:08:02.970992] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T19:08:03.125003] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-10T19:08:03.489405] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-10T19:08:04.289371] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-10T19:08:04.645301] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T19:08:05.089360] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-10T19:08:05.455458] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-10T19:08:05.617120] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T19:08:05.889375] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-10T19:08:06.689435] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-10T19:08:06.806355] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T19:08:06.809093] [INFO ] [REMOTE ] GEL: Full fetch complete (48142 records). [2025-10-10T19:08:06.809228] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-10T19:08:07.196974] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-10T19:08:07.197105] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-10T19:08:07.197994] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-10T19:08:07.198076] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-10T19:08:07.199503] [DEBUG] [LOCAL ] GEL: Trimmed 48142 records to 32658 (keeping 200 days of data) [2025-10-10T19:08:07.317668] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-10T19:08:07.433570] [DEBUG] [LOCAL ] GEL: Primary data saved (32658 records). [2025-10-10T19:08:07.433743] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-10T19:08:07.433846] [INFO ] [MAIN ] Update Progress: 914/2373 symbols completed. GEL took 25.6s. Estimated remaining: 3h 24m 25s. Rate: 7.1 symbols/min [2025-10-10T19:08:07.496577] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-10T19:08:07.601453] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:08:07.640880] [DEBUG] [LOCAL ] GES: Loaded 38897 existing records from primary storage. [2025-10-10T19:08:07.641230] [INFO ] [MAIN ] GES: Loaded 38897 existing records. [2025-10-10T19:08:07.821137] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:08:07.821684] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-10T19:08:07.821749] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-10T19:08:07.822253] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-10T19:08:07.822319] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-10T19:08:08.171368] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:08:08.289348] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-10T19:08:08.778707] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-10T19:08:09.006482] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-10T19:08:09.089404] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-10T19:08:09.889349] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-10T19:08:10.141476] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T19:08:10.689410] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-10T19:08:11.403298] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-10T19:08:11.408781] [INFO ] [REMOTE ] GE: Full fetch complete (77771 records). [2025-10-10T19:08:11.408989] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-10T19:08:11.491438] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-10T19:08:11.817333] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-10T19:08:11.817460] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-10T19:08:11.818508] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-10T19:08:11.818601] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-10T19:08:11.849314] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T19:08:11.849445] [DEBUG] [LOCAL ] GE: Trimmed 77771 records to 54486 (keeping 200 days of data) [2025-10-10T19:08:12.203833] [DEBUG] [LOCAL ] GE: Primary data saved (54486 records). [2025-10-10T19:08:12.204010] [INFO ] [MAIN ] GE: Full history saved. [2025-10-10T19:08:12.204115] [INFO ] [MAIN ] Update Progress: 915/2373 symbols completed. GE took 1m 0s. Estimated remaining: 3h 24m 11s. Rate: 7.1 symbols/min [2025-10-10T19:08:12.305527] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-10T19:08:12.378699] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:08:12.404308] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T19:08:12.443453] [DEBUG] [LOCAL ] GETY: Loaded 35597 existing records from primary storage. [2025-10-10T19:08:12.443848] [INFO ] [MAIN ] GETY: Loaded 35597 existing records. [2025-10-10T19:08:12.618389] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:08:12.618691] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-10T19:08:12.618751] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-10T19:08:12.618982] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-10T19:08:12.619038] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-10T19:08:12.988256] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:08:13.089427] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-10T19:08:13.594358] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-10T19:08:13.839504] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-10T19:08:13.889348] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-10T19:08:14.502011] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-10T19:08:14.689384] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-10T19:08:15.489383] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-10T19:08:15.787889] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T19:08:16.289433] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-10T19:08:16.651126] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T19:08:17.089394] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-10T19:08:17.607108] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-10T19:08:17.889349] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-10T19:08:17.986852] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-10T19:08:17.991817] [INFO ] [REMOTE ] GEO: Full fetch complete (75407 records). [2025-10-10T19:08:17.991965] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-10T19:08:18.383982] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T19:08:18.430695] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-10T19:08:18.430786] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-10T19:08:18.431778] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-10T19:08:18.431846] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-10T19:08:18.433342] [DEBUG] [LOCAL ] GEO: Trimmed 75407 records to 52625 (keeping 200 days of data) [2025-10-10T19:08:18.711047] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-10T19:08:18.758396] [DEBUG] [LOCAL ] GEO: Primary data saved (52625 records). [2025-10-10T19:08:18.758555] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-10T19:08:18.758936] [INFO ] [MAIN ] Update Progress: 916/2373 symbols completed. GEO took 31.4s. Estimated remaining: 3h 23m 59s. Rate: 7.1 symbols/min [2025-10-10T19:08:18.929825] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:08:18.982002] [DEBUG] [LOCAL ] GEV: Loaded 53394 existing records from primary storage. [2025-10-10T19:08:18.982335] [INFO ] [MAIN ] GEV: Loaded 53394 existing records. [2025-10-10T19:08:19.155749] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:08:19.155996] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-10T19:08:19.156045] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-10T19:08:19.156327] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-10T19:08:19.156384] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-10T19:08:19.493341] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-10T19:08:19.517167] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:08:19.548812] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T19:08:20.289433] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-10T19:08:20.790152] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-10T19:08:21.089365] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-10T19:08:21.418315] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-10T19:08:21.423384] [INFO ] [REMOTE ] GENI: Full fetch complete (75652 records). [2025-10-10T19:08:21.423505] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-10T19:08:21.660964] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T19:08:21.861811] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-10T19:08:21.861889] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-10T19:08:21.862889] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-10T19:08:21.862951] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-10T19:08:21.864520] [DEBUG] [LOCAL ] GENI: Trimmed 75652 records to 53716 (keeping 200 days of data) [2025-10-10T19:08:21.913080] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-10T19:08:22.182373] [DEBUG] [LOCAL ] GENI: Primary data saved (53716 records). [2025-10-10T19:08:22.182554] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-10T19:08:22.182713] [INFO ] [MAIN ] Update Progress: 917/2373 symbols completed. GENI took 37.4s. Estimated remaining: 3h 23m 43s. Rate: 7.1 symbols/min [2025-10-10T19:08:22.689402] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-10T19:08:22.949245] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T19:08:23.489370] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-10T19:08:23.899410] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T19:08:24.289439] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-10T19:08:25.113967] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-10T19:08:25.125067] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-10T19:08:25.227236] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-10T19:08:25.889421] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-10T19:08:25.922564] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T19:08:26.689418] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-10T19:08:27.584528] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-10T19:08:27.593695] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-10T19:08:27.743290] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-10T19:08:28.289414] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-10T19:08:28.444272] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T19:08:28.726148] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T19:08:29.089405] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-10T19:08:29.889408] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-10T19:08:30.719315] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-10T19:08:30.729916] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-10T19:08:30.771422] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T19:08:31.124106] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T19:08:31.489396] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-10T19:08:32.289419] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-10T19:08:33.204724] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T19:08:33.213459] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-10T19:08:33.284498] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-10T19:08:33.744941] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-10T19:08:33.749130] [INFO ] [REMOTE ] GES: Full fetch complete (58908 records). [2025-10-10T19:08:33.749260] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-10T19:08:33.894456] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-10T19:08:34.201380] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-10T19:08:34.201462] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-10T19:08:34.202366] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-10T19:08:34.202454] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-10T19:08:34.204047] [DEBUG] [LOCAL ] GES: Trimmed 58908 records to 39210 (keeping 200 days of data) [2025-10-10T19:08:34.479103] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-10T19:08:34.501209] [DEBUG] [LOCAL ] GES: Primary data saved (39210 records). [2025-10-10T19:08:34.501379] [INFO ] [MAIN ] GES: Full history saved. [2025-10-10T19:08:34.501471] [INFO ] [MAIN ] Update Progress: 918/2373 symbols completed. GES took 27.1s. Estimated remaining: 3h 23m 41s. Rate: 7.1 symbols/min [2025-10-10T19:08:34.689409] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-10T19:08:36.238783] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-10T19:08:36.246290] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-10T19:08:36.395514] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-10T19:08:36.406965] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-10T19:08:37.748066] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T19:08:37.751810] [INFO ] [REMOTE ] GETY: Full fetch complete (55478 records). [2025-10-10T19:08:37.751931] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-10T19:08:38.124703] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-10T19:08:38.124814] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-10T19:08:38.125582] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-10T19:08:38.125623] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-10T19:08:38.126764] [DEBUG] [LOCAL ] GETY: Trimmed 55478 records to 35855 (keeping 200 days of data) [2025-10-10T19:08:38.322177] [DEBUG] [LOCAL ] GETY: Primary data saved (35855 records). [2025-10-10T19:08:38.322320] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-10T19:08:38.322400] [INFO ] [MAIN ] Update Progress: 919/2373 symbols completed. GETY took 26.1s. Estimated remaining: 3h 23m 25s. Rate: 7.1 symbols/min [2025-10-10T19:08:38.586243] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-10T19:08:38.597398] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-10T19:08:41.180966] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-10T19:08:41.192233] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-10T19:08:43.958136] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-10T19:08:43.969968] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-10T19:08:46.901001] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-10-10T19:08:46.912900] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-10T19:08:49.432300] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-10T19:08:49.443493] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-10T19:08:52.057317] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-10T19:08:52.062288] [INFO ] [REMOTE ] GEV: Full fetch complete (76889 records). [2025-10-10T19:08:52.062420] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-10T19:08:52.439951] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-10T19:08:52.440035] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-10T19:08:52.441003] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-10T19:08:52.441071] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-10T19:08:52.442517] [DEBUG] [LOCAL ] GEV: Trimmed 76889 records to 53780 (keeping 200 days of data) [2025-10-10T19:08:52.779214] [DEBUG] [LOCAL ] GEV: Primary data saved (53780 records). [2025-10-10T19:08:52.779400] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-10T19:08:52.779814] [INFO ] [MAIN ] Update Progress: 920/2373 symbols completed. GEV took 34.0s. Estimated remaining: 3h 23m 26s. Rate: 7.1 symbols/min [2025-10-10T19:08:53.393703] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:08:53.385165] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:08:53.436984] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:08:53.471237] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:08:53.475321] [DEBUG] [LOCAL ] GF: Loaded 2790 existing records from primary storage. [2025-10-10T19:08:53.476127] [INFO ] [MAIN ] GF: Loaded 2790 existing records. [2025-10-10T19:08:53.669794] [DEBUG] [LOCAL ] GFF: Loaded 30371 existing records from primary storage. [2025-10-10T19:08:53.719547] [INFO ] [MAIN ] GFF: Loaded 30371 existing records. [2025-10-10T19:08:53.754189] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:08:53.816428] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-10T19:08:53.857046] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-10T19:08:53.862893] [DEBUG] [LOCAL ] GFL: Loaded 48223 existing records from primary storage. [2025-10-10T19:08:53.880709] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-10T19:08:53.881265] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-10T19:08:53.874811] [DEBUG] [LOCAL ] GFI: Loaded 53488 existing records from primary storage. [2025-10-10T19:08:53.881560] [INFO ] [MAIN ] GFL: Loaded 48223 existing records. [2025-10-10T19:08:53.894877] [INFO ] [MAIN ] GFI: Loaded 53488 existing records. [2025-10-10T19:08:54.285626] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:08:54.347551] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-10T19:08:54.358451] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-10T19:08:54.405776] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-10T19:08:54.500140] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-10T19:08:54.606171] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:08:54.626835] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:08:54.726893] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-10T19:08:54.737458] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-10T19:08:54.737348] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-10T19:08:54.753155] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-10T19:08:54.796730] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-10T19:08:54.800989] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-10T19:08:54.806371] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-10T19:08:54.812435] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-10T19:08:55.164043] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:08:55.316260] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-10T19:08:55.751940] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:08:55.773035] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-10T19:08:55.841457] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:08:55.874958] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-10T19:08:55.922154] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:08:55.922942] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-10T19:08:56.190353] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-10T19:08:56.192130] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-10T19:08:56.884761] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-10T19:08:56.886331] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-10T19:08:57.225968] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-10T19:08:57.231953] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-10T19:08:57.578136] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-10T19:08:57.579901] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-10T19:08:57.658541] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-10T19:08:57.667537] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-10T19:08:57.864714] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-10T19:08:57.875319] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-10T19:08:58.283108] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-10T19:08:58.289373] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-10T19:08:58.420121] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-10T19:08:58.422173] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-10T19:08:59.127749] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-10T19:08:59.129241] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-10T19:08:59.161541] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-10T19:08:59.170887] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-10T19:08:59.749501] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T19:08:59.760466] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-10T19:08:59.800441] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-10T19:08:59.806677] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-10T19:08:59.865215] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-10T19:08:59.866937] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-10T19:09:00.256270] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-10T19:09:00.257695] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-10T19:09:00.456337] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T19:09:00.465348] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-10T19:09:00.880278] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-10T19:09:00.881726] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-10T19:09:01.513511] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-10T19:09:01.515103] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-10T19:09:01.550917] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T19:09:01.561595] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-10T19:09:01.591982] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T19:09:01.599452] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-10T19:09:01.905178] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-10T19:09:01.916325] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-10T19:09:02.055221] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-10T19:09:02.056478] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-10T19:09:02.629805] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-10T19:09:02.630787] [INFO ] [REMOTE ] GF: Full fetch complete (5017 records). [2025-10-10T19:09:02.630861] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-10T19:09:03.061287] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-10T19:09:03.061463] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-10T19:09:03.061968] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-10T19:09:03.062112] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-10T19:09:03.063495] [DEBUG] [LOCAL ] GF: Trimmed 5017 records to 2802 (keeping 200 days of data) [2025-10-10T19:09:03.095854] [DEBUG] [LOCAL ] GF: Primary data saved (2802 records). [2025-10-10T19:09:03.096086] [INFO ] [MAIN ] GF: Full history saved. [2025-10-10T19:09:03.096251] [INFO ] [MAIN ] Update Progress: 921/2373 symbols completed. GF took 10.3s. Estimated remaining: 3h 23m 21s. Rate: 7.1 symbols/min [2025-10-10T19:09:03.329331] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:09:03.368785] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T19:09:03.387120] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-10T19:09:03.393330] [DEBUG] [LOCAL ] GFR: Loaded 7968 existing records from primary storage. [2025-10-10T19:09:03.396013] [INFO ] [MAIN ] GFR: Loaded 7968 existing records. [2025-10-10T19:09:03.659401] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:09:03.660586] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-10T19:09:03.661119] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-10T19:09:03.661621] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-10T19:09:03.661735] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-10T19:09:04.080442] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-10T19:09:04.175341] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-10T19:09:04.199412] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-10T19:09:04.236920] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:09:04.238400] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-10T19:09:04.239501] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-10T19:09:04.609688] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-10T19:09:04.617292] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-10T19:09:05.187377] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-10T19:09:05.191144] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-10T19:09:05.662387] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-10T19:09:05.697777] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-10T19:09:05.722192] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-10T19:09:05.889352] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-10T19:09:06.656863] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-10T19:09:06.689339] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-10T19:09:07.274373] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-10T19:09:07.489371] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-10T19:09:08.289361] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-10T19:09:08.810526] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-10T19:09:09.089355] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-10T19:09:09.200299] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-10T19:09:09.202813] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-10T19:09:09.889382] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-10T19:09:10.689366] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-10T19:09:11.286631] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-10T19:09:11.489338] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-10T19:09:11.663060] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-10T19:09:11.708796] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-10T19:09:12.289380] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-10T19:09:13.089392] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-10T19:09:13.745701] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-10T19:09:13.889395] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-10T19:09:14.011080] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-10T19:09:14.679746] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-10T19:09:14.689332] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-10T19:09:15.489347] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-10T19:09:15.674065] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T19:09:16.136751] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-10T19:09:16.289443] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-10T19:09:17.089434] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-10T19:09:17.364899] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T19:09:17.889415] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-10T19:09:18.089994] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T19:09:18.090598] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-10T19:09:18.689418] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-10T19:09:19.096577] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-10T19:09:19.099531] [INFO ] [REMOTE ] GFF: Full fetch complete (44017 records). [2025-10-10T19:09:19.099683] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-10T19:09:19.484331] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-10T19:09:19.484505] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-10T19:09:19.486088] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-10T19:09:19.486173] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-10T19:09:19.487845] [DEBUG] [LOCAL ] GFF: Trimmed 44017 records to 30567 (keeping 200 days of data) [2025-10-10T19:09:19.489467] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-10T19:09:19.689835] [DEBUG] [LOCAL ] GFF: Primary data saved (30567 records). [2025-10-10T19:09:19.690027] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-10T19:09:19.690152] [INFO ] [MAIN ] Update Progress: 922/2373 symbols completed. GFF took 26.9s. Estimated remaining: 3h 23m 25s. Rate: 7.1 symbols/min [2025-10-10T19:09:19.867809] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:09:19.922229] [DEBUG] [LOCAL ] GGB: Loaded 51552 existing records from primary storage. [2025-10-10T19:09:19.922672] [INFO ] [MAIN ] GGB: Loaded 51552 existing records. [2025-10-10T19:09:20.124687] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:09:20.124993] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-10T19:09:20.125045] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-10T19:09:20.125500] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-10T19:09:20.125559] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-10T19:09:20.295974] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-10T19:09:20.479247] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:09:20.980418] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-10T19:09:20.985490] [INFO ] [REMOTE ] GFI: Full fetch complete (76498 records). [2025-10-10T19:09:20.985615] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-10T19:09:21.090587] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-10T19:09:21.101476] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-10T19:09:21.395322] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-10T19:09:21.395529] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-10T19:09:21.396579] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-10T19:09:21.396687] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-10T19:09:21.409019] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-10T19:09:21.413218] [DEBUG] [LOCAL ] GFI: Trimmed 76498 records to 53878 (keeping 200 days of data) [2025-10-10T19:09:21.414077] [INFO ] [REMOTE ] GFL: Full fetch complete (69204 records). [2025-10-10T19:09:21.414333] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-10T19:09:21.892709] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-10T19:09:22.063832] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-10T19:09:22.063962] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-10T19:09:22.065210] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-10T19:09:22.099094] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-10T19:09:22.142553] [DEBUG] [LOCAL ] GFL: Trimmed 69204 records to 48588 (keeping 200 days of data) [2025-10-10T19:09:22.244740] [DEBUG] [LOCAL ] GFI: Primary data saved (53878 records). [2025-10-10T19:09:22.247622] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-10T19:09:22.247770] [INFO ] [MAIN ] Update Progress: 923/2373 symbols completed. GFI took 29.5s. Estimated remaining: 3h 23m 8s. Rate: 7.1 symbols/min [2025-10-10T19:09:22.476087] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:09:22.672526] [DEBUG] [LOCAL ] GFL: Primary data saved (48588 records). [2025-10-10T19:09:22.672743] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-10T19:09:22.672907] [INFO ] [MAIN ] Update Progress: 924/2373 symbols completed. GFL took 29.9s. Estimated remaining: 3h 22m 47s. Rate: 7.1 symbols/min [2025-10-10T19:09:22.685540] [DEBUG] [LOCAL ] GGG: Loaded 41084 existing records from primary storage. [2025-10-10T19:09:22.738792] [INFO ] [MAIN ] GGG: Loaded 41084 existing records. [2025-10-10T19:09:22.977296] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:09:23.038257] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:09:23.038615] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-10T19:09:23.038787] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-10T19:09:23.049995] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-10T19:09:23.070514] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-10T19:09:23.083221] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-10T19:09:23.092621] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T19:09:23.120903] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-10T19:09:23.149946] [DEBUG] [LOCAL ] GGT: Loaded 14247 existing records from primary storage. [2025-10-10T19:09:23.188376] [INFO ] [MAIN ] GGT: Loaded 14247 existing records. [2025-10-10T19:09:23.517353] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-10T19:09:23.531925] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:09:23.538354] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-10T19:09:23.544510] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-10T19:09:23.550327] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-10T19:09:23.555592] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-10T19:09:23.758879] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:09:23.956499] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-10T19:09:24.019132] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:09:24.289363] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-10T19:09:25.089450] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-10T19:09:25.326815] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T19:09:25.398314] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-10T19:09:25.889395] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-10T19:09:26.689368] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-10T19:09:26.780921] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T19:09:26.815102] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T19:09:27.404326] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-10T19:09:27.489335] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-10T19:09:28.289407] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-10T19:09:28.414029] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-10T19:09:29.089392] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-10T19:09:29.819745] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T19:09:29.820910] [INFO ] [REMOTE ] GFR: Full fetch complete (12336 records). [2025-10-10T19:09:29.820979] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-10T19:09:29.890349] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-10T19:09:30.240557] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-10T19:09:30.240302] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T19:09:30.240723] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-10T19:09:30.241500] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-10T19:09:30.251165] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-10T19:09:30.252718] [DEBUG] [LOCAL ] GFR: Trimmed 12336 records to 8021 (keeping 200 days of data) [2025-10-10T19:09:30.300140] [DEBUG] [LOCAL ] GFR: Primary data saved (8021 records). [2025-10-10T19:09:30.300330] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-10T19:09:30.300455] [INFO ] [MAIN ] Update Progress: 925/2373 symbols completed. GFR took 27.2s. Estimated remaining: 3h 22m 37s. Rate: 7.1 symbols/min [2025-10-10T19:09:30.483452] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:09:30.489311] [DEBUG] [LOCAL ] GGZ: Loaded 2437 existing records from primary storage. [2025-10-10T19:09:30.489489] [INFO ] [MAIN ] GGZ: Loaded 2437 existing records. [2025-10-10T19:09:30.673051] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:09:30.673432] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-10T19:09:30.673486] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-10T19:09:30.673699] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-10T19:09:30.673755] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-10T19:09:30.694580] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-10T19:09:31.048693] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:09:31.489363] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-10T19:09:31.614335] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-10T19:09:31.697558] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-10T19:09:31.885110] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-10T19:09:32.289393] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-10T19:09:33.031405] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-10T19:09:33.089343] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-10T19:09:33.889403] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-10T19:09:34.689904] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-10T19:09:34.701310] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T19:09:34.925577] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-10T19:09:35.489398] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-10T19:09:36.184318] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-10T19:09:36.289447] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-10T19:09:36.599744] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-10T19:09:37.089355] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-10T19:09:37.589723] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T19:09:37.648544] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-10T19:09:37.889403] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-10T19:09:38.689401] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-10T19:09:39.489396] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-10T19:09:39.772240] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T19:09:39.849928] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-10T19:09:40.289402] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-10T19:09:40.905987] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-10T19:09:41.089423] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-10T19:09:41.424489] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-10T19:09:41.889389] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-10T19:09:42.452484] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-10T19:09:42.689376] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-10T19:09:43.084527] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T19:09:43.359988] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-10T19:09:43.489388] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-10T19:09:44.289405] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-10T19:09:44.487284] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-10T19:09:45.089412] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-10T19:09:45.889385] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-10T19:09:46.198707] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T19:09:46.689461] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-10T19:09:46.996081] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-10T19:09:47.089233] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-10T19:09:47.489449] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-10T19:09:48.002710] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-10T19:09:48.289467] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-10T19:09:48.530905] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-10T19:09:48.533061] [INFO ] [REMOTE ] GGT: Full fetch complete (18733 records). [2025-10-10T19:09:48.533154] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-10T19:09:48.968504] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-10T19:09:48.968604] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-10T19:09:48.969323] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-10T19:09:48.969388] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-10T19:09:48.970151] [DEBUG] [LOCAL ] GGT: Trimmed 18733 records to 14394 (keeping 200 days of data) [2025-10-10T19:09:49.063541] [DEBUG] [LOCAL ] GGT: Primary data saved (14394 records). [2025-10-10T19:09:49.063747] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-10T19:09:49.063861] [INFO ] [MAIN ] Update Progress: 926/2373 symbols completed. GGT took 26.4s. Estimated remaining: 3h 22m 45s. Rate: 7.1 symbols/min [2025-10-10T19:09:49.098358] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-10T19:09:49.257089] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:09:49.262435] [DEBUG] [LOCAL ] GHC: Loaded 2863 existing records from primary storage. [2025-10-10T19:09:49.262675] [INFO ] [MAIN ] GHC: Loaded 2863 existing records. [2025-10-10T19:09:49.456785] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:09:49.457112] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-10T19:09:49.457178] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-10T19:09:49.457464] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-10T19:09:49.457528] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-10T19:09:49.711962] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-10T19:09:49.836553] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:09:49.889365] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-10T19:09:50.341963] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-10T19:09:50.689423] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-10T19:09:51.118250] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-10T19:09:51.466065] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T19:09:51.489344] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-10T19:09:52.289403] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-10T19:09:52.826421] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-10T19:09:53.089361] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-10T19:09:53.222117] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-10T19:09:53.889413] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-10T19:09:54.459312] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-10T19:09:54.689409] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-10T19:09:54.965866] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-10T19:09:55.489459] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-10T19:09:56.087989] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-10T19:09:56.294619] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-10T19:09:56.317241] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-10T19:09:56.937091] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-10T19:09:57.089451] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-10T19:09:57.474569] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-10T19:09:57.889385] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-10T19:09:58.689443] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-10T19:09:59.234603] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-10T19:09:59.499995] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-10T19:09:59.506423] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-10T19:10:00.289400] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-10T19:10:00.867618] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-10T19:10:01.089440] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-10T19:10:01.383219] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T19:10:01.815154] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T19:10:01.816165] [INFO ] [REMOTE ] GGZ: Full fetch complete (4040 records). [2025-10-10T19:10:01.816240] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-10T19:10:01.894468] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-10T19:10:02.261781] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-10T19:10:02.261952] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-10T19:10:02.262161] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-10T19:10:02.262208] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-10T19:10:02.262585] [DEBUG] [LOCAL ] GGZ: Trimmed 4040 records to 2465 (keeping 200 days of data) [2025-10-10T19:10:02.279088] [DEBUG] [LOCAL ] GGZ: Primary data saved (2465 records). [2025-10-10T19:10:02.279173] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-10T19:10:02.279258] [INFO ] [MAIN ] Update Progress: 927/2373 symbols completed. GGZ took 32.0s. Estimated remaining: 3h 22m 44s. Rate: 7.1 symbols/min [2025-10-10T19:10:02.459092] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:10:02.465109] [DEBUG] [LOCAL ] GHG: Loaded 3244 existing records from primary storage. [2025-10-10T19:10:02.465330] [INFO ] [MAIN ] GHG: Loaded 3244 existing records. [2025-10-10T19:10:02.655085] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:10:02.655352] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-10T19:10:02.655405] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-10T19:10:02.655624] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-10T19:10:02.655751] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-10T19:10:02.694623] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-10T19:10:03.052201] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:10:03.398960] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-10T19:10:03.489386] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-10T19:10:04.200767] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-10T19:10:04.217396] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-10T19:10:04.223744] [INFO ] [REMOTE ] GGB: Full fetch complete (74127 records). [2025-10-10T19:10:04.224010] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-10T19:10:04.294538] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-10T19:10:04.644841] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-10T19:10:04.644922] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-10T19:10:04.645887] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-10T19:10:04.645949] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-10T19:10:04.647430] [DEBUG] [LOCAL ] GGB: Trimmed 74127 records to 51931 (keeping 200 days of data) [2025-10-10T19:10:04.968034] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-10T19:10:04.992863] [DEBUG] [LOCAL ] GGB: Primary data saved (51931 records). [2025-10-10T19:10:04.993105] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-10T19:10:04.993245] [INFO ] [MAIN ] Update Progress: 928/2373 symbols completed. GGB took 45.3s. Estimated remaining: 3h 22m 27s. Rate: 7.1 symbols/min [2025-10-10T19:10:05.095960] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-10T19:10:05.181384] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:10:05.191273] [DEBUG] [LOCAL ] GHI: Loaded 7248 existing records from primary storage. [2025-10-10T19:10:05.191538] [INFO ] [MAIN ] GHI: Loaded 7248 existing records. [2025-10-10T19:10:05.378093] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:10:05.378455] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-10T19:10:05.378511] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-10T19:10:05.378968] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-10T19:10:05.379030] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-10T19:10:05.595239] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-10T19:10:05.794162] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:10:05.889395] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-10T19:10:06.648784] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-10T19:10:06.689396] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-10T19:10:07.489387] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-10T19:10:08.275030] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-10T19:10:08.278899] [INFO ] [REMOTE ] GGG: Full fetch complete (59316 records). [2025-10-10T19:10:08.279020] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-10T19:10:08.299833] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-10T19:10:08.388492] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T19:10:08.726960] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-10T19:10:08.727045] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-10T19:10:08.727874] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-10T19:10:08.727937] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-10T19:10:08.729318] [DEBUG] [LOCAL ] GGG: Trimmed 59316 records to 41367 (keeping 200 days of data) [2025-10-10T19:10:08.976038] [DEBUG] [LOCAL ] GGG: Primary data saved (41367 records). [2025-10-10T19:10:08.976179] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-10T19:10:08.976258] [INFO ] [MAIN ] Update Progress: 929/2373 symbols completed. GGG took 46.7s. Estimated remaining: 3h 22m 12s. Rate: 7.1 symbols/min [2025-10-10T19:10:09.094595] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-10T19:10:09.153090] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:10:09.160273] [DEBUG] [LOCAL ] GHLD: Loaded 4231 existing records from primary storage. [2025-10-10T19:10:09.160497] [INFO ] [MAIN ] GHLD: Loaded 4231 existing records. [2025-10-10T19:10:09.335680] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:10:09.335988] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-10T19:10:09.336038] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-10T19:10:09.336272] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-10T19:10:09.336333] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-10T19:10:09.630490] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T19:10:09.741046] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:10:09.754434] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-10T19:10:09.889423] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-10T19:10:10.227615] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-10T19:10:10.689386] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-10T19:10:11.489352] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-10T19:10:11.596388] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-10T19:10:12.244591] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-10T19:10:12.289365] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-10T19:10:12.951261] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-10T19:10:13.089397] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-10T19:10:13.799329] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-10T19:10:13.889368] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-10T19:10:14.689379] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-10T19:10:15.114375] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-10T19:10:15.250044] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-10T19:10:15.489387] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-10T19:10:16.289358] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-10T19:10:16.538095] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-10T19:10:16.609221] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-10T19:10:17.089381] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-10T19:10:17.613894] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-10T19:10:17.889402] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-10T19:10:18.689409] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-10T19:10:18.796839] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-10T19:10:19.384258] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-10T19:10:19.489397] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-10T19:10:20.289450] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-10T19:10:20.374992] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-10T19:10:20.924575] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-10T19:10:21.089424] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-10T19:10:21.856154] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-10T19:10:21.889328] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-10T19:10:22.582250] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T19:10:22.583265] [INFO ] [REMOTE ] GHG: Full fetch complete (4129 records). [2025-10-10T19:10:22.583334] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-10T19:10:22.694494] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-10T19:10:22.979455] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-10T19:10:22.979886] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-10T19:10:22.980086] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-10T19:10:22.980131] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-10T19:10:22.980550] [DEBUG] [LOCAL ] GHG: Trimmed 4129 records to 3294 (keeping 200 days of data) [2025-10-10T19:10:22.999509] [DEBUG] [LOCAL ] GHG: Primary data saved (3294 records). [2025-10-10T19:10:22.999580] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-10T19:10:22.999703] [INFO ] [MAIN ] Update Progress: 930/2373 symbols completed. GHG took 20.7s. Estimated remaining: 3h 22m 12s. Rate: 7.1 symbols/min [2025-10-10T19:10:23.166575] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:10:23.181092] [DEBUG] [LOCAL ] GHM: Loaded 14304 existing records from primary storage. [2025-10-10T19:10:23.181316] [INFO ] [MAIN ] GHM: Loaded 14304 existing records. [2025-10-10T19:10:23.353814] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:10:23.354108] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-10T19:10:23.354158] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-10T19:10:23.354926] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-10T19:10:23.354987] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-10T19:10:23.491903] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-10T19:10:23.624740] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-10T19:10:23.730101] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:10:24.142941] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-10T19:10:24.289368] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-10T19:10:25.089375] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-10T19:10:25.363756] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-10T19:10:25.364840] [INFO ] [REMOTE ] GHC: Full fetch complete (3564 records). [2025-10-10T19:10:25.364909] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-10T19:10:25.724368] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-10T19:10:25.724451] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-10T19:10:25.724583] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-10T19:10:25.724623] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-10T19:10:25.725018] [DEBUG] [LOCAL ] GHC: Trimmed 3564 records to 2905 (keeping 200 days of data) [2025-10-10T19:10:25.743227] [DEBUG] [LOCAL ] GHC: Primary data saved (2905 records). [2025-10-10T19:10:25.743318] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-10T19:10:25.743396] [INFO ] [MAIN ] Update Progress: 931/2373 symbols completed. GHC took 36.7s. Estimated remaining: 3h 21m 55s. Rate: 7.1 symbols/min [2025-10-10T19:10:25.895379] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-10T19:10:25.922312] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-10T19:10:25.920475] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:10:25.946079] [DEBUG] [LOCAL ] GHY: Loaded 21047 existing records from primary storage. [2025-10-10T19:10:25.946349] [INFO ] [MAIN ] GHY: Loaded 21047 existing records. [2025-10-10T19:10:26.117475] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:10:26.117771] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-10T19:10:26.117848] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-10T19:10:26.118548] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-10T19:10:26.118611] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-10T19:10:26.498721] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:10:26.689365] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-10T19:10:27.097722] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-10T19:10:27.489432] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-10T19:10:27.575363] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-10T19:10:28.289357] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-10T19:10:28.595863] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-10T19:10:29.089349] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-10T19:10:29.182942] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-10T19:10:29.889366] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-10T19:10:30.281945] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T19:10:30.689377] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-10T19:10:30.820986] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-10T19:10:31.258395] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-10T19:10:31.489389] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-10T19:10:32.289444] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-10T19:10:32.899759] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-10T19:10:33.089360] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-10T19:10:33.526610] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T19:10:33.889379] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-10T19:10:34.328770] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T19:10:34.689350] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-10T19:10:35.079471] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-10T19:10:35.489392] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-10T19:10:35.550822] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T19:10:35.552246] [INFO ] [REMOTE ] GHI: Full fetch complete (11363 records). [2025-10-10T19:10:35.552313] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-10T19:10:35.909940] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-10T19:10:35.910021] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-10T19:10:35.910341] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-10T19:10:35.910382] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-10T19:10:35.910851] [DEBUG] [LOCAL ] GHI: Trimmed 11363 records to 7339 (keeping 200 days of data) [2025-10-10T19:10:36.011569] [DEBUG] [LOCAL ] GHI: Primary data saved (7339 records). [2025-10-10T19:10:36.011803] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-10T19:10:36.011921] [INFO ] [MAIN ] Update Progress: 932/2373 symbols completed. GHI took 31.0s. Estimated remaining: 3h 21m 49s. Rate: 7.1 symbols/min [2025-10-10T19:10:36.190365] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:10:36.230802] [DEBUG] [LOCAL ] GIB: Loaded 32024 existing records from primary storage. [2025-10-10T19:10:36.231228] [INFO ] [MAIN ] GIB: Loaded 32024 existing records. [2025-10-10T19:10:36.294556] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-10T19:10:36.420245] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:10:36.420721] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-10T19:10:36.420853] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-10T19:10:36.421740] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-10T19:10:36.421807] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-10T19:10:36.558788] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-10T19:10:36.728474] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-10T19:10:36.811470] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:10:37.089392] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-10T19:10:37.889438] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-10T19:10:38.425626] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-10T19:10:38.440303] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T19:10:38.689427] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-10T19:10:39.489389] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-10T19:10:39.650913] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T19:10:40.289360] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-10T19:10:40.411098] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-10T19:10:41.089380] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-10T19:10:41.776123] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-10T19:10:41.804583] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-10T19:10:41.889318] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-10T19:10:42.689371] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-10T19:10:43.045356] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-10T19:10:43.489383] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-10T19:10:43.753999] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-10T19:10:44.289366] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-10T19:10:44.787405] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T19:10:45.089458] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-10T19:10:45.889426] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-10T19:10:46.008217] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T19:10:46.345914] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T19:10:46.438580] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-10T19:10:46.689378] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-10T19:10:47.489430] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-10T19:10:47.528455] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-10T19:10:48.289472] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-10T19:10:49.094475] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-10T19:10:49.111794] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-10T19:10:49.179912] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-10T19:10:49.889442] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-10T19:10:50.233045] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T19:10:50.601190] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-10T19:10:50.689358] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-10T19:10:51.489371] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-10T19:10:52.091622] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-10T19:10:52.132217] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-10T19:10:52.133322] [INFO ] [REMOTE ] GHLD: Full fetch complete (4908 records). [2025-10-10T19:10:52.133391] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-10T19:10:52.302295] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-10T19:10:52.498401] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-10T19:10:52.498484] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-10T19:10:52.498694] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-10T19:10:52.498759] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-10T19:10:52.499136] [DEBUG] [LOCAL ] GHLD: Trimmed 4908 records to 4263 (keeping 200 days of data) [2025-10-10T19:10:52.526509] [DEBUG] [LOCAL ] GHLD: Primary data saved (4263 records). [2025-10-10T19:10:52.526680] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-10T19:10:52.526790] [INFO ] [MAIN ] Update Progress: 933/2373 symbols completed. GHLD took 43.6s. Estimated remaining: 3h 21m 53s. Rate: 7.1 symbols/min [2025-10-10T19:10:52.702168] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:10:52.720915] [DEBUG] [LOCAL ] GIC: Loaded 13510 existing records from primary storage. [2025-10-10T19:10:52.721269] [INFO ] [MAIN ] GIC: Loaded 13510 existing records. [2025-10-10T19:10:52.917923] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:10:52.918245] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-10T19:10:52.918298] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-10T19:10:52.918528] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-10T19:10:52.918594] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-10T19:10:53.093205] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-10T19:10:53.305053] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:10:53.728064] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-10T19:10:53.889412] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-10T19:10:54.342023] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-10T19:10:54.689395] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-10T19:10:54.961136] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-10T19:10:55.489450] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-10T19:10:56.238890] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T19:10:56.289360] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-10T19:10:56.604868] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T19:10:57.089401] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-10T19:10:57.763801] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-10T19:10:57.779082] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T19:10:57.781250] [INFO ] [REMOTE ] GHM: Full fetch complete (21910 records). [2025-10-10T19:10:57.781345] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-10T19:10:57.894546] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-10T19:10:58.239183] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-10T19:10:58.239280] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-10T19:10:58.240137] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-10T19:10:58.240204] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-10T19:10:58.241157] [DEBUG] [LOCAL ] GHM: Trimmed 21910 records to 14401 (keeping 200 days of data) [2025-10-10T19:10:58.327125] [DEBUG] [LOCAL ] GHM: Primary data saved (14401 records). [2025-10-10T19:10:58.327286] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-10T19:10:58.327404] [INFO ] [MAIN ] Update Progress: 934/2373 symbols completed. GHM took 35.3s. Estimated remaining: 3h 21m 41s. Rate: 7.1 symbols/min [2025-10-10T19:10:58.502376] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:10:58.543170] [DEBUG] [LOCAL ] GIL: Loaded 44027 existing records from primary storage. [2025-10-10T19:10:58.543497] [INFO ] [MAIN ] GIL: Loaded 44027 existing records. [2025-10-10T19:10:58.692907] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-10T19:10:58.727949] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:10:58.728168] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-10T19:10:58.728215] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-10T19:10:58.728438] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-10T19:10:58.728494] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-10T19:10:59.073876] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:10:59.461950] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-10T19:10:59.489327] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-10T19:10:59.995928] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T19:11:00.289381] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-10T19:11:00.792124] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T19:11:01.089360] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-10T19:11:01.889361] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-10T19:11:01.994404] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T19:11:02.274575] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T19:11:02.689395] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-10T19:11:02.860980] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T19:11:03.489381] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-10T19:11:04.171670] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-10T19:11:04.174809] [INFO ] [REMOTE ] GIB: Full fetch complete (45761 records). [2025-10-10T19:11:04.174895] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-10T19:11:04.294563] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-10T19:11:04.556948] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-10T19:11:04.557029] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-10T19:11:04.557734] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-10T19:11:04.557841] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-10T19:11:04.558842] [DEBUG] [LOCAL ] GIB: Trimmed 45761 records to 32258 (keeping 200 days of data) [2025-10-10T19:11:04.763136] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T19:11:04.777595] [DEBUG] [LOCAL ] GIB: Primary data saved (32258 records). [2025-10-10T19:11:04.777768] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-10T19:11:04.777862] [INFO ] [MAIN ] Update Progress: 935/2373 symbols completed. GIB took 28.8s. Estimated remaining: 3h 21m 30s. Rate: 7.1 symbols/min [2025-10-10T19:11:04.940300] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:11:04.991995] [DEBUG] [LOCAL ] GIS: Loaded 54062 existing records from primary storage. [2025-10-10T19:11:04.992324] [INFO ] [MAIN ] GIS: Loaded 54062 existing records. [2025-10-10T19:11:05.089768] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-10T19:11:05.173826] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:11:05.174073] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-10T19:11:05.174125] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-10T19:11:05.174618] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-10T19:11:05.174713] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-10T19:11:05.519245] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:11:05.795686] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-10T19:11:05.889342] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-10T19:11:06.307792] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T19:11:06.689406] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-10T19:11:07.489367] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-10T19:11:07.537708] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-10T19:11:08.289364] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-10T19:11:08.735899] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T19:11:08.760972] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-10T19:11:09.089377] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-10T19:11:09.472141] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-10T19:11:09.889356] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-10T19:11:10.057815] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-10T19:11:10.689376] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-10T19:11:11.489415] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-10T19:11:11.618851] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-10T19:11:11.699180] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T19:11:12.289392] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-10T19:11:13.089380] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-10T19:11:13.510027] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T19:11:13.534258] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-10T19:11:13.537480] [INFO ] [REMOTE ] GHY: Full fetch complete (32308 records). [2025-10-10T19:11:13.537689] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-10T19:11:13.900790] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-10T19:11:13.915869] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-10T19:11:13.915966] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-10T19:11:13.916714] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-10T19:11:13.916877] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-10T19:11:13.917880] [DEBUG] [LOCAL ] GHY: Trimmed 32308 records to 21183 (keeping 200 days of data) [2025-10-10T19:11:14.043591] [DEBUG] [LOCAL ] GHY: Primary data saved (21183 records). [2025-10-10T19:11:14.043755] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-10T19:11:14.043859] [INFO ] [MAIN ] Update Progress: 936/2373 symbols completed. GHY took 48.3s. Estimated remaining: 3h 21m 22s. Rate: 7.1 symbols/min [2025-10-10T19:11:14.212130] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:11:14.251570] [DEBUG] [LOCAL ] GKOS: Loaded 42815 existing records from primary storage. [2025-10-10T19:11:14.251973] [INFO ] [MAIN ] GKOS: Loaded 42815 existing records. [2025-10-10T19:11:14.430408] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:11:14.430631] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-10T19:11:14.430714] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-10T19:11:14.430962] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-10T19:11:14.431018] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-10T19:11:14.702456] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-10T19:11:14.786079] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:11:14.916489] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T19:11:14.969305] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-10T19:11:15.489402] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-10T19:11:16.289390] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-10T19:11:16.861893] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-10T19:11:17.100170] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-10T19:11:17.125678] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-10T19:11:17.195127] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T19:11:17.889416] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-10T19:11:18.689357] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-10T19:11:18.839053] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-10T19:11:18.987815] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-10T19:11:19.489409] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-10T19:11:20.289494] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-10T19:11:20.378868] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T19:11:21.089356] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-10T19:11:21.240235] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T19:11:21.241776] [INFO ] [REMOTE ] GIC: Full fetch complete (20100 records). [2025-10-10T19:11:21.241848] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-10T19:11:21.634023] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-10T19:11:21.634371] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-10T19:11:21.635275] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-10T19:11:21.635394] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-10T19:11:21.636819] [DEBUG] [LOCAL ] GIC: Trimmed 20100 records to 13577 (keeping 200 days of data) [2025-10-10T19:11:21.733109] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-10T19:11:21.765062] [DEBUG] [LOCAL ] GIC: Primary data saved (13577 records). [2025-10-10T19:11:21.765220] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-10T19:11:21.765310] [INFO ] [MAIN ] Update Progress: 937/2373 symbols completed. GIC took 29.2s. Estimated remaining: 3h 21m 13s. Rate: 7.1 symbols/min [2025-10-10T19:11:21.903886] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-10T19:11:21.935600] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:11:21.972918] [DEBUG] [LOCAL ] GL: Loaded 38074 existing records from primary storage. [2025-10-10T19:11:21.973216] [INFO ] [MAIN ] GL: Loaded 38074 existing records. [2025-10-10T19:11:22.149003] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:11:22.149248] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-10T19:11:22.149296] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-10T19:11:22.150163] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-10T19:11:22.150220] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-10T19:11:22.529936] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:11:22.657872] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T19:11:22.689328] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-10T19:11:23.489363] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-10T19:11:23.572393] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-10T19:11:24.105843] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-10T19:11:24.289381] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-10T19:11:25.095020] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-10T19:11:25.104861] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T19:11:25.889374] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-10T19:11:26.331279] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T19:11:26.689359] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-10T19:11:26.908330] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T19:11:27.489421] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-10T19:11:27.591102] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-10T19:11:28.289432] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-10T19:11:28.471006] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-10T19:11:29.089390] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-10T19:11:29.655174] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T19:11:29.680033] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-10T19:11:29.684571] [INFO ] [REMOTE ] GIL: Full fetch complete (61930 records). [2025-10-10T19:11:29.684706] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-10T19:11:29.898729] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-10T19:11:30.067970] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-10T19:11:30.068080] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-10T19:11:30.069480] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-10T19:11:30.069552] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-10T19:11:30.071442] [DEBUG] [LOCAL ] GIL: Trimmed 61930 records to 44393 (keeping 200 days of data) [2025-10-10T19:11:30.365997] [DEBUG] [LOCAL ] GIL: Primary data saved (44393 records). [2025-10-10T19:11:30.366215] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-10T19:11:30.366341] [INFO ] [MAIN ] Update Progress: 938/2373 symbols completed. GIL took 32.0s. Estimated remaining: 3h 21m 5s. Rate: 7.1 symbols/min [2025-10-10T19:11:30.558005] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:11:30.607537] [DEBUG] [LOCAL ] GLOB: Loaded 48132 existing records from primary storage. [2025-10-10T19:11:30.607980] [INFO ] [MAIN ] GLOB: Loaded 48132 existing records. [2025-10-10T19:11:30.696366] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-10T19:11:30.818370] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:11:30.818906] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-10T19:11:30.819114] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-10T19:11:30.841171] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-10T19:11:30.841086] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T19:11:30.841329] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-10T19:11:31.214995] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:11:31.347040] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-10T19:11:31.489349] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-10T19:11:32.289354] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-10T19:11:32.758021] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-10T19:11:32.965666] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-10T19:11:33.089389] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-10T19:11:33.889388] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-10T19:11:34.138972] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T19:11:34.359486] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-10T19:11:34.689425] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-10T19:11:35.479351] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T19:11:35.489323] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-10T19:11:36.289388] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-10T19:11:36.360575] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-10T19:11:36.500432] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-10T19:11:37.089387] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-10T19:11:37.889356] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-10T19:11:38.472735] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-10T19:11:38.694545] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-10T19:11:38.707427] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-10T19:11:39.076976] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-10T19:11:39.489383] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-10T19:11:40.289384] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-10T19:11:40.738483] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-10T19:11:40.743762] [INFO ] [REMOTE ] GIS: Full fetch complete (77653 records). [2025-10-10T19:11:40.743909] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-10T19:11:41.093025] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-10T19:11:41.141116] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-10T19:11:41.141388] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-10T19:11:41.142432] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-10T19:11:41.142513] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-10T19:11:41.144076] [DEBUG] [LOCAL ] GIS: Trimmed 77653 records to 54452 (keeping 200 days of data) [2025-10-10T19:11:41.419463] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-10T19:11:41.528576] [DEBUG] [LOCAL ] GIS: Primary data saved (54452 records). [2025-10-10T19:11:41.528763] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-10T19:11:41.528863] [INFO ] [MAIN ] Update Progress: 939/2373 symbols completed. GIS took 36.8s. Estimated remaining: 3h 21m 1s. Rate: 7.1 symbols/min [2025-10-10T19:11:41.710868] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:11:41.721199] [DEBUG] [LOCAL ] GLP: Loaded 9309 existing records from primary storage. [2025-10-10T19:11:41.721442] [INFO ] [MAIN ] GLP: Loaded 9309 existing records. [2025-10-10T19:11:41.895204] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-10T19:11:41.899968] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:11:41.901747] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-10T19:11:41.901817] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-10T19:11:41.902207] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-10T19:11:41.902285] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-10T19:11:42.204539] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T19:11:42.304781] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:11:42.331680] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-10T19:11:42.689433] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-10T19:11:43.202423] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T19:11:43.489363] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-10T19:11:44.289401] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-10T19:11:44.495667] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-10T19:11:45.089382] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-10T19:11:45.227544] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-10T19:11:45.428249] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-10T19:11:45.889393] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-10T19:11:46.689381] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-10T19:11:46.769928] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-10T19:11:46.777591] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T19:11:47.489377] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-10T19:11:48.206842] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T19:11:48.289362] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-10T19:11:48.410711] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-10T19:11:49.089376] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-10T19:11:49.865494] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-10T19:11:49.889355] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-10T19:11:50.689373] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-10T19:11:50.911022] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-10T19:11:50.992873] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T19:11:51.489397] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-10T19:11:52.289445] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-10T19:11:52.746775] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-10T19:11:53.090213] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-10T19:11:53.095508] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-10T19:11:53.533376] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-10T19:11:53.889447] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-10T19:11:53.971269] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-10T19:11:53.975903] [INFO ] [REMOTE ] GKOS: Full fetch complete (60094 records). [2025-10-10T19:11:53.976102] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-10T19:11:54.391293] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-10T19:11:54.391467] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-10T19:11:54.392688] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-10T19:11:54.392760] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-10T19:11:54.394506] [DEBUG] [LOCAL ] GKOS: Trimmed 60094 records to 43125 (keeping 200 days of data) [2025-10-10T19:11:54.516497] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-10T19:11:54.691677] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-10T19:11:54.695547] [DEBUG] [LOCAL ] GKOS: Primary data saved (43125 records). [2025-10-10T19:11:54.695672] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-10T19:11:54.696038] [INFO ] [MAIN ] Update Progress: 940/2373 symbols completed. GKOS took 40.7s. Estimated remaining: 3h 20m 60s. Rate: 7.1 symbols/min [2025-10-10T19:11:54.874108] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:11:54.931387] [DEBUG] [LOCAL ] GLW: Loaded 54026 existing records from primary storage. [2025-10-10T19:11:54.931863] [INFO ] [MAIN ] GLW: Loaded 54026 existing records. [2025-10-10T19:11:55.122678] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:11:55.122981] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-10T19:11:55.123033] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-10T19:11:55.124228] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-10T19:11:55.124287] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-10T19:11:55.498754] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-10T19:11:55.505351] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:11:55.648978] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-10T19:11:56.289408] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-10T19:11:57.089420] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-10T19:11:57.560417] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-10T19:11:57.889407] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-10T19:11:58.066207] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T19:11:58.689463] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-10T19:11:59.167000] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-10T19:11:59.489376] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-10T19:11:59.787362] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T19:11:59.792596] [INFO ] [REMOTE ] GLOB: Full fetch complete (64854 records). [2025-10-10T19:11:59.792833] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-10T19:12:00.231482] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-10T19:12:00.231797] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-10T19:12:00.232961] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-10T19:12:00.233052] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-10T19:12:00.235120] [DEBUG] [LOCAL ] GLOB: Trimmed 64854 records to 48507 (keeping 200 days of data) [2025-10-10T19:12:00.298436] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-10T19:12:00.377796] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T19:12:00.591171] [DEBUG] [LOCAL ] GLOB: Primary data saved (48507 records). [2025-10-10T19:12:00.591379] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-10T19:12:00.591515] [INFO ] [MAIN ] Update Progress: 941/2373 symbols completed. GLOB took 30.2s. Estimated remaining: 3h 20m 47s. Rate: 7.1 symbols/min [2025-10-10T19:12:00.771214] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:12:00.823403] [DEBUG] [LOCAL ] GM: Loaded 54119 existing records from primary storage. [2025-10-10T19:12:00.823897] [INFO ] [MAIN ] GM: Loaded 54119 existing records. [2025-10-10T19:12:01.026672] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:12:01.026954] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-10T19:12:01.027020] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-10T19:12:01.028141] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-10T19:12:01.028199] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-10T19:12:01.098307] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-10T19:12:01.340193] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-10T19:12:01.448839] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:12:01.720845] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-10T19:12:01.889457] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-10T19:12:02.689414] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-10T19:12:02.739370] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T19:12:03.489459] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-10T19:12:04.226318] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-10T19:12:04.289411] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-10T19:12:04.650760] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-10T19:12:04.860272] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-10T19:12:04.864360] [INFO ] [REMOTE ] GL: Full fetch complete (55179 records). [2025-10-10T19:12:04.864475] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-10T19:12:05.094759] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-10T19:12:05.281988] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-10T19:12:05.282782] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-10T19:12:05.284469] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-10T19:12:05.284580] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-10T19:12:05.283116] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-10T19:12:05.290525] [DEBUG] [LOCAL ] GL: Trimmed 55179 records to 38358 (keeping 200 days of data) [2025-10-10T19:12:05.556365] [DEBUG] [LOCAL ] GL: Primary data saved (38358 records). [2025-10-10T19:12:05.556678] [INFO ] [MAIN ] GL: Full history saved. [2025-10-10T19:12:05.556814] [INFO ] [MAIN ] Update Progress: 942/2373 symbols completed. GL took 43.8s. Estimated remaining: 3h 20m 34s. Rate: 7.1 symbols/min [2025-10-10T19:12:05.731633] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:12:05.792718] [DEBUG] [LOCAL ] GME: Loaded 54173 existing records from primary storage. [2025-10-10T19:12:05.793123] [INFO ] [MAIN ] GME: Loaded 54173 existing records. [2025-10-10T19:12:05.894585] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-10T19:12:05.976998] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:12:05.977236] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-10T19:12:05.977292] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-10T19:12:05.977538] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-10T19:12:05.977578] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-10T19:12:06.348809] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:12:06.689402] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-10T19:12:06.876452] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T19:12:07.473701] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-10T19:12:07.489358] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-10T19:12:08.289423] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-10T19:12:09.089404] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-10T19:12:09.532059] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-10T19:12:09.536295] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-10-10T19:12:09.537070] [INFO ] [REMOTE ] GLP: Full fetch complete (14251 records). [2025-10-10T19:12:09.548797] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-10T19:12:09.897986] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-10T19:12:09.936388] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-10T19:12:09.936517] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-10T19:12:09.954757] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-10T19:12:09.966097] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-10T19:12:09.973873] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-10T19:12:09.974071] [DEBUG] [LOCAL ] GLP: Trimmed 14251 records to 9370 (keeping 200 days of data) [2025-10-10T19:12:10.052813] [DEBUG] [LOCAL ] GLP: Primary data saved (9370 records). [2025-10-10T19:12:10.053019] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-10T19:12:10.053179] [INFO ] [MAIN ] Update Progress: 943/2373 symbols completed. GLP took 28.5s. Estimated remaining: 3h 20m 19s. Rate: 7.1 symbols/min [2025-10-10T19:12:10.238992] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:12:10.289325] [DEBUG] [LOCAL ] GMED: Loaded 48701 existing records from primary storage. [2025-10-10T19:12:10.289778] [INFO ] [MAIN ] GMED: Loaded 48701 existing records. [2025-10-10T19:12:10.477701] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:12:10.477967] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-10T19:12:10.478019] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-10T19:12:10.479136] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-10T19:12:10.479196] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-10T19:12:10.696369] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-10T19:12:10.844794] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:12:11.239293] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T19:12:11.489387] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-10T19:12:12.289349] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-10T19:12:12.688151] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-10-10T19:12:13.089380] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-10T19:12:13.164302] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-10T19:12:13.257409] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T19:12:13.897023] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-10T19:12:13.926597] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T19:12:14.689444] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-10T19:12:15.489490] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-10T19:12:15.729458] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-10T19:12:16.289339] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-10T19:12:16.377494] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T19:12:16.510479] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-10T19:12:17.089412] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-10T19:12:17.533326] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-10T19:12:17.889403] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-10T19:12:18.689421] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-10T19:12:18.957763] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-10T19:12:19.031774] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-10T19:12:19.489413] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-10T19:12:20.266326] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-10T19:12:20.289336] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-10T19:12:20.363181] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T19:12:21.089476] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-10T19:12:21.426053] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T19:12:21.889365] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-10T19:12:22.396025] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-10T19:12:22.689396] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-10T19:12:23.489351] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-10T19:12:23.707251] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T19:12:23.915104] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-10T19:12:24.289414] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-10T19:12:24.624639] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-10T19:12:25.089404] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-10T19:12:25.559254] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T19:12:25.889405] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-10T19:12:26.192879] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T19:12:26.689412] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-10T19:12:27.339824] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-10T19:12:27.489405] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-10T19:12:28.205274] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-10T19:12:28.289395] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-10T19:12:28.621810] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T19:12:29.089472] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-10T19:12:29.820939] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-10T19:12:29.889416] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-10T19:12:30.667290] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-10T19:12:30.699397] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-10T19:12:30.719276] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T19:12:31.489403] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-10T19:12:32.289478] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-10T19:12:32.346559] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T19:12:32.351852] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-10-10T19:12:32.352534] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-10T19:12:32.801561] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-10T19:12:32.801921] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-10T19:12:32.803200] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-10T19:12:32.803414] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-10T19:12:32.805270] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 54509 (keeping 200 days of data) [2025-10-10T19:12:32.926396] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (3.04 seconds). [2025-10-10T19:12:33.089445] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-10T19:12:33.174901] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-10T19:12:33.183557] [INFO ] [REMOTE ] GLW: Full fetch complete (77622 records). [2025-10-10T19:12:33.184479] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-10T19:12:33.364909] [DEBUG] [LOCAL ] GM: Primary data saved (54509 records). [2025-10-10T19:12:33.373335] [INFO ] [MAIN ] GM: Full history saved. [2025-10-10T19:12:33.387612] [INFO ] [MAIN ] Update Progress: 944/2373 symbols completed. GM took 32.8s. Estimated remaining: 3h 20m 34s. Rate: 7.1 symbols/min [2025-10-10T19:12:33.764612] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:12:33.788098] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-10T19:12:33.788632] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-10T19:12:33.789719] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-10T19:12:33.789865] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-10T19:12:33.791687] [DEBUG] [LOCAL ] GLW: Trimmed 77622 records to 54416 (keeping 200 days of data) [2025-10-10T19:12:33.927777] [DEBUG] [LOCAL ] GMRE: Loaded 37301 existing records from primary storage. [2025-10-10T19:12:33.930243] [INFO ] [MAIN ] GMRE: Loaded 37301 existing records. [2025-10-10T19:12:34.235520] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:12:34.237937] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-10T19:12:34.238883] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-10T19:12:34.249811] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-10T19:12:34.256819] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-10T19:12:34.297909] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T19:12:34.350131] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-10T19:12:34.760127] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:12:34.764210] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-10T19:12:34.791229] [DEBUG] [LOCAL ] GLW: Primary data saved (54416 records). [2025-10-10T19:12:34.791427] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-10T19:12:34.791813] [INFO ] [MAIN ] Update Progress: 945/2373 symbols completed. GLW took 40.1s. Estimated remaining: 3h 20m 14s. Rate: 7.1 symbols/min [2025-10-10T19:12:34.966181] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:12:34.991158] [DEBUG] [LOCAL ] GNE: Loaded 17962 existing records from primary storage. [2025-10-10T19:12:34.991513] [INFO ] [MAIN ] GNE: Loaded 17962 existing records. [2025-10-10T19:12:35.171792] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:12:35.172268] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-10T19:12:35.172331] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-10T19:12:35.172962] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-10T19:12:35.173023] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-10T19:12:35.556794] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:12:35.557184] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-10T19:12:35.890222] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-10-10T19:12:36.014001] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T19:12:36.063716] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-10T19:12:36.091551] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T19:12:36.289367] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-10T19:12:37.089432] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-10T19:12:37.895507] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-10T19:12:37.901243] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-10T19:12:38.031577] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-10T19:12:38.689387] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-10T19:12:39.489362] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-10T19:12:40.161295] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-10T19:12:40.289371] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-10T19:12:40.694013] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-10T19:12:41.089370] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-10T19:12:41.167712] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-10T19:12:41.172996] [INFO ] [REMOTE ] GMED: Full fetch complete (69719 records). [2025-10-10T19:12:41.173168] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-10T19:12:41.593804] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-10T19:12:41.593883] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-10T19:12:41.594755] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-10T19:12:41.594817] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-10T19:12:41.599510] [DEBUG] [LOCAL ] GMED: Trimmed 69719 records to 49041 (keeping 200 days of data) [2025-10-10T19:12:41.890299] [DEBUG] [LOCAL ] GMED: Primary data saved (49041 records). [2025-10-10T19:12:41.890409] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-10T19:12:41.890771] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-10T19:12:41.890918] [INFO ] [MAIN ] Update Progress: 946/2373 symbols completed. GMED took 31.8s. Estimated remaining: 3h 20m 4s. Rate: 7.1 symbols/min [2025-10-10T19:12:42.062974] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T19:12:42.095506] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:12:42.138052] [DEBUG] [LOCAL ] GNK: Loaded 40519 existing records from primary storage. [2025-10-10T19:12:42.138392] [INFO ] [MAIN ] GNK: Loaded 40519 existing records. [2025-10-10T19:12:42.317277] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:12:42.317513] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-10T19:12:42.317564] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-10T19:12:42.318299] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-10T19:12:42.318361] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-10T19:12:42.690986] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-10T19:12:42.722574] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:12:42.731230] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-10T19:12:43.489414] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-10T19:12:43.738817] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-10T19:12:44.289365] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-10T19:12:44.404736] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T19:12:45.089455] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-10T19:12:45.161289] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-10T19:12:45.212639] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-10T19:12:45.889378] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-10T19:12:46.697227] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-10T19:12:46.702744] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-10T19:12:47.043069] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T19:12:47.489444] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-10T19:12:48.289353] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-10T19:12:48.622868] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T19:12:49.089428] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-10T19:12:49.548938] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-10-10T19:12:49.733082] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T19:12:49.889370] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-10T19:12:50.689412] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-10T19:12:50.845113] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T19:12:51.489421] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-10T19:12:51.518386] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T19:12:52.289471] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-10T19:12:53.089389] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-10T19:12:53.182843] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-10T19:12:53.466759] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-10T19:12:53.472838] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-10-10T19:12:53.473093] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-10T19:12:53.881806] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-10T19:12:53.881934] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-10T19:12:53.883141] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-10T19:12:53.883211] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-10T19:12:53.887467] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 54563 (keeping 200 days of data) [2025-10-10T19:12:53.889369] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-10T19:12:54.159045] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T19:12:54.206623] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-10T19:12:54.328524] [DEBUG] [LOCAL ] GME: Primary data saved (54563 records). [2025-10-10T19:12:54.328746] [INFO ] [MAIN ] GME: Full history saved. [2025-10-10T19:12:54.328863] [INFO ] [MAIN ] Update Progress: 947/2373 symbols completed. GME took 48.8s. Estimated remaining: 3h 20m 2s. Rate: 7.1 symbols/min [2025-10-10T19:12:54.503985] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:12:54.548378] [DEBUG] [LOCAL ] GNL: Loaded 47094 existing records from primary storage. [2025-10-10T19:12:54.548809] [INFO ] [MAIN ] GNL: Loaded 47094 existing records. [2025-10-10T19:12:54.694608] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-10T19:12:54.737795] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:12:54.738256] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-10T19:12:54.738318] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-10T19:12:54.739315] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-10T19:12:54.739376] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-10T19:12:55.115886] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:12:55.489464] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-10T19:12:55.704459] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T19:12:56.289433] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-10T19:12:56.361532] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T19:12:57.089419] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-10T19:12:57.329394] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T19:12:57.889394] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-10T19:12:57.973084] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T19:12:58.689379] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-10T19:12:58.822983] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T19:12:59.489356] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-10T19:12:59.518471] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-10T19:12:59.690615] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T19:13:00.289387] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-10T19:13:01.089352] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-10T19:13:01.218872] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T19:13:01.856094] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-10T19:13:01.859178] [INFO ] [REMOTE ] GMRE: Full fetch complete (52886 records). [2025-10-10T19:13:01.859285] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-10T19:13:01.894706] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-10T19:13:02.251821] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-10T19:13:02.252036] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-10T19:13:02.253423] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-10T19:13:02.253536] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-10T19:13:02.255209] [DEBUG] [LOCAL ] GMRE: Trimmed 52886 records to 37595 (keeping 200 days of data) [2025-10-10T19:13:02.391139] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T19:13:02.519593] [DEBUG] [LOCAL ] GMRE: Primary data saved (37595 records). [2025-10-10T19:13:02.519810] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-10T19:13:02.519920] [INFO ] [MAIN ] Update Progress: 948/2373 symbols completed. GMRE took 29.1s. Estimated remaining: 3h 19m 53s. Rate: 7.1 symbols/min [2025-10-10T19:13:02.695347] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-10T19:13:02.700869] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:13:02.749509] [DEBUG] [LOCAL ] GNRC: Loaded 45593 existing records from primary storage. [2025-10-10T19:13:02.749911] [INFO ] [MAIN ] GNRC: Loaded 45593 existing records. [2025-10-10T19:13:02.931292] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:13:02.931608] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-10T19:13:02.931698] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-10T19:13:02.931955] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-10T19:13:02.932012] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-10T19:13:03.306390] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:13:03.489379] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-10T19:13:03.713096] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T19:13:04.289441] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-10T19:13:04.440117] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-10T19:13:04.614079] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T19:13:05.089427] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-10T19:13:05.660790] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-10T19:13:05.889395] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-10T19:13:06.689368] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-10T19:13:06.791464] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-10T19:13:07.356467] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-10T19:13:07.489357] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-10T19:13:08.289375] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-10T19:13:08.560757] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T19:13:09.058829] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T19:13:09.060834] [INFO ] [REMOTE ] GNE: Full fetch complete (22475 records). [2025-10-10T19:13:09.060914] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-10T19:13:09.097102] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-10T19:13:09.515533] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-10T19:13:09.543992] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-10T19:13:09.544434] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-10T19:13:09.545145] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-10T19:13:09.545208] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-10T19:13:09.545977] [DEBUG] [LOCAL ] GNE: Trimmed 22475 records to 18049 (keeping 200 days of data) [2025-10-10T19:13:09.654757] [DEBUG] [LOCAL ] GNE: Primary data saved (18049 records). [2025-10-10T19:13:09.654919] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-10T19:13:09.655008] [INFO ] [MAIN ] Update Progress: 949/2373 symbols completed. GNE took 34.9s. Estimated remaining: 3h 19m 43s. Rate: 7.1 symbols/min [2025-10-10T19:13:09.821127] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:13:09.832008] [DEBUG] [LOCAL ] GNT: Loaded 8376 existing records from primary storage. [2025-10-10T19:13:09.832233] [INFO ] [MAIN ] GNT: Loaded 8376 existing records. [2025-10-10T19:13:09.895253] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-10T19:13:10.008685] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:13:10.008918] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-10T19:13:10.008966] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-10T19:13:10.009177] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-10T19:13:10.009233] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-10T19:13:10.355891] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:13:10.689406] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-10T19:13:11.003052] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T19:13:11.489432] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-10T19:13:11.514399] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-10T19:13:12.289380] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-10T19:13:12.464958] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T19:13:12.876879] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-10T19:13:13.089372] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-10T19:13:13.889430] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-10T19:13:13.929039] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-10T19:13:13.932905] [INFO ] [REMOTE ] GNK: Full fetch complete (57265 records). [2025-10-10T19:13:13.933013] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-10T19:13:14.344419] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-10T19:13:14.344529] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-10T19:13:14.345442] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-10T19:13:14.345507] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-10T19:13:14.346789] [DEBUG] [LOCAL ] GNK: Trimmed 57265 records to 40846 (keeping 200 days of data) [2025-10-10T19:13:14.595206] [DEBUG] [LOCAL ] GNK: Primary data saved (40846 records). [2025-10-10T19:13:14.595360] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-10T19:13:14.595455] [INFO ] [MAIN ] Update Progress: 950/2373 symbols completed. GNK took 32.7s. Estimated remaining: 3h 19m 29s. Rate: 7.1 symbols/min [2025-10-10T19:13:14.693416] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-10T19:13:14.765637] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:13:14.814309] [DEBUG] [LOCAL ] GNW: Loaded 51730 existing records from primary storage. [2025-10-10T19:13:14.814624] [INFO ] [MAIN ] GNW: Loaded 51730 existing records. [2025-10-10T19:13:15.007542] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:13:15.022990] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-10T19:13:15.023177] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-10T19:13:15.024941] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-10T19:13:15.024872] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T19:13:15.025160] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-10T19:13:15.397416] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:13:15.431015] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-10T19:13:15.448631] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-10T19:13:15.489353] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-10T19:13:16.228129] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-10T19:13:16.289373] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-10T19:13:16.970602] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-10T19:13:17.089362] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-10T19:13:17.889391] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-10T19:13:18.689365] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-10T19:13:19.125001] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T19:13:19.489369] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-10T19:13:19.816337] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T19:13:20.289430] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-10T19:13:20.463470] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T19:13:20.671180] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-10T19:13:21.089386] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-10T19:13:21.889368] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-10T19:13:22.118933] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-10T19:13:22.631021] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-10T19:13:22.689345] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-10T19:13:22.843928] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T19:13:23.489400] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-10T19:13:23.616465] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T19:13:24.289384] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-10T19:13:24.950076] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-10T19:13:25.089380] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-10T19:13:25.425813] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-10T19:13:25.889396] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-10T19:13:25.970663] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-10T19:13:26.689402] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-10T19:13:27.489351] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-10T19:13:27.805444] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T19:13:28.289406] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-10T19:13:28.564081] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-10T19:13:28.850760] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-10T19:13:29.089388] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-10T19:13:29.889358] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-10T19:13:29.927685] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-10T19:13:30.088382] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-10T19:13:30.689368] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-10T19:13:31.489354] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-10T19:13:31.586770] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-10T19:13:31.591160] [INFO ] [REMOTE ] GNL: Full fetch complete (68068 records). [2025-10-10T19:13:31.591279] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-10T19:13:32.008570] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-10T19:13:32.008721] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-10T19:13:32.010017] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-10T19:13:32.010087] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-10T19:13:32.012313] [DEBUG] [LOCAL ] GNL: Trimmed 68068 records to 47438 (keeping 200 days of data) [2025-10-10T19:13:32.290930] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-10T19:13:32.321794] [DEBUG] [LOCAL ] GNL: Primary data saved (47438 records). [2025-10-10T19:13:32.328804] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-10T19:13:32.322220] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-10T19:13:32.332492] [INFO ] [MAIN ] Update Progress: 951/2373 symbols completed. GNL took 38.0s. Estimated remaining: 3h 19m 35s. Rate: 7.1 symbols/min [2025-10-10T19:13:32.511793] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:13:32.556749] [DEBUG] [LOCAL ] GOF: Loaded 42828 existing records from primary storage. [2025-10-10T19:13:32.557150] [INFO ] [MAIN ] GOF: Loaded 42828 existing records. [2025-10-10T19:13:32.740932] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:13:32.741397] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-10T19:13:32.741454] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-10T19:13:32.766030] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-10T19:13:32.769115] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-10T19:13:32.818442] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-10T19:13:33.094555] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-10T19:13:33.154090] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:13:33.889392] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-10T19:13:34.170861] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T19:13:34.689447] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-10T19:13:34.953540] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T19:13:34.958360] [INFO ] [REMOTE ] GNRC: Full fetch complete (65413 records). [2025-10-10T19:13:34.958539] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-10T19:13:35.074045] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T19:13:35.348578] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-10T19:13:35.348682] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-10T19:13:35.349556] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-10T19:13:35.349598] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-10T19:13:35.350893] [DEBUG] [LOCAL ] GNRC: Trimmed 65413 records to 45960 (keeping 200 days of data) [2025-10-10T19:13:35.524946] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-10T19:13:35.631780] [DEBUG] [LOCAL ] GNRC: Primary data saved (45960 records). [2025-10-10T19:13:35.631941] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-10T19:13:35.632047] [INFO ] [MAIN ] Update Progress: 952/2373 symbols completed. GNRC took 33.1s. Estimated remaining: 3h 19m 18s. Rate: 7.1 symbols/min [2025-10-10T19:13:35.798281] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:13:35.827976] [DEBUG] [LOCAL ] GOLF: Loaded 31223 existing records from primary storage. [2025-10-10T19:13:35.828260] [INFO ] [MAIN ] GOLF: Loaded 31223 existing records. [2025-10-10T19:13:36.003723] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:13:36.003946] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-10T19:13:36.004000] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-10T19:13:36.004624] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-10T19:13:36.004712] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-10T19:13:36.294519] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-10T19:13:36.368923] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:13:36.582612] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-10T19:13:37.089408] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-10T19:13:37.291377] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T19:13:37.293102] [INFO ] [REMOTE ] GNT: Full fetch complete (11076 records). [2025-10-10T19:13:37.293177] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-10T19:13:37.681440] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-10T19:13:37.733914] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-10T19:13:37.734023] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-10T19:13:37.734388] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-10T19:13:37.734431] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-10T19:13:37.734890] [DEBUG] [LOCAL ] GNT: Trimmed 11076 records to 8428 (keeping 200 days of data) [2025-10-10T19:13:37.785079] [DEBUG] [LOCAL ] GNT: Primary data saved (8428 records). [2025-10-10T19:13:37.785245] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-10T19:13:37.785347] [INFO ] [MAIN ] Update Progress: 953/2373 symbols completed. GNT took 28.1s. Estimated remaining: 3h 19m 1s. Rate: 7.1 symbols/min [2025-10-10T19:13:37.894516] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-10T19:13:37.963310] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:13:38.007193] [DEBUG] [LOCAL ] GOOS: Loaded 45117 existing records from primary storage. [2025-10-10T19:13:38.007546] [INFO ] [MAIN ] GOOS: Loaded 45117 existing records. [2025-10-10T19:13:38.180976] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:13:38.181281] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-10T19:13:38.181339] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-10T19:13:38.182279] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-10T19:13:38.182337] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-10T19:13:38.527789] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:13:38.689374] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-10T19:13:39.024121] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T19:13:39.489348] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-10T19:13:39.732405] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T19:13:40.009350] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T19:13:40.289367] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-10T19:13:41.089398] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-10T19:13:41.619266] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-10T19:13:41.889422] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-10T19:13:42.130295] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T19:13:42.689344] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-10T19:13:42.940877] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T19:13:43.225155] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T19:13:43.489372] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-10T19:13:44.289372] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-10T19:13:44.672049] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T19:13:45.089377] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-10T19:13:45.139093] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T19:13:45.728822] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-10T19:13:45.889407] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-10T19:13:46.689364] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-10T19:13:47.042376] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T19:13:47.477144] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-10T19:13:47.489333] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-10T19:13:48.084913] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-10T19:13:48.289402] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-10T19:13:49.089385] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-10T19:13:49.196270] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T19:13:49.889404] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-10T19:13:50.273029] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T19:13:50.660037] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T19:13:50.689363] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-10T19:13:51.463310] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-10T19:13:51.489331] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-10T19:13:52.012960] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T19:13:52.289401] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-10T19:13:53.069064] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T19:13:53.089369] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-10T19:13:53.889362] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-10T19:13:54.234259] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T19:13:54.689353] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-10T19:13:54.889404] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-10T19:13:55.263869] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T19:13:55.489409] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-10T19:13:55.745548] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-10T19:13:56.289387] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-10T19:13:56.871984] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T19:13:57.089388] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-10T19:13:57.838761] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T19:13:57.889337] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-10T19:13:58.689442] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-10T19:13:58.919219] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-10T19:13:58.924030] [INFO ] [REMOTE ] GNW: Full fetch complete (73682 records). [2025-10-10T19:13:58.924174] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-10T19:13:59.344212] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-10T19:13:59.344915] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-10T19:13:59.345929] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-10T19:13:59.346822] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-10T19:13:59.346734] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T19:13:59.354571] [DEBUG] [LOCAL ] GNW: Trimmed 73682 records to 52114 (keeping 200 days of data) [2025-10-10T19:13:59.512392] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-10T19:13:59.652566] [DEBUG] [LOCAL ] GNW: Primary data saved (52114 records). [2025-10-10T19:13:59.652750] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-10T19:13:59.652847] [INFO ] [MAIN ] Update Progress: 954/2373 symbols completed. GNW took 45.1s. Estimated remaining: 3h 19m 12s. Rate: 7.1 symbols/min [2025-10-10T19:13:59.817502] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:13:59.854031] [DEBUG] [LOCAL ] GOTU: Loaded 37996 existing records from primary storage. [2025-10-10T19:13:59.854318] [INFO ] [MAIN ] GOTU: Loaded 37996 existing records. [2025-10-10T19:14:00.031206] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:14:00.031457] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-10T19:14:00.031505] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-10T19:14:00.032234] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-10T19:14:00.032294] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-10T19:14:00.289568] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-10T19:14:00.390191] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:14:00.662998] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-10T19:14:01.025713] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-10T19:14:01.028627] [INFO ] [REMOTE ] GOLF: Full fetch complete (45094 records). [2025-10-10T19:14:01.028764] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-10T19:14:01.094631] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-10T19:14:01.433283] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-10T19:14:01.433378] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-10T19:14:01.434130] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-10T19:14:01.434195] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-10T19:14:01.435323] [DEBUG] [LOCAL ] GOLF: Trimmed 45094 records to 31437 (keeping 200 days of data) [2025-10-10T19:14:01.632398] [DEBUG] [LOCAL ] GOLF: Primary data saved (31437 records). [2025-10-10T19:14:01.632568] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-10T19:14:01.632715] [INFO ] [MAIN ] Update Progress: 955/2373 symbols completed. GOLF took 26.0s. Estimated remaining: 3h 18m 54s. Rate: 7.1 symbols/min [2025-10-10T19:14:01.804151] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:14:01.848876] [DEBUG] [LOCAL ] GPC: Loaded 46526 existing records from primary storage. [2025-10-10T19:14:01.849212] [INFO ] [MAIN ] GPC: Loaded 46526 existing records. [2025-10-10T19:14:01.912277] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-10T19:14:02.030167] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:14:02.030423] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-10T19:14:02.030473] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-10T19:14:02.031483] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-10T19:14:02.031544] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-10T19:14:02.342813] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-10T19:14:02.437469] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:14:02.689359] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-10T19:14:02.999596] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T19:14:03.489364] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-10T19:14:03.749473] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T19:14:04.289405] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-10T19:14:04.571989] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T19:14:04.855318] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T19:14:05.089401] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-10T19:14:05.889409] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-10T19:14:05.944576] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T19:14:06.689426] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-10T19:14:06.889121] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T19:14:07.489388] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-10T19:14:07.645077] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-10T19:14:08.296219] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-10T19:14:08.299254] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-10T19:14:08.303277] [INFO ] [REMOTE ] GOOS: Full fetch complete (65013 records). [2025-10-10T19:14:08.303363] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-10T19:14:08.683676] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-10T19:14:08.683766] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-10T19:14:08.684605] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-10T19:14:08.684691] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-10T19:14:08.685997] [DEBUG] [LOCAL ] GOOS: Trimmed 65013 records to 45406 (keeping 200 days of data) [2025-10-10T19:14:08.950457] [DEBUG] [LOCAL ] GOOS: Primary data saved (45406 records). [2025-10-10T19:14:08.950671] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-10T19:14:08.950960] [INFO ] [MAIN ] Update Progress: 956/2373 symbols completed. GOOS took 31.2s. Estimated remaining: 3h 18m 44s. Rate: 7.1 symbols/min [2025-10-10T19:14:09.122053] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:14:09.119662] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-10T19:14:09.139510] [DEBUG] [LOCAL ] GPI: Loaded 14741 existing records from primary storage. [2025-10-10T19:14:09.139768] [INFO ] [MAIN ] GPI: Loaded 14741 existing records. [2025-10-10T19:14:09.318481] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:14:09.318745] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-10T19:14:09.318836] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-10T19:14:09.319326] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-10T19:14:09.319492] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-10T19:14:09.475428] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T19:14:09.721601] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:14:09.889332] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-10T19:14:10.191151] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T19:14:10.578176] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-10T19:14:10.689333] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-10T19:14:10.891578] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T19:14:11.489422] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-10T19:14:12.289426] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-10T19:14:12.604123] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T19:14:12.993116] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-10T19:14:13.089391] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-10T19:14:13.408237] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-10T19:14:13.412388] [INFO ] [REMOTE ] GOF: Full fetch complete (62090 records). [2025-10-10T19:14:13.412500] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-10T19:14:13.829168] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-10T19:14:13.829281] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-10T19:14:13.830160] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-10T19:14:13.830250] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-10T19:14:13.832146] [DEBUG] [LOCAL ] GOF: Trimmed 62090 records to 43182 (keeping 200 days of data) [2025-10-10T19:14:13.894552] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-10T19:14:14.101602] [DEBUG] [LOCAL ] GOF: Primary data saved (43182 records). [2025-10-10T19:14:14.101774] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-10T19:14:14.101889] [INFO ] [MAIN ] Update Progress: 957/2373 symbols completed. GOF took 41.8s. Estimated remaining: 3h 18m 31s. Rate: 7.1 symbols/min [2025-10-10T19:14:14.689425] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-10T19:14:14.841973] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T19:14:15.489509] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-10T19:14:15.809961] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-10T19:14:15.887469] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-10T19:14:16.289513] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-10T19:14:17.089421] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-10T19:14:17.252678] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T19:14:17.539752] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-10T19:14:17.889396] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-10T19:14:18.689414] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-10T19:14:19.061370] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T19:14:19.122109] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T19:14:19.489431] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-10T19:14:20.295290] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-10T19:14:20.300338] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-10T19:14:21.089413] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-10T19:14:21.325701] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-10T19:14:21.422274] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-10T19:14:21.889382] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-10T19:14:22.384410] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T19:14:22.689439] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-10T19:14:23.042187] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-10T19:14:23.489410] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-10T19:14:24.289418] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-10T19:14:24.396566] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T19:14:24.812580] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T19:14:25.089453] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-10T19:14:25.889357] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-10T19:14:26.113906] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-10T19:14:26.149747] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T19:14:26.689440] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-10T19:14:26.935278] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-10T19:14:27.489362] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-10T19:14:28.289414] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-10T19:14:28.498256] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-10T19:14:28.988606] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T19:14:28.992129] [INFO ] [REMOTE ] GOTU: Full fetch complete (58672 records). [2025-10-10T19:14:28.992244] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-10T19:14:29.096377] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-10T19:14:29.399592] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-10T19:14:29.400001] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-10T19:14:29.400239] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-10T19:14:29.404525] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-10T19:14:29.404614] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-10T19:14:29.406207] [DEBUG] [LOCAL ] GOTU: Trimmed 58672 records to 38292 (keeping 200 days of data) [2025-10-10T19:14:29.621878] [DEBUG] [LOCAL ] GOTU: Primary data saved (38292 records). [2025-10-10T19:14:29.622051] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-10T19:14:29.622172] [INFO ] [MAIN ] Update Progress: 958/2373 symbols completed. GOTU took 30.0s. Estimated remaining: 3h 18m 33s. Rate: 7.1 symbols/min [2025-10-10T19:14:29.889394] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-10T19:14:30.773990] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T19:14:30.776214] [INFO ] [REMOTE ] GPI: Full fetch complete (21198 records). [2025-10-10T19:14:30.776292] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-10T19:14:31.180419] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-10T19:14:31.191502] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-10T19:14:31.206885] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-10T19:14:31.209900] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-10T19:14:31.212808] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-10T19:14:31.213157] [DEBUG] [LOCAL ] GPI: Trimmed 21198 records to 14872 (keeping 200 days of data) [2025-10-10T19:14:31.225474] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-10T19:14:31.325956] [DEBUG] [LOCAL ] GPI: Primary data saved (14872 records). [2025-10-10T19:14:31.326122] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-10T19:14:31.326215] [INFO ] [MAIN ] Update Progress: 959/2373 symbols completed. GPI took 22.4s. Estimated remaining: 3h 18m 15s. Rate: 7.1 symbols/min [2025-10-10T19:14:33.049178] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T19:14:33.059257] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-10T19:14:34.867718] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T19:14:34.877540] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-10T19:14:36.552594] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-10T19:14:36.556866] [INFO ] [REMOTE ] GPC: Full fetch complete (68740 records). [2025-10-10T19:14:36.556970] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-10T19:14:36.952056] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-10T19:14:36.952163] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-10T19:14:36.953116] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-10T19:14:36.953179] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-10T19:14:36.954799] [DEBUG] [LOCAL ] GPC: Trimmed 68740 records to 46854 (keeping 200 days of data) [2025-10-10T19:14:37.243885] [DEBUG] [LOCAL ] GPC: Primary data saved (46854 records). [2025-10-10T19:14:37.244026] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-10T19:14:37.244110] [INFO ] [MAIN ] Update Progress: 960/2373 symbols completed. GPC took 35.6s. Estimated remaining: 3h 18m 3s. Rate: 7.1 symbols/min [2025-10-10T19:14:37.790825] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:14:37.901721] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:14:37.922468] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:14:37.946819] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:14:37.972546] [DEBUG] [LOCAL ] GPJA: Loaded 4288 existing records from primary storage. [2025-10-10T19:14:37.973005] [INFO ] [MAIN ] GPJA: Loaded 4288 existing records. [2025-10-10T19:14:38.022175] [DEBUG] [LOCAL ] GPMT: Loaded 26009 existing records from primary storage. [2025-10-10T19:14:38.060814] [INFO ] [MAIN ] GPMT: Loaded 26009 existing records. [2025-10-10T19:14:38.337691] [DEBUG] [LOCAL ] GPN: Loaded 52403 existing records from primary storage. [2025-10-10T19:14:38.338540] [INFO ] [MAIN ] GPN: Loaded 52403 existing records. [2025-10-10T19:14:38.315843] [DEBUG] [LOCAL ] GPK: Loaded 53056 existing records from primary storage. [2025-10-10T19:14:38.336906] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:14:38.405156] [INFO ] [MAIN ] GPK: Loaded 53056 existing records. [2025-10-10T19:14:38.418156] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-10T19:14:38.506530] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-10T19:14:38.515571] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:14:38.544510] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-10T19:14:38.571262] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-10T19:14:38.560200] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-10T19:14:38.624862] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-10T19:14:38.625039] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-10T19:14:38.640541] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-10T19:14:38.993619] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:14:39.011555] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:14:39.015665] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-10T19:14:39.027347] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-10T19:14:39.021990] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-10T19:14:39.033151] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-10T19:14:39.068433] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-10T19:14:39.054349] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-10T19:14:39.084722] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-10T19:14:39.079118] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-10T19:14:39.965020] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:14:40.043955] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-10T19:14:40.136570] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:14:40.211852] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-10T19:14:40.358678] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:14:40.363050] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-10T19:14:40.362670] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:14:40.364214] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-10T19:14:41.187291] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-10T19:14:41.189468] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-10T19:14:41.558916] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-10T19:14:41.565127] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-10T19:14:41.738112] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-10T19:14:41.741292] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-10T19:14:42.233086] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-10T19:14:42.234798] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-10T19:14:42.275143] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-10T19:14:42.285364] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-10T19:14:42.313451] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T19:14:42.324897] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-10T19:14:42.348972] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-10T19:14:42.353982] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-10T19:14:42.898025] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-10T19:14:42.899410] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-10T19:14:43.310361] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T19:14:43.315457] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-10T19:14:43.610778] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-10T19:14:43.612362] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-10T19:14:44.131508] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T19:14:44.178580] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-10T19:14:44.182209] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T19:14:44.289349] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-10T19:14:44.612476] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T19:14:45.089404] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-10T19:14:45.889406] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-10T19:14:46.183536] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T19:14:46.626910] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-10T19:14:46.689476] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-10T19:14:46.731176] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T19:14:47.489392] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-10T19:14:48.289444] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-10T19:14:48.519823] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T19:14:49.023629] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-10T19:14:49.089383] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-10T19:14:49.889409] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-10T19:14:50.152154] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T19:14:50.591127] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-10T19:14:50.689415] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-10T19:14:50.731194] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-10T19:14:51.392849] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-10T19:14:51.489402] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-10T19:14:52.184719] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-10T19:14:52.289414] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-10T19:14:53.089415] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-10T19:14:53.587542] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T19:14:53.705054] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T19:14:53.706153] [INFO ] [REMOTE ] GPJA: Full fetch complete (7169 records). [2025-10-10T19:14:53.706223] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-10T19:14:53.894827] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-10T19:14:54.117398] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-10T19:14:54.117497] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-10T19:14:54.117912] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-10T19:14:54.117978] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-10T19:14:54.118413] [DEBUG] [LOCAL ] GPJA: Trimmed 7169 records to 4306 (keeping 200 days of data) [2025-10-10T19:14:54.146006] [DEBUG] [LOCAL ] GPJA: Primary data saved (4306 records). [2025-10-10T19:14:54.146136] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-10T19:14:54.146248] [INFO ] [MAIN ] Update Progress: 961/2373 symbols completed. GPJA took 16.9s. Estimated remaining: 3h 18m 7s. Rate: 7.1 symbols/min [2025-10-10T19:14:54.326391] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:14:54.353103] [DEBUG] [LOCAL ] GPOR: Loaded 23434 existing records from primary storage. [2025-10-10T19:14:54.353426] [INFO ] [MAIN ] GPOR: Loaded 23434 existing records. [2025-10-10T19:14:54.536279] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:14:54.536575] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-10T19:14:54.536628] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-10T19:14:54.536866] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-10T19:14:54.536953] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-10T19:14:54.698709] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-10T19:14:54.921219] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:14:55.489382] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-10T19:14:55.917379] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-10T19:14:55.995826] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T19:14:56.289397] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-10T19:14:56.444710] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-10T19:14:57.089407] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-10T19:14:57.432097] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-10T19:14:57.889388] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-10T19:14:58.689399] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-10T19:14:58.715621] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T19:14:59.489406] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-10T19:14:59.915966] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T19:14:59.977093] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-10T19:14:59.979495] [INFO ] [REMOTE ] GPMT: Full fetch complete (36971 records). [2025-10-10T19:14:59.979599] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-10T19:15:00.294504] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-10T19:15:00.372066] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-10T19:15:00.372189] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-10T19:15:00.373388] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-10T19:15:00.373475] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-10T19:15:00.375149] [DEBUG] [LOCAL ] GPMT: Trimmed 36971 records to 26136 (keeping 200 days of data) [2025-10-10T19:15:00.454126] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T19:15:00.566043] [DEBUG] [LOCAL ] GPMT: Primary data saved (26136 records). [2025-10-10T19:15:00.566221] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-10T19:15:00.566327] [INFO ] [MAIN ] Update Progress: 962/2373 symbols completed. GPMT took 23.3s. Estimated remaining: 3h 17m 55s. Rate: 7.1 symbols/min [2025-10-10T19:15:00.750481] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:15:00.793465] [DEBUG] [LOCAL ] GPRK: Loaded 39734 existing records from primary storage. [2025-10-10T19:15:00.793806] [INFO ] [MAIN ] GPRK: Loaded 39734 existing records. [2025-10-10T19:15:00.979928] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:15:00.980227] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-10T19:15:00.980281] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-10T19:15:00.980501] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-10T19:15:00.980542] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-10T19:15:01.094539] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-10T19:15:01.360716] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:15:01.889346] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-10T19:15:02.559175] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-10T19:15:02.612396] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-10T19:15:02.689388] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-10T19:15:03.489404] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-10T19:15:03.661890] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T19:15:04.048127] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T19:15:04.289415] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-10T19:15:05.089386] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-10T19:15:05.636115] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-10T19:15:05.889370] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-10T19:15:06.340126] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-10T19:15:06.689408] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-10T19:15:06.855015] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T19:15:07.370818] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-10T19:15:07.489448] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-10T19:15:07.984485] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T19:15:08.289460] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-10T19:15:08.759032] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-10T19:15:09.089388] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-10T19:15:09.889392] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-10T19:15:10.154487] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-10T19:15:10.202901] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-10T19:15:10.689413] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-10T19:15:11.288845] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-10T19:15:11.489421] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-10T19:15:12.289350] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-10T19:15:12.635496] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T19:15:13.089411] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-10T19:15:13.245711] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T19:15:13.539992] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-10T19:15:13.889413] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-10T19:15:14.689362] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-10T19:15:14.981732] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-10T19:15:14.987042] [INFO ] [REMOTE ] GPK: Full fetch complete (75620 records). [2025-10-10T19:15:14.987249] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-10T19:15:15.431184] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-10T19:15:15.431500] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-10T19:15:15.438324] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-10T19:15:15.439639] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-10T19:15:15.439962] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-10T19:15:15.442494] [DEBUG] [LOCAL ] GPK: Trimmed 75620 records to 53446 (keeping 200 days of data) [2025-10-10T19:15:15.500690] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-10T19:15:15.824858] [DEBUG] [LOCAL ] GPK: Primary data saved (53446 records). [2025-10-10T19:15:15.825053] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-10T19:15:15.825181] [INFO ] [MAIN ] Update Progress: 963/2373 symbols completed. GPK took 38.6s. Estimated remaining: 3h 17m 57s. Rate: 7.1 symbols/min [2025-10-10T19:15:16.007206] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:15:16.037300] [DEBUG] [LOCAL ] GRBK: Loaded 27216 existing records from primary storage. [2025-10-10T19:15:16.037716] [INFO ] [MAIN ] GRBK: Loaded 27216 existing records. [2025-10-10T19:15:16.230581] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:15:16.231039] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-10T19:15:16.231277] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-10T19:15:16.231553] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-10T19:15:16.231620] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-10T19:15:16.298683] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-10T19:15:16.587057] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T19:15:16.661340] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:15:16.878366] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T19:15:17.089426] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-10T19:15:17.570907] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-10T19:15:17.889394] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-10T19:15:18.465463] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T19:15:18.468350] [INFO ] [REMOTE ] GPOR: Full fetch complete (35068 records). [2025-10-10T19:15:18.468447] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-10T19:15:18.694688] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-10T19:15:18.849388] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-10T19:15:18.849473] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-10T19:15:18.850189] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-10T19:15:18.850252] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-10T19:15:18.851093] [DEBUG] [LOCAL ] GPOR: Trimmed 35068 records to 23651 (keeping 200 days of data) [2025-10-10T19:15:18.995054] [DEBUG] [LOCAL ] GPOR: Primary data saved (23651 records). [2025-10-10T19:15:18.995198] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-10T19:15:18.995282] [INFO ] [MAIN ] Update Progress: 964/2373 symbols completed. GPOR took 24.8s. Estimated remaining: 3h 17m 41s. Rate: 7.1 symbols/min [2025-10-10T19:15:19.166231] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:15:19.178249] [DEBUG] [LOCAL ] GRC: Loaded 9268 existing records from primary storage. [2025-10-10T19:15:19.178461] [INFO ] [MAIN ] GRC: Loaded 9268 existing records. [2025-10-10T19:15:19.353860] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:15:19.354083] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-10T19:15:19.354131] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-10T19:15:19.354332] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-10T19:15:19.354388] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-10T19:15:19.532331] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-10T19:15:19.660742] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T19:15:19.750047] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:15:20.289405] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-10T19:15:20.702694] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-10T19:15:21.089388] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-10T19:15:21.122322] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T19:15:21.568837] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-10T19:15:21.889386] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-10T19:15:22.608554] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T19:15:22.689330] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-10T19:15:23.489393] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-10T19:15:23.528558] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-10T19:15:24.289384] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-10T19:15:24.589578] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-10T19:15:24.947380] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-10T19:15:25.089390] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-10T19:15:25.889363] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-10T19:15:26.002200] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T19:15:26.060180] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T19:15:26.689433] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-10T19:15:27.354674] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-10T19:15:27.489349] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-10T19:15:27.644868] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T19:15:28.289391] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-10T19:15:29.089369] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-10T19:15:29.302798] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-10T19:15:29.368505] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-10T19:15:29.373484] [INFO ] [REMOTE ] GPN: Full fetch complete (74917 records). [2025-10-10T19:15:29.373601] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-10T19:15:29.794483] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-10T19:15:29.794590] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-10T19:15:29.795557] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-10T19:15:29.795621] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-10T19:15:29.797273] [DEBUG] [LOCAL ] GPN: Trimmed 74917 records to 52784 (keeping 200 days of data) [2025-10-10T19:15:29.898708] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-10T19:15:30.156381] [DEBUG] [LOCAL ] GPN: Primary data saved (52784 records). [2025-10-10T19:15:30.156535] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-10T19:15:30.156620] [INFO ] [MAIN ] Update Progress: 965/2373 symbols completed. GPN took 52.9s. Estimated remaining: 3h 17m 37s. Rate: 7.1 symbols/min [2025-10-10T19:15:30.332025] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:15:30.353526] [DEBUG] [LOCAL ] GRDN: Loaded 21074 existing records from primary storage. [2025-10-10T19:15:30.353826] [INFO ] [MAIN ] GRDN: Loaded 21074 existing records. [2025-10-10T19:15:30.541277] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:15:30.541692] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-10T19:15:30.541769] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-10T19:15:30.542064] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-10T19:15:30.542141] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-10T19:15:30.694503] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-10T19:15:30.815830] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-10T19:15:30.860128] [INFO ] [REMOTE ] GPRK: Full fetch complete (57735 records). [2025-10-10T19:15:30.879030] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-10T19:15:31.062735] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:15:31.210886] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T19:15:31.371906] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-10T19:15:31.372063] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-10T19:15:31.372864] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-10T19:15:31.372927] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-10T19:15:31.374085] [DEBUG] [LOCAL ] GPRK: Trimmed 57735 records to 40024 (keeping 200 days of data) [2025-10-10T19:15:31.532203] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-10T19:15:31.589578] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-10T19:15:31.613688] [DEBUG] [LOCAL ] GPRK: Primary data saved (40024 records). [2025-10-10T19:15:31.613794] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-10T19:15:31.613868] [INFO ] [MAIN ] Update Progress: 966/2373 symbols completed. GPRK took 31.0s. Estimated remaining: 3h 17m 18s. Rate: 7.1 symbols/min [2025-10-10T19:15:31.777250] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:15:31.818130] [DEBUG] [LOCAL ] GRMN: Loaded 40895 existing records from primary storage. [2025-10-10T19:15:31.818417] [INFO ] [MAIN ] GRMN: Loaded 40895 existing records. [2025-10-10T19:15:31.993207] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:15:31.993442] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-10T19:15:31.993495] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-10T19:15:31.993710] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-10T19:15:31.993769] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-10T19:15:32.298929] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-10T19:15:32.337359] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:15:33.047426] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-10T19:15:33.089398] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-10T19:15:33.386608] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T19:15:33.889345] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-10T19:15:34.365342] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T19:15:34.689394] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-10T19:15:35.489420] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-10T19:15:35.559797] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-10T19:15:35.683613] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T19:15:36.289395] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-10T19:15:36.906785] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-10T19:15:37.089396] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-10T19:15:37.889383] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-10T19:15:38.049687] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-10T19:15:38.086724] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-10T19:15:38.506496] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-10T19:15:38.689376] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-10T19:15:39.489344] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-10T19:15:39.678383] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-10T19:15:40.289375] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-10T19:15:41.089436] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-10T19:15:41.301533] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T19:15:41.376669] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-10T19:15:41.889391] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-10T19:15:42.183030] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-10T19:15:42.689426] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-10T19:15:43.079846] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-10T19:15:43.489366] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-10T19:15:44.092915] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-10T19:15:44.289403] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-10T19:15:45.089344] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-10T19:15:45.398476] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-10T19:15:45.755734] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-10T19:15:45.889354] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-10T19:15:46.116413] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-10T19:15:46.689413] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-10T19:15:47.497025] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-10T19:15:47.500917] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-10T19:15:47.881139] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-10T19:15:48.289384] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-10T19:15:49.089361] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-10T19:15:49.335427] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-10T19:15:49.589480] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-10T19:15:49.628568] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T19:15:49.889391] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-10T19:15:50.689416] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-10T19:15:51.160684] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T19:15:51.489374] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-10T19:15:51.726296] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-10T19:15:51.728057] [INFO ] [REMOTE ] GRC: Full fetch complete (13242 records). [2025-10-10T19:15:51.728131] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-10T19:15:52.089970] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-10T19:15:52.090042] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-10T19:15:52.090340] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-10T19:15:52.090381] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-10T19:15:52.090881] [DEBUG] [LOCAL ] GRC: Trimmed 13242 records to 9381 (keeping 200 days of data) [2025-10-10T19:15:52.147780] [DEBUG] [LOCAL ] GRC: Primary data saved (9381 records). [2025-10-10T19:15:52.147893] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-10T19:15:52.147973] [INFO ] [MAIN ] Update Progress: 967/2373 symbols completed. GRC took 33.2s. Estimated remaining: 3h 17m 27s. Rate: 7.1 symbols/min [2025-10-10T19:15:52.295322] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-10T19:15:52.330296] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:15:52.381801] [DEBUG] [LOCAL ] GRND: Loaded 50333 existing records from primary storage. [2025-10-10T19:15:52.382317] [INFO ] [MAIN ] GRND: Loaded 50333 existing records. [2025-10-10T19:15:52.566283] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:15:52.566599] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-10T19:15:52.566768] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-10T19:15:52.567496] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-10T19:15:52.567554] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-10T19:15:52.868920] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T19:15:52.952771] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:15:53.089380] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-10T19:15:53.889389] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-10T19:15:54.137489] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T19:15:54.689425] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-10T19:15:54.887559] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T19:15:55.222601] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T19:15:55.225702] [INFO ] [REMOTE ] GRBK: Full fetch complete (40572 records). [2025-10-10T19:15:55.225778] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-10T19:15:55.494622] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-10T19:15:55.596361] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-10T19:15:55.596488] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-10T19:15:55.597161] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-10T19:15:55.597221] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-10T19:15:55.598082] [DEBUG] [LOCAL ] GRBK: Trimmed 40572 records to 27490 (keeping 200 days of data) [2025-10-10T19:15:55.752920] [DEBUG] [LOCAL ] GRBK: Primary data saved (27490 records). [2025-10-10T19:15:55.753052] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-10T19:15:55.753142] [INFO ] [MAIN ] Update Progress: 968/2373 symbols completed. GRBK took 39.9s. Estimated remaining: 3h 17m 12s. Rate: 7.1 symbols/min [2025-10-10T19:15:55.919865] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:15:55.931851] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T19:15:55.966465] [DEBUG] [LOCAL ] GRNT: Loaded 34158 existing records from primary storage. [2025-10-10T19:15:55.966769] [INFO ] [MAIN ] GRNT: Loaded 34158 existing records. [2025-10-10T19:15:56.141703] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:15:56.141960] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-10T19:15:56.142019] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-10T19:15:56.142327] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-10T19:15:56.142384] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-10T19:15:56.295717] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-10T19:15:56.518301] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:15:56.778147] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T19:15:57.089419] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-10T19:15:57.889424] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-10T19:15:58.191899] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T19:15:58.326502] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T19:15:58.591738] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-10T19:15:58.689390] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-10T19:15:59.489361] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-10T19:16:00.284867] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T19:16:00.291864] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-10T19:16:01.089366] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-10T19:16:01.236708] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T19:16:01.889475] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-10T19:16:02.146420] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T19:16:02.647425] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-10T19:16:02.689416] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-10T19:16:03.400797] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T19:16:03.489333] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-10T19:16:03.525135] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T19:16:03.527883] [INFO ] [REMOTE ] GRDN: Full fetch complete (26193 records). [2025-10-10T19:16:03.527965] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-10T19:16:03.905667] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-10T19:16:03.905759] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-10T19:16:03.906345] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-10T19:16:03.906406] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-10T19:16:03.907111] [DEBUG] [LOCAL ] GRDN: Trimmed 26193 records to 21246 (keeping 200 days of data) [2025-10-10T19:16:04.030582] [DEBUG] [LOCAL ] GRDN: Primary data saved (21246 records). [2025-10-10T19:16:04.030741] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-10T19:16:04.030829] [INFO ] [MAIN ] Update Progress: 969/2373 symbols completed. GRDN took 33.9s. Estimated remaining: 3h 17m 3s. Rate: 7.1 symbols/min [2025-10-10T19:16:04.199488] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:16:04.211026] [DEBUG] [LOCAL ] GROV: Loaded 8881 existing records from primary storage. [2025-10-10T19:16:04.211246] [INFO ] [MAIN ] GROV: Loaded 8881 existing records. [2025-10-10T19:16:04.294479] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-10T19:16:04.397281] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:16:04.397623] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-10T19:16:04.397705] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-10T19:16:04.397906] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-10T19:16:04.397962] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-10T19:16:04.658845] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-10T19:16:04.778060] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:16:05.089400] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-10T19:16:05.889378] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-10T19:16:06.121239] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-10T19:16:06.689351] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-10T19:16:06.952248] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-10T19:16:07.112740] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-10T19:16:07.489410] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-10T19:16:08.245999] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-10T19:16:08.289431] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-10T19:16:08.509553] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-10T19:16:09.089427] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-10T19:16:09.889375] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-10T19:16:09.983188] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-10T19:16:10.021523] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T19:16:10.689375] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-10T19:16:11.489437] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-10T19:16:11.901451] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T19:16:12.294367] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-10T19:16:12.295539] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-10T19:16:12.300818] [INFO ] [REMOTE ] GRMN: Full fetch complete (59671 records). [2025-10-10T19:16:12.300976] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-10T19:16:12.724887] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-10T19:16:12.725073] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-10T19:16:12.726239] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-10T19:16:12.726312] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-10T19:16:12.728225] [DEBUG] [LOCAL ] GRMN: Trimmed 59671 records to 41183 (keeping 200 days of data) [2025-10-10T19:16:12.985072] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-10T19:16:13.042192] [DEBUG] [LOCAL ] GRMN: Primary data saved (41183 records). [2025-10-10T19:16:13.042382] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-10T19:16:13.042868] [INFO ] [MAIN ] Update Progress: 970/2373 symbols completed. GRMN took 41.4s. Estimated remaining: 3h 16m 56s. Rate: 7.1 symbols/min [2025-10-10T19:16:13.094638] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-10T19:16:13.240060] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:16:13.251638] [DEBUG] [LOCAL ] GRX: Loaded 4805 existing records from primary storage. [2025-10-10T19:16:13.251984] [INFO ] [MAIN ] GRX: Loaded 4805 existing records. [2025-10-10T19:16:13.438701] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:16:13.438996] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-10T19:16:13.439061] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-10T19:16:13.439254] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-10T19:16:13.439313] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-10T19:16:13.820266] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:16:13.889417] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-10T19:16:14.089856] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-10T19:16:14.355858] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-10T19:16:14.677185] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-10T19:16:14.689365] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-10T19:16:15.269512] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-10T19:16:15.489398] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-10T19:16:16.289388] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-10T19:16:17.089412] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-10T19:16:17.153630] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T19:16:17.889362] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-10T19:16:17.985187] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-10T19:16:18.134297] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T19:16:18.530443] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-10T19:16:18.689345] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-10T19:16:19.489394] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-10T19:16:20.289390] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-10T19:16:20.330456] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-10T19:16:20.567203] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T19:16:21.089462] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-10T19:16:21.851579] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-10T19:16:21.889396] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-10T19:16:21.967689] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-10T19:16:22.574084] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-10T19:16:22.689429] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-10T19:16:23.489349] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-10T19:16:23.809089] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-10T19:16:24.289388] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-10T19:16:24.700274] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T19:16:25.089342] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-10T19:16:25.203693] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T19:16:25.889367] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-10T19:16:26.590569] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-10T19:16:26.611754] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-10T19:16:26.689377] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-10T19:16:27.391838] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-10T19:16:27.489373] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-10T19:16:28.197157] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T19:16:28.199147] [INFO ] [REMOTE ] GROV: Full fetch complete (14119 records). [2025-10-10T19:16:28.199232] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-10T19:16:28.294596] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-10T19:16:28.623776] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-10T19:16:28.623914] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-10T19:16:28.624353] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-10T19:16:28.624439] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-10T19:16:28.625136] [DEBUG] [LOCAL ] GROV: Trimmed 14119 records to 8934 (keeping 200 days of data) [2025-10-10T19:16:28.683078] [DEBUG] [LOCAL ] GROV: Primary data saved (8934 records). [2025-10-10T19:16:28.683239] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-10T19:16:28.683380] [INFO ] [MAIN ] Update Progress: 971/2373 symbols completed. GROV took 24.7s. Estimated remaining: 3h 16m 58s. Rate: 7.1 symbols/min [2025-10-10T19:16:28.877908] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:16:28.938354] [DEBUG] [LOCAL ] GS: Loaded 52147 existing records from primary storage. [2025-10-10T19:16:28.938837] [INFO ] [MAIN ] GS: Loaded 52147 existing records. [2025-10-10T19:16:29.095806] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-10T19:16:29.139806] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:16:29.140805] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-10T19:16:29.140871] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-10T19:16:29.141147] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-10T19:16:29.141206] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-10T19:16:29.559176] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:16:29.807372] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-10T19:16:29.889365] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-10T19:16:30.117315] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T19:16:30.689369] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-10T19:16:31.489397] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-10T19:16:31.699485] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T19:16:32.289400] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-10T19:16:32.461016] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-10T19:16:32.465759] [INFO ] [REMOTE ] GRND: Full fetch complete (71208 records). [2025-10-10T19:16:32.465902] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-10T19:16:32.782260] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T19:16:32.888766] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-10T19:16:32.888939] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-10T19:16:32.889876] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-10T19:16:32.889939] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-10T19:16:32.891942] [DEBUG] [LOCAL ] GRND: Trimmed 71208 records to 50718 (keeping 200 days of data) [2025-10-10T19:16:32.981181] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-10T19:16:33.108310] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-10T19:16:33.210184] [DEBUG] [LOCAL ] GRND: Primary data saved (50718 records). [2025-10-10T19:16:33.210334] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-10T19:16:33.210435] [INFO ] [MAIN ] Update Progress: 972/2373 symbols completed. GRND took 41.1s. Estimated remaining: 3h 16m 44s. Rate: 7.1 symbols/min [2025-10-10T19:16:33.374342] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:16:33.414243] [DEBUG] [LOCAL ] GSBD: Loaded 39733 existing records from primary storage. [2025-10-10T19:16:33.414559] [INFO ] [MAIN ] GSBD: Loaded 39733 existing records. [2025-10-10T19:16:33.622790] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:16:33.623276] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-10T19:16:33.623336] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-10T19:16:33.623952] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-10T19:16:33.624017] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-10T19:16:33.898348] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-10T19:16:34.181117] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:16:34.689425] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-10T19:16:35.293789] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-10T19:16:35.297142] [INFO ] [REMOTE ] GRNT: Full fetch complete (48382 records). [2025-10-10T19:16:35.297235] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-10T19:16:35.497205] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-10T19:16:35.530562] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-10T19:16:35.734909] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-10T19:16:35.736544] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-10T19:16:35.736755] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-10T19:16:35.747590] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-10T19:16:35.748365] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-10T19:16:35.749600] [DEBUG] [LOCAL ] GRNT: Trimmed 48382 records to 34422 (keeping 200 days of data) [2025-10-10T19:16:35.948758] [DEBUG] [LOCAL ] GRNT: Primary data saved (34422 records). [2025-10-10T19:16:35.948909] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-10T19:16:35.948994] [INFO ] [MAIN ] Update Progress: 973/2373 symbols completed. GRNT took 40.2s. Estimated remaining: 3h 16m 27s. Rate: 7.1 symbols/min [2025-10-10T19:16:36.123553] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:16:36.189420] [DEBUG] [LOCAL ] GSK: Loaded 53890 existing records from primary storage. [2025-10-10T19:16:36.189898] [INFO ] [MAIN ] GSK: Loaded 53890 existing records. [2025-10-10T19:16:36.295495] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-10T19:16:36.381997] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:16:36.382280] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-10T19:16:36.382334] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-10T19:16:36.382958] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-10T19:16:36.383018] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-10T19:16:36.769202] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:16:37.044378] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-10T19:16:37.089418] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-10T19:16:37.407272] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-10T19:16:37.889440] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-10T19:16:38.689436] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-10T19:16:39.212246] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-10T19:16:39.489372] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-10T19:16:39.593919] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-10T19:16:40.051585] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-10T19:16:40.289413] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-10T19:16:41.089382] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-10T19:16:41.099696] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T19:16:41.100815] [INFO ] [REMOTE ] GRX: Full fetch complete (6553 records). [2025-10-10T19:16:41.100883] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-10T19:16:41.467183] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-10T19:16:41.467371] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-10T19:16:41.467787] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-10T19:16:41.467908] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-10T19:16:41.468798] [DEBUG] [LOCAL ] GRX: Trimmed 6553 records to 4825 (keeping 200 days of data) [2025-10-10T19:16:41.499452] [DEBUG] [LOCAL ] GRX: Primary data saved (4825 records). [2025-10-10T19:16:41.499776] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-10T19:16:41.499961] [INFO ] [MAIN ] Update Progress: 974/2373 symbols completed. GRX took 28.5s. Estimated remaining: 3h 16m 14s. Rate: 7.1 symbols/min [2025-10-10T19:16:41.696504] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:16:41.711690] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-10T19:16:41.754396] [DEBUG] [LOCAL ] GSL: Loaded 33451 existing records from primary storage. [2025-10-10T19:16:41.754763] [INFO ] [MAIN ] GSL: Loaded 33451 existing records. [2025-10-10T19:16:41.905084] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-10T19:16:41.947375] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:16:41.947602] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-10T19:16:41.947678] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-10T19:16:41.947964] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-10T19:16:41.948022] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-10T19:16:42.303243] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:16:42.689388] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-10T19:16:42.869857] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-10T19:16:43.489405] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-10T19:16:44.016940] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-10T19:16:44.214596] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-10T19:16:44.289369] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-10T19:16:45.089381] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-10T19:16:45.591543] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-10T19:16:45.786615] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-10T19:16:45.889370] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-10T19:16:46.164032] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-10T19:16:46.689402] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-10T19:16:47.381944] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T19:16:47.489377] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-10T19:16:48.289391] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-10T19:16:48.457921] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T19:16:49.096152] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-10T19:16:49.116467] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T19:16:49.362511] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-10T19:16:49.889382] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-10T19:16:50.689340] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-10T19:16:50.919975] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T19:16:51.489445] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-10T19:16:52.145224] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-10T19:16:52.289382] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-10T19:16:53.066384] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T19:16:53.089334] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-10T19:16:53.275236] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-10T19:16:53.889420] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-10T19:16:54.369165] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-10T19:16:54.677198] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-10T19:16:54.689322] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-10T19:16:55.489360] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-10T19:16:56.188771] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-10T19:16:56.266840] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T19:16:56.289342] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-10T19:16:57.089439] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-10T19:16:57.244540] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T19:16:57.352580] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-10T19:16:57.889404] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-10T19:16:58.689354] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-10T19:16:59.216766] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-10T19:16:59.489352] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-10T19:16:59.611064] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T19:16:59.722572] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-10T19:17:00.289397] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-10T19:17:01.089347] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-10T19:17:01.482544] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-10T19:17:01.782592] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-10T19:17:01.889388] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-10T19:17:02.689441] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-10T19:17:03.311698] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-10T19:17:03.489336] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-10T19:17:04.058117] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-10T19:17:04.111015] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-10T19:17:04.115147] [INFO ] [REMOTE ] GSL: Full fetch complete (48043 records). [2025-10-10T19:17:04.115328] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-10T19:17:04.292396] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-10T19:17:04.515672] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-10T19:17:04.515874] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-10T19:17:04.516762] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-10T19:17:04.516827] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-10T19:17:04.518078] [DEBUG] [LOCAL ] GSL: Trimmed 48043 records to 33733 (keeping 200 days of data) [2025-10-10T19:17:04.736269] [DEBUG] [LOCAL ] GSL: Primary data saved (33733 records). [2025-10-10T19:17:04.736466] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-10T19:17:04.736572] [INFO ] [MAIN ] Update Progress: 975/2373 symbols completed. GSL took 23.2s. Estimated remaining: 3h 16m 27s. Rate: 7.1 symbols/min [2025-10-10T19:17:04.919285] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:17:04.971533] [DEBUG] [LOCAL ] GTES: Loaded 50804 existing records from primary storage. [2025-10-10T19:17:04.971947] [INFO ] [MAIN ] GTES: Loaded 50804 existing records. [2025-10-10T19:17:05.094636] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-10T19:17:05.179858] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:17:05.180195] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-10T19:17:05.180263] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-10T19:17:05.180616] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-10T19:17:05.180714] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-10T19:17:05.630051] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:17:05.897873] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-10T19:17:05.921360] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-10T19:17:06.556557] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-10T19:17:06.689387] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-10T19:17:06.947265] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-10T19:17:07.287299] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T19:17:07.489397] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-10T19:17:08.289342] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-10T19:17:08.500279] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-10T19:17:09.089413] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-10T19:17:09.265230] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-10T19:17:09.889397] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-10T19:17:09.963278] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-10T19:17:10.689477] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-10T19:17:11.342918] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-10T19:17:11.348066] [INFO ] [REMOTE ] GSK: Full fetch complete (77476 records). [2025-10-10T19:17:11.348192] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-10T19:17:11.492446] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-10T19:17:11.751033] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-10T19:17:11.751263] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-10T19:17:11.752341] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-10T19:17:11.752478] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-10T19:17:11.782719] [DEBUG] [LOCAL ] GSK: Trimmed 77476 records to 54280 (keeping 200 days of data) [2025-10-10T19:17:11.784492] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T19:17:12.125204] [DEBUG] [LOCAL ] GSK: Primary data saved (54280 records). [2025-10-10T19:17:12.125360] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-10T19:17:12.125444] [INFO ] [MAIN ] Update Progress: 976/2373 symbols completed. GSK took 36.2s. Estimated remaining: 3h 16m 17s. Rate: 7.1 symbols/min [2025-10-10T19:17:12.294175] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-10T19:17:12.296810] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:17:12.343227] [DEBUG] [LOCAL ] GTLS: Loaded 43271 existing records from primary storage. [2025-10-10T19:17:12.343542] [INFO ] [MAIN ] GTLS: Loaded 43271 existing records. [2025-10-10T19:17:12.524923] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:17:12.525377] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-10T19:17:12.546765] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-10T19:17:12.547556] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-10T19:17:12.548465] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T19:17:12.548551] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-10T19:17:12.928899] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:17:13.089344] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-10T19:17:13.894637] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-10T19:17:13.919024] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-10T19:17:14.197474] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T19:17:14.689372] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-10T19:17:14.912790] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-10T19:17:15.330196] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T19:17:15.335207] [INFO ] [REMOTE ] GSBD: Full fetch complete (58533 records). [2025-10-10T19:17:15.335365] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-10T19:17:15.498528] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-10T19:17:15.735465] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-10T19:17:15.735562] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-10T19:17:15.736468] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-10T19:17:15.736537] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-10T19:17:15.738001] [DEBUG] [LOCAL ] GSBD: Trimmed 58533 records to 40105 (keeping 200 days of data) [2025-10-10T19:17:15.976616] [DEBUG] [LOCAL ] GSBD: Primary data saved (40105 records). [2025-10-10T19:17:15.976779] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-10T19:17:15.976864] [INFO ] [MAIN ] Update Progress: 977/2373 symbols completed. GSBD took 42.8s. Estimated remaining: 3h 16m 2s. Rate: 7.1 symbols/min [2025-10-10T19:17:16.146421] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:17:16.188220] [DEBUG] [LOCAL ] GTN: Loaded 45558 existing records from primary storage. [2025-10-10T19:17:16.188557] [INFO ] [MAIN ] GTN: Loaded 45558 existing records. [2025-10-10T19:17:16.294588] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-10T19:17:16.369584] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:17:16.369845] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-10T19:17:16.369917] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-10T19:17:16.370126] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-10T19:17:16.370183] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-10T19:17:16.768919] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:17:16.875609] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-10T19:17:16.880538] [INFO ] [REMOTE ] GS: Full fetch complete (75633 records). [2025-10-10T19:17:16.880710] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-10T19:17:17.096581] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-10T19:17:17.246991] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T19:17:17.336313] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-10T19:17:17.336409] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-10T19:17:17.337754] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-10T19:17:17.337829] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-10T19:17:17.339691] [DEBUG] [LOCAL ] GS: Trimmed 75633 records to 52532 (keeping 200 days of data) [2025-10-10T19:17:17.679122] [DEBUG] [LOCAL ] GS: Primary data saved (52532 records). [2025-10-10T19:17:17.679255] [INFO ] [MAIN ] GS: Full history saved. [2025-10-10T19:17:17.679339] [INFO ] [MAIN ] Update Progress: 978/2373 symbols completed. GS took 49.0s. Estimated remaining: 3h 15m 44s. Rate: 7.1 symbols/min [2025-10-10T19:17:17.845246] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:17:17.875259] [DEBUG] [LOCAL ] GTY: Loaded 30428 existing records from primary storage. [2025-10-10T19:17:17.875531] [INFO ] [MAIN ] GTY: Loaded 30428 existing records. [2025-10-10T19:17:17.895992] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-10T19:17:18.056225] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:17:18.056976] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-10T19:17:18.057096] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-10T19:17:18.057365] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-10T19:17:18.057427] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-10T19:17:18.456289] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:17:18.458082] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-10T19:17:18.689352] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-10T19:17:19.006511] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-10T19:17:19.489412] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-10T19:17:19.816188] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T19:17:19.900881] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-10T19:17:20.289440] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-10T19:17:20.729004] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T19:17:21.089392] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-10T19:17:21.889382] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-10T19:17:21.984961] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-10T19:17:22.286048] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-10T19:17:22.689379] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-10T19:17:23.462688] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-10T19:17:23.489341] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-10T19:17:23.869842] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T19:17:24.289379] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-10T19:17:24.953867] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T19:17:25.089360] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-10T19:17:25.889368] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-10T19:17:26.194730] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T19:17:26.689471] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-10T19:17:26.731586] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-10T19:17:27.489348] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-10T19:17:27.739131] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T19:17:28.289363] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-10T19:17:28.462406] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T19:17:29.089415] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-10T19:17:29.390282] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T19:17:29.889399] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-10T19:17:30.115102] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T19:17:30.689422] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-10T19:17:30.710472] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-10T19:17:31.489388] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-10T19:17:31.726464] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T19:17:32.289358] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-10T19:17:32.536048] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T19:17:33.032078] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-10T19:17:33.089416] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-10T19:17:33.655200] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T19:17:33.889353] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-10T19:17:34.386423] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-10T19:17:34.689453] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-10T19:17:35.489403] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-10T19:17:35.642889] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T19:17:35.651247] [INFO ] [REMOTE ] GTES: Full fetch complete (73761 records). [2025-10-10T19:17:35.651404] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-10T19:17:36.096951] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-10T19:17:36.097214] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-10T19:17:36.098436] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-10T19:17:36.098505] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-10T19:17:36.100417] [DEBUG] [LOCAL ] GTES: Trimmed 73761 records to 51168 (keeping 200 days of data) [2025-10-10T19:17:36.311639] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-10T19:17:36.357010] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T19:17:36.449417] [DEBUG] [LOCAL ] GTES: Primary data saved (51168 records). [2025-10-10T19:17:36.449556] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-10T19:17:36.449862] [INFO ] [MAIN ] Update Progress: 979/2373 symbols completed. GTES took 31.7s. Estimated remaining: 3h 15m 51s. Rate: 7.1 symbols/min [2025-10-10T19:17:36.633932] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:17:36.650985] [DEBUG] [LOCAL ] GUG: Loaded 12290 existing records from primary storage. [2025-10-10T19:17:36.651297] [INFO ] [MAIN ] GUG: Loaded 12290 existing records. [2025-10-10T19:17:36.833384] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:17:36.833624] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-10T19:17:36.833710] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-10T19:17:36.833908] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-10T19:17:36.833966] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-10T19:17:37.094564] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-10T19:17:37.210326] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T19:17:37.239569] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:17:37.889364] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-10T19:17:38.011721] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T19:17:38.689364] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-10T19:17:39.015312] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T19:17:39.102312] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T19:17:39.489352] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-10T19:17:39.833210] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-10T19:17:40.289344] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-10T19:17:41.054012] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-10T19:17:41.089340] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-10T19:17:41.233952] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-10T19:17:41.889387] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-10T19:17:42.115160] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-10T19:17:42.118767] [INFO ] [REMOTE ] GTY: Full fetch complete (43741 records). [2025-10-10T19:17:42.119055] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-10T19:17:42.493970] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-10T19:17:42.494068] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-10T19:17:42.495027] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-10T19:17:42.495093] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-10T19:17:42.496564] [DEBUG] [LOCAL ] GTY: Trimmed 43741 records to 30692 (keeping 200 days of data) [2025-10-10T19:17:42.689503] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-10T19:17:42.711398] [DEBUG] [LOCAL ] GTY: Primary data saved (30692 records). [2025-10-10T19:17:42.711582] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-10T19:17:42.711715] [INFO ] [MAIN ] Update Progress: 980/2373 symbols completed. GTY took 25.0s. Estimated remaining: 3h 15m 39s. Rate: 7.1 symbols/min [2025-10-10T19:17:42.877779] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:17:42.894792] [DEBUG] [LOCAL ] GUT: Loaded 15593 existing records from primary storage. [2025-10-10T19:17:42.895102] [INFO ] [MAIN ] GUT: Loaded 15593 existing records. [2025-10-10T19:17:43.074962] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:17:43.075258] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-10T19:17:43.075316] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-10T19:17:43.075624] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-10T19:17:43.075728] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-10T19:17:43.461985] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:17:43.498708] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-10T19:17:43.520365] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-10T19:17:43.696984] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-10T19:17:44.289431] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-10T19:17:45.089354] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-10T19:17:45.327872] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T19:17:45.528513] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T19:17:45.889357] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-10T19:17:46.074075] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-10T19:17:46.689388] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-10T19:17:47.489364] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-10T19:17:47.534179] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-10T19:17:47.538330] [INFO ] [REMOTE ] GTN: Full fetch complete (66153 records). [2025-10-10T19:17:47.538430] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-10T19:17:47.926504] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-10T19:17:47.926586] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-10T19:17:47.927537] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-10T19:17:47.927602] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-10T19:17:47.930152] [DEBUG] [LOCAL ] GTN: Trimmed 66153 records to 45885 (keeping 200 days of data) [2025-10-10T19:17:48.220776] [DEBUG] [LOCAL ] GTN: Primary data saved (45885 records). [2025-10-10T19:17:48.220974] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-10T19:17:48.221079] [INFO ] [MAIN ] Update Progress: 981/2373 symbols completed. GTN took 32.2s. Estimated remaining: 3h 15m 27s. Rate: 7.1 symbols/min [2025-10-10T19:17:48.294562] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-10T19:17:48.404402] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:17:48.431780] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-10T19:17:48.475297] [DEBUG] [LOCAL ] GVA: Loaded 33049 existing records from primary storage. [2025-10-10T19:17:48.480401] [INFO ] [MAIN ] GVA: Loaded 33049 existing records. [2025-10-10T19:17:48.525019] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-10T19:17:48.664539] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:17:48.664809] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-10T19:17:48.664860] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-10T19:17:48.665096] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-10T19:17:48.665150] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-10T19:17:49.020551] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:17:49.089340] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-10T19:17:49.536261] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T19:17:49.889400] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-10T19:17:50.658575] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-10T19:17:50.690060] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-10T19:17:50.693120] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T19:17:51.489423] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-10T19:17:51.861947] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T19:17:52.289347] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-10T19:17:53.068773] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-10T19:17:53.089327] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-10T19:17:53.275984] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-10T19:17:53.889397] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-10T19:17:54.673421] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T19:17:54.689357] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-10T19:17:55.005383] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-10T19:17:55.489373] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-10T19:17:56.289459] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-10T19:17:56.363941] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-10T19:17:57.089376] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-10T19:17:57.333037] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T19:17:57.448285] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-10T19:17:57.889358] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-10T19:17:58.307201] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-10T19:17:58.689399] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-10T19:17:59.489379] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-10T19:17:59.706218] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T19:17:59.844487] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T19:18:00.289430] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-10T19:18:00.472567] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-10T19:18:01.089440] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-10T19:18:01.889375] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-10T19:18:02.154565] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-10T19:18:02.300110] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T19:18:02.689384] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-10T19:18:03.489344] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-10T19:18:03.649257] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-10T19:18:03.665226] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T19:18:03.665344] [INFO ] [REMOTE ] GTLS: Full fetch complete (61405 records). [2025-10-10T19:18:03.669829] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-10T19:18:04.080831] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-10T19:18:04.080914] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-10T19:18:04.081957] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-10T19:18:04.082024] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-10T19:18:04.083341] [DEBUG] [LOCAL ] GTLS: Trimmed 61405 records to 43640 (keeping 200 days of data) [2025-10-10T19:18:04.293157] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-10T19:18:04.390824] [DEBUG] [LOCAL ] GTLS: Primary data saved (43640 records). [2025-10-10T19:18:04.390950] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-10T19:18:04.391046] [INFO ] [MAIN ] Update Progress: 982/2373 symbols completed. GTLS took 52.3s. Estimated remaining: 3h 15m 29s. Rate: 7.1 symbols/min [2025-10-10T19:18:04.608077] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:18:04.610509] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-10T19:18:04.631440] [DEBUG] [LOCAL ] GWH: Loaded 17262 existing records from primary storage. [2025-10-10T19:18:04.631785] [INFO ] [MAIN ] GWH: Loaded 17262 existing records. [2025-10-10T19:18:04.842036] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:18:04.842336] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-10T19:18:04.842390] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-10T19:18:04.842708] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-10T19:18:04.842770] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-10T19:18:05.094697] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-10T19:18:05.261493] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:18:05.331435] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-10T19:18:05.684293] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-10T19:18:05.889383] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-10T19:18:06.689361] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-10T19:18:06.848205] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T19:18:06.849835] [INFO ] [REMOTE ] GUG: Full fetch complete (19408 records). [2025-10-10T19:18:06.849905] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-10T19:18:07.220091] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-10T19:18:07.220173] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-10T19:18:07.220617] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-10T19:18:07.220685] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-10T19:18:07.221216] [DEBUG] [LOCAL ] GUG: Trimmed 19408 records to 12355 (keeping 200 days of data) [2025-10-10T19:18:07.296875] [DEBUG] [LOCAL ] GUG: Primary data saved (12355 records). [2025-10-10T19:18:07.297023] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-10T19:18:07.297106] [INFO ] [MAIN ] Update Progress: 983/2373 symbols completed. GUG took 30.8s. Estimated remaining: 3h 15m 13s. Rate: 7.1 symbols/min [2025-10-10T19:18:07.465526] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:18:07.489368] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-10T19:18:07.504978] [DEBUG] [LOCAL ] GWRE: Loaded 40388 existing records from primary storage. [2025-10-10T19:18:07.505278] [INFO ] [MAIN ] GWRE: Loaded 40388 existing records. [2025-10-10T19:18:07.682463] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:18:07.682707] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-10T19:18:07.682766] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-10T19:18:07.683018] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-10T19:18:07.683077] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-10T19:18:08.030160] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:18:08.289349] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-10T19:18:08.346197] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-10T19:18:08.526560] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-10T19:18:08.864305] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-10T19:18:09.089379] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-10T19:18:09.889389] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-10T19:18:10.522376] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-10T19:18:10.582559] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T19:18:10.584478] [INFO ] [REMOTE ] GUT: Full fetch complete (22626 records). [2025-10-10T19:18:10.584553] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-10T19:18:10.694448] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-10T19:18:10.949066] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-10T19:18:10.949146] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-10T19:18:10.949738] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-10T19:18:10.949800] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-10T19:18:10.950368] [DEBUG] [LOCAL ] GUT: Trimmed 22626 records to 15771 (keeping 200 days of data) [2025-10-10T19:18:11.041418] [DEBUG] [LOCAL ] GUT: Primary data saved (15771 records). [2025-10-10T19:18:11.041563] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-10T19:18:11.041673] [INFO ] [MAIN ] Update Progress: 984/2373 symbols completed. GUT took 28.3s. Estimated remaining: 3h 14m 58s. Rate: 7.1 symbols/min [2025-10-10T19:18:11.212230] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:18:11.232744] [DEBUG] [LOCAL ] GWW: Loaded 19575 existing records from primary storage. [2025-10-10T19:18:11.233045] [INFO ] [MAIN ] GWW: Loaded 19575 existing records. [2025-10-10T19:18:11.417200] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:18:11.417437] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-10T19:18:11.417489] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-10T19:18:11.417744] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-10T19:18:11.417806] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-10T19:18:11.494454] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-10T19:18:11.768368] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:18:12.289385] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-10T19:18:12.318472] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T19:18:12.333728] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-10T19:18:13.089414] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-10T19:18:13.889379] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-10T19:18:13.983836] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-10T19:18:14.265272] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T19:18:14.689397] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-10T19:18:15.084107] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T19:18:15.489382] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-10T19:18:15.562393] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-10T19:18:16.289376] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-10T19:18:17.089384] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-10T19:18:17.360228] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-10T19:18:17.393319] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T19:18:17.889410] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-10T19:18:18.439326] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-10T19:18:18.689458] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-10T19:18:19.489414] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-10T19:18:19.604902] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T19:18:20.004572] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-10T19:18:20.289396] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-10T19:18:20.995959] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T19:18:21.089350] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-10T19:18:21.264242] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-10T19:18:21.889388] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-10T19:18:22.642354] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-10T19:18:22.689357] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-10T19:18:22.739970] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-10T19:18:23.489405] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-10T19:18:24.128100] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T19:18:24.131499] [INFO ] [REMOTE ] GVA: Full fetch complete (48327 records). [2025-10-10T19:18:24.131597] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-10T19:18:24.290364] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-10T19:18:24.528939] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-10T19:18:24.529031] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-10T19:18:24.529766] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-10T19:18:24.529830] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-10T19:18:24.531049] [DEBUG] [LOCAL ] GVA: Trimmed 48327 records to 33295 (keeping 200 days of data) [2025-10-10T19:18:24.742572] [DEBUG] [LOCAL ] GVA: Primary data saved (33295 records). [2025-10-10T19:18:24.742741] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-10T19:18:24.742836] [INFO ] [MAIN ] Update Progress: 985/2373 symbols completed. GVA took 36.5s. Estimated remaining: 3h 14m 57s. Rate: 7.1 symbols/min [2025-10-10T19:18:24.874937] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-10T19:18:24.936264] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:18:24.978981] [DEBUG] [LOCAL ] GXO: Loaded 47389 existing records from primary storage. [2025-10-10T19:18:24.979332] [INFO ] [MAIN ] GXO: Loaded 47389 existing records. [2025-10-10T19:18:25.094450] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-10T19:18:25.160077] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:18:25.160348] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-10T19:18:25.160406] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-10T19:18:25.160601] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-10T19:18:25.160687] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-10T19:18:25.557186] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:18:25.889358] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-10T19:18:26.246494] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T19:18:26.318269] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T19:18:26.689395] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-10T19:18:27.189476] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T19:18:27.489371] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-10T19:18:28.289349] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-10T19:18:28.582387] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T19:18:28.674396] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-10T19:18:29.089424] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-10T19:18:29.671221] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-10T19:18:29.889373] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-10T19:18:30.381476] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T19:18:30.689361] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-10T19:18:31.074032] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-10T19:18:31.489375] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-10T19:18:31.974097] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T19:18:32.289357] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-10T19:18:32.737181] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T19:18:33.089385] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-10T19:18:33.889429] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-10T19:18:34.155092] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T19:18:34.613348] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-10T19:18:34.618053] [INFO ] [REMOTE ] GWH: Full fetch complete (22414 records). [2025-10-10T19:18:34.618164] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-10T19:18:34.694483] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-10T19:18:34.990867] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-10T19:18:34.990945] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-10T19:18:34.991456] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-10T19:18:34.991500] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-10T19:18:34.992120] [DEBUG] [LOCAL ] GWH: Trimmed 22414 records to 17652 (keeping 200 days of data) [2025-10-10T19:18:35.096154] [DEBUG] [LOCAL ] GWH: Primary data saved (17652 records). [2025-10-10T19:18:35.096391] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-10T19:18:35.096544] [INFO ] [MAIN ] Update Progress: 986/2373 symbols completed. GWH took 30.7s. Estimated remaining: 3h 14m 51s. Rate: 7.1 symbols/min [2025-10-10T19:18:35.242179] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T19:18:35.294842] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:18:35.299059] [DEBUG] [LOCAL ] GYLD: Loaded 1552 existing records from primary storage. [2025-10-10T19:18:35.299249] [INFO ] [MAIN ] GYLD: Loaded 1552 existing records. [2025-10-10T19:18:35.473308] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:18:35.473531] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-10T19:18:35.473578] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-10T19:18:35.473735] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-10T19:18:35.473792] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-10T19:18:35.494471] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-10T19:18:35.821087] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:18:36.289415] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-10T19:18:36.551283] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T19:18:36.754216] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-10T19:18:37.089355] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-10T19:18:37.302992] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T19:18:37.889383] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-10T19:18:38.689459] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-10T19:18:39.060554] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-10T19:18:39.489460] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-10T19:18:39.705136] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T19:18:39.852480] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-10T19:18:39.854596] [INFO ] [REMOTE ] GWW: Full fetch complete (29033 records). [2025-10-10T19:18:39.854783] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-10T19:18:40.253226] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-10T19:18:40.253350] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-10T19:18:40.254249] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-10T19:18:40.254319] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-10T19:18:40.255307] [DEBUG] [LOCAL ] GWW: Trimmed 29033 records to 19737 (keeping 200 days of data) [2025-10-10T19:18:40.311591] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-10T19:18:40.395310] [DEBUG] [LOCAL ] GWW: Primary data saved (19737 records). [2025-10-10T19:18:40.395584] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-10T19:18:40.395761] [INFO ] [MAIN ] Update Progress: 987/2373 symbols completed. GWW took 29.4s. Estimated remaining: 3h 14m 38s. Rate: 7.1 symbols/min [2025-10-10T19:18:40.584798] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:18:40.634634] [DEBUG] [LOCAL ] H: Loaded 44843 existing records from primary storage. [2025-10-10T19:18:40.635058] [INFO ] [MAIN ] H: Loaded 44843 existing records. [2025-10-10T19:18:40.792987] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-10T19:18:40.834691] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:18:40.835122] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-10T19:18:40.835199] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-10T19:18:40.835555] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-10T19:18:40.835616] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-10T19:18:41.094838] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-10T19:18:41.229067] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:18:41.442971] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T19:18:41.563208] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-10T19:18:41.889393] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-10T19:18:42.689465] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-10T19:18:43.215036] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-10T19:18:43.489353] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-10T19:18:43.820560] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-10T19:18:44.289379] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-10T19:18:45.089414] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-10T19:18:45.172213] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T19:18:45.634567] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-10T19:18:45.889387] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-10T19:18:45.987574] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T19:18:46.412722] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-10T19:18:46.689359] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-10T19:18:47.489380] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-10T19:18:48.289361] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-10T19:18:48.477269] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T19:18:49.089375] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-10T19:18:49.114760] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T19:18:49.889427] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-10T19:18:50.057003] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T19:18:50.689376] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-10T19:18:50.839942] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T19:18:51.054322] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-10T19:18:51.238557] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-10T19:18:51.489363] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-10T19:18:52.289385] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-10T19:18:53.024775] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-10T19:18:53.024663] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-10T19:18:53.029626] [INFO ] [REMOTE ] GWRE: Full fetch complete (60440 records). [2025-10-10T19:18:53.029758] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-10T19:18:53.094526] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-10T19:18:53.405629] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-10T19:18:53.405758] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-10T19:18:53.409494] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-10T19:18:53.409583] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-10T19:18:53.410823] [DEBUG] [LOCAL ] GWRE: Trimmed 60440 records to 40700 (keeping 200 days of data) [2025-10-10T19:18:53.648734] [DEBUG] [LOCAL ] GWRE: Primary data saved (40700 records). [2025-10-10T19:18:53.648867] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-10T19:18:53.649112] [INFO ] [MAIN ] Update Progress: 988/2373 symbols completed. GWRE took 46.4s. Estimated remaining: 3h 14m 37s. Rate: 7.1 symbols/min [2025-10-10T19:18:53.813028] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:18:53.813208] [DEBUG] [LOCAL ] HAE: No existing data file found in primary storage. [2025-10-10T19:18:53.813246] [WARN ] [MAIN ] HAE: No existing data found, performing full refresh instead. [2025-10-10T19:18:53.813370] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-10T19:18:53.813410] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-10T19:18:53.813450] [DEBUG] [LOCAL ] HAE: No primary data file found to delete. [2025-10-10T19:18:53.813483] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-10T19:18:53.894518] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-10T19:18:54.164368] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:18:54.689431] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-10T19:18:54.943853] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-10T19:18:55.215067] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-10T19:18:55.489379] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-10T19:18:55.727006] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T19:18:56.289431] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-10T19:18:57.061284] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-10T19:18:57.089378] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-10T19:18:57.889409] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-10T19:18:58.107587] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T19:18:58.212168] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-10T19:18:58.689435] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-10T19:18:59.489347] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-10T19:18:59.738800] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T19:19:00.289356] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-10T19:19:00.397907] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T19:19:01.089355] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-10T19:19:01.405128] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T19:19:01.649149] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-10T19:19:01.889378] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-10T19:19:02.689346] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-10T19:19:02.933410] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T19:19:03.210370] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T19:19:03.214805] [INFO ] [REMOTE ] GXO: Full fetch complete (69692 records). [2025-10-10T19:19:03.214948] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-10T19:19:03.494483] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-10T19:19:03.619386] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-10T19:19:03.619467] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-10T19:19:03.620412] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-10T19:19:03.620477] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-10T19:19:03.622193] [DEBUG] [LOCAL ] GXO: Trimmed 69692 records to 47741 (keeping 200 days of data) [2025-10-10T19:19:03.895837] [DEBUG] [LOCAL ] GXO: Primary data saved (47741 records). [2025-10-10T19:19:03.895992] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-10T19:19:03.896091] [INFO ] [MAIN ] Update Progress: 989/2373 symbols completed. GXO took 39.2s. Estimated remaining: 3h 14m 31s. Rate: 7.1 symbols/min [2025-10-10T19:19:04.076322] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:19:04.119792] [DEBUG] [LOCAL ] HAFN: Loaded 43476 existing records from primary storage. [2025-10-10T19:19:04.119670] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-10T19:19:04.121461] [INFO ] [MAIN ] HAFN: Loaded 43476 existing records. [2025-10-10T19:19:04.290414] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-10T19:19:04.313110] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:19:04.313440] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-10T19:19:04.313505] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-10T19:19:04.314008] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-10T19:19:04.314099] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-10T19:19:04.715759] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:19:04.710580] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-10T19:19:04.943139] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-10T19:19:04.943889] [INFO ] [REMOTE ] GYLD: Full fetch complete (2102 records). [2025-10-10T19:19:04.943956] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-10T19:19:05.098544] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-10T19:19:05.313105] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-10T19:19:05.313206] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-10T19:19:05.313336] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-10T19:19:05.313378] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-10T19:19:05.313799] [DEBUG] [LOCAL ] GYLD: Trimmed 2102 records to 1575 (keeping 200 days of data) [2025-10-10T19:19:05.325260] [DEBUG] [LOCAL ] GYLD: Primary data saved (1575 records). [2025-10-10T19:19:05.325426] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-10T19:19:05.325530] [INFO ] [MAIN ] Update Progress: 990/2373 symbols completed. GYLD took 30.2s. Estimated remaining: 3h 14m 13s. Rate: 7.1 symbols/min [2025-10-10T19:19:05.495335] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:19:05.554688] [DEBUG] [LOCAL ] HAL: Loaded 54108 existing records from primary storage. [2025-10-10T19:19:05.555045] [INFO ] [MAIN ] HAL: Loaded 54108 existing records. [2025-10-10T19:19:05.732201] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:19:05.732446] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-10T19:19:05.732510] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-10T19:19:05.732779] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-10T19:19:05.732835] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-10T19:19:05.894586] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-10T19:19:06.107104] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:19:06.689407] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-10T19:19:07.233114] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-10T19:19:07.489388] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-10T19:19:07.661707] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T19:19:07.791602] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-10T19:19:08.289381] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-10T19:19:09.089350] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-10T19:19:09.549383] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T19:19:09.889345] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-10T19:19:10.138782] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-10T19:19:10.689455] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-10T19:19:10.759790] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-10T19:19:11.360714] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-10T19:19:11.489390] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-10T19:19:12.275230] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-10T19:19:12.289349] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-10T19:19:13.089348] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-10T19:19:13.486231] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T19:19:13.861628] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T19:19:13.889339] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-10T19:19:14.689404] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-10T19:19:15.000018] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-10T19:19:15.397766] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-10T19:19:15.489336] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-10T19:19:16.078082] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T19:19:16.289373] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-10T19:19:17.089371] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-10T19:19:17.267093] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T19:19:17.889384] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-10T19:19:18.153791] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T19:19:18.689396] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-10T19:19:19.422140] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-10T19:19:19.489388] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-10T19:19:19.536273] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-10T19:19:20.289410] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-10T19:19:20.515227] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T19:19:21.089352] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-10T19:19:21.528127] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-10T19:19:21.889366] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-10T19:19:21.933208] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T19:19:22.689353] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-10T19:19:22.818513] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-10T19:19:23.489399] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-10T19:19:23.554719] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-10T19:19:23.558839] [INFO ] [REMOTE ] HAE: Full fetch complete (58581 records). [2025-10-10T19:19:23.558919] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-10T19:19:23.928802] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-10T19:19:23.928883] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-10T19:19:23.929674] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-10T19:19:23.929735] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-10T19:19:23.930844] [DEBUG] [LOCAL ] HAE: Trimmed 58581 records to 40041 (keeping 200 days of data) [2025-10-10T19:19:24.158497] [DEBUG] [LOCAL ] HAE: Primary data saved (40041 records). [2025-10-10T19:19:24.158674] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-10T19:19:24.158777] [INFO ] [MAIN ] Update Progress: 991/2373 symbols completed. HAE took 30.5s. Estimated remaining: 3h 14m 19s. Rate: 7.1 symbols/min [2025-10-10T19:19:24.300371] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-10T19:19:24.333618] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:19:24.376256] [DEBUG] [LOCAL ] HASI: Loaded 47632 existing records from primary storage. [2025-10-10T19:19:24.376558] [INFO ] [MAIN ] HASI: Loaded 47632 existing records. [2025-10-10T19:19:24.551231] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:19:24.551416] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-10T19:19:24.551461] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-10T19:19:24.551774] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-10T19:19:24.551831] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-10T19:19:24.910007] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:19:24.940105] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-10T19:19:25.089399] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-10T19:19:25.300533] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-10T19:19:25.889366] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-10T19:19:26.075824] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T19:19:26.080202] [INFO ] [REMOTE ] H: Full fetch complete (62649 records). [2025-10-10T19:19:26.080301] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-10T19:19:26.459600] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-10T19:19:26.459709] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-10T19:19:26.460570] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-10T19:19:26.460612] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-10T19:19:26.461920] [DEBUG] [LOCAL ] H: Trimmed 62649 records to 45165 (keeping 200 days of data) [2025-10-10T19:19:26.691072] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-10T19:19:26.765154] [DEBUG] [LOCAL ] H: Primary data saved (45165 records). [2025-10-10T19:19:26.765305] [INFO ] [MAIN ] H: Full history saved. [2025-10-10T19:19:26.765389] [INFO ] [MAIN ] Update Progress: 992/2373 symbols completed. H took 46.4s. Estimated remaining: 3h 14m 2s. Rate: 7.1 symbols/min [2025-10-10T19:19:26.958946] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:19:27.004301] [DEBUG] [LOCAL ] HAYW: Loaded 49097 existing records from primary storage. [2025-10-10T19:19:27.004616] [INFO ] [MAIN ] HAYW: Loaded 49097 existing records. [2025-10-10T19:19:27.180629] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:19:27.181058] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-10T19:19:27.181174] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-10T19:19:27.181389] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-10T19:19:27.181445] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-10T19:19:27.574875] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:19:27.575827] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-10T19:19:27.578047] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-10T19:19:27.623175] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T19:19:28.289406] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-10T19:19:28.389476] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T19:19:29.089358] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-10T19:19:29.487585] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-10T19:19:29.889392] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-10T19:19:30.449894] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T19:19:30.689416] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-10T19:19:30.750232] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-10T19:19:30.754324] [INFO ] [REMOTE ] HAFN: Full fetch complete (65108 records). [2025-10-10T19:19:30.754436] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-10T19:19:31.151011] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-10T19:19:31.151106] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-10T19:19:31.151986] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-10T19:19:31.152051] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-10T19:19:31.154207] [DEBUG] [LOCAL ] HAFN: Trimmed 65108 records to 43736 (keeping 200 days of data) [2025-10-10T19:19:31.426633] [DEBUG] [LOCAL ] HAFN: Primary data saved (43736 records). [2025-10-10T19:19:31.426825] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-10T19:19:31.426921] [INFO ] [MAIN ] Update Progress: 993/2373 symbols completed. HAFN took 27.5s. Estimated remaining: 3h 13m 48s. Rate: 7.1 symbols/min [2025-10-10T19:19:31.496343] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-10T19:19:31.636904] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:19:31.673906] [DEBUG] [LOCAL ] HBB: Loaded 6516 existing records from primary storage. [2025-10-10T19:19:31.674523] [INFO ] [MAIN ] HBB: Loaded 6516 existing records. [2025-10-10T19:19:31.708714] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-10T19:19:31.878392] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:19:31.878719] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-10T19:19:31.878774] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-10T19:19:31.878975] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-10T19:19:31.879032] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-10T19:19:32.284751] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:19:32.289332] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-10T19:19:32.894511] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-10T19:19:32.957134] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-10T19:19:33.089404] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-10T19:19:33.307397] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T19:19:33.889422] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-10T19:19:33.951867] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-10T19:19:34.689374] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-10T19:19:35.489393] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-10T19:19:35.577106] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-10T19:19:35.602804] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T19:19:36.289422] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-10T19:19:37.089384] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-10T19:19:37.591496] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T19:19:37.889401] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-10T19:19:37.993624] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-10T19:19:38.352165] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-10T19:19:38.689343] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-10T19:19:38.827168] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-10T19:19:39.489437] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-10T19:19:40.289417] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-10T19:19:40.496377] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T19:19:41.089433] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-10T19:19:41.287689] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-10T19:19:41.801300] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-10T19:19:41.889375] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-10T19:19:42.689343] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-10T19:19:42.767688] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-10T19:19:42.914443] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T19:19:43.489391] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-10T19:19:44.289399] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-10T19:19:44.480699] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T19:19:44.907686] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-10T19:19:45.089378] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-10T19:19:45.789912] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-10T19:19:45.889357] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-10T19:19:46.482319] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-10T19:19:46.685371] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-10T19:19:46.689324] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-10T19:19:47.265357] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-10T19:19:47.489390] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-10T19:19:48.289389] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-10T19:19:49.089443] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-10T19:19:49.593190] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-10T19:19:49.598500] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-10-10T19:19:49.598742] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-10T19:19:49.903052] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-10T19:19:49.878531] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-10T19:19:50.046423] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-10T19:19:50.046522] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-10T19:19:50.047668] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-10T19:19:50.047737] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-10T19:19:50.049336] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 54498 (keeping 200 days of data) [2025-10-10T19:19:50.192574] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T19:19:50.429517] [DEBUG] [LOCAL ] HAL: Primary data saved (54498 records). [2025-10-10T19:19:50.429679] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-10T19:19:50.429787] [INFO ] [MAIN ] Update Progress: 994/2373 symbols completed. HAL took 45.1s. Estimated remaining: 3h 13m 55s. Rate: 7.1 symbols/min [2025-10-10T19:19:50.599601] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:19:50.651174] [DEBUG] [LOCAL ] HBI: Loaded 53371 existing records from primary storage. [2025-10-10T19:19:50.651491] [INFO ] [MAIN ] HBI: Loaded 53371 existing records. [2025-10-10T19:19:50.694765] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-10T19:19:50.831636] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:19:50.831904] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-10T19:19:50.831951] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-10T19:19:50.832596] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-10T19:19:50.832685] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-10T19:19:51.184375] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:19:51.400161] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T19:19:51.401261] [INFO ] [REMOTE ] HBB: Full fetch complete (9410 records). [2025-10-10T19:19:51.401330] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-10T19:19:51.492083] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-10T19:19:51.814480] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-10T19:19:51.814622] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-10T19:19:51.814985] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-10T19:19:51.815142] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-10T19:19:51.816187] [DEBUG] [LOCAL ] HBB: Trimmed 9410 records to 6551 (keeping 200 days of data) [2025-10-10T19:19:51.881374] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T19:19:51.901805] [DEBUG] [LOCAL ] HBB: Primary data saved (6551 records). [2025-10-10T19:19:51.902360] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-10T19:19:51.902703] [INFO ] [MAIN ] Update Progress: 995/2373 symbols completed. HBB took 20.5s. Estimated remaining: 3h 13m 37s. Rate: 7.1 symbols/min [2025-10-10T19:19:52.071833] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:19:52.121731] [DEBUG] [LOCAL ] HBM: Loaded 53318 existing records from primary storage. [2025-10-10T19:19:52.122064] [INFO ] [MAIN ] HBM: Loaded 53318 existing records. [2025-10-10T19:19:52.293134] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-10T19:19:52.296982] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:19:52.298325] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-10T19:19:52.298377] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-10T19:19:52.298805] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-10T19:19:52.298864] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-10T19:19:52.653628] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:19:53.089357] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-10T19:19:53.205957] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T19:19:53.889470] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-10T19:19:54.282015] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-10T19:19:54.689412] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-10T19:19:54.875603] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T19:19:55.489436] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-10T19:19:55.553844] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T19:19:56.289383] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-10T19:19:56.602309] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T19:19:57.089402] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-10T19:19:57.278949] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T19:19:57.889404] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-10T19:19:58.044876] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-10T19:19:58.689436] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-10T19:19:58.987431] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T19:19:59.489359] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-10T19:19:59.659125] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T19:20:00.289409] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-10T19:20:00.609982] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T19:20:01.089385] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-10T19:20:01.495372] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-10T19:20:01.889383] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-10T19:20:02.047044] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-10T19:20:02.052926] [INFO ] [REMOTE ] HASI: Full fetch complete (68024 records). [2025-10-10T19:20:02.053262] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-10T19:20:02.493806] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-10T19:20:02.493965] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-10T19:20:02.495262] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-10T19:20:02.495393] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-10T19:20:02.498521] [DEBUG] [LOCAL ] HASI: Trimmed 68024 records to 47989 (keeping 200 days of data) [2025-10-10T19:20:02.633250] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-10T19:20:02.736791] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-10T19:20:02.873772] [DEBUG] [LOCAL ] HASI: Primary data saved (47989 records). [2025-10-10T19:20:02.874002] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-10T19:20:02.874340] [INFO ] [MAIN ] Update Progress: 996/2373 symbols completed. HASI took 38.7s. Estimated remaining: 3h 13m 32s. Rate: 7.1 symbols/min [2025-10-10T19:20:03.077897] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:20:03.134291] [DEBUG] [LOCAL ] HCA: Loaded 47261 existing records from primary storage. [2025-10-10T19:20:03.134753] [INFO ] [MAIN ] HCA: Loaded 47261 existing records. [2025-10-10T19:20:03.341340] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:20:03.341633] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-10T19:20:03.341731] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-10T19:20:03.341970] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-10T19:20:03.342011] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-10T19:20:03.501747] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-10T19:20:03.749800] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:20:03.826873] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T19:20:04.289381] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-10T19:20:04.791021] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-10T19:20:05.089441] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-10T19:20:05.459383] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T19:20:05.655689] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T19:20:05.889413] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-10T19:20:06.605767] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-10T19:20:06.689401] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-10T19:20:07.489419] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-10T19:20:07.925621] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-10T19:20:08.289408] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-10T19:20:08.864550] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-10T19:20:09.089352] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-10T19:20:09.565857] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-10T19:20:09.889401] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-10T19:20:10.230859] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-10T19:20:10.236144] [INFO ] [REMOTE ] HAYW: Full fetch complete (70748 records). [2025-10-10T19:20:10.236323] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-10T19:20:10.658206] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-10T19:20:10.658342] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-10T19:20:10.659473] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-10T19:20:10.659557] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-10T19:20:10.661171] [DEBUG] [LOCAL ] HAYW: Trimmed 70748 records to 49473 (keeping 200 days of data) [2025-10-10T19:20:10.710911] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-10T19:20:10.956082] [DEBUG] [LOCAL ] HAYW: Primary data saved (49473 records). [2025-10-10T19:20:10.956230] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-10T19:20:10.956313] [INFO ] [MAIN ] Update Progress: 997/2373 symbols completed. HAYW took 44.2s. Estimated remaining: 3h 13m 23s. Rate: 7.1 symbols/min [2025-10-10T19:20:11.045352] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T19:20:11.494587] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-10T19:20:11.519023] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T19:20:12.289404] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-10T19:20:12.828420] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-10T19:20:13.089375] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-10T19:20:13.632363] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-10T19:20:13.889357] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-10T19:20:14.128453] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T19:20:14.422042] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T19:20:14.689372] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-10T19:20:15.489423] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-10T19:20:15.755923] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T19:20:16.289350] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-10T19:20:16.922589] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-10T19:20:17.089372] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-10T19:20:17.590207] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-10T19:20:17.889410] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-10T19:20:18.037848] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T19:20:18.042962] [INFO ] [REMOTE ] HBI: Full fetch complete (76867 records). [2025-10-10T19:20:18.043085] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-10T19:20:18.419996] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-10T19:20:18.420469] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-10T19:20:18.421433] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-10T19:20:18.421496] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-10T19:20:18.422959] [DEBUG] [LOCAL ] HBI: Trimmed 76867 records to 53755 (keeping 200 days of data) [2025-10-10T19:20:18.718898] [DEBUG] [LOCAL ] HBI: Primary data saved (53755 records). [2025-10-10T19:20:18.719038] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-10T19:20:18.719122] [INFO ] [MAIN ] Update Progress: 998/2373 symbols completed. HBI took 28.3s. Estimated remaining: 3h 13m 13s. Rate: 7.1 symbols/min [2025-10-10T19:20:19.231816] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-10T19:20:19.249802] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-10T19:20:19.975837] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-10T19:20:19.986589] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-10T19:20:21.297225] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T19:20:21.309150] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-10T19:20:22.148043] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T19:20:22.158222] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-10T19:20:23.501170] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-10T19:20:23.506259] [INFO ] [REMOTE ] HBM: Full fetch complete (76370 records). [2025-10-10T19:20:23.506400] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-10T19:20:23.944193] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-10T19:20:23.944324] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-10T19:20:23.945327] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-10T19:20:23.945510] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-10T19:20:23.947070] [DEBUG] [LOCAL ] HBM: Trimmed 76370 records to 53708 (keeping 200 days of data) [2025-10-10T19:20:24.176614] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T19:20:24.217221] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-10T19:20:24.307581] [DEBUG] [LOCAL ] HBM: Primary data saved (53708 records). [2025-10-10T19:20:24.307764] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-10T19:20:24.307878] [INFO ] [MAIN ] Update Progress: 999/2373 symbols completed. HBM took 32.4s. Estimated remaining: 3h 13m 1s. Rate: 7.1 symbols/min [2025-10-10T19:20:26.138356] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T19:20:26.150981] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-10T19:20:27.766706] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-10T19:20:27.776551] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-10T19:20:29.700410] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T19:20:29.710422] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-10T19:20:31.676049] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-10T19:20:31.680532] [INFO ] [REMOTE ] HCA: Full fetch complete (68706 records). [2025-10-10T19:20:31.680665] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-10T19:20:32.074504] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-10T19:20:32.074582] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-10T19:20:32.075451] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-10T19:20:32.075515] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-10T19:20:32.076867] [DEBUG] [LOCAL ] HCA: Trimmed 68706 records to 47601 (keeping 200 days of data) [2025-10-10T19:20:32.376962] [DEBUG] [LOCAL ] HCA: Primary data saved (47601 records). [2025-10-10T19:20:32.377115] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-10T19:20:32.377522] [INFO ] [MAIN ] Update Progress: 1000/2373 symbols completed. HCA took 29.5s. Estimated remaining: 3h 12m 52s. Rate: 7.1 symbols/min [2025-10-10T19:20:32.926340] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:20:33.060574] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:20:33.058386] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:20:33.086273] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-10T19:20:33.108031] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-10T19:20:33.113549] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:20:33.114262] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-10T19:20:33.114712] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-10T19:20:33.114782] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-10T19:20:33.114820] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-10T19:20:33.246021] [DEBUG] [LOCAL ] HCI: Loaded 14236 existing records from primary storage. [2025-10-10T19:20:33.282365] [INFO ] [MAIN ] HCI: Loaded 14236 existing records. [2025-10-10T19:20:33.402004] [DEBUG] [LOCAL ] HCC: Loaded 45604 existing records from primary storage. [2025-10-10T19:20:33.490832] [INFO ] [MAIN ] HCC: Loaded 45604 existing records. [2025-10-10T19:20:33.719140] [DEBUG] [LOCAL ] HD: Loaded 53881 existing records from primary storage. [2025-10-10T19:20:33.774397] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:20:33.780217] [INFO ] [MAIN ] HD: Loaded 53881 existing records. [2025-10-10T19:20:33.802526] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-10T19:20:33.842198] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-10T19:20:33.925415] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-10T19:20:33.973176] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-10T19:20:33.981480] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:20:34.007052] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-10T19:20:34.099375] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:20:34.168813] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-10T19:20:34.212381] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-10T19:20:34.234861] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-10T19:20:34.235019] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-10T19:20:34.299938] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:20:34.378689] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-10T19:20:34.425503] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-10T19:20:34.483053] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-10T19:20:34.513228] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-10T19:20:34.581418] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-10T19:20:34.642491] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-10T19:20:34.929089] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:20:34.940084] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-10T19:20:35.046147] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-10T19:20:35.102051] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:20:35.054979] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-10T19:20:35.109634] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-10T19:20:35.277952] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:20:35.278259] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-10T19:20:35.536546] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-10T19:20:35.537501] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-10T19:20:36.045524] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-10T19:20:36.048884] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-10T19:20:36.129597] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-10T19:20:36.130396] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-10T19:20:36.406693] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-10T19:20:36.407500] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-10T19:20:36.660311] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-10T19:20:36.661188] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-10T19:20:36.819275] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T19:20:36.827376] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-10T19:20:37.030734] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-10T19:20:37.031566] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-10T19:20:37.120493] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-10T19:20:37.123443] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-10T19:20:37.310126] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-10T19:20:37.310983] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-10T19:20:37.462232] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-10T19:20:37.472940] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-10T19:20:37.578231] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-10T19:20:37.889408] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-10T19:20:38.038235] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-10T19:20:38.147247] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-10T19:20:38.294407] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-10T19:20:38.689409] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-10T19:20:39.052492] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-10T19:20:39.053147] [INFO ] [REMOTE ] HCXY: Full fetch complete (519 records). [2025-10-10T19:20:39.053214] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-10T19:20:39.230317] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-10T19:20:39.230541] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T19:20:39.230686] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T19:20:39.230786] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-10T19:20:39.230865] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-10T19:20:39.230904] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-10T19:20:39.230943] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-10T19:20:39.231007] [INFO ] [MAIN ] Update Progress: 1001/2373 symbols completed. HCXY took 6.8s. Estimated remaining: 3h 12m 42s. Rate: 7.1 symbols/min [2025-10-10T19:20:39.402248] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:20:39.454075] [DEBUG] [LOCAL ] HDB: Loaded 52326 existing records from primary storage. [2025-10-10T19:20:39.454389] [INFO ] [MAIN ] HDB: Loaded 52326 existing records. [2025-10-10T19:20:39.496413] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-10T19:20:39.641765] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:20:39.642011] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-10T19:20:39.642061] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-10T19:20:39.642348] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-10T19:20:39.642398] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-10T19:20:40.049313] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:20:40.067977] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-10T19:20:40.289340] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-10T19:20:40.582846] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-10T19:20:41.089427] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-10T19:20:41.889349] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-10T19:20:42.137738] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T19:20:42.276603] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-10T19:20:42.689400] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-10T19:20:43.489429] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-10T19:20:43.975416] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-10T19:20:44.289396] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-10T19:20:44.416087] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T19:20:44.564885] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-10T19:20:45.089412] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-10T19:20:45.889381] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-10T19:20:46.258422] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T19:20:46.689406] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-10T19:20:46.809126] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T19:20:47.142127] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-10T19:20:47.489375] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-10T19:20:48.289417] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-10T19:20:48.720732] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-10T19:20:49.080888] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-10T19:20:49.093250] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-10T19:20:49.889368] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-10T19:20:49.936049] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T19:20:50.080511] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-10T19:20:50.689386] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-10T19:20:51.489400] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-10T19:20:51.657591] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T19:20:51.746786] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-10T19:20:52.289393] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-10T19:20:53.089355] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-10T19:20:53.312864] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T19:20:53.695882] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-10T19:20:53.889367] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-10T19:20:54.689374] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-10T19:20:54.989814] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T19:20:55.489409] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-10T19:20:56.000184] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T19:20:56.289354] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-10T19:20:56.500418] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-10T19:20:57.089359] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-10T19:20:57.806629] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-10T19:20:57.889398] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-10T19:20:57.928369] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T19:20:58.169179] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T19:20:58.171307] [INFO ] [REMOTE ] HCI: Full fetch complete (19524 records). [2025-10-10T19:20:58.171391] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-10T19:20:58.572500] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-10T19:20:58.572618] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-10T19:20:58.573802] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-10T19:20:58.573879] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-10T19:20:58.574783] [DEBUG] [LOCAL ] HCI: Trimmed 19524 records to 14343 (keeping 200 days of data) [2025-10-10T19:20:58.670811] [DEBUG] [LOCAL ] HCI: Primary data saved (14343 records). [2025-10-10T19:20:58.671011] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-10T19:20:58.671118] [INFO ] [MAIN ] Update Progress: 1002/2373 symbols completed. HCI took 26.3s. Estimated remaining: 3h 12m 48s. Rate: 7.1 symbols/min [2025-10-10T19:20:58.694607] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-10T19:20:58.852951] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:20:58.905745] [DEBUG] [LOCAL ] HE: Loaded 49337 existing records from primary storage. [2025-10-10T19:20:58.906196] [INFO ] [MAIN ] HE: Loaded 49337 existing records. [2025-10-10T19:20:59.086309] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:20:59.086690] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-10T19:20:59.086751] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-10T19:20:59.087582] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-10T19:20:59.087670] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-10T19:20:59.449818] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:20:59.489385] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-10T19:21:00.223377] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-10T19:21:00.289406] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-10T19:21:00.672042] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T19:21:01.089524] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-10T19:21:01.623036] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-10T19:21:01.889413] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-10T19:21:02.231024] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-10T19:21:02.689379] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-10T19:21:02.878382] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T19:21:03.489353] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-10T19:21:03.791907] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T19:21:04.289373] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-10T19:21:04.784389] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-10T19:21:05.089395] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-10T19:21:05.343933] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T19:21:05.889349] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-10T19:21:06.146900] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T19:21:06.689414] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-10T19:21:07.028248] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T19:21:07.105305] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-10T19:21:07.109556] [INFO ] [REMOTE ] HCC: Full fetch complete (64610 records). [2025-10-10T19:21:07.109716] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-10T19:21:07.488631] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-10T19:21:07.488880] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-10T19:21:07.489791] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-10T19:21:07.489879] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-10T19:21:07.489966] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-10T19:21:07.492211] [DEBUG] [LOCAL ] HCC: Trimmed 64610 records to 45904 (keeping 200 days of data) [2025-10-10T19:21:07.764900] [DEBUG] [LOCAL ] HCC: Primary data saved (45904 records). [2025-10-10T19:21:07.765052] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-10T19:21:07.765136] [INFO ] [MAIN ] Update Progress: 1003/2373 symbols completed. HCC took 35.4s. Estimated remaining: 3h 12m 41s. Rate: 7.1 symbols/min [2025-10-10T19:21:07.933270] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:21:07.970496] [DEBUG] [LOCAL ] HEI: Loaded 31775 existing records from primary storage. [2025-10-10T19:21:07.970867] [INFO ] [MAIN ] HEI: Loaded 31775 existing records. [2025-10-10T19:21:08.142811] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:21:08.142999] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-10T19:21:08.143045] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-10T19:21:08.143509] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-10T19:21:08.143566] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-10T19:21:08.292206] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-10T19:21:08.522372] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:21:08.663280] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T19:21:09.089358] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-10T19:21:09.536061] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-10T19:21:09.889394] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-10T19:21:10.617095] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-10T19:21:10.689343] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-10T19:21:11.136054] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T19:21:11.489399] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-10T19:21:11.861244] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T19:21:12.289442] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-10T19:21:13.028490] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-10T19:21:13.034373] [INFO ] [REMOTE ] HD: Full fetch complete (77443 records). [2025-10-10T19:21:13.034548] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-10T19:21:13.097577] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-10T19:21:13.435332] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T19:21:13.466121] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-10T19:21:13.466196] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-10T19:21:13.467165] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-10T19:21:13.467234] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-10T19:21:13.468621] [DEBUG] [LOCAL ] HD: Trimmed 77443 records to 54268 (keeping 200 days of data) [2025-10-10T19:21:13.820912] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T19:21:13.848676] [DEBUG] [LOCAL ] HD: Primary data saved (54268 records). [2025-10-10T19:21:13.848826] [INFO ] [MAIN ] HD: Full history saved. [2025-10-10T19:21:13.848915] [INFO ] [MAIN ] Update Progress: 1004/2373 symbols completed. HD took 41.5s. Estimated remaining: 3h 12m 29s. Rate: 7.1 symbols/min [2025-10-10T19:21:13.894602] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-10T19:21:14.016115] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:21:14.024337] [DEBUG] [LOCAL ] HEQ: Loaded 6643 existing records from primary storage. [2025-10-10T19:21:14.024526] [INFO ] [MAIN ] HEQ: Loaded 6643 existing records. [2025-10-10T19:21:14.194841] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:21:14.195032] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-10T19:21:14.195080] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-10T19:21:14.195352] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-10T19:21:14.195410] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-10T19:21:14.580907] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:21:14.639758] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-10T19:21:14.644816] [INFO ] [REMOTE ] HDB: Full fetch complete (75338 records). [2025-10-10T19:21:14.644929] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-10T19:21:14.699512] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-10T19:21:15.025963] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-10T19:21:15.026057] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-10T19:21:15.027047] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-10T19:21:15.027118] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-10T19:21:15.028709] [DEBUG] [LOCAL ] HDB: Trimmed 75338 records to 52716 (keeping 200 days of data) [2025-10-10T19:21:15.337766] [DEBUG] [LOCAL ] HDB: Primary data saved (52716 records). [2025-10-10T19:21:15.337896] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-10T19:21:15.337978] [INFO ] [MAIN ] Update Progress: 1005/2373 symbols completed. HDB took 36.1s. Estimated remaining: 3h 12m 11s. Rate: 7.1 symbols/min [2025-10-10T19:21:15.505262] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:21:15.502603] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-10T19:21:15.548792] [DEBUG] [LOCAL ] HESM: Loaded 48669 existing records from primary storage. [2025-10-10T19:21:15.549099] [INFO ] [MAIN ] HESM: Loaded 48669 existing records. [2025-10-10T19:21:15.754331] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:21:15.758737] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T19:21:15.755237] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-10T19:21:15.766852] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-10T19:21:15.768039] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-10T19:21:15.768111] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-10T19:21:16.130604] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:21:16.293567] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-10T19:21:16.295447] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-10T19:21:16.612615] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T19:21:17.089383] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-10T19:21:17.818507] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-10T19:21:17.889335] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-10T19:21:18.021111] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T19:21:18.270335] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-10T19:21:18.689416] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-10T19:21:19.169352] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-10T19:21:19.489437] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-10T19:21:20.289408] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-10T19:21:20.390260] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-10T19:21:21.089343] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-10T19:21:21.889394] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-10T19:21:22.056011] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T19:21:22.655082] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-10T19:21:22.689368] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-10T19:21:22.782000] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T19:21:23.489398] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-10T19:21:24.289398] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-10T19:21:24.449428] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T19:21:24.664446] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-10T19:21:25.089440] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-10T19:21:25.674952] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T19:21:25.889417] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-10T19:21:26.689360] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-10T19:21:26.920505] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-10T19:21:27.489362] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-10T19:21:27.715400] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T19:21:27.770050] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-10T19:21:28.289388] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-10T19:21:28.712514] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-10T19:21:29.089359] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-10T19:21:29.320982] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T19:21:29.871766] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-10T19:21:29.889381] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-10T19:21:30.689365] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-10T19:21:30.824484] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-10T19:21:31.489399] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-10T19:21:32.289411] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-10T19:21:32.519196] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T19:21:32.648277] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-10T19:21:32.906371] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T19:21:32.907895] [INFO ] [REMOTE ] HEQ: Full fetch complete (9504 records). [2025-10-10T19:21:32.907966] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-10T19:21:33.094585] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-10T19:21:33.298261] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-10T19:21:33.298358] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-10T19:21:33.298823] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-10T19:21:33.298890] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-10T19:21:33.299352] [DEBUG] [LOCAL ] HEQ: Trimmed 9504 records to 6748 (keeping 200 days of data) [2025-10-10T19:21:33.342294] [DEBUG] [LOCAL ] HEQ: Primary data saved (6748 records). [2025-10-10T19:21:33.342467] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-10T19:21:33.342571] [INFO ] [MAIN ] Update Progress: 1006/2373 symbols completed. HEQ took 19.5s. Estimated remaining: 3h 12m 16s. Rate: 7.1 symbols/min [2025-10-10T19:21:33.517306] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:21:33.517603] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-10T19:21:33.517683] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-10T19:21:33.517811] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-10T19:21:33.517854] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-10T19:21:33.517897] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-10T19:21:33.517933] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-10T19:21:33.897278] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:21:33.892850] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-10T19:21:34.689359] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-10T19:21:34.953802] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-10T19:21:35.489406] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-10T19:21:35.590789] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T19:21:36.289429] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-10T19:21:36.605701] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T19:21:37.089389] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-10T19:21:37.386751] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T19:21:37.873944] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T19:21:37.889338] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-10T19:21:38.689399] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-10T19:21:38.927778] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T19:21:39.494729] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-10T19:21:39.507912] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T19:21:40.175844] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-10T19:21:40.289385] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-10T19:21:41.089363] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-10T19:21:41.314219] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-10T19:21:41.321809] [INFO ] [REMOTE ] HE: Full fetch complete (72155 records). [2025-10-10T19:21:41.321975] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-10T19:21:41.766101] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-10T19:21:41.766197] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-10T19:21:41.767139] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-10T19:21:41.767201] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-10T19:21:41.768714] [DEBUG] [LOCAL ] HE: Trimmed 72155 records to 49673 (keeping 200 days of data) [2025-10-10T19:21:41.889472] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-10T19:21:42.011047] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-10T19:21:42.102411] [DEBUG] [LOCAL ] HE: Primary data saved (49673 records). [2025-10-10T19:21:42.102573] [INFO ] [MAIN ] HE: Full history saved. [2025-10-10T19:21:42.102692] [INFO ] [MAIN ] Update Progress: 1007/2373 symbols completed. HE took 43.4s. Estimated remaining: 3h 12m 8s. Rate: 7.1 symbols/min [2025-10-10T19:21:42.279633] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:21:42.279854] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-10T19:21:42.279911] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-10T19:21:42.280026] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-10T19:21:42.280069] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-10T19:21:42.280110] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-10T19:21:42.280142] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-10T19:21:42.340716] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-10T19:21:42.648208] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:21:42.689367] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-10T19:21:43.047924] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-10T19:21:43.070138] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T19:21:43.489394] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-10T19:21:44.289399] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-10T19:21:44.680092] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-10T19:21:45.089399] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-10T19:21:45.215847] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-10T19:21:45.220822] [INFO ] [REMOTE ] HESM: Full fetch complete (69388 records). [2025-10-10T19:21:45.220958] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-10T19:21:45.598594] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-10T19:21:45.598705] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-10T19:21:45.599568] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-10T19:21:45.599611] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-10T19:21:45.602192] [DEBUG] [LOCAL ] HESM: Trimmed 69388 records to 49040 (keeping 200 days of data) [2025-10-10T19:21:45.888870] [DEBUG] [LOCAL ] HESM: Primary data saved (49040 records). [2025-10-10T19:21:45.889007] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-10T19:21:45.889089] [INFO ] [MAIN ] Update Progress: 1008/2373 symbols completed. HESM took 30.6s. Estimated remaining: 3h 11m 53s. Rate: 7.1 symbols/min [2025-10-10T19:21:45.894858] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-10T19:21:46.060480] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:21:46.077293] [DEBUG] [LOCAL ] HFRO: Loaded 17557 existing records from primary storage. [2025-10-10T19:21:46.077545] [INFO ] [MAIN ] HFRO: Loaded 17557 existing records. [2025-10-10T19:21:46.249759] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:21:46.254143] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-10T19:21:46.254346] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-10T19:21:46.255740] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-10T19:21:46.256296] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-10T19:21:46.256356] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-10T19:21:46.633512] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:21:46.652785] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-10T19:21:46.689349] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-10T19:21:47.489343] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-10T19:21:47.754161] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-10T19:21:48.026979] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T19:21:48.289362] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-10T19:21:49.089345] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-10T19:21:49.367096] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-10T19:21:49.660595] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T19:21:49.889369] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-10T19:21:50.296428] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-10T19:21:50.689384] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-10T19:21:51.489415] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-10T19:21:52.004476] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T19:21:52.009789] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-10T19:21:52.011123] [INFO ] [REMOTE ] HEI: Full fetch complete (47869 records). [2025-10-10T19:21:52.011220] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-10T19:21:52.294565] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-10T19:21:52.386494] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-10T19:21:52.386583] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-10T19:21:52.387393] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-10T19:21:52.387461] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-10T19:21:52.388593] [DEBUG] [LOCAL ] HEI: Trimmed 47869 records to 32017 (keeping 200 days of data) [2025-10-10T19:21:52.590349] [DEBUG] [LOCAL ] HEI: Primary data saved (32017 records). [2025-10-10T19:21:52.590494] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-10T19:21:52.590577] [INFO ] [MAIN ] Update Progress: 1009/2373 symbols completed. HEI took 44.8s. Estimated remaining: 3h 11m 42s. Rate: 7.1 symbols/min [2025-10-10T19:21:52.757143] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:21:52.773332] [DEBUG] [LOCAL ] HGER: Loaded 14502 existing records from primary storage. [2025-10-10T19:21:52.773581] [INFO ] [MAIN ] HGER: Loaded 14502 existing records. [2025-10-10T19:21:52.948010] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:21:52.948206] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-10T19:21:52.948252] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-10T19:21:52.948630] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-10T19:21:52.948717] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-10T19:21:53.094545] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-10T19:21:53.314217] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:21:53.581427] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-10T19:21:53.597119] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T19:21:53.889395] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-10T19:21:54.689368] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-10T19:21:54.722001] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-10T19:21:55.093889] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-10T19:21:55.489387] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-10T19:21:55.865474] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-10T19:21:56.289400] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-10T19:21:56.575505] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-10T19:21:57.089470] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-10T19:21:57.889400] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-10T19:21:57.951098] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-10T19:21:58.260392] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-10T19:21:58.689393] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-10T19:21:58.961610] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-10T19:21:59.489371] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-10T19:21:59.759853] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-10T19:22:00.289391] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-10T19:22:01.064181] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-10T19:22:01.089342] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-10T19:22:01.889365] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-10T19:22:01.959905] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-10T19:22:02.162120] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-10T19:22:02.689374] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-10T19:22:02.955498] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-10T19:22:03.489388] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-10T19:22:04.289355] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-10T19:22:04.791813] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T19:22:05.089462] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-10T19:22:05.215037] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T19:22:05.589140] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-10T19:22:05.889452] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-10T19:22:06.255558] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-10T19:22:06.256255] [INFO ] [REMOTE ] HF: Full fetch complete (440 records). [2025-10-10T19:22:06.256341] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-10T19:22:06.449216] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-10T19:22:06.449338] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-10T19:22:06.449406] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-10T19:22:06.449481] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-10T19:22:06.449543] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-10T19:22:06.449578] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-10T19:22:06.449617] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-10T19:22:06.449699] [INFO ] [MAIN ] Update Progress: 1010/2373 symbols completed. HF took 33.1s. Estimated remaining: 3h 11m 41s. Rate: 7.1 symbols/min [2025-10-10T19:22:06.624786] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:22:06.634945] [DEBUG] [LOCAL ] HGLB: Loaded 9747 existing records from primary storage. [2025-10-10T19:22:06.635155] [INFO ] [MAIN ] HGLB: Loaded 9747 existing records. [2025-10-10T19:22:06.698355] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-10T19:22:06.818005] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:22:06.818247] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-10T19:22:06.818296] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-10T19:22:06.818601] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-10T19:22:06.818697] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-10T19:22:07.167023] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:22:07.263721] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-10T19:22:07.489416] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-10T19:22:08.024337] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-10T19:22:08.289395] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-10T19:22:09.089387] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-10T19:22:09.486741] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-10T19:22:09.889373] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-10T19:22:10.056256] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-10T19:22:10.689345] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-10T19:22:10.788533] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-10T19:22:11.192717] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-10T19:22:11.193564] [INFO ] [REMOTE ] HFND: Full fetch complete (1798 records). [2025-10-10T19:22:11.193636] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-10T19:22:11.386625] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-10T19:22:11.386870] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-10T19:22:11.386940] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-10T19:22:11.387011] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-10T19:22:11.387099] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-10T19:22:11.387157] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-10T19:22:11.387201] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-10T19:22:11.387260] [INFO ] [MAIN ] Update Progress: 1011/2373 symbols completed. HFND took 29.3s. Estimated remaining: 3h 11m 28s. Rate: 7.1 symbols/min [2025-10-10T19:22:11.494711] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-10T19:22:11.573271] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:22:11.587699] [DEBUG] [LOCAL ] HGTY: Loaded 13314 existing records from primary storage. [2025-10-10T19:22:11.587942] [INFO ] [MAIN ] HGTY: Loaded 13314 existing records. [2025-10-10T19:22:11.773443] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:22:11.773687] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-10T19:22:11.773746] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-10T19:22:11.774173] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-10T19:22:11.774232] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-10T19:22:12.126531] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:22:12.289387] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-10T19:22:12.455365] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-10T19:22:13.089433] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-10T19:22:13.232585] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T19:22:13.889341] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-10T19:22:14.218516] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-10T19:22:14.689366] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-10T19:22:14.790484] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-10T19:22:15.489363] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-10T19:22:15.843812] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-10T19:22:16.289372] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-10T19:22:16.412738] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-10T19:22:17.089372] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-10T19:22:17.217310] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-10T19:22:17.889353] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-10T19:22:18.182871] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-10T19:22:18.689373] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-10T19:22:18.798226] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-10T19:22:19.489438] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-10T19:22:19.663955] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-10T19:22:20.180508] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-10T19:22:20.289406] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-10T19:22:21.089368] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-10T19:22:21.229514] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-10T19:22:21.889413] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-10T19:22:22.005588] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-10T19:22:22.689384] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-10T19:22:23.159520] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-10T19:22:23.162444] [INFO ] [REMOTE ] HGER: Full fetch complete (17983 records). [2025-10-10T19:22:23.162531] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-10T19:22:23.523453] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-10T19:22:23.513993] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-10T19:22:23.523706] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-10T19:22:23.524895] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-10T19:22:23.525000] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-10T19:22:23.525698] [DEBUG] [LOCAL ] HGER: Trimmed 17983 records to 14757 (keeping 200 days of data) [2025-10-10T19:22:23.611317] [DEBUG] [LOCAL ] HGER: Primary data saved (14757 records). [2025-10-10T19:22:23.611521] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-10T19:22:23.611614] [INFO ] [MAIN ] Update Progress: 1012/2373 symbols completed. HGER took 31.0s. Estimated remaining: 3h 11m 25s. Rate: 7.1 symbols/min [2025-10-10T19:22:23.719542] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-10T19:22:23.789810] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:22:23.831887] [DEBUG] [LOCAL ] HGV: Loaded 46691 existing records from primary storage. [2025-10-10T19:22:23.832198] [INFO ] [MAIN ] HGV: Loaded 46691 existing records. [2025-10-10T19:22:24.014855] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:22:24.015079] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-10T19:22:24.015128] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-10T19:22:24.015420] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-10T19:22:24.015479] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-10T19:22:24.297164] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-10T19:22:24.382036] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:22:24.458008] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T19:22:25.089440] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-10T19:22:25.328103] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-10T19:22:25.889533] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-10T19:22:26.569380] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T19:22:26.689358] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-10T19:22:26.782625] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-10T19:22:27.489349] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-10T19:22:27.565237] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-10T19:22:28.289353] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-10T19:22:28.375863] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-10T19:22:29.089371] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-10T19:22:29.595354] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T19:22:29.889401] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-10T19:22:29.973965] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-10T19:22:30.481402] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-10T19:22:30.689359] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-10T19:22:31.489353] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-10T19:22:31.676294] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-10T19:22:32.289351] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-10T19:22:32.693506] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T19:22:33.089377] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-10T19:22:33.514503] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-10T19:22:33.775780] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-10T19:22:33.889352] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-10T19:22:34.689354] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-10T19:22:35.179958] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T19:22:35.489352] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-10T19:22:35.880875] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-10T19:22:36.289384] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-10T19:22:37.089355] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-10T19:22:37.305814] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T19:22:37.307570] [INFO ] [REMOTE ] HGTY: Full fetch complete (17313 records). [2025-10-10T19:22:37.307664] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-10T19:22:37.630557] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T19:22:37.771152] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-10T19:22:37.771321] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-10T19:22:37.772189] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-10T19:22:37.772256] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-10T19:22:37.772888] [DEBUG] [LOCAL ] HGTY: Trimmed 17313 records to 13389 (keeping 200 days of data) [2025-10-10T19:22:37.858948] [DEBUG] [LOCAL ] HGTY: Primary data saved (13389 records). [2025-10-10T19:22:37.859284] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-10T19:22:37.859405] [INFO ] [MAIN ] Update Progress: 1013/2373 symbols completed. HGTY took 26.5s. Estimated remaining: 3h 11m 24s. Rate: 7.1 symbols/min [2025-10-10T19:22:37.894554] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-10T19:22:37.996518] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T19:22:38.057665] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:22:38.089775] [DEBUG] [LOCAL ] HHH: Loaded 33138 existing records from primary storage. [2025-10-10T19:22:38.090092] [INFO ] [MAIN ] HHH: Loaded 33138 existing records. [2025-10-10T19:22:38.268542] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:22:38.268788] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-10T19:22:38.268850] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-10T19:22:38.269521] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-10T19:22:38.269579] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-10T19:22:38.612083] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:22:38.689351] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-10T19:22:39.489378] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-10T19:22:39.808825] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T19:22:40.100881] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T19:22:40.289365] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-10T19:22:40.509940] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T19:22:40.511863] [INFO ] [REMOTE ] HFRO: Full fetch complete (28392 records). [2025-10-10T19:22:40.511933] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-10T19:22:40.882536] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-10T19:22:40.882625] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-10T19:22:40.883203] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-10T19:22:40.883272] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-10T19:22:40.883994] [DEBUG] [LOCAL ] HFRO: Trimmed 28392 records to 17645 (keeping 200 days of data) [2025-10-10T19:22:40.984169] [DEBUG] [LOCAL ] HFRO: Primary data saved (17645 records). [2025-10-10T19:22:40.984308] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-10T19:22:40.984403] [INFO ] [MAIN ] Update Progress: 1014/2373 symbols completed. HFRO took 55.1s. Estimated remaining: 3h 11m 8s. Rate: 7.1 symbols/min [2025-10-10T19:22:41.094579] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-10T19:22:41.157182] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:22:41.191773] [DEBUG] [LOCAL ] HI: Loaded 35577 existing records from primary storage. [2025-10-10T19:22:41.192058] [INFO ] [MAIN ] HI: Loaded 35577 existing records. [2025-10-10T19:22:41.368492] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:22:41.368872] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-10T19:22:41.368994] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-10T19:22:41.369481] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-10T19:22:41.369540] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-10T19:22:41.747127] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T19:22:41.751778] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:22:41.889350] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-10T19:22:42.038281] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-10T19:22:42.689379] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-10T19:22:43.401545] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-10T19:22:43.489394] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-10T19:22:43.619453] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T19:22:43.621142] [INFO ] [REMOTE ] HGLB: Full fetch complete (14797 records). [2025-10-10T19:22:43.621209] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-10T19:22:43.979840] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-10T19:22:43.979933] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-10T19:22:43.980321] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-10T19:22:43.980364] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-10T19:22:43.980909] [DEBUG] [LOCAL ] HGLB: Trimmed 14797 records to 9807 (keeping 200 days of data) [2025-10-10T19:22:44.040106] [DEBUG] [LOCAL ] HGLB: Primary data saved (9807 records). [2025-10-10T19:22:44.040245] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-10T19:22:44.040330] [INFO ] [MAIN ] Update Progress: 1015/2373 symbols completed. HGLB took 37.6s. Estimated remaining: 3h 10m 53s. Rate: 7.1 symbols/min [2025-10-10T19:22:44.210789] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:22:44.260523] [DEBUG] [LOCAL ] HIG: Loaded 51520 existing records from primary storage. [2025-10-10T19:22:44.260877] [INFO ] [MAIN ] HIG: Loaded 51520 existing records. [2025-10-10T19:22:44.294586] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-10T19:22:44.436868] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:22:44.437105] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-10T19:22:44.437158] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-10T19:22:44.437465] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-10T19:22:44.437522] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-10T19:22:44.794249] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:22:44.984824] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-10T19:22:45.089408] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-10T19:22:45.889407] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-10T19:22:46.195605] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T19:22:46.518925] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T19:22:46.689373] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-10T19:22:47.241549] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-10T19:22:47.489379] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-10T19:22:48.198349] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T19:22:48.289388] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-10T19:22:49.089553] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-10T19:22:49.391271] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T19:22:49.849432] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-10T19:22:49.889338] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-10T19:22:50.521915] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-10T19:22:50.689385] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-10T19:22:51.489450] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-10T19:22:51.607194] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T19:22:52.289347] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-10T19:22:52.484631] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-10T19:22:53.089394] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-10T19:22:53.889385] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-10T19:23:06.020532] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (12.13 seconds). [2025-10-10T19:23:06.028046] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-10T19:23:06.618035] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (14.33 seconds). [2025-10-10T19:23:06.627384] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-10T19:23:06.729812] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (15.24 seconds). [2025-10-10T19:23:06.739520] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-10T19:23:07.007174] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (13.92 seconds). [2025-10-10T19:23:07.016942] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-10T19:23:08.736695] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T19:23:08.747692] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-10T19:23:08.845698] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-10T19:23:08.854761] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-10T19:23:08.900711] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T19:23:08.912036] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-10T19:23:09.074276] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-10-10T19:23:09.082055] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-10T19:23:10.421348] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T19:23:10.429093] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-10T19:23:10.557757] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-10T19:23:10.567808] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-10T19:23:10.644873] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T19:23:10.652318] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-10T19:23:10.683902] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T19:23:10.695021] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-10T19:23:11.751827] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T19:23:11.759756] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-10T19:23:12.466664] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T19:23:12.474578] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-10T19:23:12.596093] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T19:23:12.605871] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-10T19:23:12.932469] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-10T19:23:12.943586] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-10T19:23:14.022282] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-10T19:23:14.025446] [INFO ] [REMOTE ] HHH: Full fetch complete (45734 records). [2025-10-10T19:23:14.025547] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-10T19:23:14.407583] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-10T19:23:14.407762] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-10T19:23:14.408505] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-10T19:23:14.408584] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-10T19:23:14.409635] [DEBUG] [LOCAL ] HHH: Trimmed 45734 records to 33400 (keeping 200 days of data) [2025-10-10T19:23:14.525385] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-10T19:23:14.537145] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-10T19:23:14.647509] [DEBUG] [LOCAL ] HHH: Primary data saved (33400 records). [2025-10-10T19:23:14.647680] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-10T19:23:14.647782] [INFO ] [MAIN ] Update Progress: 1016/2373 symbols completed. HHH took 36.8s. Estimated remaining: 3h 11m 14s. Rate: 7.1 symbols/min [2025-10-10T19:23:14.815477] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:23:14.850969] [DEBUG] [LOCAL ] HII: Loaded 34262 existing records from primary storage. [2025-10-10T19:23:14.851280] [INFO ] [MAIN ] HII: Loaded 34262 existing records. [2025-10-10T19:23:15.027319] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:23:15.027684] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-10T19:23:15.027777] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-10T19:23:15.028177] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-10T19:23:15.028238] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-10T19:23:15.346402] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-10T19:23:15.409665] [INFO ] [REMOTE ] HGV: Full fetch complete (65792 records). [2025-10-10T19:23:15.415009] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:23:15.415421] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-10T19:23:15.441488] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-10T19:23:15.504359] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-10T19:23:15.576418] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-10T19:23:15.867431] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-10T19:23:15.867537] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-10T19:23:15.868507] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-10T19:23:15.868576] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-10T19:23:15.870124] [DEBUG] [LOCAL ] HGV: Trimmed 65792 records to 46989 (keeping 200 days of data) [2025-10-10T19:23:16.143281] [DEBUG] [LOCAL ] HGV: Primary data saved (46989 records). [2025-10-10T19:23:16.143426] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-10T19:23:16.143510] [INFO ] [MAIN ] Update Progress: 1017/2373 symbols completed. HGV took 52.5s. Estimated remaining: 3h 10m 56s. Rate: 7.1 symbols/min [2025-10-10T19:23:16.313212] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:23:16.362602] [DEBUG] [LOCAL ] HIMS: Loaded 54207 existing records from primary storage. [2025-10-10T19:23:16.362966] [INFO ] [MAIN ] HIMS: Loaded 54207 existing records. [2025-10-10T19:23:16.539210] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:23:16.539579] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-10T19:23:16.539693] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-10T19:23:16.540897] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-10T19:23:16.540956] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-10T19:23:16.848854] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-10T19:23:16.896026] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-10T19:23:16.940274] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:23:16.940576] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-10T19:23:17.248574] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T19:23:17.257400] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-10T19:23:17.600145] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T19:23:17.611692] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-10T19:23:17.915606] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T19:23:17.919368] [INFO ] [REMOTE ] HI: Full fetch complete (50052 records). [2025-10-10T19:23:17.919470] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-10T19:23:18.309706] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-10T19:23:18.309799] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-10T19:23:18.310635] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-10T19:23:18.310719] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-10T19:23:18.311981] [DEBUG] [LOCAL ] HI: Trimmed 50052 records to 35881 (keeping 200 days of data) [2025-10-10T19:23:18.543351] [DEBUG] [LOCAL ] HI: Primary data saved (35881 records). [2025-10-10T19:23:18.543473] [INFO ] [MAIN ] HI: Full history saved. [2025-10-10T19:23:18.543557] [INFO ] [MAIN ] Update Progress: 1018/2373 symbols completed. HI took 37.6s. Estimated remaining: 3h 10m 40s. Rate: 7.1 symbols/min [2025-10-10T19:23:18.724143] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:23:18.748014] [DEBUG] [LOCAL ] HIO: Loaded 24258 existing records from primary storage. [2025-10-10T19:23:18.748265] [INFO ] [MAIN ] HIO: Loaded 24258 existing records. [2025-10-10T19:23:18.935887] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:23:18.936409] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-10T19:23:18.936488] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-10T19:23:18.944796] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-10T19:23:18.950024] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-10T19:23:19.017180] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-10T19:23:19.071269] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-10T19:23:19.330443] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:23:19.330808] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-10T19:23:19.548214] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-10T19:23:19.559092] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-10T19:23:19.638353] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T19:23:19.649465] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-10T19:23:20.660573] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T19:23:20.666452] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-10T19:23:21.090624] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T19:23:21.099766] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-10T19:23:21.519899] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T19:23:21.531710] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-10T19:23:21.666508] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-10T19:23:21.677304] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-10T19:23:21.694676] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-10T19:23:21.701071] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-10T19:23:23.109930] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-10T19:23:23.120324] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-10T19:23:23.252807] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-10T19:23:23.259141] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-10T19:23:23.492164] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-10T19:23:23.496806] [INFO ] [REMOTE ] HIG: Full fetch complete (73180 records). [2025-10-10T19:23:23.496913] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-10T19:23:23.891508] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-10T19:23:23.891600] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-10T19:23:23.892537] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-10T19:23:23.892605] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-10T19:23:23.894170] [DEBUG] [LOCAL ] HIG: Trimmed 73180 records to 51891 (keeping 200 days of data) [2025-10-10T19:23:24.218585] [DEBUG] [LOCAL ] HIG: Primary data saved (51891 records). [2025-10-10T19:23:24.218805] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-10T19:23:24.219304] [INFO ] [MAIN ] Update Progress: 1019/2373 symbols completed. HIG took 40.2s. Estimated remaining: 3h 10m 28s. Rate: 7.1 symbols/min [2025-10-10T19:23:24.323587] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-10-10T19:23:24.395178] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-10T19:23:24.421319] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-10T19:23:24.491193] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-10T19:23:24.497019] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:23:24.524676] [DEBUG] [LOCAL ] HIPO: Loaded 22079 existing records from primary storage. [2025-10-10T19:23:24.525080] [INFO ] [MAIN ] HIPO: Loaded 22079 existing records. [2025-10-10T19:23:24.717162] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:23:24.717563] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-10T19:23:24.717628] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-10T19:23:24.718021] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-10T19:23:24.718081] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-10T19:23:25.094980] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:23:25.095410] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-10T19:23:25.125093] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T19:23:25.135781] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-10T19:23:25.827593] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-10T19:23:25.833904] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-10T19:23:26.397837] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-10T19:23:26.402552] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-10T19:23:26.992192] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T19:23:26.999948] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-10T19:23:27.076813] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-10T19:23:27.079932] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-10T19:23:27.183545] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-10T19:23:27.489387] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-10T19:23:28.130301] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-10T19:23:28.289403] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-10T19:23:28.546532] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T19:23:29.087988] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-10T19:23:29.092635] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-10T19:23:29.889425] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-10T19:23:30.689393] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-10T19:23:30.942933] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-10T19:23:31.489409] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-10T19:23:31.881484] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-10T19:23:31.944170] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-10T19:23:32.289435] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-10T19:23:32.750410] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T19:23:33.089386] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-10T19:23:33.889453] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-10T19:23:34.389490] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T19:23:34.689431] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-10T19:23:35.319181] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-10-10T19:23:35.489351] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-10T19:23:35.535445] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T19:23:35.816247] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T19:23:36.289425] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-10T19:23:37.089350] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-10T19:23:37.491417] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T19:23:37.889409] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-10T19:23:38.304282] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-10-10T19:23:38.689348] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-10T19:23:38.751697] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-10T19:23:39.188365] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-10T19:23:39.191988] [INFO ] [REMOTE ] HIO: Full fetch complete (37747 records). [2025-10-10T19:23:39.192098] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-10T19:23:39.492309] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-10T19:23:39.580579] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-10T19:23:39.580689] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-10T19:23:39.581394] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-10T19:23:39.581438] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-10T19:23:39.582379] [DEBUG] [LOCAL ] HIO: Trimmed 37747 records to 24411 (keeping 200 days of data) [2025-10-10T19:23:39.728001] [DEBUG] [LOCAL ] HIO: Primary data saved (24411 records). [2025-10-10T19:23:39.728144] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-10T19:23:39.728231] [INFO ] [MAIN ] Update Progress: 1020/2373 symbols completed. HIO took 21.2s. Estimated remaining: 3h 10m 28s. Rate: 7.1 symbols/min [2025-10-10T19:23:39.896929] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:23:39.937903] [DEBUG] [LOCAL ] HIW: Loaded 44796 existing records from primary storage. [2025-10-10T19:23:39.938246] [INFO ] [MAIN ] HIW: Loaded 44796 existing records. [2025-10-10T19:23:40.117024] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:23:40.117241] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-10T19:23:40.117288] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-10T19:23:40.118297] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-10T19:23:40.118356] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-10T19:23:40.292588] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-10T19:23:40.479087] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:23:40.955466] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T19:23:41.093286] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-10T19:23:41.108184] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-10T19:23:41.889379] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-10T19:23:42.034199] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-10T19:23:42.689411] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-10T19:23:42.814106] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T19:23:43.489388] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-10T19:23:43.939562] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-10T19:23:44.289353] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-10T19:23:44.541895] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-10T19:23:44.576321] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T19:23:44.579550] [INFO ] [REMOTE ] HII: Full fetch complete (52359 records). [2025-10-10T19:23:44.579635] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-10T19:23:44.962890] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-10T19:23:44.962974] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-10T19:23:44.963722] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-10T19:23:44.963783] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-10T19:23:44.964922] [DEBUG] [LOCAL ] HII: Trimmed 52359 records to 34485 (keeping 200 days of data) [2025-10-10T19:23:45.092522] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-10T19:23:45.194406] [DEBUG] [LOCAL ] HII: Primary data saved (34485 records). [2025-10-10T19:23:45.194572] [INFO ] [MAIN ] HII: Full history saved. [2025-10-10T19:23:45.194704] [INFO ] [MAIN ] Update Progress: 1021/2373 symbols completed. HII took 30.5s. Estimated remaining: 3h 10m 16s. Rate: 7.1 symbols/min [2025-10-10T19:23:45.369225] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:23:45.387963] [DEBUG] [LOCAL ] HIX: Loaded 20748 existing records from primary storage. [2025-10-10T19:23:45.388209] [INFO ] [MAIN ] HIX: Loaded 20748 existing records. [2025-10-10T19:23:45.545839] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-10T19:23:45.586674] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:23:45.586941] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-10T19:23:45.586995] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-10T19:23:45.587579] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-10T19:23:45.587636] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-10T19:23:45.894592] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-10T19:23:45.937619] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:23:46.689394] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-10T19:23:47.489349] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-10T19:23:47.572428] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-10T19:23:48.025374] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.93 seconds). [2025-10-10T19:23:48.075282] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T19:23:48.289390] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-10T19:23:48.712316] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T19:23:49.089357] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-10T19:23:49.150017] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-10T19:23:49.889338] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-10T19:23:50.291542] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T19:23:50.293664] [INFO ] [REMOTE ] HIPO: Full fetch complete (31351 records). [2025-10-10T19:23:50.293776] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-10T19:23:50.655471] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-10T19:23:50.655568] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-10T19:23:50.656195] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-10T19:23:50.656256] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-10T19:23:50.657064] [DEBUG] [LOCAL ] HIPO: Trimmed 31351 records to 22218 (keeping 200 days of data) [2025-10-10T19:23:50.704001] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-10T19:23:50.791434] [DEBUG] [LOCAL ] HIPO: Primary data saved (22218 records). [2025-10-10T19:23:50.791576] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-10T19:23:50.791680] [INFO ] [MAIN ] Update Progress: 1022/2373 symbols completed. HIPO took 26.6s. Estimated remaining: 3h 10m 4s. Rate: 7.1 symbols/min [2025-10-10T19:23:50.995057] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:23:51.012551] [DEBUG] [LOCAL ] HKD: Loaded 18664 existing records from primary storage. [2025-10-10T19:23:51.012835] [INFO ] [MAIN ] HKD: Loaded 18664 existing records. [2025-10-10T19:23:51.191719] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:23:51.191950] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-10T19:23:51.192048] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-10T19:23:51.192481] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-10T19:23:51.192540] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-10T19:23:51.493156] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-10T19:23:51.549539] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:23:51.619588] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T19:23:51.902314] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-10T19:23:52.289359] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-10T19:23:53.089422] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-10T19:23:53.889398] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-10T19:23:54.034322] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-10T19:23:54.117477] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-10T19:23:54.438870] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.95 seconds). [2025-10-10T19:23:54.444026] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-10-10T19:23:54.444166] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-10T19:23:54.694553] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-10T19:23:54.863530] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-10T19:23:54.863630] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-10T19:23:54.864748] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-10T19:23:54.864819] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-10T19:23:54.866482] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 54597 (keeping 200 days of data) [2025-10-10T19:23:55.209492] [DEBUG] [LOCAL ] HIMS: Primary data saved (54597 records). [2025-10-10T19:23:55.209610] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-10T19:23:55.209740] [INFO ] [MAIN ] Update Progress: 1023/2373 symbols completed. HIMS took 39.1s. Estimated remaining: 3h 9m 50s. Rate: 7.1 symbols/min [2025-10-10T19:23:55.392402] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:23:55.409486] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T19:23:55.462580] [DEBUG] [LOCAL ] HL: Loaded 54062 existing records from primary storage. [2025-10-10T19:23:55.463730] [INFO ] [MAIN ] HL: Loaded 54062 existing records. [2025-10-10T19:23:55.495211] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-10T19:23:55.650595] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:23:55.650876] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-10T19:23:55.650924] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-10T19:23:55.652004] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-10T19:23:55.652066] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-10T19:23:56.028756] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:23:56.043811] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T19:23:56.289370] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-10T19:23:57.089419] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-10T19:23:57.280074] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T19:23:57.879932] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T19:23:57.891253] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-10T19:23:58.350403] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T19:23:58.689396] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-10T19:23:59.489397] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-10T19:23:59.929183] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T19:24:00.289365] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-10T19:24:00.557426] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-10T19:24:00.721918] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T19:24:01.089376] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-10T19:24:01.566490] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T19:24:01.889421] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-10T19:24:02.467048] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-10T19:24:02.689398] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-10T19:24:03.494512] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-10T19:24:03.516379] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T19:24:04.113491] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T19:24:04.289408] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-10T19:24:04.704534] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T19:24:05.089456] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-10T19:24:05.116236] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-10T19:24:05.889410] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-10T19:24:06.363721] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T19:24:06.689400] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-10T19:24:07.489375] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-10T19:24:07.850047] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-10T19:24:07.852792] [INFO ] [REMOTE ] HIX: Full fetch complete (30275 records). [2025-10-10T19:24:07.852965] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-10T19:24:08.108696] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-10T19:24:08.308818] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-10T19:24:08.323131] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-10T19:24:08.323195] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-10T19:24:08.323941] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-10T19:24:08.324007] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-10T19:24:08.324966] [DEBUG] [LOCAL ] HIX: Trimmed 30275 records to 20859 (keeping 200 days of data) [2025-10-10T19:24:08.461832] [DEBUG] [LOCAL ] HIX: Primary data saved (20859 records). [2025-10-10T19:24:08.462010] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-10T19:24:08.462116] [INFO ] [MAIN ] Update Progress: 1024/2373 symbols completed. HIX took 23.3s. Estimated remaining: 3h 9m 48s. Rate: 7.1 symbols/min [2025-10-10T19:24:08.638347] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:24:08.695737] [DEBUG] [LOCAL ] HLF: Loaded 48765 existing records from primary storage. [2025-10-10T19:24:08.696313] [INFO ] [MAIN ] HLF: Loaded 48765 existing records. [2025-10-10T19:24:08.910612] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:24:08.910951] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-10T19:24:08.911021] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-10T19:24:08.912242] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-10T19:24:08.912318] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-10T19:24:09.109934] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-10T19:24:09.346965] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:24:09.350590] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T19:24:09.889410] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-10T19:24:10.383012] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-10T19:24:10.694515] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-10T19:24:10.715242] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-10T19:24:11.489407] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-10T19:24:11.666920] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T19:24:12.289340] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-10T19:24:12.521606] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T19:24:12.706261] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-10T19:24:13.089375] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-10T19:24:13.889352] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-10T19:24:14.059556] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T19:24:14.689367] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-10T19:24:15.472738] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-10T19:24:15.501729] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-10T19:24:15.505220] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-10T19:24:15.971234] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T19:24:15.975567] [INFO ] [REMOTE ] HIW: Full fetch complete (64726 records). [2025-10-10T19:24:15.975759] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-10T19:24:16.294442] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-10T19:24:16.374334] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-10T19:24:16.374419] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-10T19:24:16.375281] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-10T19:24:16.375346] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-10T19:24:16.377021] [DEBUG] [LOCAL ] HIW: Trimmed 64726 records to 45116 (keeping 200 days of data) [2025-10-10T19:24:16.665341] [DEBUG] [LOCAL ] HIW: Primary data saved (45116 records). [2025-10-10T19:24:16.665490] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-10T19:24:16.665585] [INFO ] [MAIN ] Update Progress: 1025/2373 symbols completed. HIW took 36.9s. Estimated remaining: 3h 9m 39s. Rate: 7.1 symbols/min [2025-10-10T19:24:16.843697] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:24:16.874525] [DEBUG] [LOCAL ] HLI: Loaded 31088 existing records from primary storage. [2025-10-10T19:24:16.874827] [INFO ] [MAIN ] HLI: Loaded 31088 existing records. [2025-10-10T19:24:17.053774] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:24:17.054125] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-10T19:24:17.054181] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-10T19:24:17.054886] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-10T19:24:17.054945] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-10T19:24:17.099743] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-10T19:24:17.438613] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T19:24:17.443035] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:24:17.668208] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-10T19:24:17.889366] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-10T19:24:18.689371] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-10T19:24:19.489438] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-10T19:24:19.561607] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-10T19:24:19.663978] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T19:24:19.878420] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T19:24:20.289365] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-10T19:24:20.481689] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-10T19:24:21.089506] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-10T19:24:21.889343] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-10T19:24:22.127453] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T19:24:22.216283] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T19:24:22.689374] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-10T19:24:22.966770] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T19:24:23.489392] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-10T19:24:24.289421] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-10T19:24:24.573301] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T19:24:24.839508] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T19:24:24.841826] [INFO ] [REMOTE ] HKD: Full fetch complete (28329 records). [2025-10-10T19:24:24.841901] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-10T19:24:25.098787] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-10T19:24:25.208747] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-10T19:24:25.208833] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-10T19:24:25.209376] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-10T19:24:25.209414] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-10T19:24:25.210071] [DEBUG] [LOCAL ] HKD: Trimmed 28329 records to 18878 (keeping 200 days of data) [2025-10-10T19:24:25.313971] [DEBUG] [LOCAL ] HKD: Primary data saved (18878 records). [2025-10-10T19:24:25.314101] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-10T19:24:25.314182] [INFO ] [MAIN ] Update Progress: 1026/2373 symbols completed. HKD took 34.5s. Estimated remaining: 3h 9m 31s. Rate: 7.1 symbols/min [2025-10-10T19:24:25.483891] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:24:25.511224] [DEBUG] [LOCAL ] HLIO: Loaded 28060 existing records from primary storage. [2025-10-10T19:24:25.511500] [INFO ] [MAIN ] HLIO: Loaded 28060 existing records. [2025-10-10T19:24:25.688900] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:24:25.689155] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-10T19:24:25.689204] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-10T19:24:25.689916] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-10T19:24:25.689990] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-10T19:24:25.904127] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-10T19:24:26.049576] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:24:26.219575] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T19:24:26.689377] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-10T19:24:26.966832] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-10T19:24:27.476973] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T19:24:27.489324] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-10T19:24:28.289335] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-10T19:24:28.520123] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T19:24:28.553430] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-10T19:24:29.089381] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-10T19:24:29.889402] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-10T19:24:30.128264] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T19:24:30.689346] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-10T19:24:30.737712] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-10T19:24:31.084053] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T19:24:31.489373] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-10T19:24:32.289391] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-10T19:24:32.602922] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T19:24:32.678965] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-10T19:24:33.089376] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-10T19:24:33.889422] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-10T19:24:33.928327] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T19:24:34.490720] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-10T19:24:34.689365] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-10T19:24:35.036500] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-10T19:24:35.489367] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-10T19:24:36.289376] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-10T19:24:37.089349] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-10T19:24:37.122468] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-10T19:24:37.234680] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T19:24:37.682430] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-10T19:24:37.889344] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-10T19:24:38.626399] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-10T19:24:38.689334] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-10T19:24:39.489347] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-10T19:24:39.681630] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-10T19:24:39.700627] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-10T19:24:39.705608] [INFO ] [REMOTE ] HL: Full fetch complete (77663 records). [2025-10-10T19:24:39.705757] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-10T19:24:40.127977] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-10T19:24:40.128073] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-10T19:24:40.129122] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-10T19:24:40.129232] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-10T19:24:40.130799] [DEBUG] [LOCAL ] HL: Trimmed 77663 records to 54452 (keeping 200 days of data) [2025-10-10T19:24:40.295329] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-10T19:24:40.451402] [DEBUG] [LOCAL ] HL: Primary data saved (54452 records). [2025-10-10T19:24:40.451539] [INFO ] [MAIN ] HL: Full history saved. [2025-10-10T19:24:40.451618] [INFO ] [MAIN ] Update Progress: 1027/2373 symbols completed. HL took 45.2s. Estimated remaining: 3h 9m 31s. Rate: 7.1 symbols/min [2025-10-10T19:24:40.623554] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:24:40.655553] [DEBUG] [LOCAL ] HLLY: Loaded 33723 existing records from primary storage. [2025-10-10T19:24:40.655860] [INFO ] [MAIN ] HLLY: Loaded 33723 existing records. [2025-10-10T19:24:40.831006] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:24:40.831405] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-10T19:24:40.831497] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-10T19:24:40.831902] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-10T19:24:40.832005] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-10T19:24:40.964910] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-10T19:24:41.094730] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-10T19:24:41.222805] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:24:41.889349] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-10T19:24:42.022080] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-10T19:24:42.689358] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-10T19:24:42.759182] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-10T19:24:42.952143] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-10T19:24:43.489434] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-10T19:24:44.231828] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-10T19:24:44.289344] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-10T19:24:44.943496] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-10T19:24:45.089347] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-10T19:24:45.697992] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T19:24:45.889370] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-10T19:24:45.958081] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-10T19:24:46.689355] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-10T19:24:47.471040] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-10T19:24:47.489348] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-10T19:24:48.050021] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-10T19:24:48.054866] [INFO ] [REMOTE ] HLI: Full fetch complete (45136 records). [2025-10-10T19:24:48.054997] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-10T19:24:48.289916] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-10T19:24:48.449772] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-10T19:24:48.449867] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-10T19:24:48.450551] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-10T19:24:48.450593] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-10T19:24:48.451727] [DEBUG] [LOCAL ] HLI: Trimmed 45136 records to 31364 (keeping 200 days of data) [2025-10-10T19:24:48.640363] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-10T19:24:48.681696] [DEBUG] [LOCAL ] HLI: Primary data saved (31364 records). [2025-10-10T19:24:48.681794] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-10T19:24:48.681869] [INFO ] [MAIN ] Update Progress: 1028/2373 symbols completed. HLI took 32.0s. Estimated remaining: 3h 9m 23s. Rate: 7.1 symbols/min [2025-10-10T19:24:48.848135] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:24:48.897514] [DEBUG] [LOCAL ] HLN: Loaded 53487 existing records from primary storage. [2025-10-10T19:24:48.897880] [INFO ] [MAIN ] HLN: Loaded 53487 existing records. [2025-10-10T19:24:49.072976] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:24:49.073198] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-10T19:24:49.073245] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-10T19:24:49.073810] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-10T19:24:49.073868] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-10T19:24:49.094436] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-10T19:24:49.433932] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:24:49.889412] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-10T19:24:50.039310] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T19:24:50.044996] [INFO ] [REMOTE ] HLF: Full fetch complete (70924 records). [2025-10-10T19:24:50.045134] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-10T19:24:50.431954] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-10T19:24:50.432124] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-10T19:24:50.433094] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-10T19:24:50.433200] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-10T19:24:50.434684] [DEBUG] [LOCAL ] HLF: Trimmed 70924 records to 49122 (keeping 200 days of data) [2025-10-10T19:24:50.664122] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-10T19:24:50.693110] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-10T19:24:50.752387] [DEBUG] [LOCAL ] HLF: Primary data saved (49122 records). [2025-10-10T19:24:50.752539] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-10T19:24:50.752683] [INFO ] [MAIN ] Update Progress: 1029/2373 symbols completed. HLF took 42.3s. Estimated remaining: 3h 9m 6s. Rate: 7.1 symbols/min [2025-10-10T19:24:50.921142] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:24:50.977396] [DEBUG] [LOCAL ] HLT: Loaded 50968 existing records from primary storage. [2025-10-10T19:24:50.977769] [INFO ] [MAIN ] HLT: Loaded 50968 existing records. [2025-10-10T19:24:51.160884] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:24:51.161118] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-10T19:24:51.161174] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-10T19:24:51.161429] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-10T19:24:51.161473] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-10T19:24:51.494601] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-10T19:24:51.561707] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:24:51.908605] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T19:24:51.940100] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-10T19:24:52.289371] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-10T19:24:52.810441] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-10T19:24:53.089388] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-10T19:24:53.415816] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-10T19:24:53.889413] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-10T19:24:54.291846] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T19:24:54.294340] [INFO ] [REMOTE ] HLIO: Full fetch complete (36398 records). [2025-10-10T19:24:54.294409] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-10T19:24:54.670539] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-10T19:24:54.670617] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-10T19:24:54.671292] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-10T19:24:54.671355] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-10T19:24:54.672368] [DEBUG] [LOCAL ] HLIO: Trimmed 36398 records to 28206 (keeping 200 days of data) [2025-10-10T19:24:54.725248] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-10T19:24:54.848444] [DEBUG] [LOCAL ] HLIO: Primary data saved (28206 records). [2025-10-10T19:24:54.848624] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-10T19:24:54.848756] [INFO ] [MAIN ] Update Progress: 1030/2373 symbols completed. HLIO took 29.5s. Estimated remaining: 3h 8m 52s. Rate: 7.1 symbols/min [2025-10-10T19:24:55.030462] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:24:55.075675] [DEBUG] [LOCAL ] HLX: Loaded 47890 existing records from primary storage. [2025-10-10T19:24:55.076011] [INFO ] [MAIN ] HLX: Loaded 47890 existing records. [2025-10-10T19:24:55.254271] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:24:55.254487] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-10T19:24:55.254535] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-10T19:24:55.254888] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-10T19:24:55.254946] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-10T19:24:55.496704] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-10T19:24:55.630340] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:24:55.833928] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T19:24:56.289347] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-10T19:24:56.492777] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-10T19:24:56.697799] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T19:24:57.089390] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-10T19:24:57.889468] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-10T19:24:58.063980] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T19:24:58.689405] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-10T19:24:58.790966] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T19:24:58.997092] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-10T19:24:59.489358] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-10T19:25:00.289452] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-10T19:25:00.654446] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T19:25:00.750814] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-10T19:25:01.089376] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-10T19:25:01.889389] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-10T19:25:02.137218] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-10T19:25:02.689424] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-10T19:25:02.917874] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T19:25:03.489359] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-10T19:25:03.715542] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-10T19:25:04.289391] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-10T19:25:04.443463] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-10T19:25:05.052272] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T19:25:05.089331] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-10T19:25:05.889350] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-10T19:25:05.932250] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-10T19:25:06.070319] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T19:25:06.689393] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-10T19:25:07.489356] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-10T19:25:07.709876] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T19:25:08.232832] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-10T19:25:08.236274] [INFO ] [REMOTE ] HLLY: Full fetch complete (46264 records). [2025-10-10T19:25:08.236359] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-10T19:25:08.302128] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-10T19:25:08.641525] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-10T19:25:08.641624] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-10T19:25:08.642307] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-10T19:25:08.642356] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-10T19:25:08.643387] [DEBUG] [LOCAL ] HLLY: Trimmed 46264 records to 34004 (keeping 200 days of data) [2025-10-10T19:25:08.833786] [DEBUG] [LOCAL ] HLLY: Primary data saved (34004 records). [2025-10-10T19:25:08.833934] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-10T19:25:08.834033] [INFO ] [MAIN ] Update Progress: 1031/2373 symbols completed. HLLY took 28.4s. Estimated remaining: 3h 8m 51s. Rate: 7.1 symbols/min [2025-10-10T19:25:09.005764] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:25:09.048390] [DEBUG] [LOCAL ] HMC: Loaded 46880 existing records from primary storage. [2025-10-10T19:25:09.048745] [INFO ] [MAIN ] HMC: Loaded 46880 existing records. [2025-10-10T19:25:09.092392] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-10T19:25:09.237704] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:25:09.238507] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-10T19:25:09.238562] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-10T19:25:09.239020] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-10T19:25:09.239079] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-10T19:25:09.612104] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:25:09.645124] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-10T19:25:09.889367] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-10T19:25:10.446843] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-10T19:25:10.492029] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-10T19:25:10.689352] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-10T19:25:11.489447] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-10T19:25:11.741325] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T19:25:12.289354] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-10T19:25:12.507530] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T19:25:12.861551] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T19:25:13.089351] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-10T19:25:13.889346] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-10T19:25:14.281770] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-10T19:25:14.689375] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-10T19:25:14.834275] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T19:25:15.489358] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-10T19:25:15.967616] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-10T19:25:16.113403] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T19:25:16.289366] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-10T19:25:16.994260] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-10T19:25:17.089384] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-10T19:25:17.889411] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-10T19:25:18.254035] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T19:25:18.689400] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-10T19:25:19.204705] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-10T19:25:19.392384] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T19:25:19.489377] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-10T19:25:20.289385] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-10T19:25:20.457354] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T19:25:21.089438] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-10T19:25:21.348173] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T19:25:21.889342] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-10T19:25:22.259687] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T19:25:22.689360] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-10T19:25:23.064417] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T19:25:23.489392] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-10T19:25:23.706793] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T19:25:24.289343] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-10T19:25:24.646489] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T19:25:25.089347] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-10T19:25:25.454185] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T19:25:25.889464] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-10T19:25:26.039540] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T19:25:26.044171] [INFO ] [REMOTE ] HLX: Full fetch complete (68953 records). [2025-10-10T19:25:26.044336] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-10T19:25:26.438962] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-10T19:25:26.439286] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-10T19:25:26.440430] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-10T19:25:26.440574] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-10T19:25:26.441979] [DEBUG] [LOCAL ] HLX: Trimmed 68953 records to 48235 (keeping 200 days of data) [2025-10-10T19:25:26.698679] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-10T19:25:26.713191] [DEBUG] [LOCAL ] HLX: Primary data saved (48235 records). [2025-10-10T19:25:26.713318] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-10T19:25:26.713895] [INFO ] [MAIN ] Update Progress: 1032/2373 symbols completed. HLX took 31.9s. Estimated remaining: 3h 8m 54s. Rate: 7.1 symbols/min [2025-10-10T19:25:26.886146] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:25:26.914153] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T19:25:26.941683] [DEBUG] [LOCAL ] HMN: Loaded 23567 existing records from primary storage. [2025-10-10T19:25:26.941982] [INFO ] [MAIN ] HMN: Loaded 23567 existing records. [2025-10-10T19:25:27.117865] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:25:27.118135] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-10T19:25:27.118185] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-10T19:25:27.118593] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-10T19:25:27.118682] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-10T19:25:27.479704] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:25:27.489328] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-10T19:25:27.833289] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T19:25:28.289430] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-10T19:25:28.626342] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-10T19:25:28.631831] [INFO ] [REMOTE ] HLN: Full fetch complete (76838 records). [2025-10-10T19:25:28.631980] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-10T19:25:28.803579] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-10T19:25:29.051793] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-10T19:25:29.051875] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-10T19:25:29.052813] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-10T19:25:29.052876] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-10T19:25:29.054509] [DEBUG] [LOCAL ] HLN: Trimmed 76838 records to 53870 (keeping 200 days of data) [2025-10-10T19:25:29.106766] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-10T19:25:29.378632] [DEBUG] [LOCAL ] HLN: Primary data saved (53870 records). [2025-10-10T19:25:29.378789] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-10T19:25:29.378914] [INFO ] [MAIN ] Update Progress: 1033/2373 symbols completed. HLN took 40.7s. Estimated remaining: 3h 8m 38s. Rate: 7.1 symbols/min [2025-10-10T19:25:29.546676] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:25:29.596914] [DEBUG] [LOCAL ] HMY: Loaded 53525 existing records from primary storage. [2025-10-10T19:25:29.597248] [INFO ] [MAIN ] HMY: Loaded 53525 existing records. [2025-10-10T19:25:29.777780] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:25:29.777979] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-10T19:25:29.778044] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-10T19:25:29.779174] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-10T19:25:29.779235] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-10T19:25:29.894503] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-10T19:25:30.146303] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:25:30.304889] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-10T19:25:30.434426] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T19:25:30.689329] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-10T19:25:31.222881] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-10T19:25:31.450953] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-10T19:25:31.489334] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-10T19:25:32.289414] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-10T19:25:33.089354] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-10T19:25:33.459944] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-10T19:25:33.889411] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-10T19:25:34.146715] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T19:25:34.152871] [INFO ] [REMOTE ] HLT: Full fetch complete (73512 records). [2025-10-10T19:25:34.153052] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-10T19:25:34.330893] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-10T19:25:34.577685] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-10T19:25:34.577783] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-10T19:25:34.578964] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-10T19:25:34.579028] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-10T19:25:34.580437] [DEBUG] [LOCAL ] HLT: Trimmed 73512 records to 51350 (keeping 200 days of data) [2025-10-10T19:25:34.689942] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-10T19:25:34.905858] [DEBUG] [LOCAL ] HLT: Primary data saved (51350 records). [2025-10-10T19:25:34.906029] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-10T19:25:34.906133] [INFO ] [MAIN ] Update Progress: 1034/2373 symbols completed. HLT took 44.2s. Estimated remaining: 3h 8m 26s. Rate: 7.1 symbols/min [2025-10-10T19:25:35.073800] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:25:35.073969] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-10T19:25:35.074006] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-10T19:25:35.074114] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-10T19:25:35.074155] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-10T19:25:35.074194] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-10T19:25:35.074226] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-10T19:25:35.425962] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:25:35.489341] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-10T19:25:35.706178] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T19:25:35.706546] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-10T19:25:35.706636] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T19:25:35.706726] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-10T19:25:35.706764] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T19:25:35.706801] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-10T19:25:35.706856] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-10T19:25:35.706890] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-10T19:25:35.706927] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-10T19:25:35.706974] [INFO ] [MAIN ] Update Progress: 1035/2373 symbols completed. HNGE took 0.8s. Estimated remaining: 3h 8m 8s. Rate: 7.1 symbols/min [2025-10-10T19:25:35.888202] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-10T19:25:35.930434] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:25:35.960954] [DEBUG] [LOCAL ] HNI: Loaded 29530 existing records from primary storage. [2025-10-10T19:25:35.961303] [INFO ] [MAIN ] HNI: Loaded 29530 existing records. [2025-10-10T19:25:36.177895] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-10T19:25:36.176740] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:25:36.183783] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-10T19:25:36.184395] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-10T19:25:36.185293] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-10T19:25:36.185367] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-10T19:25:36.294588] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-10T19:25:36.541352] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:25:37.089441] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-10T19:25:37.889394] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-10T19:25:38.225549] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T19:25:38.653030] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-10T19:25:38.689330] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-10T19:25:39.489456] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-10T19:25:39.933295] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-10T19:25:39.966725] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T19:25:40.289382] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-10T19:25:40.784743] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T19:25:41.089352] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-10T19:25:41.530462] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T19:25:41.889411] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-10T19:25:42.349780] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T19:25:42.689406] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-10T19:25:43.348866] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-10T19:25:43.489336] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-10T19:25:44.289393] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-10T19:25:44.716448] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-10T19:25:44.720740] [INFO ] [REMOTE ] HMC: Full fetch complete (69085 records). [2025-10-10T19:25:44.720841] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-10T19:25:44.963941] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-10T19:25:45.094519] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-10T19:25:45.147732] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-10T19:25:45.147824] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-10T19:25:45.148786] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-10T19:25:45.148850] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-10T19:25:45.150238] [DEBUG] [LOCAL ] HMC: Trimmed 69085 records to 47231 (keeping 200 days of data) [2025-10-10T19:25:45.425371] [DEBUG] [LOCAL ] HMC: Primary data saved (47231 records). [2025-10-10T19:25:45.425512] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-10T19:25:45.425596] [INFO ] [MAIN ] Update Progress: 1036/2373 symbols completed. HMC took 36.6s. Estimated remaining: 3h 8m 1s. Rate: 7.1 symbols/min [2025-10-10T19:25:45.593356] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:25:45.645161] [DEBUG] [LOCAL ] HOG: Loaded 51361 existing records from primary storage. [2025-10-10T19:25:45.645487] [INFO ] [MAIN ] HOG: Loaded 51361 existing records. [2025-10-10T19:25:45.823692] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:25:45.823924] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-10T19:25:45.823970] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-10T19:25:45.824307] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-10T19:25:45.824362] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-10T19:25:45.896733] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-10T19:25:46.187076] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:25:46.406240] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-10T19:25:46.490561] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-10T19:25:46.689334] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-10T19:25:47.225026] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-10T19:25:47.489361] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-10T19:25:48.289351] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-10T19:25:48.667518] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T19:25:48.785572] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-10T19:25:49.089345] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-10T19:25:49.486502] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T19:25:49.889374] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-10T19:25:50.689353] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-10T19:25:51.171982] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-10T19:25:51.210276] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-10T19:25:51.489380] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-10T19:25:52.146398] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T19:25:52.289333] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-10T19:25:53.089423] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-10T19:25:53.813741] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-10T19:25:53.879018] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T19:25:53.889373] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-10T19:25:54.689384] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-10T19:25:54.791877] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-10T19:25:55.489367] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-10T19:25:55.807972] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T19:25:55.861845] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T19:25:56.289381] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-10T19:25:57.093676] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-10T19:25:57.098302] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-10T19:25:57.444982] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-10T19:25:57.447223] [INFO ] [REMOTE ] HMN: Full fetch complete (31443 records). [2025-10-10T19:25:57.447296] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-10T19:25:57.805318] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-10T19:25:57.805403] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-10T19:25:57.805973] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-10T19:25:57.806035] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-10T19:25:57.806912] [DEBUG] [LOCAL ] HMN: Trimmed 31443 records to 23715 (keeping 200 days of data) [2025-10-10T19:25:57.896570] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-10T19:25:57.955134] [DEBUG] [LOCAL ] HMN: Primary data saved (23715 records). [2025-10-10T19:25:57.955265] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-10T19:25:57.955361] [INFO ] [MAIN ] Update Progress: 1037/2373 symbols completed. HMN took 31.2s. Estimated remaining: 3h 7m 58s. Rate: 7.1 symbols/min [2025-10-10T19:25:58.689354] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-10T19:25:59.047529] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T19:25:59.489358] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-10T19:26:00.177748] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-10T19:26:00.181142] [INFO ] [REMOTE ] HNI: Full fetch complete (41788 records). [2025-10-10T19:26:00.181222] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-10T19:26:00.511529] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-10T19:26:00.583407] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-10T19:26:00.607239] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-10T19:26:00.607345] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-10T19:26:00.608086] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-10T19:26:00.608154] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-10T19:26:00.609412] [DEBUG] [LOCAL ] HNI: Trimmed 41788 records to 29751 (keeping 200 days of data) [2025-10-10T19:26:00.789346] [DEBUG] [LOCAL ] HNI: Primary data saved (29751 records). [2025-10-10T19:26:00.789478] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-10T19:26:00.789559] [INFO ] [MAIN ] Update Progress: 1038/2373 symbols completed. HNI took 25.1s. Estimated remaining: 3h 7m 42s. Rate: 7.1 symbols/min [2025-10-10T19:26:01.700141] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-10T19:26:01.712453] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-10T19:26:03.149388] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-10T19:26:03.161834] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-10T19:26:03.244078] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T19:26:03.254335] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-10T19:26:05.423366] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T19:26:05.435946] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-10T19:26:05.473626] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-10T19:26:05.484983] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-10T19:26:07.329797] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T19:26:07.341518] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-10T19:26:07.687448] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-10T19:26:07.699047] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-10T19:26:09.350079] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T19:26:09.360892] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-10T19:26:09.975226] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-10T19:26:09.986889] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-10T19:26:10.629904] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-10T19:26:10.635984] [INFO ] [REMOTE ] HOG: Full fetch complete (74091 records). [2025-10-10T19:26:10.636151] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-10T19:26:11.023496] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-10T19:26:11.023604] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-10T19:26:11.024688] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-10T19:26:11.024752] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-10T19:26:11.026366] [DEBUG] [LOCAL ] HOG: Trimmed 74091 records to 51709 (keeping 200 days of data) [2025-10-10T19:26:11.341014] [DEBUG] [LOCAL ] HOG: Primary data saved (51709 records). [2025-10-10T19:26:11.341146] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-10T19:26:11.341250] [INFO ] [MAIN ] Update Progress: 1039/2373 symbols completed. HOG took 25.9s. Estimated remaining: 3h 7m 37s. Rate: 7.1 symbols/min [2025-10-10T19:26:12.340577] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-10T19:26:12.352127] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-10T19:26:14.569802] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-10T19:26:14.574765] [INFO ] [REMOTE ] HMY: Full fetch complete (76775 records). [2025-10-10T19:26:14.574873] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-10T19:26:14.966390] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-10T19:26:14.966485] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-10T19:26:14.967534] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-10T19:26:14.967600] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-10T19:26:14.969212] [DEBUG] [LOCAL ] HMY: Trimmed 76775 records to 53913 (keeping 200 days of data) [2025-10-10T19:26:15.295716] [DEBUG] [LOCAL ] HMY: Primary data saved (53913 records). [2025-10-10T19:26:15.295858] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-10T19:26:15.295939] [INFO ] [MAIN ] Update Progress: 1040/2373 symbols completed. HMY took 45.9s. Estimated remaining: 3h 7m 22s. Rate: 7.1 symbols/min [2025-10-10T19:26:15.840088] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:26:15.977602] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:26:16.045440] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:26:16.066179] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:26:16.090324] [DEBUG] [LOCAL ] HOV: Loaded 14000 existing records from primary storage. [2025-10-10T19:26:16.090750] [INFO ] [MAIN ] HOV: Loaded 14000 existing records. [2025-10-10T19:26:16.198728] [DEBUG] [LOCAL ] HOUS: Loaded 45220 existing records from primary storage. [2025-10-10T19:26:16.218894] [INFO ] [MAIN ] HOUS: Loaded 45220 existing records. [2025-10-10T19:26:16.393365] [DEBUG] [LOCAL ] HOMB: Loaded 43753 existing records from primary storage. [2025-10-10T19:26:16.456891] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:26:16.467416] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-10T19:26:16.473127] [INFO ] [MAIN ] HOMB: Loaded 43753 existing records. [2025-10-10T19:26:16.479423] [DEBUG] [LOCAL ] HP: Loaded 51959 existing records from primary storage. [2025-10-10T19:26:16.564195] [INFO ] [MAIN ] HP: Loaded 51959 existing records. [2025-10-10T19:26:16.589695] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-10T19:26:16.599795] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:26:16.624801] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-10T19:26:16.693028] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-10T19:26:16.693168] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-10T19:26:16.692978] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-10T19:26:16.797529] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-10T19:26:16.845750] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-10T19:26:17.079517] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:26:17.127335] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:26:17.163118] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-10T19:26:17.174172] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-10T19:26:17.179447] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-10T19:26:17.231574] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-10T19:26:17.237529] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-10T19:26:17.231449] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-10T19:26:17.259292] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-10T19:26:17.365907] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-10T19:26:18.169529] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:26:18.150451] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:26:18.179861] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-10T19:26:18.190443] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-10T19:26:18.520323] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:26:18.528151] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-10T19:26:18.527747] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:26:18.529493] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-10T19:26:19.548197] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T19:26:19.551769] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-10T19:26:20.020691] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T19:26:20.030116] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-10T19:26:20.219918] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T19:26:20.228976] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-10T19:26:20.237180] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-10T19:26:20.240596] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-10T19:26:20.391250] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T19:26:20.402999] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-10T19:26:21.208016] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T19:26:21.211038] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-10T19:26:21.737714] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T19:26:21.747279] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-10T19:26:21.864313] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T19:26:21.873951] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-10T19:26:22.202523] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T19:26:22.203553] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-10T19:26:22.216116] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-10T19:26:22.216866] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-10T19:26:23.150560] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T19:26:23.161075] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-10T19:26:23.328184] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-10T19:26:23.331493] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-10T19:26:23.361997] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T19:26:23.370332] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-10T19:26:23.875418] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-10T19:26:23.879513] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-10T19:26:23.918279] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-10T19:26:23.929585] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-10T19:26:24.383559] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T19:26:24.394679] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-10T19:26:25.019872] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-10T19:26:25.097202] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-10T19:26:25.098147] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T19:26:25.228240] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T19:26:25.889414] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-10T19:26:26.213691] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T19:26:26.689365] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-10T19:26:26.882883] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T19:26:27.051867] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T19:26:27.489462] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-10T19:26:28.289390] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-10T19:26:28.348631] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-10T19:26:28.749258] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-10T19:26:29.089394] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-10T19:26:29.889372] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-10T19:26:29.949279] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-10T19:26:30.689447] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-10T19:26:31.198036] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T19:26:31.489392] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-10T19:26:31.546854] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T19:26:31.781541] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T19:26:32.289433] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-10T19:26:33.089373] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-10T19:26:33.504308] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T19:26:33.889358] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-10T19:26:34.067355] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T19:26:34.203715] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-10T19:26:34.689378] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-10T19:26:35.400272] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-10T19:26:35.489349] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-10T19:26:36.289490] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-10T19:26:36.493719] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T19:26:36.556956] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-10T19:26:36.558761] [INFO ] [REMOTE ] HOV: Full fetch complete (19004 records). [2025-10-10T19:26:36.558831] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-10T19:26:36.919104] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-10T19:26:36.919186] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-10T19:26:36.919697] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-10T19:26:36.919760] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-10T19:26:36.920407] [DEBUG] [LOCAL ] HOV: Trimmed 19004 records to 14065 (keeping 200 days of data) [2025-10-10T19:26:37.007282] [DEBUG] [LOCAL ] HOV: Primary data saved (14065 records). [2025-10-10T19:26:37.007434] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-10T19:26:37.007521] [INFO ] [MAIN ] Update Progress: 1041/2373 symbols completed. HOV took 21.7s. Estimated remaining: 3h 7m 31s. Rate: 7.1 symbols/min [2025-10-10T19:26:37.094708] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-10T19:26:37.182055] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:26:37.231701] [DEBUG] [LOCAL ] HPE: Loaded 54087 existing records from primary storage. [2025-10-10T19:26:37.232045] [INFO ] [MAIN ] HPE: Loaded 54087 existing records. [2025-10-10T19:26:37.435589] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:26:37.435950] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-10T19:26:37.436012] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-10T19:26:37.437923] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-10T19:26:37.438002] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-10T19:26:37.843135] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:26:37.889470] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-10T19:26:38.208167] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-10T19:26:38.689373] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-10T19:26:38.839398] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T19:26:39.307282] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-10T19:26:39.489375] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-10T19:26:40.289451] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-10T19:26:40.964192] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-10T19:26:41.089361] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-10T19:26:41.218232] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T19:26:41.802750] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-10T19:26:41.889349] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-10T19:26:42.689342] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-10T19:26:42.908686] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-10T19:26:42.913588] [INFO ] [REMOTE ] HOUS: Full fetch complete (63984 records). [2025-10-10T19:26:42.913762] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-10T19:26:43.310715] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-10T19:26:43.310803] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-10T19:26:43.311729] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-10T19:26:43.311796] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-10T19:26:43.313090] [DEBUG] [LOCAL ] HOUS: Trimmed 63984 records to 45606 (keeping 200 days of data) [2025-10-10T19:26:43.505891] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-10T19:26:43.573363] [DEBUG] [LOCAL ] HOUS: Primary data saved (45606 records). [2025-10-10T19:26:43.573501] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-10T19:26:43.573586] [INFO ] [MAIN ] Update Progress: 1042/2373 symbols completed. HOUS took 28.3s. Estimated remaining: 3h 7m 20s. Rate: 7.1 symbols/min [2025-10-10T19:26:43.751195] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:26:43.760326] [DEBUG] [LOCAL ] HPF: Loaded 7514 existing records from primary storage. [2025-10-10T19:26:43.760545] [INFO ] [MAIN ] HPF: Loaded 7514 existing records. [2025-10-10T19:26:43.978095] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:26:43.978802] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-10T19:26:43.978950] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-10T19:26:43.980568] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-10T19:26:43.985569] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-10T19:26:43.985435] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-10T19:26:44.125382] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T19:26:44.169240] [INFO ] [REMOTE ] HOMB: Full fetch complete (63879 records). [2025-10-10T19:26:44.194410] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-10T19:26:44.300711] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-10T19:26:44.541125] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:26:44.782481] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-10T19:26:44.782560] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-10T19:26:44.783419] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-10T19:26:44.783481] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-10T19:26:44.784712] [DEBUG] [LOCAL ] HOMB: Trimmed 63879 records to 44074 (keeping 200 days of data) [2025-10-10T19:26:45.048592] [DEBUG] [LOCAL ] HOMB: Primary data saved (44074 records). [2025-10-10T19:26:45.048776] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-10T19:26:45.048878] [INFO ] [MAIN ] Update Progress: 1043/2373 symbols completed. HOMB took 29.7s. Estimated remaining: 3h 7m 3s. Rate: 7.1 symbols/min [2025-10-10T19:26:45.113410] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-10T19:26:45.264368] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:26:45.282243] [DEBUG] [LOCAL ] HPI: Loaded 10659 existing records from primary storage. [2025-10-10T19:26:45.282566] [INFO ] [MAIN ] HPI: Loaded 10659 existing records. [2025-10-10T19:26:45.541868] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:26:45.542283] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-10T19:26:45.542395] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-10T19:26:45.542927] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-10T19:26:45.542992] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-10T19:26:46.140706] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:26:46.154896] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-10T19:26:46.155721] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-10T19:26:46.153193] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-10-10T19:26:46.427468] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-10T19:26:46.689386] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-10T19:26:47.114976] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-10T19:26:47.489402] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-10T19:26:47.553761] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-10T19:26:48.289404] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-10T19:26:49.089392] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-10T19:26:49.889423] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-10T19:26:49.909366] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-10T19:26:50.148005] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T19:26:50.152903] [INFO ] [REMOTE ] HP: Full fetch complete (73912 records). [2025-10-10T19:26:50.153062] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-10T19:26:50.549079] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-10T19:26:50.549158] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-10T19:26:50.550091] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-10T19:26:50.550153] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-10T19:26:50.551710] [DEBUG] [LOCAL ] HP: Trimmed 73912 records to 52330 (keeping 200 days of data) [2025-10-10T19:26:50.721458] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-10T19:26:50.859680] [DEBUG] [LOCAL ] HP: Primary data saved (52330 records). [2025-10-10T19:26:50.859829] [INFO ] [MAIN ] HP: Full history saved. [2025-10-10T19:26:50.859930] [INFO ] [MAIN ] Update Progress: 1044/2373 symbols completed. HP took 35.6s. Estimated remaining: 3h 6m 51s. Rate: 7.1 symbols/min [2025-10-10T19:26:51.024545] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:26:51.069224] [DEBUG] [LOCAL ] HPP: Loaded 51424 existing records from primary storage. [2025-10-10T19:26:51.069559] [INFO ] [MAIN ] HPP: Loaded 51424 existing records. [2025-10-10T19:26:51.241896] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:26:51.242102] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-10T19:26:51.242149] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-10T19:26:51.243026] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-10T19:26:51.243085] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-10T19:26:51.527394] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-10T19:26:51.542206] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-10T19:26:51.652315] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:26:51.689632] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (4.20 seconds). [2025-10-10T19:26:51.795956] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-10T19:26:52.289435] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-10T19:26:52.526311] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-10T19:26:53.089378] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-10T19:26:53.193398] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T19:26:53.889480] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-10T19:26:54.689362] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-10T19:26:54.762420] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-10T19:26:55.013234] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T19:26:55.489442] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-10T19:26:56.289415] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-10T19:26:56.367513] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-10T19:26:56.946693] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-10T19:26:57.089370] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-10T19:26:57.123498] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-10T19:26:57.889414] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-10T19:26:58.689356] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-10T19:26:58.796976] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-10T19:26:59.272638] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-10T19:26:59.489379] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-10T19:27:00.289404] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-10T19:27:00.374903] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-10T19:27:00.538491] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-10T19:27:01.089385] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-10T19:27:01.889382] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-10T19:27:01.951992] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-10T19:27:02.460501] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-10T19:27:02.689429] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-10T19:27:03.489449] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-10T19:27:03.595997] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T19:27:03.596706] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-10T19:27:03.950897] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-10T19:27:04.289370] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-10T19:27:05.089371] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-10T19:27:05.324376] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-10T19:27:05.889381] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-10T19:27:06.689344] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-10T19:27:06.809975] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T19:27:06.837927] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-10T19:27:07.489425] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-10T19:27:08.289361] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-10T19:27:08.589126] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-10T19:27:08.945999] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-10T19:27:09.089404] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-10T19:27:09.889374] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-10T19:27:09.960784] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T19:27:10.042475] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T19:27:10.044020] [INFO ] [REMOTE ] HPI: Full fetch complete (13947 records). [2025-10-10T19:27:10.044101] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-10T19:27:10.399262] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-10T19:27:10.399474] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-10T19:27:10.399871] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-10T19:27:10.400002] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-10T19:27:10.406565] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-10T19:27:10.406786] [DEBUG] [LOCAL ] HPI: Trimmed 13947 records to 10713 (keeping 200 days of data) [2025-10-10T19:27:10.474334] [DEBUG] [LOCAL ] HPI: Primary data saved (10713 records). [2025-10-10T19:27:10.474468] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-10T19:27:10.474548] [INFO ] [MAIN ] Update Progress: 1045/2373 symbols completed. HPI took 25.4s. Estimated remaining: 3h 6m 57s. Rate: 7.1 symbols/min [2025-10-10T19:27:10.643024] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:27:10.690978] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-10T19:27:10.693112] [DEBUG] [LOCAL ] HPQ: Loaded 54058 existing records from primary storage. [2025-10-10T19:27:10.693473] [INFO ] [MAIN ] HPQ: Loaded 54058 existing records. [2025-10-10T19:27:10.894096] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:27:10.894309] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-10T19:27:10.894354] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-10T19:27:10.894547] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-10T19:27:10.894584] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-10T19:27:11.233931] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:27:11.489354] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-10T19:27:12.289406] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-10T19:27:12.461207] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-10T19:27:13.089380] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-10T19:27:13.552111] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-10T19:27:13.889343] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-10T19:27:14.312809] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T19:27:14.689413] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-10T19:27:15.026372] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T19:27:15.472211] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T19:27:15.473559] [INFO ] [REMOTE ] HPF: Full fetch complete (10710 records). [2025-10-10T19:27:15.473718] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-10T19:27:15.494514] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-10T19:27:15.834860] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-10T19:27:15.835005] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-10T19:27:15.835357] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-10T19:27:15.835458] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-10T19:27:15.836105] [DEBUG] [LOCAL ] HPF: Trimmed 10710 records to 7555 (keeping 200 days of data) [2025-10-10T19:27:15.882572] [DEBUG] [LOCAL ] HPF: Primary data saved (7555 records). [2025-10-10T19:27:15.882757] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-10T19:27:15.882863] [INFO ] [MAIN ] Update Progress: 1046/2373 symbols completed. HPF took 32.3s. Estimated remaining: 3h 6m 44s. Rate: 7.1 symbols/min [2025-10-10T19:27:16.055522] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:27:16.091584] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-10T19:27:16.108170] [DEBUG] [LOCAL ] HPS: Loaded 10353 existing records from primary storage. [2025-10-10T19:27:16.108465] [INFO ] [MAIN ] HPS: Loaded 10353 existing records. [2025-10-10T19:27:16.294566] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-10T19:27:16.298871] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:27:16.300119] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-10T19:27:16.300228] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-10T19:27:16.300598] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-10T19:27:16.300986] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-10T19:27:16.646413] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:27:16.934618] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-10T19:27:17.089346] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-10T19:27:17.889362] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-10T19:27:18.545935] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-10T19:27:18.689354] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-10T19:27:18.854366] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-10T19:27:18.984038] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T19:27:19.489391] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-10T19:27:20.289352] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-10T19:27:20.511964] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-10T19:27:20.861554] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-10T19:27:21.089395] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-10T19:27:21.889344] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-10T19:27:22.013835] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-10T19:27:22.102136] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T19:27:22.689360] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-10T19:27:23.489352] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-10T19:27:23.626166] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-10T19:27:23.829129] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-10T19:27:24.289388] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-10T19:27:25.089351] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-10T19:27:25.338953] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-10T19:27:25.343980] [INFO ] [REMOTE ] HPP: Full fetch complete (73287 records). [2025-10-10T19:27:25.344146] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-10T19:27:25.775697] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-10T19:27:25.775850] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-10T19:27:25.776875] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-10T19:27:25.776958] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-10T19:27:25.779433] [DEBUG] [LOCAL ] HPP: Trimmed 73287 records to 51811 (keeping 200 days of data) [2025-10-10T19:27:25.893050] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-10T19:27:25.902159] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-10T19:27:26.044874] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-10T19:27:26.125765] [DEBUG] [LOCAL ] HPP: Primary data saved (51811 records). [2025-10-10T19:27:26.125902] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-10T19:27:26.125983] [INFO ] [MAIN ] Update Progress: 1047/2373 symbols completed. HPP took 35.3s. Estimated remaining: 3h 6m 38s. Rate: 7.1 symbols/min [2025-10-10T19:27:26.296951] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:27:26.327261] [DEBUG] [LOCAL ] HQH: Loaded 25751 existing records from primary storage. [2025-10-10T19:27:26.327708] [INFO ] [MAIN ] HQH: Loaded 25751 existing records. [2025-10-10T19:27:26.522069] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:27:26.522354] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-10T19:27:26.522406] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-10T19:27:26.522717] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-10T19:27:26.522777] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-10T19:27:26.696031] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-10T19:27:26.921939] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:27:27.489349] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-10T19:27:27.884611] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-10T19:27:27.889900] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-10-10T19:27:27.890062] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-10T19:27:28.290301] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-10T19:27:28.311523] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-10T19:27:28.311693] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-10T19:27:28.313236] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-10T19:27:28.313418] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-10T19:27:28.316025] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 54477 (keeping 200 days of data) [2025-10-10T19:27:28.391897] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-10T19:27:28.668360] [DEBUG] [LOCAL ] HPE: Primary data saved (54477 records). [2025-10-10T19:27:28.668508] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-10T19:27:28.668594] [INFO ] [MAIN ] Update Progress: 1048/2373 symbols completed. HPE took 51.7s. Estimated remaining: 3h 6m 22s. Rate: 7.1 symbols/min [2025-10-10T19:27:28.838186] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:27:28.874790] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-10T19:27:28.901520] [DEBUG] [LOCAL ] HQL: Loaded 16859 existing records from primary storage. [2025-10-10T19:27:28.901824] [INFO ] [MAIN ] HQL: Loaded 16859 existing records. [2025-10-10T19:27:29.095899] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:27:29.096029] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-10T19:27:29.096904] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-10T19:27:29.097969] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-10T19:27:29.098553] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-10T19:27:29.098615] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-10T19:27:29.446098] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:27:29.889368] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-10T19:27:29.963075] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-10T19:27:30.484863] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-10T19:27:30.689378] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-10T19:27:31.052049] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-10T19:27:31.489449] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-10T19:27:32.289420] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-10T19:27:32.551616] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T19:27:32.846223] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T19:27:33.089385] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-10T19:27:33.452494] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T19:27:33.889437] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-10T19:27:34.111778] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-10T19:27:34.689432] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-10T19:27:35.489412] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-10T19:27:35.795620] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-10T19:27:36.043748] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-10T19:27:36.289392] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-10T19:27:36.417091] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T19:27:37.089433] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-10T19:27:37.421817] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-10T19:27:37.889402] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-10T19:27:38.031146] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-10T19:27:38.689378] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-10T19:27:39.106398] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T19:27:39.489496] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-10T19:27:40.289428] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-10T19:27:40.688848] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-10T19:27:40.967112] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-10T19:27:41.089345] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-10T19:27:41.889354] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-10T19:27:41.950949] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T19:27:42.114809] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-10T19:27:42.116363] [INFO ] [REMOTE ] HPS: Full fetch complete (15208 records). [2025-10-10T19:27:42.116432] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-10T19:27:42.474413] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-10T19:27:42.474489] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-10T19:27:42.474887] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-10T19:27:42.474969] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-10T19:27:42.475468] [DEBUG] [LOCAL ] HPS: Trimmed 15208 records to 10421 (keeping 200 days of data) [2025-10-10T19:27:42.543326] [DEBUG] [LOCAL ] HPS: Primary data saved (10421 records). [2025-10-10T19:27:42.543479] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-10T19:27:42.543569] [INFO ] [MAIN ] Update Progress: 1049/2373 symbols completed. HPS took 26.7s. Estimated remaining: 3h 6m 21s. Rate: 7.1 symbols/min [2025-10-10T19:27:42.712785] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:27:42.695779] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-10T19:27:42.767720] [DEBUG] [LOCAL ] HR: Loaded 52363 existing records from primary storage. [2025-10-10T19:27:42.768059] [INFO ] [MAIN ] HR: Loaded 52363 existing records. [2025-10-10T19:27:42.946144] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:27:42.946405] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-10T19:27:42.946455] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-10T19:27:42.947012] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-10T19:27:42.947070] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-10T19:27:43.306713] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:27:43.312448] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-10T19:27:43.489425] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-10T19:27:44.050594] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T19:27:44.289381] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-10T19:27:45.089347] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-10T19:27:45.244398] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T19:27:45.731014] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-10T19:27:45.889375] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-10T19:27:46.133925] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-10T19:27:46.689430] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-10T19:27:47.489373] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-10T19:27:47.697415] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-10T19:27:47.993056] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-10T19:27:48.289361] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-10T19:27:49.069824] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-10T19:27:49.089350] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-10T19:27:49.889363] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-10T19:27:50.213892] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T19:27:50.689421] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-10T19:27:51.092047] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T19:27:51.132335] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-10T19:27:51.137421] [INFO ] [REMOTE ] HPQ: Full fetch complete (77669 records). [2025-10-10T19:27:51.137591] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-10T19:27:51.501786] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-10T19:27:51.526246] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-10T19:27:51.526400] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-10T19:27:51.527402] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-10T19:27:51.527464] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-10T19:27:51.529125] [DEBUG] [LOCAL ] HPQ: Trimmed 77669 records to 54448 (keeping 200 days of data) [2025-10-10T19:27:51.776399] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-10T19:27:51.921172] [DEBUG] [LOCAL ] HPQ: Primary data saved (54448 records). [2025-10-10T19:27:51.921382] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-10T19:27:51.921834] [INFO ] [MAIN ] Update Progress: 1050/2373 symbols completed. HPQ took 41.4s. Estimated remaining: 3h 6m 14s. Rate: 7.1 symbols/min [2025-10-10T19:27:52.113526] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:27:52.163607] [DEBUG] [LOCAL ] HRB: Loaded 48723 existing records from primary storage. [2025-10-10T19:27:52.164063] [INFO ] [MAIN ] HRB: Loaded 48723 existing records. [2025-10-10T19:27:52.294482] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-10T19:27:52.353930] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:27:52.354633] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-10T19:27:52.354738] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-10T19:27:52.356008] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-10T19:27:52.356072] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-10T19:27:52.742030] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:27:52.743389] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T19:27:53.089436] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-10T19:27:53.838611] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-10T19:27:53.889523] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-10T19:27:54.514715] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-10T19:27:54.689388] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-10T19:27:55.144397] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-10T19:27:55.489432] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-10T19:27:56.061556] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-10T19:27:56.064348] [INFO ] [REMOTE ] HQL: Full fetch complete (25145 records). [2025-10-10T19:27:56.064419] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-10T19:27:56.299238] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-10T19:27:56.425408] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-10T19:27:56.425482] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-10T19:27:56.425989] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-10T19:27:56.426050] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-10T19:27:56.426709] [DEBUG] [LOCAL ] HQL: Trimmed 25145 records to 17027 (keeping 200 days of data) [2025-10-10T19:27:56.528035] [DEBUG] [LOCAL ] HQL: Primary data saved (17027 records). [2025-10-10T19:27:56.528179] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-10T19:27:56.528261] [INFO ] [MAIN ] Update Progress: 1051/2373 symbols completed. HQL took 27.9s. Estimated remaining: 3h 6m 0s. Rate: 7.1 symbols/min [2025-10-10T19:27:56.700084] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:27:56.740146] [DEBUG] [LOCAL ] HRI: Loaded 32776 existing records from primary storage. [2025-10-10T19:27:56.740582] [INFO ] [MAIN ] HRI: Loaded 32776 existing records. [2025-10-10T19:27:56.947479] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:27:56.948009] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-10T19:27:56.948176] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-10T19:27:56.957734] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-10T19:27:56.972158] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-10T19:27:57.009855] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-10T19:27:57.096629] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-10T19:27:57.383022] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:27:57.889341] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-10T19:27:58.147950] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T19:27:58.442906] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T19:27:58.689460] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-10T19:27:59.376887] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-10T19:27:59.489397] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-10T19:28:00.289383] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-10T19:28:00.449414] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T19:28:00.608337] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-10T19:28:01.089384] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-10T19:28:01.889389] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-10T19:28:02.185149] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T19:28:02.689394] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-10T19:28:03.422725] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-10T19:28:03.489407] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-10T19:28:04.045783] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (2.96 seconds). [2025-10-10T19:28:04.289808] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-10T19:28:04.325478] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T19:28:04.930139] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T19:28:04.933467] [INFO ] [REMOTE ] HQH: Full fetch complete (37333 records). [2025-10-10T19:28:04.933599] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-10T19:28:05.094548] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-10T19:28:05.327836] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-10T19:28:05.327926] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-10T19:28:05.328683] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-10T19:28:05.328746] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-10T19:28:05.329530] [DEBUG] [LOCAL ] HQH: Trimmed 37333 records to 26049 (keeping 200 days of data) [2025-10-10T19:28:05.486813] [DEBUG] [LOCAL ] HQH: Primary data saved (26049 records). [2025-10-10T19:28:05.486944] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-10T19:28:05.487027] [INFO ] [MAIN ] Update Progress: 1052/2373 symbols completed. HQH took 39.4s. Estimated remaining: 3h 5m 52s. Rate: 7.1 symbols/min [2025-10-10T19:28:05.654477] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:28:05.706123] [DEBUG] [LOCAL ] HRL: Loaded 53484 existing records from primary storage. [2025-10-10T19:28:05.706525] [INFO ] [MAIN ] HRL: Loaded 53484 existing records. [2025-10-10T19:28:05.883948] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:28:05.884164] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-10T19:28:05.884211] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-10T19:28:05.884540] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-10T19:28:05.884596] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-10T19:28:05.916448] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-10T19:28:06.252131] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:28:06.280326] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T19:28:06.584138] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-10T19:28:06.689403] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-10T19:28:07.375855] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-10T19:28:07.489436] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-10T19:28:07.800279] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-10T19:28:08.289389] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-10T19:28:09.089396] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-10T19:28:09.476257] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T19:28:09.889364] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-10T19:28:09.929449] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T19:28:10.689476] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-10T19:28:10.838799] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-10T19:28:11.489382] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-10T19:28:11.571763] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T19:28:12.067700] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-10T19:28:12.289382] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-10T19:28:12.893779] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-10T19:28:13.089474] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-10T19:28:13.889363] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-10T19:28:14.060995] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-10T19:28:14.105456] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T19:28:14.689380] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-10T19:28:15.186044] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-10T19:28:15.489367] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-10T19:28:16.289359] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-10T19:28:16.671166] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-10T19:28:16.804183] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-10T19:28:17.089430] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-10T19:28:17.889391] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-10T19:28:18.148093] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T19:28:18.658144] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T19:28:18.689334] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-10T19:28:18.943257] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-10T19:28:19.489434] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-10T19:28:20.289359] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-10T19:28:20.334029] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T19:28:21.089437] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-10T19:28:21.521238] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T19:28:21.626358] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T19:28:21.889374] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-10T19:28:22.689357] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-10T19:28:23.100087] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T19:28:23.489376] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-10T19:28:23.728519] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T19:28:24.042747] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T19:28:24.047574] [INFO ] [REMOTE ] HR: Full fetch complete (74808 records). [2025-10-10T19:28:24.047763] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-10T19:28:24.300852] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-10T19:28:24.471695] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-10T19:28:24.471795] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-10T19:28:24.472705] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-10T19:28:24.472769] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-10T19:28:24.474246] [DEBUG] [LOCAL ] HR: Trimmed 74808 records to 52742 (keeping 200 days of data) [2025-10-10T19:28:24.797917] [DEBUG] [LOCAL ] HR: Primary data saved (52742 records). [2025-10-10T19:28:24.798052] [INFO ] [MAIN ] HR: Full history saved. [2025-10-10T19:28:24.798134] [INFO ] [MAIN ] Update Progress: 1053/2373 symbols completed. HR took 42.3s. Estimated remaining: 3h 5m 58s. Rate: 7.1 symbols/min [2025-10-10T19:28:24.979662] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:28:25.022001] [DEBUG] [LOCAL ] HRTG: Loaded 34091 existing records from primary storage. [2025-10-10T19:28:25.022448] [INFO ] [MAIN ] HRTG: Loaded 34091 existing records. [2025-10-10T19:28:25.093997] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-10T19:28:25.222522] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:28:25.222969] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-10T19:28:25.223033] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-10T19:28:25.223977] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-10T19:28:25.224041] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-10T19:28:25.627909] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:28:25.633099] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-10T19:28:25.889432] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-10T19:28:26.011503] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-10T19:28:26.016034] [INFO ] [REMOTE ] HRB: Full fetch complete (69870 records). [2025-10-10T19:28:26.016155] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-10T19:28:26.409950] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-10T19:28:26.410080] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-10T19:28:26.411022] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-10T19:28:26.411096] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-10T19:28:26.412712] [DEBUG] [LOCAL ] HRB: Trimmed 69870 records to 49060 (keeping 200 days of data) [2025-10-10T19:28:26.690352] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-10T19:28:26.733284] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-10T19:28:26.742923] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-10T19:28:26.769465] [DEBUG] [LOCAL ] HRB: Primary data saved (49060 records). [2025-10-10T19:28:26.769595] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-10T19:28:26.769864] [INFO ] [MAIN ] Update Progress: 1054/2373 symbols completed. HRB took 34.8s. Estimated remaining: 3h 5m 41s. Rate: 7.1 symbols/min [2025-10-10T19:28:26.950670] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:28:26.997183] [DEBUG] [LOCAL ] HSBC: Loaded 51335 existing records from primary storage. [2025-10-10T19:28:26.997488] [INFO ] [MAIN ] HSBC: Loaded 51335 existing records. [2025-10-10T19:28:27.171950] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:28:27.172191] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-10T19:28:27.172248] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-10T19:28:27.173389] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-10T19:28:27.173447] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-10T19:28:27.494992] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-10T19:28:27.524775] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:28:28.289386] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-10T19:28:28.654571] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T19:28:28.925329] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T19:28:28.928611] [INFO ] [REMOTE ] HRI: Full fetch complete (46186 records). [2025-10-10T19:28:28.928830] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-10T19:28:29.091351] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-10T19:28:29.300610] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-10T19:28:29.300735] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-10T19:28:29.301475] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-10T19:28:29.301515] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-10T19:28:29.302502] [DEBUG] [LOCAL ] HRI: Trimmed 46186 records to 32990 (keeping 200 days of data) [2025-10-10T19:28:29.510788] [DEBUG] [LOCAL ] HRI: Primary data saved (32990 records). [2025-10-10T19:28:29.510930] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-10T19:28:29.511015] [INFO ] [MAIN ] Update Progress: 1055/2373 symbols completed. HRI took 33.0s. Estimated remaining: 3h 5m 26s. Rate: 7.1 symbols/min [2025-10-10T19:28:29.682963] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:28:29.697634] [DEBUG] [LOCAL ] HSHP: Loaded 15090 existing records from primary storage. [2025-10-10T19:28:29.697894] [INFO ] [MAIN ] HSHP: Loaded 15090 existing records. [2025-10-10T19:28:29.873148] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:28:29.873403] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-10T19:28:29.873465] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-10T19:28:29.873889] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-10T19:28:29.873945] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-10T19:28:29.894637] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-10T19:28:30.268710] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:28:30.286329] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T19:28:30.689401] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-10T19:28:31.158734] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-10T19:28:31.226095] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T19:28:31.489404] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-10T19:28:32.092235] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-10T19:28:32.289372] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-10T19:28:32.862763] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T19:28:33.089383] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-10T19:28:33.443319] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-10T19:28:33.889379] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-10T19:28:34.689351] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-10T19:28:35.093347] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-10T19:28:35.285713] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-10T19:28:35.489402] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-10T19:28:36.289392] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-10T19:28:36.756106] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-10T19:28:37.089377] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-10T19:28:37.545672] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-10T19:28:37.550673] [INFO ] [REMOTE ] HRL: Full fetch complete (76685 records). [2025-10-10T19:28:37.550791] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-10T19:28:37.899769] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-10T19:28:37.887365] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T19:28:37.965859] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-10T19:28:37.965977] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-10T19:28:37.967149] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-10T19:28:37.967219] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-10T19:28:37.968626] [DEBUG] [LOCAL ] HRL: Trimmed 76685 records to 53874 (keeping 200 days of data) [2025-10-10T19:28:38.289181] [DEBUG] [LOCAL ] HRL: Primary data saved (53874 records). [2025-10-10T19:28:38.289328] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-10T19:28:38.289414] [INFO ] [MAIN ] Update Progress: 1056/2373 symbols completed. HRL took 32.8s. Estimated remaining: 3h 5m 17s. Rate: 7.1 symbols/min [2025-10-10T19:28:38.455532] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:28:38.505396] [DEBUG] [LOCAL ] HSY: Loaded 50708 existing records from primary storage. [2025-10-10T19:28:38.505804] [INFO ] [MAIN ] HSY: Loaded 50708 existing records. [2025-10-10T19:28:38.681145] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:28:38.681349] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-10T19:28:38.681394] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-10T19:28:38.682237] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-10T19:28:38.682295] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-10T19:28:38.713102] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-10T19:28:39.035331] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:28:39.232414] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T19:28:39.399571] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-10T19:28:39.489356] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-10T19:28:39.850931] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-10T19:28:40.289364] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-10T19:28:41.089408] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-10T19:28:41.490899] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T19:28:41.553396] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T19:28:41.889431] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-10T19:28:42.689386] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-10T19:28:43.347749] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-10T19:28:43.489443] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-10T19:28:43.911696] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T19:28:44.289367] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-10T19:28:44.907807] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-10T19:28:45.089384] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-10T19:28:45.314915] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T19:28:45.889396] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-10T19:28:46.453592] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-10T19:28:46.689412] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-10T19:28:47.115805] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T19:28:47.236222] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-10T19:28:47.489385] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-10T19:28:47.691815] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-10T19:28:48.289404] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-10T19:28:48.485168] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-10T19:28:49.089417] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-10T19:28:49.889415] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-10T19:28:50.108435] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T19:28:50.690970] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-10T19:28:50.696570] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-10T19:28:51.489387] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-10T19:28:51.601878] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T19:28:51.628604] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-10T19:28:52.289397] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-10T19:28:53.089415] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-10T19:28:53.562468] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T19:28:53.889371] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-10T19:28:54.288034] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-10T19:28:54.319307] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T19:28:54.689369] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-10T19:28:55.489351] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-10T19:28:55.827802] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T19:28:56.289407] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-10T19:28:56.441542] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-10T19:28:56.789331] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-10T19:28:57.089383] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-10T19:28:57.889363] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-10T19:28:58.218706] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T19:28:58.327314] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-10T19:28:58.689408] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-10T19:28:59.447965] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T19:28:59.449877] [INFO ] [REMOTE ] HSHP: Full fetch complete (23242 records). [2025-10-10T19:28:59.449956] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-10T19:28:59.494560] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-10T19:28:59.825987] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-10T19:28:59.826072] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-10T19:28:59.829800] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-10T19:28:59.829950] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-10T19:28:59.831253] [DEBUG] [LOCAL ] HSHP: Trimmed 23242 records to 15260 (keeping 200 days of data) [2025-10-10T19:28:59.922413] [DEBUG] [LOCAL ] HSHP: Primary data saved (15260 records). [2025-10-10T19:28:59.922572] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-10T19:28:59.922704] [INFO ] [MAIN ] Update Progress: 1057/2373 symbols completed. HSHP took 30.4s. Estimated remaining: 3h 5m 25s. Rate: 7.1 symbols/min [2025-10-10T19:29:00.093512] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:29:00.093893] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-10T19:29:00.094055] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-10T19:29:00.094310] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-10T19:29:00.094358] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-10T19:29:00.094401] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-10T19:29:00.094435] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-10T19:29:00.273387] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-10T19:29:00.289989] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-10T19:29:00.550430] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:29:01.089378] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-10T19:29:01.227967] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T19:29:01.305995] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T19:29:01.306478] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-10T19:29:01.306582] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T19:29:01.306631] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-10T19:29:01.306710] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T19:29:01.306785] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-10T19:29:01.306857] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-10T19:29:01.306895] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-10T19:29:01.306934] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-10T19:29:01.306988] [INFO ] [MAIN ] Update Progress: 1058/2373 symbols completed. HTB took 1.4s. Estimated remaining: 3h 5m 8s. Rate: 7.1 symbols/min [2025-10-10T19:29:01.485443] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:29:01.501230] [DEBUG] [LOCAL ] HTD: Loaded 14048 existing records from primary storage. [2025-10-10T19:29:01.501469] [INFO ] [MAIN ] HTD: Loaded 14048 existing records. [2025-10-10T19:29:01.686214] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:29:01.686446] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-10T19:29:01.686507] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-10T19:29:01.686725] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-10T19:29:01.686781] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-10T19:29:01.901851] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-10T19:29:02.057035] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:29:02.380524] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-10T19:29:02.385473] [INFO ] [REMOTE ] HSBC: Full fetch complete (73836 records). [2025-10-10T19:29:02.385584] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-10T19:29:02.694559] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-10T19:29:02.769284] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-10T19:29:02.769362] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-10T19:29:02.770282] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-10T19:29:02.770345] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-10T19:29:02.771866] [DEBUG] [LOCAL ] HSBC: Trimmed 73836 records to 51725 (keeping 200 days of data) [2025-10-10T19:29:03.078477] [DEBUG] [LOCAL ] HSBC: Primary data saved (51725 records). [2025-10-10T19:29:03.078612] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-10T19:29:03.078887] [INFO ] [MAIN ] Update Progress: 1059/2373 symbols completed. HSBC took 36.3s. Estimated remaining: 3h 4m 52s. Rate: 7.1 symbols/min [2025-10-10T19:29:03.249236] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:29:03.249494] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-10T19:29:03.249547] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-10T19:29:03.249711] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-10T19:29:03.249763] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-10T19:29:03.249805] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-10T19:29:03.249837] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-10T19:29:03.489593] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-10T19:29:03.541237] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-10T19:29:03.595883] [INFO ] [REMOTE ] HRTG: Full fetch complete (43574 records). [2025-10-10T19:29:03.613065] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-10T19:29:03.618854] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:29:03.986748] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-10T19:29:03.986827] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-10T19:29:03.987505] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-10T19:29:03.987552] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-10T19:29:03.988562] [DEBUG] [LOCAL ] HRTG: Trimmed 43574 records to 34334 (keeping 200 days of data) [2025-10-10T19:29:04.187610] [DEBUG] [LOCAL ] HRTG: Primary data saved (34334 records). [2025-10-10T19:29:04.187791] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-10T19:29:04.187884] [INFO ] [MAIN ] Update Progress: 1060/2373 symbols completed. HRTG took 39.4s. Estimated remaining: 3h 4m 34s. Rate: 7.1 symbols/min [2025-10-10T19:29:04.294460] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-10T19:29:04.357219] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:29:04.400478] [DEBUG] [LOCAL ] HTGC: Loaded 47851 existing records from primary storage. [2025-10-10T19:29:04.400832] [INFO ] [MAIN ] HTGC: Loaded 47851 existing records. [2025-10-10T19:29:04.543836] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-10T19:29:04.606430] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:29:04.606888] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-10T19:29:04.607037] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-10T19:29:04.608101] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-10T19:29:04.608163] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-10T19:29:04.801128] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-10T19:29:05.008918] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:29:05.010718] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-10T19:29:05.089333] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-10T19:29:05.889363] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-10T19:29:06.689373] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-10T19:29:07.066572] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-10T19:29:07.069523] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T19:29:07.489410] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-10T19:29:07.671730] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-10T19:29:08.289396] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-10T19:29:08.677059] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-10T19:29:09.089373] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-10T19:29:09.391210] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T19:29:09.889376] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-10T19:29:10.294391] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-10T19:29:10.689353] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-10T19:29:11.049496] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T19:29:11.234497] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-10T19:29:11.489370] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-10T19:29:12.289398] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-10T19:29:12.685843] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-10T19:29:13.089394] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-10T19:29:13.260695] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T19:29:13.889362] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-10T19:29:14.202371] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-10T19:29:14.266281] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-10T19:29:14.689376] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-10T19:29:15.489618] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-10T19:29:15.601461] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-10T19:29:16.289373] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-10T19:29:17.089407] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-10T19:29:17.362381] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-10T19:29:17.398565] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-10T19:29:17.403989] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-10T19:29:17.889368] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-10T19:29:18.689375] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-10T19:29:19.040868] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-10T19:29:19.489393] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-10T19:29:19.786705] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T19:29:19.791405] [INFO ] [REMOTE ] HSY: Full fetch complete (73484 records). [2025-10-10T19:29:19.791560] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-10T19:29:20.183375] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-10T19:29:20.183456] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-10T19:29:20.184481] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-10T19:29:20.184556] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-10T19:29:20.186767] [DEBUG] [LOCAL ] HSY: Trimmed 73484 records to 51062 (keeping 200 days of data) [2025-10-10T19:29:20.299328] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-10T19:29:20.531117] [DEBUG] [LOCAL ] HSY: Primary data saved (51062 records). [2025-10-10T19:29:20.531283] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-10T19:29:20.531378] [INFO ] [MAIN ] Update Progress: 1061/2373 symbols completed. HSY took 42.2s. Estimated remaining: 3h 4m 35s. Rate: 7.1 symbols/min [2025-10-10T19:29:20.634920] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T19:29:20.717381] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:29:20.717583] [DEBUG] [LOCAL ] HTH: No existing data file found in primary storage. [2025-10-10T19:29:20.717683] [WARN ] [MAIN ] HTH: No existing data found, performing full refresh instead. [2025-10-10T19:29:20.717815] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-10T19:29:20.717857] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-10T19:29:20.717898] [DEBUG] [LOCAL ] HTH: No primary data file found to delete. [2025-10-10T19:29:20.717930] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-10T19:29:21.062013] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:29:21.089330] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-10T19:29:21.889397] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-10T19:29:22.288722] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T19:29:22.467126] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T19:29:22.481758] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-10T19:29:22.689357] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-10T19:29:23.061161] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-10T19:29:23.489382] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-10T19:29:24.289353] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-10T19:29:24.715068] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-10T19:29:24.715741] [INFO ] [REMOTE ] HTFC: Full fetch complete (845 records). [2025-10-10T19:29:24.715810] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-10T19:29:24.927380] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T19:29:24.926122] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-10T19:29:24.929882] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T19:29:24.934331] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T19:29:24.934415] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-10T19:29:24.934485] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-10T19:29:24.934523] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-10T19:29:24.934563] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-10T19:29:24.934630] [INFO ] [MAIN ] Update Progress: 1062/2373 symbols completed. HTFC took 21.9s. Estimated remaining: 3h 4m 22s. Rate: 7.1 symbols/min [2025-10-10T19:29:25.089378] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-10T19:29:25.109603] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:29:25.152263] [DEBUG] [LOCAL ] HUBB: Loaded 36829 existing records from primary storage. [2025-10-10T19:29:25.152792] [INFO ] [MAIN ] HUBB: Loaded 36829 existing records. [2025-10-10T19:29:25.343922] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:29:25.344250] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-10T19:29:25.344304] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-10T19:29:25.344824] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-10T19:29:25.345041] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-10T19:29:25.701781] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:29:25.889376] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-10T19:29:26.689401] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-10T19:29:27.067938] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T19:29:27.112212] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T19:29:27.489402] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-10T19:29:27.699545] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-10T19:29:28.289417] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-10T19:29:29.089374] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-10T19:29:29.283081] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T19:29:29.889377] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-10T19:29:29.922235] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T19:29:30.353429] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T19:29:30.689351] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-10T19:29:31.097099] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-10T19:29:31.489427] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-10T19:29:31.787976] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-10T19:29:32.289430] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-10T19:29:32.566454] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T19:29:33.089397] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-10T19:29:33.658686] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T19:29:33.889385] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-10T19:29:34.195738] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-10T19:29:34.689414] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-10T19:29:35.489375] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-10T19:29:35.702246] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T19:29:36.054308] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-10T19:29:36.056272] [INFO ] [REMOTE ] HTD: Full fetch complete (19208 records). [2025-10-10T19:29:36.056377] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-10T19:29:36.301614] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-10T19:29:36.435948] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-10T19:29:36.436021] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-10T19:29:36.436493] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-10T19:29:36.436553] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-10T19:29:36.437189] [DEBUG] [LOCAL ] HTD: Trimmed 19208 records to 14213 (keeping 200 days of data) [2025-10-10T19:29:36.524013] [DEBUG] [LOCAL ] HTD: Primary data saved (14213 records). [2025-10-10T19:29:36.524149] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-10T19:29:36.524232] [INFO ] [MAIN ] Update Progress: 1063/2373 symbols completed. HTD took 35.2s. Estimated remaining: 3h 4m 17s. Rate: 7.1 symbols/min [2025-10-10T19:29:36.700437] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:29:36.737297] [DEBUG] [LOCAL ] HUBS: Loaded 40004 existing records from primary storage. [2025-10-10T19:29:36.737631] [INFO ] [MAIN ] HUBS: Loaded 40004 existing records. [2025-10-10T19:29:36.918198] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:29:36.918622] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-10T19:29:36.918715] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-10T19:29:36.919528] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-10T19:29:36.919588] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-10T19:29:37.098179] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-10T19:29:37.306299] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:29:37.401215] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T19:29:37.889352] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-10T19:29:38.140422] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T19:29:38.234215] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-10T19:29:38.689421] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-10T19:29:39.489447] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-10T19:29:39.993045] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-10T19:29:40.289325] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-10T19:29:40.855396] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-10T19:29:41.089405] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-10T19:29:41.170067] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T19:29:41.596103] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T19:29:41.889385] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-10T19:29:42.689355] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-10T19:29:42.836023] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T19:29:43.297162] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T19:29:43.489374] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-10T19:29:44.289350] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-10T19:29:44.515686] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-10T19:29:44.521362] [INFO ] [REMOTE ] HTGC: Full fetch complete (68504 records). [2025-10-10T19:29:44.521499] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-10T19:29:44.902443] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-10T19:29:44.902522] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-10T19:29:44.903378] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-10T19:29:44.903441] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-10T19:29:44.904765] [DEBUG] [LOCAL ] HTGC: Trimmed 68504 records to 48240 (keeping 200 days of data) [2025-10-10T19:29:45.038293] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T19:29:45.109151] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-10T19:29:45.229521] [DEBUG] [LOCAL ] HTGC: Primary data saved (48240 records). [2025-10-10T19:29:45.229675] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-10T19:29:45.229776] [INFO ] [MAIN ] Update Progress: 1064/2373 symbols completed. HTGC took 41.0s. Estimated remaining: 3h 4m 9s. Rate: 7.1 symbols/min [2025-10-10T19:29:45.405263] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:29:45.455146] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T19:29:45.478099] [DEBUG] [LOCAL ] HUM: Loaded 49359 existing records from primary storage. [2025-10-10T19:29:45.478455] [INFO ] [MAIN ] HUM: Loaded 49359 existing records. [2025-10-10T19:29:45.651316] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:29:45.651531] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-10T19:29:45.651589] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-10T19:29:45.652132] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-10T19:29:45.652190] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-10T19:29:45.894438] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-10T19:29:46.013819] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:29:46.689359] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-10T19:29:46.782937] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T19:29:47.306587] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-10T19:29:47.489370] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-10T19:29:48.289424] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-10T19:29:48.811761] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-10T19:29:49.094453] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-10T19:29:49.105225] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-10T19:29:49.650114] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-10T19:29:49.889394] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-10T19:29:50.689376] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-10T19:29:50.913462] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T19:29:51.489371] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-10T19:29:51.767264] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-10T19:29:51.859209] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-10T19:29:52.289454] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-10T19:29:52.797568] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-10T19:29:53.089379] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-10T19:29:53.889363] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-10T19:29:53.959817] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-10T19:29:54.391552] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T19:29:54.689396] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-10T19:29:55.489379] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-10T19:29:55.872194] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-10T19:29:56.289393] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-10T19:29:56.412834] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T19:29:57.089402] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-10T19:29:57.164719] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-10T19:29:57.168573] [INFO ] [REMOTE ] HUBB: Full fetch complete (53903 records). [2025-10-10T19:29:57.168729] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-10T19:29:57.553381] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-10T19:29:57.553490] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-10T19:29:57.554602] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-10T19:29:57.554762] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-10T19:29:57.556393] [DEBUG] [LOCAL ] HUBB: Trimmed 53903 records to 37087 (keeping 200 days of data) [2025-10-10T19:29:57.802559] [DEBUG] [LOCAL ] HUBB: Primary data saved (37087 records). [2025-10-10T19:29:57.802791] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-10T19:29:57.802902] [INFO ] [MAIN ] Update Progress: 1065/2373 symbols completed. HUBB took 32.9s. Estimated remaining: 3h 4m 6s. Rate: 7.1 symbols/min [2025-10-10T19:29:57.895233] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-10T19:29:57.983599] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:29:58.041007] [DEBUG] [LOCAL ] HUN: Loaded 53591 existing records from primary storage. [2025-10-10T19:29:58.041425] [INFO ] [MAIN ] HUN: Loaded 53591 existing records. [2025-10-10T19:29:58.231668] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:29:58.232956] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-10T19:29:58.243085] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-10T19:29:58.260244] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-10T19:29:58.260324] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-10T19:29:58.261451] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T19:29:58.660836] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:29:58.685048] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-10T19:29:58.692751] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-10T19:29:59.181441] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-10T19:29:59.184725] [INFO ] [REMOTE ] HTH: Full fetch complete (46752 records). [2025-10-10T19:29:59.184827] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-10T19:29:59.492901] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-10T19:29:59.590950] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-10T19:29:59.591057] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-10T19:29:59.591963] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-10T19:29:59.592030] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-10T19:29:59.593501] [DEBUG] [LOCAL ] HTH: Trimmed 46752 records to 32795 (keeping 200 days of data) [2025-10-10T19:29:59.806175] [DEBUG] [LOCAL ] HTH: Primary data saved (32795 records). [2025-10-10T19:29:59.806420] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-10T19:29:59.806552] [INFO ] [MAIN ] Update Progress: 1066/2373 symbols completed. HTH took 39.3s. Estimated remaining: 3h 3m 50s. Rate: 7.1 symbols/min [2025-10-10T19:29:59.979936] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:30:00.027014] [DEBUG] [LOCAL ] HUYA: Loaded 44268 existing records from primary storage. [2025-10-10T19:30:00.027416] [INFO ] [MAIN ] HUYA: Loaded 44268 existing records. [2025-10-10T19:30:00.210144] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:30:00.211279] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-10T19:30:00.211340] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-10T19:30:00.212153] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-10T19:30:00.212215] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-10T19:30:00.293143] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-10T19:30:00.601005] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:30:00.640983] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T19:30:00.676427] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-10T19:30:01.089373] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-10T19:30:01.889399] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-10T19:30:02.570339] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-10T19:30:02.689394] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-10T19:30:03.075491] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T19:30:03.452625] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-10T19:30:03.489412] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-10T19:30:04.289408] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-10T19:30:04.864973] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-10T19:30:05.089454] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-10T19:30:05.288511] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T19:30:05.889406] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-10T19:30:06.221314] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T19:30:06.689407] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-10T19:30:06.805469] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T19:30:07.489445] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-10T19:30:07.792754] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T19:30:08.289475] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-10T19:30:08.586475] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T19:30:08.591036] [INFO ] [REMOTE ] HUBS: Full fetch complete (56045 records). [2025-10-10T19:30:08.591189] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-10T19:30:08.982396] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-10T19:30:08.982494] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-10T19:30:08.983346] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-10T19:30:08.983488] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-10T19:30:08.984966] [DEBUG] [LOCAL ] HUBS: Trimmed 56045 records to 40321 (keeping 200 days of data) [2025-10-10T19:30:09.105234] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-10T19:30:09.113562] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T19:30:09.304425] [DEBUG] [LOCAL ] HUBS: Primary data saved (40321 records). [2025-10-10T19:30:09.304615] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-10T19:30:09.304783] [INFO ] [MAIN ] Update Progress: 1067/2373 symbols completed. HUBS took 32.8s. Estimated remaining: 3h 3m 42s. Rate: 7.1 symbols/min [2025-10-10T19:30:09.500717] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:30:09.519345] [DEBUG] [LOCAL ] HVT: Loaded 15407 existing records from primary storage. [2025-10-10T19:30:09.519709] [INFO ] [MAIN ] HVT: Loaded 15407 existing records. [2025-10-10T19:30:09.699283] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:30:09.699560] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-10T19:30:09.699676] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-10T19:30:09.699957] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-10T19:30:09.700014] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-10T19:30:09.916135] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-10T19:30:10.076239] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:30:10.323395] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-10T19:30:10.689394] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-10T19:30:11.082434] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T19:30:11.489342] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-10T19:30:11.875873] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T19:30:11.930377] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T19:30:12.289374] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-10T19:30:12.706170] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-10T19:30:13.089364] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-10T19:30:13.889413] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-10T19:30:14.196504] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-10T19:30:14.689356] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-10T19:30:15.158267] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T19:30:15.388805] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-10T19:30:15.494450] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-10T19:30:15.512874] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T19:30:16.289357] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-10T19:30:17.089346] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-10T19:30:17.433983] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-10T19:30:17.796401] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-10T19:30:17.889332] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-10T19:30:18.689342] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-10T19:30:18.931826] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T19:30:19.489380] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-10T19:30:19.886101] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-10T19:30:19.891054] [INFO ] [REMOTE ] HUM: Full fetch complete (70907 records). [2025-10-10T19:30:19.891177] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-10T19:30:20.277470] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-10T19:30:20.277564] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-10T19:30:20.278503] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-10T19:30:20.278566] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-10T19:30:20.279937] [DEBUG] [LOCAL ] HUM: Trimmed 70907 records to 49709 (keeping 200 days of data) [2025-10-10T19:30:20.336576] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-10T19:30:20.530034] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-10T19:30:20.632309] [DEBUG] [LOCAL ] HUM: Primary data saved (49709 records). [2025-10-10T19:30:20.632456] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-10T19:30:20.632553] [INFO ] [MAIN ] Update Progress: 1068/2373 symbols completed. HUM took 35.4s. Estimated remaining: 3h 3m 37s. Rate: 7.1 symbols/min [2025-10-10T19:30:20.789772] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T19:30:20.819249] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:30:20.871131] [DEBUG] [LOCAL ] HWM: Loaded 53247 existing records from primary storage. [2025-10-10T19:30:20.871443] [INFO ] [MAIN ] HWM: Loaded 53247 existing records. [2025-10-10T19:30:21.055024] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:30:21.055747] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-10T19:30:21.055810] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-10T19:30:21.056054] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-10T19:30:21.056114] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-10T19:30:21.094526] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-10T19:30:21.415218] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:30:21.889389] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-10T19:30:22.331826] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-10T19:30:22.359098] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T19:30:22.689450] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-10T19:30:23.278743] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-10T19:30:23.489380] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-10T19:30:24.289344] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-10T19:30:24.515823] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T19:30:24.702453] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-10T19:30:25.089392] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-10T19:30:25.889337] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-10T19:30:26.155609] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-10T19:30:26.689419] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-10T19:30:26.873847] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T19:30:27.489436] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-10T19:30:28.059624] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-10T19:30:28.289427] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-10T19:30:28.581476] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T19:30:28.872005] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-10T19:30:29.089359] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-10T19:30:29.889421] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-10T19:30:30.397362] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-10T19:30:30.689517] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-10T19:30:30.928923] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T19:30:31.489350] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-10T19:30:31.508317] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-10T19:30:31.513973] [INFO ] [REMOTE ] HUN: Full fetch complete (76725 records). [2025-10-10T19:30:31.514077] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-10T19:30:31.923221] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-10T19:30:31.923345] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-10T19:30:31.925084] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-10T19:30:31.925188] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-10T19:30:31.927266] [DEBUG] [LOCAL ] HUN: Trimmed 76725 records to 53981 (keeping 200 days of data) [2025-10-10T19:30:32.261663] [DEBUG] [LOCAL ] HUN: Primary data saved (53981 records). [2025-10-10T19:30:32.261943] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-10T19:30:32.262364] [INFO ] [MAIN ] Update Progress: 1069/2373 symbols completed. HUN took 34.5s. Estimated remaining: 3h 3m 33s. Rate: 7.1 symbols/min [2025-10-10T19:30:32.294628] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-10T19:30:32.433968] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:30:32.476873] [DEBUG] [LOCAL ] HXL: Loaded 46202 existing records from primary storage. [2025-10-10T19:30:32.477316] [INFO ] [MAIN ] HXL: Loaded 46202 existing records. [2025-10-10T19:30:32.658676] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:30:32.658897] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-10T19:30:32.658956] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-10T19:30:32.659149] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-10T19:30:32.659205] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-10T19:30:33.014115] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:30:33.044516] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-10T19:30:33.089329] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-10T19:30:33.226793] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-10T19:30:33.423833] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T19:30:33.889409] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-10T19:30:34.689913] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-10T19:30:34.694792] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-10T19:30:35.489410] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-10T19:30:36.156159] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-10T19:30:36.289456] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-10T19:30:36.364327] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-10T19:30:36.369085] [INFO ] [REMOTE ] HUYA: Full fetch complete (63946 records). [2025-10-10T19:30:36.369249] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-10T19:30:36.699782] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-10T19:30:36.780673] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-10T19:30:36.780770] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-10T19:30:36.781676] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-10T19:30:36.781740] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-10T19:30:36.783355] [DEBUG] [LOCAL ] HUYA: Trimmed 63946 records to 44619 (keeping 200 days of data) [2025-10-10T19:30:37.032770] [DEBUG] [LOCAL ] HUYA: Primary data saved (44619 records). [2025-10-10T19:30:37.032901] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-10T19:30:37.032982] [INFO ] [MAIN ] Update Progress: 1070/2373 symbols completed. HUYA took 37.2s. Estimated remaining: 3h 3m 20s. Rate: 7.1 symbols/min [2025-10-10T19:30:37.095501] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-10T19:30:37.204555] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:30:37.216026] [DEBUG] [LOCAL ] HY: Loaded 10036 existing records from primary storage. [2025-10-10T19:30:37.216236] [INFO ] [MAIN ] HY: Loaded 10036 existing records. [2025-10-10T19:30:37.393510] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:30:37.393776] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-10T19:30:37.393829] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-10T19:30:37.394015] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-10T19:30:37.394099] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-10T19:30:37.760597] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:30:37.889381] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-10T19:30:38.363706] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T19:30:38.689371] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-10T19:30:38.891286] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T19:30:38.917395] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-10T19:30:39.489372] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-10T19:30:40.289351] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-10T19:30:40.901126] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-10T19:30:41.015606] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-10T19:30:41.089341] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-10T19:30:41.205905] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-10T19:30:41.889397] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-10T19:30:42.169720] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T19:30:42.689353] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-10T19:30:42.789481] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T19:30:43.489359] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-10T19:30:43.708880] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-10T19:30:44.207770] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-10T19:30:44.289395] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-10T19:30:45.089360] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-10T19:30:45.393999] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-10T19:30:45.395750] [INFO ] [REMOTE ] HVT: Full fetch complete (23206 records). [2025-10-10T19:30:45.395829] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-10T19:30:45.759487] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-10T19:30:45.759585] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-10T19:30:45.760130] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-10T19:30:45.760191] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-10T19:30:45.760841] [DEBUG] [LOCAL ] HVT: Trimmed 23206 records to 15512 (keeping 200 days of data) [2025-10-10T19:30:45.853853] [DEBUG] [LOCAL ] HVT: Primary data saved (15512 records). [2025-10-10T19:30:45.853996] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-10T19:30:45.854078] [INFO ] [MAIN ] Update Progress: 1071/2373 symbols completed. HVT took 36.5s. Estimated remaining: 3h 3m 12s. Rate: 7.1 symbols/min [2025-10-10T19:30:45.896409] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-10T19:30:46.023852] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:30:46.024083] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-10T19:30:46.024127] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-10T19:30:46.024240] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-10T19:30:46.024282] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-10T19:30:46.024325] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-10T19:30:46.024359] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-10T19:30:46.374741] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:30:46.689338] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-10T19:30:47.409915] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-10T19:30:47.489386] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-10T19:30:47.741931] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-10T19:30:47.803490] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-10T19:30:48.289426] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-10T19:30:49.089381] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-10T19:30:49.638107] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-10T19:30:49.889402] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-10T19:30:50.055388] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-10T19:30:50.252968] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T19:30:50.689406] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-10T19:30:51.489413] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-10T19:30:51.874023] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-10T19:30:52.295168] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-10T19:30:52.301967] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-10T19:30:52.437197] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T19:30:53.089351] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-10T19:30:53.181367] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-10T19:30:53.451700] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-10T19:30:53.889411] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-10T19:30:54.689385] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-10T19:30:55.062177] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-10T19:30:55.489370] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-10T19:30:55.848127] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-10T19:30:55.946995] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-10T19:30:55.953128] [INFO ] [REMOTE ] HWM: Full fetch complete (76524 records). [2025-10-10T19:30:55.953432] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-10T19:30:56.295912] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-10T19:30:56.356981] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-10T19:30:56.357075] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-10T19:30:56.358216] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-10T19:30:56.358286] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-10T19:30:56.359901] [DEBUG] [LOCAL ] HWM: Trimmed 76524 records to 53615 (keeping 200 days of data) [2025-10-10T19:30:56.703336] [DEBUG] [LOCAL ] HWM: Primary data saved (53615 records). [2025-10-10T19:30:56.703508] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-10T19:30:56.703678] [INFO ] [MAIN ] Update Progress: 1072/2373 symbols completed. HWM took 36.1s. Estimated remaining: 3h 3m 6s. Rate: 7.1 symbols/min [2025-10-10T19:30:56.877912] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:30:56.878099] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-10T19:30:56.878154] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-10T19:30:56.878282] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-10T19:30:56.878323] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-10T19:30:56.878365] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-10T19:30:56.878398] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-10T19:30:57.098385] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-10T19:30:57.236752] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:30:57.444074] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-10T19:30:57.889376] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-10T19:30:58.115204] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T19:30:58.144967] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-10T19:30:58.689367] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-10T19:30:59.075289] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-10T19:30:59.489402] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-10T19:30:59.981230] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-10T19:31:00.289375] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-10T19:31:01.089407] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-10T19:31:01.406000] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-10T19:31:01.889421] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-10T19:31:02.373761] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-10T19:31:02.689468] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-10T19:31:02.973702] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T19:31:03.489438] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-10T19:31:03.667708] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-10T19:31:03.894152] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-10T19:31:04.289414] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-10T19:31:04.545127] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-10T19:31:05.089381] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-10T19:31:05.889383] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-10T19:31:06.102967] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-10T19:31:06.689431] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-10T19:31:07.489361] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-10T19:31:07.629775] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T19:31:07.628129] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T19:31:07.641006] [INFO ] [REMOTE ] HY: Full fetch complete (15022 records). [2025-10-10T19:31:07.641171] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-10T19:31:07.798416] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-10T19:31:08.036617] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-10T19:31:08.036754] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-10T19:31:08.037418] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-10T19:31:08.037485] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-10T19:31:08.038234] [DEBUG] [LOCAL ] HY: Trimmed 15022 records to 10112 (keeping 200 days of data) [2025-10-10T19:31:08.108628] [DEBUG] [LOCAL ] HY: Primary data saved (10112 records). [2025-10-10T19:31:08.108886] [INFO ] [MAIN ] HY: Full history saved. [2025-10-10T19:31:08.109005] [INFO ] [MAIN ] Update Progress: 1073/2373 symbols completed. HY took 31.1s. Estimated remaining: 3h 3m 2s. Rate: 7.1 symbols/min [2025-10-10T19:31:08.290923] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-10T19:31:08.290764] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:31:08.308608] [DEBUG] [LOCAL ] HYI: Loaded 9984 existing records from primary storage. [2025-10-10T19:31:08.308945] [INFO ] [MAIN ] HYI: Loaded 9984 existing records. [2025-10-10T19:31:08.499954] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:31:08.500242] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-10T19:31:08.500294] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-10T19:31:08.500517] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-10T19:31:08.500574] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-10T19:31:08.891518] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:31:09.089378] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-10T19:31:09.561330] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-10T19:31:09.562668] [INFO ] [REMOTE ] HYAC: Full fetch complete (904 records). [2025-10-10T19:31:09.562759] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-10T19:31:09.600239] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T19:31:09.778180] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-10T19:31:09.778421] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T19:31:09.778492] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T19:31:09.778584] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-10T19:31:09.778718] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-10T19:31:09.778769] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-10T19:31:09.778812] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-10T19:31:09.778869] [INFO ] [MAIN ] Update Progress: 1074/2373 symbols completed. HYAC took 23.9s. Estimated remaining: 3h 2m 45s. Rate: 7.1 symbols/min [2025-10-10T19:31:09.896072] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-10T19:31:09.973178] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:31:10.006037] [DEBUG] [LOCAL ] HYT: Loaded 33742 existing records from primary storage. [2025-10-10T19:31:10.006363] [INFO ] [MAIN ] HYT: Loaded 33742 existing records. [2025-10-10T19:31:10.179123] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:31:10.179375] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-10T19:31:10.179423] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-10T19:31:10.179714] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-10T19:31:10.179770] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-10T19:31:10.579535] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:31:10.689374] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-10T19:31:11.489404] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-10T19:31:11.631677] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T19:31:11.637190] [INFO ] [REMOTE ] HXL: Full fetch complete (66221 records). [2025-10-10T19:31:11.637355] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-10T19:31:11.761266] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-10T19:31:11.957298] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-10T19:31:12.089689] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-10T19:31:12.089824] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-10T19:31:12.090941] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-10T19:31:12.091019] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-10T19:31:12.092874] [DEBUG] [LOCAL ] HXL: Trimmed 66221 records to 46548 (keeping 200 days of data) [2025-10-10T19:31:12.308785] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-10T19:31:12.389302] [DEBUG] [LOCAL ] HXL: Primary data saved (46548 records). [2025-10-10T19:31:12.389492] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-10T19:31:12.389839] [INFO ] [MAIN ] Update Progress: 1075/2373 symbols completed. HXL took 40.1s. Estimated remaining: 3h 2m 30s. Rate: 7.1 symbols/min [2025-10-10T19:31:12.564517] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:31:12.572306] [DEBUG] [LOCAL ] HYTR: Loaded 3138 existing records from primary storage. [2025-10-10T19:31:12.572619] [INFO ] [MAIN ] HYTR: Loaded 3138 existing records. [2025-10-10T19:31:12.771956] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:31:12.772341] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-10T19:31:12.772396] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-10T19:31:12.772597] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-10T19:31:12.772705] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-10T19:31:13.044478] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-10T19:31:13.094451] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-10T19:31:13.173063] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:31:13.889375] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-10T19:31:14.669055] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-10T19:31:14.689388] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-10T19:31:14.805614] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-10T19:31:14.962923] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-10T19:31:15.489430] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-10T19:31:16.137966] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-10T19:31:16.289410] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-10T19:31:17.089395] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-10T19:31:17.183757] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-10T19:31:17.889409] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-10T19:31:18.086183] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-10T19:31:18.689410] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-10T19:31:18.763196] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-10T19:31:19.489438] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-10T19:31:20.272876] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-10T19:31:20.289328] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-10T19:31:20.513270] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-10T19:31:21.089382] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-10T19:31:21.628765] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-10T19:31:21.889412] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-10T19:31:21.999777] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T19:31:22.269906] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-10T19:31:22.689382] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-10T19:31:23.489419] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-10T19:31:23.858778] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-10T19:31:24.289401] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-10T19:31:24.371314] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T19:31:24.697453] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-10T19:31:25.089393] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-10T19:31:25.766224] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-10T19:31:25.889379] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-10T19:31:26.689350] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-10T19:31:26.794982] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-10T19:31:27.489443] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-10T19:31:27.786721] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-10T19:31:28.289461] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-10T19:31:28.352153] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T19:31:29.089349] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-10T19:31:29.254022] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-10T19:31:29.746582] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-10T19:31:29.889354] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-10T19:31:30.353590] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-10T19:31:30.689382] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-10T19:31:31.366050] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-10T19:31:31.489343] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-10T19:31:32.200281] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-10T19:31:32.289405] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-10T19:31:33.089441] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-10T19:31:33.481079] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-10T19:31:33.862672] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T19:31:33.889337] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-10T19:31:34.159025] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-10T19:31:34.689371] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-10T19:31:35.489394] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-10T19:31:35.877525] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-10T19:31:35.878314] [INFO ] [REMOTE ] HYBX: Full fetch complete (723 records). [2025-10-10T19:31:35.878384] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-10T19:31:36.088902] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-10-10T19:31:36.089095] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T19:31:36.089143] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T19:31:36.089184] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-10T19:31:36.089246] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-10T19:31:36.089282] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-10T19:31:36.089323] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-10T19:31:36.089391] [INFO ] [MAIN ] Update Progress: 1076/2373 symbols completed. HYBX took 39.4s. Estimated remaining: 3h 2m 39s. Rate: 7.1 symbols/min [2025-10-10T19:31:36.296996] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-10T19:31:36.298993] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:31:36.330162] [DEBUG] [LOCAL ] HZO: Loaded 29215 existing records from primary storage. [2025-10-10T19:31:36.330528] [INFO ] [MAIN ] HZO: Loaded 29215 existing records. [2025-10-10T19:31:36.469561] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T19:31:36.558758] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:31:36.559106] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-10T19:31:36.559180] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-10T19:31:36.559766] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-10T19:31:36.559838] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-10T19:31:36.970431] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:31:37.089381] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-10T19:31:37.262445] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-10T19:31:37.889430] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-10T19:31:38.341445] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-10T19:31:38.442114] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T19:31:38.689378] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-10T19:31:39.489422] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-10T19:31:39.600302] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T19:31:40.289401] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-10T19:31:41.089409] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-10T19:31:41.140325] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-10T19:31:41.631369] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-10T19:31:41.681416] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-10T19:31:41.889385] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-10T19:31:42.689385] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-10T19:31:42.816137] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-10T19:31:43.489382] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-10T19:31:44.044003] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-10T19:31:44.236155] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-10T19:31:44.239601] [INFO ] [REMOTE ] HYT: Full fetch complete (47736 records). [2025-10-10T19:31:44.239709] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-10T19:31:44.298204] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-10T19:31:44.620510] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-10T19:31:44.620613] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-10T19:31:44.621409] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-10T19:31:44.621471] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-10T19:31:44.622530] [DEBUG] [LOCAL ] HYT: Trimmed 47736 records to 34001 (keeping 200 days of data) [2025-10-10T19:31:44.820371] [DEBUG] [LOCAL ] HYT: Primary data saved (34001 records). [2025-10-10T19:31:44.820499] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-10T19:31:44.820578] [INFO ] [MAIN ] Update Progress: 1077/2373 symbols completed. HYT took 35.0s. Estimated remaining: 3h 2m 31s. Rate: 7.1 symbols/min [2025-10-10T19:31:45.089367] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-10T19:31:45.481475] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-10T19:31:45.483764] [INFO ] [REMOTE ] HYI: Full fetch complete (13974 records). [2025-10-10T19:31:45.483843] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-10T19:31:45.675599] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-10T19:31:45.696255] [INFO ] [REMOTE ] HYTR: Full fetch complete (4630 records). [2025-10-10T19:31:45.696399] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-10T19:31:45.895317] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-10T19:31:46.138708] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-10T19:31:46.171185] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-10T19:31:46.183727] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-10T19:31:46.188954] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-10T19:31:46.214272] [DEBUG] [LOCAL ] HYI: Trimmed 13974 records to 10069 (keeping 200 days of data) [2025-10-10T19:31:46.345317] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-10T19:31:46.347870] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-10T19:31:46.348633] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-10T19:31:46.349101] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-10T19:31:46.355275] [DEBUG] [LOCAL ] HYTR: Trimmed 4630 records to 3168 (keeping 200 days of data) [2025-10-10T19:31:46.367466] [DEBUG] [LOCAL ] HYI: Primary data saved (10069 records). [2025-10-10T19:31:46.367900] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-10T19:31:46.368077] [INFO ] [MAIN ] Update Progress: 1078/2373 symbols completed. HYI took 38.3s. Estimated remaining: 3h 2m 15s. Rate: 7.1 symbols/min [2025-10-10T19:31:46.387587] [DEBUG] [LOCAL ] HYTR: Primary data saved (3168 records). [2025-10-10T19:31:46.387728] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-10T19:31:46.387823] [INFO ] [MAIN ] Update Progress: 1079/2373 symbols completed. HYTR took 34.0s. Estimated remaining: 3h 1m 56s. Rate: 7.1 symbols/min [2025-10-10T19:31:47.293000] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-10T19:31:47.298454] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-10T19:31:48.867702] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T19:31:48.874400] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-10T19:31:50.509332] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T19:31:50.517856] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-10T19:31:52.043603] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-10T19:31:52.050321] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-10T19:31:53.545278] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T19:31:53.551434] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-10T19:31:55.088226] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-10T19:31:55.095475] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-10T19:31:56.100547] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-10T19:31:56.107546] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-10T19:31:57.186291] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-10T19:31:57.193361] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-10T19:31:58.479509] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-10T19:31:58.482363] [INFO ] [REMOTE ] HZO: Full fetch complete (41087 records). [2025-10-10T19:31:58.482454] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-10T19:31:58.861638] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-10T19:31:58.861753] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-10T19:31:58.862385] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-10T19:31:58.862448] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-10T19:31:58.863439] [DEBUG] [LOCAL ] HZO: Trimmed 41087 records to 29457 (keeping 200 days of data) [2025-10-10T19:31:59.049816] [DEBUG] [LOCAL ] HZO: Primary data saved (29457 records). [2025-10-10T19:31:59.050012] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-10T19:31:59.050156] [INFO ] [MAIN ] Update Progress: 1080/2373 symbols completed. HZO took 23.0s. Estimated remaining: 3h 1m 53s. Rate: 7.1 symbols/min [2025-10-10T19:31:59.768084] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:31:59.797384] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:31:59.892784] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:31:59.897365] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:31:59.905869] [DEBUG] [LOCAL ] IAE: Loaded 6203 existing records from primary storage. [2025-10-10T19:31:59.906368] [INFO ] [MAIN ] IAE: Loaded 6203 existing records. [2025-10-10T19:32:00.171262] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:32:00.189089] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-10T19:32:00.191534] [DEBUG] [LOCAL ] IBN: Loaded 53246 existing records from primary storage. [2025-10-10T19:32:00.192625] [DEBUG] [LOCAL ] IAG: Loaded 53863 existing records from primary storage. [2025-10-10T19:32:00.192881] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-10T19:32:00.193144] [INFO ] [MAIN ] IAG: Loaded 53863 existing records. [2025-10-10T19:32:00.198745] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-10T19:32:00.193573] [INFO ] [MAIN ] IBN: Loaded 53246 existing records. [2025-10-10T19:32:00.205842] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-10T19:32:00.414211] [DEBUG] [LOCAL ] IBM: Loaded 54021 existing records from primary storage. [2025-10-10T19:32:00.511767] [INFO ] [MAIN ] IBM: Loaded 54021 existing records. [2025-10-10T19:32:00.914536] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:32:00.942388] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-10T19:32:01.015751] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-10T19:32:01.021495] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:32:01.091758] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-10T19:32:01.113531] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-10T19:32:01.113349] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-10T19:32:01.165045] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-10T19:32:01.168414] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-10T19:32:01.173578] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:32:01.190457] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-10T19:32:01.220099] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-10T19:32:01.190134] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-10T19:32:01.343198] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-10T19:32:01.390894] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-10T19:32:01.451123] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:32:01.480487] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-10T19:32:02.212290] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:32:02.270288] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-10T19:32:02.362450] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:32:02.373571] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-10T19:32:02.391621] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-10T19:32:02.425114] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-10T19:32:02.467616] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:32:02.468408] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-10T19:32:03.215663] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-10T19:32:03.217421] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-10T19:32:04.083269] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-10T19:32:04.085273] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-10T19:32:04.150700] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T19:32:04.165176] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-10T19:32:04.266252] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T19:32:04.277043] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-10T19:32:04.828003] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-10T19:32:04.829998] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-10T19:32:04.938580] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-10T19:32:04.949270] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-10T19:32:05.320327] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-10T19:32:05.321999] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-10T19:32:05.668914] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-10T19:32:05.679455] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-10T19:32:06.152878] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-10T19:32:06.154820] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-10T19:32:06.333296] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T19:32:06.343930] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-10T19:32:07.088580] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-10T19:32:07.090547] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-10T19:32:07.298607] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-10T19:32:07.309482] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-10T19:32:07.433512] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-10T19:32:07.443538] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-10T19:32:07.761778] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T19:32:07.773263] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-10T19:32:07.779058] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-10T19:32:08.289410] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-10T19:32:09.052539] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T19:32:09.089329] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-10T19:32:09.565356] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-10T19:32:09.619134] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-10T19:32:09.675571] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T19:32:09.889403] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-10T19:32:10.011697] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-10T19:32:10.689419] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-10T19:32:11.489349] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-10T19:32:12.114969] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-10T19:32:12.289381] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-10T19:32:12.335514] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T19:32:12.336958] [INFO ] [REMOTE ] IAE: Full fetch complete (8886 records). [2025-10-10T19:32:12.337028] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-10T19:32:12.701423] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-10T19:32:12.701594] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-10T19:32:12.701890] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-10T19:32:12.701969] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-10T19:32:12.702677] [DEBUG] [LOCAL ] IAE: Trimmed 8886 records to 6312 (keeping 200 days of data) [2025-10-10T19:32:12.769808] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-10T19:32:12.783314] [DEBUG] [LOCAL ] IAE: Primary data saved (6312 records). [2025-10-10T19:32:12.783775] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-10T19:32:12.783899] [INFO ] [MAIN ] Update Progress: 1081/2373 symbols completed. IAE took 13.7s. Estimated remaining: 3h 1m 51s. Rate: 7.1 symbols/min [2025-10-10T19:32:12.950863] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:32:12.979769] [DEBUG] [LOCAL ] IBP: Loaded 29034 existing records from primary storage. [2025-10-10T19:32:12.980032] [INFO ] [MAIN ] IBP: Loaded 29034 existing records. [2025-10-10T19:32:13.094467] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-10T19:32:13.161239] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:32:13.161467] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-10T19:32:13.161517] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-10T19:32:13.161733] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-10T19:32:13.161791] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-10T19:32:13.529128] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:32:13.889387] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-10T19:32:14.384756] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-10T19:32:14.606276] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-10T19:32:14.689341] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-10T19:32:15.489375] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-10T19:32:16.289358] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-10T19:32:16.391025] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-10T19:32:16.658775] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-10T19:32:16.906775] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T19:32:17.089376] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-10T19:32:17.889408] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-10T19:32:18.394296] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T19:32:18.428957] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-10T19:32:18.689373] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-10T19:32:19.489385] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-10T19:32:20.289361] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-10T19:32:20.566545] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T19:32:20.612317] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-10T19:32:20.804697] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T19:32:21.089391] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-10T19:32:21.852741] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-10T19:32:21.889338] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-10T19:32:22.689424] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-10T19:32:23.489408] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-10T19:32:23.606477] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-10T19:32:23.651162] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T19:32:24.197480] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T19:32:24.289382] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-10T19:32:25.089350] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-10T19:32:25.528885] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-10T19:32:25.889399] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-10T19:32:26.570308] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-10T19:32:26.689336] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-10T19:32:26.731617] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T19:32:27.391162] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-10T19:32:27.489421] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-10T19:32:28.289454] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-10T19:32:28.523435] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-10T19:32:28.677432] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T19:32:29.089398] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-10T19:32:29.889340] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-10T19:32:30.417274] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-10T19:32:30.422382] [INFO ] [REMOTE ] IAG: Full fetch complete (77282 records). [2025-10-10T19:32:30.422542] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-10T19:32:30.695218] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-10T19:32:30.804481] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T19:32:30.880145] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-10T19:32:30.880230] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-10T19:32:30.881280] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-10T19:32:30.881344] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-10T19:32:30.883004] [DEBUG] [LOCAL ] IAG: Trimmed 77282 records to 54253 (keeping 200 days of data) [2025-10-10T19:32:31.191271] [DEBUG] [LOCAL ] IAG: Primary data saved (54253 records). [2025-10-10T19:32:31.191423] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-10T19:32:31.191521] [INFO ] [MAIN ] Update Progress: 1082/2373 symbols completed. IAG took 32.1s. Estimated remaining: 3h 1m 54s. Rate: 7.1 symbols/min [2025-10-10T19:32:31.373020] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:32:31.409763] [DEBUG] [LOCAL ] IBTA: Loaded 37355 existing records from primary storage. [2025-10-10T19:32:31.410048] [INFO ] [MAIN ] IBTA: Loaded 37355 existing records. [2025-10-10T19:32:31.499800] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-10T19:32:31.607976] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:32:31.608269] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-10T19:32:31.608344] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-10T19:32:31.608722] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-10T19:32:31.608803] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-10T19:32:32.121141] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:32:32.185026] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-10T19:32:32.289456] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-10T19:32:33.024118] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T19:32:33.089458] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-10T19:32:33.446407] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-10-10T19:32:33.889412] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-10T19:32:34.689451] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-10T19:32:36.704932] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-10-10T19:32:36.716803] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-10T19:32:39.307250] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.59 seconds). [2025-10-10T19:32:39.312922] [INFO ] [REMOTE ] IBM: Full fetch complete (77622 records). [2025-10-10T19:32:39.313093] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-10T19:32:39.740743] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-10T19:32:39.740850] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-10T19:32:39.741927] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-10T19:32:39.741999] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-10T19:32:39.743581] [DEBUG] [LOCAL ] IBM: Trimmed 77622 records to 54410 (keeping 200 days of data) [2025-10-10T19:32:40.127260] [DEBUG] [LOCAL ] IBM: Primary data saved (54410 records). [2025-10-10T19:32:40.127464] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-10T19:32:40.127571] [INFO ] [MAIN ] Update Progress: 1083/2373 symbols completed. IBM took 41.1s. Estimated remaining: 3h 1m 46s. Rate: 7.1 symbols/min [2025-10-10T19:32:40.322022] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:32:40.376124] [DEBUG] [LOCAL ] ICE: Loaded 53402 existing records from primary storage. [2025-10-10T19:32:40.376501] [INFO ] [MAIN ] ICE: Loaded 53402 existing records. [2025-10-10T19:32:40.592784] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:32:40.593048] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-10T19:32:40.593104] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-10T19:32:40.593394] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-10T19:32:40.593445] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-10T19:32:40.992564] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:32:40.993021] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-10T19:32:41.014878] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (7.93 seconds). [2025-10-10T19:32:41.022857] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-10T19:32:42.455000] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-10T19:32:42.461432] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-10T19:32:42.902246] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (8.21 seconds). [2025-10-10T19:32:42.908839] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-10T19:32:43.603524] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T19:32:43.606488] [INFO ] [REMOTE ] IBP: Full fetch complete (41076 records). [2025-10-10T19:32:43.606573] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-10T19:32:43.692500] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (11.40 seconds). [2025-10-10T19:32:43.732274] [INFO ] [REMOTE ] IBN: Full fetch complete (76325 records). [2025-10-10T19:32:43.771901] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-10T19:32:44.279605] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-10T19:32:44.285254] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-10T19:32:44.303923] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-10T19:32:44.331761] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-10T19:32:44.386310] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-10T19:32:44.398358] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-10T19:32:44.397967] [DEBUG] [LOCAL ] IBP: Trimmed 41076 records to 29252 (keeping 200 days of data) [2025-10-10T19:32:44.599558] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-10T19:32:44.601486] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-10T19:32:44.603280] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-10T19:32:44.603407] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-10T19:32:44.620019] [DEBUG] [LOCAL ] IBN: Trimmed 76325 records to 53629 (keeping 200 days of data) [2025-10-10T19:32:44.806982] [DEBUG] [LOCAL ] IBP: Primary data saved (29252 records). [2025-10-10T19:32:44.808480] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-10T19:32:44.808618] [INFO ] [MAIN ] Update Progress: 1084/2373 symbols completed. IBP took 32.0s. Estimated remaining: 3h 1m 33s. Rate: 7.1 symbols/min [2025-10-10T19:32:44.929761] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (3.94 seconds). [2025-10-10T19:32:44.954420] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-10T19:32:45.140988] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:32:45.282140] [DEBUG] [LOCAL ] ICL: Loaded 38682 existing records from primary storage. [2025-10-10T19:32:45.288809] [DEBUG] [LOCAL ] IBN: Primary data saved (53629 records). [2025-10-10T19:32:45.289137] [INFO ] [MAIN ] ICL: Loaded 38682 existing records. [2025-10-10T19:32:45.319808] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-10T19:32:45.343291] [INFO ] [MAIN ] Update Progress: 1085/2373 symbols completed. IBN took 46.3s. Estimated remaining: 3h 1m 15s. Rate: 7.1 symbols/min [2025-10-10T19:32:45.641569] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:32:45.622595] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:32:45.642276] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-10T19:32:45.642800] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-10T19:32:45.643122] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-10T19:32:45.643183] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-10T19:32:45.900144] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-10T19:32:45.962164] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-10T19:32:45.963837] [DEBUG] [LOCAL ] IDA: Loaded 32825 existing records from primary storage. [2025-10-10T19:32:45.975395] [INFO ] [MAIN ] IDA: Loaded 32825 existing records. [2025-10-10T19:32:46.147320] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:32:46.158579] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-10T19:32:46.239541] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:32:46.239813] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-10T19:32:46.239867] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-10T19:32:46.240055] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-10T19:32:46.240094] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-10T19:32:46.591307] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:32:46.591634] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-10T19:32:46.917437] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T19:32:46.927955] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-10T19:32:47.344154] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T19:32:47.353456] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-10T19:32:47.752570] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T19:32:47.762569] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-10T19:32:47.982740] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T19:32:47.988290] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-10T19:32:48.786586] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T19:32:48.797258] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-10T19:32:48.831043] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-10T19:32:48.839173] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-10T19:32:49.548403] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T19:32:49.558753] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-10T19:32:49.638378] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T19:32:49.645781] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-10T19:32:50.393830] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T19:32:50.405486] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-10T19:32:50.451965] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T19:32:50.689376] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-10T19:32:50.787852] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-10T19:32:50.885842] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T19:32:51.489434] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-10T19:32:52.289379] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-10T19:32:52.413621] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T19:32:52.499321] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-10T19:32:52.526623] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-10T19:32:53.089433] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-10T19:32:53.783912] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T19:32:53.889419] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-10T19:32:54.689372] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-10T19:32:55.204090] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-10T19:32:55.407831] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T19:32:55.489374] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-10T19:32:56.289366] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-10T19:32:56.369201] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-10T19:32:57.070639] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T19:32:57.089329] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-10T19:32:57.889424] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-10T19:32:57.988242] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-10T19:32:58.501720] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T19:32:58.689395] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-10T19:32:59.072679] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-10T19:32:59.489386] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-10T19:33:00.289351] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-10T19:33:00.429416] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-10T19:33:01.089353] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-10T19:33:01.571695] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-10T19:33:01.889450] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-10T19:33:02.689425] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-10T19:33:02.800986] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-10T19:33:02.804856] [INFO ] [REMOTE ] IBTA: Full fetch complete (50893 records). [2025-10-10T19:33:02.804991] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-10T19:33:02.988044] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-10T19:33:03.247330] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-10T19:33:03.247449] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-10T19:33:03.248604] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-10T19:33:03.248698] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-10T19:33:03.250460] [DEBUG] [LOCAL ] IBTA: Trimmed 50893 records to 37604 (keeping 200 days of data) [2025-10-10T19:33:03.493414] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-10T19:33:03.503380] [DEBUG] [LOCAL ] IBTA: Primary data saved (37604 records). [2025-10-10T19:33:03.503567] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-10T19:33:03.503711] [INFO ] [MAIN ] Update Progress: 1086/2373 symbols completed. IBTA took 32.3s. Estimated remaining: 3h 1m 18s. Rate: 7.1 symbols/min [2025-10-10T19:33:03.697223] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:33:03.711590] [DEBUG] [LOCAL ] IDE: Loaded 8984 existing records from primary storage. [2025-10-10T19:33:03.712020] [INFO ] [MAIN ] IDE: Loaded 8984 existing records. [2025-10-10T19:33:03.904743] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:33:03.905353] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-10T19:33:03.905717] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-10T19:33:03.906298] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-10T19:33:03.906377] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-10T19:33:04.262361] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-10T19:33:04.302889] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-10T19:33:04.310730] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-10T19:33:04.388171] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:33:05.089343] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-10T19:33:05.216419] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T19:33:05.889372] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-10T19:33:06.067120] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T19:33:06.689372] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-10T19:33:06.778955] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-10T19:33:06.945719] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-10T19:33:07.489425] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-10T19:33:08.047469] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-10T19:33:08.289412] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-10T19:33:08.417563] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-10T19:33:09.089383] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-10T19:33:09.889411] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-10T19:33:10.364819] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-10T19:33:10.371610] [INFO ] [REMOTE ] ICE: Full fetch complete (76768 records). [2025-10-10T19:33:10.371824] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-10T19:33:10.693300] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T19:33:10.709607] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-10T19:33:10.845237] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-10T19:33:10.845314] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-10T19:33:10.846339] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-10T19:33:10.846401] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-10T19:33:10.847874] [DEBUG] [LOCAL ] ICE: Trimmed 76768 records to 53792 (keeping 200 days of data) [2025-10-10T19:33:11.183938] [DEBUG] [LOCAL ] ICE: Primary data saved (53792 records). [2025-10-10T19:33:11.184072] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-10T19:33:11.184556] [INFO ] [MAIN ] Update Progress: 1087/2373 symbols completed. ICE took 31.1s. Estimated remaining: 3h 1m 9s. Rate: 7.1 symbols/min [2025-10-10T19:33:11.354709] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:33:11.374412] [DEBUG] [LOCAL ] IDT: Loaded 18343 existing records from primary storage. [2025-10-10T19:33:11.374711] [INFO ] [MAIN ] IDT: Loaded 18343 existing records. [2025-10-10T19:33:11.494597] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-10T19:33:11.556887] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:33:11.557231] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-10T19:33:11.557420] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-10T19:33:11.557858] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-10T19:33:11.557915] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-10T19:33:11.663772] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-10T19:33:11.678261] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T19:33:11.960576] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:33:12.289392] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-10T19:33:13.016362] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T19:33:13.089386] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-10T19:33:13.335608] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-10T19:33:13.889436] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-10T19:33:14.611189] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-10T19:33:14.614269] [INFO ] [REMOTE ] IDA: Full fetch complete (45031 records). [2025-10-10T19:33:14.614341] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-10T19:33:14.694583] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-10T19:33:14.990248] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-10T19:33:14.990328] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-10T19:33:14.991032] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-10T19:33:14.991095] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-10T19:33:14.992199] [DEBUG] [LOCAL ] IDA: Trimmed 45031 records to 33044 (keeping 200 days of data) [2025-10-10T19:33:15.216076] [DEBUG] [LOCAL ] IDA: Primary data saved (33044 records). [2025-10-10T19:33:15.216232] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-10T19:33:15.216358] [INFO ] [MAIN ] Update Progress: 1088/2373 symbols completed. IDA took 29.9s. Estimated remaining: 3h 0m 55s. Rate: 7.1 symbols/min [2025-10-10T19:33:15.396787] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:33:15.419410] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-10T19:33:15.463709] [DEBUG] [LOCAL ] IEX: Loaded 38578 existing records from primary storage. [2025-10-10T19:33:15.464007] [INFO ] [MAIN ] IEX: Loaded 38578 existing records. [2025-10-10T19:33:15.494693] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-10T19:33:15.646218] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:33:15.646563] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-10T19:33:15.646618] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-10T19:33:15.646947] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-10T19:33:15.647005] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-10T19:33:15.754280] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-10T19:33:16.018604] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:33:16.146138] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-10T19:33:16.289401] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-10T19:33:17.089377] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-10T19:33:17.186514] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T19:33:17.889417] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-10T19:33:18.032836] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-10T19:33:18.689383] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-10T19:33:19.340580] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-10T19:33:19.489393] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-10T19:33:19.566763] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-10T19:33:20.289435] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-10T19:33:21.049367] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-10T19:33:21.053183] [INFO ] [REMOTE ] ICL: Full fetch complete (55931 records). [2025-10-10T19:33:21.053323] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-10T19:33:21.099385] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-10T19:33:21.268924] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T19:33:21.482140] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-10T19:33:21.482236] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-10T19:33:21.483139] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-10T19:33:21.483207] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-10T19:33:21.484588] [DEBUG] [LOCAL ] ICL: Trimmed 55931 records to 39002 (keeping 200 days of data) [2025-10-10T19:33:21.708594] [DEBUG] [LOCAL ] ICL: Primary data saved (39002 records). [2025-10-10T19:33:21.708772] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-10T19:33:21.708866] [INFO ] [MAIN ] Update Progress: 1089/2373 symbols completed. ICL took 36.9s. Estimated remaining: 3h 0m 45s. Rate: 7.1 symbols/min [2025-10-10T19:33:21.902416] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-10T19:33:21.905364] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:33:21.953666] [DEBUG] [LOCAL ] IFF: Loaded 51422 existing records from primary storage. [2025-10-10T19:33:21.954015] [INFO ] [MAIN ] IFF: Loaded 51422 existing records. [2025-10-10T19:33:22.133927] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:33:22.134187] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-10T19:33:22.134244] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-10T19:33:22.134446] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-10T19:33:22.134501] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-10T19:33:22.505083] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:33:22.689402] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-10T19:33:22.775584] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-10T19:33:22.814947] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-10T19:33:23.494521] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-10T19:33:23.504034] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-10T19:33:24.289494] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-10T19:33:25.089491] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-10T19:33:25.303349] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T19:33:25.455452] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-10T19:33:25.595417] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-10T19:33:25.889367] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-10T19:33:26.689371] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-10T19:33:27.489397] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-10T19:33:27.687487] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T19:33:27.756399] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-10T19:33:28.289396] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-10T19:33:29.089353] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-10T19:33:29.163726] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-10T19:33:29.497308] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-10T19:33:29.889375] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-10T19:33:30.589214] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-10T19:33:30.689369] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-10T19:33:31.395317] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-10T19:33:31.489391] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-10T19:33:32.289368] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-10T19:33:32.647791] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T19:33:33.089414] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-10T19:33:33.131555] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-10T19:33:33.575635] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T19:33:33.889380] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-10T19:33:34.592031] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-10T19:33:34.689339] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-10T19:33:35.058535] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T19:33:35.489375] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-10T19:33:35.603922] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T19:33:35.605438] [INFO ] [REMOTE ] IDE: Full fetch complete (12691 records). [2025-10-10T19:33:35.605514] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-10T19:33:36.003509] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-10T19:33:36.003620] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-10T19:33:36.004006] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-10T19:33:36.004095] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-10T19:33:36.004847] [DEBUG] [LOCAL ] IDE: Trimmed 12691 records to 9136 (keeping 200 days of data) [2025-10-10T19:33:36.060205] [DEBUG] [LOCAL ] IDE: Primary data saved (9136 records). [2025-10-10T19:33:36.060346] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-10T19:33:36.060440] [INFO ] [MAIN ] Update Progress: 1090/2373 symbols completed. IDE took 32.6s. Estimated remaining: 3h 0m 43s. Rate: 7.1 symbols/min [2025-10-10T19:33:36.229417] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:33:36.248491] [DEBUG] [LOCAL ] IFN: Loaded 18452 existing records from primary storage. [2025-10-10T19:33:36.248757] [INFO ] [MAIN ] IFN: Loaded 18452 existing records. [2025-10-10T19:33:36.290561] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-10T19:33:36.430959] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:33:36.431405] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-10T19:33:36.431527] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-10T19:33:36.431773] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-10T19:33:36.431832] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-10T19:33:36.563849] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-10T19:33:36.818861] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:33:37.089386] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-10T19:33:37.889358] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-10T19:33:38.217062] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-10T19:33:38.354270] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T19:33:38.689367] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-10T19:33:39.489390] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-10T19:33:39.703369] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T19:33:40.242466] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T19:33:40.289337] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-10T19:33:40.802259] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T19:33:41.089446] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-10T19:33:41.889363] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-10T19:33:42.284067] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T19:33:42.314955] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-10T19:33:42.689370] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-10T19:33:43.489361] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-10T19:33:43.544110] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-10T19:33:44.169281] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-10T19:33:44.289350] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-10T19:33:44.716764] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-10T19:33:44.719889] [INFO ] [REMOTE ] IDT: Full fetch complete (23539 records). [2025-10-10T19:33:44.720015] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-10T19:33:45.091178] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-10T19:33:45.092193] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-10T19:33:45.092250] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-10T19:33:45.092766] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-10T19:33:45.092923] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-10T19:33:45.093902] [DEBUG] [LOCAL ] IDT: Trimmed 23539 records to 18518 (keeping 200 days of data) [2025-10-10T19:33:45.205752] [DEBUG] [LOCAL ] IDT: Primary data saved (18518 records). [2025-10-10T19:33:45.205860] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-10T19:33:45.205937] [INFO ] [MAIN ] Update Progress: 1091/2373 symbols completed. IDT took 34.0s. Estimated remaining: 3h 0m 36s. Rate: 7.1 symbols/min [2025-10-10T19:33:45.374292] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:33:45.396035] [DEBUG] [LOCAL ] IFS: Loaded 23061 existing records from primary storage. [2025-10-10T19:33:45.396269] [INFO ] [MAIN ] IFS: Loaded 23061 existing records. [2025-10-10T19:33:45.568310] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:33:45.568559] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-10T19:33:45.568617] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-10T19:33:45.569215] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-10T19:33:45.569272] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-10T19:33:45.799715] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-10T19:33:45.899384] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-10T19:33:45.939154] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:33:46.689363] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-10T19:33:47.066399] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-10T19:33:47.196114] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T19:33:47.476121] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-10T19:33:47.489361] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-10T19:33:48.289380] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-10T19:33:48.608458] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-10T19:33:49.089422] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-10T19:33:49.889373] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-10T19:33:49.951545] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T19:33:50.037932] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-10T19:33:50.689365] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-10T19:33:51.489405] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-10T19:33:52.227412] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-10T19:33:52.289337] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-10T19:33:52.424051] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-10T19:33:52.802252] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T19:33:53.089391] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-10T19:33:53.708524] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-10T19:33:53.714636] [INFO ] [REMOTE ] IFF: Full fetch complete (73216 records). [2025-10-10T19:33:53.714849] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-10T19:33:53.896289] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-10T19:33:54.155379] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-10T19:33:54.155501] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-10T19:33:54.156785] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-10T19:33:54.156910] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-10T19:33:54.158788] [DEBUG] [LOCAL ] IFF: Trimmed 73216 records to 51808 (keeping 200 days of data) [2025-10-10T19:33:54.288150] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T19:33:54.518361] [DEBUG] [LOCAL ] IFF: Primary data saved (51808 records). [2025-10-10T19:33:54.518501] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-10T19:33:54.518581] [INFO ] [MAIN ] Update Progress: 1092/2373 symbols completed. IFF took 32.8s. Estimated remaining: 3h 0m 28s. Rate: 7.1 symbols/min [2025-10-10T19:33:54.688670] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:33:54.689385] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-10T19:33:54.700945] [DEBUG] [LOCAL ] IGA: Loaded 10089 existing records from primary storage. [2025-10-10T19:33:54.701186] [INFO ] [MAIN ] IGA: Loaded 10089 existing records. [2025-10-10T19:33:54.875980] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:33:54.876226] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-10T19:33:54.876273] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-10T19:33:54.876423] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-10T19:33:54.876459] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-10T19:33:55.240543] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:33:55.402596] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-10T19:33:55.489426] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-10T19:33:56.264780] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T19:33:56.273281] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-10T19:33:56.273082] [INFO ] [REMOTE ] IEX: Full fetch complete (53409 records). [2025-10-10T19:33:56.273471] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-10T19:33:56.295985] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-10T19:33:56.664055] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-10T19:33:56.664174] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-10T19:33:56.665450] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-10T19:33:56.665522] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-10T19:33:56.667302] [DEBUG] [LOCAL ] IEX: Trimmed 53409 records to 38845 (keeping 200 days of data) [2025-10-10T19:33:56.933463] [DEBUG] [LOCAL ] IEX: Primary data saved (38845 records). [2025-10-10T19:33:56.933693] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-10T19:33:56.933852] [INFO ] [MAIN ] Update Progress: 1093/2373 symbols completed. IEX took 41.7s. Estimated remaining: 3h 0m 13s. Rate: 7.1 symbols/min [2025-10-10T19:33:57.094883] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-10T19:33:57.117343] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:33:57.141208] [DEBUG] [LOCAL ] IGD: Loaded 19396 existing records from primary storage. [2025-10-10T19:33:57.141537] [INFO ] [MAIN ] IGD: Loaded 19396 existing records. [2025-10-10T19:33:57.328871] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:33:57.329209] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-10T19:33:57.329317] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-10T19:33:57.329586] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-10T19:33:57.329671] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-10T19:33:57.724686] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:33:57.879551] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T19:33:57.889353] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-10T19:33:58.035221] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-10T19:33:58.689423] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-10T19:33:59.156973] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-10T19:33:59.489365] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-10T19:34:00.070793] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T19:34:00.289388] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-10T19:34:00.754510] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-10T19:34:01.089436] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-10T19:34:01.310575] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-10T19:34:01.889449] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-10T19:34:02.048496] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-10T19:34:02.689403] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-10T19:34:03.112119] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-10T19:34:03.489436] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-10T19:34:03.610958] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-10T19:34:04.289412] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-10T19:34:04.653573] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T19:34:05.089393] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-10T19:34:05.643926] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T19:34:05.889353] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-10T19:34:05.946561] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-10T19:34:06.689379] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-10T19:34:07.168970] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T19:34:07.489380] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-10T19:34:07.943566] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-10T19:34:08.053792] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-10T19:34:08.289412] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-10T19:34:09.089404] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-10T19:34:09.451808] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-10T19:34:09.889369] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-10T19:34:10.308848] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T19:34:10.676766] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-10T19:34:10.678845] [INFO ] [REMOTE ] IFN: Full fetch complete (28648 records). [2025-10-10T19:34:10.678917] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-10T19:34:10.699212] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-10T19:34:11.044576] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-10T19:34:11.044677] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-10T19:34:11.045239] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-10T19:34:11.045280] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-10T19:34:11.045949] [DEBUG] [LOCAL ] IFN: Trimmed 28648 records to 18563 (keeping 200 days of data) [2025-10-10T19:34:11.158326] [DEBUG] [LOCAL ] IFN: Primary data saved (18563 records). [2025-10-10T19:34:11.158476] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-10T19:34:11.158560] [INFO ] [MAIN ] Update Progress: 1094/2373 symbols completed. IFN took 35.1s. Estimated remaining: 3h 0m 11s. Rate: 7.1 symbols/min [2025-10-10T19:34:11.323708] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:34:11.330314] [DEBUG] [LOCAL ] IGI: Loaded 3844 existing records from primary storage. [2025-10-10T19:34:11.330504] [INFO ] [MAIN ] IGI: Loaded 3844 existing records. [2025-10-10T19:34:11.503327] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-10T19:34:11.508289] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:34:11.508514] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-10T19:34:11.509302] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-10T19:34:11.509546] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-10T19:34:11.509613] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-10T19:34:11.882343] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:34:11.964858] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-10T19:34:12.289376] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-10T19:34:12.756596] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-10T19:34:12.759054] [INFO ] [REMOTE ] IFS: Full fetch complete (31824 records). [2025-10-10T19:34:12.759129] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-10T19:34:13.115581] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-10T19:34:13.129361] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-10T19:34:13.129446] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-10T19:34:13.130105] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-10T19:34:13.130168] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-10T19:34:13.130999] [DEBUG] [LOCAL ] IFS: Trimmed 31824 records to 23218 (keeping 200 days of data) [2025-10-10T19:34:13.263738] [DEBUG] [LOCAL ] IFS: Primary data saved (23218 records). [2025-10-10T19:34:13.263872] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-10T19:34:13.263953] [INFO ] [MAIN ] Update Progress: 1095/2373 symbols completed. IFS took 28.1s. Estimated remaining: 2h 59m 55s. Rate: 7.1 symbols/min [2025-10-10T19:34:13.432859] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:34:13.463676] [DEBUG] [LOCAL ] IGR: Loaded 30591 existing records from primary storage. [2025-10-10T19:34:13.463952] [INFO ] [MAIN ] IGR: Loaded 30591 existing records. [2025-10-10T19:34:13.602137] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T19:34:13.666772] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:34:13.666989] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-10T19:34:13.667040] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-10T19:34:13.667286] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-10T19:34:13.667324] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-10T19:34:13.895295] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-10T19:34:14.021632] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:34:14.031750] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-10T19:34:14.689388] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-10T19:34:14.935327] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-10T19:34:15.442547] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-10T19:34:15.489371] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-10T19:34:16.289384] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-10T19:34:16.492908] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-10T19:34:17.089450] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-10T19:34:17.515781] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-10T19:34:17.530184] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-10T19:34:17.889428] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-10T19:34:18.689380] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-10T19:34:19.192067] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-10T19:34:19.205463] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-10T19:34:19.489404] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-10T19:34:20.289400] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-10T19:34:20.765543] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-10T19:34:21.089389] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-10T19:34:21.196443] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T19:34:21.835555] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-10T19:34:21.889451] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-10T19:34:22.429870] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-10T19:34:22.689378] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-10T19:34:23.224010] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-10T19:34:23.489415] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-10T19:34:24.289384] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-10T19:34:25.089383] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-10T19:34:25.440808] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T19:34:25.459287] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T19:34:25.889382] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-10T19:34:26.012133] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-10T19:34:26.689375] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-10T19:34:27.489339] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-10T19:34:27.616339] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T19:34:27.813991] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T19:34:27.900045] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-10T19:34:28.289373] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-10T19:34:29.089376] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-10T19:34:29.250124] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T19:34:29.251712] [INFO ] [REMOTE ] IGA: Full fetch complete (13936 records). [2025-10-10T19:34:29.251781] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-10T19:34:29.611749] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-10T19:34:29.612421] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-10T19:34:29.612262] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-10T19:34:29.614724] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-10T19:34:29.614785] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-10T19:34:29.615252] [DEBUG] [LOCAL ] IGA: Trimmed 13936 records to 10174 (keeping 200 days of data) [2025-10-10T19:34:29.676226] [DEBUG] [LOCAL ] IGA: Primary data saved (10174 records). [2025-10-10T19:34:29.676375] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-10T19:34:29.676462] [INFO ] [MAIN ] Update Progress: 1096/2373 symbols completed. IGA took 35.2s. Estimated remaining: 2h 59m 56s. Rate: 7.1 symbols/min [2025-10-10T19:34:29.842099] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:34:29.847280] [DEBUG] [LOCAL ] IH: Loaded 2870 existing records from primary storage. [2025-10-10T19:34:29.847469] [INFO ] [MAIN ] IH: Loaded 2870 existing records. [2025-10-10T19:34:29.894675] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-10T19:34:30.026213] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:34:30.026384] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-10T19:34:30.026432] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-10T19:34:30.026573] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-10T19:34:30.026629] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-10T19:34:30.398909] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:34:30.659530] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T19:34:30.689332] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-10T19:34:31.402511] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-10T19:34:31.489395] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-10T19:34:32.088471] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-10T19:34:32.089689] [INFO ] [REMOTE ] IGI: Full fetch complete (5419 records). [2025-10-10T19:34:32.089758] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-10T19:34:32.294549] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-10T19:34:32.445484] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-10T19:34:32.445604] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-10T19:34:32.445817] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-10T19:34:32.445913] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-10T19:34:32.446281] [DEBUG] [LOCAL ] IGI: Trimmed 5419 records to 3893 (keeping 200 days of data) [2025-10-10T19:34:32.470033] [DEBUG] [LOCAL ] IGI: Primary data saved (3893 records). [2025-10-10T19:34:32.470100] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-10T19:34:32.470171] [INFO ] [MAIN ] Update Progress: 1097/2373 symbols completed. IGI took 21.3s. Estimated remaining: 2h 59m 41s. Rate: 7.1 symbols/min [2025-10-10T19:34:32.635482] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:34:32.645465] [DEBUG] [LOCAL ] IHD: Loaded 7145 existing records from primary storage. [2025-10-10T19:34:32.645691] [INFO ] [MAIN ] IHD: Loaded 7145 existing records. [2025-10-10T19:34:32.820701] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:34:32.820861] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-10T19:34:32.820910] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-10T19:34:32.821042] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-10T19:34:32.821079] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-10T19:34:33.091481] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-10T19:34:33.169228] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:34:33.496188] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T19:34:33.498771] [INFO ] [REMOTE ] IGD: Full fetch complete (29860 records). [2025-10-10T19:34:33.498848] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-10T19:34:33.786940] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-10T19:34:33.869041] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-10T19:34:33.869104] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-10T19:34:33.869670] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-10T19:34:33.869731] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-10T19:34:33.870407] [DEBUG] [LOCAL ] IGD: Trimmed 29860 records to 19633 (keeping 200 days of data) [2025-10-10T19:34:33.918945] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-10T19:34:33.986009] [DEBUG] [LOCAL ] IGD: Primary data saved (19633 records). [2025-10-10T19:34:33.986128] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-10T19:34:33.986204] [INFO ] [MAIN ] Update Progress: 1098/2373 symbols completed. IGD took 37.1s. Estimated remaining: 2h 59m 24s. Rate: 7.1 symbols/min [2025-10-10T19:34:34.153884] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:34:34.178721] [DEBUG] [LOCAL ] IHG: Loaded 24344 existing records from primary storage. [2025-10-10T19:34:34.178999] [INFO ] [MAIN ] IHG: Loaded 24344 existing records. [2025-10-10T19:34:34.358146] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:34:34.358386] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-10T19:34:34.358438] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-10T19:34:34.358613] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-10T19:34:34.358687] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-10T19:34:34.515192] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-10T19:34:34.695364] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-10T19:34:34.725484] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:34:35.434884] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-10T19:34:35.489376] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-10T19:34:36.289369] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-10T19:34:37.010747] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T19:34:37.089350] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-10T19:34:37.400522] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-10T19:34:37.889376] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-10T19:34:38.291810] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-10T19:34:38.689361] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-10T19:34:38.838010] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-10T19:34:39.489402] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-10T19:34:40.095447] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-10T19:34:40.188665] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T19:34:40.289400] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-10T19:34:41.089380] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-10T19:34:41.245120] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-10T19:34:41.889427] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-10T19:34:42.583487] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T19:34:42.637993] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-10T19:34:42.689392] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-10T19:34:43.489411] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-10T19:34:44.176990] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-10T19:34:44.289387] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-10T19:34:44.362686] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-10T19:34:45.089372] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-10T19:34:45.777728] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-10T19:34:45.889369] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-10T19:34:45.986086] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-10T19:34:46.689366] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-10T19:34:47.366639] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-10T19:34:47.489349] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-10T19:34:47.580760] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-10T19:34:48.289387] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-10T19:34:49.078247] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-10T19:34:49.093921] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-10T19:34:49.097708] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-10T19:34:49.642111] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-10T19:34:49.889392] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-10T19:34:50.689366] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-10T19:34:50.695968] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-10T19:34:51.489435] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-10T19:34:52.138337] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-10T19:34:52.289408] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-10T19:34:52.990508] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-10T19:34:53.089338] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-10T19:34:53.658473] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T19:34:53.889393] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-10T19:34:54.051442] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-10T19:34:54.541371] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-10T19:34:54.689380] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-10T19:34:55.264537] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-10T19:34:55.489473] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-10T19:34:56.289439] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-10T19:34:57.089465] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-10T19:34:57.127053] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T19:34:57.230264] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-10T19:34:57.813848] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-10T19:34:57.889390] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-10T19:34:58.689366] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-10T19:34:59.320915] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-10T19:34:59.385044] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-10T19:34:59.489379] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-10T19:35:00.218150] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T19:35:00.218971] [INFO ] [REMOTE ] IH: Full fetch complete (4982 records). [2025-10-10T19:35:00.219039] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-10T19:35:00.294557] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-10T19:35:00.586894] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-10T19:35:00.586996] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-10T19:35:00.587187] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-10T19:35:00.587228] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-10T19:35:00.587584] [DEBUG] [LOCAL ] IH: Trimmed 4982 records to 2888 (keeping 200 days of data) [2025-10-10T19:35:00.603936] [DEBUG] [LOCAL ] IH: Primary data saved (2888 records). [2025-10-10T19:35:00.604004] [INFO ] [MAIN ] IH: Full history saved. [2025-10-10T19:35:00.604110] [INFO ] [MAIN ] Update Progress: 1099/2373 symbols completed. IH took 30.9s. Estimated remaining: 2h 59m 37s. Rate: 7.1 symbols/min [2025-10-10T19:35:00.778836] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:35:00.814888] [DEBUG] [LOCAL ] IHS: Loaded 38498 existing records from primary storage. [2025-10-10T19:35:00.815195] [INFO ] [MAIN ] IHS: Loaded 38498 existing records. [2025-10-10T19:35:00.988116] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:35:00.988323] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-10T19:35:00.988369] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-10T19:35:00.988599] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-10T19:35:00.988690] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-10T19:35:01.091072] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-10T19:35:01.371736] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:35:01.889396] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-10T19:35:02.057391] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-10T19:35:02.206520] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-10T19:35:02.689378] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-10T19:35:03.489439] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-10T19:35:03.693888] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T19:35:03.776283] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T19:35:03.778216] [INFO ] [REMOTE ] IHD: Full fetch complete (11893 records). [2025-10-10T19:35:03.778289] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-10T19:35:04.136290] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-10T19:35:04.136389] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-10T19:35:04.136807] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-10T19:35:04.136912] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-10T19:35:04.137354] [DEBUG] [LOCAL ] IHD: Trimmed 11893 records to 7240 (keeping 200 days of data) [2025-10-10T19:35:04.179475] [DEBUG] [LOCAL ] IHD: Primary data saved (7240 records). [2025-10-10T19:35:04.179593] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-10T19:35:04.179700] [INFO ] [MAIN ] Update Progress: 1100/2373 symbols completed. IHD took 31.7s. Estimated remaining: 2h 59m 23s. Rate: 7.1 symbols/min [2025-10-10T19:35:04.294605] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-10T19:35:04.371521] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:35:04.382267] [DEBUG] [LOCAL ] IIF: Loaded 5676 existing records from primary storage. [2025-10-10T19:35:04.382603] [INFO ] [MAIN ] IIF: Loaded 5676 existing records. [2025-10-10T19:35:04.566467] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:35:04.566981] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-10T19:35:04.567038] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-10T19:35:04.567210] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-10T19:35:04.567266] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-10T19:35:04.849900] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-10T19:35:04.874327] [INFO ] [REMOTE ] IGR: Full fetch complete (45083 records). [2025-10-10T19:35:04.892669] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-10T19:35:05.001386] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:35:05.104789] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-10T19:35:05.383361] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-10T19:35:05.383492] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-10T19:35:05.384293] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-10T19:35:05.384359] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-10T19:35:05.385541] [DEBUG] [LOCAL ] IGR: Trimmed 45083 records to 30825 (keeping 200 days of data) [2025-10-10T19:35:05.583737] [DEBUG] [LOCAL ] IGR: Primary data saved (30825 records). [2025-10-10T19:35:05.584094] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-10T19:35:05.584203] [INFO ] [MAIN ] Update Progress: 1101/2373 symbols completed. IGR took 52.3s. Estimated remaining: 2h 59m 6s. Rate: 7.1 symbols/min [2025-10-10T19:35:05.806087] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:35:05.807418] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T19:35:05.807705] [DEBUG] [LOCAL ] IIIN: No existing data file found in primary storage. [2025-10-10T19:35:05.814370] [WARN ] [MAIN ] IIIN: No existing data found, performing full refresh instead. [2025-10-10T19:35:05.815222] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-10T19:35:05.815269] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-10T19:35:05.815315] [DEBUG] [LOCAL ] IIIN: No primary data file found to delete. [2025-10-10T19:35:05.815350] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-10T19:35:05.894668] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-10T19:35:06.232731] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:35:06.613037] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-10T19:35:06.689329] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-10T19:35:07.225852] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T19:35:07.489500] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-10T19:35:07.491008] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-10T19:35:08.289423] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-10T19:35:09.089433] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-10T19:35:09.148311] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T19:35:09.230105] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-10T19:35:09.889424] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-10T19:35:10.276712] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T19:35:10.689386] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-10T19:35:11.494559] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-10T19:35:11.506152] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-10T19:35:11.985489] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T19:35:12.289438] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-10T19:35:12.753834] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T19:35:13.089386] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-10T19:35:13.209183] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T19:35:13.211661] [INFO ] [REMOTE ] IHG: Full fetch complete (33750 records). [2025-10-10T19:35:13.211753] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-10T19:35:13.601851] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-10T19:35:13.602019] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-10T19:35:13.602711] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-10T19:35:13.602790] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-10T19:35:13.610468] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-10T19:35:13.613834] [DEBUG] [LOCAL ] IHG: Trimmed 33750 records to 24505 (keeping 200 days of data) [2025-10-10T19:35:13.764886] [DEBUG] [LOCAL ] IHG: Primary data saved (24505 records). [2025-10-10T19:35:13.765017] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-10T19:35:13.765099] [INFO ] [MAIN ] Update Progress: 1102/2373 symbols completed. IHG took 39.8s. Estimated remaining: 2h 58m 57s. Rate: 7.1 symbols/min [2025-10-10T19:35:13.894460] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-10T19:35:13.948939] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:35:13.966732] [DEBUG] [LOCAL ] IIM: Loaded 15957 existing records from primary storage. [2025-10-10T19:35:13.966976] [INFO ] [MAIN ] IIM: Loaded 15957 existing records. [2025-10-10T19:35:14.156102] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:35:14.156341] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-10T19:35:14.156388] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-10T19:35:14.156637] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-10T19:35:14.156731] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-10T19:35:14.531118] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:35:14.689358] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-10T19:35:14.836794] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-10T19:35:15.489355] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-10T19:35:16.144557] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-10T19:35:16.289408] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-10T19:35:17.089411] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-10T19:35:17.278670] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T19:35:17.635537] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T19:35:17.889335] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-10T19:35:18.102870] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-10T19:35:18.689419] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-10T19:35:19.489352] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-10T19:35:19.648789] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-10T19:35:19.648515] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T19:35:20.289405] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-10T19:35:20.750074] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T19:35:21.089418] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-10T19:35:21.894492] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-10T19:35:21.908432] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T19:35:22.324920] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T19:35:22.653091] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-10T19:35:22.689396] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-10T19:35:23.489372] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-10T19:35:24.295165] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-10T19:35:24.306186] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-10T19:35:24.794775] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T19:35:25.079691] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-10T19:35:25.089433] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-10T19:35:25.889428] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-10T19:35:26.585152] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-10T19:35:26.689413] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-10T19:35:27.137198] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T19:35:27.489393] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-10T19:35:27.907317] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-10T19:35:28.289380] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-10T19:35:29.039914] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-10T19:35:29.043046] [INFO ] [REMOTE ] IHS: Full fetch complete (51506 records). [2025-10-10T19:35:29.043247] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-10T19:35:29.097371] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-10T19:35:29.425600] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-10T19:35:29.425705] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-10T19:35:29.426472] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-10T19:35:29.426532] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-10T19:35:29.427870] [DEBUG] [LOCAL ] IHS: Trimmed 51506 records to 38726 (keeping 200 days of data) [2025-10-10T19:35:29.523222] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-10T19:35:29.658724] [DEBUG] [LOCAL ] IHS: Primary data saved (38726 records). [2025-10-10T19:35:29.658880] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-10T19:35:29.658971] [INFO ] [MAIN ] Update Progress: 1103/2373 symbols completed. IHS took 29.1s. Estimated remaining: 2h 58m 58s. Rate: 7.1 symbols/min [2025-10-10T19:35:29.825292] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:35:29.854902] [DEBUG] [LOCAL ] IIPR: Loaded 29611 existing records from primary storage. [2025-10-10T19:35:29.855177] [INFO ] [MAIN ] IIPR: Loaded 29611 existing records. [2025-10-10T19:35:29.896052] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-10T19:35:30.046086] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-10T19:35:30.051234] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:35:30.053292] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-10T19:35:30.053397] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-10T19:35:30.054409] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-10T19:35:30.054469] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-10T19:35:30.398610] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:35:30.689339] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-10T19:35:31.119518] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T19:35:31.447455] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-10T19:35:31.489343] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-10T19:35:32.289393] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-10T19:35:32.650699] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-10T19:35:33.089388] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-10T19:35:33.798922] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-10T19:35:33.875466] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T19:35:33.889343] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-10T19:35:34.689430] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-10T19:35:35.489379] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-10T19:35:35.624332] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T19:35:35.939275] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-10T19:35:36.143238] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-10T19:35:36.289374] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-10T19:35:37.089421] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-10T19:35:37.465830] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-10T19:35:37.593048] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-10T19:35:37.593924] [INFO ] [REMOTE ] IIF: Full fetch complete (9126 records). [2025-10-10T19:35:37.594006] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-10T19:35:37.894472] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-10T19:35:37.979965] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-10T19:35:37.980068] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-10T19:35:37.980391] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-10T19:35:37.980471] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-10T19:35:37.981276] [DEBUG] [LOCAL ] IIF: Trimmed 9126 records to 5698 (keeping 200 days of data) [2025-10-10T19:35:38.021540] [DEBUG] [LOCAL ] IIF: Primary data saved (5698 records). [2025-10-10T19:35:38.021816] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-10T19:35:38.021939] [INFO ] [MAIN ] Update Progress: 1104/2373 symbols completed. IIF took 33.8s. Estimated remaining: 2h 58m 49s. Rate: 7.1 symbols/min [2025-10-10T19:35:38.241425] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:35:38.285550] [DEBUG] [LOCAL ] IMAX: Loaded 43236 existing records from primary storage. [2025-10-10T19:35:38.286113] [INFO ] [MAIN ] IMAX: Loaded 43236 existing records. [2025-10-10T19:35:38.475163] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:35:38.475367] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-10T19:35:38.475428] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-10T19:35:38.475731] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-10T19:35:38.475803] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-10T19:35:38.694531] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-10T19:35:38.834388] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:35:39.170952] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T19:35:39.489397] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-10T19:35:39.886957] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T19:35:40.289385] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-10T19:35:41.089352] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-10T19:35:41.141238] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-10T19:35:41.894458] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-10T19:35:41.907115] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T19:35:42.018100] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T19:35:42.689348] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-10T19:35:43.489363] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-10T19:35:43.654281] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T19:35:44.251974] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-10T19:35:44.289359] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-10T19:35:44.542422] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-10T19:35:45.089378] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-10T19:35:45.820245] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-10T19:35:45.835873] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-10T19:35:45.889380] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-10T19:35:46.689383] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-10T19:35:46.888557] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T19:35:46.890131] [INFO ] [REMOTE ] IIIN: Full fetch complete (24468 records). [2025-10-10T19:35:46.890199] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-10T19:35:47.278683] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-10T19:35:47.278769] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-10T19:35:47.279331] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-10T19:35:47.279405] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-10T19:35:47.280098] [DEBUG] [LOCAL ] IIIN: Trimmed 24468 records to 16292 (keeping 200 days of data) [2025-10-10T19:35:47.379114] [DEBUG] [LOCAL ] IIIN: Primary data saved (16292 records). [2025-10-10T19:35:47.379256] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-10T19:35:47.379346] [INFO ] [MAIN ] Update Progress: 1105/2373 symbols completed. IIIN took 41.8s. Estimated remaining: 2h 58m 42s. Rate: 7.1 symbols/min [2025-10-10T19:35:47.494521] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-10T19:35:47.562991] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:35:47.607825] [DEBUG] [LOCAL ] INFA: Loaded 49552 existing records from primary storage. [2025-10-10T19:35:47.608136] [INFO ] [MAIN ] INFA: Loaded 49552 existing records. [2025-10-10T19:35:47.785503] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:35:47.785922] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-10T19:35:47.785997] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-10T19:35:47.786343] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-10T19:35:47.786401] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-10T19:35:47.920239] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-10T19:35:48.160873] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:35:48.289346] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-10T19:35:48.669592] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T19:35:49.089374] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-10T19:35:49.809587] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T19:35:49.889436] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-10T19:35:50.689457] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-10T19:35:50.784302] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T19:35:51.053420] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-10T19:35:51.489421] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-10T19:35:52.167060] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-10T19:35:52.289371] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-10T19:35:53.089377] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-10T19:35:53.272635] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T19:35:53.826585] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-10T19:35:53.889381] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-10T19:35:54.244335] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-10T19:35:54.246351] [INFO ] [REMOTE ] IIM: Full fetch complete (25339 records). [2025-10-10T19:35:54.246420] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-10T19:35:54.605473] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-10T19:35:54.605552] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-10T19:35:54.606092] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-10T19:35:54.606154] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-10T19:35:54.606934] [DEBUG] [LOCAL ] IIM: Trimmed 25339 records to 16054 (keeping 200 days of data) [2025-10-10T19:35:54.689404] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-10T19:35:54.711406] [DEBUG] [LOCAL ] IIM: Primary data saved (16054 records). [2025-10-10T19:35:54.711573] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-10T19:35:54.712092] [INFO ] [MAIN ] Update Progress: 1106/2373 symbols completed. IIM took 40.9s. Estimated remaining: 2h 58m 32s. Rate: 7.1 symbols/min [2025-10-10T19:35:54.898259] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:35:54.951796] [DEBUG] [LOCAL ] INFY: Loaded 53984 existing records from primary storage. [2025-10-10T19:35:54.952116] [INFO ] [MAIN ] INFY: Loaded 53984 existing records. [2025-10-10T19:35:55.131872] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:35:55.132329] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-10T19:35:55.132440] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-10T19:35:55.132865] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-10T19:35:55.132966] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-10T19:35:55.470080] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-10T19:35:55.490913] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-10T19:35:55.545443] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:35:56.289347] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-10T19:35:56.763220] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-10T19:35:56.966263] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-10T19:35:57.089341] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-10T19:35:57.889343] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-10T19:35:57.977359] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T19:35:58.564125] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-10T19:35:58.689344] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-10T19:35:59.237821] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-10T19:35:59.489360] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-10T19:36:00.076951] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-10T19:36:00.080158] [INFO ] [REMOTE ] IIPR: Full fetch complete (44598 records). [2025-10-10T19:36:00.080240] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-10T19:36:00.300487] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-10T19:36:00.462528] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-10T19:36:00.462609] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-10T19:36:00.463356] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-10T19:36:00.463418] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-10T19:36:00.464432] [DEBUG] [LOCAL ] IIPR: Trimmed 44598 records to 29852 (keeping 200 days of data) [2025-10-10T19:36:00.649735] [DEBUG] [LOCAL ] IIPR: Primary data saved (29852 records). [2025-10-10T19:36:00.649892] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-10T19:36:00.650001] [INFO ] [MAIN ] Update Progress: 1107/2373 symbols completed. IIPR took 31.0s. Estimated remaining: 2h 58m 21s. Rate: 7.1 symbols/min [2025-10-10T19:36:00.825054] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:36:00.873506] [DEBUG] [LOCAL ] ING: Loaded 51085 existing records from primary storage. [2025-10-10T19:36:00.873859] [INFO ] [MAIN ] ING: Loaded 51085 existing records. [2025-10-10T19:36:01.052712] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:36:01.052924] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-10T19:36:01.052972] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-10T19:36:01.053202] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-10T19:36:01.053258] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-10T19:36:01.118563] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-10T19:36:01.429268] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:36:01.462574] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T19:36:01.889386] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-10T19:36:02.234529] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T19:36:02.689362] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-10T19:36:03.158177] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-10T19:36:03.489357] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-10T19:36:04.148811] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-10T19:36:04.289354] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-10T19:36:04.461579] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T19:36:05.089401] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-10T19:36:05.507636] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T19:36:05.889424] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-10T19:36:05.955203] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-10T19:36:06.700484] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-10T19:36:06.705918] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T19:36:07.306751] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T19:36:07.489374] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-10T19:36:08.289363] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-10T19:36:08.899571] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-10T19:36:09.089371] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-10T19:36:09.504335] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-10T19:36:09.889362] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-10T19:36:10.067843] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T19:36:10.689357] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-10T19:36:11.033909] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-10T19:36:11.489359] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-10T19:36:11.774169] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T19:36:12.289384] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-10T19:36:12.868565] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-10T19:36:13.089351] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-10T19:36:13.429351] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T19:36:13.889375] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-10T19:36:14.395567] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-10T19:36:14.689359] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-10T19:36:15.090343] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T19:36:15.210844] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-10T19:36:15.489395] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-10T19:36:16.289441] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-10T19:36:16.355112] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-10T19:36:16.360082] [INFO ] [REMOTE ] IMAX: Full fetch complete (60227 records). [2025-10-10T19:36:16.360380] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-10T19:36:16.755843] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-10T19:36:16.755937] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-10T19:36:16.756842] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-10T19:36:16.756907] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-10T19:36:16.758293] [DEBUG] [LOCAL ] IMAX: Trimmed 60227 records to 43577 (keeping 200 days of data) [2025-10-10T19:36:17.028472] [DEBUG] [LOCAL ] IMAX: Primary data saved (43577 records). [2025-10-10T19:36:17.028624] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-10T19:36:17.028757] [INFO ] [MAIN ] Update Progress: 1108/2373 symbols completed. IMAX took 39.0s. Estimated remaining: 2h 58m 21s. Rate: 7.1 symbols/min [2025-10-10T19:36:17.102926] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-10T19:36:17.197731] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:36:17.228924] [DEBUG] [LOCAL ] INGM: Loaded 28891 existing records from primary storage. [2025-10-10T19:36:17.229219] [INFO ] [MAIN ] INGM: Loaded 28891 existing records. [2025-10-10T19:36:17.439499] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:36:17.440067] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-10T19:36:17.440338] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-10T19:36:17.440690] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-10T19:36:17.440768] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-10T19:36:17.846892] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-10T19:36:17.912509] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-10T19:36:18.082463] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-10T19:36:18.088851] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:36:18.096077] [INFO ] [REMOTE ] INFA: Full fetch complete (70797 records). [2025-10-10T19:36:18.096318] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-10T19:36:18.592716] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-10T19:36:18.592804] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-10T19:36:18.593916] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-10T19:36:18.593979] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-10T19:36:18.595430] [DEBUG] [LOCAL ] INFA: Trimmed 70797 records to 49851 (keeping 200 days of data) [2025-10-10T19:36:18.690674] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-10T19:36:18.885020] [DEBUG] [LOCAL ] INFA: Primary data saved (49851 records). [2025-10-10T19:36:18.885159] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-10T19:36:18.885571] [INFO ] [MAIN ] Update Progress: 1109/2373 symbols completed. INFA took 31.5s. Estimated remaining: 2h 58m 5s. Rate: 7.1 symbols/min [2025-10-10T19:36:19.080715] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:36:19.116415] [DEBUG] [LOCAL ] INGR: Loaded 33896 existing records from primary storage. [2025-10-10T19:36:19.116733] [INFO ] [MAIN ] INGR: Loaded 33896 existing records. [2025-10-10T19:36:19.335830] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:36:19.338214] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-10T19:36:19.349382] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-10T19:36:19.349683] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-10T19:36:19.350151] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-10T19:36:19.350214] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-10T19:36:19.494453] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-10T19:36:19.720158] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:36:19.902835] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T19:36:20.283364] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T19:36:20.290223] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-10T19:36:21.089431] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-10T19:36:21.194723] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-10T19:36:21.889445] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-10T19:36:21.963443] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-10T19:36:22.689381] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-10T19:36:22.964591] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T19:36:23.061447] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T19:36:23.489409] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-10T19:36:24.289409] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-10T19:36:24.773572] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T19:36:24.878969] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-10T19:36:25.089390] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-10T19:36:25.894478] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-10T19:36:25.912333] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T19:36:26.553780] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T19:36:26.689375] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-10T19:36:27.489346] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-10T19:36:27.566132] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-10T19:36:28.289370] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-10T19:36:28.540975] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T19:36:28.748617] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T19:36:28.753475] [INFO ] [REMOTE ] INFY: Full fetch complete (77545 records). [2025-10-10T19:36:28.753600] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-10T19:36:29.099867] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-10T19:36:29.140563] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-10T19:36:29.140735] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-10T19:36:29.141685] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-10T19:36:29.141748] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-10T19:36:29.143156] [DEBUG] [LOCAL ] INFY: Trimmed 77545 records to 54374 (keeping 200 days of data) [2025-10-10T19:36:29.465163] [DEBUG] [LOCAL ] INFY: Primary data saved (54374 records). [2025-10-10T19:36:29.465294] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-10T19:36:29.465421] [INFO ] [MAIN ] Update Progress: 1110/2373 symbols completed. INFY took 34.8s. Estimated remaining: 2h 57m 59s. Rate: 7.1 symbols/min [2025-10-10T19:36:29.634265] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:36:29.670521] [DEBUG] [LOCAL ] INN: Loaded 42044 existing records from primary storage. [2025-10-10T19:36:29.670833] [INFO ] [MAIN ] INN: Loaded 42044 existing records. [2025-10-10T19:36:29.846346] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:36:29.846579] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-10T19:36:29.846635] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-10T19:36:29.846878] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-10T19:36:29.846933] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-10T19:36:29.900527] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-10T19:36:30.007925] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T19:36:30.246670] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-10T19:36:30.245782] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:36:30.689411] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-10T19:36:31.489410] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-10T19:36:31.825045] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T19:36:32.074456] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-10T19:36:32.289404] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-10T19:36:33.089397] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-10T19:36:33.180776] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T19:36:33.889375] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-10T19:36:33.968573] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T19:36:34.689377] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-10T19:36:34.762354] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T19:36:35.374956] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-10T19:36:35.489336] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-10T19:36:36.289339] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-10T19:36:36.619225] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-10T19:36:36.624504] [INFO ] [REMOTE ] ING: Full fetch complete (73611 records). [2025-10-10T19:36:36.624716] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-10T19:36:37.034149] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-10T19:36:37.034383] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-10T19:36:37.054344] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-10T19:36:37.055216] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-10T19:36:37.057014] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T19:36:37.068864] [DEBUG] [LOCAL ] ING: Trimmed 73611 records to 51465 (keeping 200 days of data) [2025-10-10T19:36:37.124311] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-10T19:36:37.415876] [DEBUG] [LOCAL ] ING: Primary data saved (51465 records). [2025-10-10T19:36:37.416115] [INFO ] [MAIN ] ING: Full history saved. [2025-10-10T19:36:37.416245] [INFO ] [MAIN ] Update Progress: 1111/2373 symbols completed. ING took 36.8s. Estimated remaining: 2h 57m 50s. Rate: 7.1 symbols/min [2025-10-10T19:36:37.610168] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:36:37.610540] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-10T19:36:37.610741] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-10T19:36:37.611036] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-10T19:36:37.611253] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-10T19:36:37.611463] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-10T19:36:37.611521] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-10T19:36:37.760094] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-10T19:36:37.894522] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-10T19:36:38.012103] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:36:38.572223] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-10T19:36:38.689362] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-10T19:36:38.922919] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T19:36:38.923255] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-10T19:36:38.923359] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T19:36:38.923407] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-10T19:36:38.923468] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T19:36:38.923541] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-10T19:36:38.923604] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-10T19:36:38.923639] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-10T19:36:38.923734] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-10T19:36:38.923785] [INFO ] [MAIN ] Update Progress: 1112/2373 symbols completed. INR took 1.5s. Estimated remaining: 2h 57m 34s. Rate: 7.1 symbols/min [2025-10-10T19:36:39.100522] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:36:39.136340] [DEBUG] [LOCAL ] INSP: Loaded 37994 existing records from primary storage. [2025-10-10T19:36:39.136705] [INFO ] [MAIN ] INSP: Loaded 37994 existing records. [2025-10-10T19:36:39.283539] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T19:36:39.347197] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:36:39.347775] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-10T19:36:39.347835] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-10T19:36:39.348425] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-10T19:36:39.348487] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-10T19:36:39.494457] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-10T19:36:39.726252] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:36:40.289377] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-10T19:36:41.095990] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-10T19:36:41.098208] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-10T19:36:41.774888] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T19:36:41.889345] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-10T19:36:42.689447] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-10T19:36:42.876008] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-10T19:36:43.489366] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-10T19:36:43.642433] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T19:36:44.018866] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T19:36:44.289429] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-10T19:36:44.607526] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-10T19:36:45.089439] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-10T19:36:45.889386] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-10T19:36:46.008458] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-10T19:36:46.332079] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T19:36:46.689383] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-10T19:36:47.489433] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-10T19:36:47.704294] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T19:36:48.289424] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-10T19:36:48.360526] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-10T19:36:48.447529] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T19:36:48.450620] [INFO ] [REMOTE ] INGM: Full fetch complete (42054 records). [2025-10-10T19:36:48.450729] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-10T19:36:48.830213] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-10T19:36:48.830279] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-10T19:36:48.831013] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-10T19:36:48.831075] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-10T19:36:48.831981] [DEBUG] [LOCAL ] INGM: Trimmed 42054 records to 29140 (keeping 200 days of data) [2025-10-10T19:36:49.011060] [DEBUG] [LOCAL ] INGM: Primary data saved (29140 records). [2025-10-10T19:36:49.011230] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-10T19:36:49.011350] [INFO ] [MAIN ] Update Progress: 1113/2373 symbols completed. INGM took 32.0s. Estimated remaining: 2h 57m 27s. Rate: 7.1 symbols/min [2025-10-10T19:36:49.094771] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-10T19:36:49.183069] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:36:49.219961] [DEBUG] [LOCAL ] INSW: Loaded 40038 existing records from primary storage. [2025-10-10T19:36:49.220245] [INFO ] [MAIN ] INSW: Loaded 40038 existing records. [2025-10-10T19:36:49.401780] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:36:49.401992] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-10T19:36:49.402041] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-10T19:36:49.402380] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-10T19:36:49.402435] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-10T19:36:49.770607] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:36:49.894483] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-10T19:36:49.906402] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T19:36:50.689357] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-10T19:36:50.764176] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-10T19:36:51.489379] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-10T19:36:51.692125] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-10T19:36:52.166306] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T19:36:52.289419] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-10T19:36:52.949756] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-10T19:36:52.953821] [INFO ] [REMOTE ] INGR: Full fetch complete (50458 records). [2025-10-10T19:36:52.953932] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-10T19:36:53.096874] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-10T19:36:53.333090] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-10T19:36:53.333172] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-10T19:36:53.333983] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-10T19:36:53.334045] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-10T19:36:53.335084] [DEBUG] [LOCAL ] INGR: Trimmed 50458 records to 34205 (keeping 200 days of data) [2025-10-10T19:36:53.552744] [DEBUG] [LOCAL ] INGR: Primary data saved (34205 records). [2025-10-10T19:36:53.552911] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-10T19:36:53.553001] [INFO ] [MAIN ] Update Progress: 1114/2373 symbols completed. INGR took 34.7s. Estimated remaining: 2h 57m 14s. Rate: 7.1 symbols/min [2025-10-10T19:36:53.721677] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:36:53.772937] [DEBUG] [LOCAL ] INVH: Loaded 53549 existing records from primary storage. [2025-10-10T19:36:53.773249] [INFO ] [MAIN ] INVH: Loaded 53549 existing records. [2025-10-10T19:36:53.892722] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-10T19:36:53.951146] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:36:53.951703] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-10T19:36:53.951800] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-10T19:36:53.970333] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-10T19:36:53.971543] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T19:36:53.971608] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-10T19:36:54.324941] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:36:54.494923] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-10T19:36:54.689359] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-10T19:36:55.489362] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-10T19:36:55.739468] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T19:36:55.854879] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-10T19:36:56.289465] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-10T19:36:57.025135] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-10T19:36:57.089419] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-10T19:36:57.889422] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-10T19:36:57.922778] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T19:36:58.687394] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-10T19:36:58.694100] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-10T19:36:59.489449] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-10T19:36:59.582251] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T19:36:59.739560] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-10T19:37:00.289377] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-10T19:37:01.089426] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-10T19:37:01.146291] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T19:37:01.889405] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-10T19:37:01.929478] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T19:37:02.514907] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T19:37:02.689398] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-10T19:37:03.489339] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-10T19:37:03.605227] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T19:37:04.202637] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T19:37:04.289391] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-10T19:37:04.539957] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T19:37:04.543678] [INFO ] [REMOTE ] INN: Full fetch complete (57770 records). [2025-10-10T19:37:04.543760] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-10T19:37:04.920981] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-10T19:37:04.921066] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-10T19:37:04.921842] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-10T19:37:04.921903] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-10T19:37:04.923002] [DEBUG] [LOCAL ] INN: Trimmed 57770 records to 42347 (keeping 200 days of data) [2025-10-10T19:37:05.102134] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-10T19:37:05.198528] [DEBUG] [LOCAL ] INN: Primary data saved (42347 records). [2025-10-10T19:37:05.198717] [INFO ] [MAIN ] INN: Full history saved. [2025-10-10T19:37:05.198820] [INFO ] [MAIN ] Update Progress: 1115/2373 symbols completed. INN took 35.7s. Estimated remaining: 2h 57m 9s. Rate: 7.1 symbols/min [2025-10-10T19:37:05.369296] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:37:05.398605] [DEBUG] [LOCAL ] INVX: Loaded 29349 existing records from primary storage. [2025-10-10T19:37:05.398919] [INFO ] [MAIN ] INVX: Loaded 29349 existing records. [2025-10-10T19:37:05.581790] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:37:05.581991] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-10T19:37:05.582038] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-10T19:37:05.582240] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-10T19:37:05.582296] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-10T19:37:05.893575] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-10T19:37:05.934782] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:37:06.229693] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T19:37:06.689336] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-10T19:37:07.349517] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-10T19:37:07.489420] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-10T19:37:07.778179] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T19:37:07.886302] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-10T19:37:08.289418] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-10T19:37:08.776101] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T19:37:09.089418] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-10T19:37:09.889401] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-10T19:37:10.210407] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T19:37:10.354550] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T19:37:10.689451] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-10T19:37:11.489362] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-10T19:37:11.590422] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-10T19:37:12.289410] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-10T19:37:12.349406] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-10T19:37:12.355575] [INFO ] [REMOTE ] INSP: Full fetch complete (53327 records). [2025-10-10T19:37:12.355738] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-10T19:37:12.736130] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-10T19:37:12.736296] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-10T19:37:12.737167] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-10T19:37:12.737291] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-10T19:37:12.738610] [DEBUG] [LOCAL ] INSP: Trimmed 53327 records to 38337 (keeping 200 days of data) [2025-10-10T19:37:12.973614] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-10T19:37:13.009552] [DEBUG] [LOCAL ] INSP: Primary data saved (38337 records). [2025-10-10T19:37:13.009724] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-10T19:37:13.009831] [INFO ] [MAIN ] Update Progress: 1116/2373 symbols completed. INSP took 34.1s. Estimated remaining: 2h 57m 0s. Rate: 7.1 symbols/min [2025-10-10T19:37:13.097957] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-10T19:37:13.178745] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:37:13.227293] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-10-10T19:37:13.227633] [INFO ] [MAIN ] IONQ: Loaded 54178 existing records. [2025-10-10T19:37:13.405599] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:37:13.405819] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-10T19:37:13.405866] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-10T19:37:13.406136] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-10T19:37:13.406193] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-10T19:37:13.767234] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:37:13.889395] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-10T19:37:14.009715] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T19:37:14.689398] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-10T19:37:15.202622] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-10T19:37:15.489418] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-10T19:37:16.198073] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T19:37:16.289330] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-10T19:37:16.751715] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.86 seconds). [2025-10-10T19:37:17.089388] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-10T19:37:17.191090] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-10T19:37:17.789825] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-10T19:37:17.889341] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-10T19:37:18.689400] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-10T19:37:18.874194] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T19:37:19.185168] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T19:37:19.489380] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-10T19:37:19.666954] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T19:37:20.289385] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-10T19:37:21.053562] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T19:37:21.089603] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-10T19:37:21.889374] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-10T19:37:22.401855] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T19:37:22.564209] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-10T19:37:22.567862] [INFO ] [REMOTE ] INSW: Full fetch complete (60226 records). [2025-10-10T19:37:22.567954] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-10T19:37:22.689371] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-10T19:37:23.000932] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-10T19:37:23.001055] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-10T19:37:23.002266] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-10T19:37:23.002345] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-10T19:37:23.004940] [DEBUG] [LOCAL ] INSW: Trimmed 60226 records to 40341 (keeping 200 days of data) [2025-10-10T19:37:23.297453] [DEBUG] [LOCAL ] INSW: Primary data saved (40341 records). [2025-10-10T19:37:23.297640] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-10T19:37:23.297787] [INFO ] [MAIN ] Update Progress: 1117/2373 symbols completed. INSW took 34.3s. Estimated remaining: 2h 56m 54s. Rate: 7.1 symbols/min [2025-10-10T19:37:23.346937] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-10T19:37:23.489391] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-10T19:37:24.289371] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-10T19:37:24.643533] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-10T19:37:24.947093] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T19:37:25.089457] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-10T19:37:25.889396] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-10T19:37:26.625557] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-10T19:37:26.689366] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-10T19:37:27.064325] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-10-10T19:37:27.372057] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T19:37:27.489348] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-10T19:37:28.112242] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-10T19:37:28.289425] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-10T19:37:29.089365] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-10T19:37:29.389741] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T19:37:29.394540] [INFO ] [REMOTE ] INVH: Full fetch complete (76740 records). [2025-10-10T19:37:29.394683] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-10T19:37:29.791638] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-10T19:37:29.791798] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-10T19:37:29.792807] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-10T19:37:29.792901] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-10T19:37:29.794372] [DEBUG] [LOCAL ] INVH: Trimmed 76740 records to 53939 (keeping 200 days of data) [2025-10-10T19:37:30.043897] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-10T19:37:30.054343] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-10T19:37:30.158562] [DEBUG] [LOCAL ] INVH: Primary data saved (53939 records). [2025-10-10T19:37:30.158753] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-10T19:37:30.158901] [INFO ] [MAIN ] Update Progress: 1118/2373 symbols completed. INVH took 36.6s. Estimated remaining: 2h 56m 44s. Rate: 7.1 symbols/min [2025-10-10T19:37:30.616520] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-10T19:37:30.689332] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-10T19:37:31.276107] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-10T19:37:31.279156] [INFO ] [REMOTE ] INVX: Full fetch complete (43547 records). [2025-10-10T19:37:31.279235] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-10T19:37:31.656390] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-10T19:37:31.656484] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-10T19:37:31.657232] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-10T19:37:31.657294] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-10T19:37:31.658177] [DEBUG] [LOCAL ] INVX: Trimmed 43547 records to 29577 (keeping 200 days of data) [2025-10-10T19:37:31.824684] [DEBUG] [LOCAL ] INVX: Primary data saved (29577 records). [2025-10-10T19:37:31.824823] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-10T19:37:31.824925] [INFO ] [MAIN ] Update Progress: 1119/2373 symbols completed. INVX took 26.6s. Estimated remaining: 2h 56m 28s. Rate: 7.1 symbols/min [2025-10-10T19:37:33.081310] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-10T19:37:33.092516] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-10T19:37:35.774777] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-10T19:37:35.785937] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-10T19:37:38.729727] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.94 seconds). [2025-10-10T19:37:38.743782] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-10T19:37:41.409385] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-10T19:37:41.420205] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-10T19:37:44.333973] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-10T19:37:44.346776] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-10T19:37:47.285945] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-10-10T19:37:47.298790] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-10T19:37:50.313099] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-10-10T19:37:50.325931] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-10T19:37:53.236320] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.91 seconds). [2025-10-10T19:37:53.242284] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-10T19:37:53.242617] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-10T19:37:53.663684] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-10T19:37:53.663779] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-10T19:37:53.665035] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-10T19:37:53.665100] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-10T19:37:53.666839] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54568 (keeping 200 days of data) [2025-10-10T19:37:54.041385] [DEBUG] [LOCAL ] IONQ: Primary data saved (54568 records). [2025-10-10T19:37:54.041544] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-10T19:37:54.041631] [INFO ] [MAIN ] Update Progress: 1120/2373 symbols completed. IONQ took 41.0s. Estimated remaining: 2h 56m 35s. Rate: 7.1 symbols/min [2025-10-10T19:37:54.735517] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:37:54.740731] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:37:54.789290] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:37:54.792057] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:37:54.817310] [DEBUG] [LOCAL ] IPI: Loaded 21686 existing records from primary storage. [2025-10-10T19:37:54.817671] [INFO ] [MAIN ] IPI: Loaded 21686 existing records. [2025-10-10T19:37:55.044081] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:37:55.088625] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-10T19:37:55.090320] [DEBUG] [LOCAL ] IP: Loaded 53701 existing records from primary storage. [2025-10-10T19:37:55.091349] [DEBUG] [LOCAL ] IOT: Loaded 53862 existing records from primary storage. [2025-10-10T19:37:55.092300] [DEBUG] [LOCAL ] IPG: Loaded 53718 existing records from primary storage. [2025-10-10T19:37:55.090568] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-10T19:37:55.093077] [INFO ] [MAIN ] IOT: Loaded 53862 existing records. [2025-10-10T19:37:55.113384] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-10T19:37:55.092917] [INFO ] [MAIN ] IPG: Loaded 53718 existing records. [2025-10-10T19:37:55.137902] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-10T19:37:55.113534] [INFO ] [MAIN ] IP: Loaded 53701 existing records. [2025-10-10T19:37:55.720848] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:37:55.793913] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-10T19:37:55.847795] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-10T19:37:55.878885] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:37:55.886618] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-10T19:37:55.897984] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-10T19:37:55.911518] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:37:55.897815] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-10T19:37:55.930080] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-10T19:37:55.922435] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-10T19:37:55.950924] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-10T19:37:55.950786] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-10T19:37:55.983976] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-10T19:37:55.978766] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-10T19:37:56.009865] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-10T19:37:56.457863] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:37:56.498086] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-10T19:37:57.130711] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:37:57.185767] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-10T19:37:57.247561] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:37:57.270976] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:37:57.272693] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-10T19:37:57.272202] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-10T19:37:57.733108] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T19:37:57.736989] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-10T19:37:58.586598] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-10T19:37:58.590306] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-10T19:37:58.943348] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T19:37:58.954342] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-10T19:37:59.077825] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T19:37:59.089089] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-10T19:37:59.193768] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T19:37:59.204723] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-10T19:37:59.682150] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-10T19:37:59.686160] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-10T19:38:00.811916] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T19:38:00.824473] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-10T19:38:01.025269] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-10T19:38:01.032233] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-10T19:38:01.062302] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T19:38:01.073619] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-10T19:38:01.282505] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-10T19:38:01.293100] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-10T19:38:02.420335] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T19:38:02.427300] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-10T19:38:02.776156] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T19:38:02.792928] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-10T19:38:02.886849] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T19:38:02.901728] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-10T19:38:03.400208] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-10T19:38:03.411216] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-10T19:38:03.748118] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T19:38:03.753763] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-10T19:38:04.331736] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-10T19:38:04.343605] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-10T19:38:04.359832] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-10T19:38:04.364200] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-10T19:38:04.980085] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T19:38:05.001156] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-10T19:38:05.020011] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-10T19:38:05.031378] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-10T19:38:05.121541] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-10T19:38:05.125989] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-10T19:38:06.441264] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T19:38:06.463143] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T19:38:06.468178] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-10T19:38:06.468442] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-10T19:38:06.718464] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-10T19:38:06.729505] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-10T19:38:07.119275] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-10T19:38:07.130334] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-10T19:38:07.568285] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-10T19:38:07.573494] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-10T19:38:07.851911] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-10T19:38:07.864860] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-10T19:38:08.481198] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T19:38:08.492493] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-10T19:38:08.537086] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T19:38:08.539550] [INFO ] [REMOTE ] IPI: Full fetch complete (29669 records). [2025-10-10T19:38:08.539622] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-10T19:38:08.899606] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-10T19:38:08.899708] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-10T19:38:08.900316] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-10T19:38:08.900376] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-10T19:38:08.901152] [DEBUG] [LOCAL ] IPI: Trimmed 29669 records to 21875 (keeping 200 days of data) [2025-10-10T19:38:09.027174] [DEBUG] [LOCAL ] IPI: Primary data saved (21875 records). [2025-10-10T19:38:09.027311] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-10T19:38:09.027390] [INFO ] [MAIN ] Update Progress: 1121/2373 symbols completed. IPI took 15.0s. Estimated remaining: 2h 56m 33s. Rate: 7.1 symbols/min [2025-10-10T19:38:09.195393] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:38:09.213970] [DEBUG] [LOCAL ] IQI: Loaded 18049 existing records from primary storage. [2025-10-10T19:38:09.214225] [INFO ] [MAIN ] IQI: Loaded 18049 existing records. [2025-10-10T19:38:09.396723] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:38:09.397131] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-10T19:38:09.397263] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-10T19:38:09.397844] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-10T19:38:09.397924] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-10T19:38:09.534967] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-10T19:38:09.598640] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-10T19:38:09.844786] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:38:09.845310] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-10T19:38:09.886317] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T19:38:09.897683] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-10T19:38:09.934418] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-10T19:38:09.945721] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-10T19:38:11.155051] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-10T19:38:11.160326] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-10T19:38:11.292016] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T19:38:11.304167] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-10T19:38:11.394851] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T19:38:11.406322] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-10T19:38:11.809178] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-10T19:38:11.813441] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-10T19:38:12.038271] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-10T19:38:12.051106] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-10T19:38:12.530985] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-10T19:38:12.536093] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-10T19:38:12.936879] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T19:38:12.949835] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-10T19:38:13.138522] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-10T19:38:13.142406] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-10T19:38:13.234606] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-10T19:38:13.247471] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-10T19:38:13.372754] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T19:38:13.385553] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-10T19:38:14.456964] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T19:38:14.462367] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-10T19:38:14.702620] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T19:38:14.716637] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-10T19:38:15.253165] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T19:38:15.266235] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-10T19:38:15.414455] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T19:38:15.489395] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-10T19:38:15.569215] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-10T19:38:16.289448] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-10T19:38:16.792871] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T19:38:17.068530] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-10T19:38:17.073915] [INFO ] [REMOTE ] IPG: Full fetch complete (77251 records). [2025-10-10T19:38:17.074103] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-10T19:38:17.120035] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-10T19:38:17.185492] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T19:38:17.454814] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-10T19:38:17.509519] [INFO ] [REMOTE ] IP: Full fetch complete (77166 records). [2025-10-10T19:38:17.532782] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-10T19:38:17.532515] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-10T19:38:17.533278] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-10T19:38:17.534326] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-10T19:38:17.534410] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-10T19:38:17.636433] [DEBUG] [LOCAL ] IPG: Trimmed 77251 records to 54108 (keeping 200 days of data) [2025-10-10T19:38:17.898143] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-10T19:38:18.107959] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-10T19:38:18.108047] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-10T19:38:18.109167] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-10T19:38:18.109248] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-10T19:38:18.119887] [DEBUG] [LOCAL ] IP: Trimmed 77166 records to 54090 (keeping 200 days of data) [2025-10-10T19:38:18.561390] [DEBUG] [LOCAL ] IPG: Primary data saved (54108 records). [2025-10-10T19:38:18.569679] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-10T19:38:18.575933] [INFO ] [MAIN ] Update Progress: 1122/2373 symbols completed. IPG took 24.5s. Estimated remaining: 2h 56m 26s. Rate: 7.1 symbols/min [2025-10-10T19:38:18.840778] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:38:18.858985] [DEBUG] [LOCAL ] IP: Primary data saved (54090 records). [2025-10-10T19:38:18.859152] [INFO ] [MAIN ] IP: Full history saved. [2025-10-10T19:38:18.859535] [INFO ] [MAIN ] Update Progress: 1123/2373 symbols completed. IP took 24.8s. Estimated remaining: 2h 56m 9s. Rate: 7.1 symbols/min [2025-10-10T19:38:19.051714] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:38:19.086552] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-10T19:38:19.110489] [DEBUG] [LOCAL ] IQV: Loaded 50443 existing records from primary storage. [2025-10-10T19:38:19.111239] [INFO ] [MAIN ] IQV: Loaded 50443 existing records. [2025-10-10T19:38:19.132781] [INFO ] [REMOTE ] IOT: Full fetch complete (77392 records). [2025-10-10T19:38:19.153495] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-10T19:38:19.277637] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-10T19:38:19.349562] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-10T19:38:19.433313] [DEBUG] [LOCAL ] IR: Loaded 53136 existing records from primary storage. [2025-10-10T19:38:19.489960] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:38:19.502015] [INFO ] [MAIN ] IR: Loaded 53136 existing records. [2025-10-10T19:38:19.517865] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-10T19:38:19.518065] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-10T19:38:19.590533] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-10T19:38:19.595862] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-10T19:38:20.085385] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:38:20.250271] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-10T19:38:20.290561] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-10T19:38:20.290725] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-10T19:38:20.323228] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-10T19:38:20.333754] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-10T19:38:20.340252] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-10T19:38:20.396531] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-10T19:38:20.393415] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-10T19:38:20.479007] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-10T19:38:20.553761] [DEBUG] [LOCAL ] IOT: Trimmed 77392 records to 54252 (keeping 200 days of data) [2025-10-10T19:38:20.602704] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:38:20.603396] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-10T19:38:20.632792] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-10T19:38:20.982732] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:38:21.090893] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-10T19:38:21.188875] [DEBUG] [LOCAL ] IOT: Primary data saved (54252 records). [2025-10-10T19:38:21.189086] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-10T19:38:21.189175] [INFO ] [MAIN ] Update Progress: 1124/2373 symbols completed. IOT took 27.1s. Estimated remaining: 2h 55m 53s. Rate: 7.1 symbols/min [2025-10-10T19:38:21.354454] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:38:21.397951] [DEBUG] [LOCAL ] IRM: Loaded 49607 existing records from primary storage. [2025-10-10T19:38:21.398254] [INFO ] [MAIN ] IRM: Loaded 49607 existing records. [2025-10-10T19:38:21.574599] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:38:21.574811] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-10T19:38:21.574857] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-10T19:38:21.575809] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-10T19:38:21.575868] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-10T19:38:21.687515] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-10T19:38:21.894476] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-10T19:38:21.945856] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:38:22.149062] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T19:38:22.689399] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-10T19:38:22.867656] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-10T19:38:22.869590] [INFO ] [REMOTE ] IQI: Full fetch complete (26672 records). [2025-10-10T19:38:22.869690] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-10T19:38:23.254972] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-10T19:38:23.291367] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-10T19:38:23.291432] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-10T19:38:23.291994] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-10T19:38:23.292054] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-10T19:38:23.292684] [DEBUG] [LOCAL ] IQI: Trimmed 26672 records to 18146 (keeping 200 days of data) [2025-10-10T19:38:23.402167] [DEBUG] [LOCAL ] IQI: Primary data saved (18146 records). [2025-10-10T19:38:23.402321] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-10T19:38:23.402410] [INFO ] [MAIN ] Update Progress: 1125/2373 symbols completed. IQI took 14.4s. Estimated remaining: 2h 55m 38s. Rate: 7.1 symbols/min [2025-10-10T19:38:23.498849] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-10T19:38:23.571606] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:38:23.593623] [DEBUG] [LOCAL ] IRS: Loaded 22729 existing records from primary storage. [2025-10-10T19:38:23.593922] [INFO ] [MAIN ] IRS: Loaded 22729 existing records. [2025-10-10T19:38:23.791270] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:38:23.791488] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-10T19:38:23.791536] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-10T19:38:23.791967] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-10T19:38:23.792027] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-10T19:38:24.172027] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:38:24.297854] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-10T19:38:24.303399] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-10T19:38:25.089384] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-10T19:38:25.323445] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-10T19:38:25.889373] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-10T19:38:26.120489] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-10T19:38:26.689368] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-10T19:38:26.855235] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T19:38:27.128173] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T19:38:27.489386] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-10T19:38:28.289345] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-10T19:38:28.471131] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T19:38:28.735421] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-10T19:38:29.089351] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-10T19:38:29.889375] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-10T19:38:30.294052] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T19:38:30.689413] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-10T19:38:31.011300] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T19:38:31.489385] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-10T19:38:31.684400] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T19:38:31.763420] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-10T19:38:32.289375] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-10T19:38:33.089384] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-10T19:38:33.374583] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-10T19:38:33.889363] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-10T19:38:34.094732] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T19:38:34.157762] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-10T19:38:34.689385] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-10T19:38:35.489372] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-10T19:38:35.916304] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-10T19:38:36.289374] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-10T19:38:36.368639] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-10T19:38:36.641823] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T19:38:37.089404] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-10T19:38:37.889374] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-10T19:38:38.119198] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T19:38:38.689405] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-10T19:38:38.963009] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T19:38:39.038701] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T19:38:39.489394] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-10T19:38:40.289400] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-10T19:38:40.821710] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-10T19:38:41.089409] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-10T19:38:41.410289] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T19:38:41.889412] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-10T19:38:42.301979] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T19:38:42.689409] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-10T19:38:42.959674] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-10T19:38:43.489391] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-10T19:38:43.783177] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T19:38:43.861625] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T19:38:44.289414] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-10T19:38:45.089446] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-10T19:38:45.382634] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T19:38:45.575771] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-10T19:38:45.889402] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-10T19:38:46.689417] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-10T19:38:47.019251] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T19:38:47.408678] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-10T19:38:47.489349] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-10T19:38:47.687518] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-10T19:38:47.692359] [INFO ] [REMOTE ] IR: Full fetch complete (76231 records). [2025-10-10T19:38:47.692477] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-10T19:38:48.085295] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-10T19:38:48.085382] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-10T19:38:48.086301] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-10T19:38:48.086364] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-10T19:38:48.087816] [DEBUG] [LOCAL ] IR: Trimmed 76231 records to 53520 (keeping 200 days of data) [2025-10-10T19:38:48.297798] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-10T19:38:48.413941] [DEBUG] [LOCAL ] IR: Primary data saved (53520 records). [2025-10-10T19:38:48.429208] [INFO ] [MAIN ] IR: Full history saved. [2025-10-10T19:38:48.429556] [INFO ] [MAIN ] Update Progress: 1126/2373 symbols completed. IR took 29.6s. Estimated remaining: 2h 55m 48s. Rate: 7.1 symbols/min [2025-10-10T19:38:48.463862] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-10T19:38:48.613119] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:38:48.664950] [DEBUG] [LOCAL ] IRT: Loaded 50811 existing records from primary storage. [2025-10-10T19:38:48.665372] [INFO ] [MAIN ] IRT: Loaded 50811 existing records. [2025-10-10T19:38:48.842242] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:38:48.842503] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-10T19:38:48.842553] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-10T19:38:48.843559] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-10T19:38:48.843618] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-10T19:38:49.094588] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-10T19:38:49.201014] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:38:49.889397] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-10T19:38:50.332863] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-10T19:38:50.676131] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-10T19:38:50.689323] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-10T19:38:51.489402] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-10T19:38:51.641787] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-10T19:38:52.182317] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-10T19:38:52.185582] [INFO ] [REMOTE ] IRS: Full fetch complete (32485 records). [2025-10-10T19:38:52.185710] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-10T19:38:52.294506] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-10T19:38:52.560631] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-10T19:38:52.560742] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-10T19:38:52.561400] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-10T19:38:52.561440] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-10T19:38:52.562194] [DEBUG] [LOCAL ] IRS: Trimmed 32485 records to 22978 (keeping 200 days of data) [2025-10-10T19:38:52.690255] [DEBUG] [LOCAL ] IRS: Primary data saved (22978 records). [2025-10-10T19:38:52.690381] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-10T19:38:52.690458] [INFO ] [MAIN ] Update Progress: 1127/2373 symbols completed. IRS took 29.3s. Estimated remaining: 2h 55m 35s. Rate: 7.1 symbols/min [2025-10-10T19:38:52.861150] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:38:52.877770] [DEBUG] [LOCAL ] ISD: Loaded 15962 existing records from primary storage. [2025-10-10T19:38:52.878011] [INFO ] [MAIN ] ISD: Loaded 15962 existing records. [2025-10-10T19:38:53.059428] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:38:53.060243] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-10T19:38:53.060303] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-10T19:38:53.060751] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-10T19:38:53.060808] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-10T19:38:53.102489] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-10T19:38:53.416038] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:38:53.451953] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T19:38:53.889348] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-10T19:38:54.232913] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T19:38:54.689340] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-10T19:38:55.007677] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T19:38:55.489358] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-10T19:38:55.680769] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T19:38:56.289370] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-10T19:38:56.598880] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-10T19:38:56.725566] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T19:38:57.089400] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-10T19:38:57.889398] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-10T19:38:57.933852] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T19:38:58.252786] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-10T19:38:58.689399] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-10T19:38:59.489361] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-10T19:38:59.604022] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T19:39:00.289384] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-10T19:39:00.420033] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T19:39:01.089348] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-10T19:39:01.476191] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-10T19:39:01.480873] [INFO ] [REMOTE ] IRM: Full fetch complete (72226 records). [2025-10-10T19:39:01.481000] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-10T19:39:01.859143] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-10T19:39:01.891487] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-10T19:39:01.915392] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-10T19:39:01.916864] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-10T19:39:01.917956] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-10T19:39:01.918147] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-10T19:39:01.916722] [INFO ] [REMOTE ] IQV: Full fetch complete (72156 records). [2025-10-10T19:39:01.918602] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-10T19:39:01.932415] [DEBUG] [LOCAL ] IRM: Trimmed 72226 records to 49959 (keeping 200 days of data) [2025-10-10T19:39:02.248446] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T19:39:02.515187] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-10T19:39:02.515578] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-10T19:39:02.517789] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-10T19:39:02.518261] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-10T19:39:02.529411] [DEBUG] [LOCAL ] IQV: Trimmed 72156 records to 50832 (keeping 200 days of data) [2025-10-10T19:39:02.710335] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-10T19:39:02.980326] [DEBUG] [LOCAL ] IRM: Primary data saved (49959 records). [2025-10-10T19:39:02.980785] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-10T19:39:02.980932] [INFO ] [MAIN ] Update Progress: 1128/2373 symbols completed. IRM took 41.8s. Estimated remaining: 2h 55m 28s. Rate: 7.1 symbols/min [2025-10-10T19:39:03.225877] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:39:03.244239] [DEBUG] [LOCAL ] IQV: Primary data saved (50832 records). [2025-10-10T19:39:03.244594] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-10T19:39:03.244878] [INFO ] [MAIN ] Update Progress: 1129/2373 symbols completed. IQV took 44.7s. Estimated remaining: 2h 55m 11s. Rate: 7.1 symbols/min [2025-10-10T19:39:03.451959] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:39:03.468204] [DEBUG] [LOCAL ] IT: Loaded 42507 existing records from primary storage. [2025-10-10T19:39:03.468879] [INFO ] [MAIN ] IT: Loaded 42507 existing records. [2025-10-10T19:39:03.669002] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:39:03.670111] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-10T19:39:03.670364] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-10T19:39:03.678746] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-10T19:39:03.679734] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-10T19:39:03.703877] [DEBUG] [LOCAL ] ITGR: Loaded 31372 existing records from primary storage. [2025-10-10T19:39:03.751798] [INFO ] [MAIN ] ITGR: Loaded 31372 existing records. [2025-10-10T19:39:03.887579] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T19:39:04.007848] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T19:39:04.079965] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-10T19:39:04.253917] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:39:04.274497] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-10T19:39:04.285378] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-10T19:39:04.301303] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-10T19:39:04.320784] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-10T19:39:04.327948] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-10T19:39:04.437993] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:39:04.753210] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:39:05.089375] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-10T19:39:05.189184] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-10T19:39:05.889423] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-10T19:39:06.102240] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-10T19:39:06.276159] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T19:39:06.490819] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-10T19:39:06.689445] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-10T19:39:07.489433] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-10T19:39:07.904285] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-10T19:39:08.289455] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-10T19:39:09.089433] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-10T19:39:09.247007] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T19:39:09.752482] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-10T19:39:09.889425] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-10T19:39:10.269175] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T19:39:10.689498] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-10T19:39:11.247438] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-10T19:39:11.295198] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-10T19:39:11.489429] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-10T19:39:12.289368] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-10T19:39:12.839508] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T19:39:13.089407] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-10T19:39:13.363182] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-10T19:39:13.889395] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-10T19:39:14.689390] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-10T19:39:14.790208] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-10T19:39:14.926756] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-10T19:39:15.489406] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-10T19:39:15.926368] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-10T19:39:16.289408] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-10T19:39:17.016688] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-10T19:39:17.089402] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-10T19:39:17.373547] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T19:39:17.376055] [INFO ] [REMOTE ] ISD: Full fetch complete (24101 records). [2025-10-10T19:39:17.376128] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-10T19:39:17.742284] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-10T19:39:17.742372] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-10T19:39:17.743254] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-10T19:39:17.743328] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-10T19:39:17.744056] [DEBUG] [LOCAL ] ISD: Trimmed 24101 records to 16060 (keeping 200 days of data) [2025-10-10T19:39:17.854694] [DEBUG] [LOCAL ] ISD: Primary data saved (16060 records). [2025-10-10T19:39:17.854857] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-10T19:39:17.854945] [INFO ] [MAIN ] Update Progress: 1130/2373 symbols completed. ISD took 25.2s. Estimated remaining: 2h 55m 9s. Rate: 7.1 symbols/min [2025-10-10T19:39:17.895536] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-10T19:39:18.060972] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:39:18.097289] [DEBUG] [LOCAL ] ITT: Loaded 32802 existing records from primary storage. [2025-10-10T19:39:18.097619] [INFO ] [MAIN ] ITT: Loaded 32802 existing records. [2025-10-10T19:39:18.298312] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:39:18.298701] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-10T19:39:18.298759] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-10T19:39:18.299505] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-10T19:39:18.299563] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-10T19:39:18.643149] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:39:18.689333] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-10T19:39:18.834795] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T19:39:19.489376] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-10T19:39:19.810408] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-10T19:39:20.100626] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T19:39:20.289350] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-10T19:39:20.758123] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-10T19:39:21.089382] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-10T19:39:21.889379] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-10T19:39:22.057784] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T19:39:22.621877] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-10T19:39:22.689335] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-10T19:39:23.489380] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-10T19:39:23.799000] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-10T19:39:24.289417] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-10T19:39:24.316950] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T19:39:24.991779] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-10T19:39:25.089390] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-10T19:39:25.621465] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T19:39:25.626513] [INFO ] [REMOTE ] IRT: Full fetch complete (72747 records). [2025-10-10T19:39:25.626721] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-10T19:39:25.898861] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-10T19:39:26.030222] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-10T19:39:26.030302] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-10T19:39:26.031197] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-10T19:39:26.031258] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-10T19:39:26.032556] [DEBUG] [LOCAL ] IRT: Trimmed 72747 records to 51183 (keeping 200 days of data) [2025-10-10T19:39:26.338788] [DEBUG] [LOCAL ] IRT: Primary data saved (51183 records). [2025-10-10T19:39:26.338941] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-10T19:39:26.339231] [INFO ] [MAIN ] Update Progress: 1131/2373 symbols completed. IRT took 37.9s. Estimated remaining: 2h 55m 1s. Rate: 7.1 symbols/min [2025-10-10T19:39:26.506350] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:39:26.554787] [DEBUG] [LOCAL ] ITUB: Loaded 53698 existing records from primary storage. [2025-10-10T19:39:26.555111] [INFO ] [MAIN ] ITUB: Loaded 53698 existing records. [2025-10-10T19:39:26.692622] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-10T19:39:26.751140] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:39:26.751424] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-10T19:39:26.751544] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-10T19:39:26.753280] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-10T19:39:26.753446] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-10T19:39:26.957502] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-10T19:39:27.176667] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:39:27.489406] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-10T19:39:27.587332] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T19:39:28.040896] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-10T19:39:28.289391] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-10T19:39:29.089411] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-10T19:39:29.148496] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-10T19:39:29.775738] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-10T19:39:29.889379] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-10T19:39:30.689382] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-10T19:39:30.767950] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-10T19:39:31.489425] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-10T19:39:31.690323] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T19:39:32.289349] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-10T19:39:32.443890] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-10T19:39:32.797850] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-10T19:39:33.089366] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-10T19:39:33.889410] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-10T19:39:34.001524] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T19:39:34.346892] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-10T19:39:34.689406] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-10T19:39:35.489360] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-10T19:39:35.602031] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T19:39:36.289414] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-10T19:39:36.697330] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T19:39:36.790022] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T19:39:37.089340] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-10T19:39:37.703013] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T19:39:37.889385] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-10T19:39:38.689391] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-10T19:39:38.992382] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T19:39:39.489344] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-10T19:39:39.594118] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-10T19:39:39.643520] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T19:39:39.647100] [INFO ] [REMOTE ] ITGR: Full fetch complete (42379 records). [2025-10-10T19:39:39.647191] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-10T19:39:40.039620] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-10T19:39:40.039751] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-10T19:39:40.040718] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-10T19:39:40.040812] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-10T19:39:40.041980] [DEBUG] [LOCAL ] ITGR: Trimmed 42379 records to 31647 (keeping 200 days of data) [2025-10-10T19:39:40.243513] [DEBUG] [LOCAL ] ITGR: Primary data saved (31647 records). [2025-10-10T19:39:40.243732] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-10T19:39:40.243849] [INFO ] [MAIN ] Update Progress: 1132/2373 symbols completed. ITGR took 37.0s. Estimated remaining: 2h 54m 58s. Rate: 7.1 symbols/min [2025-10-10T19:39:40.297240] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-10T19:39:40.423444] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:39:40.470725] [DEBUG] [LOCAL ] ITW: Loaded 46099 existing records from primary storage. [2025-10-10T19:39:40.471290] [INFO ] [MAIN ] ITW: Loaded 46099 existing records. [2025-10-10T19:39:40.652753] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:39:40.653025] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-10T19:39:40.653080] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-10T19:39:40.654499] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-10T19:39:40.654560] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-10T19:39:41.040430] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:39:41.053110] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-10T19:39:41.089334] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-10T19:39:41.889344] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-10T19:39:42.267916] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T19:39:42.512147] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-10T19:39:42.689354] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-10T19:39:43.489370] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-10T19:39:43.662948] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-10T19:39:43.667732] [INFO ] [REMOTE ] IT: Full fetch complete (56783 records). [2025-10-10T19:39:43.667857] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-10T19:39:44.050601] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-10T19:39:44.050726] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-10T19:39:44.051533] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-10T19:39:44.051581] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-10T19:39:44.052991] [DEBUG] [LOCAL ] IT: Trimmed 56783 records to 42823 (keeping 200 days of data) [2025-10-10T19:39:44.290295] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-10T19:39:44.308432] [DEBUG] [LOCAL ] IT: Primary data saved (42823 records). [2025-10-10T19:39:44.308572] [INFO ] [MAIN ] IT: Full history saved. [2025-10-10T19:39:44.308704] [INFO ] [MAIN ] Update Progress: 1133/2373 symbols completed. IT took 41.3s. Estimated remaining: 2h 54m 45s. Rate: 7.1 symbols/min [2025-10-10T19:39:44.483925] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:39:44.525750] [DEBUG] [LOCAL ] IVR: Loaded 48445 existing records from primary storage. [2025-10-10T19:39:44.526125] [INFO ] [MAIN ] IVR: Loaded 48445 existing records. [2025-10-10T19:39:44.725073] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:39:44.749956] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-10T19:39:44.750146] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-10T19:39:44.755754] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-10T19:39:44.755566] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-10T19:39:44.756024] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-10T19:39:45.078429] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-10T19:39:45.106305] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-10T19:39:45.168098] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:39:45.889428] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-10T19:39:46.312466] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-10T19:39:46.689416] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-10T19:39:46.924064] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-10T19:39:46.991806] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-10T19:39:46.994919] [INFO ] [REMOTE ] ITT: Full fetch complete (46947 records). [2025-10-10T19:39:46.995015] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-10T19:39:47.383105] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-10T19:39:47.383198] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-10T19:39:47.383993] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-10T19:39:47.384060] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-10T19:39:47.385113] [DEBUG] [LOCAL ] ITT: Trimmed 46947 records to 33112 (keeping 200 days of data) [2025-10-10T19:39:47.496134] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-10T19:39:47.596924] [DEBUG] [LOCAL ] ITT: Primary data saved (33112 records). [2025-10-10T19:39:47.597061] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-10T19:39:47.597159] [INFO ] [MAIN ] Update Progress: 1134/2373 symbols completed. ITT took 29.7s. Estimated remaining: 2h 54m 31s. Rate: 7.1 symbols/min [2025-10-10T19:39:47.763082] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:39:47.793992] [DEBUG] [LOCAL ] IVT: Loaded 31295 existing records from primary storage. [2025-10-10T19:39:47.794346] [INFO ] [MAIN ] IVT: Loaded 31295 existing records. [2025-10-10T19:39:47.989087] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:39:47.989984] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-10T19:39:47.990042] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-10T19:39:47.991191] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-10T19:39:47.991252] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-10T19:39:48.293389] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-10T19:39:48.347998] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:39:48.383490] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T19:39:49.089345] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-10T19:39:49.331287] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T19:39:49.889379] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-10T19:39:50.222326] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T19:39:50.658905] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-10T19:39:50.689336] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-10T19:39:51.311556] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-10T19:39:51.489410] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-10T19:39:51.774882] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-10T19:39:52.289385] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-10T19:39:53.089346] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-10T19:39:53.440391] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T19:39:53.889348] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-10T19:39:54.361812] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T19:39:54.558477] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-10T19:39:54.689342] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-10T19:39:54.716089] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-10T19:39:55.489382] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-10T19:39:56.289421] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-10T19:39:56.366364] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-10T19:39:56.459426] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-10T19:39:57.089381] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-10T19:39:57.640895] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T19:39:57.889363] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-10T19:39:58.689354] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-10T19:39:58.788939] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-10T19:39:59.489358] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-10T19:39:59.827882] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T19:40:00.288851] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-10T19:40:00.298664] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-10T19:40:01.089354] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-10T19:40:01.571401] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T19:40:01.849799] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-10T19:40:01.889347] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-10T19:40:02.456315] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T19:40:02.689412] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-10T19:40:03.284500] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-10T19:40:03.489445] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-10T19:40:04.289433] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-10T19:40:04.610348] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T19:40:05.089395] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-10T19:40:05.406294] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-10T19:40:05.411095] [INFO ] [REMOTE ] ITUB: Full fetch complete (77152 records). [2025-10-10T19:40:05.411197] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-10T19:40:05.822100] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-10T19:40:05.822208] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-10T19:40:05.823159] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-10T19:40:05.823388] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-10T19:40:05.845749] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-10T19:40:05.853558] [DEBUG] [LOCAL ] ITUB: Trimmed 77152 records to 54088 (keeping 200 days of data) [2025-10-10T19:40:05.903150] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-10T19:40:06.178053] [DEBUG] [LOCAL ] ITUB: Primary data saved (54088 records). [2025-10-10T19:40:06.178182] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-10T19:40:06.178529] [INFO ] [MAIN ] Update Progress: 1135/2373 symbols completed. ITUB took 39.8s. Estimated remaining: 2h 54m 34s. Rate: 7.1 symbols/min [2025-10-10T19:40:06.343555] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:40:06.392709] [DEBUG] [LOCAL ] IVZ: Loaded 53491 existing records from primary storage. [2025-10-10T19:40:06.393020] [INFO ] [MAIN ] IVZ: Loaded 53491 existing records. [2025-10-10T19:40:06.565356] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:40:06.565545] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-10T19:40:06.565593] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-10T19:40:06.566844] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-10T19:40:06.566903] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-10T19:40:06.702168] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-10T19:40:06.917579] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:40:07.088030] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-10T19:40:07.183538] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T19:40:07.489457] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-10T19:40:08.289350] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-10T19:40:08.904895] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-10T19:40:09.089361] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-10T19:40:09.247719] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T19:40:09.779343] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T19:40:09.889350] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-10T19:40:10.689381] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-10T19:40:11.232925] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T19:40:11.237211] [INFO ] [REMOTE ] IVT: Full fetch complete (45670 records). [2025-10-10T19:40:11.237380] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-10T19:40:11.500950] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-10T19:40:11.649202] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-10T19:40:11.698819] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-10T19:40:11.698899] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-10T19:40:11.699633] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-10T19:40:11.699715] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-10T19:40:11.700772] [DEBUG] [LOCAL ] IVT: Trimmed 45670 records to 31596 (keeping 200 days of data) [2025-10-10T19:40:11.892901] [DEBUG] [LOCAL ] IVT: Primary data saved (31596 records). [2025-10-10T19:40:11.893056] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-10T19:40:11.893142] [INFO ] [MAIN ] Update Progress: 1136/2373 symbols completed. IVT took 24.3s. Estimated remaining: 2h 54m 22s. Rate: 7.1 symbols/min [2025-10-10T19:40:12.084280] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:40:12.104905] [DEBUG] [LOCAL ] IX: Loaded 22441 existing records from primary storage. [2025-10-10T19:40:12.105150] [INFO ] [MAIN ] IX: Loaded 22441 existing records. [2025-10-10T19:40:12.303668] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:40:12.297897] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-10T19:40:12.304174] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-10T19:40:12.305178] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-10T19:40:12.305716] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-10T19:40:12.305775] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-10T19:40:12.615993] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-10T19:40:12.657033] [INFO ] [REMOTE ] ITW: Full fetch complete (66430 records). [2025-10-10T19:40:12.691420] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-10T19:40:12.698059] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:40:13.091050] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-10T19:40:13.100883] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-10T19:40:13.114767] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-10T19:40:13.119038] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-10T19:40:13.119253] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-10T19:40:13.121290] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-10T19:40:13.133499] [DEBUG] [LOCAL ] ITW: Trimmed 66430 records to 46468 (keeping 200 days of data) [2025-10-10T19:40:13.431999] [DEBUG] [LOCAL ] ITW: Primary data saved (46468 records). [2025-10-10T19:40:13.432138] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-10T19:40:13.432219] [INFO ] [MAIN ] Update Progress: 1137/2373 symbols completed. ITW took 33.2s. Estimated remaining: 2h 54m 6s. Rate: 7.1 symbols/min [2025-10-10T19:40:13.598031] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:40:13.638307] [DEBUG] [LOCAL ] J: Loaded 40500 existing records from primary storage. [2025-10-10T19:40:13.638664] [INFO ] [MAIN ] J: Loaded 40500 existing records. [2025-10-10T19:40:13.810769] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:40:13.810979] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-10T19:40:13.811026] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-10T19:40:13.811825] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-10T19:40:13.811896] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-10T19:40:13.891129] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-10T19:40:14.073906] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-10T19:40:14.185937] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:40:14.246614] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T19:40:14.689392] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-10T19:40:15.489454] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-10T19:40:15.760773] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T19:40:16.005394] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-10T19:40:16.289394] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-10T19:40:17.089420] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-10T19:40:17.423219] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T19:40:17.889374] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-10T19:40:18.050106] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-10T19:40:18.248953] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T19:40:18.689467] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-10T19:40:19.484327] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T19:40:19.491923] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-10T19:40:20.174077] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-10T19:40:20.289339] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-10T19:40:21.089344] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-10T19:40:21.451344] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T19:40:21.889424] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-10T19:40:22.075569] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-10T19:40:22.451817] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-10T19:40:22.689390] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-10T19:40:22.783012] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T19:40:23.489380] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-10T19:40:24.064885] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-10T19:40:24.289373] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-10T19:40:25.089389] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-10T19:40:25.430386] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-10T19:40:25.435901] [INFO ] [REMOTE ] IVR: Full fetch complete (69125 records). [2025-10-10T19:40:25.436116] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-10T19:40:25.863704] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-10T19:40:25.863843] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-10T19:40:25.865318] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-10T19:40:25.865391] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-10T19:40:25.868794] [DEBUG] [LOCAL ] IVR: Trimmed 69125 records to 48793 (keeping 200 days of data) [2025-10-10T19:40:25.920060] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-10T19:40:26.206535] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T19:40:26.209240] [DEBUG] [LOCAL ] IVR: Primary data saved (48793 records). [2025-10-10T19:40:26.212693] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-10T19:40:26.218128] [INFO ] [MAIN ] Update Progress: 1138/2373 symbols completed. IVR took 41.9s. Estimated remaining: 2h 54m 2s. Rate: 7.1 symbols/min [2025-10-10T19:40:26.391841] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:40:26.430710] [DEBUG] [LOCAL ] JBGS: Loaded 42466 existing records from primary storage. [2025-10-10T19:40:26.431003] [INFO ] [MAIN ] JBGS: Loaded 42466 existing records. [2025-10-10T19:40:26.593777] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-10T19:40:26.642395] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:40:26.643239] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-10T19:40:26.643314] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-10T19:40:26.644590] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-10T19:40:26.644685] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-10T19:40:26.694541] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-10T19:40:27.010339] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:40:27.489408] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-10T19:40:27.999939] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-10T19:40:28.163968] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-10T19:40:28.289345] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-10T19:40:28.883809] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T19:40:29.089416] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-10T19:40:29.889376] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-10T19:40:30.149460] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T19:40:30.689448] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-10T19:40:30.928551] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T19:40:31.489358] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-10T19:40:31.597875] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T19:40:31.933235] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T19:40:32.289348] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-10T19:40:32.911180] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-10T19:40:33.032600] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-10T19:40:33.089327] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-10T19:40:33.889341] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-10T19:40:34.421319] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-10T19:40:34.689383] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-10T19:40:35.489409] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-10T19:40:35.513807] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-10T19:40:35.899683] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T19:40:36.289353] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-10T19:40:37.089346] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-10T19:40:37.344794] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T19:40:37.710514] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T19:40:37.778110] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-10T19:40:37.889426] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-10T19:40:38.689458] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-10T19:40:39.489403] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-10T19:40:39.668303] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T19:40:39.814863] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-10T19:40:39.817550] [INFO ] [REMOTE ] IX: Full fetch complete (27839 records). [2025-10-10T19:40:39.817635] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-10T19:40:40.215514] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-10T19:40:40.215639] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-10T19:40:40.216866] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-10T19:40:40.216935] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-10T19:40:40.218430] [DEBUG] [LOCAL ] IX: Trimmed 27839 records to 22586 (keeping 200 days of data) [2025-10-10T19:40:40.310393] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-10T19:40:40.380507] [DEBUG] [LOCAL ] IX: Primary data saved (22586 records). [2025-10-10T19:40:40.380736] [INFO ] [MAIN ] IX: Full history saved. [2025-10-10T19:40:40.380853] [INFO ] [MAIN ] Update Progress: 1139/2373 symbols completed. IX took 28.5s. Estimated remaining: 2h 54m 0s. Rate: 7.1 symbols/min [2025-10-10T19:40:40.560444] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:40:40.604635] [DEBUG] [LOCAL ] JBI: Loaded 43587 existing records from primary storage. [2025-10-10T19:40:40.605216] [INFO ] [MAIN ] JBI: Loaded 43587 existing records. [2025-10-10T19:40:40.829773] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:40:40.833605] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-10T19:40:40.842035] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-10T19:40:40.842843] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-10T19:40:40.843734] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-10T19:40:40.843801] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-10T19:40:41.094775] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-10T19:40:41.202417] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:40:41.535707] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-10T19:40:41.889395] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-10T19:40:42.689387] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-10T19:40:42.777534] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-10T19:40:43.489432] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-10T19:40:43.748988] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T19:40:44.247319] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T19:40:44.289368] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-10T19:40:45.089405] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-10T19:40:45.159867] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-10T19:40:45.889413] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-10T19:40:45.934570] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-10T19:40:46.689357] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-10T19:40:46.991176] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T19:40:46.996052] [INFO ] [REMOTE ] IVZ: Full fetch complete (76810 records). [2025-10-10T19:40:46.996170] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-10T19:40:47.388933] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-10T19:40:47.389090] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-10T19:40:47.390196] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-10T19:40:47.390387] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-10T19:40:47.391860] [DEBUG] [LOCAL ] IVZ: Trimmed 76810 records to 53881 (keeping 200 days of data) [2025-10-10T19:40:47.492550] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-10T19:40:47.645782] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-10T19:40:47.660573] [INFO ] [REMOTE ] J: Full fetch complete (59210 records). [2025-10-10T19:40:47.660808] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-10T19:40:47.792638] [DEBUG] [LOCAL ] IVZ: Primary data saved (53881 records). [2025-10-10T19:40:47.823048] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-10T19:40:47.835848] [INFO ] [MAIN ] Update Progress: 1140/2373 symbols completed. IVZ took 41.7s. Estimated remaining: 2h 53m 51s. Rate: 7.1 symbols/min [2025-10-10T19:40:48.205121] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:40:48.405541] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T19:40:48.418973] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-10T19:40:48.419312] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-10T19:40:48.420731] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-10T19:40:48.420946] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-10T19:40:48.421398] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-10T19:40:48.440792] [DEBUG] [LOCAL ] J: Trimmed 59210 records to 40817 (keeping 200 days of data) [2025-10-10T19:40:48.529434] [DEBUG] [LOCAL ] JBL: Loaded 48733 existing records from primary storage. [2025-10-10T19:40:48.562558] [INFO ] [MAIN ] JBL: Loaded 48733 existing records. [2025-10-10T19:40:48.931478] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:40:48.941490] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-10T19:40:48.945612] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-10T19:40:48.947085] [DEBUG] [LOCAL ] J: Primary data saved (40817 records). [2025-10-10T19:40:48.947347] [INFO ] [MAIN ] J: Full history saved. [2025-10-10T19:40:48.947481] [INFO ] [MAIN ] Update Progress: 1141/2373 symbols completed. J took 35.5s. Estimated remaining: 2h 53m 34s. Rate: 7.1 symbols/min [2025-10-10T19:40:48.981902] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-10T19:40:49.016793] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-10T19:40:49.267172] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:40:49.492479] [DEBUG] [LOCAL ] JBND: Loaded 26753 existing records from primary storage. [2025-10-10T19:40:49.519980] [INFO ] [MAIN ] JBND: Loaded 26753 existing records. [2025-10-10T19:40:49.578127] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:40:49.626300] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-10T19:40:49.745302] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-10T19:40:49.786398] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:40:49.786591] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-10T19:40:49.786685] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-10T19:40:49.787440] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-10T19:40:49.787502] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-10T19:40:49.889624] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-10T19:40:50.155299] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:40:50.180127] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-10T19:40:50.689433] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-10T19:40:51.489381] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-10T19:40:51.517091] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T19:40:52.014398] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-10T19:40:52.289359] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-10T19:40:52.372632] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-10T19:40:52.582240] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-10T19:40:53.089402] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-10T19:40:53.802663] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T19:40:53.889364] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-10T19:40:54.304636] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T19:40:54.689393] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-10T19:40:55.489426] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-10T19:40:55.648222] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T19:40:55.762853] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-10T19:40:56.289431] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-10T19:40:57.089458] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-10T19:40:57.117356] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T19:40:57.121992] [INFO ] [REMOTE ] JBGS: Full fetch complete (59311 records). [2025-10-10T19:40:57.122160] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-10T19:40:57.528197] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-10T19:40:57.528285] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-10T19:40:57.529314] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-10T19:40:57.529406] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-10T19:40:57.530969] [DEBUG] [LOCAL ] JBGS: Trimmed 59311 records to 42765 (keeping 200 days of data) [2025-10-10T19:40:57.791737] [DEBUG] [LOCAL ] JBGS: Primary data saved (42765 records). [2025-10-10T19:40:57.791873] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-10T19:40:57.791954] [INFO ] [MAIN ] Update Progress: 1142/2373 symbols completed. JBGS took 31.6s. Estimated remaining: 2h 53m 26s. Rate: 7.1 symbols/min [2025-10-10T19:40:57.889891] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-10T19:40:57.963688] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:40:57.963966] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-10T19:40:57.964029] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-10T19:40:57.964137] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-10T19:40:57.964177] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-10T19:40:57.964218] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-10T19:40:57.964250] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-10T19:40:58.279492] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-10T19:40:58.377309] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:40:58.412930] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-10T19:40:58.689386] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-10T19:40:59.489409] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-10T19:40:59.542361] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-10T19:40:59.634018] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-10T19:40:59.715186] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T19:40:59.715517] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-10T19:40:59.715609] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T19:40:59.715692] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-10T19:40:59.715744] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T19:40:59.715811] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-10T19:40:59.715936] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-10T19:40:59.715998] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-10T19:40:59.716043] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-10T19:40:59.716093] [INFO ] [MAIN ] Update Progress: 1143/2373 symbols completed. JBS took 1.9s. Estimated remaining: 2h 53m 11s. Rate: 7.1 symbols/min [2025-10-10T19:40:59.916672] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:40:59.916873] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-10T19:40:59.916921] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-10T19:40:59.917035] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-10T19:40:59.917076] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-10T19:40:59.917118] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-10T19:40:59.917151] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-10T19:41:00.295158] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-10T19:41:00.333210] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:41:01.089441] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-10T19:41:01.889362] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-10T19:41:02.107448] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T19:41:02.107812] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-10T19:41:02.107902] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T19:41:02.107948] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-10T19:41:02.108007] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T19:41:02.108073] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-10T19:41:02.108135] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-10T19:41:02.108170] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-10T19:41:02.108210] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-10T19:41:02.108298] [INFO ] [MAIN ] Update Progress: 1144/2373 symbols completed. JBTM took 2.4s. Estimated remaining: 2h 52m 56s. Rate: 7.1 symbols/min [2025-10-10T19:41:02.331497] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:41:02.334465] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T19:41:02.351745] [DEBUG] [LOCAL ] JCE: Loaded 7225 existing records from primary storage. [2025-10-10T19:41:02.351988] [INFO ] [MAIN ] JCE: Loaded 7225 existing records. [2025-10-10T19:41:02.535779] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:41:02.535995] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-10T19:41:02.536043] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-10T19:41:02.536427] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-10T19:41:02.536488] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-10T19:41:02.698473] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-10T19:41:02.937608] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:41:02.970525] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T19:41:03.489360] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-10T19:41:03.569792] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T19:41:04.289427] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-10T19:41:05.089473] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-10T19:41:05.253935] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-10T19:41:05.283788] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T19:41:05.889383] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-10T19:41:06.689399] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-10T19:41:06.698805] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-10T19:41:06.890705] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T19:41:07.489354] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-10T19:41:07.740552] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-10T19:41:08.192112] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T19:41:08.289356] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-10T19:41:09.089377] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-10T19:41:09.687415] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-10T19:41:09.887409] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-10T19:41:09.889497] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-10T19:41:10.689353] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-10T19:41:10.730912] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-10T19:41:11.489382] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-10T19:41:11.865362] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T19:41:12.289411] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-10T19:41:13.085611] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-10T19:41:13.095089] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-10T19:41:13.795459] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-10T19:41:13.889403] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-10T19:41:14.177733] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T19:41:14.689366] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-10T19:41:15.489338] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-10T19:41:15.606787] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T19:41:16.122116] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-10T19:41:16.289377] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-10T19:41:17.080971] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T19:41:17.089318] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-10T19:41:17.889346] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-10T19:41:18.161601] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-10T19:41:18.320824] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-10T19:41:18.545073] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-10T19:41:18.689373] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-10T19:41:19.489400] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-10T19:41:20.267032] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-10T19:41:20.289374] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-10T19:41:21.089428] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-10T19:41:21.168475] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-10T19:41:21.730200] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T19:41:21.733589] [INFO ] [REMOTE ] JBND: Full fetch complete (34994 records). [2025-10-10T19:41:21.733709] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-10T19:41:21.889471] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-10T19:41:22.101475] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-10T19:41:22.101566] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-10T19:41:22.102201] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-10T19:41:22.102271] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-10T19:41:22.103252] [DEBUG] [LOCAL ] JBND: Trimmed 34994 records to 26996 (keeping 200 days of data) [2025-10-10T19:41:22.268343] [DEBUG] [LOCAL ] JBND: Primary data saved (26996 records). [2025-10-10T19:41:22.268505] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-10T19:41:22.268619] [INFO ] [MAIN ] Update Progress: 1145/2373 symbols completed. JBND took 33.3s. Estimated remaining: 2h 52m 60s. Rate: 7.1 symbols/min [2025-10-10T19:41:22.432746] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:41:22.483293] [DEBUG] [LOCAL ] JCI: Loaded 53928 existing records from primary storage. [2025-10-10T19:41:22.483600] [INFO ] [MAIN ] JCI: Loaded 53928 existing records. [2025-10-10T19:41:22.662620] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:41:22.663001] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-10T19:41:22.663057] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-10T19:41:22.664055] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-10T19:41:22.664139] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-10T19:41:22.695510] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-10T19:41:22.895245] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-10T19:41:23.044614] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:41:23.129006] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-10T19:41:23.489372] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-10T19:41:24.247697] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T19:41:24.289351] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-10T19:41:24.436434] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-10T19:41:25.089369] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-10T19:41:25.889394] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-10T19:41:26.291927] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T19:41:26.648383] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-10T19:41:26.652502] [INFO ] [REMOTE ] JBI: Full fetch complete (64040 records). [2025-10-10T19:41:26.652609] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-10T19:41:26.695331] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-10T19:41:27.054277] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-10T19:41:27.054391] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-10T19:41:27.055498] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-10T19:41:27.055566] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-10T19:41:27.057364] [DEBUG] [LOCAL ] JBI: Trimmed 64040 records to 43912 (keeping 200 days of data) [2025-10-10T19:41:27.301723] [DEBUG] [LOCAL ] JBI: Primary data saved (43912 records). [2025-10-10T19:41:27.301856] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-10T19:41:27.301935] [INFO ] [MAIN ] Update Progress: 1146/2373 symbols completed. JBI took 46.9s. Estimated remaining: 2h 52m 48s. Rate: 7.1 symbols/min [2025-10-10T19:41:27.465194] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:41:27.491431] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-10T19:41:27.512072] [DEBUG] [LOCAL ] JEF: Loaded 50519 existing records from primary storage. [2025-10-10T19:41:27.512392] [INFO ] [MAIN ] JEF: Loaded 50519 existing records. [2025-10-10T19:41:27.687088] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:41:27.687321] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-10T19:41:27.687483] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-10T19:41:27.693619] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-10T19:41:27.699919] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-10T19:41:27.732031] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-10T19:41:27.779540] [INFO ] [REMOTE ] JBL: Full fetch complete (70377 records). [2025-10-10T19:41:27.794985] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-10T19:41:28.395098] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:41:28.445592] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-10T19:41:28.460792] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-10T19:41:28.486774] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-10T19:41:28.486949] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-10T19:41:28.488024] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-10T19:41:28.488159] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-10T19:41:28.489845] [DEBUG] [LOCAL ] JBL: Trimmed 70377 records to 49115 (keeping 200 days of data) [2025-10-10T19:41:28.647270] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T19:41:28.841611] [DEBUG] [LOCAL ] JBL: Primary data saved (49115 records). [2025-10-10T19:41:28.841774] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-10T19:41:28.841863] [INFO ] [MAIN ] Update Progress: 1147/2373 symbols completed. JBL took 41.0s. Estimated remaining: 2h 52m 32s. Rate: 7.1 symbols/min [2025-10-10T19:41:29.006458] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:41:29.045050] [DEBUG] [LOCAL ] JELD: Loaded 46434 existing records from primary storage. [2025-10-10T19:41:29.045362] [INFO ] [MAIN ] JELD: Loaded 46434 existing records. [2025-10-10T19:41:29.098366] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-10T19:41:29.233257] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:41:29.233624] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-10T19:41:29.233719] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-10T19:41:29.234565] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-10T19:41:29.234636] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-10T19:41:29.616724] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:41:29.889399] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-10T19:41:30.689380] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-10T19:41:30.753499] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-10T19:41:30.816603] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T19:41:30.818860] [INFO ] [REMOTE ] JCE: Full fetch complete (9754 records). [2025-10-10T19:41:30.818938] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-10T19:41:31.123104] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T19:41:31.259165] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-10T19:41:31.259282] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-10T19:41:31.259893] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-10T19:41:31.259961] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-10T19:41:31.260605] [DEBUG] [LOCAL ] JCE: Trimmed 9754 records to 7358 (keeping 200 days of data) [2025-10-10T19:41:31.309078] [DEBUG] [LOCAL ] JCE: Primary data saved (7358 records). [2025-10-10T19:41:31.309264] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-10T19:41:31.309376] [INFO ] [MAIN ] Update Progress: 1148/2373 symbols completed. JCE took 29.2s. Estimated remaining: 2h 52m 17s. Rate: 7.1 symbols/min [2025-10-10T19:41:31.486220] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:41:31.489438] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-10T19:41:31.499124] [DEBUG] [LOCAL ] JEQ: Loaded 8743 existing records from primary storage. [2025-10-10T19:41:31.499466] [INFO ] [MAIN ] JEQ: Loaded 8743 existing records. [2025-10-10T19:41:31.692310] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:41:31.692617] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-10-10T19:41:31.692704] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-10-10T19:41:31.693070] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-10-10T19:41:31.693132] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-10-10T19:41:32.039259] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T19:41:32.122000] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:41:32.289436] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-10-10T19:41:32.997956] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-10T19:41:33.089414] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-10T19:41:33.320695] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-10T19:41:33.889401] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-10T19:41:34.624011] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-10T19:41:34.689403] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-10T19:41:35.489388] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-10T19:41:35.707045] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T19:41:35.811312] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-10T19:41:36.289396] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-10T19:41:37.089413] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-10-10T19:41:37.522234] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T19:41:37.759770] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-10T19:41:37.889427] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-10T19:41:38.292096] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T19:41:38.689363] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-10T19:41:39.294244] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-10T19:41:39.489440] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-10-10T19:41:40.224670] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-10T19:41:40.289372] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-10T19:41:40.532570] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-10T19:41:41.089382] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-10T19:41:41.889384] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-10-10T19:41:42.188440] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T19:41:42.689379] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-10T19:41:42.861516] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-10T19:41:42.896212] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T19:41:43.489409] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-10T19:41:44.289384] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-10T19:41:44.391135] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T19:41:45.089370] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-10T19:41:45.571810] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-10T19:41:45.889352] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-10-10T19:41:46.398198] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T19:41:46.408323] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-10T19:41:46.456725] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-10T19:41:46.689363] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-10T19:41:47.489436] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-10-10T19:41:48.289550] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-10T19:41:48.359179] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-10T19:41:48.707186] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T19:41:49.089394] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-10T19:41:49.889396] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-10T19:41:50.131056] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T19:41:50.234312] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-10T19:41:50.689370] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-10T19:41:51.489340] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-10-10T19:41:51.823166] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T19:41:52.212103] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-10T19:41:52.289412] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-10-10T19:41:52.472456] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T19:41:53.019543] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-10T19:41:53.089388] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-10T19:41:53.889459] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-10T19:41:54.689407] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-10-10T19:41:54.940190] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T19:41:55.088802] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T19:41:55.093062] [INFO ] [REMOTE ] JELD: Full fetch complete (64176 records). [2025-10-10T19:41:55.093199] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-10T19:41:55.475268] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-10T19:41:55.475339] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-10T19:41:55.476178] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-10T19:41:55.476264] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-10T19:41:55.477474] [DEBUG] [LOCAL ] JELD: Trimmed 64176 records to 46759 (keeping 200 days of data) [2025-10-10T19:41:55.520637] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-10T19:41:55.737531] [DEBUG] [LOCAL ] JELD: Primary data saved (46759 records). [2025-10-10T19:41:55.737731] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-10T19:41:55.738060] [INFO ] [MAIN ] Update Progress: 1149/2373 symbols completed. JELD took 26.9s. Estimated remaining: 2h 52m 26s. Rate: 7.1 symbols/min [2025-10-10T19:41:55.827465] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-10T19:41:55.922818] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:41:55.954100] [DEBUG] [LOCAL ] JFR: Loaded 31188 existing records from primary storage. [2025-10-10T19:41:55.954379] [INFO ] [MAIN ] JFR: Loaded 31188 existing records. [2025-10-10T19:41:56.129204] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:41:56.129404] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-10T19:41:56.129449] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-10T19:41:56.130044] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-10T19:41:56.130101] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-10T19:41:56.303281] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-10T19:41:56.495887] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:41:57.089347] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-10T19:41:57.660818] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-10T19:41:57.889388] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-10T19:41:58.247177] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T19:41:58.689407] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-10T19:41:58.740839] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-10T19:41:59.489360] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-10T19:41:59.955500] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-10T19:42:00.289431] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-10T19:42:00.446789] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T19:42:00.571947] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T19:42:01.089374] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-10T19:42:01.889419] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-10T19:42:02.178503] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T19:42:02.689378] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-10-10T19:42:03.250129] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-10T19:42:03.349850] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-10T19:42:03.354764] [INFO ] [REMOTE ] JEF: Full fetch complete (73036 records). [2025-10-10T19:42:03.354880] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-10T19:42:03.508553] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-10T19:42:03.762591] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-10T19:42:03.790995] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-10T19:42:03.791075] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-10T19:42:03.792301] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-10T19:42:03.792369] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-10T19:42:03.793836] [DEBUG] [LOCAL ] JEF: Trimmed 73036 records to 50909 (keeping 200 days of data) [2025-10-10T19:42:04.100541] [DEBUG] [LOCAL ] JEF: Primary data saved (50909 records). [2025-10-10T19:42:04.100705] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-10T19:42:04.100824] [INFO ] [MAIN ] Update Progress: 1150/2373 symbols completed. JEF took 36.8s. Estimated remaining: 2h 52m 17s. Rate: 7.1 symbols/min [2025-10-10T19:42:04.265694] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:42:04.278288] [DEBUG] [LOCAL ] JGH: Loaded 11697 existing records from primary storage. [2025-10-10T19:42:04.278523] [INFO ] [MAIN ] JGH: Loaded 11697 existing records. [2025-10-10T19:42:04.298760] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-10T19:42:04.460136] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:42:04.460475] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-10T19:42:04.460534] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-10T19:42:04.460872] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-10T19:42:04.460932] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-10T19:42:04.802626] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:42:05.089370] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-10. [2025-10-10T19:42:05.434805] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-10T19:42:05.439908] [INFO ] [REMOTE ] JCI: Full fetch complete (77405 records). [2025-10-10T19:42:05.440043] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-10T19:42:05.822588] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-10T19:42:05.822758] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-10T19:42:05.823741] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-10T19:42:05.823814] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-10T19:42:05.825356] [DEBUG] [LOCAL ] JCI: Trimmed 77405 records to 54312 (keeping 200 days of data) [2025-10-10T19:42:05.895728] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-10T19:42:06.078332] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T19:42:06.096221] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-10T19:42:06.096877] [INFO ] [REMOTE ] JEQ: Full fetch complete (11954 records). [2025-10-10T19:42:06.106401] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-10-10T19:42:06.576568] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-10-10T19:42:06.577030] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-10-10T19:42:06.579374] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-10-10T19:42:06.579453] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-10-10T19:42:06.584879] [DEBUG] [LOCAL ] JEQ: Trimmed 11954 records to 8854 (keeping 200 days of data) [2025-10-10T19:42:06.626748] [DEBUG] [LOCAL ] JCI: Primary data saved (54312 records). [2025-10-10T19:42:06.627070] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-10T19:42:06.627305] [INFO ] [MAIN ] Update Progress: 1151/2373 symbols completed. JCI took 44.4s. Estimated remaining: 2h 52m 2s. Rate: 7.1 symbols/min [2025-10-10T19:42:06.695610] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-10T19:42:06.743943] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-10T19:42:06.821895] [DEBUG] [LOCAL ] JEQ: Primary data saved (8854 records). [2025-10-10T19:42:06.838406] [INFO ] [MAIN ] JEQ: Full history saved. [2025-10-10T19:42:06.839737] [INFO ] [MAIN ] Update Progress: 1152/2373 symbols completed. JEQ took 35.5s. Estimated remaining: 2h 51m 45s. Rate: 7.1 symbols/min [2025-10-10T19:42:06.873905] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:42:07.012867] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:42:07.029569] [DEBUG] [LOCAL ] JHI: Loaded 3850 existing records from primary storage. [2025-10-10T19:42:07.029904] [INFO ] [MAIN ] JHI: Loaded 3850 existing records. [2025-10-10T19:42:07.177115] [DEBUG] [LOCAL ] JHG: Loaded 47922 existing records from primary storage. [2025-10-10T19:42:07.199076] [INFO ] [MAIN ] JHG: Loaded 47922 existing records. [2025-10-10T19:42:07.320385] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:42:07.333816] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-10T19:42:07.333919] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-10T19:42:07.350159] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-10T19:42:07.361110] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-10T19:42:07.493829] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-10T19:42:07.550973] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:42:07.609954] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-10T19:42:07.638585] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-10T19:42:07.733127] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-10T19:42:07.743528] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-10T19:42:07.945819] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:42:08.260861] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:42:08.281376] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-10T19:42:08.289318] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-10T19:42:08.471205] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-10T19:42:09.089351] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-10T19:42:09.580100] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T19:42:09.798627] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T19:42:09.889350] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-10T19:42:10.689373] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-10T19:42:11.109140] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T19:42:11.489434] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-10T19:42:12.289381] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-10T19:42:12.604289] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-10T19:42:12.695155] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-10T19:42:13.089382] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-10T19:42:13.105419] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-10T19:42:13.889403] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-10T19:42:14.492100] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-10T19:42:14.689370] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-10T19:42:14.782516] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-10T19:42:15.022604] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-10T19:42:15.489392] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-10T19:42:16.289402] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-10T19:42:16.445494] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-10T19:42:17.089412] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-10T19:42:17.660738] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T19:42:17.682451] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-10T19:42:17.889425] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-10T19:42:18.689380] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-10T19:42:19.383982] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-10T19:42:19.489431] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-10T19:42:19.614129] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T19:42:20.289453] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-10T19:42:20.416089] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-10T19:42:21.089419] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-10T19:42:21.889379] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-10T19:42:22.165925] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T19:42:22.333751] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-10T19:42:22.689348] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-10T19:42:22.749035] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T19:42:23.489348] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-10T19:42:23.645314] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-10T19:42:24.185160] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-10T19:42:24.289364] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-10T19:42:24.954329] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-10T19:42:25.089355] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-10T19:42:25.889384] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-10T19:42:26.475452] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-10T19:42:26.478963] [INFO ] [REMOTE ] JFR: Full fetch complete (48238 records). [2025-10-10T19:42:26.479049] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-10T19:42:26.697331] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-10T19:42:26.863538] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-10T19:42:26.863668] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-10T19:42:26.864755] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-10T19:42:26.865007] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-10T19:42:26.866443] [DEBUG] [LOCAL ] JFR: Trimmed 48238 records to 31454 (keeping 200 days of data) [2025-10-10T19:42:26.934155] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-10T19:42:27.079787] [DEBUG] [LOCAL ] JFR: Primary data saved (31454 records). [2025-10-10T19:42:27.079994] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-10T19:42:27.080108] [INFO ] [MAIN ] Update Progress: 1153/2373 symbols completed. JFR took 31.3s. Estimated remaining: 2h 51m 49s. Rate: 7.1 symbols/min [2025-10-10T19:42:27.263410] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:42:27.268226] [DEBUG] [LOCAL ] JHS: Loaded 2942 existing records from primary storage. [2025-10-10T19:42:27.268385] [INFO ] [MAIN ] JHS: Loaded 2942 existing records. [2025-10-10T19:42:27.366906] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-10T19:42:27.459487] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:42:27.459816] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-10T19:42:27.459897] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-10T19:42:27.460188] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-10T19:42:27.460250] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-10T19:42:27.494482] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-10T19:42:27.831042] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:42:28.289327] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-10T19:42:28.426339] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-10T19:42:29.089377] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-10T19:42:29.685523] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-10T19:42:29.889373] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-10T19:42:30.158974] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T19:42:30.689398] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-10T19:42:30.944880] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-10T19:42:30.947327] [INFO ] [REMOTE ] JGH: Full fetch complete (15552 records). [2025-10-10T19:42:30.947397] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-10T19:42:31.333029] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-10T19:42:31.333127] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-10T19:42:31.333635] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-10T19:42:31.333716] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-10T19:42:31.334329] [DEBUG] [LOCAL ] JGH: Trimmed 15552 records to 12013 (keeping 200 days of data) [2025-10-10T19:42:31.412402] [DEBUG] [LOCAL ] JGH: Primary data saved (12013 records). [2025-10-10T19:42:31.412595] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-10T19:42:31.412720] [INFO ] [MAIN ] Update Progress: 1154/2373 symbols completed. JGH took 27.3s. Estimated remaining: 2h 51m 36s. Rate: 7.1 symbols/min [2025-10-10T19:42:31.494608] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-10T19:42:31.588029] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:42:31.636531] [DEBUG] [LOCAL ] JHX: Loaded 53541 existing records from primary storage. [2025-10-10T19:42:31.636900] [INFO ] [MAIN ] JHX: Loaded 53541 existing records. [2025-10-10T19:42:31.816817] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:42:31.817037] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-10T19:42:31.817085] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-10T19:42:31.818464] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-10T19:42:31.818526] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-10T19:42:32.243902] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-10T19:42:32.275545] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:42:32.294607] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-10T19:42:32.320296] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T19:42:33.089402] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-10T19:42:33.141124] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-10T19:42:33.797473] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-10T19:42:33.889374] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-10T19:42:34.666483] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T19:42:34.667964] [INFO ] [REMOTE ] JHI: Full fetch complete (5503 records). [2025-10-10T19:42:34.668039] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-10T19:42:34.699254] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-10T19:42:35.037150] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-10T19:42:35.037253] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-10T19:42:35.037586] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-10T19:42:35.037631] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-10T19:42:35.038086] [DEBUG] [LOCAL ] JHI: Trimmed 5503 records to 3929 (keeping 200 days of data) [2025-10-10T19:42:35.065055] [DEBUG] [LOCAL ] JHI: Primary data saved (3929 records). [2025-10-10T19:42:35.065240] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-10T19:42:35.065342] [INFO ] [MAIN ] Update Progress: 1155/2373 symbols completed. JHI took 28.2s. Estimated remaining: 2h 51m 23s. Rate: 7.1 symbols/min [2025-10-10T19:42:35.238793] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:42:35.258496] [DEBUG] [LOCAL ] JILL: Loaded 16360 existing records from primary storage. [2025-10-10T19:42:35.258877] [INFO ] [MAIN ] JILL: Loaded 16360 existing records. [2025-10-10T19:42:35.435137] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:42:35.435420] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-10T19:42:35.435470] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-10T19:42:35.435975] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-10T19:42:35.436034] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-10T19:42:35.497299] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-10T19:42:35.803416] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:42:36.289415] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-10T19:42:36.491972] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T19:42:36.752322] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T19:42:36.990004] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-10T19:42:37.089369] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-10T19:42:37.889362] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-10T19:42:38.123449] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-10T19:42:38.689436] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-10T19:42:39.156823] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-10T19:42:39.489407] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-10T19:42:40.200194] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T19:42:40.289367] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-10T19:42:40.506368] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-10T19:42:41.089353] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-10T19:42:41.192561] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T19:42:41.889413] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-10T19:42:42.689423] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-10T19:42:42.809334] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-10T19:42:42.908262] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-10T19:42:43.222780] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-10T19:42:43.489443] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-10T19:42:44.289416] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-10T19:42:44.437731] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-10T19:42:45.089478] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-10T19:42:45.889367] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-10T19:42:45.998969] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-10T19:42:46.038473] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T19:42:46.689438] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-10T19:42:47.492056] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-10T19:42:47.499756] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-10T19:42:47.526339] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-10T19:42:48.289417] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-10T19:42:49.089392] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-10T19:42:49.233808] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T19:42:49.238953] [INFO ] [REMOTE ] JHG: Full fetch complete (68261 records). [2025-10-10T19:42:49.239148] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-10T19:42:49.646249] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-10T19:42:49.646460] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-10T19:42:49.647963] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-10T19:42:49.648032] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-10T19:42:49.649852] [DEBUG] [LOCAL ] JHG: Trimmed 68261 records to 48298 (keeping 200 days of data) [2025-10-10T19:42:49.889784] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-10T19:42:49.981216] [DEBUG] [LOCAL ] JHG: Primary data saved (48298 records). [2025-10-10T19:42:49.981427] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-10T19:42:49.981538] [INFO ] [MAIN ] Update Progress: 1156/2373 symbols completed. JHG took 43.3s. Estimated remaining: 2h 51m 21s. Rate: 7.1 symbols/min [2025-10-10T19:42:50.171403] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:42:50.211818] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T19:42:50.242730] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T19:42:50.278485] [DEBUG] [LOCAL ] JKS: Loaded 40155 existing records from primary storage. [2025-10-10T19:42:50.278918] [INFO ] [MAIN ] JKS: Loaded 40155 existing records. [2025-10-10T19:42:50.445533] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-10T19:42:50.479969] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:42:50.480307] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-10T19:42:50.480367] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-10T19:42:50.481497] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-10T19:42:50.481563] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-10T19:42:50.698291] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-10T19:42:50.853441] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:42:51.489401] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-10T19:42:52.289385] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-10T19:42:52.474967] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T19:42:52.594974] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-10T19:42:52.821786] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-10T19:42:53.089424] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-10T19:42:53.889461] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-10T19:42:54.689443] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-10T19:42:55.189219] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T19:42:55.415817] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-10T19:42:55.489351] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-10T19:42:55.910825] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T19:42:56.289463] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-10T19:42:57.089414] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-10T19:42:57.570039] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T19:42:57.889398] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-10T19:42:57.936519] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-10T19:42:57.969141] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-10T19:42:58.689411] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-10T19:42:59.012005] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-10T19:42:59.489461] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-10T19:42:59.721024] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-10T19:43:00.289412] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-10T19:43:01.089416] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-10T19:43:01.306081] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T19:43:01.889398] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-10T19:43:02.137258] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-10T19:43:02.143531] [INFO ] [REMOTE ] JHX: Full fetch complete (60360 records). [2025-10-10T19:43:02.143867] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-10T19:43:02.573688] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-10T19:43:02.573879] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-10T19:43:02.578593] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-10T19:43:02.579922] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-10T19:43:02.580332] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-10T19:43:02.581970] [DEBUG] [LOCAL ] JHX: Trimmed 60360 records to 53931 (keeping 200 days of data) [2025-10-10T19:43:02.689582] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-10T19:43:02.922546] [DEBUG] [LOCAL ] JHX: Primary data saved (53931 records). [2025-10-10T19:43:02.922763] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-10T19:43:02.922870] [INFO ] [MAIN ] Update Progress: 1157/2373 symbols completed. JHX took 31.5s. Estimated remaining: 2h 51m 18s. Rate: 7.1 symbols/min [2025-10-10T19:43:03.489401] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-10T19:43:03.561384] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-10T19:43:03.825090] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-10T19:43:04.195830] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-10T19:43:04.289360] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-10T19:43:04.752156] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-10T19:43:04.753291] [INFO ] [REMOTE ] JHS: Full fetch complete (4498 records). [2025-10-10T19:43:04.753402] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-10T19:43:05.103441] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-10T19:43:05.150045] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-10T19:43:05.150145] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-10T19:43:05.150344] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-10T19:43:05.150387] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-10T19:43:05.150858] [DEBUG] [LOCAL ] JHS: Trimmed 4498 records to 2954 (keeping 200 days of data) [2025-10-10T19:43:05.170850] [DEBUG] [LOCAL ] JHS: Primary data saved (2954 records). [2025-10-10T19:43:05.171391] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-10T19:43:05.171639] [INFO ] [MAIN ] Update Progress: 1158/2373 symbols completed. JHS took 38.1s. Estimated remaining: 2h 51m 3s. Rate: 7.1 symbols/min [2025-10-10T19:43:05.889451] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-10T19:43:07.007199] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-10T19:43:07.011296] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-10T19:43:07.079880] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T19:43:07.489432] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-10T19:43:08.101755] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-10T19:43:08.289392] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-10T19:43:09.023752] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-10T19:43:09.089407] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-10T19:43:09.703375] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-10T19:43:09.705504] [INFO ] [REMOTE ] JILL: Full fetch complete (22617 records). [2025-10-10T19:43:09.705590] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-10T19:43:10.093242] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-10T19:43:10.093371] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-10T19:43:10.094378] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-10T19:43:10.094447] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-10T19:43:10.095430] [DEBUG] [LOCAL ] JILL: Trimmed 22617 records to 16471 (keeping 200 days of data) [2025-10-10T19:43:10.203740] [DEBUG] [LOCAL ] JILL: Primary data saved (16471 records). [2025-10-10T19:43:10.203882] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-10T19:43:10.203993] [INFO ] [MAIN ] Update Progress: 1159/2373 symbols completed. JILL took 35.1s. Estimated remaining: 2h 50m 51s. Rate: 7.1 symbols/min [2025-10-10T19:43:10.670402] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T19:43:10.683848] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-10T19:43:12.479157] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-10T19:43:12.492230] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-10T19:43:14.133535] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-10T19:43:14.141128] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-10T19:43:15.345406] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T19:43:15.354716] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-10T19:43:16.577499] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-10T19:43:16.581340] [INFO ] [REMOTE ] JKS: Full fetch complete (58761 records). [2025-10-10T19:43:16.581448] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-10T19:43:16.962416] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-10T19:43:16.962532] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-10T19:43:16.963962] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-10T19:43:16.964031] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-10T19:43:16.965708] [DEBUG] [LOCAL ] JKS: Trimmed 58761 records to 40520 (keeping 200 days of data) [2025-10-10T19:43:17.226382] [DEBUG] [LOCAL ] JKS: Primary data saved (40520 records). [2025-10-10T19:43:17.226547] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-10T19:43:17.226638] [INFO ] [MAIN ] Update Progress: 1160/2373 symbols completed. JKS took 27.2s. Estimated remaining: 2h 50m 41s. Rate: 7.1 symbols/min [2025-10-10T19:43:17.919124] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:43:17.977967] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:43:18.013544] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:43:18.035928] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:43:18.038128] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-10T19:43:18.038438] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-10T19:43:18.038745] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-10T19:43:18.038796] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-10T19:43:18.038843] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-10T19:43:18.038879] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-10T19:43:18.086716] [DEBUG] [LOCAL ] JLS: Loaded 4181 existing records from primary storage. [2025-10-10T19:43:18.111920] [INFO ] [MAIN ] JLS: Loaded 4181 existing records. [2025-10-10T19:43:18.441941] [DEBUG] [LOCAL ] JLL: Loaded 31654 existing records from primary storage. [2025-10-10T19:43:18.452679] [DEBUG] [LOCAL ] JMIA: Loaded 51233 existing records from primary storage. [2025-10-10T19:43:18.451787] [INFO ] [MAIN ] JLL: Loaded 31654 existing records. [2025-10-10T19:43:18.512411] [INFO ] [MAIN ] JMIA: Loaded 51233 existing records. [2025-10-10T19:43:18.525134] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:43:18.575700] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-10T19:43:18.632432] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-10T19:43:18.762740] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-10T19:43:18.817896] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-10T19:43:19.188963] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:43:19.220459] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:43:19.225914] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-10T19:43:19.238178] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:43:19.238771] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-10T19:43:19.244312] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-10T19:43:19.259615] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-10T19:43:19.259817] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-10T19:43:19.270346] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-10T19:43:19.270245] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-10T19:43:19.276182] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-10T19:43:19.270950] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-10T19:43:20.077837] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-10T19:43:20.096091] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-10T19:43:20.244380] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:43:20.277202] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-10T19:43:20.422981] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:43:20.425459] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-10T19:43:20.448462] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:43:20.449059] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-10T19:43:20.611692] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-10T19:43:20.612900] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-10T19:43:21.082771] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-10T19:43:21.084150] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-10T19:43:21.112311] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-10T19:43:21.113537] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-10T19:43:21.517319] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-10T19:43:21.519211] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-10T19:43:21.596794] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-10T19:43:21.602154] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-10T19:43:21.733676] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-10T19:43:21.735213] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-10T19:43:22.066393] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-10T19:43:22.067869] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-10T19:43:22.441182] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T19:43:22.524425] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-10T19:43:22.577791] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-10T19:43:22.689382] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-10T19:43:23.040822] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T19:43:23.489424] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-10T19:43:24.114129] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-10T19:43:24.289408] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-10T19:43:24.664559] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T19:43:24.967048] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-10T19:43:25.089373] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-10T19:43:25.889423] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-10T19:43:26.430969] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-10T19:43:26.689409] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-10T19:43:27.027296] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-10T19:43:27.489384] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-10T19:43:28.256627] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T19:43:28.289459] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-10T19:43:28.865589] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-10T19:43:29.089339] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-10T19:43:29.322069] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-10T19:43:29.623535] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-10T19:43:29.624534] [INFO ] [REMOTE ] JMM: Full fetch complete (2309 records). [2025-10-10T19:43:29.624621] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-10T19:43:29.851413] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-10T19:43:29.851607] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T19:43:29.851708] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T19:43:29.851795] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-10T19:43:29.851871] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-10T19:43:29.851910] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-10T19:43:29.851953] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-10T19:43:29.852012] [INFO ] [MAIN ] Update Progress: 1161/2373 symbols completed. JMM took 12.6s. Estimated remaining: 2h 50m 37s. Rate: 7.1 symbols/min [2025-10-10T19:43:29.894461] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-10T19:43:30.029129] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:43:30.080226] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-10-10T19:43:30.080536] [INFO ] [MAIN ] JNJ: Loaded 54143 existing records. [2025-10-10T19:43:30.250199] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:43:30.250444] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-10T19:43:30.250499] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-10T19:43:30.251489] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-10T19:43:30.251549] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-10T19:43:30.354963] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-10T19:43:30.607284] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:43:30.689363] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-10T19:43:31.182451] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-10T19:43:31.489371] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-10T19:43:32.192528] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-10T19:43:32.289422] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-10T19:43:33.089391] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-10T19:43:33.766401] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-10T19:43:33.889409] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-10T19:43:34.164708] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T19:43:34.689369] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-10T19:43:35.489446] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-10T19:43:36.187948] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-10T19:43:36.289409] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-10T19:43:36.508670] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-10T19:43:36.707583] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-10T19:43:37.089419] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-10T19:43:37.347393] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-10T19:43:37.440155] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-10T19:43:37.889368] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-10T19:43:38.362698] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-10T19:43:38.689385] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-10T19:43:39.489380] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-10T19:43:40.289429] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-10T19:43:40.650461] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T19:43:41.089473] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-10T19:43:41.144504] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T19:43:41.889443] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-10T19:43:42.511327] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T19:43:42.512435] [INFO ] [REMOTE ] JLS: Full fetch complete (5824 records). [2025-10-10T19:43:42.512504] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-10T19:43:42.713717] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-10T19:43:42.896030] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-10T19:43:42.967976] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-10T19:43:42.968182] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-10T19:43:42.968763] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-10T19:43:42.968854] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-10T19:43:42.969742] [DEBUG] [LOCAL ] JLS: Trimmed 5824 records to 4203 (keeping 200 days of data) [2025-10-10T19:43:43.011255] [DEBUG] [LOCAL ] JLS: Primary data saved (4203 records). [2025-10-10T19:43:43.016675] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-10T19:43:43.027439] [INFO ] [MAIN ] Update Progress: 1162/2373 symbols completed. JLS took 25.8s. Estimated remaining: 2h 50m 33s. Rate: 7.1 symbols/min [2025-10-10T19:43:43.056535] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-10T19:43:43.222680] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:43:43.279395] [DEBUG] [LOCAL ] JOBY: Loaded 54191 existing records from primary storage. [2025-10-10T19:43:43.279852] [INFO ] [MAIN ] JOBY: Loaded 54191 existing records. [2025-10-10T19:43:43.463841] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:43:43.464138] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-10T19:43:43.464189] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-10T19:43:43.465158] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-10T19:43:43.465218] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-10T19:43:43.498583] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-10T19:43:43.845858] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:43:44.289397] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-10T19:43:44.399006] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-10T19:43:45.089393] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-10T19:43:45.708947] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-10T19:43:45.889413] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-10T19:43:46.690950] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-10T19:43:46.691035] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-10T19:43:47.329499] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-10T19:43:47.437607] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T19:43:47.489342] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-10T19:43:48.289442] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-10T19:43:48.406564] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-10T19:43:49.060155] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T19:43:49.089416] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-10T19:43:49.889386] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-10T19:43:50.689432] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-10T19:43:50.760364] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-10T19:43:50.793586] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-10T19:43:51.489392] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-10T19:43:52.289453] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-10T19:43:52.509465] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-10T19:43:52.835317] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-10T19:43:52.841076] [INFO ] [REMOTE ] JMIA: Full fetch complete (73294 records). [2025-10-10T19:43:52.841287] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-10T19:43:52.980267] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T19:43:53.096990] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-10T19:43:53.276830] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-10T19:43:53.276948] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-10T19:43:53.278209] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-10T19:43:53.278281] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-10T19:43:53.282046] [DEBUG] [LOCAL ] JMIA: Trimmed 73294 records to 51623 (keeping 200 days of data) [2025-10-10T19:43:53.605009] [DEBUG] [LOCAL ] JMIA: Primary data saved (51623 records). [2025-10-10T19:43:53.605202] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-10T19:43:53.605354] [INFO ] [MAIN ] Update Progress: 1163/2373 symbols completed. JMIA took 36.4s. Estimated remaining: 2h 50m 27s. Rate: 7.1 symbols/min [2025-10-10T19:43:53.789335] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:43:53.819713] [DEBUG] [LOCAL ] JOE: Loaded 24061 existing records from primary storage. [2025-10-10T19:43:53.820118] [INFO ] [MAIN ] JOE: Loaded 24061 existing records. [2025-10-10T19:43:53.898777] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-10T19:43:54.011457] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:43:54.011828] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-10T19:43:54.011891] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-10T19:43:54.012505] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-10T19:43:54.012572] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-10T19:43:54.388288] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:43:54.444435] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T19:43:54.447564] [INFO ] [REMOTE ] JLL: Full fetch complete (44648 records). [2025-10-10T19:43:54.447722] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-10T19:43:54.693216] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-10T19:43:54.847977] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-10T19:43:54.848239] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-10T19:43:54.851070] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-10T19:43:54.849681] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-10T19:43:54.861460] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-10T19:43:54.863205] [DEBUG] [LOCAL ] JLL: Trimmed 44648 records to 31853 (keeping 200 days of data) [2025-10-10T19:43:55.050570] [DEBUG] [LOCAL ] JLL: Primary data saved (31853 records). [2025-10-10T19:43:55.050772] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-10T19:43:55.050925] [INFO ] [MAIN ] Update Progress: 1164/2373 symbols completed. JLL took 37.8s. Estimated remaining: 2h 50m 11s. Rate: 7.1 symbols/min [2025-10-10T19:43:55.217066] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:43:55.225218] [DEBUG] [LOCAL ] JOF: Loaded 6915 existing records from primary storage. [2025-10-10T19:43:55.225425] [INFO ] [MAIN ] JOF: Loaded 6915 existing records. [2025-10-10T19:43:55.397181] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:43:55.397380] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-10T19:43:55.397426] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-10T19:43:55.397702] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-10T19:43:55.397760] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-10T19:43:55.494763] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-10T19:43:55.748560] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:43:55.948999] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T19:43:56.289352] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-10T19:43:56.565293] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-10-10T19:43:57.089389] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-10T19:43:57.677195] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-10T19:43:57.889398] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-10T19:43:58.046902] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-10T19:43:58.241506] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-10T19:43:58.690380] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-10T19:43:59.194964] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T19:43:59.452788] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-10T19:43:59.489365] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-10T19:44:00.190993] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T19:44:00.289381] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-10T19:44:01.089356] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-10T19:44:01.189669] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-10T19:44:01.889400] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-10T19:44:02.568860] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-10T19:44:02.689396] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-10T19:44:03.489353] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-10T19:44:04.009499] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-10T19:44:04.105773] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-10T19:44:04.289377] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-10T19:44:05.089357] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-10T19:44:05.592229] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T19:44:05.849910] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-10T19:44:05.889388] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-10T19:44:06.689385] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-10T19:44:07.398531] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-10T19:44:07.489336] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-10T19:44:07.718543] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-10T19:44:08.289380] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-10T19:44:08.880827] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-10T19:44:09.095437] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-10T19:44:09.124005] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-10T19:44:09.889348] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-10T19:44:10.000924] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-10T19:44:10.628781] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-10T19:44:10.689356] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-10T19:44:11.065375] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-10T19:44:11.489375] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-10T19:44:12.289387] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-10T19:44:12.510457] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-10T19:44:12.670045] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-10T19:44:12.966772] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-10T19:44:13.089416] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-10T19:44:13.889370] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-10T19:44:14.689407] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-10T19:44:15.202754] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T19:44:15.489797] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-10T19:44:15.514430] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-10T19:44:15.517137] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-10T19:44:16.289396] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-10T19:44:17.089385] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-10T19:44:17.889428] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-10T19:44:18.015479] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T19:44:18.529974] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (3.04 seconds). [2025-10-10T19:44:18.582763] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-10T19:44:18.588199] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-10-10T19:44:18.588368] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-10T19:44:18.695179] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-10T19:44:18.899187] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-10T19:44:18.925323] [INFO ] [REMOTE ] JOE: Full fetch complete (35637 records). [2025-10-10T19:44:18.941492] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-10T19:44:19.149780] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-10T19:44:19.149947] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-10T19:44:19.151699] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-10T19:44:19.157693] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-10T19:44:19.235209] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 54533 (keeping 200 days of data) [2025-10-10T19:44:19.498965] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-10T19:44:19.563582] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-10T19:44:19.564199] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-10T19:44:19.565447] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-10T19:44:19.566853] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-10T19:44:19.573753] [DEBUG] [LOCAL ] JOE: Trimmed 35637 records to 24247 (keeping 200 days of data) [2025-10-10T19:44:19.770782] [DEBUG] [LOCAL ] JOE: Primary data saved (24247 records). [2025-10-10T19:44:19.777320] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-10T19:44:19.777592] [INFO ] [MAIN ] Update Progress: 1165/2373 symbols completed. JOE took 26.2s. Estimated remaining: 2h 50m 20s. Rate: 7.1 symbols/min [2025-10-10T19:44:20.069871] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:44:20.077930] [DEBUG] [LOCAL ] JPC: No existing data file found in primary storage. [2025-10-10T19:44:20.078076] [WARN ] [MAIN ] JPC: No existing data found, performing full refresh instead. [2025-10-10T19:44:20.089198] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-10T19:44:20.090722] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-10T19:44:20.092792] [DEBUG] [LOCAL ] JPC: No primary data file found to delete. [2025-10-10T19:44:20.098948] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-10T19:44:20.443394] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-10T19:44:20.509781] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-10T19:44:20.605529] [DEBUG] [LOCAL ] JNJ: Primary data saved (54533 records). [2025-10-10T19:44:20.612610] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:44:20.613167] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-10T19:44:20.613967] [INFO ] [MAIN ] Update Progress: 1166/2373 symbols completed. JNJ took 50.8s. Estimated remaining: 2h 50m 3s. Rate: 7.1 symbols/min [2025-10-10T19:44:20.821154] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:44:20.875142] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-10-10T19:44:20.875558] [INFO ] [MAIN ] JPM: Loaded 54184 existing records. [2025-10-10T19:44:21.061172] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:44:21.061453] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-10T19:44:21.061500] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-10T19:44:21.062900] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-10T19:44:21.062958] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-10T19:44:21.093524] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-10T19:44:21.350337] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T19:44:21.373476] [INFO ] [REMOTE ] JOF: Full fetch complete (9521 records). [2025-10-10T19:44:21.379246] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-10T19:44:21.501739] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:44:21.843482] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-10T19:44:21.843600] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-10T19:44:21.844083] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-10T19:44:21.844202] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-10T19:44:21.845008] [DEBUG] [LOCAL ] JOF: Trimmed 9521 records to 6991 (keeping 200 days of data) [2025-10-10T19:44:21.891036] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-10T19:44:21.947573] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (3.25 seconds). [2025-10-10T19:44:21.963867] [DEBUG] [LOCAL ] JOF: Primary data saved (6991 records). [2025-10-10T19:44:21.964717] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-10T19:44:21.964893] [INFO ] [MAIN ] Update Progress: 1167/2373 symbols completed. JOF took 26.9s. Estimated remaining: 2h 49m 47s. Rate: 7.1 symbols/min [2025-10-10T19:44:22.171878] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:44:22.210558] [DEBUG] [LOCAL ] JQC: Loaded 34386 existing records from primary storage. [2025-10-10T19:44:22.211116] [INFO ] [MAIN ] JQC: Loaded 34386 existing records. [2025-10-10T19:44:22.429149] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T19:44:22.433804] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:44:22.443356] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-10T19:44:22.443460] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-10T19:44:22.445205] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-10T19:44:22.445270] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-10T19:44:22.694600] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-10T19:44:22.789525] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:44:23.489399] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-10T19:44:24.289358] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-10T19:44:24.366528] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-10T19:44:24.927989] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-10T19:44:25.089421] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-10T19:44:25.544796] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-10T19:44:25.591471] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-10-10T19:44:25.889361] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-10T19:44:26.199786] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-10T19:44:26.689403] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-10T19:44:27.489413] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-10T19:44:28.016046] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T19:44:28.289397] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-10T19:44:28.882045] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.99 seconds). [2025-10-10T19:44:29.089391] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-10T19:44:29.133545] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T19:44:29.312697] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-10T19:44:29.889415] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-10T19:44:30.689438] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-10T19:44:31.334015] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-10T19:44:31.489381] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-10T19:44:31.658258] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-10T19:44:31.663292] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-10-10T19:44:31.663411] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-10T19:44:32.080248] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T19:44:32.113437] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-10T19:44:32.113957] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-10T19:44:32.115721] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-10T19:44:32.115847] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-10T19:44:32.118213] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 54581 (keeping 200 days of data) [2025-10-10T19:44:32.291807] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-10T19:44:32.441546] [DEBUG] [LOCAL ] JOBY: Primary data saved (54581 records). [2025-10-10T19:44:32.441717] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-10T19:44:32.441817] [INFO ] [MAIN ] Update Progress: 1168/2373 symbols completed. JOBY took 49.4s. Estimated remaining: 2h 49m 41s. Rate: 7.1 symbols/min [2025-10-10T19:44:32.618072] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:44:32.633729] [DEBUG] [LOCAL ] JRI: Loaded 15351 existing records from primary storage. [2025-10-10T19:44:32.633968] [INFO ] [MAIN ] JRI: Loaded 15351 existing records. [2025-10-10T19:44:32.808284] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:44:32.808635] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-10T19:44:32.808962] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-10T19:44:32.809435] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-10T19:44:32.809496] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-10T19:44:33.090225] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-10T19:44:33.210913] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:44:33.227287] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T19:44:33.889395] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-10T19:44:34.260269] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T19:44:34.399514] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-10T19:44:34.689395] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-10T19:44:34.819091] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-10T19:44:35.489431] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-10T19:44:36.138169] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-10T19:44:36.289399] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-10T19:44:37.089408] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-10T19:44:37.834063] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-10T19:44:37.863325] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T19:44:37.889346] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-10T19:44:38.262128] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-10T19:44:38.689425] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-10T19:44:39.013277] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-10T19:44:39.489373] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-10T19:44:39.765540] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T19:44:40.289443] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-10T19:44:41.089434] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-10T19:44:41.378323] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-10T19:44:41.889358] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-10T19:44:42.018185] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-10T19:44:42.055266] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-10T19:44:42.689417] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-10T19:44:43.068573] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-10T19:44:43.489461] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-10T19:44:44.289380] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-10T19:44:44.581979] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-10T19:44:45.089455] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-10T19:44:45.404590] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-10T19:44:45.592069] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T19:44:45.889379] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-10T19:44:46.218941] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-10T19:44:46.223404] [INFO ] [REMOTE ] JQC: Full fetch complete (49572 records). [2025-10-10T19:44:46.223553] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-10T19:44:46.620061] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-10T19:44:46.620149] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-10T19:44:46.621073] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-10T19:44:46.621139] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-10T19:44:46.622302] [DEBUG] [LOCAL ] JQC: Trimmed 49572 records to 34731 (keeping 200 days of data) [2025-10-10T19:44:46.706072] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-10T19:44:46.827092] [DEBUG] [LOCAL ] JQC: Primary data saved (34731 records). [2025-10-10T19:44:46.827238] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-10T19:44:46.827330] [INFO ] [MAIN ] Update Progress: 1169/2373 symbols completed. JQC took 24.9s. Estimated remaining: 2h 49m 39s. Rate: 7.1 symbols/min [2025-10-10T19:44:47.013848] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:44:47.027133] [DEBUG] [LOCAL ] JRS: Loaded 11656 existing records from primary storage. [2025-10-10T19:44:47.027470] [INFO ] [MAIN ] JRS: Loaded 11656 existing records. [2025-10-10T19:44:47.221522] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:44:47.222050] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-10T19:44:47.222131] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-10T19:44:47.222565] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-10T19:44:47.222626] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-10T19:44:47.493779] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-10T19:44:47.599325] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T19:44:47.619571] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:44:48.289437] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-10T19:44:48.651056] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-10T19:44:48.891436] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-10T19:44:49.089413] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-10T19:44:49.889367] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-10T19:44:49.938577] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-10T19:44:49.943698] [INFO ] [REMOTE ] JPC: Full fetch complete (55355 records). [2025-10-10T19:44:49.943976] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-10T19:44:50.350150] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-10T19:44:50.350282] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-10T19:44:50.351706] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-10T19:44:50.351774] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-10T19:44:50.353329] [DEBUG] [LOCAL ] JPC: Trimmed 55355 records to 37827 (keeping 200 days of data) [2025-10-10T19:44:50.585301] [DEBUG] [LOCAL ] JPC: Primary data saved (37827 records). [2025-10-10T19:44:50.585515] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-10T19:44:50.585690] [INFO ] [MAIN ] Update Progress: 1170/2373 symbols completed. JPC took 30.8s. Estimated remaining: 2h 49m 25s. Rate: 7.1 symbols/min [2025-10-10T19:44:50.689552] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-10T19:44:50.770470] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:44:50.804941] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-10T19:44:50.827266] [DEBUG] [LOCAL ] JXN: Loaded 45365 existing records from primary storage. [2025-10-10T19:44:50.827717] [INFO ] [MAIN ] JXN: Loaded 45365 existing records. [2025-10-10T19:44:51.018464] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:44:51.018991] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-10T19:44:51.019139] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-10T19:44:51.020141] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-10T19:44:51.020208] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-10T19:44:51.405369] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:44:51.418386] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-10T19:44:51.460427] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-10T19:44:51.489367] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-10T19:44:52.289394] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-10T19:44:53.089359] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-10T19:44:53.204239] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-10T19:44:53.292823] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T19:44:53.889360] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-10T19:44:54.150593] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-10T19:44:54.689434] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-10T19:44:54.817060] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-10T19:44:55.489388] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-10T19:44:56.289424] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-10T19:44:56.477869] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-10T19:44:56.933150] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-10T19:44:57.089381] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-10T19:44:57.889395] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-10T19:44:57.969037] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-10T19:44:58.179371] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T19:44:58.689438] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-10T19:44:58.836690] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-10T19:44:59.489404] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-10T19:44:59.546554] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-10T19:45:00.289415] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-10T19:45:00.408986] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-10T19:45:01.089487] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-10T19:45:01.430986] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-10T19:45:01.889355] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-10T19:45:02.126339] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-10T19:45:02.689350] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-10T19:45:03.099147] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-10T19:45:03.489387] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-10T19:45:04.289413] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-10T19:45:04.418328] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T19:45:04.491219] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-10T19:45:05.089421] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-10T19:45:05.429935] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T19:45:05.432147] [INFO ] [REMOTE ] JRI: Full fetch complete (23285 records). [2025-10-10T19:45:05.432218] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-10T19:45:05.794736] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-10T19:45:05.794841] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-10T19:45:05.795404] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-10T19:45:05.795464] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-10T19:45:05.796088] [DEBUG] [LOCAL ] JRI: Trimmed 23285 records to 15506 (keeping 200 days of data) [2025-10-10T19:45:05.890430] [DEBUG] [LOCAL ] JRI: Primary data saved (15506 records). [2025-10-10T19:45:05.890679] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-10T19:45:05.890271] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-10T19:45:05.891006] [INFO ] [MAIN ] Update Progress: 1171/2373 symbols completed. JRI took 33.4s. Estimated remaining: 2h 49m 24s. Rate: 7.1 symbols/min [2025-10-10T19:45:06.058759] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:45:06.103485] [DEBUG] [LOCAL ] K: Loaded 50465 existing records from primary storage. [2025-10-10T19:45:06.103829] [INFO ] [MAIN ] K: Loaded 50465 existing records. [2025-10-10T19:45:06.274679] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:45:06.274885] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-10T19:45:06.274930] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-10T19:45:06.275835] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-10T19:45:06.275893] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-10T19:45:06.658339] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:45:06.689390] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-10T19:45:07.489388] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-10T19:45:07.556758] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-10T19:45:07.970588] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T19:45:08.289354] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-10T19:45:08.462994] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-10T19:45:08.571988] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T19:45:09.089385] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-10T19:45:09.889411] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-10T19:45:10.689399] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-10T19:45:11.008551] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-10-10T19:45:11.122454] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T19:45:11.489361] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-10T19:45:11.716037] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-10T19:45:11.873187] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T19:45:12.289380] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-10T19:45:12.746735] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T19:45:13.089397] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-10T19:45:13.889399] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-10T19:45:14.689397] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-10T19:45:14.851778] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-10T19:45:14.857555] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-10-10T19:45:14.857794] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-10T19:45:14.970941] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T19:45:14.998004] [INFO ] [REMOTE ] JRS: Full fetch complete (16355 records). [2025-10-10T19:45:15.047700] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-10T19:45:15.161085] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T19:45:15.499603] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-10T19:45:15.568578] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-10T19:45:15.607150] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-10T19:45:15.614063] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-10T19:45:15.619281] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-10T19:45:15.691008] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 54574 (keeping 200 days of data) [2025-10-10T19:45:15.704241] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-10T19:45:15.704431] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-10T19:45:15.705110] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-10T19:45:15.705198] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-10T19:45:15.706114] [DEBUG] [LOCAL ] JRS: Trimmed 16355 records to 11760 (keeping 200 days of data) [2025-10-10T19:45:15.886973] [DEBUG] [LOCAL ] JRS: Primary data saved (11760 records). [2025-10-10T19:45:15.892712] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-10T19:45:15.905778] [INFO ] [MAIN ] Update Progress: 1172/2373 symbols completed. JRS took 29.1s. Estimated remaining: 2h 49m 17s. Rate: 7.1 symbols/min [2025-10-10T19:45:16.208221] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:45:16.286493] [DEBUG] [LOCAL ] KAI: Loaded 13436 existing records from primary storage. [2025-10-10T19:45:16.294271] [INFO ] [MAIN ] KAI: Loaded 13436 existing records. [2025-10-10T19:45:16.512486] [DEBUG] [LOCAL ] JPM: Primary data saved (54574 records). [2025-10-10T19:45:16.532942] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-10T19:45:16.533104] [INFO ] [MAIN ] Update Progress: 1173/2373 symbols completed. JPM took 55.9s. Estimated remaining: 2h 49m 1s. Rate: 7.1 symbols/min [2025-10-10T19:45:16.532628] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:45:16.545936] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-10T19:45:16.585708] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-10T19:45:16.626032] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-10T19:45:16.631503] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-10T19:45:16.681373] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T19:45:16.874821] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:45:16.870274] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-10T19:45:17.142964] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:45:17.143375] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-10T19:45:17.158015] [DEBUG] [LOCAL ] KAR: Loaded 40359 existing records from primary storage. [2025-10-10T19:45:17.158390] [INFO ] [MAIN ] KAR: Loaded 40359 existing records. [2025-10-10T19:45:17.365267] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:45:17.365513] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-10T19:45:17.365585] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-10T19:45:17.366353] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-10T19:45:17.366424] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-10T19:45:17.772167] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:45:17.804591] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-10T19:45:17.808864] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-10T19:45:17.889331] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-10T19:45:18.689416] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-10T19:45:18.896773] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T19:45:19.274252] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-10T19:45:19.489353] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-10T19:45:19.629449] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-10T19:45:20.289390] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-10T19:45:21.089353] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-10T19:45:21.121157] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T19:45:21.541741] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T19:45:21.889411] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-10T19:45:22.610065] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T19:45:22.689371] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-10T19:45:23.309453] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-10T19:45:23.489374] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-10T19:45:24.289383] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-10T19:45:24.394711] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T19:45:25.089400] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-10T19:45:25.414392] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T19:45:25.468077] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-10T19:45:25.889361] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-10T19:45:26.174850] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-10T19:45:26.689408] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-10T19:45:27.083142] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-10T19:45:27.489444] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-10T19:45:28.289404] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-10T19:45:28.620758] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T19:45:28.700373] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-10T19:45:28.704218] [INFO ] [REMOTE ] JXN: Full fetch complete (65169 records). [2025-10-10T19:45:28.704354] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-10T19:45:29.094586] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-10T19:45:29.095156] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-10T19:45:29.096342] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-10T19:45:29.097912] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-10T19:45:29.098167] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-10T19:45:29.101199] [DEBUG] [LOCAL ] JXN: Trimmed 65169 records to 45676 (keeping 200 days of data) [2025-10-10T19:45:29.416218] [DEBUG] [LOCAL ] JXN: Primary data saved (45676 records). [2025-10-10T19:45:29.417138] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-10T19:45:29.417275] [INFO ] [MAIN ] Update Progress: 1174/2373 symbols completed. JXN took 38.8s. Estimated remaining: 2h 48m 57s. Rate: 7.1 symbols/min [2025-10-10T19:45:29.604902] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:45:29.629882] [DEBUG] [LOCAL ] KB: Loaded 23768 existing records from primary storage. [2025-10-10T19:45:29.630231] [INFO ] [MAIN ] KB: Loaded 23768 existing records. [2025-10-10T19:45:29.815780] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:45:29.816677] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-10T19:45:29.816935] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-10T19:45:29.817573] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-10T19:45:29.817637] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-10T19:45:29.894524] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-10T19:45:30.096573] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T19:45:30.238360] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:45:30.248020] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-10T19:45:30.689376] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-10T19:45:31.493210] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-10T19:45:31.495683] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-10T19:45:31.738428] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T19:45:32.289441] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-10T19:45:32.908456] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T19:45:33.089443] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-10T19:45:33.840397] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T19:45:33.880027] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-10T19:45:33.889355] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-10T19:45:34.689377] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-10T19:45:35.214566] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T19:45:35.489424] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-10T19:45:36.289386] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-10T19:45:36.609033] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T19:45:37.089354] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-10T19:45:37.148381] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T19:45:37.244096] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-10T19:45:37.889351] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-10T19:45:38.164046] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-10T19:45:38.689352] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-10T19:45:39.489462] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-10T19:45:39.702477] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T19:45:40.080432] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T19:45:40.289396] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-10T19:45:40.547001] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-10T19:45:41.089430] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-10T19:45:41.889348] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-10T19:45:42.205713] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-10T19:45:42.211033] [INFO ] [REMOTE ] K: Full fetch complete (72099 records). [2025-10-10T19:45:42.211149] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-10T19:45:42.614260] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-10T19:45:42.614358] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-10T19:45:42.615401] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-10T19:45:42.615505] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-10T19:45:42.617059] [DEBUG] [LOCAL ] K: Trimmed 72099 records to 50837 (keeping 200 days of data) [2025-10-10T19:45:42.708723] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-10T19:45:42.746270] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T19:45:42.960371] [DEBUG] [LOCAL ] K: Primary data saved (50837 records). [2025-10-10T19:45:42.960504] [INFO ] [MAIN ] K: Full history saved. [2025-10-10T19:45:42.961024] [INFO ] [MAIN ] Update Progress: 1175/2373 symbols completed. K took 37.1s. Estimated remaining: 2h 48m 53s. Rate: 7.1 symbols/min [2025-10-10T19:45:43.128183] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:45:43.148363] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T19:45:43.173519] [DEBUG] [LOCAL ] KBDC: Loaded 21910 existing records from primary storage. [2025-10-10T19:45:43.173790] [INFO ] [MAIN ] KBDC: Loaded 21910 existing records. [2025-10-10T19:45:43.353057] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:45:43.353237] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-10T19:45:43.353282] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-10T19:45:43.353809] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-10T19:45:43.353867] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-10T19:45:43.498704] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-10T19:45:43.740219] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:45:43.742190] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-10T19:45:44.289413] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-10T19:45:44.871808] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T19:45:45.089344] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-10T19:45:45.318877] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-10T19:45:45.889368] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-10T19:45:46.558347] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-10T19:45:46.689348] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-10T19:45:46.896933] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-10T19:45:46.898747] [INFO ] [REMOTE ] KAI: Full fetch complete (18907 records). [2025-10-10T19:45:46.898829] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-10T19:45:47.266936] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-10T19:45:47.267016] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-10T19:45:47.267466] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-10T19:45:47.267504] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-10T19:45:47.268156] [DEBUG] [LOCAL ] KAI: Trimmed 18907 records to 13601 (keeping 200 days of data) [2025-10-10T19:45:47.353513] [DEBUG] [LOCAL ] KAI: Primary data saved (13601 records). [2025-10-10T19:45:47.353636] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-10T19:45:47.353751] [INFO ] [MAIN ] Update Progress: 1176/2373 symbols completed. KAI took 31.4s. Estimated remaining: 2h 48m 41s. Rate: 7.1 symbols/min [2025-10-10T19:45:47.497577] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-10T19:45:47.530706] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:45:47.573241] [DEBUG] [LOCAL ] KBH: Loaded 49233 existing records from primary storage. [2025-10-10T19:45:47.573539] [INFO ] [MAIN ] KBH: Loaded 49233 existing records. [2025-10-10T19:45:47.750512] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:45:47.750688] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-10T19:45:47.750745] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-10T19:45:47.751809] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-10T19:45:47.751867] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-10T19:45:48.031782] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T19:45:48.136595] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:45:48.289400] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-10T19:45:49.089383] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-10T19:45:49.167130] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T19:45:49.889358] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-10T19:45:50.243633] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T19:45:50.315240] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-10T19:45:50.689403] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-10T19:45:51.090054] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T19:45:51.489422] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-10T19:45:52.144697] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T19:45:52.289428] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-10T19:45:52.962404] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-10T19:45:53.089404] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-10T19:45:53.889428] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-10T19:45:54.131478] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T19:45:54.250777] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-10T19:45:54.689381] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-10T19:45:55.046296] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T19:45:55.489397] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-10T19:45:56.289375] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-10T19:45:56.473422] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T19:45:56.744089] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-10T19:45:57.089483] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-10T19:45:57.495419] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-10T19:45:57.499395] [INFO ] [REMOTE ] KAR: Full fetch complete (56770 records). [2025-10-10T19:45:57.499486] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-10T19:45:57.894200] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-10T19:45:57.894509] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-10T19:45:57.893699] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-10T19:45:57.896308] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-10T19:45:57.897537] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-10T19:45:57.899914] [DEBUG] [LOCAL ] KAR: Trimmed 56770 records to 40626 (keeping 200 days of data) [2025-10-10T19:45:58.025516] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-10T19:45:58.176535] [DEBUG] [LOCAL ] KAR: Primary data saved (40626 records). [2025-10-10T19:45:58.176783] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-10T19:45:58.176903] [INFO ] [MAIN ] Update Progress: 1177/2373 symbols completed. KAR took 41.6s. Estimated remaining: 2h 48m 35s. Rate: 7.1 symbols/min [2025-10-10T19:45:58.356800] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:45:58.403185] [DEBUG] [LOCAL ] KBR: Loaded 48203 existing records from primary storage. [2025-10-10T19:45:58.403666] [INFO ] [MAIN ] KBR: Loaded 48203 existing records. [2025-10-10T19:45:58.584711] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:45:58.584968] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-10T19:45:58.585018] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-10T19:45:58.585889] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-10T19:45:58.585947] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-10T19:45:58.692997] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-10T19:45:58.951915] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:45:59.090561] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T19:45:59.092769] [INFO ] [REMOTE ] KB: Full fetch complete (33758 records). [2025-10-10T19:45:59.092864] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-10T19:45:59.464926] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-10T19:45:59.465004] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-10T19:45:59.465701] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-10T19:45:59.465764] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-10T19:45:59.466584] [DEBUG] [LOCAL ] KB: Trimmed 33758 records to 23980 (keeping 200 days of data) [2025-10-10T19:45:59.520441] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-10T19:45:59.613660] [DEBUG] [LOCAL ] KB: Primary data saved (23980 records). [2025-10-10T19:45:59.613809] [INFO ] [MAIN ] KB: Full history saved. [2025-10-10T19:45:59.613922] [INFO ] [MAIN ] Update Progress: 1178/2373 symbols completed. KB took 30.2s. Estimated remaining: 2h 48m 19s. Rate: 7.1 symbols/min [2025-10-10T19:45:59.789534] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:45:59.847746] [DEBUG] [LOCAL ] KD: Loaded 52707 existing records from primary storage. [2025-10-10T19:45:59.848197] [INFO ] [MAIN ] KD: Loaded 52707 existing records. [2025-10-10T19:46:00.039261] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:46:00.039573] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-10T19:46:00.039712] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-10T19:46:00.040956] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-10T19:46:00.041018] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-10T19:46:00.299421] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-10T19:46:00.420638] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:46:00.687968] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T19:46:01.089348] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-10T19:46:01.454066] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T19:46:01.509943] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-10T19:46:01.889410] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-10T19:46:02.689396] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-10T19:46:02.885973] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T19:46:03.489412] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-10T19:46:03.719899] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T19:46:03.947461] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-10T19:46:04.289390] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-10T19:46:05.089343] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-10T19:46:05.559409] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-10T19:46:05.673493] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T19:46:05.803264] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-10T19:46:05.889352] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-10T19:46:06.689353] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-10T19:46:07.131851] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T19:46:07.489393] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-10T19:46:08.289415] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-10T19:46:08.503415] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T19:46:08.828802] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T19:46:09.089401] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-10T19:46:09.889406] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-10T19:46:10.194409] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T19:46:10.323326] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-10T19:46:10.689411] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-10T19:46:11.391608] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T19:46:11.489353] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-10T19:46:12.285202] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-10T19:46:12.291310] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-10T19:46:13.089367] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-10T19:46:13.312084] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T19:46:13.889342] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-10T19:46:14.065034] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T19:46:14.350452] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T19:46:14.353801] [INFO ] [REMOTE ] KBDC: Full fetch complete (29780 records). [2025-10-10T19:46:14.353877] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-10T19:46:14.701718] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-10T19:46:14.715364] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-10T19:46:14.715428] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-10T19:46:14.716075] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-10T19:46:14.716136] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-10T19:46:14.717036] [DEBUG] [LOCAL ] KBDC: Trimmed 29780 records to 22135 (keeping 200 days of data) [2025-10-10T19:46:14.854499] [DEBUG] [LOCAL ] KBDC: Primary data saved (22135 records). [2025-10-10T19:46:14.854630] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-10T19:46:14.854751] [INFO ] [MAIN ] Update Progress: 1179/2373 symbols completed. KBDC took 31.9s. Estimated remaining: 2h 48m 18s. Rate: 7.1 symbols/min [2025-10-10T19:46:15.019742] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:46:15.026095] [DEBUG] [LOCAL ] KEN: Loaded 4702 existing records from primary storage. [2025-10-10T19:46:15.026273] [INFO ] [MAIN ] KEN: Loaded 4702 existing records. [2025-10-10T19:46:15.196571] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:46:15.196845] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-10T19:46:15.196897] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-10T19:46:15.197152] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-10T19:46:15.197208] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-10T19:46:15.494575] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-10T19:46:15.568847] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:46:15.794997] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T19:46:16.289406] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-10T19:46:16.732328] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T19:46:17.089366] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-10T19:46:17.485866] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T19:46:17.762181] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-10T19:46:17.889342] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-10T19:46:18.689343] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-10T19:46:19.067012] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-10T19:46:19.071579] [INFO ] [REMOTE ] KBH: Full fetch complete (70810 records). [2025-10-10T19:46:19.071714] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-10T19:46:19.333187] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-10T19:46:19.465305] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-10T19:46:19.465409] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-10T19:46:19.466392] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-10T19:46:19.466576] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-10T19:46:19.468002] [DEBUG] [LOCAL ] KBH: Trimmed 70810 records to 49611 (keeping 200 days of data) [2025-10-10T19:46:19.519964] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-10T19:46:19.806517] [DEBUG] [LOCAL ] KBH: Primary data saved (49611 records). [2025-10-10T19:46:19.807507] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-10T19:46:19.809092] [INFO ] [MAIN ] Update Progress: 1180/2373 symbols completed. KBH took 32.5s. Estimated remaining: 2h 48m 6s. Rate: 7.1 symbols/min [2025-10-10T19:46:19.808941] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T19:46:19.992457] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:46:20.023611] [DEBUG] [LOCAL ] KEP: Loaded 31601 existing records from primary storage. [2025-10-10T19:46:20.023942] [INFO ] [MAIN ] KEP: Loaded 31601 existing records. [2025-10-10T19:46:20.201258] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:46:20.201465] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-10T19:46:20.201511] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-10T19:46:20.202116] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-10T19:46:20.202173] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-10T19:46:20.301722] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-10T19:46:20.294750] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-10T19:46:20.552963] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:46:21.089366] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-10T19:46:21.889383] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-10T19:46:22.025016] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-10T19:46:22.424095] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-10T19:46:22.689403] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-10T19:46:23.093235] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T19:46:23.375423] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-10T19:46:23.489403] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-10T19:46:24.289446] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-10T19:46:24.409618] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-10T19:46:25.089422] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-10T19:46:25.889427] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-10T19:46:26.151269] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T19:46:26.689351] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-10T19:46:26.889615] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T19:46:27.353446] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-10T19:46:27.374805] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-10T19:46:27.489395] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-10T19:46:28.289358] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-10T19:46:28.826069] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T19:46:29.008807] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-10T19:46:29.089343] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-10T19:46:29.849168] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-10T19:46:29.889343] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-10T19:46:30.614313] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-10T19:46:30.689351] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-10T19:46:31.489393] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-10T19:46:32.284695] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T19:46:32.289340] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-10T19:46:32.289686] [INFO ] [REMOTE ] KBR: Full fetch complete (69744 records). [2025-10-10T19:46:32.290495] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-10T19:46:32.680508] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-10T19:46:32.680586] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-10T19:46:32.681499] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-10T19:46:32.681561] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-10T19:46:32.682892] [DEBUG] [LOCAL ] KBR: Trimmed 69744 records to 48571 (keeping 200 days of data) [2025-10-10T19:46:32.797273] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T19:46:33.008865] [DEBUG] [LOCAL ] KBR: Primary data saved (48571 records). [2025-10-10T19:46:33.008971] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-10T19:46:33.009057] [INFO ] [MAIN ] Update Progress: 1181/2373 symbols completed. KBR took 34.8s. Estimated remaining: 2h 48m 2s. Rate: 7.1 symbols/min [2025-10-10T19:46:33.093543] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-10T19:46:33.102935] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-10T19:46:33.197302] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:46:33.235499] [DEBUG] [LOCAL ] KEX: Loaded 38809 existing records from primary storage. [2025-10-10T19:46:33.235840] [INFO ] [MAIN ] KEX: Loaded 38809 existing records. [2025-10-10T19:46:33.450163] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:46:33.450405] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-10T19:46:33.450451] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-10T19:46:33.451144] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-10T19:46:33.451203] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-10T19:46:33.804188] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:46:33.889352] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-10T19:46:34.689393] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-10T19:46:34.996757] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T19:46:35.489366] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-10T19:46:35.518984] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T19:46:35.956898] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-10T19:46:36.289370] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-10T19:46:37.089371] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-10T19:46:37.355926] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-10T19:46:37.356765] [INFO ] [REMOTE ] KEN: Full fetch complete (5947 records). [2025-10-10T19:46:37.356865] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-10T19:46:37.660215] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T19:46:37.758455] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-10T19:46:37.758529] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-10T19:46:37.758735] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-10T19:46:37.758796] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-10T19:46:37.759176] [DEBUG] [LOCAL ] KEN: Trimmed 5947 records to 4721 (keeping 200 days of data) [2025-10-10T19:46:37.786496] [DEBUG] [LOCAL ] KEN: Primary data saved (4721 records). [2025-10-10T19:46:37.786596] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-10T19:46:37.786698] [INFO ] [MAIN ] Update Progress: 1182/2373 symbols completed. KEN took 22.9s. Estimated remaining: 2h 47m 50s. Rate: 7.1 symbols/min [2025-10-10T19:46:37.894523] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-10T19:46:37.956019] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:46:37.956205] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-10T19:46:37.956279] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-10T19:46:37.956437] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-10T19:46:37.956507] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-10T19:46:37.956600] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-10T19:46:37.956704] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-10T19:46:38.324394] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:46:38.650743] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-10T19:46:38.689368] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-10T19:46:39.489352] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-10T19:46:40.126682] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-10T19:46:40.247760] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-10T19:46:40.289394] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-10T19:46:41.089453] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-10T19:46:41.467483] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T19:46:41.889423] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-10T19:46:42.331359] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-10T19:46:42.689402] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-10T19:46:42.745975] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T19:46:43.292932] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-10T19:46:43.489465] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-10T19:46:44.289383] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-10T19:46:44.611747] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-10T19:46:44.618531] [INFO ] [REMOTE ] KD: Full fetch complete (75741 records). [2025-10-10T19:46:44.618680] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-10T19:46:45.012502] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-10T19:46:45.012584] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-10T19:46:45.013569] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-10T19:46:45.013633] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-10T19:46:45.015108] [DEBUG] [LOCAL ] KD: Trimmed 75741 records to 53097 (keeping 200 days of data) [2025-10-10T19:46:45.100331] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-10T19:46:45.258598] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T19:46:45.371676] [DEBUG] [LOCAL ] KD: Primary data saved (53097 records). [2025-10-10T19:46:45.371882] [INFO ] [MAIN ] KD: Full history saved. [2025-10-10T19:46:45.371989] [INFO ] [MAIN ] Update Progress: 1183/2373 symbols completed. KD took 45.8s. Estimated remaining: 2h 47m 41s. Rate: 7.1 symbols/min [2025-10-10T19:46:45.553041] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:46:45.593822] [DEBUG] [LOCAL ] KEYS: Loaded 43424 existing records from primary storage. [2025-10-10T19:46:45.594134] [INFO ] [MAIN ] KEYS: Loaded 43424 existing records. [2025-10-10T19:46:45.778007] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:46:45.778237] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-10T19:46:45.778283] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-10T19:46:45.779150] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-10T19:46:45.779211] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-10T19:46:45.892277] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-10T19:46:46.143746] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:46:46.253466] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T19:46:46.347796] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-10T19:46:46.689367] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-10T19:46:47.489354] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-10T19:46:47.699144] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T19:46:48.289463] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-10T19:46:48.488384] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T19:46:49.089386] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-10T19:46:49.262811] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T19:46:49.748950] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T19:46:49.889376] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-10T19:46:50.689417] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-10T19:46:51.093623] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T19:46:51.489344] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-10T19:46:51.612037] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T19:46:52.289348] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-10T19:46:52.475129] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T19:46:53.089407] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-10T19:46:53.603896] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T19:46:53.889394] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-10T19:46:53.980133] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T19:46:54.689436] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-10T19:46:54.969423] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T19:46:55.489356] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-10T19:46:55.603311] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-10T19:46:56.078430] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-10T19:46:56.289381] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-10T19:46:57.089362] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-10T19:46:57.300421] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T19:46:57.889346] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-10T19:46:58.020714] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-10T19:46:58.673343] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T19:46:58.677756] [INFO ] [REMOTE ] KEX: Full fetch complete (55786 records). [2025-10-10T19:46:58.677869] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-10T19:46:58.695096] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-10T19:46:59.061533] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-10T19:46:59.061610] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-10T19:46:59.062417] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-10T19:46:59.062478] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-10T19:46:59.063587] [DEBUG] [LOCAL ] KEX: Trimmed 55786 records to 39119 (keeping 200 days of data) [2025-10-10T19:46:59.294980] [DEBUG] [LOCAL ] KEX: Primary data saved (39119 records). [2025-10-10T19:46:59.295111] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-10T19:46:59.295190] [INFO ] [MAIN ] Update Progress: 1184/2373 symbols completed. KEX took 26.3s. Estimated remaining: 2h 47m 38s. Rate: 7.1 symbols/min [2025-10-10T19:46:59.463744] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:46:59.467588] [DEBUG] [LOCAL ] KF: Loaded 2381 existing records from primary storage. [2025-10-10T19:46:59.467761] [INFO ] [MAIN ] KF: Loaded 2381 existing records. [2025-10-10T19:46:59.498131] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-10T19:46:59.647958] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:46:59.648208] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-10T19:46:59.648355] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-10T19:46:59.648556] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-10T19:46:59.648613] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-10T19:47:00.008390] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:47:00.028608] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-10T19:47:00.289349] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-10T19:47:00.748669] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-10T19:47:01.089385] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-10T19:47:01.220521] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-10T19:47:01.864606] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-10T19:47:01.889339] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-10T19:47:02.299015] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-10T19:47:02.470829] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-10T19:47:02.689378] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-10T19:47:03.489360] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-10T19:47:04.214270] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T19:47:04.289334] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-10T19:47:05.089371] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-10T19:47:05.591590] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T19:47:05.627043] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-10T19:47:05.636147] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T19:47:05.639262] [INFO ] [REMOTE ] KEP: Full fetch complete (41817 records). [2025-10-10T19:47:05.639344] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-10T19:47:05.894547] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-10T19:47:06.005494] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-10T19:47:06.005587] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-10T19:47:06.006306] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-10T19:47:06.006366] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-10T19:47:06.007294] [DEBUG] [LOCAL ] KEP: Trimmed 41817 records to 31817 (keeping 200 days of data) [2025-10-10T19:47:06.189013] [DEBUG] [LOCAL ] KEP: Primary data saved (31817 records). [2025-10-10T19:47:06.189147] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-10T19:47:06.189228] [INFO ] [MAIN ] Update Progress: 1185/2373 symbols completed. KEP took 46.4s. Estimated remaining: 2h 47m 28s. Rate: 7.1 symbols/min [2025-10-10T19:47:06.358246] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:47:06.377354] [DEBUG] [LOCAL ] KFRC: Loaded 20191 existing records from primary storage. [2025-10-10T19:47:06.377594] [INFO ] [MAIN ] KFRC: Loaded 20191 existing records. [2025-10-10T19:47:06.554538] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-10T19:47:06.559984] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:47:06.561990] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-10T19:47:06.562040] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-10T19:47:06.562528] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-10T19:47:06.562586] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-10T19:47:06.699025] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-10T19:47:06.912547] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:47:07.456912] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-10T19:47:07.489349] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-10T19:47:08.160045] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-10T19:47:08.289394] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-10T19:47:09.089401] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-10T19:47:09.352090] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-10T19:47:09.853731] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-10T19:47:09.889430] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-10T19:47:10.447787] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-10T19:47:10.689361] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-10T19:47:11.489355] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-10T19:47:11.622565] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-10T19:47:12.289386] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-10T19:47:12.594028] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-10T19:47:13.089376] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-10T19:47:13.535501] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-10T19:47:13.565610] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T19:47:13.889406] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-10T19:47:14.409503] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-10T19:47:14.410312] [INFO ] [REMOTE ] KF: Full fetch complete (3547 records). [2025-10-10T19:47:14.410379] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-10T19:47:14.689607] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-10T19:47:14.772524] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-10T19:47:14.772615] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-10T19:47:14.772831] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-10T19:47:14.772882] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-10T19:47:14.773229] [DEBUG] [LOCAL ] KF: Trimmed 3547 records to 2400 (keeping 200 days of data) [2025-10-10T19:47:14.787214] [DEBUG] [LOCAL ] KF: Primary data saved (2400 records). [2025-10-10T19:47:14.787274] [INFO ] [MAIN ] KF: Full history saved. [2025-10-10T19:47:14.787373] [INFO ] [MAIN ] Update Progress: 1186/2373 symbols completed. KF took 15.5s. Estimated remaining: 2h 47m 19s. Rate: 7.1 symbols/min [2025-10-10T19:47:14.962158] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:47:14.972448] [DEBUG] [LOCAL ] KFS: Loaded 8608 existing records from primary storage. [2025-10-10T19:47:14.972697] [INFO ] [MAIN ] KFS: Loaded 8608 existing records. [2025-10-10T19:47:15.161760] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:47:15.162063] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-10T19:47:15.162123] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-10T19:47:15.162448] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-10T19:47:15.162506] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-10T19:47:15.494504] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-10T19:47:15.525526] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:47:16.289350] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-10T19:47:16.586244] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T19:47:16.678249] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-10T19:47:17.089446] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-10T19:47:17.869896] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-10T19:47:17.889353] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-10T19:47:17.921991] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-10T19:47:18.689373] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-10T19:47:19.428253] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-10T19:47:19.489363] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-10T19:47:19.769780] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-10T19:47:19.774778] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-10-10T19:47:19.774894] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-10T19:47:19.967029] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T19:47:19.967853] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T19:47:19.967929] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T19:47:19.968003] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-10T19:47:19.968085] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-10T19:47:19.968126] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-10T19:47:19.968181] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-10T19:47:19.968267] [INFO ] [MAIN ] Update Progress: 1187/2373 symbols completed. KEY took 42.2s. Estimated remaining: 2h 47m 7s. Rate: 7.1 symbols/min [2025-10-10T19:47:20.135144] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:47:20.164174] [DEBUG] [LOCAL ] KFY: Loaded 30040 existing records from primary storage. [2025-10-10T19:47:20.164494] [INFO ] [MAIN ] KFY: Loaded 30040 existing records. [2025-10-10T19:47:20.304550] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-10T19:47:20.344114] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:47:20.344321] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-10T19:47:20.344366] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-10T19:47:20.345041] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-10T19:47:20.345098] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-10T19:47:20.738895] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:47:20.862222] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T19:47:21.089879] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-10T19:47:21.092424] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-10T19:47:21.889364] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-10T19:47:22.689429] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-10T19:47:22.878119] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T19:47:23.331027] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-10T19:47:23.353204] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-10T19:47:23.489375] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-10T19:47:24.289379] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-10T19:47:24.365723] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-10T19:47:25.009094] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-10T19:47:25.089362] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-10T19:47:25.889342] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-10T19:47:25.981025] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-10T19:47:26.689381] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-10T19:47:27.489396] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-10T19:47:27.632091] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T19:47:28.025127] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T19:47:28.289388] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-10T19:47:28.653858] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-10T19:47:29.089395] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-10T19:47:29.748830] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T19:47:29.889347] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-10T19:47:30.084083] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-10T19:47:30.689356] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-10T19:47:31.348693] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-10T19:47:31.447317] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-10T19:47:31.489363] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-10T19:47:32.289439] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-10T19:47:32.585463] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-10T19:47:33.089432] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-10T19:47:33.274105] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T19:47:33.889410] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-10T19:47:33.970498] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-10T19:47:34.689342] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-10T19:47:35.311020] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-10T19:47:35.489378] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-10T19:47:36.042395] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T19:47:36.289403] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-10T19:47:36.341818] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-10T19:47:37.089379] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-10T19:47:37.889514] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-10T19:47:38.018529] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-10T19:47:38.022607] [INFO ] [REMOTE ] KEYS: Full fetch complete (62590 records). [2025-10-10T19:47:38.022781] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-10T19:47:38.434093] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-10T19:47:38.434218] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-10T19:47:38.435108] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-10T19:47:38.435171] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-10T19:47:38.436752] [DEBUG] [LOCAL ] KEYS: Trimmed 62590 records to 43794 (keeping 200 days of data) [2025-10-10T19:47:38.690305] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-10T19:47:38.703196] [DEBUG] [LOCAL ] KEYS: Primary data saved (43794 records). [2025-10-10T19:47:38.703351] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-10T19:47:38.703508] [INFO ] [MAIN ] Update Progress: 1188/2373 symbols completed. KEYS took 53.3s. Estimated remaining: 2h 47m 9s. Rate: 7.1 symbols/min [2025-10-10T19:47:38.832757] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-10T19:47:38.911572] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:47:38.960881] [DEBUG] [LOCAL ] KGC: Loaded 54089 existing records from primary storage. [2025-10-10T19:47:38.961186] [INFO ] [MAIN ] KGC: Loaded 54089 existing records. [2025-10-10T19:47:39.136571] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:47:39.136844] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-10T19:47:39.136902] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-10T19:47:39.138094] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-10T19:47:39.138152] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-10T19:47:39.408116] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T19:47:39.491826] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-10T19:47:39.524160] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:47:39.692841] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-10T19:47:40.289380] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-10T19:47:40.802932] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T19:47:41.089404] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-10T19:47:41.889371] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-10T19:47:42.121607] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-10T19:47:42.124491] [INFO ] [REMOTE ] KFRC: Full fetch complete (26235 records). [2025-10-10T19:47:42.124587] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-10T19:47:42.476888] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-10T19:47:42.564702] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-10T19:47:42.564809] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-10T19:47:42.565488] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-10T19:47:42.565534] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-10T19:47:42.566484] [DEBUG] [LOCAL ] KFRC: Trimmed 26235 records to 20385 (keeping 200 days of data) [2025-10-10T19:47:42.690383] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-10T19:47:42.697866] [DEBUG] [LOCAL ] KFRC: Primary data saved (20385 records). [2025-10-10T19:47:42.698016] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-10T19:47:42.698105] [INFO ] [MAIN ] Update Progress: 1189/2373 symbols completed. KFRC took 36.5s. Estimated remaining: 2h 46m 56s. Rate: 7.1 symbols/min [2025-10-10T19:47:42.889420] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:47:42.886393] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-10T19:47:42.934771] [DEBUG] [LOCAL ] KGS: Loaded 46271 existing records from primary storage. [2025-10-10T19:47:42.935158] [INFO ] [MAIN ] KGS: Loaded 46271 existing records. [2025-10-10T19:47:43.109184] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:47:43.109398] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-10T19:47:43.109446] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-10T19:47:43.110410] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-10T19:47:43.110470] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-10T19:47:43.453812] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:47:43.489334] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-10T19:47:44.289442] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-10T19:47:44.792181] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-10T19:47:44.983814] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-10T19:47:45.089339] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-10T19:47:45.273376] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-10T19:47:45.889367] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-10T19:47:46.689385] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-10T19:47:47.178141] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-10T19:47:47.404169] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-10T19:47:47.489360] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-10T19:47:48.289432] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-10T19:47:48.356861] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T19:47:48.849213] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-10T19:47:48.852256] [INFO ] [REMOTE ] KFY: Full fetch complete (43212 records). [2025-10-10T19:47:48.852355] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-10T19:47:48.996260] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-10T19:47:49.095562] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-10T19:47:49.273350] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-10T19:47:49.273428] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-10T19:47:49.274148] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-10T19:47:49.274210] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-10T19:47:49.275356] [DEBUG] [LOCAL ] KFY: Trimmed 43212 records to 30330 (keeping 200 days of data) [2025-10-10T19:47:49.458266] [DEBUG] [LOCAL ] KFY: Primary data saved (30330 records). [2025-10-10T19:47:49.458407] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-10T19:47:49.458493] [INFO ] [MAIN ] Update Progress: 1190/2373 symbols completed. KFY took 29.5s. Estimated remaining: 2h 46m 46s. Rate: 7.1 symbols/min [2025-10-10T19:47:49.622421] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:47:49.673066] [DEBUG] [LOCAL ] KIM: Loaded 53373 existing records from primary storage. [2025-10-10T19:47:49.673393] [INFO ] [MAIN ] KIM: Loaded 53373 existing records. [2025-10-10T19:47:49.848188] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:47:49.848414] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-10T19:47:49.848464] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-10T19:47:49.849589] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-10T19:47:49.849679] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-10T19:47:49.894693] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-10T19:47:50.205127] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:47:50.689420] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-10T19:47:50.730466] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T19:47:50.731725] [INFO ] [REMOTE ] KFS: Full fetch complete (10774 records). [2025-10-10T19:47:50.731793] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-10T19:47:51.069101] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-10T19:47:51.139666] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-10T19:47:51.139764] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-10T19:47:51.140108] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-10T19:47:51.140148] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-10T19:47:51.140597] [DEBUG] [LOCAL ] KFS: Trimmed 10774 records to 8671 (keeping 200 days of data) [2025-10-10T19:47:51.190017] [DEBUG] [LOCAL ] KFS: Primary data saved (8671 records). [2025-10-10T19:47:51.190156] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-10T19:47:51.190237] [INFO ] [MAIN ] Update Progress: 1191/2373 symbols completed. KFS took 36.4s. Estimated remaining: 2h 46m 31s. Rate: 7.1 symbols/min [2025-10-10T19:47:51.355505] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:47:51.377853] [DEBUG] [LOCAL ] KIO: Loaded 21605 existing records from primary storage. [2025-10-10T19:47:51.378109] [INFO ] [MAIN ] KIO: Loaded 21605 existing records. [2025-10-10T19:47:51.494591] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-10T19:47:51.561807] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:47:51.562205] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-10T19:47:51.562278] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-10T19:47:51.562802] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-10T19:47:51.562862] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-10T19:47:51.925433] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:47:52.289364] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-10T19:47:52.903552] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-10T19:47:52.926523] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-10T19:47:53.089408] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-10T19:47:53.341769] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T19:47:53.889447] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-10T19:47:54.681600] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T19:47:54.691992] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-10T19:47:55.489452] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-10T19:47:55.808356] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T19:47:56.289387] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-10T19:47:56.865472] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-10T19:47:57.089407] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-10T19:47:57.363402] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T19:47:57.610016] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T19:47:57.889346] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-10T19:47:58.689391] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-10T19:47:59.010046] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T19:47:59.094918] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T19:47:59.489357] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-10T19:47:59.662012] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-10T19:48:00.289381] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-10T19:48:01.089383] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-10T19:48:01.438421] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T19:48:01.657759] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T19:48:01.889399] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-10T19:48:02.698677] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-10T19:48:02.704183] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-10T19:48:03.489364] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-10T19:48:03.849913] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T19:48:03.963074] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T19:48:04.289374] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-10T19:48:05.089406] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-10T19:48:05.590088] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T19:48:05.733935] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-10T19:48:05.889370] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-10T19:48:06.689382] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-10T19:48:07.161670] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T19:48:07.299217] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-10T19:48:07.489428] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-10T19:48:07.658614] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T19:48:08.289458] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-10T19:48:08.581534] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T19:48:09.089412] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-10T19:48:09.889369] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-10T19:48:10.539270] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T19:48:10.565128] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-10T19:48:10.689360] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-10T19:48:11.489443] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-10T19:48:11.794155] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T19:48:12.289376] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-10T19:48:13.083383] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-10T19:48:13.094118] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-10T19:48:13.322283] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-10T19:48:13.635181] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T19:48:13.889353] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-10T19:48:14.003928] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T19:48:14.689389] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-10T19:48:15.489354] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-10T19:48:15.710823] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T19:48:16.289356] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-10T19:48:16.800634] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T19:48:17.089358] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-10T19:48:17.261208] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-10T19:48:17.751724] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-10T19:48:17.756282] [INFO ] [REMOTE ] KGS: Full fetch complete (66369 records). [2025-10-10T19:48:17.756412] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-10T19:48:17.901430] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-10T19:48:18.050359] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T19:48:18.079325] [INFO ] [REMOTE ] KIO: Full fetch complete (31620 records). [2025-10-10T19:48:18.079694] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-10T19:48:18.297378] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-10T19:48:18.319489] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-10T19:48:18.329126] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-10T19:48:18.329844] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-10T19:48:18.435440] [DEBUG] [LOCAL ] KGS: Trimmed 66369 records to 46609 (keeping 200 days of data) [2025-10-10T19:48:18.633443] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-10T19:48:18.634049] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-10T19:48:18.634991] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-10T19:48:18.636275] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-10T19:48:18.643365] [DEBUG] [LOCAL ] KIO: Trimmed 31620 records to 21860 (keeping 200 days of data) [2025-10-10T19:48:18.698335] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-10T19:48:18.914126] [DEBUG] [LOCAL ] KIO: Primary data saved (21860 records). [2025-10-10T19:48:18.914869] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-10T19:48:18.917829] [INFO ] [MAIN ] Update Progress: 1192/2373 symbols completed. KIO took 27.7s. Estimated remaining: 2h 46m 42s. Rate: 7.1 symbols/min [2025-10-10T19:48:19.111203] [DEBUG] [LOCAL ] KGS: Primary data saved (46609 records). [2025-10-10T19:48:19.126632] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-10T19:48:19.129079] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:48:19.128028] [INFO ] [MAIN ] Update Progress: 1193/2373 symbols completed. KGS took 36.4s. Estimated remaining: 2h 46m 25s. Rate: 7.1 symbols/min [2025-10-10T19:48:19.299195] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:48:19.319809] [DEBUG] [LOCAL ] KKRS: Loaded 5747 existing records from primary storage. [2025-10-10T19:48:19.320008] [INFO ] [MAIN ] KKRS: Loaded 5747 existing records. [2025-10-10T19:48:19.484925] [DEBUG] [LOCAL ] KKR: Loaded 53892 existing records from primary storage. [2025-10-10T19:48:19.514060] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:48:19.514514] [INFO ] [MAIN ] KKR: Loaded 53892 existing records. [2025-10-10T19:48:19.514712] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-10T19:48:19.545978] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-10T19:48:19.601422] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-10T19:48:19.607819] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-10T19:48:19.814043] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:48:19.829827] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-10T19:48:19.880354] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-10T19:48:19.925823] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-10T19:48:19.951123] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-10T19:48:20.164697] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:48:20.169252] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-10T19:48:20.288411] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-10T19:48:20.404022] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-10T19:48:20.492705] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:48:20.795674] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-10T19:48:21.089396] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-10T19:48:21.148185] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-10T19:48:21.153578] [INFO ] [REMOTE ] KGC: Full fetch complete (77702 records). [2025-10-10T19:48:21.153811] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-10T19:48:21.579406] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-10T19:48:21.579488] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-10T19:48:21.580489] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-10T19:48:21.580555] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-10T19:48:21.582211] [DEBUG] [LOCAL ] KGC: Trimmed 77702 records to 54479 (keeping 200 days of data) [2025-10-10T19:48:21.776429] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-10T19:48:21.904963] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-10T19:48:21.933422] [DEBUG] [LOCAL ] KGC: Primary data saved (54479 records). [2025-10-10T19:48:21.933559] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-10T19:48:21.933667] [INFO ] [MAIN ] Update Progress: 1194/2373 symbols completed. KGC took 43.2s. Estimated remaining: 2h 46m 11s. Rate: 7.1 symbols/min [2025-10-10T19:48:22.101746] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:48:22.101966] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-10T19:48:22.102016] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-10T19:48:22.102141] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-10T19:48:22.102180] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-10T19:48:22.102222] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-10T19:48:22.102253] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-10T19:48:22.410364] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T19:48:22.498624] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:48:22.605169] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T19:48:22.689407] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-10T19:48:23.372948] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-10T19:48:23.489418] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-10T19:48:23.716197] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T19:48:23.716510] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-10T19:48:23.716599] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T19:48:23.716665] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-10T19:48:23.716722] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T19:48:23.716788] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-10T19:48:23.716881] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-10T19:48:23.716931] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-10T19:48:23.716973] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-10T19:48:23.717021] [INFO ] [MAIN ] Update Progress: 1195/2373 symbols completed. KKRT took 1.8s. Estimated remaining: 2h 45m 56s. Rate: 7.1 symbols/min [2025-10-10T19:48:23.884761] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:48:23.884962] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-10T19:48:23.885039] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-10T19:48:23.885156] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-10T19:48:23.885197] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-10T19:48:23.885238] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-10T19:48:23.885269] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-10T19:48:24.282174] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:48:24.289341] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-10T19:48:24.515262] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T19:48:24.515547] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-10T19:48:24.515687] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T19:48:24.515741] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-10T19:48:24.515776] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T19:48:24.515841] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-10T19:48:24.515914] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-10T19:48:24.515967] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-10T19:48:24.516010] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-10T19:48:24.516058] [INFO ] [MAIN ] Update Progress: 1196/2373 symbols completed. KLAR took 0.8s. Estimated remaining: 2h 45m 40s. Rate: 7.1 symbols/min [2025-10-10T19:48:24.682633] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:48:24.716559] [DEBUG] [LOCAL ] KLC: Loaded 37008 existing records from primary storage. [2025-10-10T19:48:24.716893] [INFO ] [MAIN ] KLC: Loaded 37008 existing records. [2025-10-10T19:48:24.900132] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:48:24.900358] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-10T19:48:24.900467] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-10T19:48:24.901499] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-10T19:48:24.901560] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-10T19:48:25.104142] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-10T19:48:25.295561] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:48:25.889470] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-10T19:48:26.689375] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-10T19:48:26.820173] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T19:48:27.285563] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-10T19:48:27.489349] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-10T19:48:28.289405] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-10T19:48:28.397834] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-10T19:48:28.645532] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-10T19:48:28.650569] [INFO ] [REMOTE ] KIM: Full fetch complete (76796 records). [2025-10-10T19:48:28.650714] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-10T19:48:29.028700] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-10T19:48:29.028802] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-10T19:48:29.029783] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-10T19:48:29.029845] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-10T19:48:29.031387] [DEBUG] [LOCAL ] KIM: Trimmed 76796 records to 53761 (keeping 200 days of data) [2025-10-10T19:48:29.092100] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-10T19:48:29.355694] [DEBUG] [LOCAL ] KIM: Primary data saved (53761 records). [2025-10-10T19:48:29.355831] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-10T19:48:29.356195] [INFO ] [MAIN ] Update Progress: 1197/2373 symbols completed. KIM took 39.9s. Estimated remaining: 2h 45m 28s. Rate: 7.1 symbols/min [2025-10-10T19:48:29.889347] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-10T19:48:30.338917] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-10T19:48:30.391784] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-10T19:48:30.689350] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-10T19:48:30.779734] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T19:48:31.489410] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-10T19:48:32.289415] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-10T19:48:32.670046] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-10T19:48:32.755829] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-10T19:48:32.966579] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-10T19:48:33.089350] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-10T19:48:33.834012] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-10T19:48:33.889365] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-10T19:48:34.689390] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-10T19:48:35.489488] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-10T19:48:35.912822] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-10T19:48:36.155814] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-10T19:48:36.289335] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-10T19:48:36.308873] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-10T19:48:37.089347] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-10T19:48:37.889357] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-10T19:48:38.498351] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-10T19:48:38.596253] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T19:48:38.597771] [INFO ] [REMOTE ] KKRS: Full fetch complete (7742 records). [2025-10-10T19:48:38.597839] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-10T19:48:38.694516] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-10T19:48:38.810038] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T19:48:39.022879] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-10T19:48:39.022963] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-10T19:48:39.023221] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-10T19:48:39.023263] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-10T19:48:39.023690] [DEBUG] [LOCAL ] KKRS: Trimmed 7742 records to 5772 (keeping 200 days of data) [2025-10-10T19:48:39.061495] [DEBUG] [LOCAL ] KKRS: Primary data saved (5772 records). [2025-10-10T19:48:39.061715] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-10T19:48:39.061839] [INFO ] [MAIN ] Update Progress: 1198/2373 symbols completed. KKRS took 19.9s. Estimated remaining: 2h 45m 21s. Rate: 7.1 symbols/min [2025-10-10T19:48:39.489470] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-10T19:48:41.014100] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-10T19:48:41.025447] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-10T19:48:41.147063] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T19:48:41.156100] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-10T19:48:42.698266] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-10T19:48:42.706319] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-10T19:48:43.127806] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-10T19:48:43.139539] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-10T19:48:43.764142] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-10T19:48:43.772157] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-10T19:48:44.900226] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-10T19:48:44.912546] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-10T19:48:45.337709] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T19:48:45.345745] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-10T19:48:46.686932] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T19:48:46.695793] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-10T19:48:47.067775] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-10T19:48:47.079609] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-10T19:48:48.404546] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T19:48:48.412854] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-10T19:48:49.129198] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T19:48:49.140502] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-10T19:48:50.046292] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T19:48:50.050172] [INFO ] [REMOTE ] KLC: Full fetch complete (50476 records). [2025-10-10T19:48:50.050269] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-10T19:48:50.421059] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-10T19:48:50.421141] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-10T19:48:50.421901] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-10T19:48:50.421967] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-10T19:48:50.423054] [DEBUG] [LOCAL ] KLC: Trimmed 50476 records to 37317 (keeping 200 days of data) [2025-10-10T19:48:50.630191] [DEBUG] [LOCAL ] KLC: Primary data saved (37317 records). [2025-10-10T19:48:50.630324] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-10T19:48:50.630406] [INFO ] [MAIN ] Update Progress: 1199/2373 symbols completed. KLC took 26.1s. Estimated remaining: 2h 45m 15s. Rate: 7.1 symbols/min [2025-10-10T19:48:51.134621] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-10T19:48:51.139924] [INFO ] [REMOTE ] KKR: Full fetch complete (77452 records). [2025-10-10T19:48:51.140083] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-10T19:48:51.555505] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-10T19:48:51.555626] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-10T19:48:51.556886] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-10T19:48:51.557021] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-10T19:48:51.559175] [DEBUG] [LOCAL ] KKR: Trimmed 77452 records to 54282 (keeping 200 days of data) [2025-10-10T19:48:51.941723] [DEBUG] [LOCAL ] KKR: Primary data saved (54282 records). [2025-10-10T19:48:51.941932] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-10T19:48:51.942039] [INFO ] [MAIN ] Update Progress: 1200/2373 symbols completed. KKR took 33.0s. Estimated remaining: 2h 45m 0s. Rate: 7.1 symbols/min [2025-10-10T19:48:52.525247] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:48:52.668163] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:48:52.711967] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:48:52.716189] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:48:52.720786] [DEBUG] [LOCAL ] KMPB: Loaded 3842 existing records from primary storage. [2025-10-10T19:48:52.721774] [INFO ] [MAIN ] KMPB: Loaded 3842 existing records. [2025-10-10T19:48:52.944888] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:48:52.945420] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-10T19:48:52.945511] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-10T19:48:52.945891] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-10T19:48:52.959639] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-10T19:48:53.091763] [DEBUG] [LOCAL ] KMPR: Loaded 39672 existing records from primary storage. [2025-10-10T19:48:53.111006] [INFO ] [MAIN ] KMPR: Loaded 39672 existing records. [2025-10-10T19:48:53.138669] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-10-10T19:48:53.117093] [DEBUG] [LOCAL ] KMT: Loaded 43222 existing records from primary storage. [2025-10-10T19:48:53.196148] [INFO ] [MAIN ] KMI: Loaded 54083 existing records. [2025-10-10T19:48:53.205944] [INFO ] [MAIN ] KMT: Loaded 43222 existing records. [2025-10-10T19:48:53.888287] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:48:53.901027] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-10T19:48:53.994137] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:48:53.983118] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-10T19:48:53.965791] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:48:54.011806] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-10T19:48:54.012082] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-10T19:48:54.018170] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:48:54.019038] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-10T19:48:54.019141] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-10T19:48:54.019220] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-10T19:48:54.021107] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-10T19:48:54.019542] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-10T19:48:54.021236] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-10T19:48:54.026735] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-10T19:48:54.067139] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-10T19:48:54.114992] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-10T19:48:54.926451] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-10T19:48:54.960811] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-10T19:48:55.113266] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:48:55.170374] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-10T19:48:55.175096] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:48:55.192346] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-10T19:48:55.268144] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:48:55.268601] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-10T19:48:55.701715] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-10T19:48:55.703159] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-10T19:48:56.282575] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-10T19:48:56.288335] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-10T19:48:56.310453] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-10T19:48:56.311693] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-10T19:48:56.879358] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-10T19:48:56.881706] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-10T19:48:56.907200] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T19:48:56.916746] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-10T19:48:57.556303] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-10T19:48:57.558259] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-10T19:48:57.565156] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-10T19:48:57.643770] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T19:48:57.889352] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-10T19:48:57.909475] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-10T19:48:58.532193] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T19:48:58.689343] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-10T19:48:59.245274] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-10T19:48:59.489401] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-10T19:49:00.289382] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-10T19:49:00.341669] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-10T19:49:01.089755] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-10T19:49:01.091092] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-10T19:49:01.115031] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T19:49:01.889365] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-10T19:49:02.445121] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-10T19:49:02.689390] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-10T19:49:03.394714] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-10T19:49:03.489354] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-10T19:49:03.542710] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-10T19:49:04.289409] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-10T19:49:04.932009] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-10T19:49:05.088235] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-10T19:49:05.095679] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-10T19:49:05.889390] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-10T19:49:06.689373] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-10T19:49:06.834238] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-10T19:49:07.413240] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-10T19:49:07.414401] [INFO ] [REMOTE ] KMPB: Full fetch complete (5053 records). [2025-10-10T19:49:07.423368] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-10T19:49:07.464414] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-10T19:49:07.494496] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-10T19:49:07.820264] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-10T19:49:07.820353] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-10T19:49:07.820558] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-10T19:49:07.820597] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-10T19:49:07.820975] [DEBUG] [LOCAL ] KMPB: Trimmed 5053 records to 3854 (keeping 200 days of data) [2025-10-10T19:49:07.843855] [DEBUG] [LOCAL ] KMPB: Primary data saved (3854 records). [2025-10-10T19:49:07.843924] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-10T19:49:07.843999] [INFO ] [MAIN ] Update Progress: 1201/2373 symbols completed. KMPB took 15.9s. Estimated remaining: 2h 44m 59s. Rate: 7.1 symbols/min [2025-10-10T19:49:08.014220] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:49:08.014416] [DEBUG] [LOCAL ] KMX: No existing data file found in primary storage. [2025-10-10T19:49:08.014452] [WARN ] [MAIN ] KMX: No existing data found, performing full refresh instead. [2025-10-10T19:49:08.014575] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-10T19:49:08.014614] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-10T19:49:08.014685] [DEBUG] [LOCAL ] KMX: No primary data file found to delete. [2025-10-10T19:49:08.014734] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-10T19:49:08.294533] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-10T19:49:08.361676] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:49:09.089399] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-10T19:49:09.801614] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-10T19:49:09.889343] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-10T19:49:09.966169] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T19:49:10.689427] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-10T19:49:10.970832] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T19:49:11.489402] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-10T19:49:12.035531] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T19:49:12.289360] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-10T19:49:12.463179] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T19:49:13.089351] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-10T19:49:13.224870] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T19:49:13.889353] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-10T19:49:14.605823] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-10T19:49:14.689334] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-10T19:49:14.923549] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-10T19:49:15.489344] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-10T19:49:15.609265] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T19:49:16.289409] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-10T19:49:16.365436] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T19:49:17.089347] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-10T19:49:17.338598] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T19:49:17.636176] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T19:49:17.889415] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-10T19:49:18.689406] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-10T19:49:19.298464] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-10T19:49:19.489333] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-10T19:49:19.602239] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-10T19:49:19.606270] [INFO ] [REMOTE ] KMPR: Full fetch complete (52203 records). [2025-10-10T19:49:19.606352] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-10T19:49:19.981716] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-10T19:49:19.981828] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-10T19:49:19.982709] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-10T19:49:19.982865] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-10T19:49:19.984028] [DEBUG] [LOCAL ] KMPR: Trimmed 52203 records to 40015 (keeping 200 days of data) [2025-10-10T19:49:20.248547] [DEBUG] [LOCAL ] KMPR: Primary data saved (40015 records). [2025-10-10T19:49:20.249241] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-10T19:49:20.250231] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-10T19:49:20.250353] [INFO ] [MAIN ] Update Progress: 1202/2373 symbols completed. KMPR took 28.3s. Estimated remaining: 2h 44m 54s. Rate: 7.1 symbols/min [2025-10-10T19:49:20.294467] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-10T19:49:20.427193] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:49:20.461909] [DEBUG] [LOCAL ] KN: Loaded 38814 existing records from primary storage. [2025-10-10T19:49:20.462203] [INFO ] [MAIN ] KN: Loaded 38814 existing records. [2025-10-10T19:49:20.634151] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:49:20.634352] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-10T19:49:20.634399] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-10T19:49:20.635220] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-10T19:49:20.635280] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-10T19:49:20.979755] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:49:21.089333] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-10T19:49:21.856244] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-10T19:49:21.889341] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-10T19:49:22.045897] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-10T19:49:22.190939] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T19:49:22.689378] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-10T19:49:23.489374] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-10T19:49:24.037866] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-10T19:49:24.185482] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-10T19:49:24.289339] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-10T19:49:25.089405] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-10T19:49:25.133250] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T19:49:25.889398] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-10T19:49:26.241059] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T19:49:26.689358] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-10T19:49:27.274667] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-10T19:49:27.489428] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-10T19:49:27.632507] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T19:49:28.289375] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-10T19:49:28.808503] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-10T19:49:29.089352] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-10T19:49:29.514078] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-10T19:49:29.519155] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-10-10T19:49:29.519285] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-10T19:49:29.891500] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-10T19:49:29.941290] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-10T19:49:29.941464] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-10T19:49:29.942622] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-10T19:49:29.943201] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-10T19:49:29.945507] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T19:49:29.956753] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 54473 (keeping 200 days of data) [2025-10-10T19:49:30.280466] [DEBUG] [LOCAL ] KMI: Primary data saved (54473 records). [2025-10-10T19:49:30.280613] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-10T19:49:30.280725] [INFO ] [MAIN ] Update Progress: 1203/2373 symbols completed. KMI took 38.3s. Estimated remaining: 2h 44m 47s. Rate: 7.1 symbols/min [2025-10-10T19:49:30.443849] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:49:30.476906] [DEBUG] [LOCAL ] KNF: Loaded 36539 existing records from primary storage. [2025-10-10T19:49:30.477191] [INFO ] [MAIN ] KNF: Loaded 36539 existing records. [2025-10-10T19:49:30.651671] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:49:30.651889] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-10T19:49:30.651941] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-10T19:49:30.652483] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-10T19:49:30.652567] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-10T19:49:30.705405] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-10T19:49:30.997502] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:49:31.173721] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-10T19:49:31.489386] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-10T19:49:31.668047] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T19:49:31.894330] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-10T19:49:31.898108] [INFO ] [REMOTE ] KMT: Full fetch complete (61830 records). [2025-10-10T19:49:31.898209] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-10T19:49:32.273137] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-10T19:49:32.273212] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-10T19:49:32.274056] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-10T19:49:32.274119] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-10T19:49:32.275516] [DEBUG] [LOCAL ] KMT: Trimmed 61830 records to 43511 (keeping 200 days of data) [2025-10-10T19:49:32.329955] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-10T19:49:32.537162] [DEBUG] [LOCAL ] KMT: Primary data saved (43511 records). [2025-10-10T19:49:32.537292] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-10T19:49:32.537372] [INFO ] [MAIN ] Update Progress: 1204/2373 symbols completed. KMT took 40.6s. Estimated remaining: 2h 44m 33s. Rate: 7.1 symbols/min [2025-10-10T19:49:32.703694] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:49:32.714630] [DEBUG] [LOCAL ] KNOP: Loaded 10559 existing records from primary storage. [2025-10-10T19:49:32.714881] [INFO ] [MAIN ] KNOP: Loaded 10559 existing records. [2025-10-10T19:49:32.888220] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:49:32.888555] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-10T19:49:32.888707] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-10T19:49:32.889112] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-10T19:49:32.889176] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-10T19:49:33.061190] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-10T19:49:33.090993] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-10T19:49:33.268333] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:49:33.889391] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-10T19:49:34.316727] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T19:49:34.657894] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-10T19:49:34.689413] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-10T19:49:35.489339] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-10T19:49:35.617727] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T19:49:36.138119] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-10T19:49:36.289344] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-10T19:49:37.089358] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-10T19:49:37.751727] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-10T19:49:37.889493] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-10T19:49:37.969242] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T19:49:38.246042] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-10T19:49:38.689407] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-10T19:49:39.264437] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T19:49:39.489408] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-10T19:49:40.091880] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-10T19:49:40.289377] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-10T19:49:41.013102] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T19:49:41.089361] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-10T19:49:41.275446] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-10T19:49:41.889435] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-10T19:49:42.689455] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-10T19:49:43.333707] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-10T19:49:43.451855] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-10T19:49:43.489357] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-10T19:49:43.588992] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-10T19:49:44.289384] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-10T19:49:45.089386] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-10T19:49:45.129614] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T19:49:45.889340] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-10T19:49:45.997077] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-10T19:49:46.116001] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-10T19:49:46.121167] [INFO ] [REMOTE ] KMX: Full fetch complete (76103 records). [2025-10-10T19:49:46.121328] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-10T19:49:46.528061] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-10T19:49:46.528209] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-10T19:49:46.529680] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-10T19:49:46.529756] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-10T19:49:46.531911] [DEBUG] [LOCAL ] KMX: Trimmed 76103 records to 53995 (keeping 200 days of data) [2025-10-10T19:49:46.710411] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-10T19:49:46.879004] [DEBUG] [LOCAL ] KMX: Primary data saved (53995 records). [2025-10-10T19:49:46.879205] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-10T19:49:46.879310] [INFO ] [MAIN ] Update Progress: 1205/2373 symbols completed. KMX took 39.0s. Estimated remaining: 2h 44m 30s. Rate: 7.1 symbols/min [2025-10-10T19:49:47.066285] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:49:47.085198] [DEBUG] [LOCAL ] KNSL: Loaded 18524 existing records from primary storage. [2025-10-10T19:49:47.085470] [INFO ] [MAIN ] KNSL: Loaded 18524 existing records. [2025-10-10T19:49:47.280459] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:49:47.280796] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-10T19:49:47.280959] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-10T19:49:47.281486] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-10T19:49:47.281563] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-10T19:49:47.430962] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-10T19:49:47.489806] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-10T19:49:47.711635] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:49:47.719821] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-10T19:49:48.289390] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-10T19:49:49.089348] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-10T19:49:49.294398] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-10T19:49:49.889377] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-10T19:49:50.004368] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T19:49:50.222487] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T19:49:50.689379] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-10T19:49:51.406050] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T19:49:51.489371] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-10T19:49:51.940332] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T19:49:52.289403] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-10T19:49:53.094945] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-10T19:49:53.099495] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-10T19:49:53.889346] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-10T19:49:53.925542] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-10T19:49:53.929843] [INFO ] [REMOTE ] KNF: Full fetch complete (51032 records). [2025-10-10T19:49:53.929955] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-10T19:49:54.301448] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-10T19:49:54.301525] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-10T19:49:54.302274] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-10T19:49:54.302335] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-10T19:49:54.303324] [DEBUG] [LOCAL ] KNF: Trimmed 51032 records to 36854 (keeping 200 days of data) [2025-10-10T19:49:54.416013] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-10T19:49:54.532564] [DEBUG] [LOCAL ] KNF: Primary data saved (36854 records). [2025-10-10T19:49:54.532712] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-10T19:49:54.532800] [INFO ] [MAIN ] Update Progress: 1206/2373 symbols completed. KNF took 24.3s. Estimated remaining: 2h 44m 21s. Rate: 7.1 symbols/min [2025-10-10T19:49:54.699485] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-10T19:49:54.701951] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:49:54.743510] [DEBUG] [LOCAL ] KNTK: Loaded 46944 existing records from primary storage. [2025-10-10T19:49:54.743825] [INFO ] [MAIN ] KNTK: Loaded 46944 existing records. [2025-10-10T19:49:54.918287] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:49:54.918471] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-10T19:49:54.918528] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-10T19:49:54.919420] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-10T19:49:54.919489] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-10T19:49:55.039699] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T19:49:55.292446] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:49:55.489370] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-10T19:49:56.299373] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-10T19:49:56.301358] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T19:49:56.791090] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-10T19:49:57.089424] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-10T19:49:57.221516] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T19:49:57.889404] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-10T19:49:58.645198] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-10T19:49:58.659512] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-10T19:49:58.689353] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-10T19:49:59.489429] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-10T19:49:59.665100] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T19:50:00.289382] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-10T19:50:00.733638] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-10T19:50:01.089380] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-10T19:50:01.889523] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-10T19:50:01.928082] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T19:50:02.017766] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T19:50:02.689369] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-10T19:50:03.489428] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-10T19:50:03.516536] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T19:50:03.520618] [INFO ] [REMOTE ] KN: Full fetch complete (56499 records). [2025-10-10T19:50:03.520744] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-10T19:50:03.817997] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T19:50:03.907994] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-10T19:50:03.908067] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-10T19:50:03.908852] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-10T19:50:03.908914] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-10T19:50:03.910177] [DEBUG] [LOCAL ] KN: Trimmed 56499 records to 39166 (keeping 200 days of data) [2025-10-10T19:50:04.130028] [DEBUG] [LOCAL ] KN: Primary data saved (39166 records). [2025-10-10T19:50:04.130162] [INFO ] [MAIN ] KN: Full history saved. [2025-10-10T19:50:04.130239] [INFO ] [MAIN ] Update Progress: 1207/2373 symbols completed. KN took 43.9s. Estimated remaining: 2h 44m 14s. Rate: 7.1 symbols/min [2025-10-10T19:50:04.295157] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:50:04.293763] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-10T19:50:04.346791] [DEBUG] [LOCAL ] KNX: Loaded 52986 existing records from primary storage. [2025-10-10T19:50:04.347117] [INFO ] [MAIN ] KNX: Loaded 52986 existing records. [2025-10-10T19:50:04.526260] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:50:04.526496] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-10T19:50:04.526575] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-10T19:50:04.527437] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-10T19:50:04.527493] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-10T19:50:04.887481] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:50:04.909822] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T19:50:05.089381] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-10T19:50:05.481347] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-10T19:50:05.483600] [INFO ] [REMOTE ] KNOP: Full fetch complete (14567 records). [2025-10-10T19:50:05.483760] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-10T19:50:05.844415] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-10T19:50:05.844492] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-10T19:50:05.844853] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-10T19:50:05.844914] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-10T19:50:05.845367] [DEBUG] [LOCAL ] KNOP: Trimmed 14567 records to 10627 (keeping 200 days of data) [2025-10-10T19:50:05.889740] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-10T19:50:05.907475] [DEBUG] [LOCAL ] KNOP: Primary data saved (10627 records). [2025-10-10T19:50:05.907591] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-10T19:50:05.907695] [INFO ] [MAIN ] Update Progress: 1208/2373 symbols completed. KNOP took 33.4s. Estimated remaining: 2h 43m 59s. Rate: 7.1 symbols/min [2025-10-10T19:50:06.072774] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:50:06.072920] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-10T19:50:06.072957] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-10T19:50:06.073060] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-10T19:50:06.073100] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-10T19:50:06.073140] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-10T19:50:06.073172] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-10T19:50:06.463901] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:50:06.689408] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-10T19:50:06.744637] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T19:50:07.362899] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-10T19:50:07.489390] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-10T19:50:08.289369] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-10T19:50:08.666265] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T19:50:09.089424] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-10T19:50:09.490578] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T19:50:09.889413] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-10T19:50:10.689338] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-10T19:50:11.064991] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T19:50:11.127017] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-10-10T19:50:11.320290] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-10T19:50:11.489367] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-10T19:50:11.773687] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T19:50:12.289431] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-10T19:50:12.734198] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T19:50:13.089391] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-10T19:50:13.889378] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-10T19:50:14.196413] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-10T19:50:14.689362] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-10T19:50:14.910249] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T19:50:15.489421] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-10T19:50:16.294495] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-10T19:50:16.307495] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T19:50:16.825806] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.94 seconds). [2025-10-10T19:50:16.926187] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-10T19:50:17.089336] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-10T19:50:17.618100] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T19:50:17.889369] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-10T19:50:18.689358] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-10T19:50:18.907211] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T19:50:19.489351] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-10T19:50:19.921416] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-10T19:50:20.153976] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-10T19:50:20.289378] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-10T19:50:21.089361] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-10T19:50:21.317680] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-10T19:50:21.889390] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-10T19:50:22.689376] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-10T19:50:23.078386] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-10T19:50:23.217260] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T19:50:23.489390] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-10T19:50:23.656974] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-10T19:50:23.662285] [INFO ] [REMOTE ] KNTK: Full fetch complete (65036 records). [2025-10-10T19:50:23.662464] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-10T19:50:24.025178] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-10T19:50:24.118106] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-10T19:50:24.118208] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-10T19:50:24.119264] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-10T19:50:24.119356] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-10T19:50:24.120889] [DEBUG] [LOCAL ] KNTK: Trimmed 65036 records to 47300 (keeping 200 days of data) [2025-10-10T19:50:24.308586] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-10T19:50:24.439671] [DEBUG] [LOCAL ] KNTK: Primary data saved (47300 records). [2025-10-10T19:50:24.439880] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-10T19:50:24.440005] [INFO ] [MAIN ] Update Progress: 1209/2373 symbols completed. KNTK took 29.9s. Estimated remaining: 2h 43m 60s. Rate: 7.1 symbols/min [2025-10-10T19:50:24.620878] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:50:24.664951] [DEBUG] [LOCAL ] KODK: Loaded 43771 existing records from primary storage. [2025-10-10T19:50:24.665407] [INFO ] [MAIN ] KODK: Loaded 43771 existing records. [2025-10-10T19:50:24.850982] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:50:24.851311] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-10T19:50:24.851367] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-10T19:50:24.852187] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-10T19:50:24.852248] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-10T19:50:25.098384] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-10T19:50:25.250419] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:50:25.889419] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-10T19:50:26.228325] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-10T19:50:26.290014] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-10T19:50:26.292266] [INFO ] [REMOTE ] KNSL: Full fetch complete (26785 records). [2025-10-10T19:50:26.292337] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-10T19:50:26.501584] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-10T19:50:26.718296] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-10T19:50:26.733223] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-10T19:50:26.733304] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-10T19:50:26.734106] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-10T19:50:26.734174] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-10T19:50:26.735152] [DEBUG] [LOCAL ] KNSL: Trimmed 26785 records to 18641 (keeping 200 days of data) [2025-10-10T19:50:26.911562] [DEBUG] [LOCAL ] KNSL: Primary data saved (18641 records). [2025-10-10T19:50:26.911797] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-10T19:50:26.911955] [INFO ] [MAIN ] Update Progress: 1210/2373 symbols completed. KNSL took 40.0s. Estimated remaining: 2h 43m 46s. Rate: 7.1 symbols/min [2025-10-10T19:50:27.171067] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:50:27.210212] [DEBUG] [LOCAL ] KOF: Loaded 26683 existing records from primary storage. [2025-10-10T19:50:27.210605] [INFO ] [MAIN ] KOF: Loaded 26683 existing records. [2025-10-10T19:50:27.499875] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-10T19:50:27.508146] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:50:27.509765] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-10T19:50:27.510077] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-10T19:50:27.510942] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-10T19:50:27.511025] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-10T19:50:28.072518] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-10T19:50:28.078218] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:50:28.289385] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-10T19:50:29.089429] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-10T19:50:29.456805] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T19:50:29.669480] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-10-10T19:50:29.837375] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-10T19:50:29.889378] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-10T19:50:30.057803] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T19:50:30.689412] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-10T19:50:31.352213] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T19:50:31.489384] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-10T19:50:32.289357] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-10T19:50:32.820513] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T19:50:33.089367] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-10T19:50:33.359721] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-10T19:50:33.889453] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-10T19:50:34.249479] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T19:50:34.389837] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T19:50:34.689370] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-10T19:50:35.489391] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-10T19:50:36.289437] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-10T19:50:36.440092] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T19:50:36.743051] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-10T19:50:36.775448] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T19:50:37.089443] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-10T19:50:37.889410] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-10T19:50:38.199552] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-10T19:50:38.689400] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-10T19:50:38.875866] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T19:50:39.489410] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-10T19:50:40.197885] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-10T19:50:40.253897] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T19:50:40.289331] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-10T19:50:41.037055] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-10T19:50:41.089340] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-10T19:50:41.307147] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-10T19:50:41.889384] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-10T19:50:42.689357] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-10T19:50:42.989828] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T19:50:42.994743] [INFO ] [REMOTE ] KNX: Full fetch complete (75918 records). [2025-10-10T19:50:42.994882] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-10T19:50:43.395274] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-10T19:50:43.395386] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-10T19:50:43.396479] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-10T19:50:43.396992] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-10T19:50:43.398606] [DEBUG] [LOCAL ] KNX: Trimmed 75918 records to 53376 (keeping 200 days of data) [2025-10-10T19:50:43.492221] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-10T19:50:43.647094] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T19:50:43.762492] [DEBUG] [LOCAL ] KNX: Primary data saved (53376 records). [2025-10-10T19:50:43.762627] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-10T19:50:43.762744] [INFO ] [MAIN ] Update Progress: 1211/2373 symbols completed. KNX took 39.6s. Estimated remaining: 2h 43m 45s. Rate: 7.1 symbols/min [2025-10-10T19:50:43.928790] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:50:43.945319] [DEBUG] [LOCAL ] KOP: Loaded 17572 existing records from primary storage. [2025-10-10T19:50:43.945551] [INFO ] [MAIN ] KOP: Loaded 17572 existing records. [2025-10-10T19:50:44.136223] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:50:44.136484] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-10T19:50:44.136737] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-10T19:50:44.138233] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-10T19:50:44.145177] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-10T19:50:44.145265] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-10T19:50:44.314435] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-10T19:50:44.504162] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:50:45.089426] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-10T19:50:45.889384] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-10T19:50:46.074688] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T19:50:46.178694] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-10T19:50:46.264447] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-10T19:50:46.689430] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-10T19:50:46.855990] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-10T19:50:47.489352] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-10T19:50:48.289374] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-10T19:50:48.551558] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T19:50:48.748271] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-10T19:50:49.089347] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-10T19:50:49.548003] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-10T19:50:49.889400] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-10T19:50:49.968415] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-10T19:50:50.689372] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-10T19:50:51.489375] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-10T19:50:52.289408] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-10T19:50:52.558358] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.67 seconds). [2025-10-10T19:50:52.573104] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-10-10T19:50:52.588837] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-10T19:50:52.591218] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T19:50:52.731049] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T19:50:52.806591] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-10T19:50:52.807407] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T19:50:52.807478] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T19:50:52.807546] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-10T19:50:52.807612] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-10T19:50:52.807671] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-10T19:50:52.807736] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-10T19:50:52.807800] [INFO ] [MAIN ] Update Progress: 1212/2373 symbols completed. KO took 46.9s. Estimated remaining: 2h 43m 38s. Rate: 7.1 symbols/min [2025-10-10T19:50:52.978992] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:50:52.983006] [DEBUG] [LOCAL ] KORE: Loaded 2137 existing records from primary storage. [2025-10-10T19:50:52.983184] [INFO ] [MAIN ] KORE: Loaded 2137 existing records. [2025-10-10T19:50:53.089376] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-10T19:50:53.175695] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:50:53.176045] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-10T19:50:53.176110] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-10T19:50:53.176588] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-10T19:50:53.177064] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-10T19:50:53.538119] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:50:53.625405] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T19:50:53.628393] [INFO ] [REMOTE ] KOF: Full fetch complete (37675 records). [2025-10-10T19:50:53.628470] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-10T19:50:53.896199] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-10T19:50:53.992239] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-10T19:50:53.992315] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-10T19:50:53.993072] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-10T19:50:53.993135] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-10T19:50:53.993982] [DEBUG] [LOCAL ] KOF: Trimmed 37675 records to 26841 (keeping 200 days of data) [2025-10-10T19:50:54.153727] [DEBUG] [LOCAL ] KOF: Primary data saved (26841 records). [2025-10-10T19:50:54.153850] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-10T19:50:54.153930] [INFO ] [MAIN ] Update Progress: 1213/2373 symbols completed. KOF took 27.2s. Estimated remaining: 2h 43m 22s. Rate: 7.1 symbols/min [2025-10-10T19:50:54.319725] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:50:54.367419] [DEBUG] [LOCAL ] KOS: Loaded 53462 existing records from primary storage. [2025-10-10T19:50:54.367752] [INFO ] [MAIN ] KOS: Loaded 53462 existing records. [2025-10-10T19:50:54.539934] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:50:54.540141] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-10T19:50:54.540190] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-10T19:50:54.541164] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-10T19:50:54.541237] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-10T19:50:54.691262] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-10T19:50:54.925516] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:50:54.928123] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T19:50:55.084505] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T19:50:55.489384] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-10T19:50:56.054952] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-10T19:50:56.289372] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-10T19:50:57.089385] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-10T19:50:57.317048] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-10T19:50:57.322938] [INFO ] [REMOTE ] KODK: Full fetch complete (63345 records). [2025-10-10T19:50:57.323096] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-10T19:50:57.662104] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T19:50:57.738406] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-10T19:50:57.738494] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-10T19:50:57.739463] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-10T19:50:57.739526] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-10T19:50:57.740747] [DEBUG] [LOCAL ] KODK: Trimmed 63345 records to 44104 (keeping 200 days of data) [2025-10-10T19:50:57.895400] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-10T19:50:57.998719] [DEBUG] [LOCAL ] KODK: Primary data saved (44104 records). [2025-10-10T19:50:57.999400] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-10T19:50:57.999700] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-10T19:50:58.003590] [INFO ] [MAIN ] Update Progress: 1214/2373 symbols completed. KODK took 33.6s. Estimated remaining: 2h 43m 9s. Rate: 7.1 symbols/min [2025-10-10T19:50:58.171577] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:50:58.220183] [DEBUG] [LOCAL ] KR: Loaded 54071 existing records from primary storage. [2025-10-10T19:50:58.220489] [INFO ] [MAIN ] KR: Loaded 54071 existing records. [2025-10-10T19:50:58.395257] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:50:58.395545] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-10T19:50:58.395604] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-10T19:50:58.396684] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-10T19:50:58.396752] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-10T19:50:58.694568] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-10T19:50:58.747247] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:50:59.091319] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T19:50:59.489379] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-10T19:51:00.053984] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-10T19:51:00.289359] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-10T19:51:00.746230] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T19:51:00.828356] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-10T19:51:01.089399] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-10T19:51:01.637367] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-10T19:51:01.889367] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-10T19:51:02.469477] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-10T19:51:02.689375] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-10T19:51:03.247218] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-10T19:51:03.489373] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-10T19:51:04.289452] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-10T19:51:04.658231] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-10T19:51:05.089368] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-10T19:51:05.637852] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-10T19:51:05.640724] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-10T19:51:05.889384] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-10T19:51:06.689407] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-10T19:51:07.489360] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-10T19:51:07.813439] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-10T19:51:07.948826] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T19:51:08.289378] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-10T19:51:09.089389] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-10T19:51:09.133470] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T19:51:09.420407] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-10T19:51:09.889374] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-10T19:51:10.689402] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-10T19:51:11.104612] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T19:51:11.489393] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-10T19:51:11.762551] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-10T19:51:11.851690] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-10T19:51:11.870501] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-10T19:51:12.289413] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-10T19:51:13.089398] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-10T19:51:13.588067] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T19:51:13.889389] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-10T19:51:14.689378] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-10T19:51:15.015093] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-10T19:51:15.017220] [INFO ] [REMOTE ] KOP: Full fetch complete (25443 records). [2025-10-10T19:51:15.017295] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-10T19:51:15.220944] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-10T19:51:15.262038] [INFO ] [REMOTE ] KORE: Full fetch complete (5638 records). [2025-10-10T19:51:15.302210] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-10T19:51:15.493701] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-10T19:51:15.512573] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-10T19:51:15.526319] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-10T19:51:15.528782] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-10T19:51:15.570433] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-10T19:51:15.590733] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-10T19:51:15.645389] [DEBUG] [LOCAL ] KOP: Trimmed 25443 records to 17721 (keeping 200 days of data) [2025-10-10T19:51:15.992849] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-10T19:51:15.995678] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-10T19:51:16.000860] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-10T19:51:16.007908] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-10T19:51:16.008708] [DEBUG] [LOCAL ] KORE: Trimmed 5638 records to 2158 (keeping 200 days of data) [2025-10-10T19:51:16.008031] [DEBUG] [LOCAL ] KOP: Primary data saved (17721 records). [2025-10-10T19:51:16.009448] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-10T19:51:16.016012] [INFO ] [MAIN ] Update Progress: 1215/2373 symbols completed. KOP took 32.3s. Estimated remaining: 2h 43m 10s. Rate: 7.1 symbols/min [2025-10-10T19:51:16.062215] [DEBUG] [LOCAL ] KORE: Primary data saved (2158 records). [2025-10-10T19:51:16.088742] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-10T19:51:16.088921] [INFO ] [MAIN ] Update Progress: 1216/2373 symbols completed. KORE took 23.3s. Estimated remaining: 2h 42m 54s. Rate: 7.1 symbols/min [2025-10-10T19:51:16.290759] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-10T19:51:16.386844] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:51:16.408817] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:51:16.461384] [DEBUG] [LOCAL ] KREF: Loaded 38087 existing records from primary storage. [2025-10-10T19:51:16.461778] [INFO ] [MAIN ] KREF: Loaded 38087 existing records. [2025-10-10T19:51:16.584954] [DEBUG] [LOCAL ] KRC: Loaded 48686 existing records from primary storage. [2025-10-10T19:51:16.601571] [INFO ] [MAIN ] KRC: Loaded 48686 existing records. [2025-10-10T19:51:16.777790] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:51:16.781251] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-10T19:51:16.781342] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-10T19:51:16.787314] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-10T19:51:16.797743] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-10T19:51:16.970427] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:51:16.981373] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-10T19:51:16.981466] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-10T19:51:16.997808] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-10T19:51:17.021476] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-10T19:51:17.503337] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:51:17.529068] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-10T19:51:17.681711] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:51:17.718131] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-10T19:51:17.889394] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-10T19:51:18.571638] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-10T19:51:18.689393] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-10T19:51:19.228276] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T19:51:19.489404] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-10T19:51:19.708725] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-10T19:51:20.289345] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-10T19:51:20.727590] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T19:51:20.756436] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-10T19:51:21.089400] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-10T19:51:21.889345] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-10T19:51:22.057106] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T19:51:22.689347] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-10T19:51:23.232609] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-10T19:51:23.489441] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-10T19:51:23.856196] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T19:51:23.997666] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T19:51:24.289374] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-10T19:51:25.089406] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-10T19:51:25.620456] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-10T19:51:25.889356] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-10T19:51:26.088577] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-10T19:51:26.524155] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-10T19:51:26.689393] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-10T19:51:27.309270] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-10T19:51:27.489384] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-10T19:51:28.289417] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-10T19:51:28.930386] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-10T19:51:29.089349] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-10T19:51:29.637935] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T19:51:29.686303] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-10T19:51:29.889394] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-10T19:51:30.689375] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-10T19:51:30.823705] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T19:51:31.489388] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-10T19:51:32.092002] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-10T19:51:32.289341] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-10T19:51:32.643922] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-10T19:51:32.704637] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-10T19:51:33.089373] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-10T19:51:33.889420] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-10T19:51:34.364693] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T19:51:34.505872] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-10T19:51:34.689383] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-10T19:51:35.476138] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-10T19:51:35.489335] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-10T19:51:36.289463] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-10T19:51:36.404949] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-10T19:51:37.089413] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-10T19:51:37.224097] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T19:51:37.889379] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-10T19:51:37.923146] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T19:51:38.689428] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-10T19:51:39.197039] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-10T19:51:39.201933] [INFO ] [REMOTE ] KOS: Full fetch complete (76870 records). [2025-10-10T19:51:39.202043] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-10T19:51:39.494298] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-10T19:51:39.592926] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-10T19:51:39.593015] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-10T19:51:39.594096] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-10T19:51:39.594160] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-10T19:51:39.595679] [DEBUG] [LOCAL ] KOS: Trimmed 76870 records to 53851 (keeping 200 days of data) [2025-10-10T19:51:39.897022] [DEBUG] [LOCAL ] KOS: Primary data saved (53851 records). [2025-10-10T19:51:39.897424] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-10T19:51:39.897518] [INFO ] [MAIN ] Update Progress: 1217/2373 symbols completed. KOS took 45.7s. Estimated remaining: 2h 42m 60s. Rate: 7.1 symbols/min [2025-10-10T19:51:40.068023] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:51:40.111502] [DEBUG] [LOCAL ] KRG: Loaded 49521 existing records from primary storage. [2025-10-10T19:51:40.111896] [INFO ] [MAIN ] KRG: Loaded 49521 existing records. [2025-10-10T19:51:40.292699] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:51:40.292952] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-10T19:51:40.292999] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-10T19:51:40.293879] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-10T19:51:40.293935] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-10T19:51:40.631080] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-10T19:51:40.713062] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:51:40.713614] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-10T19:51:40.745727] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-10T19:51:41.089392] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-10T19:51:41.636773] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-10T19:51:41.642556] [INFO ] [REMOTE ] KR: Full fetch complete (77680 records). [2025-10-10T19:51:41.642799] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-10T19:51:41.894525] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-10T19:51:42.074321] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-10T19:51:42.074450] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-10T19:51:42.075914] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-10T19:51:42.076110] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-10T19:51:42.078547] [DEBUG] [LOCAL ] KR: Trimmed 77680 records to 54461 (keeping 200 days of data) [2025-10-10T19:51:42.334233] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-10T19:51:42.459829] [DEBUG] [LOCAL ] KR: Primary data saved (54461 records). [2025-10-10T19:51:42.460031] [INFO ] [MAIN ] KR: Full history saved. [2025-10-10T19:51:42.460381] [INFO ] [MAIN ] Update Progress: 1218/2373 symbols completed. KR took 44.5s. Estimated remaining: 2h 42m 46s. Rate: 7.1 symbols/min [2025-10-10T19:51:42.641514] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:51:42.641889] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-10T19:51:42.641946] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-10T19:51:42.642070] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-10T19:51:42.642113] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-10T19:51:42.642157] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-10T19:51:42.642191] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-10T19:51:42.706293] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-10T19:51:43.049899] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T19:51:43.047857] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:51:43.489386] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-10T19:51:43.702584] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T19:51:43.714477] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T19:51:43.714856] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-10T19:51:43.714949] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T19:51:43.714995] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-10T19:51:43.715028] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T19:51:43.715064] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-10T19:51:43.715120] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-10T19:51:43.715154] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-10T19:51:43.715192] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-10T19:51:43.715238] [INFO ] [MAIN ] Update Progress: 1219/2373 symbols completed. KRMN took 1.3s. Estimated remaining: 2h 42m 30s. Rate: 7.1 symbols/min [2025-10-10T19:51:43.881376] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:51:43.906182] [DEBUG] [LOCAL ] KRO: Loaded 26410 existing records from primary storage. [2025-10-10T19:51:43.906487] [INFO ] [MAIN ] KRO: Loaded 26410 existing records. [2025-10-10T19:51:44.084878] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:51:44.085139] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-10T19:51:44.085193] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-10T19:51:44.085754] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-10T19:51:44.085812] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-10T19:51:44.299304] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-10T19:51:44.457344] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:51:44.482614] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T19:51:45.089394] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-10T19:51:45.889397] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-10T19:51:46.164908] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T19:51:46.244860] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-10T19:51:46.248889] [INFO ] [REMOTE ] KREF: Full fetch complete (52759 records). [2025-10-10T19:51:46.248975] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-10T19:51:46.617040] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-10T19:51:46.617128] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-10T19:51:46.617920] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-10T19:51:46.617984] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-10T19:51:46.619102] [DEBUG] [LOCAL ] KREF: Trimmed 52759 records to 38383 (keeping 200 days of data) [2025-10-10T19:51:46.705593] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-10T19:51:46.846754] [DEBUG] [LOCAL ] KREF: Primary data saved (38383 records). [2025-10-10T19:51:46.846926] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-10T19:51:46.847020] [INFO ] [MAIN ] Update Progress: 1220/2373 symbols completed. KREF took 30.7s. Estimated remaining: 2h 42m 17s. Rate: 7.1 symbols/min [2025-10-10T19:51:47.043431] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:51:47.080907] [DEBUG] [LOCAL ] KRP: Loaded 36952 existing records from primary storage. [2025-10-10T19:51:47.081225] [INFO ] [MAIN ] KRP: Loaded 36952 existing records. [2025-10-10T19:51:47.275574] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:51:47.275835] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-10T19:51:47.275886] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-10T19:51:47.276694] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-10T19:51:47.276755] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-10T19:51:47.493082] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-10T19:51:47.671718] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:51:47.730614] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T19:51:48.289369] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-10T19:51:48.425951] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T19:51:48.971211] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T19:51:49.089397] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-10T19:51:49.889374] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-10T19:51:50.210691] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-10T19:51:50.215471] [INFO ] [REMOTE ] KRC: Full fetch complete (69880 records). [2025-10-10T19:51:50.215586] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-10T19:51:50.386790] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T19:51:50.624773] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-10T19:51:50.624860] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-10T19:51:50.625784] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-10T19:51:50.625846] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-10T19:51:50.627255] [DEBUG] [LOCAL ] KRC: Trimmed 69880 records to 49050 (keeping 200 days of data) [2025-10-10T19:51:50.716405] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-10T19:51:50.942108] [DEBUG] [LOCAL ] KRC: Primary data saved (49050 records). [2025-10-10T19:51:50.942260] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-10T19:51:50.942345] [INFO ] [MAIN ] Update Progress: 1221/2373 symbols completed. KRC took 34.9s. Estimated remaining: 2h 42m 4s. Rate: 7.1 symbols/min [2025-10-10T19:51:51.132129] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:51:51.185203] [DEBUG] [LOCAL ] KSS: Loaded 53986 existing records from primary storage. [2025-10-10T19:51:51.185569] [INFO ] [MAIN ] KSS: Loaded 53986 existing records. [2025-10-10T19:51:51.362711] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:51:51.362905] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-10T19:51:51.362951] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-10T19:51:51.363893] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-10T19:51:51.363950] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-10T19:51:51.489564] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-10T19:51:51.738089] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:51:51.765630] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T19:51:51.814229] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-10T19:51:52.289410] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-10T19:51:53.096527] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-10T19:51:53.100533] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-10T19:51:53.889396] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-10T19:51:54.206381] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T19:51:54.689381] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-10T19:51:55.341724] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-10T19:51:55.489390] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-10T19:51:55.560091] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T19:51:56.289379] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-10T19:51:56.488292] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-10T19:51:57.089414] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-10T19:51:57.674079] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-10T19:51:57.899214] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-10T19:51:57.903692] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T19:51:58.390168] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T19:51:58.689367] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-10T19:51:59.424869] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T19:51:59.489336] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-10T19:52:00.289459] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-10T19:52:00.509579] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T19:52:00.605616] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-10T19:52:01.089436] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-10T19:52:01.889370] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-10T19:52:02.293412] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-10T19:52:02.467221] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-10T19:52:02.689373] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-10T19:52:03.434779] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-10T19:52:03.489351] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-10T19:52:04.025469] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-10T19:52:04.289421] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-10T19:52:04.901275] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T19:52:05.089380] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-10T19:52:05.889399] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-10T19:52:06.096605] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T19:52:06.689400] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-10T19:52:07.017396] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-10T19:52:07.489384] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-10T19:52:07.599892] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T19:52:08.167201] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-10T19:52:08.289369] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-10T19:52:09.089365] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-10T19:52:09.149872] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-10T19:52:09.889381] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-10T19:52:10.597162] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-10T19:52:10.638102] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T19:52:10.689342] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-10T19:52:11.306795] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-10T19:52:11.311317] [INFO ] [REMOTE ] KRG: Full fetch complete (71099 records). [2025-10-10T19:52:11.311422] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-10T19:52:11.495227] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-10T19:52:11.753545] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-10T19:52:11.753679] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-10T19:52:11.754923] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-10T19:52:11.754992] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-10T19:52:11.756577] [DEBUG] [LOCAL ] KRG: Trimmed 71099 records to 49891 (keeping 200 days of data) [2025-10-10T19:52:12.171285] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T19:52:12.205927] [DEBUG] [LOCAL ] KRG: Primary data saved (49891 records). [2025-10-10T19:52:12.206134] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-10T19:52:12.206304] [INFO ] [MAIN ] Update Progress: 1222/2373 symbols completed. KRG took 32.3s. Estimated remaining: 2h 42m 8s. Rate: 7.1 symbols/min [2025-10-10T19:52:12.300548] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-10T19:52:12.468429] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:52:12.532780] [DEBUG] [LOCAL ] KT: Loaded 45849 existing records from primary storage. [2025-10-10T19:52:12.533470] [INFO ] [MAIN ] KT: Loaded 45849 existing records. [2025-10-10T19:52:12.793919] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:52:12.794209] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-10T19:52:12.794266] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-10T19:52:12.794989] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-10T19:52:12.795047] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-10T19:52:13.094524] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-10T19:52:13.148742] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:52:13.226899] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T19:52:13.889419] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-10T19:52:14.190511] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-10T19:52:14.641726] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-10T19:52:14.644426] [INFO ] [REMOTE ] KRO: Full fetch complete (35112 records). [2025-10-10T19:52:14.644497] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-10T19:52:14.697526] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-10T19:52:15.019012] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-10T19:52:15.019216] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-10T19:52:15.019968] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-10T19:52:15.020045] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-10T19:52:15.039970] [DEBUG] [LOCAL ] KRO: Trimmed 35112 records to 26592 (keeping 200 days of data) [2025-10-10T19:52:15.041851] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-10T19:52:15.202207] [DEBUG] [LOCAL ] KRO: Primary data saved (26592 records). [2025-10-10T19:52:15.202343] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-10T19:52:15.202447] [INFO ] [MAIN ] Update Progress: 1223/2373 symbols completed. KRO took 31.5s. Estimated remaining: 2h 41m 55s. Rate: 7.1 symbols/min [2025-10-10T19:52:15.368141] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:52:15.403802] [DEBUG] [LOCAL ] KTB: Loaded 40852 existing records from primary storage. [2025-10-10T19:52:15.404084] [INFO ] [MAIN ] KTB: Loaded 40852 existing records. [2025-10-10T19:52:15.498928] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-10T19:52:15.579111] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:52:15.579347] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-10T19:52:15.579393] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-10T19:52:15.580244] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-10T19:52:15.580301] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-10T19:52:15.923146] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:52:16.289383] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-10T19:52:16.428114] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T19:52:17.089424] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-10T19:52:17.311267] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-10T19:52:17.364325] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T19:52:17.889370] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-10T19:52:18.689396] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-10T19:52:19.019605] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T19:52:19.376482] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T19:52:19.489356] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-10T19:52:19.656060] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-10T19:52:20.289370] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-10T19:52:20.842863] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T19:52:20.846069] [INFO ] [REMOTE ] KRP: Full fetch complete (54874 records). [2025-10-10T19:52:20.846151] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-10T19:52:21.095786] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-10T19:52:21.240160] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-10T19:52:21.240234] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-10T19:52:21.241021] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-10T19:52:21.241082] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-10T19:52:21.242127] [DEBUG] [LOCAL ] KRP: Trimmed 54874 records to 37244 (keeping 200 days of data) [2025-10-10T19:52:21.471286] [DEBUG] [LOCAL ] KRP: Primary data saved (37244 records). [2025-10-10T19:52:21.471430] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-10T19:52:21.471524] [INFO ] [MAIN ] Update Progress: 1224/2373 symbols completed. KRP took 34.6s. Estimated remaining: 2h 41m 44s. Rate: 7.1 symbols/min [2025-10-10T19:52:21.643677] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:52:21.655407] [DEBUG] [LOCAL ] KTF: Loaded 12113 existing records from primary storage. [2025-10-10T19:52:21.655633] [INFO ] [MAIN ] KTF: Loaded 12113 existing records. [2025-10-10T19:52:21.836940] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:52:21.837175] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-10T19:52:21.837249] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-10T19:52:21.843742] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-10T19:52:21.854172] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-10T19:52:21.888453] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-10T19:52:21.900043] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-10T19:52:22.249698] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:52:22.689400] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-10T19:52:23.484867] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-10T19:52:23.496406] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-10T19:52:23.749778] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-10T19:52:24.289345] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-10T19:52:24.406508] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T19:52:24.645088] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-10T19:52:25.089391] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-10T19:52:25.889406] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-10T19:52:26.066883] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T19:52:26.689420] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-10T19:52:26.876107] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-10T19:52:27.255810] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-10T19:52:27.489450] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-10T19:52:28.289359] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-10T19:52:28.461781] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T19:52:28.524949] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T19:52:29.089379] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-10T19:52:29.889361] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-10T19:52:30.472516] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-10T19:52:30.477578] [INFO ] [REMOTE ] KSS: Full fetch complete (77627 records). [2025-10-10T19:52:30.477749] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-10T19:52:30.696568] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-10T19:52:30.926159] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-10T19:52:30.926287] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-10T19:52:30.927341] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-10T19:52:30.927617] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-10T19:52:30.929758] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-10T19:52:30.942472] [DEBUG] [LOCAL ] KSS: Trimmed 77627 records to 54376 (keeping 200 days of data) [2025-10-10T19:52:31.273475] [DEBUG] [LOCAL ] KSS: Primary data saved (54376 records). [2025-10-10T19:52:31.273620] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-10T19:52:31.273736] [INFO ] [MAIN ] Update Progress: 1225/2373 symbols completed. KSS took 40.3s. Estimated remaining: 2h 41m 37s. Rate: 7.1 symbols/min [2025-10-10T19:52:31.450076] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:52:31.450416] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-10T19:52:31.450470] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-10T19:52:31.450582] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-10T19:52:31.450622] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-10T19:52:31.450700] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-10T19:52:31.450745] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-10T19:52:31.513022] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-10T19:52:31.843623] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:52:31.845801] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T19:52:31.902221] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-10T19:52:32.289385] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-10T19:52:33.089350] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-10T19:52:33.124472] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-10T19:52:33.351464] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T19:52:33.889387] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-10T19:52:34.689376] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-10T19:52:34.768577] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-10T19:52:35.022574] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-10T19:52:35.489353] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-10T19:52:35.743568] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-10T19:52:36.289351] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-10T19:52:36.364447] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-10T19:52:37.089377] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-10T19:52:37.869506] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-10T19:52:37.889340] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-10T19:52:37.970824] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T19:52:38.689395] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-10T19:52:38.962580] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-10T19:52:39.489394] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-10T19:52:40.289413] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-10T19:52:40.417197] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T19:52:40.444795] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T19:52:41.089348] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-10T19:52:41.397574] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-10T19:52:41.889391] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-10T19:52:42.509663] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-10T19:52:42.689396] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-10T19:52:42.899051] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-10T19:52:43.206982] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-10T19:52:43.489380] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-10T19:52:44.289385] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-10T19:52:45.084294] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-10T19:52:45.092318] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-10T19:52:45.605966] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-10T19:52:45.889345] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-10T19:52:46.082221] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T19:52:46.689387] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-10T19:52:47.211045] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-10T19:52:47.489373] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-10T19:52:47.627860] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-10T19:52:48.169253] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-10T19:52:48.289350] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-10T19:52:49.089381] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-10T19:52:49.889372] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-10T19:52:50.028590] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-10T19:52:50.069100] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T19:52:50.689384] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-10T19:52:51.489379] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-10T19:52:51.667954] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T19:52:52.282304] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-10T19:52:52.289852] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-10T19:52:52.386124] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-10T19:52:53.089401] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-10T19:52:53.293561] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-10T19:52:53.889432] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-10T19:52:53.907306] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T19:52:53.908960] [INFO ] [REMOTE ] KTF: Full fetch complete (17453 records). [2025-10-10T19:52:53.909045] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-10T19:52:54.278859] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-10T19:52:54.278941] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-10T19:52:54.279404] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-10T19:52:54.279444] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-10T19:52:54.279966] [DEBUG] [LOCAL ] KTF: Trimmed 17453 records to 12160 (keeping 200 days of data) [2025-10-10T19:52:54.356156] [DEBUG] [LOCAL ] KTF: Primary data saved (12160 records). [2025-10-10T19:52:54.356303] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-10T19:52:54.356388] [INFO ] [MAIN ] Update Progress: 1226/2373 symbols completed. KTF took 32.9s. Estimated remaining: 2h 41m 42s. Rate: 7.1 symbols/min [2025-10-10T19:52:54.519415] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:52:54.568054] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-10-10T19:52:54.568359] [INFO ] [MAIN ] KVUE: Loaded 54057 existing records. [2025-10-10T19:52:54.703515] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-10T19:52:54.744136] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:52:54.744741] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-10T19:52:54.744797] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-10T19:52:54.745866] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-10T19:52:54.745924] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-10T19:52:55.091300] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:52:55.148568] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T19:52:55.150103] [INFO ] [REMOTE ] KUKE: Full fetch complete (8859 records). [2025-10-10T19:52:55.150169] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-10T19:52:55.323358] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T19:52:55.323604] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-10T19:52:55.323701] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-10T19:52:55.323780] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-10T19:52:55.323844] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-10T19:52:55.323881] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-10T19:52:55.323919] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-10T19:52:55.323981] [INFO ] [MAIN ] Update Progress: 1227/2373 symbols completed. KUKE took 24.1s. Estimated remaining: 2h 41m 27s. Rate: 7.1 symbols/min [2025-10-10T19:52:55.486082] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:52:55.489378] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-10T19:52:55.534612] [DEBUG] [LOCAL ] KVYO: Loaded 50818 existing records from primary storage. [2025-10-10T19:52:55.534941] [INFO ] [MAIN ] KVYO: Loaded 50818 existing records. [2025-10-10T19:52:55.705932] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:52:55.706152] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-10T19:52:55.706202] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-10T19:52:55.707075] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-10T19:52:55.707133] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-10T19:52:56.054387] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:52:56.289385] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-10T19:52:56.419385] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-10T19:52:56.422867] [INFO ] [REMOTE ] KTB: Full fetch complete (57940 records). [2025-10-10T19:52:56.422954] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-10T19:52:56.793079] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-10T19:52:56.793156] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-10T19:52:56.793976] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-10T19:52:56.794036] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-10T19:52:56.795202] [DEBUG] [LOCAL ] KTB: Trimmed 57940 records to 41117 (keeping 200 days of data) [2025-10-10T19:52:57.045093] [DEBUG] [LOCAL ] KTB: Primary data saved (41117 records). [2025-10-10T19:52:57.045212] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-10T19:52:57.045488] [INFO ] [MAIN ] Update Progress: 1228/2373 symbols completed. KTB took 41.8s. Estimated remaining: 2h 41m 12s. Rate: 7.1 symbols/min [2025-10-10T19:52:57.098943] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-10T19:52:57.215073] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:52:57.226593] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T19:52:57.231630] [INFO ] [REMOTE ] KT: Full fetch complete (66394 records). [2025-10-10T19:52:57.231840] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-10T19:52:57.501396] [DEBUG] [LOCAL ] KW: Loaded 40664 existing records from primary storage. [2025-10-10T19:52:57.528481] [INFO ] [MAIN ] KW: Loaded 40664 existing records. [2025-10-10T19:52:57.812453] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:52:57.822982] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-10T19:52:57.831180] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-10T19:52:57.853096] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-10T19:52:57.853318] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-10T19:52:57.877948] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-10T19:52:57.891833] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-10T19:52:57.915714] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-10T19:52:57.923779] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-10T19:52:58.002385] [DEBUG] [LOCAL ] KT: Trimmed 66394 records to 46155 (keeping 200 days of data) [2025-10-10T19:52:58.431409] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-10T19:52:58.511165] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-10T19:52:58.550200] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:52:58.614216] [DEBUG] [LOCAL ] KT: Primary data saved (46155 records). [2025-10-10T19:52:58.614359] [INFO ] [MAIN ] KT: Full history saved. [2025-10-10T19:52:58.614446] [INFO ] [MAIN ] Update Progress: 1229/2373 symbols completed. KT took 46.4s. Estimated remaining: 2h 40m 57s. Rate: 7.1 symbols/min [2025-10-10T19:52:58.694461] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-10T19:52:58.791061] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:52:58.808699] [DEBUG] [LOCAL ] KWR: Loaded 16328 existing records from primary storage. [2025-10-10T19:52:58.808959] [INFO ] [MAIN ] KWR: Loaded 16328 existing records. [2025-10-10T19:52:58.987755] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:52:58.988009] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-10T19:52:58.988067] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-10T19:52:58.988528] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-10T19:52:58.988586] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-10T19:52:59.340692] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:52:59.377226] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-10T19:52:59.489369] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-10T19:53:00.289402] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-10T19:53:00.404103] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-10T19:53:00.507459] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T19:53:00.834466] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T19:53:01.089383] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-10T19:53:01.889396] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-10T19:53:02.350212] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T19:53:02.689384] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-10T19:53:02.982691] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T19:53:03.090711] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-10T19:53:03.489358] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-10T19:53:04.289407] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-10T19:53:04.810951] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-10T19:53:05.089508] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-10T19:53:05.303116] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T19:53:05.823012] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-10T19:53:05.889340] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-10T19:53:06.689415] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-10T19:53:06.983275] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T19:53:07.489437] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-10T19:53:07.667556] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T19:53:07.870295] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-10T19:53:08.289425] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-10T19:53:09.089458] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-10T19:53:09.472242] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T19:53:09.889377] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-10T19:53:10.107087] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-10T19:53:10.374424] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-10T19:53:10.689414] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-10T19:53:11.489372] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-10T19:53:11.705106] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T19:53:11.881060] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-10T19:53:12.289400] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-10T19:53:13.089366] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-10T19:53:13.488030] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T19:53:13.545099] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-10T19:53:13.889425] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-10T19:53:14.689338] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-10T19:53:14.899102] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T19:53:15.489368] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-10T19:53:15.802712] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T19:53:16.289396] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-10T19:53:16.741782] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-10T19:53:16.817404] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-10T19:53:17.089433] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-10T19:53:17.889384] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-10T19:53:18.004427] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T19:53:18.689340] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-10T19:53:19.253720] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-10T19:53:19.489350] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-10T19:53:19.730707] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T19:53:20.289427] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-10T19:53:20.364407] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T19:53:21.089340] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-10T19:53:21.573412] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T19:53:21.889380] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-10T19:53:22.200787] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T19:53:22.305439] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T19:53:22.689419] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-10T19:53:23.489430] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-10T19:53:24.289383] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-10T19:53:24.390154] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-10T19:53:24.507328] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T19:53:24.529193] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-10T19:53:25.089372] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-10T19:53:25.889352] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-10T19:53:25.969050] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T19:53:26.252540] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T19:53:26.689440] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-10T19:53:27.489429] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-10T19:53:28.289405] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-10T19:53:28.414039] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-10T19:53:28.419301] [INFO ] [REMOTE ] KVUE: Full fetch complete (77674 records). [2025-10-10T19:53:28.419448] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-10T19:53:28.775084] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T19:53:28.860372] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-10T19:53:28.877310] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-10T19:53:28.878724] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-10T19:53:28.878812] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-10T19:53:28.880924] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-10T19:53:28.892740] [DEBUG] [LOCAL ] KVUE: Trimmed 77674 records to 54447 (keeping 200 days of data) [2025-10-10T19:53:29.098012] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-10T19:53:29.262090] [DEBUG] [LOCAL ] KVUE: Primary data saved (54447 records). [2025-10-10T19:53:29.262237] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-10T19:53:29.262322] [INFO ] [MAIN ] Update Progress: 1230/2373 symbols completed. KVUE took 34.9s. Estimated remaining: 2h 41m 9s. Rate: 7.1 symbols/min [2025-10-10T19:53:29.461853] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:53:29.493509] [DEBUG] [LOCAL ] KYN: Loaded 30315 existing records from primary storage. [2025-10-10T19:53:29.493862] [INFO ] [MAIN ] KYN: Loaded 30315 existing records. [2025-10-10T19:53:29.702879] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:53:29.703127] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-10T19:53:29.703177] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-10T19:53:29.703845] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-10T19:53:29.703906] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-10T19:53:29.908624] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-10T19:53:29.948720] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-10T19:53:30.035746] [INFO ] [REMOTE ] KW: Full fetch complete (57078 records). [2025-10-10T19:53:30.063286] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-10T19:53:30.258117] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:53:30.276625] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T19:53:30.598952] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-10T19:53:30.599032] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-10T19:53:30.599966] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-10T19:53:30.600063] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-10T19:53:30.601314] [DEBUG] [LOCAL ] KW: Trimmed 57078 records to 40951 (keeping 200 days of data) [2025-10-10T19:53:30.695011] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-10T19:53:30.847612] [DEBUG] [LOCAL ] KW: Primary data saved (40951 records). [2025-10-10T19:53:30.847771] [INFO ] [MAIN ] KW: Full history saved. [2025-10-10T19:53:30.848050] [INFO ] [MAIN ] Update Progress: 1231/2373 symbols completed. KW took 33.8s. Estimated remaining: 2h 40m 54s. Rate: 7.1 symbols/min [2025-10-10T19:53:31.026603] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:53:31.071427] [DEBUG] [LOCAL ] L: Loaded 41365 existing records from primary storage. [2025-10-10T19:53:31.071781] [INFO ] [MAIN ] L: Loaded 41365 existing records. [2025-10-10T19:53:31.246749] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:53:31.247036] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-10T19:53:31.247094] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-10T19:53:31.247898] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-10T19:53:31.247956] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-10T19:53:31.494609] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-10T19:53:31.597410] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:53:31.669029] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-10T19:53:31.670599] [INFO ] [REMOTE ] KWR: Full fetch complete (23703 records). [2025-10-10T19:53:31.670694] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-10T19:53:32.043698] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-10T19:53:32.048968] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-10T19:53:32.056511] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-10T19:53:32.057274] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-10T19:53:32.058001] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-10T19:53:32.063443] [DEBUG] [LOCAL ] KWR: Trimmed 23703 records to 16404 (keeping 200 days of data) [2025-10-10T19:53:32.063862] [INFO ] [REMOTE ] KVYO: Full fetch complete (71781 records). [2025-10-10T19:53:32.064213] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-10T19:53:32.303669] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-10T19:53:32.379976] [DEBUG] [LOCAL ] KWR: Primary data saved (16404 records). [2025-10-10T19:53:32.435239] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-10T19:53:32.469686] [INFO ] [MAIN ] Update Progress: 1232/2373 symbols completed. KWR took 33.9s. Estimated remaining: 2h 40m 40s. Rate: 7.1 symbols/min [2025-10-10T19:53:32.764368] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-10T19:53:32.771333] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-10T19:53:32.773570] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-10T19:53:32.775555] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-10T19:53:32.801328] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:53:32.803913] [DEBUG] [LOCAL ] KVYO: Trimmed 71781 records to 51205 (keeping 200 days of data) [2025-10-10T19:53:33.093394] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T19:53:33.120963] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-10T19:53:33.172689] [DEBUG] [LOCAL ] LAC: Loaded 52833 existing records from primary storage. [2025-10-10T19:53:33.173279] [INFO ] [MAIN ] LAC: Loaded 52833 existing records. [2025-10-10T19:53:33.285677] [DEBUG] [LOCAL ] KVYO: Primary data saved (51205 records). [2025-10-10T19:53:33.307128] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-10T19:53:33.310535] [INFO ] [MAIN ] Update Progress: 1233/2373 symbols completed. KVYO took 38.0s. Estimated remaining: 2h 40m 24s. Rate: 7.1 symbols/min [2025-10-10T19:53:33.526973] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:53:33.542751] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-10T19:53:33.547983] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-10T19:53:33.577507] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-10T19:53:33.577720] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-10T19:53:33.606007] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:53:33.898220] [DEBUG] [LOCAL ] LAD: Loaded 23719 existing records from primary storage. [2025-10-10T19:53:33.924792] [INFO ] [MAIN ] LAD: Loaded 23719 existing records. [2025-10-10T19:53:34.079552] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:53:34.080450] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-10T19:53:34.163832] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:53:34.164371] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-10T19:53:34.164566] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-10T19:53:34.165168] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-10T19:53:34.165232] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-10T19:53:34.395334] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-10T19:53:34.588815] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:53:34.689381] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-10T19:53:34.811896] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T19:53:35.489385] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-10T19:53:35.913964] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T19:53:36.259568] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-10T19:53:36.289335] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-10T19:53:36.472103] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-10T19:53:37.089376] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-10T19:53:37.854768] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-10T19:53:37.889330] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-10T19:53:38.689342] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-10T19:53:38.800805] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T19:53:39.166907] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T19:53:39.489375] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-10T19:53:40.289367] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-10T19:53:40.839906] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-10T19:53:41.089371] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-10T19:53:41.166141] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T19:53:41.269847] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-10T19:53:41.889387] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-10T19:53:42.690146] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-10T19:53:42.692634] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-10T19:53:42.779217] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-10T19:53:43.489458] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-10T19:53:44.289418] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-10T19:53:44.518612] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T19:53:45.027541] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-10T19:53:45.089345] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-10T19:53:45.760884] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-10T19:53:45.889367] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-10T19:53:46.689383] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-10T19:53:47.204015] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-10T19:53:47.316591] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-10T19:53:47.489385] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-10T19:53:47.938951] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-10T19:53:48.289394] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-10T19:53:49.089417] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-10T19:53:49.620072] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-10T19:53:49.889381] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-10T19:53:49.963629] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T19:53:50.279699] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-10T19:53:50.689380] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-10T19:53:51.489376] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-10T19:53:51.543477] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T19:53:52.227449] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-10T19:53:52.289340] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-10T19:53:53.089420] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-10T19:53:53.310462] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-10T19:53:53.423358] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-10T19:53:53.889383] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-10T19:53:54.689361] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-10T19:53:55.402866] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-10T19:53:55.489331] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-10T19:53:55.546467] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-10T19:53:56.088908] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-10T19:53:56.289351] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-10T19:53:57.089407] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-10T19:53:57.544700] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-10T19:53:57.664426] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-10T19:53:57.889375] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-10T19:53:58.573969] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-10T19:53:58.689351] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-10T19:53:59.489384] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-10T19:54:00.016867] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T19:54:00.260236] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-10T19:54:00.289346] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-10T19:54:01.089406] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-10T19:54:01.149060] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T19:54:01.889400] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-10T19:54:02.689394] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-10T19:54:02.840225] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T19:54:03.133128] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.84 seconds). [2025-10-10T19:54:03.138114] [INFO ] [REMOTE ] LAC: Full fetch complete (76007 records). [2025-10-10T19:54:03.138222] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-10T19:54:03.249935] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-10T19:54:03.290264] [INFO ] [REMOTE ] LAD: Full fetch complete (35253 records). [2025-10-10T19:54:03.304831] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-10T19:54:03.508712] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-10T19:54:03.721499] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-10T19:54:03.740801] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-10T19:54:03.787185] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-10T19:54:03.787514] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-10T19:54:03.838142] [DEBUG] [LOCAL ] LAC: Trimmed 76007 records to 53223 (keeping 200 days of data) [2025-10-10T19:54:03.985368] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T19:54:04.027243] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-10T19:54:04.028719] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-10T19:54:04.038957] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-10T19:54:04.046675] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-10T19:54:04.069211] [DEBUG] [LOCAL ] LAD: Trimmed 35253 records to 23862 (keeping 200 days of data) [2025-10-10T19:54:04.292486] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-10T19:54:04.403677] [DEBUG] [LOCAL ] LAD: Primary data saved (23862 records). [2025-10-10T19:54:04.407207] [DEBUG] [LOCAL ] LAC: Primary data saved (53223 records). [2025-10-10T19:54:04.407416] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-10T19:54:04.407351] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-10T19:54:04.407548] [INFO ] [MAIN ] Update Progress: 1234/2373 symbols completed. LAC took 31.9s. Estimated remaining: 2h 40m 37s. Rate: 7.1 symbols/min [2025-10-10T19:54:04.418946] [INFO ] [MAIN ] Update Progress: 1235/2373 symbols completed. LAD took 31.1s. Estimated remaining: 2h 40m 20s. Rate: 7.1 symbols/min [2025-10-10T19:54:04.761252] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:54:04.763817] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:54:04.769620] [DEBUG] [LOCAL ] LANV: Loaded 2790 existing records from primary storage. [2025-10-10T19:54:04.769909] [INFO ] [MAIN ] LANV: Loaded 2790 existing records. [2025-10-10T19:54:04.960833] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:54:04.961333] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-10T19:54:04.961424] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-10T19:54:04.961711] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-10T19:54:04.961785] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-10T19:54:05.085390] [DEBUG] [LOCAL ] LADR: Loaded 39462 existing records from primary storage. [2025-10-10T19:54:05.096898] [INFO ] [MAIN ] LADR: Loaded 39462 existing records. [2025-10-10T19:54:05.416088] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:54:05.430981] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-10T19:54:05.441518] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-10T19:54:05.489421] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-10T19:54:05.495425] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-10T19:54:05.522284] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-10T19:54:05.622034] [INFO ] [REMOTE ] L: Full fetch complete (59234 records). [2025-10-10T19:54:05.661425] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-10T19:54:05.700973] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:54:05.707470] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-10T19:54:06.202347] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:54:06.223222] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-10T19:54:06.224285] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T19:54:06.371074] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-10T19:54:06.371181] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-10T19:54:06.372129] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-10T19:54:06.372205] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-10T19:54:06.373959] [DEBUG] [LOCAL ] L: Trimmed 59234 records to 41622 (keeping 200 days of data) [2025-10-10T19:54:06.468552] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-10T19:54:06.627936] [DEBUG] [LOCAL ] L: Primary data saved (41622 records). [2025-10-10T19:54:06.628063] [INFO ] [MAIN ] L: Full history saved. [2025-10-10T19:54:06.628376] [INFO ] [MAIN ] Update Progress: 1236/2373 symbols completed. L took 35.8s. Estimated remaining: 2h 40m 6s. Rate: 7.1 symbols/min [2025-10-10T19:54:06.694524] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-10T19:54:06.796587] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:54:06.796760] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-10T19:54:06.796813] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-10T19:54:06.796943] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-10T19:54:06.796992] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-10T19:54:06.797034] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-10T19:54:06.797066] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-10T19:54:07.145061] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:54:07.489343] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-10T19:54:07.660048] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-10T19:54:07.707770] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T19:54:07.707991] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-10T19:54:07.708097] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T19:54:07.708184] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-10T19:54:07.708268] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T19:54:07.708361] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-10T19:54:07.708438] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-10T19:54:07.708476] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-10T19:54:07.708515] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-10T19:54:07.708556] [INFO ] [MAIN ] Update Progress: 1237/2373 symbols completed. LAR took 1.1s. Estimated remaining: 2h 39m 51s. Rate: 7.1 symbols/min [2025-10-10T19:54:08.200889] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-10T19:54:08.289373] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-10T19:54:09.089397] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-10T19:54:09.567201] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T19:54:09.570258] [INFO ] [REMOTE ] KYN: Full fetch complete (44364 records). [2025-10-10T19:54:09.570340] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-10T19:54:09.688501] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-10T19:54:09.894486] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-10T19:54:09.961300] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-10T19:54:09.961375] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-10T19:54:09.962165] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-10T19:54:09.962227] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-10T19:54:09.963231] [DEBUG] [LOCAL ] KYN: Trimmed 44364 records to 30600 (keeping 200 days of data) [2025-10-10T19:54:10.144024] [DEBUG] [LOCAL ] KYN: Primary data saved (30600 records). [2025-10-10T19:54:10.144153] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-10T19:54:10.144233] [INFO ] [MAIN ] Update Progress: 1238/2373 symbols completed. KYN took 40.9s. Estimated remaining: 2h 39m 37s. Rate: 7.1 symbols/min [2025-10-10T19:54:10.529248] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-10T19:54:10.689329] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-10T19:54:11.236116] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-10T19:54:11.489352] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-10T19:54:12.092392] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-10T19:54:12.289447] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-10T19:54:13.089440] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-10T19:54:13.592552] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-10T19:54:13.889399] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-10T19:54:13.931846] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T19:54:14.408239] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-10T19:54:14.689409] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-10T19:54:15.489383] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-10T19:54:16.089492] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-10T19:54:16.242109] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-10T19:54:16.289383] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-10T19:54:17.089382] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-10T19:54:17.731765] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-10T19:54:17.889412] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-10T19:54:17.972020] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T19:54:18.605162] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-10T19:54:18.689347] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-10T19:54:19.406223] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-10T19:54:19.407188] [INFO ] [REMOTE ] LANV: Full fetch complete (4383 records). [2025-10-10T19:54:19.407256] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-10T19:54:19.494470] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-10T19:54:19.752267] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-10T19:54:19.752345] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-10T19:54:19.752489] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-10T19:54:19.752529] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-10T19:54:19.752900] [DEBUG] [LOCAL ] LANV: Trimmed 4383 records to 2845 (keeping 200 days of data) [2025-10-10T19:54:19.768444] [DEBUG] [LOCAL ] LANV: Primary data saved (2845 records). [2025-10-10T19:54:19.768522] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-10T19:54:19.768595] [INFO ] [MAIN ] Update Progress: 1239/2373 symbols completed. LANV took 15.3s. Estimated remaining: 2h 39m 30s. Rate: 7.1 symbols/min [2025-10-10T19:54:21.305875] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T19:54:21.315590] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-10T19:54:22.889746] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-10T19:54:22.897102] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-10T19:54:24.618385] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T19:54:24.626475] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-10T19:54:26.285966] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T19:54:26.295575] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-10T19:54:27.888639] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-10T19:54:27.897188] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-10T19:54:29.523881] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T19:54:29.533880] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-10T19:54:31.214985] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-10T19:54:31.219540] [INFO ] [REMOTE ] LADR: Full fetch complete (55578 records). [2025-10-10T19:54:31.219692] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-10T19:54:31.617134] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-10T19:54:31.617229] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-10T19:54:31.618130] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-10T19:54:31.618224] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-10T19:54:31.619381] [DEBUG] [LOCAL ] LADR: Trimmed 55578 records to 39783 (keeping 200 days of data) [2025-10-10T19:54:31.858405] [DEBUG] [LOCAL ] LADR: Primary data saved (39783 records). [2025-10-10T19:54:31.858595] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-10T19:54:31.858749] [INFO ] [MAIN ] Update Progress: 1240/2373 symbols completed. LADR took 27.5s. Estimated remaining: 2h 39m 25s. Rate: 7.1 symbols/min [2025-10-10T19:54:32.479895] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:54:32.483495] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:54:32.537097] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:54:32.584913] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:54:32.599484] [DEBUG] [LOCAL ] LAW: Loaded 14351 existing records from primary storage. [2025-10-10T19:54:32.599965] [INFO ] [MAIN ] LAW: Loaded 14351 existing records. [2025-10-10T19:54:32.805561] [DEBUG] [LOCAL ] LAZ: Loaded 45066 existing records from primary storage. [2025-10-10T19:54:32.837818] [DEBUG] [LOCAL ] LB: Loaded 37931 existing records from primary storage. [2025-10-10T19:54:32.838257] [INFO ] [MAIN ] LAZ: Loaded 45066 existing records. [2025-10-10T19:54:32.836612] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:54:32.857764] [INFO ] [MAIN ] LB: Loaded 37931 existing records. [2025-10-10T19:54:32.892083] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-10T19:54:32.923395] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-10T19:54:32.972959] [DEBUG] [LOCAL ] LBRT: Loaded 53323 existing records from primary storage. [2025-10-10T19:54:33.003390] [INFO ] [MAIN ] LBRT: Loaded 53323 existing records. [2025-10-10T19:54:33.003474] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-10T19:54:33.008926] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-10T19:54:33.415156] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:54:33.443929] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-10T19:54:33.484485] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-10T19:54:33.492661] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:54:33.526040] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-10T19:54:33.573106] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-10T19:54:33.548529] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-10T19:54:33.594818] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-10T19:54:33.577001] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:54:33.595032] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-10T19:54:33.594941] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-10T19:54:33.664864] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-10T19:54:33.665032] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-10T19:54:33.755741] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-10T19:54:33.812825] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-10T19:54:34.216400] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:54:34.315762] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-10T19:54:34.789679] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:54:34.825087] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-10T19:54:34.928455] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:54:34.923370] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:54:34.928848] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-10T19:54:34.929085] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-10T19:54:35.610191] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T19:54:35.614083] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-10T19:54:36.581448] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T19:54:36.590325] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-10T19:54:36.615928] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T19:54:36.625200] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-10T19:54:36.655539] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-10T19:54:36.659237] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-10T19:54:36.862326] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T19:54:36.872761] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-10T19:54:37.850671] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-10T19:54:37.855083] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-10T19:54:37.920815] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T19:54:37.930089] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-10T19:54:38.076478] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-10T19:54:38.086696] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-10T19:54:38.760407] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-10T19:54:38.771398] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-10T19:54:38.781830] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-10T19:54:38.785814] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-10T19:54:38.952104] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-10T19:54:38.960001] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-10T19:54:39.322330] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T19:54:39.330970] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-10T19:54:39.720707] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T19:54:39.724365] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-10T19:54:40.697168] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T19:54:40.707147] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-10T19:54:40.750388] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-10T19:54:40.754916] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-10T19:54:40.781291] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T19:54:40.791404] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-10T19:54:41.310158] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T19:54:41.319822] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-10T19:54:41.902591] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-10T19:54:41.907947] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-10T19:54:42.042864] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T19:54:42.168438] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-10T19:54:42.689354] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-10T19:54:42.966474] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-10T19:54:43.108614] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T19:54:43.489427] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-10T19:54:44.289400] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-10T19:54:44.339856] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-10T19:54:44.583866] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-10T19:54:45.089368] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-10T19:54:45.889436] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-10T19:54:46.280621] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T19:54:46.321740] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T19:54:46.689391] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-10T19:54:47.489350] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-10T19:54:47.782921] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-10T19:54:47.802201] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-10T19:54:48.289374] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-10T19:54:49.089369] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-10T19:54:49.477437] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T19:54:49.889356] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-10T19:54:50.020117] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-10T19:54:50.030425] [DEBUG] [REMOTE ] LBRT: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-10T19:54:50.031976] [WARN ] [REMOTE ] LBRT: No data returned for month 2025-06 [2025-10-10T19:54:50.032108] [FATAL] [REMOTE ] LBRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T19:54:50.037397] [FATAL] [MAIN ] LBRT: Failed to fetch primary data. [2025-10-10T19:54:50.038293] [WARN ] [MAIN ] LBRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T19:54:50.038231] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T19:54:50.040348] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-10T19:54:50.040534] [DEBUG] [LOCAL ] LBRT: No primary data file found to delete. [2025-10-10T19:54:50.040616] [INFO ] [REMOTE ] LAW: Full fetch complete (20736 records). [2025-10-10T19:54:50.040749] [INFO ] [LOCAL ] LBRT: Starting deletion of derivative data. [2025-10-10T19:54:50.040795] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-10T19:54:50.072252] [DEBUG] [LOCAL ] LBRT: Deleted derivative data file. [2025-10-10T19:54:50.114341] [INFO ] [MAIN ] Update Progress: 1241/2373 symbols completed. LBRT took 18.2s. Estimated remaining: 2h 39m 25s. Rate: 7.1 symbols/min [2025-10-10T19:54:50.495124] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:54:50.579084] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-10T19:54:50.580381] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-10T19:54:50.581034] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-10T19:54:50.581104] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-10T19:54:50.582131] [DEBUG] [LOCAL ] LAW: Trimmed 20736 records to 14516 (keeping 200 days of data) [2025-10-10T19:54:50.694220] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-10T19:54:50.694475] [DEBUG] [LOCAL ] LAW: Primary data saved (14516 records). [2025-10-10T19:54:50.695447] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-10T19:54:50.695578] [INFO ] [MAIN ] Update Progress: 1242/2373 symbols completed. LAW took 18.8s. Estimated remaining: 2h 39m 9s. Rate: 7.1 symbols/min [2025-10-10T19:54:50.697046] [DEBUG] [LOCAL ] LC: Loaded 48313 existing records from primary storage. [2025-10-10T19:54:50.718552] [INFO ] [MAIN ] LC: Loaded 48313 existing records. [2025-10-10T19:54:51.050450] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:54:51.053214] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:54:51.053493] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-10T19:54:51.053566] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-10T19:54:51.055031] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-10T19:54:51.055095] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-10T19:54:51.359221] [DEBUG] [LOCAL ] LCII: Loaded 27795 existing records from primary storage. [2025-10-10T19:54:51.370343] [INFO ] [MAIN ] LCII: Loaded 27795 existing records. [2025-10-10T19:54:51.505469] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-10T19:54:51.516358] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:54:51.641438] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:54:51.641779] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-10T19:54:51.641861] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-10T19:54:51.642788] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-10T19:54:51.642867] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-10T19:54:51.996332] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:54:52.289357] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-10T19:54:52.503675] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-10T19:54:53.089349] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-10T19:54:53.145461] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-10T19:54:53.889343] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-10T19:54:54.294573] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T19:54:54.412628] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T19:54:54.689421] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-10T19:54:55.489342] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-10T19:54:55.619162] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-10T19:54:56.289429] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-10T19:54:56.616821] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T19:54:57.089359] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-10T19:54:57.145314] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T19:54:57.242847] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-10T19:54:57.889420] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-10T19:54:58.689358] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-10T19:54:58.955681] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-10T19:54:59.386232] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T19:54:59.390077] [INFO ] [REMOTE ] LB: Full fetch complete (55883 records). [2025-10-10T19:54:59.390164] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-10T19:54:59.489703] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-10T19:54:59.771208] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-10T19:54:59.771312] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-10T19:54:59.772103] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-10T19:54:59.772166] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-10T19:54:59.773375] [DEBUG] [LOCAL ] LB: Trimmed 55883 records to 38235 (keeping 200 days of data) [2025-10-10T19:54:59.996901] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T19:55:00.023339] [DEBUG] [LOCAL ] LB: Primary data saved (38235 records). [2025-10-10T19:55:00.023504] [INFO ] [MAIN ] LB: Full history saved. [2025-10-10T19:55:00.023593] [INFO ] [MAIN ] Update Progress: 1243/2373 symbols completed. LB took 28.2s. Estimated remaining: 2h 39m 2s. Rate: 7.1 symbols/min [2025-10-10T19:55:00.188320] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:55:00.227969] [DEBUG] [LOCAL ] LDI: Loaded 44871 existing records from primary storage. [2025-10-10T19:55:00.228268] [INFO ] [MAIN ] LDI: Loaded 44871 existing records. [2025-10-10T19:55:00.294563] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-10T19:55:00.414997] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:55:00.415315] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-10T19:55:00.415370] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-10T19:55:00.416769] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-10T19:55:00.416835] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-10T19:55:00.791810] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:55:01.089407] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-10T19:55:01.304506] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-10T19:55:01.889392] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-10T19:55:02.196527] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T19:55:02.689400] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-10T19:55:02.901607] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T19:55:03.489390] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-10T19:55:03.524970] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-10T19:55:04.157111] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-10T19:55:04.289422] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-10T19:55:05.019754] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-10T19:55:05.089404] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-10T19:55:05.889400] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-10T19:55:06.099860] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T19:55:06.689387] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-10T19:55:06.734662] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-10T19:55:07.489414] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-10T19:55:07.659277] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T19:55:08.240468] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-10T19:55:08.289346] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-10T19:55:08.883190] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-10T19:55:08.891863] [INFO ] [REMOTE ] LAZ: Full fetch complete (65638 records). [2025-10-10T19:55:08.892170] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-10T19:55:09.095361] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-10T19:55:09.384265] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-10T19:55:09.384425] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-10T19:55:09.385959] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-10T19:55:09.386083] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-10T19:55:09.388075] [DEBUG] [LOCAL ] LAZ: Trimmed 65638 records to 45361 (keeping 200 days of data) [2025-10-10T19:55:09.720530] [DEBUG] [LOCAL ] LAZ: Primary data saved (45361 records). [2025-10-10T19:55:09.721456] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-10T19:55:09.723236] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-10T19:55:09.721587] [INFO ] [MAIN ] Update Progress: 1244/2373 symbols completed. LAZ took 37.9s. Estimated remaining: 2h 38m 55s. Rate: 7.1 symbols/min [2025-10-10T19:55:09.911720] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-10T19:55:09.915329] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:55:09.965708] [DEBUG] [LOCAL ] LDOS: Loaded 45603 existing records from primary storage. [2025-10-10T19:55:09.966132] [INFO ] [MAIN ] LDOS: Loaded 45603 existing records. [2025-10-10T19:55:10.155926] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:55:10.156249] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-10T19:55:10.156300] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-10T19:55:10.157687] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-10T19:55:10.157751] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-10T19:55:10.525467] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:55:10.689378] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-10T19:55:10.912634] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T19:55:11.489366] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-10T19:55:11.626732] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-10T19:55:12.064198] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T19:55:12.289471] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-10T19:55:13.089441] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-10T19:55:13.172151] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T19:55:13.889400] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-10T19:55:14.218262] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T19:55:14.414527] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-10T19:55:14.689410] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-10T19:55:15.309178] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-10T19:55:15.489408] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-10T19:55:16.287236] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-10T19:55:16.294226] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-10T19:55:17.089437] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-10T19:55:17.253593] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T19:55:17.544149] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T19:55:17.889406] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-10T19:55:18.689401] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-10T19:55:18.799553] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T19:55:19.335905] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-10T19:55:19.489402] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-10T19:55:20.091052] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-10T19:55:20.289437] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-10T19:55:21.089407] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-10T19:55:21.469185] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T19:55:21.555550] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T19:55:21.889411] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-10T19:55:22.387183] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-10T19:55:22.392537] [INFO ] [REMOTE ] LC: Full fetch complete (70475 records). [2025-10-10T19:55:22.392757] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-10T19:55:22.697207] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-10T19:55:22.797458] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-10T19:55:22.797547] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-10T19:55:22.798723] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-10T19:55:22.798789] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-10T19:55:22.800256] [DEBUG] [LOCAL ] LC: Trimmed 70475 records to 48680 (keeping 200 days of data) [2025-10-10T19:55:23.087310] [DEBUG] [LOCAL ] LC: Primary data saved (48680 records). [2025-10-10T19:55:23.087453] [INFO ] [MAIN ] LC: Full history saved. [2025-10-10T19:55:23.087535] [INFO ] [MAIN ] Update Progress: 1245/2373 symbols completed. LC took 33.0s. Estimated remaining: 2h 38m 51s. Rate: 7.1 symbols/min [2025-10-10T19:55:23.199938] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-10T19:55:23.224212] [INFO ] [REMOTE ] LCII: Full fetch complete (39069 records). [2025-10-10T19:55:23.248861] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-10T19:55:23.323614] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:55:23.469822] [DEBUG] [LOCAL ] LDP: Loaded 13016 existing records from primary storage. [2025-10-10T19:55:23.538020] [INFO ] [MAIN ] LDP: Loaded 13016 existing records. [2025-10-10T19:55:23.544705] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-10T19:55:23.988345] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:55:23.989063] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-10T19:55:23.989668] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-10T19:55:23.989897] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-10T19:55:23.989802] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-10T19:55:23.991038] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-10T19:55:23.991258] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-10T19:55:23.991174] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-10T19:55:23.991415] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-10T19:55:24.090031] [DEBUG] [LOCAL ] LCII: Trimmed 39069 records to 27968 (keeping 200 days of data) [2025-10-10T19:55:24.547235] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T19:55:24.579880] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:55:24.615323] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-10T19:55:24.646524] [DEBUG] [LOCAL ] LCII: Primary data saved (27968 records). [2025-10-10T19:55:24.646773] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-10T19:55:24.646913] [INFO ] [MAIN ] Update Progress: 1246/2373 symbols completed. LCII took 33.9s. Estimated remaining: 2h 38m 36s. Rate: 7.1 symbols/min [2025-10-10T19:55:24.832939] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:55:24.875567] [DEBUG] [LOCAL ] LEA: Loaded 41878 existing records from primary storage. [2025-10-10T19:55:24.875975] [INFO ] [MAIN ] LEA: Loaded 41878 existing records. [2025-10-10T19:55:25.099583] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-10T19:55:25.106110] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:55:25.107005] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-10T19:55:25.107115] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-10T19:55:25.109559] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-10T19:55:25.109636] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-10T19:55:25.503508] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:55:25.551957] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T19:55:25.737246] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-10T19:55:25.889369] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-10T19:55:26.689356] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-10T19:55:26.928861] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T19:55:26.991134] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-10T19:55:27.489378] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-10T19:55:28.199184] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-10T19:55:28.289421] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-10T19:55:29.089416] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-10T19:55:29.397860] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T19:55:29.889350] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-10T19:55:29.925919] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T19:55:29.941792] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-10T19:55:30.689382] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-10T19:55:31.489351] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-10T19:55:31.752071] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-10T19:55:31.811009] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-10T19:55:32.289406] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-10T19:55:33.089344] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-10T19:55:33.117974] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T19:55:33.385687] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-10T19:55:33.889392] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-10T19:55:34.689409] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-10T19:55:34.862689] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T19:55:35.077871] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T19:55:35.489374] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-10T19:55:35.825220] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-10T19:55:36.289389] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-10T19:55:37.089347] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-10T19:55:37.201878] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-10T19:55:37.322060] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-10T19:55:37.889457] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-10T19:55:38.689384] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-10T19:55:38.988533] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-10T19:55:39.301853] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-10T19:55:39.489360] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-10T19:55:40.289344] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-10T19:55:40.544148] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-10T19:55:41.089397] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-10T19:55:41.894889] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-10T19:55:41.903286] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-10T19:55:41.910378] [INFO ] [REMOTE ] LDI: Full fetch complete (61265 records). [2025-10-10T19:55:41.910538] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-10T19:55:42.281454] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T19:55:42.334613] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-10T19:55:42.334793] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-10T19:55:42.335622] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-10T19:55:42.335705] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-10T19:55:42.337167] [DEBUG] [LOCAL ] LDI: Trimmed 61265 records to 45259 (keeping 200 days of data) [2025-10-10T19:55:42.594157] [DEBUG] [LOCAL ] LDI: Primary data saved (45259 records). [2025-10-10T19:55:42.594287] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-10T19:55:42.594365] [INFO ] [MAIN ] Update Progress: 1247/2373 symbols completed. LDI took 42.6s. Estimated remaining: 2h 38m 36s. Rate: 7.1 symbols/min [2025-10-10T19:55:42.696750] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-10T19:55:42.775775] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:55:42.801115] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T19:55:42.850374] [DEBUG] [LOCAL ] LEG: Loaded 50535 existing records from primary storage. [2025-10-10T19:55:42.850704] [INFO ] [MAIN ] LEG: Loaded 50535 existing records. [2025-10-10T19:55:42.989586] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-10T19:55:43.044529] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:55:43.044787] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-10T19:55:43.044854] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-10T19:55:43.045836] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-10T19:55:43.045895] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-10T19:55:43.395265] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:55:43.489367] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-10T19:55:44.289364] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-10T19:55:44.380507] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T19:55:45.089356] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-10T19:55:45.657550] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T19:55:45.724418] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-10T19:55:45.889398] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-10T19:55:46.689353] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-10T19:55:47.311390] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-10T19:55:47.316470] [INFO ] [REMOTE ] LDOS: Full fetch complete (67236 records). [2025-10-10T19:55:47.316596] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-10T19:55:47.495064] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-10T19:55:47.720879] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-10T19:55:47.721052] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-10T19:55:47.723247] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-10T19:55:47.724230] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-10T19:55:47.723124] [INFO ] [REMOTE ] LDP: Full fetch complete (19043 records). [2025-10-10T19:55:47.724380] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-10T19:55:47.724708] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-10T19:55:47.810782] [DEBUG] [LOCAL ] LDOS: Trimmed 67236 records to 45881 (keeping 200 days of data) [2025-10-10T19:55:47.857457] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-10T19:55:48.291884] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-10T19:55:48.325527] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-10T19:55:48.334522] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-10T19:55:48.335432] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-10T19:55:48.361514] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-10T19:55:48.365526] [DEBUG] [LOCAL ] LDP: Trimmed 19043 records to 13106 (keeping 200 days of data) [2025-10-10T19:55:48.467951] [DEBUG] [LOCAL ] LDP: Primary data saved (13106 records). [2025-10-10T19:55:48.479762] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-10T19:55:48.479914] [INFO ] [MAIN ] Update Progress: 1248/2373 symbols completed. LDP took 25.4s. Estimated remaining: 2h 38m 25s. Rate: 7.1 symbols/min [2025-10-10T19:55:48.592962] [DEBUG] [LOCAL ] LDOS: Primary data saved (45881 records). [2025-10-10T19:55:48.618356] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-10T19:55:48.621573] [INFO ] [MAIN ] Update Progress: 1249/2373 symbols completed. LDOS took 38.9s. Estimated remaining: 2h 38m 9s. Rate: 7.1 symbols/min [2025-10-10T19:55:48.807000] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:55:48.883569] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:55:48.904083] [DEBUG] [LOCAL ] LEO: Loaded 17020 existing records from primary storage. [2025-10-10T19:55:48.904497] [INFO ] [MAIN ] LEO: Loaded 17020 existing records. [2025-10-10T19:55:49.105710] [DEBUG] [LOCAL ] LEN: Loaded 53560 existing records from primary storage. [2025-10-10T19:55:49.134057] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:55:49.134721] [INFO ] [MAIN ] LEN: Loaded 53560 existing records. [2025-10-10T19:55:49.156961] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-10T19:55:49.167086] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-10T19:55:49.217360] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-10T19:55:49.235511] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-10T19:55:49.393197] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:55:49.426022] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-10T19:55:49.426178] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-10T19:55:49.432181] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-10T19:55:49.466179] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-10T19:55:49.791876] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-10T19:55:49.917796] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-10T19:55:49.916996] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:55:49.948947] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-10T19:55:50.150161] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:55:50.178382] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-10T19:55:50.627433] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-10T19:55:50.689401] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-10T19:55:51.489427] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-10T19:55:51.735114] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T19:55:52.289370] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-10T19:55:52.785100] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-10T19:55:52.811807] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T19:55:53.089387] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-10T19:55:53.427743] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-10T19:55:53.889431] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-10T19:55:54.689385] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-10T19:55:54.786295] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-10T19:55:54.842018] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-10T19:55:55.489436] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-10T19:55:56.289372] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-10T19:55:56.489459] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T19:55:56.694545] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-10T19:55:57.089396] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-10T19:55:57.894627] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-10T19:55:57.925414] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T19:55:58.370832] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-10T19:55:58.689352] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-10T19:55:59.489418] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-10T19:55:59.651621] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-10T19:55:59.655560] [INFO ] [REMOTE ] LEA: Full fetch complete (60615 records). [2025-10-10T19:55:59.655665] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-10T19:55:59.831284] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-10T19:56:00.048792] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-10T19:56:00.048900] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-10T19:56:00.049735] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-10T19:56:00.049798] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-10T19:56:00.050997] [DEBUG] [LOCAL ] LEA: Trimmed 60615 records to 42180 (keeping 200 days of data) [2025-10-10T19:56:00.289942] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-10T19:56:00.302520] [DEBUG] [LOCAL ] LEA: Primary data saved (42180 records). [2025-10-10T19:56:00.303619] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-10T19:56:00.303960] [INFO ] [MAIN ] Update Progress: 1250/2373 symbols completed. LEA took 35.7s. Estimated remaining: 2h 38m 4s. Rate: 7.1 symbols/min [2025-10-10T19:56:00.469257] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:56:00.518021] [DEBUG] [LOCAL ] LEVI: Loaded 52062 existing records from primary storage. [2025-10-10T19:56:00.518323] [INFO ] [MAIN ] LEVI: Loaded 52062 existing records. [2025-10-10T19:56:00.692385] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:56:00.692602] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-10T19:56:00.692672] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-10T19:56:00.693710] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-10T19:56:00.693768] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-10T19:56:01.035101] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:56:01.089329] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-10T19:56:01.410813] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T19:56:01.669397] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T19:56:01.889382] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-10T19:56:02.689383] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-10T19:56:03.010190] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T19:56:03.079110] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T19:56:03.489332] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-10T19:56:04.289372] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-10T19:56:04.400542] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T19:56:04.547035] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-10T19:56:05.089431] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-10T19:56:05.774574] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-10T19:56:05.889359] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-10T19:56:06.136230] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-10T19:56:06.689427] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-10T19:56:07.489348] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-10T19:56:08.016299] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T19:56:08.289406] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-10T19:56:08.341868] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T19:56:08.343592] [INFO ] [REMOTE ] LEO: Full fetch complete (26583 records). [2025-10-10T19:56:08.343886] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-10T19:56:08.720854] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-10T19:56:08.730607] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-10T19:56:08.747344] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-10T19:56:08.747498] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-10T19:56:08.749715] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-10T19:56:08.759867] [DEBUG] [LOCAL ] LEO: Trimmed 26583 records to 17099 (keeping 200 days of data) [2025-10-10T19:56:08.855539] [DEBUG] [LOCAL ] LEO: Primary data saved (17099 records). [2025-10-10T19:56:08.855691] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-10T19:56:08.855785] [INFO ] [MAIN ] Update Progress: 1251/2373 symbols completed. LEO took 20.2s. Estimated remaining: 2h 37m 55s. Rate: 7.1 symbols/min [2025-10-10T19:56:09.021620] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:56:09.039091] [DEBUG] [LOCAL ] LFT: Loaded 18493 existing records from primary storage. [2025-10-10T19:56:09.039327] [INFO ] [MAIN ] LFT: Loaded 18493 existing records. [2025-10-10T19:56:09.101105] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-10T19:56:09.217290] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:56:09.217489] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-10T19:56:09.217535] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-10T19:56:09.218041] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-10T19:56:09.218098] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-10T19:56:09.569607] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:56:09.660900] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T19:56:09.889407] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-10T19:56:10.689373] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-10T19:56:10.720096] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-10T19:56:11.127833] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T19:56:11.489378] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-10T19:56:12.289347] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-10T19:56:12.424360] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T19:56:13.089350] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-10T19:56:13.412781] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-10T19:56:13.512951] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T19:56:13.889395] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-10T19:56:14.689346] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-10T19:56:14.794252] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-10T19:56:14.936961] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-10T19:56:15.489404] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-10T19:56:16.289413] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-10T19:56:16.404801] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T19:56:16.456872] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T19:56:17.089361] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-10T19:56:17.889385] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-10T19:56:18.085854] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T19:56:18.121171] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-10T19:56:18.689396] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-10T19:56:19.489411] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-10T19:56:19.902807] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T19:56:19.948704] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-10T19:56:20.289447] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-10T19:56:21.089422] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-10T19:56:21.145891] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T19:56:21.889360] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-10T19:56:22.204450] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T19:56:22.689352] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-10T19:56:23.037305] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T19:56:23.489389] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-10T19:56:23.956848] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-10T19:56:24.275724] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-10T19:56:24.289339] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-10T19:56:25.089378] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-10T19:56:25.349352] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-10T19:56:25.889366] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-10T19:56:26.689462] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-10T19:56:26.949024] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-10T19:56:26.973011] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-10T19:56:26.978882] [INFO ] [REMOTE ] LEG: Full fetch complete (72982 records). [2025-10-10T19:56:26.979030] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-10T19:56:27.362338] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-10T19:56:27.362414] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-10T19:56:27.363330] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-10T19:56:27.363392] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-10T19:56:27.364783] [DEBUG] [LOCAL ] LEG: Trimmed 72982 records to 50914 (keeping 200 days of data) [2025-10-10T19:56:27.535349] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-10T19:56:27.612002] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-10T19:56:27.699444] [DEBUG] [LOCAL ] LEG: Primary data saved (50914 records). [2025-10-10T19:56:27.699606] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-10T19:56:27.699740] [INFO ] [MAIN ] Update Progress: 1252/2373 symbols completed. LEG took 45.1s. Estimated remaining: 2h 37m 56s. Rate: 7.1 symbols/min [2025-10-10T19:56:27.871012] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:56:27.871298] [DEBUG] [LOCAL ] LGI: No existing data file found in primary storage. [2025-10-10T19:56:27.871352] [WARN ] [MAIN ] LGI: No existing data found, performing full refresh instead. [2025-10-10T19:56:27.871428] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-10T19:56:27.871464] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-10T19:56:27.871504] [DEBUG] [LOCAL ] LGI: No primary data file found to delete. [2025-10-10T19:56:27.871536] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-10T19:56:28.200777] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-10T19:56:28.273392] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:56:28.289366] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-10T19:56:29.089462] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-10T19:56:29.208029] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-10T19:56:29.889461] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-10T19:56:29.935131] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-10T19:56:29.940107] [INFO ] [REMOTE ] LEN: Full fetch complete (77046 records). [2025-10-10T19:56:29.940248] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-10T19:56:30.335606] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-10T19:56:30.335812] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-10T19:56:30.337010] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-10T19:56:30.337093] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-10T19:56:30.338975] [DEBUG] [LOCAL ] LEN: Trimmed 77046 records to 53950 (keeping 200 days of data) [2025-10-10T19:56:30.416308] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-10T19:56:30.469426] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-10T19:56:30.695738] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-10T19:56:30.704789] [DEBUG] [LOCAL ] LEN: Primary data saved (53950 records). [2025-10-10T19:56:30.705100] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-10T19:56:30.705216] [INFO ] [MAIN ] Update Progress: 1253/2373 symbols completed. LEN took 42.2s. Estimated remaining: 2h 37m 43s. Rate: 7.1 symbols/min [2025-10-10T19:56:30.872506] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:56:30.908589] [DEBUG] [LOCAL ] LH: Loaded 37996 existing records from primary storage. [2025-10-10T19:56:30.908937] [INFO ] [MAIN ] LH: Loaded 37996 existing records. [2025-10-10T19:56:31.084872] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:56:31.085101] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-10T19:56:31.085148] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-10T19:56:31.086069] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-10T19:56:31.086127] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-10T19:56:31.442539] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:56:31.489396] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-10T19:56:31.915227] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T19:56:32.289397] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-10T19:56:32.972250] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-10T19:56:33.089339] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-10T19:56:33.398109] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-10T19:56:33.889370] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-10T19:56:34.689394] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-10T19:56:35.032597] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T19:56:35.474973] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T19:56:35.489336] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-10T19:56:35.722494] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-10T19:56:35.724280] [INFO ] [REMOTE ] LFT: Full fetch complete (24048 records). [2025-10-10T19:56:35.724350] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-10T19:56:36.101057] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-10T19:56:36.101195] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-10T19:56:36.102675] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-10T19:56:36.102750] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-10T19:56:36.103792] [DEBUG] [LOCAL ] LFT: Trimmed 24048 records to 18593 (keeping 200 days of data) [2025-10-10T19:56:36.227770] [DEBUG] [LOCAL ] LFT: Primary data saved (18593 records). [2025-10-10T19:56:36.227990] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-10T19:56:36.228122] [INFO ] [MAIN ] Update Progress: 1254/2373 symbols completed. LFT took 27.4s. Estimated remaining: 2h 37m 32s. Rate: 7.1 symbols/min [2025-10-10T19:56:36.296437] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-10T19:56:36.422932] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:56:36.479381] [DEBUG] [LOCAL ] LHX: Loaded 48939 existing records from primary storage. [2025-10-10T19:56:36.479913] [INFO ] [MAIN ] LHX: Loaded 48939 existing records. [2025-10-10T19:56:36.667329] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:56:36.667617] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-10T19:56:36.667711] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-10T19:56:36.668927] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-10T19:56:36.668985] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-10T19:56:37.029462] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:56:37.089402] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-10T19:56:37.179206] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T19:56:37.265119] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T19:56:37.889351] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-10T19:56:38.689428] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-10T19:56:39.150240] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-10T19:56:39.489345] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-10T19:56:39.571131] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-10T19:56:40.179088] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-10T19:56:40.183991] [INFO ] [REMOTE ] LEVI: Full fetch complete (74564 records). [2025-10-10T19:56:40.184102] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-10T19:56:40.294526] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-10T19:56:40.470213] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-10T19:56:40.586106] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-10T19:56:40.586180] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-10T19:56:40.587113] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-10T19:56:40.587176] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-10T19:56:40.588573] [DEBUG] [LOCAL ] LEVI: Trimmed 74564 records to 52452 (keeping 200 days of data) [2025-10-10T19:56:40.897878] [DEBUG] [LOCAL ] LEVI: Primary data saved (52452 records). [2025-10-10T19:56:40.898091] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-10T19:56:40.898461] [INFO ] [MAIN ] Update Progress: 1255/2373 symbols completed. LEVI took 40.6s. Estimated remaining: 2h 37m 20s. Rate: 7.1 symbols/min [2025-10-10T19:56:41.085543] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:56:41.089380] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-10T19:56:41.114560] [DEBUG] [LOCAL ] LII: Loaded 28203 existing records from primary storage. [2025-10-10T19:56:41.114841] [INFO ] [MAIN ] LII: Loaded 28203 existing records. [2025-10-10T19:56:41.285155] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:56:41.285402] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-10T19:56:41.285460] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-10T19:56:41.286166] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-10T19:56:41.286224] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-10T19:56:41.634975] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:56:41.889396] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-10T19:56:42.259215] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T19:56:42.689370] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-10T19:56:42.760194] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-10T19:56:43.440714] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T19:56:43.489373] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-10T19:56:44.289404] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-10T19:56:44.612360] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T19:56:45.089349] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-10T19:56:45.110202] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T19:56:45.651340] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T19:56:45.889352] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-10T19:56:46.091971] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-10T19:56:46.689392] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-10T19:56:47.489411] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-10T19:56:47.885716] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T19:56:48.241193] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-10T19:56:48.289346] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-10T19:56:49.089389] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-10T19:56:49.344502] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T19:56:49.889407] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-10T19:56:50.191850] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T19:56:50.689380] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-10T19:56:51.034264] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T19:56:51.489388] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-10T19:56:51.575961] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T19:56:52.289438] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-10T19:56:52.434001] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T19:56:53.089373] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-10T19:56:53.602937] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-10T19:56:53.653401] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-10T19:56:53.889384] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-10T19:56:54.079465] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T19:56:54.689438] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-10T19:56:54.776509] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-10T19:56:55.489398] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-10T19:56:55.863507] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T19:56:56.289400] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-10T19:56:57.040168] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T19:56:57.089368] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-10T19:56:57.211624] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-10T19:56:57.889414] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-10T19:56:58.689393] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-10T19:56:58.816974] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-10T19:56:59.227799] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-10T19:56:59.489392] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-10T19:56:59.827565] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-10T19:57:00.116402] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-10T19:57:00.289377] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-10T19:57:01.089394] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-10T19:57:01.186211] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-10T19:57:01.889378] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-10T19:57:02.689352] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-10T19:57:03.184515] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T19:57:03.437309] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-10T19:57:03.489345] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-10T19:57:03.587250] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T19:57:03.588980] [INFO ] [REMOTE ] LGI: Full fetch complete (14440 records). [2025-10-10T19:57:03.589050] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-10T19:57:03.944882] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-10T19:57:03.944970] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-10T19:57:03.945405] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-10T19:57:03.945445] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-10T19:57:03.945963] [DEBUG] [LOCAL ] LGI: Trimmed 14440 records to 10159 (keeping 200 days of data) [2025-10-10T19:57:04.011338] [DEBUG] [LOCAL ] LGI: Primary data saved (10159 records). [2025-10-10T19:57:04.011505] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-10T19:57:04.011606] [INFO ] [MAIN ] Update Progress: 1256/2373 symbols completed. LGI took 36.3s. Estimated remaining: 2h 37m 25s. Rate: 7.1 symbols/min [2025-10-10T19:57:04.183491] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:57:04.224639] [DEBUG] [LOCAL ] LION: Loaded 45809 existing records from primary storage. [2025-10-10T19:57:04.225118] [INFO ] [MAIN ] LION: Loaded 45809 existing records. [2025-10-10T19:57:04.294513] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-10T19:57:04.414791] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:57:04.415066] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-10T19:57:04.415127] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-10T19:57:04.416317] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-10T19:57:04.416392] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-10T19:57:04.763768] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:57:04.932599] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T19:57:05.089351] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-10T19:57:05.889378] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-10T19:57:06.157808] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T19:57:06.549691] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T19:57:06.689352] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-10T19:57:07.042496] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-10T19:57:07.489387] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-10T19:57:07.781152] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T19:57:07.785370] [INFO ] [REMOTE ] LH: Full fetch complete (54953 records). [2025-10-10T19:57:07.785533] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-10T19:57:08.191012] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-10T19:57:08.191098] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-10T19:57:08.192010] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-10T19:57:08.192077] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-10T19:57:08.193587] [DEBUG] [LOCAL ] LH: Trimmed 54953 records to 38243 (keeping 200 days of data) [2025-10-10T19:57:08.293855] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-10T19:57:08.447094] [DEBUG] [LOCAL ] LH: Primary data saved (38243 records). [2025-10-10T19:57:08.447243] [INFO ] [MAIN ] LH: Full history saved. [2025-10-10T19:57:08.447333] [INFO ] [MAIN ] Update Progress: 1257/2373 symbols completed. LH took 37.7s. Estimated remaining: 2h 37m 13s. Rate: 7.1 symbols/min [2025-10-10T19:57:08.615260] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:57:08.621187] [DEBUG] [LOCAL ] LITB: Loaded 4269 existing records from primary storage. [2025-10-10T19:57:08.621383] [INFO ] [MAIN ] LITB: Loaded 4269 existing records. [2025-10-10T19:57:08.795195] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:57:08.795487] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-10T19:57:08.795541] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-10T19:57:08.801032] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-10T19:57:08.808944] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-10T19:57:08.843300] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-10T19:57:09.090024] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-10T19:57:09.170163] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:57:09.889382] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-10T19:57:10.293083] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-10T19:57:10.366566] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T19:57:10.453433] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-10T19:57:10.689377] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-10T19:57:11.489382] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-10T19:57:11.840717] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T19:57:12.035572] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-10T19:57:12.289382] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-10T19:57:13.089396] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-10T19:57:13.695503] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-10T19:57:13.698605] [INFO ] [REMOTE ] LII: Full fetch complete (41263 records). [2025-10-10T19:57:13.698737] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-10T19:57:13.894537] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-10T19:57:14.103405] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-10T19:57:14.103486] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-10T19:57:14.104163] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-10T19:57:14.104225] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-10T19:57:14.105078] [DEBUG] [LOCAL ] LII: Trimmed 41263 records to 28417 (keeping 200 days of data) [2025-10-10T19:57:14.286163] [DEBUG] [LOCAL ] LII: Primary data saved (28417 records). [2025-10-10T19:57:14.286297] [INFO ] [MAIN ] LII: Full history saved. [2025-10-10T19:57:14.286376] [INFO ] [MAIN ] Update Progress: 1258/2373 symbols completed. LII took 33.4s. Estimated remaining: 2h 37m 2s. Rate: 7.1 symbols/min [2025-10-10T19:57:14.456308] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:57:14.505358] [DEBUG] [LOCAL ] LLY: Loaded 53664 existing records from primary storage. [2025-10-10T19:57:14.505687] [INFO ] [MAIN ] LLY: Loaded 53664 existing records. [2025-10-10T19:57:14.579279] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-10T19:57:14.691900] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:57:14.691989] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-10T19:57:14.692318] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-10T19:57:14.693150] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-10T19:57:14.694616] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-10T19:57:14.694701] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-10T19:57:14.860092] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-10T19:57:14.887459] [INFO ] [REMOTE ] LHX: Full fetch complete (70645 records). [2025-10-10T19:57:14.904724] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-10T19:57:15.469470] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:57:15.494538] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-10T19:57:15.577084] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-10T19:57:15.577166] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-10T19:57:15.578141] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-10T19:57:15.578205] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-10T19:57:15.579551] [DEBUG] [LOCAL ] LHX: Trimmed 70645 records to 49289 (keeping 200 days of data) [2025-10-10T19:57:15.888253] [DEBUG] [LOCAL ] LHX: Primary data saved (49289 records). [2025-10-10T19:57:15.888380] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-10T19:57:15.888462] [INFO ] [MAIN ] Update Progress: 1259/2373 symbols completed. LHX took 39.7s. Estimated remaining: 2h 36m 47s. Rate: 7.1 symbols/min [2025-10-10T19:57:16.060123] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:57:16.110018] [DEBUG] [LOCAL ] LMND: Loaded 52371 existing records from primary storage. [2025-10-10T19:57:16.110358] [INFO ] [MAIN ] LMND: Loaded 52371 existing records. [2025-10-10T19:57:16.293592] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-10T19:57:16.322370] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:57:16.318536] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-10T19:57:16.330093] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-10T19:57:16.342420] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-10T19:57:16.347135] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-10T19:57:16.347089] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T19:57:16.349579] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-10T19:57:16.699355] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:57:17.089384] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-10T19:57:17.889419] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-10T19:57:18.689434] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-10T19:57:18.860484] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-10T19:57:19.098752] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-10-10T19:57:19.152866] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-10T19:57:19.489373] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-10T19:57:20.289396] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-10T19:57:20.621784] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-10T19:57:21.089366] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-10T19:57:21.491679] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-10T19:57:21.889376] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-10T19:57:22.446014] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-10T19:57:22.581287] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-10T19:57:22.689391] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-10T19:57:22.957482] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-10T19:57:23.017153] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-10T19:57:23.489369] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-10T19:57:24.028631] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-10T19:57:24.289348] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-10T19:57:25.089379] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-10T19:57:25.617786] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-10T19:57:25.889344] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-10T19:57:26.331524] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-10T19:57:26.610358] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-10T19:57:26.689350] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-10T19:57:27.489434] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-10T19:57:28.289375] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-10T19:57:28.557543] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-10T19:57:28.900527] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-10T19:57:28.901422] [INFO ] [REMOTE ] LITB: Full fetch complete (5669 records). [2025-10-10T19:57:28.901489] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-10T19:57:29.090354] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-10T19:57:29.281840] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-10T19:57:29.281950] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-10T19:57:29.282256] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-10T19:57:29.282365] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-10T19:57:29.282913] [DEBUG] [LOCAL ] LITB: Trimmed 5669 records to 4305 (keeping 200 days of data) [2025-10-10T19:57:29.306990] [DEBUG] [LOCAL ] LITB: Primary data saved (4305 records). [2025-10-10T19:57:29.307110] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-10T19:57:29.307255] [INFO ] [MAIN ] Update Progress: 1260/2373 symbols completed. LITB took 20.9s. Estimated remaining: 2h 36m 43s. Rate: 7.1 symbols/min [2025-10-10T19:57:29.484481] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:57:29.531223] [DEBUG] [LOCAL ] LMT: Loaded 50089 existing records from primary storage. [2025-10-10T19:57:29.531513] [INFO ] [MAIN ] LMT: Loaded 50089 existing records. [2025-10-10T19:57:29.711173] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:57:29.711483] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-10T19:57:29.711577] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-10T19:57:29.735676] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-10T19:57:29.738515] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-10T19:57:29.787197] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-10T19:57:29.894532] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-10T19:57:30.132903] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:57:30.689372] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-10T19:57:31.489396] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-10T19:57:31.702560] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-10T19:57:31.817145] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T19:57:32.289349] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-10T19:57:32.636036] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T19:57:33.089384] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-10T19:57:33.550750] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-10T19:57:33.657177] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-10T19:57:33.889377] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-10T19:57:34.689378] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-10T19:57:35.182589] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-10T19:57:35.489375] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-10T19:57:35.668400] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T19:57:35.673165] [INFO ] [REMOTE ] LION: Full fetch complete (56357 records). [2025-10-10T19:57:35.673286] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-10T19:57:36.073146] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-10T19:57:36.073229] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-10T19:57:36.074040] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-10T19:57:36.074103] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-10T19:57:36.075448] [DEBUG] [LOCAL ] LION: Trimmed 56357 records to 46182 (keeping 200 days of data) [2025-10-10T19:57:36.298385] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-10T19:57:36.332625] [DEBUG] [LOCAL ] LION: Primary data saved (46182 records). [2025-10-10T19:57:36.332785] [INFO ] [MAIN ] LION: Full history saved. [2025-10-10T19:57:36.332871] [INFO ] [MAIN ] Update Progress: 1261/2373 symbols completed. LION took 32.3s. Estimated remaining: 2h 36m 34s. Rate: 7.1 symbols/min [2025-10-10T19:57:36.509172] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:57:36.556565] [DEBUG] [LOCAL ] LNC: Loaded 51968 existing records from primary storage. [2025-10-10T19:57:36.556961] [INFO ] [MAIN ] LNC: Loaded 51968 existing records. [2025-10-10T19:57:36.736761] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:57:36.737153] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-10T19:57:36.737205] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-10T19:57:36.738299] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-10T19:57:36.738365] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-10T19:57:36.924799] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-10T19:57:37.094495] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-10T19:57:37.130610] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:57:37.889357] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-10T19:57:38.150821] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-10T19:57:38.624866] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-10T19:57:38.689356] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-10T19:57:39.386299] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-10T19:57:39.489403] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-10T19:57:39.770161] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T19:57:40.289378] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-10T19:57:40.529692] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-10T19:57:41.089396] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-10T19:57:41.889343] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-10T19:57:41.940346] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-10T19:57:42.036721] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T19:57:42.689373] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-10T19:57:43.451351] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-10T19:57:43.489338] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-10T19:57:44.289368] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-10T19:57:44.634435] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-10-10T19:57:45.007499] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-10T19:57:45.089370] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-10T19:57:45.237279] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T19:57:45.687107] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-10T19:57:45.889411] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-10T19:57:46.689382] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-10T19:57:47.344211] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-10T19:57:47.489373] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-10T19:57:48.214238] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-10T19:57:48.219941] [INFO ] [REMOTE ] LMND: Full fetch complete (75332 records). [2025-10-10T19:57:48.220132] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-10T19:57:48.298705] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-10T19:57:48.636844] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-10T19:57:48.636964] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-10T19:57:48.638156] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-10T19:57:48.638224] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-10T19:57:48.639754] [DEBUG] [LOCAL ] LMND: Trimmed 75332 records to 52761 (keeping 200 days of data) [2025-10-10T19:57:48.956954] [DEBUG] [LOCAL ] LMND: Primary data saved (52761 records). [2025-10-10T19:57:48.957120] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-10T19:57:48.957210] [INFO ] [MAIN ] Update Progress: 1262/2373 symbols completed. LMND took 33.1s. Estimated remaining: 2h 36m 29s. Rate: 7.1 symbols/min [2025-10-10T19:57:49.122578] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:57:49.128704] [DEBUG] [LOCAL ] LND: Loaded 4996 existing records from primary storage. [2025-10-10T19:57:49.128892] [INFO ] [MAIN ] LND: Loaded 4996 existing records. [2025-10-10T19:57:49.305154] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:57:49.305441] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-10T19:57:49.305492] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-10T19:57:49.305730] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-10T19:57:49.305787] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-10T19:57:49.672957] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:57:49.673860] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-10T19:57:49.710577] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (3.02 seconds). [2025-10-10T19:57:49.757074] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-10T19:57:49.889380] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-10T19:57:50.320609] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-10T19:57:50.390865] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-10T19:57:50.689369] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-10T19:57:51.435348] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-10T19:57:51.489433] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-10T19:57:52.289385] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-10T19:57:52.481041] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-10T19:57:52.481801] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-10T19:57:53.089428] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-10T19:57:53.889466] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-10T19:57:54.322995] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T19:57:54.689377] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-10T19:57:55.434260] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-10T19:57:55.489338] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-10T19:57:56.263541] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-10T19:57:56.289358] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-10T19:57:56.473540] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-10T19:57:56.518369] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-10T19:57:57.089422] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-10T19:57:57.889399] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-10T19:57:58.502094] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-10T19:57:58.689405] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-10T19:57:58.936740] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T19:57:59.100530] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-10T19:57:59.489398] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-10T19:58:00.214861] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-10T19:58:00.289338] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-10T19:58:00.503471] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-10T19:58:01.050924] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-10T19:58:01.089394] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-10T19:58:01.818302] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-10T19:58:01.889411] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-10T19:58:02.405822] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-10T19:58:02.689364] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-10T19:58:03.489431] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-10T19:58:04.244777] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-10T19:58:04.289325] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-10T19:58:04.495541] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T19:58:04.988072] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-10T19:58:04.989168] [INFO ] [REMOTE ] LND: Full fetch complete (8023 records). [2025-10-10T19:58:04.989255] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-10T19:58:05.092579] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-10T19:58:05.355362] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-10T19:58:05.355438] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-10T19:58:05.355691] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-10T19:58:05.355753] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-10T19:58:05.356161] [DEBUG] [LOCAL ] LND: Trimmed 8023 records to 5034 (keeping 200 days of data) [2025-10-10T19:58:05.384527] [DEBUG] [LOCAL ] LND: Primary data saved (5034 records). [2025-10-10T19:58:05.384625] [INFO ] [MAIN ] LND: Full history saved. [2025-10-10T19:58:05.384740] [INFO ] [MAIN ] Update Progress: 1263/2373 symbols completed. LND took 16.4s. Estimated remaining: 2h 36m 27s. Rate: 7.1 symbols/min [2025-10-10T19:58:05.554814] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:58:05.603970] [DEBUG] [LOCAL ] LNG: Loaded 51690 existing records from primary storage. [2025-10-10T19:58:05.604284] [INFO ] [MAIN ] LNG: Loaded 51690 existing records. [2025-10-10T19:58:05.782266] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:58:05.782484] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-10T19:58:05.782560] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-10T19:58:05.783961] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-10T19:58:05.784020] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-10T19:58:05.894448] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-10T19:58:06.143582] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:58:06.689445] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-10T19:58:06.998273] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-10T19:58:07.489384] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-10T19:58:08.213699] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-10T19:58:08.218393] [INFO ] [REMOTE ] LMT: Full fetch complete (72353 records). [2025-10-10T19:58:08.218509] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-10T19:58:08.294506] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-10T19:58:08.633409] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-10T19:58:08.633574] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-10T19:58:08.634714] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-10T19:58:08.634781] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-10T19:58:08.636465] [DEBUG] [LOCAL ] LMT: Trimmed 72353 records to 50457 (keeping 200 days of data) [2025-10-10T19:58:08.923205] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-10T19:58:09.003229] [DEBUG] [LOCAL ] LMT: Primary data saved (50457 records). [2025-10-10T19:58:09.003368] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-10T19:58:09.003457] [INFO ] [MAIN ] Update Progress: 1264/2373 symbols completed. LMT took 39.7s. Estimated remaining: 2h 36m 15s. Rate: 7.1 symbols/min [2025-10-10T19:58:09.105134] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-10T19:58:09.177575] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:58:09.189760] [DEBUG] [LOCAL ] LNN: Loaded 11354 existing records from primary storage. [2025-10-10T19:58:09.189980] [INFO ] [MAIN ] LNN: Loaded 11354 existing records. [2025-10-10T19:58:09.373558] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:58:09.373902] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-10T19:58:09.374046] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-10T19:58:09.374603] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-10T19:58:09.374714] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-10T19:58:09.738163] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-10T19:58:09.793392] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:58:09.889396] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-10T19:58:10.498876] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-10T19:58:10.689376] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-10T19:58:11.489434] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-10T19:58:11.624494] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-10T19:58:11.921459] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-10T19:58:11.926363] [INFO ] [REMOTE ] LNC: Full fetch complete (74335 records). [2025-10-10T19:58:11.926482] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-10T19:58:12.265958] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-10T19:58:12.299109] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-10T19:58:12.358562] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-10T19:58:12.358666] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-10T19:58:12.359602] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-10T19:58:12.359669] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-10T19:58:12.362294] [DEBUG] [LOCAL ] LNC: Trimmed 74335 records to 52341 (keeping 200 days of data) [2025-10-10T19:58:12.680738] [DEBUG] [LOCAL ] LNC: Primary data saved (52341 records). [2025-10-10T19:58:12.680868] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-10T19:58:12.680947] [INFO ] [MAIN ] Update Progress: 1265/2373 symbols completed. LNC took 36.3s. Estimated remaining: 2h 36m 2s. Rate: 7.1 symbols/min [2025-10-10T19:58:12.849528] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:58:12.879115] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-10T19:58:12.923512] [DEBUG] [LOCAL ] LOAR: Loaded 42335 existing records from primary storage. [2025-10-10T19:58:12.923830] [INFO ] [MAIN ] LOAR: Loaded 42335 existing records. [2025-10-10T19:58:13.096354] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-10T19:58:13.101592] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:58:13.102687] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-10T19:58:13.102781] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-10T19:58:13.103539] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-10T19:58:13.103599] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-10T19:58:13.540541] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:58:13.559279] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T19:58:13.564460] [INFO ] [REMOTE ] LLY: Full fetch complete (77247 records). [2025-10-10T19:58:13.564601] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-10T19:58:13.896394] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-10T19:58:13.944974] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-10T19:58:13.945055] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-10T19:58:13.946095] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-10T19:58:13.946159] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-10T19:58:13.947686] [DEBUG] [LOCAL ] LLY: Trimmed 77247 records to 54048 (keeping 200 days of data) [2025-10-10T19:58:14.340757] [DEBUG] [LOCAL ] LLY: Primary data saved (54048 records). [2025-10-10T19:58:14.341127] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-10T19:58:14.341623] [INFO ] [MAIN ] Update Progress: 1266/2373 symbols completed. LLY took 1m 0s. Estimated remaining: 2h 35m 48s. Rate: 7.1 symbols/min [2025-10-10T19:58:14.520863] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:58:14.530447] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-10T19:58:14.560703] [DEBUG] [LOCAL ] LOB: Loaded 27349 existing records from primary storage. [2025-10-10T19:58:14.561091] [INFO ] [MAIN ] LOB: Loaded 27349 existing records. [2025-10-10T19:58:14.694465] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-10T19:58:14.761886] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:58:14.762546] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-10T19:58:14.762700] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-10T19:58:14.763531] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-10T19:58:14.763594] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-10T19:58:15.139042] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:58:15.240978] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-10T19:58:15.489397] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-10T19:58:16.124892] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T19:58:16.289357] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-10T19:58:16.440047] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-10T19:58:17.089373] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-10T19:58:17.780987] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-10T19:58:17.889384] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-10T19:58:18.689376] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-10T19:58:18.901415] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-10T19:58:19.135633] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T19:58:19.489357] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-10T19:58:19.891793] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-10T19:58:20.289344] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-10T19:58:20.701885] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T19:58:21.089394] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-10T19:58:21.687615] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-10T19:58:21.889408] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-10T19:58:22.689347] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-10T19:58:22.797158] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-10T19:58:23.163871] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T19:58:23.489386] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-10T19:58:24.193781] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T19:58:24.289387] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-10T19:58:24.812740] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T19:58:25.089410] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-10T19:58:25.889346] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-10T19:58:26.014613] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T19:58:26.101707] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-10T19:58:26.689372] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-10T19:58:27.489427] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-10T19:58:27.673321] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T19:58:28.008213] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-10T19:58:28.289366] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-10T19:58:29.035235] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T19:58:29.089328] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-10T19:58:29.889343] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-10T19:58:30.141235] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T19:58:30.637694] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-10T19:58:30.689337] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-10T19:58:31.489394] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-10T19:58:31.971580] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-10T19:58:32.289410] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-10T19:58:32.391714] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-10T19:58:32.439731] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T19:58:33.089481] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-10T19:58:33.889401] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-10T19:58:34.301185] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-10T19:58:34.387965] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T19:58:34.558935] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-10T19:58:34.689428] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-10T19:58:35.489407] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-10T19:58:36.289404] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-10T19:58:36.341404] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T19:58:36.980459] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-10T19:58:37.089353] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-10T19:58:37.252955] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-10T19:58:37.889424] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-10T19:58:38.409827] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-10T19:58:38.689438] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-10T19:58:39.489356] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-10T19:58:39.683549] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-10T19:58:39.915444] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T19:58:40.289381] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-10T19:58:41.089364] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-10T19:58:41.285548] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T19:58:41.287084] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T19:58:41.288770] [INFO ] [REMOTE ] LNN: Full fetch complete (15539 records). [2025-10-10T19:58:41.288939] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-10T19:58:41.664827] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-10T19:58:41.664907] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-10T19:58:41.665311] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-10T19:58:41.665372] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-10T19:58:41.665890] [DEBUG] [LOCAL ] LNN: Trimmed 15539 records to 11409 (keeping 200 days of data) [2025-10-10T19:58:41.739706] [DEBUG] [LOCAL ] LNN: Primary data saved (11409 records). [2025-10-10T19:58:41.739805] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-10T19:58:41.739883] [INFO ] [MAIN ] Update Progress: 1267/2373 symbols completed. LNN took 32.7s. Estimated remaining: 2h 35m 56s. Rate: 7.1 symbols/min [2025-10-10T19:58:41.893027] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-10T19:58:41.918777] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:58:41.924583] [DEBUG] [LOCAL ] LOCL: Loaded 3651 existing records from primary storage. [2025-10-10T19:58:41.924816] [INFO ] [MAIN ] LOCL: Loaded 3651 existing records. [2025-10-10T19:58:42.116117] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:58:42.116436] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-10T19:58:42.116490] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-10T19:58:42.116717] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-10T19:58:42.116776] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-10T19:58:42.315725] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-10T19:58:42.505543] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:58:42.689378] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-10T19:58:43.423282] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-10T19:58:43.489345] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-10T19:58:43.961321] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-10T19:58:44.289367] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-10T19:58:44.985272] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-10T19:58:45.089369] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-10T19:58:45.590830] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-10T19:58:45.593724] [INFO ] [REMOTE ] LOB: Full fetch complete (38048 records). [2025-10-10T19:58:45.593808] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-10T19:58:45.673639] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-10T19:58:45.894487] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-10T19:58:45.979679] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-10T19:58:45.979814] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-10T19:58:45.980805] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-10T19:58:45.980885] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-10T19:58:45.982119] [DEBUG] [LOCAL ] LOB: Trimmed 38048 records to 27539 (keeping 200 days of data) [2025-10-10T19:58:46.147991] [DEBUG] [LOCAL ] LOB: Primary data saved (27539 records). [2025-10-10T19:58:46.148126] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-10T19:58:46.148211] [INFO ] [MAIN ] Update Progress: 1268/2373 symbols completed. LOB took 31.8s. Estimated remaining: 2h 35m 44s. Rate: 7.1 symbols/min [2025-10-10T19:58:46.343741] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:58:46.346854] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-10T19:58:46.378902] [DEBUG] [LOCAL ] LOMA: Loaded 32538 existing records from primary storage. [2025-10-10T19:58:46.379198] [INFO ] [MAIN ] LOMA: Loaded 32538 existing records. [2025-10-10T19:58:46.558744] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:58:46.559068] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-10T19:58:46.559131] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-10T19:58:46.559910] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-10T19:58:46.559970] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-10T19:58:46.698775] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-10T19:58:46.916527] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:58:47.489376] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-10T19:58:48.289428] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-10T19:58:48.647813] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-10T19:58:48.652916] [INFO ] [REMOTE ] LNG: Full fetch complete (74628 records). [2025-10-10T19:58:48.653061] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-10T19:58:48.838352] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-10T19:58:49.080360] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-10T19:58:49.084565] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-10T19:58:49.085881] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-10T19:58:49.086528] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-10T19:58:49.086997] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T19:58:49.091202] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-10T19:58:49.093182] [INFO ] [REMOTE ] LOAR: Full fetch complete (56076 records). [2025-10-10T19:58:49.093388] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-10T19:58:49.094095] [DEBUG] [LOCAL ] LNG: Trimmed 74628 records to 52045 (keeping 200 days of data) [2025-10-10T19:58:49.808576] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-10T19:58:49.810086] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-10T19:58:49.811374] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-10T19:58:49.811805] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-10T19:58:49.821596] [DEBUG] [LOCAL ] LOAR: Trimmed 56076 records to 42616 (keeping 200 days of data) [2025-10-10T19:58:49.827269] [DEBUG] [LOCAL ] LNG: Primary data saved (52045 records). [2025-10-10T19:58:49.827782] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-10T19:58:49.827904] [INFO ] [MAIN ] Update Progress: 1269/2373 symbols completed. LNG took 44.4s. Estimated remaining: 2h 35m 31s. Rate: 7.1 symbols/min [2025-10-10T19:58:49.931513] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-10T19:58:50.189973] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:58:50.411426] [DEBUG] [LOCAL ] LOW: Loaded 53366 existing records from primary storage. [2025-10-10T19:58:50.413141] [INFO ] [MAIN ] LOW: Loaded 53366 existing records. [2025-10-10T19:58:50.732458] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:58:50.737370] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-10T19:58:50.739051] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-10T19:58:50.738779] [DEBUG] [LOCAL ] LOAR: Primary data saved (42616 records). [2025-10-10T19:58:50.739409] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-10T19:58:50.739519] [INFO ] [MAIN ] Update Progress: 1270/2373 symbols completed. LOAR took 38.1s. Estimated remaining: 2h 35m 16s. Rate: 7.1 symbols/min [2025-10-10T19:58:50.751361] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-10T19:58:50.778629] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-10T19:58:51.102063] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:58:51.142114] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T19:58:51.204095] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-10T19:58:51.309945] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-10T19:58:51.402595] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:58:51.430521] [DEBUG] [LOCAL ] LPG: Loaded 39911 existing records from primary storage. [2025-10-10T19:58:51.430902] [INFO ] [MAIN ] LPG: Loaded 39911 existing records. [2025-10-10T19:58:51.494557] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-10T19:58:51.616043] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:58:51.616282] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-10T19:58:51.616332] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-10T19:58:51.617194] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-10T19:58:51.617253] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-10T19:58:51.869907] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-10T19:58:51.981040] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:58:52.289376] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-10T19:58:53.089403] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-10T19:58:53.550709] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-10T19:58:53.620244] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-10T19:58:53.889352] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-10T19:58:53.952692] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-10T19:58:54.561262] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-10T19:58:54.689386] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-10T19:58:55.489427] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-10T19:58:56.289395] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-10T19:58:56.454861] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T19:58:57.089389] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-10T19:58:57.471682] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-10T19:58:57.614841] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-10T19:58:57.889393] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-10T19:58:58.133463] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-10T19:58:58.689404] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-10T19:58:59.246895] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-10T19:58:59.367804] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-10T19:58:59.489391] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-10T19:59:00.217104] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-10T19:59:00.289377] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-10T19:59:01.089400] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-10T19:59:01.889374] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-10T19:59:02.499610] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-10T19:59:02.625336] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T19:59:02.626206] [INFO ] [REMOTE ] LOCL: Full fetch complete (4464 records). [2025-10-10T19:59:02.626295] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-10T19:59:02.695817] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-10T19:59:02.981998] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T19:59:03.065258] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-10T19:59:03.065336] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-10T19:59:03.065476] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-10T19:59:03.065515] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-10T19:59:03.065913] [DEBUG] [LOCAL ] LOCL: Trimmed 4464 records to 3665 (keeping 200 days of data) [2025-10-10T19:59:03.089111] [DEBUG] [LOCAL ] LOCL: Primary data saved (3665 records). [2025-10-10T19:59:03.089216] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-10T19:59:03.089323] [INFO ] [MAIN ] Update Progress: 1271/2373 symbols completed. LOCL took 21.3s. Estimated remaining: 2h 35m 11s. Rate: 7.1 symbols/min [2025-10-10T19:59:03.260257] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:59:03.285049] [DEBUG] [LOCAL ] LPL: Loaded 27712 existing records from primary storage. [2025-10-10T19:59:03.285303] [INFO ] [MAIN ] LPL: Loaded 27712 existing records. [2025-10-10T19:59:03.457068] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:59:03.457373] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-10T19:59:03.457432] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-10T19:59:03.458071] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-10T19:59:03.458129] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-10T19:59:03.499469] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-10T19:59:03.815126] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:59:04.289427] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-10T19:59:04.346497] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-10T19:59:05.063457] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T19:59:05.089361] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-10T19:59:05.152290] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-10T19:59:05.889383] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-10T19:59:06.689383] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-10T19:59:07.069873] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T19:59:07.280214] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T19:59:07.489368] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-10T19:59:08.289350] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-10T19:59:08.398002] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T19:59:09.089455] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-10T19:59:09.889458] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-10T19:59:10.019906] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T19:59:10.689377] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-10T19:59:10.722716] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (3.23 seconds). [2025-10-10T19:59:11.122436] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-10T19:59:11.417672] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T19:59:11.489336] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-10T19:59:11.904237] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T19:59:12.289416] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-10T19:59:12.718966] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-10T19:59:13.089377] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-10T19:59:13.563064] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-10T19:59:13.889405] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-10T19:59:14.349146] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-10T19:59:14.689420] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-10T19:59:15.332186] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-10T19:59:15.489404] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-10T19:59:16.290716] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-10T19:59:16.298247] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-10T19:59:17.089367] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-10T19:59:17.628714] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-10T19:59:17.733199] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-10T19:59:17.889410] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-10T19:59:18.006290] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-10T19:59:18.689429] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-10T19:59:19.489413] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-10T19:59:19.928017] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-10T19:59:19.970610] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-10T19:59:20.289433] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-10T19:59:20.706814] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-10T19:59:21.089441] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-10T19:59:21.889433] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-10T19:59:22.295520] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-10T19:59:22.297138] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-10T19:59:22.689412] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-10T19:59:23.319558] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T19:59:23.323991] [INFO ] [REMOTE ] LPG: Full fetch complete (59250 records). [2025-10-10T19:59:23.324218] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-10T19:59:23.489553] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-10T19:59:23.724110] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-10T19:59:23.724228] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-10T19:59:23.725364] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-10T19:59:23.725433] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-10T19:59:23.727369] [DEBUG] [LOCAL ] LPG: Trimmed 59250 records to 40224 (keeping 200 days of data) [2025-10-10T19:59:23.997920] [DEBUG] [LOCAL ] LPG: Primary data saved (40224 records). [2025-10-10T19:59:23.998089] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-10T19:59:23.998185] [INFO ] [MAIN ] Update Progress: 1272/2373 symbols completed. LPG took 33.3s. Estimated remaining: 2h 35m 13s. Rate: 7.1 symbols/min [2025-10-10T19:59:24.208010] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T19:59:24.212395] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:59:24.263330] [DEBUG] [LOCAL ] LPX: Loaded 40167 existing records from primary storage. [2025-10-10T19:59:24.263759] [INFO ] [MAIN ] LPX: Loaded 40167 existing records. [2025-10-10T19:59:24.295882] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-10T19:59:24.446135] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:59:24.446413] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-10T19:59:24.446462] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-10T19:59:24.447317] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-10T19:59:24.447375] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-10T19:59:24.788202] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:59:25.089404] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-10T19:59:25.476378] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T19:59:25.889382] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-10T19:59:26.062096] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T19:59:26.689447] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-10T19:59:26.760890] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-10T19:59:27.489375] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-10T19:59:28.134486] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-10T19:59:28.163671] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-10T19:59:28.289376] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-10T19:59:29.057987] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-10T19:59:29.061705] [INFO ] [REMOTE ] LOMA: Full fetch complete (47770 records). [2025-10-10T19:59:29.061831] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-10T19:59:29.094742] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-10T19:59:29.492585] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-10T19:59:29.492748] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-10T19:59:29.493776] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-10T19:59:29.493845] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-10T19:59:29.495440] [DEBUG] [LOCAL ] LOMA: Trimmed 47770 records to 32810 (keeping 200 days of data) [2025-10-10T19:59:29.734669] [DEBUG] [LOCAL ] LOMA: Primary data saved (32810 records). [2025-10-10T19:59:29.734900] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-10T19:59:29.735019] [INFO ] [MAIN ] Update Progress: 1273/2373 symbols completed. LOMA took 43.6s. Estimated remaining: 2h 35m 3s. Rate: 7.1 symbols/min [2025-10-10T19:59:29.895526] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-10T19:59:29.933430] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:59:29.961080] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T19:59:30.009860] [DEBUG] [LOCAL ] LRN: Loaded 39921 existing records from primary storage. [2025-10-10T19:59:30.010249] [INFO ] [MAIN ] LRN: Loaded 39921 existing records. [2025-10-10T19:59:30.190364] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:59:30.190836] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-10T19:59:30.190903] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-10T19:59:30.192124] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-10T19:59:30.192189] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-10T19:59:30.625331] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:59:30.689422] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-10T19:59:31.159381] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-10T19:59:31.165007] [INFO ] [REMOTE ] LOW: Full fetch complete (76524 records). [2025-10-10T19:59:31.165318] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-10T19:59:31.490839] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-10T19:59:31.582734] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T19:59:31.636750] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-10T19:59:31.636896] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-10T19:59:31.638726] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-10T19:59:31.638827] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-10T19:59:31.641521] [DEBUG] [LOCAL ] LOW: Trimmed 76524 records to 53753 (keeping 200 days of data) [2025-10-10T19:59:32.025392] [DEBUG] [LOCAL ] LOW: Primary data saved (53753 records). [2025-10-10T19:59:32.025814] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-10T19:59:32.026005] [INFO ] [MAIN ] Update Progress: 1274/2373 symbols completed. LOW took 42.2s. Estimated remaining: 2h 34m 49s. Rate: 7.1 symbols/min [2025-10-10T19:59:32.219662] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:59:32.269855] [DEBUG] [LOCAL ] LSPD: Loaded 43111 existing records from primary storage. [2025-10-10T19:59:32.270247] [INFO ] [MAIN ] LSPD: Loaded 43111 existing records. [2025-10-10T19:59:32.304337] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-10T19:59:32.469902] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T19:59:32.491397] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:59:32.500341] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-10T19:59:32.500450] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-10T19:59:32.501701] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-10T19:59:32.501770] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-10T19:59:32.906808] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:59:33.089427] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-10T19:59:33.251592] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T19:59:33.418977] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-10T19:59:33.423127] [INFO ] [REMOTE ] LPL: Full fetch complete (36518 records). [2025-10-10T19:59:33.423244] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-10T19:59:33.789765] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-10T19:59:33.789848] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-10T19:59:33.790512] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-10T19:59:33.790551] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-10T19:59:33.791441] [DEBUG] [LOCAL ] LPL: Trimmed 36518 records to 28058 (keeping 200 days of data) [2025-10-10T19:59:33.889585] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-10T19:59:33.949963] [DEBUG] [LOCAL ] LPL: Primary data saved (28058 records). [2025-10-10T19:59:33.950114] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-10T19:59:33.950200] [INFO ] [MAIN ] Update Progress: 1275/2373 symbols completed. LPL took 30.9s. Estimated remaining: 2h 34m 35s. Rate: 7.1 symbols/min [2025-10-10T19:59:34.121142] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:59:34.149485] [DEBUG] [LOCAL ] LTC: Loaded 30454 existing records from primary storage. [2025-10-10T19:59:34.149812] [INFO ] [MAIN ] LTC: Loaded 30454 existing records. [2025-10-10T19:59:34.329500] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T19:59:34.329778] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-10T19:59:34.329827] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-10T19:59:34.330428] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-10T19:59:34.330487] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-10T19:59:34.680605] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T19:59:34.689335] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-10T19:59:34.770619] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T19:59:35.489444] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-10T19:59:35.781366] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-10T19:59:36.030190] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T19:59:36.289386] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-10T19:59:37.089393] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-10T19:59:37.167395] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-10T19:59:37.264085] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T19:59:37.889420] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-10T19:59:38.689399] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-10T19:59:38.741404] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-10T19:59:39.489430] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-10T19:59:39.701598] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T19:59:40.289401] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-10T19:59:40.376581] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T19:59:41.089446] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-10T19:59:41.118711] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T19:59:41.889992] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-10T19:59:41.895712] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-10T19:59:42.689399] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-10T19:59:42.873451] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T19:59:43.445570] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-10T19:59:43.489451] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-10T19:59:43.962014] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-10T19:59:44.289390] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-10T19:59:45.089386] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-10T19:59:45.333565] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-10T19:59:45.889375] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-10T19:59:46.110457] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T19:59:46.174971] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-10T19:59:46.689377] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-10T19:59:47.489423] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-10T19:59:47.636732] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T19:59:48.243808] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-10T19:59:48.289428] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-10T19:59:49.089453] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-10T19:59:49.263523] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T19:59:49.889393] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-10T19:59:50.090214] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T19:59:50.689426] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-10T19:59:50.737961] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-10T19:59:51.489352] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-10T19:59:51.592847] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-10T19:59:52.289374] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-10T19:59:52.480399] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T19:59:52.572676] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-10T19:59:53.089370] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-10T19:59:53.889397] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-10T19:59:54.074606] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T19:59:54.689392] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-10T19:59:54.771751] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-10T19:59:55.489355] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-10T19:59:55.568423] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T19:59:56.289380] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-10T19:59:56.377797] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-10T19:59:57.088531] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-10T19:59:57.097359] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-10T19:59:57.889404] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-10T19:59:57.953943] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T19:59:58.689412] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-10T19:59:58.723956] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-10T19:59:59.047118] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-10T19:59:59.051122] [INFO ] [REMOTE ] LPX: Full fetch complete (58818 records). [2025-10-10T19:59:59.051205] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-10T19:59:59.429775] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-10T19:59:59.429849] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-10T19:59:59.430661] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-10T19:59:59.430723] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-10T19:59:59.431948] [DEBUG] [LOCAL ] LPX: Trimmed 58818 records to 40508 (keeping 200 days of data) [2025-10-10T19:59:59.496227] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-10T19:59:59.681944] [DEBUG] [LOCAL ] LPX: Primary data saved (40508 records). [2025-10-10T19:59:59.682067] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-10T19:59:59.682143] [INFO ] [MAIN ] Update Progress: 1276/2373 symbols completed. LPX took 35.7s. Estimated remaining: 2h 34m 41s. Rate: 7.1 symbols/min [2025-10-10T19:59:59.848065] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T19:59:59.894243] [DEBUG] [LOCAL ] LTH: Loaded 52105 existing records from primary storage. [2025-10-10T19:59:59.894564] [INFO ] [MAIN ] LTH: Loaded 52105 existing records. [2025-10-10T20:00:00.072900] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:00:00.073141] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-10T20:00:00.073193] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-10T20:00:00.074045] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-10T20:00:00.074104] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-10T20:00:00.304565] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-10T20:00:00.432564] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:00:00.454738] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T20:00:01.089368] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-10T20:00:01.299240] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T20:00:01.889352] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-10T20:00:02.016989] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T20:00:02.689378] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-10T20:00:03.057404] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T20:00:03.301254] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T20:00:03.489410] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-10T20:00:03.764854] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T20:00:03.768164] [INFO ] [REMOTE ] LTC: Full fetch complete (43451 records). [2025-10-10T20:00:03.768317] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-10T20:00:04.153698] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-10T20:00:04.153783] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-10T20:00:04.154509] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-10T20:00:04.154549] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-10T20:00:04.155491] [DEBUG] [LOCAL ] LTC: Trimmed 43451 records to 30684 (keeping 200 days of data) [2025-10-10T20:00:04.313243] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-10T20:00:04.357665] [DEBUG] [LOCAL ] LTC: Primary data saved (30684 records). [2025-10-10T20:00:04.358252] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-10T20:00:04.358371] [INFO ] [MAIN ] Update Progress: 1277/2373 symbols completed. LTC took 30.4s. Estimated remaining: 2h 34m 30s. Rate: 7.1 symbols/min [2025-10-10T20:00:05.089399] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-10-10T20:00:05.123817] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T20:00:05.128460] [INFO ] [REMOTE ] LSPD: Full fetch complete (61716 records). [2025-10-10T20:00:05.128669] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-10T20:00:05.516962] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-10T20:00:05.517057] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-10T20:00:05.517948] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-10T20:00:05.518013] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-10T20:00:05.519278] [DEBUG] [LOCAL ] LSPD: Trimmed 61716 records to 43440 (keeping 200 days of data) [2025-10-10T20:00:05.774174] [DEBUG] [LOCAL ] LSPD: Primary data saved (43440 records). [2025-10-10T20:00:05.774327] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-10T20:00:05.774414] [INFO ] [MAIN ] Update Progress: 1278/2373 symbols completed. LSPD took 33.7s. Estimated remaining: 2h 34m 15s. Rate: 7.1 symbols/min [2025-10-10T20:00:06.173987] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T20:00:06.177480] [INFO ] [REMOTE ] LRN: Full fetch complete (58387 records). [2025-10-10T20:00:06.177571] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-10T20:00:06.573543] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-10T20:00:06.573635] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-10T20:00:06.574523] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-10T20:00:06.574606] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-10T20:00:06.575973] [DEBUG] [LOCAL ] LRN: Trimmed 58387 records to 40180 (keeping 200 days of data) [2025-10-10T20:00:06.819726] [DEBUG] [LOCAL ] LRN: Primary data saved (40180 records). [2025-10-10T20:00:06.819925] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-10T20:00:06.820207] [INFO ] [MAIN ] Update Progress: 1279/2373 symbols completed. LRN took 37.1s. Estimated remaining: 2h 34m 0s. Rate: 7.1 symbols/min [2025-10-10T20:00:06.952175] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T20:00:06.961566] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-10T20:00:08.801541] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T20:00:08.812419] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-10T20:00:10.629508] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T20:00:10.646762] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-10T20:00:12.529597] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T20:00:12.543792] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-10T20:00:14.486108] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T20:00:14.497884] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-10T20:00:16.375775] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T20:00:16.387079] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-10T20:00:18.020991] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T20:00:18.031613] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-10T20:00:20.076854] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-10T20:00:20.088286] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-10T20:00:21.991543] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T20:00:22.003787] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-10T20:00:23.923754] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T20:00:23.936224] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-10T20:00:25.699840] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-10T20:00:25.706850] [INFO ] [REMOTE ] LTH: Full fetch complete (74425 records). [2025-10-10T20:00:25.707077] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-10T20:00:26.093759] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-10T20:00:26.093863] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-10T20:00:26.094871] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-10T20:00:26.094934] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-10T20:00:26.096990] [DEBUG] [LOCAL ] LTH: Trimmed 74425 records to 52485 (keeping 200 days of data) [2025-10-10T20:00:26.395397] [DEBUG] [LOCAL ] LTH: Primary data saved (52485 records). [2025-10-10T20:00:26.395534] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-10T20:00:26.395615] [INFO ] [MAIN ] Update Progress: 1280/2373 symbols completed. LTH took 26.7s. Estimated remaining: 2h 34m 1s. Rate: 7.1 symbols/min [2025-10-10T20:00:26.985699] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:00:27.081569] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:00:27.088037] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:00:27.114744] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:00:27.150169] [DEBUG] [LOCAL ] LUCK: Loaded 24525 existing records from primary storage. [2025-10-10T20:00:27.161570] [INFO ] [MAIN ] LUCK: Loaded 24525 existing records. [2025-10-10T20:00:27.162355] [DEBUG] [LOCAL ] LTM: Loaded 38258 existing records from primary storage. [2025-10-10T20:00:27.185327] [INFO ] [MAIN ] LTM: Loaded 38258 existing records. [2025-10-10T20:00:27.466751] [DEBUG] [LOCAL ] LU: Loaded 49350 existing records from primary storage. [2025-10-10T20:00:27.487432] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:00:27.493007] [INFO ] [MAIN ] LU: Loaded 49350 existing records. [2025-10-10T20:00:27.504426] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-10T20:00:27.534031] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-10T20:00:27.576698] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-10T20:00:27.580528] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-10T20:00:27.664900] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:00:27.639168] [DEBUG] [LOCAL ] LUMN: Loaded 54030 existing records from primary storage. [2025-10-10T20:00:27.689248] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-10T20:00:27.717162] [INFO ] [MAIN ] LUMN: Loaded 54030 existing records. [2025-10-10T20:00:27.717249] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-10T20:00:27.777023] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-10T20:00:27.795044] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-10T20:00:28.100442] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:00:28.203623] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-10T20:00:28.257431] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-10T20:00:28.336371] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-10T20:00:28.352009] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:00:28.352211] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-10T20:00:28.560058] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-10T20:00:28.617461] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-10T20:00:28.684293] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-10T20:00:28.762161] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-10T20:00:28.782981] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:00:28.948720] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-10-10T20:00:28.939572] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:00:29.000596] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-10-10T20:00:29.369410] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:00:29.380011] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-10-10T20:00:29.440786] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:00:29.441048] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-10-10T20:00:30.378819] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T20:00:30.385081] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-10T20:00:30.398971] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-10T20:00:30.404176] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-10T20:00:31.270922] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T20:00:31.280940] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-10T20:00:31.667845] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-10T20:00:31.679887] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-10T20:00:31.693822] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T20:00:31.698995] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-10T20:00:31.882315] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-10T20:00:31.890136] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-10T20:00:32.499629] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-10T20:00:32.505064] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-10T20:00:33.089082] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T20:00:33.098707] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-10T20:00:33.489863] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-10T20:00:33.497022] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-10T20:00:33.685293] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-10T20:00:33.695796] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-10T20:00:34.042612] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-10T20:00:34.049157] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-10T20:00:34.510553] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-10T20:00:34.520245] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-10T20:00:34.538322] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-10T20:00:34.545339] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-10T20:00:35.407061] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T20:00:35.419106] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-10T20:00:35.565943] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-10T20:00:35.576580] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-10T20:00:36.135910] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-10T20:00:36.142905] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-10T20:00:36.468326] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T20:00:36.484851] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-10T20:00:36.557150] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-10T20:00:36.564812] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-10T20:00:37.544879] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-10T20:00:37.558535] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-10T20:00:37.658586] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-10T20:00:37.665912] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-10T20:00:37.795909] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T20:00:37.803820] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-10T20:00:38.338730] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-10T20:00:38.349560] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-10T20:00:38.933134] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-10T20:00:38.941119] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-10T20:00:38.977530] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-10T20:00:38.986234] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-10T20:00:39.594008] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T20:00:39.605290] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-10T20:00:40.232277] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T20:00:40.312945] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-10T20:00:40.316171] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T20:00:40.328337] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T20:00:40.340382] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-10T20:00:40.341827] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-10T20:00:41.483867] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T20:00:41.489580] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-10T20:00:41.912056] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-10T20:00:41.924151] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-10T20:00:41.963171] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-10T20:00:41.974741] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-10T20:00:42.134836] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T20:00:42.150374] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-10T20:00:42.292301] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-10T20:00:42.689483] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-10T20:00:43.480213] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-10T20:00:43.484851] [INFO ] [REMOTE ] LTM: Full fetch complete (49340 records). [2025-10-10T20:00:43.484947] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-10T20:00:43.868578] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-10T20:00:43.867485] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T20:00:43.909178] [INFO ] [REMOTE ] LUCK: Full fetch complete (40308 records). [2025-10-10T20:00:43.922239] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-10T20:00:43.923301] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-10T20:00:43.921789] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-10T20:00:43.923489] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-10T20:00:43.924586] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-10T20:00:43.924885] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-10T20:00:44.037179] [DEBUG] [LOCAL ] LTM: Trimmed 49340 records to 38625 (keeping 200 days of data) [2025-10-10T20:00:44.360494] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-10T20:00:44.424590] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-10T20:00:44.521614] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-10T20:00:44.524831] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-10T20:00:44.525775] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-10T20:00:44.568847] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-10T20:00:44.608022] [DEBUG] [LOCAL ] LUCK: Trimmed 40308 records to 24680 (keeping 200 days of data) [2025-10-10T20:00:44.734813] [DEBUG] [LOCAL ] LTM: Primary data saved (38625 records). [2025-10-10T20:00:44.740238] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-10T20:00:44.742766] [INFO ] [MAIN ] Update Progress: 1281/2373 symbols completed. LTM took 18.3s. Estimated remaining: 2h 34m 1s. Rate: 7.1 symbols/min [2025-10-10T20:00:44.960911] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:00:44.970068] [DEBUG] [LOCAL ] LUCK: Primary data saved (24680 records). [2025-10-10T20:00:44.970224] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-10T20:00:44.970311] [INFO ] [MAIN ] Update Progress: 1282/2373 symbols completed. LUCK took 18.6s. Estimated remaining: 2h 33m 46s. Rate: 7.1 symbols/min [2025-10-10T20:00:45.140401] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:00:45.140723] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-10T20:00:45.140779] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-10T20:00:45.140904] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-10T20:00:45.140944] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-10T20:00:45.140986] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-10T20:00:45.141017] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-10T20:00:45.411523] [DEBUG] [LOCAL ] LUV: Loaded 54079 existing records from primary storage. [2025-10-10T20:00:45.438527] [INFO ] [MAIN ] LUV: Loaded 54079 existing records. [2025-10-10T20:00:45.651187] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:00:45.671131] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-10-10T20:00:45.760297] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:00:45.760589] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-10T20:00:45.760692] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-10T20:00:45.761692] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-10T20:00:45.761750] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-10T20:00:45.945100] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:00:45.962451] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-10-10T20:00:45.982966] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:00:46.015828] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-10T20:00:46.021162] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:00:46.043725] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-10T20:00:46.055574] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-10T20:00:46.082172] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-10T20:00:46.106475] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-10T20:00:46.109881] [INFO ] [MAIN ] Update Progress: 1283/2373 symbols completed. LUXE took 1.1s. Estimated remaining: 2h 33m 31s. Rate: 7.1 symbols/min [2025-10-10T20:00:46.166718] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:00:46.206257] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-10-10T20:00:46.297469] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-10T20:00:46.348737] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:00:46.387882] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T20:00:46.442284] [DEBUG] [LOCAL ] LVS: Loaded 53959 existing records from primary storage. [2025-10-10T20:00:46.442627] [INFO ] [MAIN ] LVS: Loaded 53959 existing records. [2025-10-10T20:00:46.620309] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:00:46.620524] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-10T20:00:46.620569] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-10T20:00:46.621155] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-10T20:00:46.621213] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-10T20:00:46.694446] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-10T20:00:46.976158] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:00:47.489407] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-10-10T20:00:48.289437] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-10T20:00:48.464425] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-10T20:00:49.077079] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-10T20:00:49.089333] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-10T20:00:49.523145] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-10T20:00:49.564546] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T20:00:49.889371] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-10T20:00:50.689363] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-10T20:00:51.450113] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-10T20:00:51.497577] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-10T20:00:51.505592] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T20:00:52.289380] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-10T20:00:52.509624] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-10T20:00:52.514868] [INFO ] [REMOTE ] LU: Full fetch complete (70486 records). [2025-10-10T20:00:52.515010] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-10T20:00:52.935347] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-10T20:00:52.935548] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-10T20:00:52.936745] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-10T20:00:52.937048] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-10T20:00:52.938604] [DEBUG] [LOCAL ] LU: Trimmed 70486 records to 49739 (keeping 200 days of data) [2025-10-10T20:00:53.098425] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-10T20:00:53.247138] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T20:00:53.269737] [DEBUG] [LOCAL ] LU: Primary data saved (49739 records). [2025-10-10T20:00:53.269876] [INFO ] [MAIN ] LU: Full history saved. [2025-10-10T20:00:53.269962] [INFO ] [MAIN ] Update Progress: 1284/2373 symbols completed. LU took 26.9s. Estimated remaining: 2h 33m 22s. Rate: 7.1 symbols/min [2025-10-10T20:00:53.442050] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:00:53.460339] [DEBUG] [LOCAL ] LVWR: Loaded 18268 existing records from primary storage. [2025-10-10T20:00:53.460612] [INFO ] [MAIN ] LVWR: Loaded 18268 existing records. [2025-10-10T20:00:53.660530] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:00:53.660859] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-10T20:00:53.660917] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-10T20:00:53.661271] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-10T20:00:53.661334] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-10T20:00:53.900240] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-10T20:00:54.051008] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:00:54.287352] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-10T20:00:54.689372] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-10-10T20:00:55.129867] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-10T20:00:55.479222] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-10T20:00:55.484136] [INFO ] [REMOTE ] LUMN: Full fetch complete (77636 records). [2025-10-10T20:00:55.484238] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-10T20:00:55.495672] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-10T20:00:55.834519] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T20:00:55.934266] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-10T20:00:55.934433] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-10T20:00:55.935451] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-10T20:00:55.935514] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-10T20:00:55.938248] [DEBUG] [LOCAL ] LUMN: Trimmed 77636 records to 54420 (keeping 200 days of data) [2025-10-10T20:00:56.247522] [DEBUG] [LOCAL ] LUMN: Primary data saved (54420 records). [2025-10-10T20:00:56.247682] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-10T20:00:56.247825] [INFO ] [MAIN ] Update Progress: 1285/2373 symbols completed. LUMN took 29.9s. Estimated remaining: 2h 33m 8s. Rate: 7.1 symbols/min [2025-10-10T20:00:56.294553] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-10T20:00:56.422081] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:00:56.471543] [DEBUG] [LOCAL ] LW: Loaded 51599 existing records from primary storage. [2025-10-10T20:00:56.471983] [INFO ] [MAIN ] LW: Loaded 51599 existing records. [2025-10-10T20:00:56.659849] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:00:56.660126] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-10T20:00:56.660172] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-10T20:00:56.660792] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-10T20:00:56.660857] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-10T20:00:56.998475] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:00:57.089329] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-10-10T20:00:57.796773] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-10T20:00:57.889379] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-10T20:00:58.034712] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-10T20:00:58.460535] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T20:00:58.689426] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-10T20:00:59.470569] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T20:00:59.489340] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-10T20:01:00.289362] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-10T20:01:01.064201] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-10T20:01:01.089348] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-10T20:01:01.663517] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-10T20:01:01.889380] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-10T20:01:02.214828] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T20:01:02.689346] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-10T20:01:03.384517] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-10T20:01:03.424072] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-10T20:01:03.489406] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-10T20:01:03.837741] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T20:01:03.876918] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-10T20:01:04.289403] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-10T20:01:04.983586] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-10T20:01:05.089362] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-10T20:01:05.889365] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-10T20:01:06.689414] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-10T20:01:07.364759] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-10T20:01:07.406872] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-10T20:01:07.489351] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-10T20:01:07.926969] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T20:01:08.289425] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-10T20:01:08.955422] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-10T20:01:09.089413] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-10T20:01:09.889361] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-10T20:01:10.245190] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T20:01:10.423786] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-10T20:01:10.689369] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-10T20:01:11.489351] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-10T20:01:11.828999] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T20:01:12.289354] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-10T20:01:12.659326] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-10T20:01:13.089354] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-10T20:01:13.682626] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-10T20:01:13.889366] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-10T20:01:14.238440] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T20:01:14.450000] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-10T20:01:14.689427] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-10T20:01:15.489393] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-10T20:01:15.567245] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-10T20:01:15.572329] [INFO ] [REMOTE ] LVS: Full fetch complete (77519 records). [2025-10-10T20:01:15.572432] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-10T20:01:16.041257] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-10T20:01:16.041340] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-10T20:01:16.042434] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-10T20:01:16.042515] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-10T20:01:16.044087] [DEBUG] [LOCAL ] LVS: Trimmed 77519 records to 54349 (keeping 200 days of data) [2025-10-10T20:01:16.291954] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-10T20:01:16.403295] [DEBUG] [LOCAL ] LVS: Primary data saved (54349 records). [2025-10-10T20:01:16.403453] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-10T20:01:16.403853] [INFO ] [MAIN ] Update Progress: 1286/2373 symbols completed. LVS took 30.3s. Estimated remaining: 2h 33m 10s. Rate: 7.1 symbols/min [2025-10-10T20:01:16.600557] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:01:16.619567] [DEBUG] [LOCAL ] LXFR: Loaded 16823 existing records from primary storage. [2025-10-10T20:01:16.619869] [INFO ] [MAIN ] LXFR: Loaded 16823 existing records. [2025-10-10T20:01:16.829609] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:01:16.829930] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-10T20:01:16.830138] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-10T20:01:16.830888] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-10T20:01:16.830949] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-10T20:01:17.244105] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:01:17.244840] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-10-10T20:01:17.251273] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-10T20:01:17.339259] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-10T20:01:17.428815] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-10T20:01:17.889384] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-10T20:01:18.452565] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-10T20:01:18.689449] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-10T20:01:19.489365] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-10T20:01:19.712057] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T20:01:20.289402] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-10T20:01:20.848313] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-10T20:01:20.871912] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T20:01:21.089359] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-10T20:01:21.889413] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-10T20:01:22.452389] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-10T20:01:22.472438] [INFO ] [REMOTE ] LVWR: Full fetch complete (20435 records). [2025-10-10T20:01:22.474150] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-10T20:01:22.472946] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-10T20:01:22.696742] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-10T20:01:22.697289] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-10T20:01:22.878101] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-10T20:01:22.878179] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-10T20:01:22.878618] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-10T20:01:22.878731] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-10T20:01:22.879474] [DEBUG] [LOCAL ] LVWR: Trimmed 20435 records to 18359 (keeping 200 days of data) [2025-10-10T20:01:22.983865] [DEBUG] [LOCAL ] LVWR: Primary data saved (18359 records). [2025-10-10T20:01:22.983992] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-10T20:01:22.984070] [INFO ] [MAIN ] Update Progress: 1287/2373 symbols completed. LVWR took 29.7s. Estimated remaining: 2h 32m 60s. Rate: 7.1 symbols/min [2025-10-10T20:01:23.147119] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:01:23.191119] [DEBUG] [LOCAL ] LXP: Loaded 51100 existing records from primary storage. [2025-10-10T20:01:23.191432] [INFO ] [MAIN ] LXP: Loaded 51100 existing records. [2025-10-10T20:01:23.362676] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:01:23.362838] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-10T20:01:23.362883] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-10T20:01:23.364084] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-10T20:01:23.364142] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-10T20:01:23.498354] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-10T20:01:23.714701] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:01:24.289373] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-10T20:01:25.092359] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-10-10T20:01:25.101676] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-10T20:01:25.471044] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T20:01:25.501836] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T20:01:25.889388] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-10T20:01:26.689369] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-10T20:01:27.159672] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-10T20:01:27.489393] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-10T20:01:27.728146] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T20:01:28.289366] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-10T20:01:28.724331] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-10T20:01:28.729447] [INFO ] [REMOTE ] LUV: Full fetch complete (77729 records). [2025-10-10T20:01:28.729594] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-10T20:01:29.089925] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-10T20:01:29.153509] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-10T20:01:29.174736] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-10T20:01:29.180544] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-10T20:01:29.182582] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-10T20:01:29.182831] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-10T20:01:29.184863] [DEBUG] [LOCAL ] LUV: Trimmed 77729 records to 54469 (keeping 200 days of data) [2025-10-10T20:01:29.325409] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T20:01:29.606757] [DEBUG] [LOCAL ] LUV: Primary data saved (54469 records). [2025-10-10T20:01:29.606923] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-10T20:01:29.607066] [INFO ] [MAIN ] Update Progress: 1288/2373 symbols completed. LUV took 44.9s. Estimated remaining: 2h 32m 50s. Rate: 7.1 symbols/min [2025-10-10T20:01:29.773664] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:01:29.802362] [DEBUG] [LOCAL ] LXU: Loaded 32021 existing records from primary storage. [2025-10-10T20:01:29.802673] [INFO ] [MAIN ] LXU: Loaded 32021 existing records. [2025-10-10T20:01:29.898545] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-10T20:01:29.980737] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:01:29.980969] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-10T20:01:29.981016] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-10T20:01:29.981568] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-10T20:01:29.981630] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-10T20:01:30.335665] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:01:30.689359] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-10T20:01:31.052362] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-10T20:01:31.057902] [INFO ] [REMOTE ] LW: Full fetch complete (74666 records). [2025-10-10T20:01:31.058042] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-10T20:01:31.242219] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-10T20:01:31.497728] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-10-10T20:01:31.522366] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-10T20:01:31.522457] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-10T20:01:31.523478] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-10T20:01:31.523543] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-10T20:01:31.526000] [DEBUG] [LOCAL ] LW: Trimmed 74666 records to 51986 (keeping 200 days of data) [2025-10-10T20:01:31.856739] [DEBUG] [LOCAL ] LW: Primary data saved (51986 records). [2025-10-10T20:01:31.856875] [INFO ] [MAIN ] LW: Full history saved. [2025-10-10T20:01:31.856976] [INFO ] [MAIN ] Update Progress: 1289/2373 symbols completed. LW took 35.6s. Estimated remaining: 2h 32m 36s. Rate: 7.1 symbols/min [2025-10-10T20:01:32.027931] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:01:32.059111] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T20:01:32.113273] [DEBUG] [LOCAL ] LYB: Loaded 53999 existing records from primary storage. [2025-10-10T20:01:32.113580] [INFO ] [MAIN ] LYB: Loaded 53999 existing records. [2025-10-10T20:01:32.291391] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-10T20:01:32.291277] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:01:32.291776] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-10T20:01:32.292580] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-10T20:01:32.293621] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-10T20:01:32.293707] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-10T20:01:32.644156] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:01:32.903628] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T20:01:33.089448] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-10T20:01:33.559564] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-10T20:01:33.889386] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-10T20:01:34.670047] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-10T20:01:34.689346] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-10T20:01:35.121298] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T20:01:35.489367] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-10T20:01:36.289453] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-10T20:01:36.567526] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T20:01:36.656569] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-10T20:01:37.089361] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-10T20:01:37.538497] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T20:01:37.889386] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-10T20:01:38.689372] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-10T20:01:39.063003] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T20:01:39.396459] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-10T20:01:39.489368] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-10T20:01:39.913134] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T20:01:40.289364] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-10T20:01:41.089384] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-10T20:01:41.169978] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-10T20:01:41.746042] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-10T20:01:41.889387] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-10T20:01:42.197281] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T20:01:42.527090] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-10T20:01:42.529676] [INFO ] [REMOTE ] LXFR: Full fetch complete (24730 records). [2025-10-10T20:01:42.529808] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-10T20:01:42.699507] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-10T20:01:42.937905] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-10T20:01:42.938015] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-10T20:01:42.938612] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-10T20:01:42.938694] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-10T20:01:42.939406] [DEBUG] [LOCAL ] LXFR: Trimmed 24730 records to 16936 (keeping 200 days of data) [2025-10-10T20:01:43.040583] [DEBUG] [LOCAL ] LXFR: Primary data saved (16936 records). [2025-10-10T20:01:43.040838] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-10T20:01:43.040930] [INFO ] [MAIN ] Update Progress: 1290/2373 symbols completed. LXFR took 26.6s. Estimated remaining: 2h 32m 30s. Rate: 7.1 symbols/min [2025-10-10T20:01:43.215563] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:01:43.265710] [DEBUG] [LOCAL ] LYG: Loaded 53160 existing records from primary storage. [2025-10-10T20:01:43.266240] [INFO ] [MAIN ] LYG: Loaded 53160 existing records. [2025-10-10T20:01:43.470519] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:01:43.470801] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-10T20:01:43.470856] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-10T20:01:43.472052] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-10T20:01:43.472116] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-10T20:01:43.494562] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-10T20:01:43.897510] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:01:43.927994] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-10T20:01:44.289412] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-10-10T20:01:45.017117] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T20:01:45.089403] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-10T20:01:45.889379] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-10T20:01:46.255606] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T20:01:46.689400] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-10T20:01:47.006667] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T20:01:47.090446] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-10T20:01:47.489421] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-10-10T20:01:48.289404] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-10T20:01:48.557784] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T20:01:48.950439] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-10T20:01:49.089365] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-10T20:01:49.889391] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-10T20:01:49.929930] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T20:01:50.689372] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-10T20:01:51.113703] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T20:01:51.489382] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-10T20:01:51.761444] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-10T20:01:51.966059] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T20:01:52.289365] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-10T20:01:52.863405] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T20:01:53.089382] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-10T20:01:53.889401] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-10T20:01:54.156416] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T20:01:54.522164] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-10T20:01:54.689374] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-10T20:01:55.489319] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-10T20:01:56.035423] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T20:01:56.289383] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-10T20:01:56.544550] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T20:01:56.970555] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T20:01:57.089342] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-10T20:01:57.889362] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-10T20:01:58.115764] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-10T20:01:58.120866] [INFO ] [REMOTE ] LXP: Full fetch complete (72710 records). [2025-10-10T20:01:58.121012] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-10T20:01:58.472133] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T20:01:58.514251] [INFO ] [REMOTE ] LXU: Full fetch complete (45120 records). [2025-10-10T20:01:58.544826] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-10T20:01:58.562794] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-10T20:01:58.562882] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-10T20:01:58.595485] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-10T20:01:58.608363] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-10T20:01:58.676323] [DEBUG] [LOCAL ] LXP: Trimmed 72710 records to 51488 (keeping 200 days of data) [2025-10-10T20:01:58.692387] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-10T20:01:59.252023] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-10T20:01:59.257489] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-10T20:01:59.258907] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-10T20:01:59.258991] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-10T20:01:59.296054] [DEBUG] [LOCAL ] LXP: Primary data saved (51488 records). [2025-10-10T20:01:59.296446] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-10T20:01:59.296604] [INFO ] [MAIN ] Update Progress: 1291/2373 symbols completed. LXP took 36.3s. Estimated remaining: 2h 32m 28s. Rate: 7.1 symbols/min [2025-10-10T20:01:59.366562] [DEBUG] [LOCAL ] LXU: Trimmed 45120 records to 32306 (keeping 200 days of data) [2025-10-10T20:01:59.563112] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:01:59.669824] [DEBUG] [LOCAL ] LXU: Primary data saved (32306 records). [2025-10-10T20:01:59.669995] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-10T20:01:59.670090] [INFO ] [MAIN ] Update Progress: 1292/2373 symbols completed. LXU took 30.1s. Estimated remaining: 2h 32m 13s. Rate: 7.1 symbols/min [2025-10-10T20:01:59.863704] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:01:59.879691] [DEBUG] [LOCAL ] LYV: Loaded 51511 existing records from primary storage. [2025-10-10T20:01:59.880255] [INFO ] [MAIN ] LYV: Loaded 51511 existing records. [2025-10-10T20:02:00.070709] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:02:00.072024] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-10T20:02:00.072162] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-10T20:02:00.089173] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-10T20:02:00.089084] [DEBUG] [LOCAL ] LZB: Loaded 35263 existing records from primary storage. [2025-10-10T20:02:00.089550] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-10T20:02:00.116910] [INFO ] [MAIN ] LZB: Loaded 35263 existing records. [2025-10-10T20:02:00.187246] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-10T20:02:00.316156] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-10T20:02:00.587922] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:02:00.617554] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-10T20:02:00.629778] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-10T20:02:00.668763] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-10T20:02:00.679255] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-10T20:02:00.785022] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:02:00.822633] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-10-10T20:02:01.149077] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:02:01.149822] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-10-10T20:02:01.152438] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-10T20:02:01.889357] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-10T20:02:02.380541] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-10T20:02:02.556028] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T20:02:02.689388] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-10T20:02:02.727782] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-10T20:02:03.489352] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-10T20:02:03.627723] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T20:02:04.292436] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-10T20:02:04.302318] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-10T20:02:05.089375] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-10T20:02:05.439399] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T20:02:05.889385] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-10T20:02:06.196982] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T20:02:06.689430] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-10T20:02:07.114712] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T20:02:07.489387] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-10T20:02:07.539027] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-10T20:02:08.289426] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-10T20:02:08.836459] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T20:02:09.089366] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-10T20:02:09.479461] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T20:02:09.513927] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T20:02:09.889420] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-10T20:02:10.689343] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-10T20:02:10.863621] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T20:02:11.489394] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-10T20:02:11.960137] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-10T20:02:12.289370] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-10T20:02:12.682542] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T20:02:13.089350] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-10T20:02:13.502018] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T20:02:13.542853] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T20:02:13.889398] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-10T20:02:14.689424] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-10T20:02:15.333326] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-10T20:02:15.494460] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-10T20:02:15.505602] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-10T20:02:16.289395] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-10T20:02:16.358076] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T20:02:17.089383] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-10T20:02:17.640840] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-10T20:02:17.889460] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-10T20:02:17.918119] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T20:02:17.923231] [INFO ] [REMOTE ] LYG: Full fetch complete (76067 records). [2025-10-10T20:02:17.923395] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-10T20:02:18.327907] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-10T20:02:18.328036] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-10T20:02:18.329052] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-10T20:02:18.329115] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-10T20:02:18.330522] [DEBUG] [LOCAL ] LYG: Trimmed 76067 records to 53540 (keeping 200 days of data) [2025-10-10T20:02:18.657865] [DEBUG] [LOCAL ] LYG: Primary data saved (53540 records). [2025-10-10T20:02:18.658028] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-10T20:02:18.658636] [INFO ] [MAIN ] Update Progress: 1293/2373 symbols completed. LYG took 35.6s. Estimated remaining: 2h 32m 13s. Rate: 7.1 symbols/min [2025-10-10T20:02:18.692343] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-10T20:02:18.834053] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T20:02:18.864638] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:02:18.880436] [DEBUG] [LOCAL ] LZM: Loaded 14501 existing records from primary storage. [2025-10-10T20:02:18.880699] [INFO ] [MAIN ] LZM: Loaded 14501 existing records. [2025-10-10T20:02:19.054059] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:02:19.054248] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-10T20:02:19.054297] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-10T20:02:19.054742] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-10T20:02:19.054800] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-10T20:02:19.407991] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:02:19.489412] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-10-10T20:02:19.980357] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-10T20:02:19.985567] [INFO ] [REMOTE ] LYB: Full fetch complete (77460 records). [2025-10-10T20:02:19.985895] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-10T20:02:20.292467] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-10T20:02:20.419571] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-10T20:02:20.419875] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-10T20:02:20.426978] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-10T20:02:20.427567] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-10T20:02:20.427863] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-10T20:02:20.431623] [DEBUG] [LOCAL ] LYB: Trimmed 77460 records to 54389 (keeping 200 days of data) [2025-10-10T20:02:20.781732] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-10T20:02:20.815016] [DEBUG] [LOCAL ] LYB: Primary data saved (54389 records). [2025-10-10T20:02:20.815181] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-10T20:02:20.815271] [INFO ] [MAIN ] Update Progress: 1294/2373 symbols completed. LYB took 49.0s. Estimated remaining: 2h 31m 60s. Rate: 7.1 symbols/min [2025-10-10T20:02:21.004467] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:02:21.062040] [DEBUG] [LOCAL ] M: Loaded 53930 existing records from primary storage. [2025-10-10T20:02:21.062416] [INFO ] [MAIN ] M: Loaded 53930 existing records. [2025-10-10T20:02:21.094680] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-10T20:02:21.246235] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:02:21.246442] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-10T20:02:21.246492] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-10T20:02:21.247724] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-10T20:02:21.247783] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-10T20:02:21.626283] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:02:21.647087] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T20:02:21.889377] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-10-10T20:02:22.689371] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-10T20:02:23.050687] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T20:02:23.489353] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-10T20:02:24.062017] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T20:02:24.289353] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-10T20:02:24.372810] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-10T20:02:24.395886] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T20:02:25.089388] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-10T20:02:25.889371] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-10T20:02:26.674041] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-10T20:02:26.689362] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-10T20:02:26.865559] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T20:02:26.866568] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T20:02:27.489381] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-10T20:02:28.289346] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-10T20:02:28.644144] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T20:02:28.717178] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-10T20:02:29.089428] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-10T20:02:29.889408] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-10T20:02:30.066180] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T20:02:30.069553] [INFO ] [REMOTE ] LZB: Full fetch complete (50583 records). [2025-10-10T20:02:30.069685] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-10T20:02:30.463797] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-10T20:02:30.463966] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-10T20:02:30.464957] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-10T20:02:30.465134] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-10T20:02:30.466356] [DEBUG] [LOCAL ] LZB: Trimmed 50583 records to 35516 (keeping 200 days of data) [2025-10-10T20:02:30.678397] [DEBUG] [LOCAL ] LZB: Primary data saved (35516 records). [2025-10-10T20:02:30.678530] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-10T20:02:30.678611] [INFO ] [MAIN ] Update Progress: 1295/2373 symbols completed. LZB took 31.0s. Estimated remaining: 2h 31m 52s. Rate: 7.1 symbols/min [2025-10-10T20:02:30.690066] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-10T20:02:30.860875] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:02:30.894361] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-10T20:02:30.921102] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-10T20:02:30.970702] [DEBUG] [LOCAL ] MA: Loaded 52878 existing records from primary storage. [2025-10-10T20:02:30.971048] [INFO ] [MAIN ] MA: Loaded 52878 existing records. [2025-10-10T20:02:31.146422] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:02:31.146624] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-10T20:02:31.146702] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-10T20:02:31.147816] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-10T20:02:31.147874] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-10T20:02:31.489935] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-10T20:02:31.512295] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:02:32.289363] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-10T20:02:32.912577] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-10T20:02:33.089368] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-10-10T20:02:33.182743] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-10T20:02:33.636879] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-10T20:02:33.889369] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-10T20:02:34.689356] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-10T20:02:35.206231] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-10T20:02:35.489379] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-10T20:02:35.916061] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-10T20:02:35.976635] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-10T20:02:36.289401] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-10T20:02:37.089356] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-10T20:02:37.221871] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-10T20:02:37.889398] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-10T20:02:38.328253] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T20:02:38.496501] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-10T20:02:38.689399] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-10T20:02:39.489379] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-10T20:02:39.686891] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-10T20:02:40.140196] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-10T20:02:40.289389] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-10T20:02:41.089377] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-10T20:02:41.900951] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-10T20:02:41.918032] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-10T20:02:42.332277] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T20:02:42.581966] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-10T20:02:42.689372] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-10T20:02:43.489412] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-10T20:02:43.793467] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T20:02:44.007083] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T20:02:44.011948] [INFO ] [REMOTE ] LYV: Full fetch complete (73833 records). [2025-10-10T20:02:44.012098] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-10T20:02:44.294216] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-10T20:02:44.350930] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T20:02:44.379869] [INFO ] [REMOTE ] LZM: Full fetch complete (19043 records). [2025-10-10T20:02:44.399152] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-10T20:02:44.482213] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-10T20:02:44.509387] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-10T20:02:44.541117] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-10T20:02:44.543612] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-10T20:02:44.618965] [DEBUG] [LOCAL ] LYV: Trimmed 73833 records to 51877 (keeping 200 days of data) [2025-10-10T20:02:44.928713] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-10T20:02:44.929386] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-10T20:02:44.930207] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-10T20:02:44.932921] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-10T20:02:44.939064] [DEBUG] [LOCAL ] LZM: Trimmed 19043 records to 14676 (keeping 200 days of data) [2025-10-10T20:02:45.091620] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-10T20:02:45.143566] [DEBUG] [LOCAL ] LZM: Primary data saved (14676 records). [2025-10-10T20:02:45.146318] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-10T20:02:45.148031] [INFO ] [MAIN ] Update Progress: 1296/2373 symbols completed. LZM took 26.5s. Estimated remaining: 2h 31m 49s. Rate: 7.1 symbols/min [2025-10-10T20:02:45.373785] [DEBUG] [LOCAL ] LYV: Primary data saved (51877 records). [2025-10-10T20:02:45.387143] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-10T20:02:45.387266] [INFO ] [MAIN ] Update Progress: 1297/2373 symbols completed. LYV took 46.1s. Estimated remaining: 2h 31m 34s. Rate: 7.1 symbols/min [2025-10-10T20:02:45.405929] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:02:45.576662] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:02:45.611051] [DEBUG] [LOCAL ] MAA: Loaded 42937 existing records from primary storage. [2025-10-10T20:02:45.622723] [INFO ] [MAIN ] MAA: Loaded 42937 existing records. [2025-10-10T20:02:45.772174] [DEBUG] [LOCAL ] MAC: Loaded 49954 existing records from primary storage. [2025-10-10T20:02:45.791002] [INFO ] [MAIN ] MAC: Loaded 49954 existing records. [2025-10-10T20:02:45.882145] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:02:45.915543] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-10T20:02:45.920771] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-10T20:02:45.948867] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-10T20:02:45.964730] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-10T20:02:46.079729] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:02:46.099579] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-10T20:02:46.099710] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-10T20:02:46.119048] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-10T20:02:46.130132] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-10T20:02:46.758126] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:02:46.774985] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-10-10T20:02:46.843906] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:02:46.844575] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-10-10T20:02:46.882498] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-10T20:02:47.107331] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-10T20:02:47.489379] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-10T20:02:48.289361] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-10T20:02:48.568707] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T20:02:48.624256] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-10T20:02:49.089377] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-10T20:02:49.577375] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-10T20:02:49.889375] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-10T20:02:50.587339] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-10T20:02:50.689396] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-10T20:02:50.870253] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-10T20:02:51.489450] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-10T20:02:51.903518] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-10T20:02:51.909935] [INFO ] [REMOTE ] M: Full fetch complete (77519 records). [2025-10-10T20:02:51.910186] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-10T20:02:52.296937] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-10T20:02:52.363937] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-10T20:02:52.364077] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-10T20:02:52.365594] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-10T20:02:52.365759] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-10T20:02:52.369441] [DEBUG] [LOCAL ] M: Trimmed 77519 records to 54320 (keeping 200 days of data) [2025-10-10T20:02:52.737470] [DEBUG] [LOCAL ] M: Primary data saved (54320 records). [2025-10-10T20:02:52.737826] [INFO ] [MAIN ] M: Full history saved. [2025-10-10T20:02:52.738158] [INFO ] [MAIN ] Update Progress: 1298/2373 symbols completed. M took 31.9s. Estimated remaining: 2h 31m 24s. Rate: 7.1 symbols/min [2025-10-10T20:02:52.935597] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:02:52.977854] [DEBUG] [LOCAL ] MAGN: Loaded 35945 existing records from primary storage. [2025-10-10T20:02:52.978468] [INFO ] [MAIN ] MAGN: Loaded 35945 existing records. [2025-10-10T20:02:53.210962] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:02:53.212692] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-10T20:02:53.219297] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-10T20:02:53.219411] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-10T20:02:53.230637] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-10T20:02:53.231440] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-10T20:02:53.312943] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-10T20:02:53.396472] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T20:02:53.676922] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:02:53.710817] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-10T20:02:53.889384] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-10T20:02:54.689405] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-10T20:02:54.820327] [DEBUG] [REMOTE ] MAC: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-10T20:02:54.820600] [WARN ] [REMOTE ] MAC: No data returned for month 2025-03 [2025-10-10T20:02:54.820719] [FATAL] [REMOTE ] MAC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:02:54.820797] [FATAL] [MAIN ] MAC: Failed to fetch primary data. [2025-10-10T20:02:54.820860] [WARN ] [MAIN ] MAC: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:02:54.820933] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-10T20:02:54.820995] [DEBUG] [LOCAL ] MAC: No primary data file found to delete. [2025-10-10T20:02:54.821031] [INFO ] [LOCAL ] MAC: Starting deletion of derivative data. [2025-10-10T20:02:54.821201] [DEBUG] [LOCAL ] MAC: Deleted derivative data file. [2025-10-10T20:02:54.821299] [INFO ] [MAIN ] Update Progress: 1299/2373 symbols completed. MAC took 9.4s. Estimated remaining: 2h 31m 11s. Rate: 7.1 symbols/min [2025-10-10T20:02:54.986981] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:02:55.023766] [DEBUG] [LOCAL ] MAIN: Loaded 41726 existing records from primary storage. [2025-10-10T20:02:55.024073] [INFO ] [MAIN ] MAIN: Loaded 41726 existing records. [2025-10-10T20:02:55.201129] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:02:55.201419] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-10T20:02:55.201469] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-10T20:02:55.202470] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-10T20:02:55.202529] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-10T20:02:55.494774] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-10-10T20:02:55.588863] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:02:55.627162] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-10T20:02:55.772500] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T20:02:56.289406] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-10-10T20:02:56.863674] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T20:02:57.089387] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-10T20:02:57.889446] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-10T20:02:58.237751] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T20:02:58.689414] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-10T20:02:58.967342] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T20:02:59.489458] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-10T20:03:00.084969] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-10T20:03:00.151929] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T20:03:00.289357] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-10T20:03:01.089360] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-10T20:03:01.318367] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T20:03:01.889409] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-10T20:03:02.595580] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-10T20:03:02.689334] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-10T20:03:02.841266] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-10T20:03:03.029187] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T20:03:03.489430] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-10T20:03:04.012461] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T20:03:04.289391] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-10T20:03:05.089364] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-10T20:03:05.205143] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T20:03:05.889341] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-10T20:03:06.370511] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T20:03:06.689412] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-10T20:03:06.916329] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T20:03:07.327936] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-10T20:03:07.489375] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-10T20:03:08.289361] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-10T20:03:08.338061] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T20:03:09.089360] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-10T20:03:09.516568] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T20:03:09.889343] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-10T20:03:10.404155] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T20:03:10.438297] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-10T20:03:10.689424] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-10T20:03:11.489410] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-10T20:03:11.987601] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T20:03:12.289367] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-10T20:03:12.486266] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T20:03:12.704955] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T20:03:13.089360] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-10T20:03:13.889406] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-10T20:03:14.264527] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T20:03:14.366255] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-10T20:03:14.689442] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-10T20:03:15.489370] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-10T20:03:15.602810] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T20:03:16.289349] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-10T20:03:16.386967] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-10T20:03:17.089351] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-10T20:03:17.263679] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T20:03:17.896944] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-10T20:03:17.898072] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-10T20:03:17.903182] [INFO ] [REMOTE ] MAA: Full fetch complete (61224 records). [2025-10-10T20:03:17.903285] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-10T20:03:18.301220] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-10T20:03:18.301347] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-10T20:03:18.302767] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-10T20:03:18.302847] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-10T20:03:18.304971] [DEBUG] [LOCAL ] MAA: Trimmed 61224 records to 43220 (keeping 200 days of data) [2025-10-10T20:03:18.537970] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T20:03:18.583694] [INFO ] [REMOTE ] MA: Full fetch complete (76243 records). [2025-10-10T20:03:18.585980] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-10T20:03:18.690165] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-10T20:03:18.896372] [DEBUG] [LOCAL ] MAA: Primary data saved (43220 records). [2025-10-10T20:03:18.923146] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-10T20:03:18.923622] [INFO ] [MAIN ] Update Progress: 1300/2373 symbols completed. MAA took 33.8s. Estimated remaining: 2h 31m 15s. Rate: 7.1 symbols/min [2025-10-10T20:03:19.206832] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-10T20:03:19.213170] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-10T20:03:19.218018] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-10T20:03:19.218119] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-10T20:03:19.239172] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:03:19.242895] [DEBUG] [LOCAL ] MA: Trimmed 76243 records to 53267 (keeping 200 days of data) [2025-10-10T20:03:19.467200] [DEBUG] [LOCAL ] MAN: Loaded 43985 existing records from primary storage. [2025-10-10T20:03:19.497872] [INFO ] [MAIN ] MAN: Loaded 43985 existing records. [2025-10-10T20:03:19.709761] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:03:19.712438] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-10T20:03:19.712921] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-10T20:03:19.714263] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-10T20:03:19.714947] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-10T20:03:20.113391] [DEBUG] [LOCAL ] MA: Primary data saved (53267 records). [2025-10-10T20:03:20.131327] [INFO ] [MAIN ] MA: Full history saved. [2025-10-10T20:03:20.154774] [INFO ] [MAIN ] Update Progress: 1301/2373 symbols completed. MA took 49.5s. Estimated remaining: 2h 31m 1s. Rate: 7.1 symbols/min [2025-10-10T20:03:20.238623] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:03:20.295402] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-10-10T20:03:20.323300] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T20:03:20.427887] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:03:20.432219] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-10T20:03:20.431692] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-10T20:03:20.467223] [DEBUG] [LOCAL ] MANU: Loaded 26944 existing records from primary storage. [2025-10-10T20:03:20.467542] [INFO ] [MAIN ] MANU: Loaded 26944 existing records. [2025-10-10T20:03:20.642673] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:03:20.642924] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-10T20:03:20.642974] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-10T20:03:20.643582] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-10T20:03:20.643639] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-10T20:03:21.007951] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:03:21.089375] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-10-10T20:03:21.889351] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-10T20:03:22.031493] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-10T20:03:22.106263] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-10T20:03:22.110696] [INFO ] [REMOTE ] MAGN: Full fetch complete (51455 records). [2025-10-10T20:03:22.110786] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-10T20:03:22.499508] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T20:03:22.521303] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-10T20:03:22.521365] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-10T20:03:22.522174] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-10T20:03:22.522236] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-10T20:03:22.523290] [DEBUG] [LOCAL ] MAGN: Trimmed 51455 records to 36255 (keeping 200 days of data) [2025-10-10T20:03:22.701960] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-10T20:03:22.730460] [DEBUG] [LOCAL ] MAGN: Primary data saved (36255 records). [2025-10-10T20:03:22.730598] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-10T20:03:22.730720] [INFO ] [MAIN ] Update Progress: 1302/2373 symbols completed. MAGN took 30.0s. Estimated remaining: 2h 30m 47s. Rate: 7.1 symbols/min [2025-10-10T20:03:22.896066] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:03:22.943019] [DEBUG] [LOCAL ] MAS: Loaded 52645 existing records from primary storage. [2025-10-10T20:03:22.943323] [INFO ] [MAIN ] MAS: Loaded 52645 existing records. [2025-10-10T20:03:23.118719] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:03:23.118941] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-10T20:03:23.119003] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-10T20:03:23.120358] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-10T20:03:23.120416] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-10T20:03:23.502887] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-10T20:03:23.507323] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:03:23.675474] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T20:03:24.289338] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-10-10T20:03:24.329674] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T20:03:24.705781] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-10T20:03:25.089369] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-10T20:03:25.889350] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-10T20:03:26.214548] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T20:03:26.687096] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-10T20:03:26.694339] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-10T20:03:27.489385] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-10T20:03:27.748166] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T20:03:27.842197] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-10T20:03:28.289392] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-10T20:03:29.089376] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-10T20:03:29.261963] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T20:03:29.794794] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-10T20:03:29.889430] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-10T20:03:30.689350] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-10T20:03:31.009448] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-10T20:03:31.489473] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-10T20:03:31.850949] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T20:03:32.183134] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-10T20:03:32.289375] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-10T20:03:33.089403] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-10T20:03:33.435621] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-10T20:03:33.440350] [INFO ] [REMOTE ] MAIN: Full fetch complete (60159 records). [2025-10-10T20:03:33.440481] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-10T20:03:33.771696] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-10T20:03:33.875306] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-10T20:03:33.875390] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-10T20:03:33.876382] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-10T20:03:33.876446] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-10T20:03:33.877780] [DEBUG] [LOCAL ] MAIN: Trimmed 60159 records to 42110 (keeping 200 days of data) [2025-10-10T20:03:33.931117] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-10T20:03:34.141876] [DEBUG] [LOCAL ] MAIN: Primary data saved (42110 records). [2025-10-10T20:03:34.142015] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-10T20:03:34.142094] [INFO ] [MAIN ] Update Progress: 1303/2373 symbols completed. MAIN took 39.3s. Estimated remaining: 2h 30m 41s. Rate: 7.1 symbols/min [2025-10-10T20:03:34.328479] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:03:34.360852] [DEBUG] [LOCAL ] MATV: Loaded 36134 existing records from primary storage. [2025-10-10T20:03:34.361128] [INFO ] [MAIN ] MATV: Loaded 36134 existing records. [2025-10-10T20:03:34.553979] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:03:34.554236] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-10T20:03:34.554285] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-10T20:03:34.554963] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-10T20:03:34.555022] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-10T20:03:34.694103] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-10T20:03:34.942134] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:03:34.970242] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T20:03:35.484702] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T20:03:35.491419] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-10-10T20:03:36.289442] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-10T20:03:36.592125] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T20:03:36.626822] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-10T20:03:37.089386] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-10T20:03:37.304828] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-10T20:03:37.889360] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-10T20:03:38.517065] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-10T20:03:38.689390] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-10T20:03:39.489359] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-10T20:03:39.933347] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T20:03:39.956214] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-10T20:03:40.289405] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-10T20:03:40.946611] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T20:03:41.089370] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-10T20:03:41.886758] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-10T20:03:41.893184] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-10T20:03:42.689415] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-10T20:03:42.880980] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T20:03:42.978356] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-10T20:03:43.481700] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-10T20:03:43.484615] [INFO ] [REMOTE ] MANU: Full fetch complete (38423 records). [2025-10-10T20:03:43.484755] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-10T20:03:43.496328] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-10T20:03:43.883931] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-10T20:03:43.884059] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-10T20:03:43.885079] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-10T20:03:43.885184] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-10T20:03:43.887094] [DEBUG] [LOCAL ] MANU: Trimmed 38423 records to 27241 (keeping 200 days of data) [2025-10-10T20:03:44.060327] [DEBUG] [LOCAL ] MANU: Primary data saved (27241 records). [2025-10-10T20:03:44.060521] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-10T20:03:44.060629] [INFO ] [MAIN ] Update Progress: 1304/2373 symbols completed. MANU took 23.9s. Estimated remaining: 2h 30m 34s. Rate: 7.1 symbols/min [2025-10-10T20:03:44.237120] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:03:44.279246] [DEBUG] [LOCAL ] MATX: Loaded 31582 existing records from primary storage. [2025-10-10T20:03:44.279896] [INFO ] [MAIN ] MATX: Loaded 31582 existing records. [2025-10-10T20:03:44.294549] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-10T20:03:44.470788] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:03:44.471082] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-10T20:03:44.471133] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-10T20:03:44.471847] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-10T20:03:44.471909] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-10T20:03:44.841907] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:03:45.089384] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-10-10T20:03:45.415612] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T20:03:45.813778] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-10T20:03:45.889352] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-10T20:03:46.544354] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-10T20:03:46.689385] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-10T20:03:47.489439] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-10T20:03:47.672608] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T20:03:48.289367] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-10T20:03:48.511472] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T20:03:48.597428] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-10T20:03:49.089362] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-10T20:03:49.889352] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-10T20:03:50.216306] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-10T20:03:50.253389] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-10T20:03:50.689376] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-10T20:03:50.720814] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-10T20:03:51.489381] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-10T20:03:52.289403] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-10T20:03:52.319059] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T20:03:53.089362] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-10T20:03:53.427232] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T20:03:53.630036] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-10T20:03:53.889699] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-10T20:03:54.657452] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T20:03:54.689350] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-10T20:03:55.489439] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-10T20:03:55.554741] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T20:03:56.289359] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-10T20:03:56.383070] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-10T20:03:57.089384] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-10T20:03:57.506312] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T20:03:57.889375] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-10T20:03:57.926387] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-10T20:03:57.930928] [INFO ] [REMOTE ] MAN: Full fetch complete (62236 records). [2025-10-10T20:03:57.931065] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-10T20:03:58.343716] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-10T20:03:58.343831] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-10T20:03:58.345245] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-10T20:03:58.345347] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-10T20:03:58.347140] [DEBUG] [LOCAL ] MAN: Trimmed 62236 records to 44317 (keeping 200 days of data) [2025-10-10T20:03:58.636812] [DEBUG] [LOCAL ] MAN: Primary data saved (44317 records). [2025-10-10T20:03:58.637051] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-10T20:03:58.637214] [INFO ] [MAIN ] Update Progress: 1305/2373 symbols completed. MAN took 39.7s. Estimated remaining: 2h 30m 31s. Rate: 7.1 symbols/min [2025-10-10T20:03:58.715202] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-10T20:03:58.844772] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:03:58.869679] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-10T20:03:58.908913] [DEBUG] [LOCAL ] MAX: Loaded 31210 existing records from primary storage. [2025-10-10T20:03:58.909293] [INFO ] [MAIN ] MAX: Loaded 31210 existing records. [2025-10-10T20:03:59.095689] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:03:59.095970] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-10T20:03:59.096021] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-10T20:03:59.096612] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-10T20:03:59.096701] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-10T20:03:59.500489] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:03:59.493545] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-10T20:03:59.530254] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-10T20:04:00.289413] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-10-10T20:04:00.586751] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-10T20:04:01.089384] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-10T20:04:01.143455] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T20:04:01.894530] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-10T20:04:01.915351] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T20:04:02.689370] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-10T20:04:03.100256] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T20:04:03.489352] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-10T20:04:03.517869] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T20:04:04.234571] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-10T20:04:04.289378] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-10T20:04:05.089351] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-10T20:04:05.190639] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-10T20:04:05.765145] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-10T20:04:05.889375] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-10T20:04:06.689390] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-10T20:04:07.014498] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-10T20:04:07.020214] [INFO ] [REMOTE ] MAS: Full fetch complete (74877 records). [2025-10-10T20:04:07.020505] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-10T20:04:07.448903] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T20:04:07.456095] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-10T20:04:07.456585] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-10T20:04:07.457877] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-10T20:04:07.457962] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-10T20:04:07.460208] [DEBUG] [LOCAL ] MAS: Trimmed 74877 records to 53015 (keeping 200 days of data) [2025-10-10T20:04:07.517907] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-10T20:04:07.787862] [DEBUG] [LOCAL ] MAS: Primary data saved (53015 records). [2025-10-10T20:04:07.788016] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-10T20:04:07.788102] [INFO ] [MAIN ] Update Progress: 1306/2373 symbols completed. MAS took 45.1s. Estimated remaining: 2h 30m 23s. Rate: 7.1 symbols/min [2025-10-10T20:04:07.958179] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:04:07.998583] [DEBUG] [LOCAL ] MBC: Loaded 43932 existing records from primary storage. [2025-10-10T20:04:07.998911] [INFO ] [MAIN ] MBC: Loaded 43932 existing records. [2025-10-10T20:04:08.127553] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T20:04:08.165351] [INFO ] [REMOTE ] MATV: Full fetch complete (52110 records). [2025-10-10T20:04:08.190268] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-10T20:04:08.196276] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:04:08.196699] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-10T20:04:08.196759] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-10T20:04:08.229441] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-10T20:04:08.274743] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-10T20:04:08.291135] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-10T20:04:08.902221] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-10T20:04:08.902967] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-10T20:04:08.903902] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-10T20:04:08.919974] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-10T20:04:08.985351] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:04:08.986270] [DEBUG] [LOCAL ] MATV: Trimmed 52110 records to 36348 (keeping 200 days of data) [2025-10-10T20:04:09.089002] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T20:04:09.092807] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-10-10T20:04:09.224016] [DEBUG] [LOCAL ] MATV: Primary data saved (36348 records). [2025-10-10T20:04:09.224161] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-10T20:04:09.224240] [INFO ] [MAIN ] Update Progress: 1307/2373 symbols completed. MATV took 35.1s. Estimated remaining: 2h 30m 9s. Rate: 7.1 symbols/min [2025-10-10T20:04:09.388374] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:04:09.409392] [DEBUG] [LOCAL ] MBI: Loaded 24418 existing records from primary storage. [2025-10-10T20:04:09.409637] [INFO ] [MAIN ] MBI: Loaded 24418 existing records. [2025-10-10T20:04:09.582045] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:04:09.582304] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-10T20:04:09.582354] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-10T20:04:09.582873] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-10T20:04:09.582931] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-10T20:04:09.894594] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-10T20:04:09.952731] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:04:10.043230] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T20:04:10.689435] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-10-10T20:04:10.834601] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-10T20:04:11.261665] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-10T20:04:11.265026] [INFO ] [REMOTE ] MATX: Full fetch complete (43075 records). [2025-10-10T20:04:11.265147] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-10T20:04:11.497568] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-10T20:04:11.642485] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-10T20:04:11.642630] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-10T20:04:11.643437] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-10T20:04:11.643510] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-10T20:04:11.644552] [DEBUG] [LOCAL ] MATX: Trimmed 43075 records to 31897 (keeping 200 days of data) [2025-10-10T20:04:11.842274] [DEBUG] [LOCAL ] MATX: Primary data saved (31897 records). [2025-10-10T20:04:11.842401] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-10T20:04:11.842480] [INFO ] [MAIN ] Update Progress: 1308/2373 symbols completed. MATX took 27.8s. Estimated remaining: 2h 29m 55s. Rate: 7.1 symbols/min [2025-10-10T20:04:12.015864] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:04:12.053724] [DEBUG] [LOCAL ] MC: Loaded 44235 existing records from primary storage. [2025-10-10T20:04:12.054036] [INFO ] [MAIN ] MC: Loaded 44235 existing records. [2025-10-10T20:04:12.159437] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-10T20:04:12.249367] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:04:12.249577] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-10T20:04:12.249623] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-10T20:04:12.250322] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-10T20:04:12.250378] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-10T20:04:12.294533] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-10T20:04:12.598110] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:04:13.089370] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-10-10T20:04:13.287738] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T20:04:13.865277] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-10T20:04:13.889381] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-10T20:04:14.696190] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-10T20:04:14.721504] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T20:04:15.361258] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-10T20:04:15.489363] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-10T20:04:16.289423] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-10T20:04:16.329080] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T20:04:16.682188] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-10T20:04:17.089368] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-10T20:04:17.889350] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-10T20:04:18.102312] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T20:04:18.306891] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T20:04:18.689444] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-10T20:04:19.206013] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-10T20:04:19.489433] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-10T20:04:20.289364] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-10T20:04:20.334526] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-10T20:04:20.992972] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T20:04:21.089484] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-10T20:04:21.793521] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T20:04:21.889382] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-10T20:04:22.689404] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-10T20:04:22.852950] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T20:04:23.425011] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-10T20:04:23.489377] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-10T20:04:23.534857] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-10T20:04:24.289388] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-10T20:04:25.089355] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-10T20:04:25.374715] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-10T20:04:25.615009] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-10T20:04:25.889443] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-10T20:04:26.689355] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-10T20:04:26.825209] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-10T20:04:27.489371] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-10T20:04:27.771044] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T20:04:28.289348] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-10T20:04:28.462439] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T20:04:28.532173] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-10T20:04:28.536043] [INFO ] [REMOTE ] MAX: Full fetch complete (45438 records). [2025-10-10T20:04:28.536172] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-10T20:04:28.904857] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-10T20:04:28.904935] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-10T20:04:28.905661] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-10T20:04:28.905724] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-10T20:04:28.906611] [DEBUG] [LOCAL ] MAX: Trimmed 45438 records to 31469 (keeping 200 days of data) [2025-10-10T20:04:29.098748] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-10T20:04:29.106845] [DEBUG] [LOCAL ] MAX: Primary data saved (31469 records). [2025-10-10T20:04:29.107147] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-10T20:04:29.107293] [INFO ] [MAIN ] Update Progress: 1309/2373 symbols completed. MAX took 30.5s. Estimated remaining: 2h 29m 54s. Rate: 7.1 symbols/min [2025-10-10T20:04:29.297859] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:04:29.311323] [DEBUG] [LOCAL ] MCB: Loaded 11314 existing records from primary storage. [2025-10-10T20:04:29.311720] [INFO ] [MAIN ] MCB: Loaded 11314 existing records. [2025-10-10T20:04:29.497908] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:04:29.498194] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-10T20:04:29.498247] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-10T20:04:29.498677] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-10T20:04:29.498739] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-10T20:04:29.644756] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-10T20:04:29.892155] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-10T20:04:29.895966] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:04:30.689397] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-10-10T20:04:30.777774] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-10T20:04:31.489349] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-10T20:04:31.629583] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T20:04:31.676411] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-10T20:04:32.289396] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-10T20:04:33.089340] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-10T20:04:33.468391] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T20:04:33.588686] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T20:04:33.889386] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-10T20:04:34.689366] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-10T20:04:34.852586] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T20:04:35.128627] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-10T20:04:35.489479] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-10T20:04:36.152041] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-10T20:04:36.289421] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-10T20:04:36.684532] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T20:04:37.089447] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-10T20:04:37.617216] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T20:04:37.889392] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-10T20:04:38.056846] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T20:04:38.689416] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-10T20:04:39.489434] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-10T20:04:39.508920] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-10T20:04:39.513138] [INFO ] [REMOTE ] MC: Full fetch complete (62622 records). [2025-10-10T20:04:39.513276] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-10T20:04:39.910398] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-10T20:04:39.910486] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-10T20:04:39.911405] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-10T20:04:39.911484] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-10T20:04:39.912790] [DEBUG] [LOCAL ] MC: Trimmed 62622 records to 44518 (keeping 200 days of data) [2025-10-10T20:04:40.102876] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-10T20:04:40.132188] [INFO ] [REMOTE ] MBI: Full fetch complete (36502 records). [2025-10-10T20:04:40.139585] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-10T20:04:40.289757] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-10T20:04:40.542679] [DEBUG] [LOCAL ] MC: Primary data saved (44518 records). [2025-10-10T20:04:40.565577] [INFO ] [MAIN ] MC: Full history saved. [2025-10-10T20:04:40.581937] [INFO ] [MAIN ] Update Progress: 1310/2373 symbols completed. MC took 28.7s. Estimated remaining: 2h 29m 48s. Rate: 7.1 symbols/min [2025-10-10T20:04:40.625382] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-10T20:04:40.671242] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-10T20:04:40.687063] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-10T20:04:40.709532] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-10T20:04:40.768756] [DEBUG] [LOCAL ] MBI: Trimmed 36502 records to 24626 (keeping 200 days of data) [2025-10-10T20:04:40.796876] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:04:40.797325] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-10T20:04:40.797387] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-10T20:04:40.797528] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-10T20:04:40.797585] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-10T20:04:40.797673] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-10T20:04:40.797747] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-10T20:04:41.237826] [DEBUG] [LOCAL ] MBI: Primary data saved (24626 records). [2025-10-10T20:04:41.266159] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T20:04:41.249526] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-10T20:04:41.274794] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-10T20:04:41.288940] [INFO ] [MAIN ] Update Progress: 1311/2373 symbols completed. MBI took 32.1s. Estimated remaining: 2h 29m 33s. Rate: 7.1 symbols/min [2025-10-10T20:04:41.333901] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:04:41.461964] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-10T20:04:41.539400] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:04:41.547920] [DEBUG] [LOCAL ] MCI: Loaded 6510 existing records from primary storage. [2025-10-10T20:04:41.548135] [INFO ] [MAIN ] MCI: Loaded 6510 existing records. [2025-10-10T20:04:41.725107] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:04:41.725390] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-10T20:04:41.725448] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-10T20:04:41.725722] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-10T20:04:41.725781] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-10T20:04:41.898568] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-10T20:04:42.087065] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:04:42.484402] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-10T20:04:42.689388] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-10T20:04:43.489357] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-10-10T20:04:43.691947] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T20:04:43.866119] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-10T20:04:43.982379] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-10T20:04:44.289395] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-10T20:04:45.089450] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-10T20:04:45.889382] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-10T20:04:45.956628] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-10T20:04:46.037346] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T20:04:46.567248] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-10T20:04:46.689376] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-10T20:04:47.489384] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-10-10T20:04:47.596561] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-10T20:04:48.289370] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-10T20:04:49.089373] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-10T20:04:49.381866] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-10T20:04:49.889420] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-10T20:04:49.969337] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-10T20:04:50.015714] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-10T20:04:50.689363] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-10T20:04:51.489372] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-10T20:04:51.694033] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T20:04:52.289348] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-10T20:04:52.338959] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-10T20:04:52.988044] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-10T20:04:53.089342] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-10T20:04:53.889394] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-10T20:04:53.994627] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-10T20:04:54.356041] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-10T20:04:54.362986] [INFO ] [REMOTE ] MBC: Full fetch complete (63133 records). [2025-10-10T20:04:54.363186] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-10T20:04:54.695722] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-10T20:04:54.751464] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-10T20:04:54.751552] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-10T20:04:54.752441] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-10T20:04:54.752510] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-10T20:04:54.754098] [DEBUG] [LOCAL ] MBC: Trimmed 63133 records to 44294 (keeping 200 days of data) [2025-10-10T20:04:55.016730] [DEBUG] [LOCAL ] MBC: Primary data saved (44294 records). [2025-10-10T20:04:55.016879] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-10T20:04:55.017042] [INFO ] [MAIN ] Update Progress: 1312/2373 symbols completed. MBC took 47.2s. Estimated remaining: 2h 29m 29s. Rate: 7.1 symbols/min [2025-10-10T20:04:55.187070] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:04:55.222074] [DEBUG] [LOCAL ] MCK: Loaded 39077 existing records from primary storage. [2025-10-10T20:04:55.222359] [INFO ] [MAIN ] MCK: Loaded 39077 existing records. [2025-10-10T20:04:55.392723] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:04:55.392931] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-10T20:04:55.392977] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-10T20:04:55.393779] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-10T20:04:55.393838] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-10T20:04:55.492870] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-10T20:04:55.513704] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T20:04:55.581475] [INFO ] [REMOTE ] MCB: Full fetch complete (16417 records). [2025-10-10T20:04:55.618131] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-10T20:04:55.936694] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:04:56.203064] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-10T20:04:56.203263] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-10T20:04:56.205940] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-10T20:04:56.204625] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-10T20:04:56.216010] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-10T20:04:56.217519] [DEBUG] [LOCAL ] MCB: Trimmed 16417 records to 11456 (keeping 200 days of data) [2025-10-10T20:04:56.290003] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-10T20:04:56.295461] [DEBUG] [LOCAL ] MCB: Primary data saved (11456 records). [2025-10-10T20:04:56.296691] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-10T20:04:56.296926] [INFO ] [MAIN ] Update Progress: 1313/2373 symbols completed. MCB took 27.2s. Estimated remaining: 2h 29m 15s. Rate: 7.1 symbols/min [2025-10-10T20:04:56.412625] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-10T20:04:56.489764] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:04:56.499221] [DEBUG] [LOCAL ] MCN: Loaded 8218 existing records from primary storage. [2025-10-10T20:04:56.499470] [INFO ] [MAIN ] MCN: Loaded 8218 existing records. [2025-10-10T20:04:56.684594] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:04:56.684865] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-10T20:04:56.684915] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-10T20:04:56.685255] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-10T20:04:56.685333] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-10T20:04:57.055774] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:04:57.089415] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-10T20:04:57.889458] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-10-10T20:04:57.936231] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-10T20:04:58.500168] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-10T20:04:58.689402] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-10T20:04:58.853450] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-10T20:04:59.489488] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-10-10T20:04:59.608532] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-10T20:05:00.289464] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-10T20:05:01.089362] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-10T20:05:01.299485] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T20:05:01.889372] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-10T20:05:01.960332] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-10T20:05:02.496638] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-10T20:05:02.668223] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-10T20:05:02.689389] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-10T20:05:03.489410] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-10T20:05:03.606954] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-10T20:05:04.289347] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-10T20:05:04.396169] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-10T20:05:04.979906] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-10T20:05:05.089356] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-10T20:05:05.889349] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-10T20:05:05.972327] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-10T20:05:06.615617] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-10T20:05:06.689352] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-10T20:05:07.489364] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-10T20:05:07.575995] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-10T20:05:08.289356] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-10T20:05:09.089336] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-10T20:05:09.202903] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-10T20:05:09.225866] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-10T20:05:09.889419] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-10T20:05:09.937108] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-10T20:05:10.689378] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-10T20:05:11.461412] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T20:05:11.462628] [INFO ] [REMOTE ] MCI: Full fetch complete (10012 records). [2025-10-10T20:05:11.462720] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-10T20:05:11.494485] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-10T20:05:11.854555] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-10T20:05:11.854674] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-10T20:05:11.854932] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-10T20:05:11.855012] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-10T20:05:11.855449] [DEBUG] [LOCAL ] MCI: Trimmed 10012 records to 6589 (keeping 200 days of data) [2025-10-10T20:05:11.894779] [DEBUG] [LOCAL ] MCI: Primary data saved (6589 records). [2025-10-10T20:05:11.894885] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-10T20:05:11.894965] [INFO ] [MAIN ] Update Progress: 1314/2373 symbols completed. MCI took 30.6s. Estimated remaining: 2h 29m 12s. Rate: 7.1 symbols/min [2025-10-10T20:05:12.065479] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:05:12.101864] [DEBUG] [LOCAL ] MCO: Loaded 39546 existing records from primary storage. [2025-10-10T20:05:12.102136] [INFO ] [MAIN ] MCO: Loaded 39546 existing records. [2025-10-10T20:05:12.278945] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:05:12.279261] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-10T20:05:12.279385] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-10T20:05:12.280234] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-10T20:05:12.280292] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-10T20:05:12.294445] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-10T20:05:12.433097] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-10T20:05:12.670061] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:05:13.089344] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-10-10T20:05:13.224781] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-10T20:05:13.338296] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T20:05:13.889387] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-10T20:05:14.345473] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T20:05:14.689378] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-10T20:05:15.489416] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-10T20:05:15.528012] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-10T20:05:15.753263] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T20:05:16.289383] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-10T20:05:17.089414] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-10T20:05:17.126472] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T20:05:17.889350] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-10T20:05:18.221077] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-10T20:05:18.689386] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-10T20:05:18.862514] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T20:05:19.489416] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-10T20:05:19.672523] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T20:05:20.289423] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-10T20:05:20.445317] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T20:05:21.089385] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-10T20:05:21.125893] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-10T20:05:21.469096] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T20:05:21.889385] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-10T20:05:22.689349] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-10T20:05:23.028388] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T20:05:23.489406] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-10T20:05:23.912010] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T20:05:24.215083] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-10T20:05:24.289374] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-10T20:05:24.722579] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T20:05:25.089377] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-10T20:05:25.889353] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-10T20:05:25.919268] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T20:05:25.924405] [INFO ] [REMOTE ] MCN: Full fetch complete (11709 records). [2025-10-10T20:05:25.924938] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-10T20:05:25.926222] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T20:05:26.319260] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-10T20:05:26.319355] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-10T20:05:26.319662] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-10T20:05:26.319724] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-10T20:05:26.320196] [DEBUG] [LOCAL ] MCN: Trimmed 11709 records to 8270 (keeping 200 days of data) [2025-10-10T20:05:26.369778] [DEBUG] [LOCAL ] MCN: Primary data saved (8270 records). [2025-10-10T20:05:26.369917] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-10T20:05:26.370019] [INFO ] [MAIN ] Update Progress: 1315/2373 symbols completed. MCN took 30.1s. Estimated remaining: 2h 29m 9s. Rate: 7.1 symbols/min [2025-10-10T20:05:26.542778] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:05:26.552297] [DEBUG] [LOCAL ] MCR: Loaded 8949 existing records from primary storage. [2025-10-10T20:05:26.552521] [INFO ] [MAIN ] MCR: Loaded 8949 existing records. [2025-10-10T20:05:26.697618] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-10T20:05:26.741832] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:05:26.742106] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-10T20:05:26.742156] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-10T20:05:26.742498] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-10T20:05:26.742555] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-10T20:05:27.109762] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:05:27.489403] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-10T20:05:27.552194] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-10T20:05:27.806767] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-10T20:05:27.812054] [INFO ] [REMOTE ] MCD: Full fetch complete (77029 records). [2025-10-10T20:05:27.812184] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-10T20:05:28.019347] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T20:05:28.020188] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:05:28.020259] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:05:28.020309] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-10T20:05:28.020371] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-10T20:05:28.020406] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-10T20:05:28.020445] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-10T20:05:28.020513] [INFO ] [MAIN ] Update Progress: 1316/2373 symbols completed. MCD took 47.4s. Estimated remaining: 2h 28m 55s. Rate: 7.1 symbols/min [2025-10-10T20:05:28.193216] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:05:28.213287] [DEBUG] [LOCAL ] MCS: Loaded 21106 existing records from primary storage. [2025-10-10T20:05:28.213624] [INFO ] [MAIN ] MCS: Loaded 21106 existing records. [2025-10-10T20:05:28.294570] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-10-10T20:05:28.409068] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:05:28.409967] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-10T20:05:28.410027] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-10T20:05:28.410955] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-10T20:05:28.411015] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-10T20:05:28.776144] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:05:29.089389] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-10-10T20:05:29.242852] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-10T20:05:29.337044] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-10T20:05:29.872419] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-10T20:05:29.889425] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-10T20:05:30.689430] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-10T20:05:31.489753] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-10T20:05:31.492505] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T20:05:32.289362] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-10T20:05:32.315841] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T20:05:32.334312] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-10T20:05:33.089352] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-10T20:05:33.889352] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-10T20:05:33.974283] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T20:05:34.310126] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-10T20:05:34.689418] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-10T20:05:35.351075] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-10T20:05:35.489398] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-10T20:05:35.873147] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-10T20:05:35.876624] [INFO ] [REMOTE ] MCK: Full fetch complete (56820 records). [2025-10-10T20:05:35.876742] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-10T20:05:36.251218] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-10T20:05:36.251307] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-10T20:05:36.252154] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-10T20:05:36.252217] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-10T20:05:36.253601] [DEBUG] [LOCAL ] MCK: Trimmed 56820 records to 39349 (keeping 200 days of data) [2025-10-10T20:05:36.308724] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-10T20:05:36.504426] [DEBUG] [LOCAL ] MCK: Primary data saved (39349 records). [2025-10-10T20:05:36.504561] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-10T20:05:36.504667] [INFO ] [MAIN ] Update Progress: 1317/2373 symbols completed. MCK took 41.5s. Estimated remaining: 2h 28m 46s. Rate: 7.1 symbols/min [2025-10-10T20:05:37.089405] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-10T20:05:37.178373] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T20:05:37.495262] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-10T20:05:37.889409] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-10T20:05:38.308059] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T20:05:38.689346] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-10T20:05:38.756810] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-10T20:05:39.489441] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-10T20:05:40.289412] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-10T20:05:40.572107] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T20:05:40.652517] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-10T20:05:41.089403] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-10T20:05:41.273735] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-10T20:05:41.889393] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-10T20:05:42.195894] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-10T20:05:42.689365] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-10T20:05:43.149687] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T20:05:43.153769] [INFO ] [REMOTE ] MCO: Full fetch complete (57276 records). [2025-10-10T20:05:43.153874] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-10T20:05:43.498723] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-10T20:05:43.542278] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-10T20:05:43.542390] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-10T20:05:43.543233] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-10T20:05:43.543295] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-10T20:05:43.544470] [DEBUG] [LOCAL ] MCO: Trimmed 57276 records to 39893 (keeping 200 days of data) [2025-10-10T20:05:43.790842] [DEBUG] [LOCAL ] MCO: Primary data saved (39893 records). [2025-10-10T20:05:43.790981] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-10T20:05:43.791061] [INFO ] [MAIN ] Update Progress: 1318/2373 symbols completed. MCO took 31.9s. Estimated remaining: 2h 28m 37s. Rate: 7.1 symbols/min [2025-10-10T20:05:43.830536] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T20:05:44.289436] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-10T20:05:44.611374] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-10T20:05:45.089365] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-10T20:05:45.656313] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-10T20:05:45.889370] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-10T20:05:45.962410] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-10T20:05:46.689365] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-10T20:05:47.182506] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T20:05:47.489407] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-10T20:05:47.565180] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-10T20:05:48.289388] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-10T20:05:48.739259] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T20:05:49.089373] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-10T20:05:49.178399] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-10T20:05:49.889455] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-10T20:05:50.306278] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-10T20:05:50.308859] [INFO ] [REMOTE ] MCS: Full fetch complete (30515 records). [2025-10-10T20:05:50.308948] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-10T20:05:50.690138] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-10T20:05:50.690230] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-10T20:05:50.690932] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-10T20:05:50.690994] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-10T20:05:50.691790] [DEBUG] [LOCAL ] MCS: Trimmed 30515 records to 21277 (keeping 200 days of data) [2025-10-10T20:05:50.799447] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T20:05:50.807308] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-10T20:05:50.848808] [DEBUG] [LOCAL ] MCS: Primary data saved (21277 records). [2025-10-10T20:05:50.848974] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-10T20:05:50.849077] [INFO ] [MAIN ] Update Progress: 1319/2373 symbols completed. MCS took 22.8s. Estimated remaining: 2h 28m 27s. Rate: 7.1 symbols/min [2025-10-10T20:05:51.595380] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-10T20:05:51.598037] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-10T20:05:52.470662] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T20:05:52.472588] [INFO ] [REMOTE ] MCR: Full fetch complete (14061 records). [2025-10-10T20:05:52.472715] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-10T20:05:52.844133] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-10T20:05:52.844215] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-10T20:05:52.844552] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-10T20:05:52.844613] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-10T20:05:52.845162] [DEBUG] [LOCAL ] MCR: Trimmed 14061 records to 8990 (keeping 200 days of data) [2025-10-10T20:05:52.898889] [DEBUG] [LOCAL ] MCR: Primary data saved (8990 records). [2025-10-10T20:05:52.899042] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-10T20:05:52.899129] [INFO ] [MAIN ] Update Progress: 1320/2373 symbols completed. MCR took 26.5s. Estimated remaining: 2h 28m 14s. Rate: 7.1 symbols/min [2025-10-10T20:05:53.394535] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:05:53.603888] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:05:53.607375] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:05:53.601601] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:05:53.610772] [DEBUG] [LOCAL ] MDST: Loaded 5842 existing records from primary storage. [2025-10-10T20:05:53.611826] [INFO ] [MAIN ] MDST: Loaded 5842 existing records. [2025-10-10T20:05:53.810946] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:05:53.819209] [DEBUG] [LOCAL ] MCY: Loaded 24125 existing records from primary storage. [2025-10-10T20:05:53.818799] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-10T20:05:53.819521] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-10T20:05:53.819622] [INFO ] [MAIN ] MCY: Loaded 24125 existing records. [2025-10-10T20:05:53.830469] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-10T20:05:53.840275] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-10T20:05:54.023850] [DEBUG] [LOCAL ] MD: Loaded 38768 existing records from primary storage. [2025-10-10T20:05:54.059781] [INFO ] [MAIN ] MD: Loaded 38768 existing records. [2025-10-10T20:05:54.086613] [DEBUG] [LOCAL ] MDT: Loaded 54068 existing records from primary storage. [2025-10-10T20:05:54.158174] [INFO ] [MAIN ] MDT: Loaded 54068 existing records. [2025-10-10T20:05:54.334709] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:05:54.371801] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-10T20:05:54.392082] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-10T20:05:54.448042] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-10T20:05:54.503347] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-10T20:05:54.792190] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:05:54.749162] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:05:54.842176] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-10T20:05:54.864462] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-10T20:05:54.837026] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-10T20:05:54.882735] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-10T20:05:54.909125] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-10T20:05:54.918010] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-10T20:05:54.912680] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:05:54.909077] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-10T20:05:54.943402] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-10-10T20:05:54.976303] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-10T20:05:55.621368] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:05:55.681883] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-10-10T20:05:55.846904] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:05:55.882255] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-10-10T20:05:55.904854] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:05:55.905243] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-10-10T20:05:55.910981] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-10T20:05:55.912916] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-10T20:05:56.637060] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-10T20:05:56.640046] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-10T20:05:56.971835] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T20:05:57.048000] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-10T20:05:57.089322] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-10T20:05:57.592437] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T20:05:57.778483] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-10T20:05:57.865019] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T20:05:57.889332] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-10T20:05:58.689394] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-10T20:05:59.380428] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-10T20:05:59.489377] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-10T20:06:00.186293] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-10T20:06:00.289400] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-10T20:06:01.089392] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-10T20:06:01.148359] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-10T20:06:01.815097] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-10T20:06:01.889768] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-10T20:06:01.892275] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-10T20:06:02.689385] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-10T20:06:03.456713] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T20:06:03.489394] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-10T20:06:04.156671] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-10T20:06:04.289391] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-10T20:06:05.089376] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-10T20:06:05.260520] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T20:06:05.261252] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-10T20:06:05.889359] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-10T20:06:06.685314] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-10T20:06:06.689332] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-10T20:06:07.137527] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T20:06:07.489440] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-10T20:06:07.783229] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-10T20:06:08.213185] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-10T20:06:08.289475] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-10T20:06:09.089378] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-10T20:06:09.889412] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-10T20:06:10.417439] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T20:06:10.632321] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-10T20:06:10.689445] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-10T20:06:11.454599] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T20:06:11.489326] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-10T20:06:12.289389] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-10T20:06:12.404184] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T20:06:13.075077] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-10T20:06:13.089341] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-10T20:06:13.889392] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-10T20:06:14.104554] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T20:06:14.549375] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-10T20:06:14.562931] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-10T20:06:14.689391] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-10T20:06:15.489379] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-10T20:06:16.289397] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-10T20:06:16.915154] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-10T20:06:17.089376] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-10T20:06:17.121589] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T20:06:17.512809] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T20:06:17.889440] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-10T20:06:18.689363] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-10T20:06:19.348722] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-10T20:06:19.489407] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-10T20:06:19.521320] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T20:06:19.522691] [INFO ] [REMOTE ] MDST: Full fetch complete (8674 records). [2025-10-10T20:06:19.522760] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-10T20:06:19.704117] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T20:06:19.922690] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-10T20:06:19.922781] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-10T20:06:19.923075] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-10T20:06:19.923115] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-10T20:06:19.923503] [DEBUG] [LOCAL ] MDST: Trimmed 8674 records to 5946 (keeping 200 days of data) [2025-10-10T20:06:19.960019] [DEBUG] [LOCAL ] MDST: Primary data saved (5946 records). [2025-10-10T20:06:19.960149] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-10T20:06:19.960241] [INFO ] [MAIN ] Update Progress: 1321/2373 symbols completed. MDST took 27.0s. Estimated remaining: 2h 28m 20s. Rate: 7.1 symbols/min [2025-10-10T20:06:20.125272] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:06:20.167448] [DEBUG] [LOCAL ] MDU: Loaded 48351 existing records from primary storage. [2025-10-10T20:06:20.167771] [INFO ] [MAIN ] MDU: Loaded 48351 existing records. [2025-10-10T20:06:20.303199] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-10T20:06:20.348933] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:06:20.349235] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-10T20:06:20.349290] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-10T20:06:20.350236] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-10T20:06:20.350299] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-10T20:06:20.694976] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:06:21.089379] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-10-10T20:06:21.865626] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-10T20:06:21.892826] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-10T20:06:21.910517] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-10T20:06:22.689392] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-10T20:06:22.930876] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T20:06:23.489406] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-10T20:06:23.558661] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-10T20:06:23.648164] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-10T20:06:24.289433] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-10T20:06:25.089420] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-10T20:06:25.281188] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T20:06:25.889356] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-10T20:06:26.000210] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-10T20:06:26.431335] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T20:06:26.689376] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-10T20:06:27.121862] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-10T20:06:27.489363] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-10T20:06:27.962873] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-10T20:06:27.966852] [INFO ] [REMOTE ] MCY: Full fetch complete (41098 records). [2025-10-10T20:06:27.967071] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-10T20:06:28.306561] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-10T20:06:28.358439] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-10T20:06:28.358519] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-10T20:06:28.359349] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-10T20:06:28.359413] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-10T20:06:28.360338] [DEBUG] [LOCAL ] MCY: Trimmed 41098 records to 24282 (keeping 200 days of data) [2025-10-10T20:06:28.506006] [DEBUG] [LOCAL ] MCY: Primary data saved (24282 records). [2025-10-10T20:06:28.506139] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-10T20:06:28.506219] [INFO ] [MAIN ] Update Progress: 1322/2373 symbols completed. MCY took 35.6s. Estimated remaining: 2h 28m 12s. Rate: 7.1 symbols/min [2025-10-10T20:06:28.674687] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:06:28.684369] [DEBUG] [LOCAL ] MDV: Loaded 8589 existing records from primary storage. [2025-10-10T20:06:28.684595] [INFO ] [MAIN ] MDV: Loaded 8589 existing records. [2025-10-10T20:06:28.865472] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:06:28.865857] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-10T20:06:28.865931] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-10T20:06:28.866212] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-10T20:06:28.866269] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-10T20:06:29.099732] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-10T20:06:29.226134] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:06:29.334481] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T20:06:29.889412] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-10T20:06:29.928266] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-10T20:06:29.933248] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-10-10T20:06:29.933389] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-10T20:06:30.321149] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-10T20:06:30.321280] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-10T20:06:30.322452] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-10T20:06:30.322535] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-10T20:06:30.324050] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 54458 (keeping 200 days of data) [2025-10-10T20:06:30.671986] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T20:06:30.689817] [DEBUG] [LOCAL ] MDT: Primary data saved (54458 records). [2025-10-10T20:06:30.689930] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-10T20:06:30.690061] [INFO ] [MAIN ] Update Progress: 1323/2373 symbols completed. MDT took 37.8s. Estimated remaining: 2h 27m 58s. Rate: 7.1 symbols/min [2025-10-10T20:06:30.689682] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-10T20:06:30.866962] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:06:30.882765] [DEBUG] [LOCAL ] MEC: Loaded 16410 existing records from primary storage. [2025-10-10T20:06:30.882982] [INFO ] [MAIN ] MEC: Loaded 16410 existing records. [2025-10-10T20:06:31.069160] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:06:31.069380] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-10T20:06:31.069447] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-10T20:06:31.069802] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-10T20:06:31.069860] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-10T20:06:31.436676] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:06:31.489374] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-10-10T20:06:31.660181] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T20:06:32.154041] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-10T20:06:32.289371] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-10T20:06:32.318305] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T20:06:32.322296] [INFO ] [REMOTE ] MD: Full fetch complete (55082 records). [2025-10-10T20:06:32.322390] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-10T20:06:32.709521] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-10T20:06:32.709603] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-10T20:06:32.710527] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-10T20:06:32.710587] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-10T20:06:32.711769] [DEBUG] [LOCAL ] MD: Trimmed 55082 records to 39070 (keeping 200 days of data) [2025-10-10T20:06:32.961946] [DEBUG] [LOCAL ] MD: Primary data saved (39070 records). [2025-10-10T20:06:32.962094] [INFO ] [MAIN ] MD: Full history saved. [2025-10-10T20:06:32.962176] [INFO ] [MAIN ] Update Progress: 1324/2373 symbols completed. MD took 40.1s. Estimated remaining: 2h 27m 45s. Rate: 7.1 symbols/min [2025-10-10T20:06:33.094542] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-10T20:06:33.142934] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:06:33.163225] [DEBUG] [LOCAL ] MED: Loaded 21505 existing records from primary storage. [2025-10-10T20:06:33.163477] [INFO ] [MAIN ] MED: Loaded 21505 existing records. [2025-10-10T20:06:33.340079] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:06:33.340280] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-10T20:06:33.340326] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-10T20:06:33.340792] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-10T20:06:33.340849] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-10T20:06:33.689360] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:06:33.889410] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-10-10T20:06:33.936229] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-10T20:06:34.170225] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T20:06:34.689393] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-10-10T20:06:34.916348] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-10T20:06:35.127132] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-10T20:06:35.489382] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-10T20:06:36.159680] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-10T20:06:36.289413] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-10T20:06:37.089359] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-10T20:06:37.555494] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-10T20:06:37.642395] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-10T20:06:37.889373] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-10T20:06:38.689366] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-10T20:06:39.111117] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T20:06:39.489363] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-10T20:06:40.180438] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T20:06:40.289356] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-10T20:06:40.697252] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T20:06:41.089351] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-10T20:06:41.265613] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T20:06:41.889422] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-10T20:06:42.368277] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-10T20:06:42.689388] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-10T20:06:43.116721] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-10T20:06:43.452052] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-10T20:06:43.489387] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-10T20:06:44.289382] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-10T20:06:44.360520] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-10T20:06:45.089373] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-10T20:06:45.740419] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-10T20:06:45.889339] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-10T20:06:46.081353] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-10T20:06:46.689384] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-10T20:06:47.063972] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T20:06:47.489346] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-10T20:06:47.654225] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T20:06:48.289372] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-10T20:06:49.089389] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-10T20:06:49.292937] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-10T20:06:49.404283] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-10T20:06:49.889367] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-10T20:06:50.400091] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T20:06:50.689387] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-10T20:06:51.489350] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-10T20:06:51.830545] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T20:06:51.977327] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T20:06:52.289376] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-10T20:06:52.373400] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-10T20:06:53.089368] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-10T20:06:53.889352] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-10T20:06:53.959020] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-10T20:06:53.975252] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-10T20:06:53.980219] [INFO ] [REMOTE ] MDU: Full fetch complete (70378 records). [2025-10-10T20:06:53.980391] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-10T20:06:54.370268] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-10T20:06:54.370355] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-10T20:06:54.371322] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-10T20:06:54.371386] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-10T20:06:54.372827] [DEBUG] [LOCAL ] MDU: Trimmed 70378 records to 48734 (keeping 200 days of data) [2025-10-10T20:06:54.670081] [DEBUG] [LOCAL ] MDU: Primary data saved (48734 records). [2025-10-10T20:06:54.670217] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-10T20:06:54.670299] [INFO ] [MAIN ] Update Progress: 1325/2373 symbols completed. MDU took 34.7s. Estimated remaining: 2h 27m 47s. Rate: 7.1 symbols/min [2025-10-10T20:06:54.691598] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-10T20:06:54.842726] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:06:54.872337] [DEBUG] [LOCAL ] MEG: Loaded 31669 existing records from primary storage. [2025-10-10T20:06:54.872679] [INFO ] [MAIN ] MEG: Loaded 31669 existing records. [2025-10-10T20:06:55.053929] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:06:55.054279] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-10T20:06:55.054350] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-10T20:06:55.054990] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-10T20:06:55.055052] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-10T20:06:55.219093] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T20:06:55.484480] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:06:55.489344] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-10-10T20:06:55.604103] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-10T20:06:56.289371] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-10T20:06:57.076054] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T20:06:57.089343] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-10T20:06:57.189805] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T20:06:57.191107] [INFO ] [REMOTE ] MDV: Full fetch complete (11774 records). [2025-10-10T20:06:57.191176] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-10T20:06:57.544343] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-10T20:06:57.544421] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-10T20:06:57.544713] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-10T20:06:57.544775] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-10T20:06:57.545209] [DEBUG] [LOCAL ] MDV: Trimmed 11774 records to 8643 (keeping 200 days of data) [2025-10-10T20:06:57.597414] [DEBUG] [LOCAL ] MDV: Primary data saved (8643 records). [2025-10-10T20:06:57.597547] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-10T20:06:57.597630] [INFO ] [MAIN ] Update Progress: 1326/2373 symbols completed. MDV took 29.1s. Estimated remaining: 2h 27m 34s. Rate: 7.1 symbols/min [2025-10-10T20:06:57.763092] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:06:57.782811] [DEBUG] [LOCAL ] MEGI: Loaded 20095 existing records from primary storage. [2025-10-10T20:06:57.783074] [INFO ] [MAIN ] MEGI: Loaded 20095 existing records. [2025-10-10T20:06:57.894590] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-10T20:06:57.961537] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:06:57.961913] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-10T20:06:57.961967] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-10T20:06:57.962438] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-10T20:06:57.962497] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-10T20:06:58.317735] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:06:58.513945] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-10T20:06:58.689331] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-10T20:06:59.127821] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-10T20:06:59.489404] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-10T20:07:00.095795] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-10T20:07:00.161065] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-10T20:07:00.289393] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-10T20:07:01.089415] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-10T20:07:01.491391] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T20:07:01.889386] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-10-10T20:07:02.694460] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-10T20:07:02.704823] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T20:07:03.316161] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T20:07:03.489406] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-10T20:07:04.155735] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-10T20:07:04.158127] [INFO ] [REMOTE ] MED: Full fetch complete (32207 records). [2025-10-10T20:07:04.158243] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-10T20:07:04.304871] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-10T20:07:04.570389] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-10T20:07:04.570479] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-10T20:07:04.571355] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-10T20:07:04.571420] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-10T20:07:04.572183] [DEBUG] [LOCAL ] MED: Trimmed 32207 records to 21627 (keeping 200 days of data) [2025-10-10T20:07:04.707703] [DEBUG] [LOCAL ] MED: Primary data saved (21627 records). [2025-10-10T20:07:04.707892] [INFO ] [MAIN ] MED: Full history saved. [2025-10-10T20:07:04.707997] [INFO ] [MAIN ] Update Progress: 1327/2373 symbols completed. MED took 31.7s. Estimated remaining: 2h 27m 25s. Rate: 7.1 symbols/min [2025-10-10T20:07:04.845015] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T20:07:04.906281] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:07:04.941594] [DEBUG] [LOCAL ] MEI: Loaded 32020 existing records from primary storage. [2025-10-10T20:07:04.942046] [INFO ] [MAIN ] MEI: Loaded 32020 existing records. [2025-10-10T20:07:05.094723] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-10T20:07:05.125539] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:07:05.126023] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-10T20:07:05.126087] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-10T20:07:05.126724] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-10T20:07:05.126784] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-10T20:07:05.488130] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:07:05.889393] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-10-10T20:07:06.047047] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T20:07:06.243491] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-10T20:07:06.689361] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-10T20:07:07.022920] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T20:07:07.255210] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-10T20:07:07.489362] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-10T20:07:08.289403] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-10T20:07:08.573216] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-10T20:07:09.089354] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-10T20:07:09.506715] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T20:07:09.889334] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-10T20:07:10.446985] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-10T20:07:10.689328] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-10T20:07:10.907380] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T20:07:10.909623] [INFO ] [REMOTE ] MEC: Full fetch complete (22812 records). [2025-10-10T20:07:10.909726] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-10T20:07:11.303196] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-10T20:07:11.303299] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-10T20:07:11.304141] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-10T20:07:11.304208] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-10T20:07:11.304984] [DEBUG] [LOCAL ] MEC: Trimmed 22812 records to 16527 (keeping 200 days of data) [2025-10-10T20:07:11.411310] [DEBUG] [LOCAL ] MEC: Primary data saved (16527 records). [2025-10-10T20:07:11.411520] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-10T20:07:11.411626] [INFO ] [MAIN ] Update Progress: 1328/2373 symbols completed. MEC took 40.7s. Estimated remaining: 2h 27m 15s. Rate: 7.1 symbols/min [2025-10-10T20:07:11.493373] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-10T20:07:11.597316] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:07:11.645678] [DEBUG] [LOCAL ] MET: Loaded 53712 existing records from primary storage. [2025-10-10T20:07:11.646015] [INFO ] [MAIN ] MET: Loaded 53712 existing records. [2025-10-10T20:07:11.787210] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-10T20:07:11.859200] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:07:11.859439] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-10T20:07:11.859490] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-10T20:07:11.860361] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-10T20:07:11.860422] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-10T20:07:12.211167] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:07:12.289340] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-10-10T20:07:12.930474] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-10T20:07:13.089373] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-10T20:07:13.889377] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-10T20:07:14.250263] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-10T20:07:14.495246] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T20:07:14.689426] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-10T20:07:15.093058] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T20:07:15.489441] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-10T20:07:16.202504] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-10T20:07:16.289343] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-10T20:07:16.937328] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-10T20:07:17.089401] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-10T20:07:17.818126] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-10T20:07:17.889341] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-10T20:07:18.290200] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-10T20:07:18.689429] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-10T20:07:19.489347] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-10T20:07:19.532902] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T20:07:19.984397] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T20:07:20.289393] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-10T20:07:20.862883] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-10T20:07:21.089375] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-10T20:07:21.584360] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-10T20:07:21.587852] [INFO ] [REMOTE ] MEG: Full fetch complete (47485 records). [2025-10-10T20:07:21.587952] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-10T20:07:21.891617] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-10T20:07:21.972166] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-10T20:07:21.972256] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-10T20:07:21.973110] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-10T20:07:21.973173] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-10T20:07:21.974227] [DEBUG] [LOCAL ] MEG: Trimmed 47485 records to 31917 (keeping 200 days of data) [2025-10-10T20:07:22.158976] [DEBUG] [LOCAL ] MEG: Primary data saved (31917 records). [2025-10-10T20:07:22.159112] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-10T20:07:22.159198] [INFO ] [MAIN ] Update Progress: 1329/2373 symbols completed. MEG took 27.5s. Estimated remaining: 2h 27m 8s. Rate: 7.1 symbols/min [2025-10-10T20:07:22.326016] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:07:22.372755] [DEBUG] [LOCAL ] MFA: Loaded 46023 existing records from primary storage. [2025-10-10T20:07:22.373249] [INFO ] [MAIN ] MFA: Loaded 46023 existing records. [2025-10-10T20:07:22.583313] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-10T20:07:22.606849] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:07:22.613725] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-10T20:07:22.613829] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-10T20:07:22.614596] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-10T20:07:22.614878] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-10T20:07:22.694566] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-10T20:07:22.988915] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:07:23.489433] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-10T20:07:23.855936] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T20:07:23.898845] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T20:07:24.289385] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-10T20:07:24.653510] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-10T20:07:25.089365] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-10-10T20:07:25.292383] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T20:07:25.294208] [INFO ] [REMOTE ] MEGI: Full fetch complete (29656 records). [2025-10-10T20:07:25.294284] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-10T20:07:25.671484] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-10T20:07:25.671570] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-10T20:07:25.672336] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-10T20:07:25.672400] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-10T20:07:25.673250] [DEBUG] [LOCAL ] MEGI: Trimmed 29656 records to 20167 (keeping 200 days of data) [2025-10-10T20:07:25.803025] [DEBUG] [LOCAL ] MEGI: Primary data saved (20167 records). [2025-10-10T20:07:25.803155] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-10T20:07:25.803234] [INFO ] [MAIN ] Update Progress: 1330/2373 symbols completed. MEGI took 28.2s. Estimated remaining: 2h 26m 56s. Rate: 7.1 symbols/min [2025-10-10T20:07:25.898116] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-10T20:07:25.972295] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:07:25.978417] [DEBUG] [LOCAL ] MFAN: Loaded 4401 existing records from primary storage. [2025-10-10T20:07:25.978598] [INFO ] [MAIN ] MFAN: Loaded 4401 existing records. [2025-10-10T20:07:26.148013] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:07:26.148226] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-10T20:07:26.148274] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-10T20:07:26.148505] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-10T20:07:26.148562] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-10T20:07:26.496823] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:07:26.689363] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-10-10T20:07:26.925719] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T20:07:27.425542] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-10T20:07:27.467625] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-10T20:07:27.489348] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-10T20:07:28.289385] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-10T20:07:28.659513] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-10T20:07:29.089347] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-10T20:07:29.317241] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-10T20:07:29.889380] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-10T20:07:30.689349] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-10T20:07:31.013158] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T20:07:31.129661] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-10T20:07:31.350445] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-10T20:07:31.489376] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-10T20:07:32.161695] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-10T20:07:32.289412] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-10T20:07:33.089370] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-10T20:07:33.889359] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-10T20:07:34.098342] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T20:07:34.689383] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-10T20:07:34.823943] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T20:07:34.848284] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T20:07:35.489371] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-10T20:07:36.289338] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-10T20:07:36.717067] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T20:07:36.769495] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T20:07:36.981723] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-10T20:07:37.089382] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-10T20:07:37.889378] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-10T20:07:38.689374] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-10T20:07:38.752745] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T20:07:39.333866] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-10T20:07:39.425522] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-10T20:07:39.489408] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-10T20:07:40.289387] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-10T20:07:41.089409] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-10T20:07:41.267827] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T20:07:41.767247] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-10T20:07:41.864252] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-10T20:07:41.889335] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-10T20:07:42.689433] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-10T20:07:43.454402] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T20:07:43.489360] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-10T20:07:44.289429] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-10T20:07:44.736716] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-10T20:07:44.737774] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-10T20:07:44.754374] [INFO ] [REMOTE ] MEI: Full fetch complete (45488 records). [2025-10-10T20:07:44.754578] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-10T20:07:45.049327] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T20:07:45.094501] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-10T20:07:45.175589] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-10T20:07:45.175719] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-10T20:07:45.176712] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-10T20:07:45.176818] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-10T20:07:45.178065] [DEBUG] [LOCAL ] MEI: Trimmed 45488 records to 32205 (keeping 200 days of data) [2025-10-10T20:07:45.381509] [DEBUG] [LOCAL ] MEI: Primary data saved (32205 records). [2025-10-10T20:07:45.381734] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-10T20:07:45.381869] [INFO ] [MAIN ] Update Progress: 1331/2373 symbols completed. MEI took 40.7s. Estimated remaining: 2h 26m 56s. Rate: 7.1 symbols/min [2025-10-10T20:07:45.553316] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:07:45.560325] [DEBUG] [LOCAL ] MFAO: Loaded 3989 existing records from primary storage. [2025-10-10T20:07:45.560570] [INFO ] [MAIN ] MFAO: Loaded 3989 existing records. [2025-10-10T20:07:45.734823] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:07:45.735027] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-10T20:07:45.735074] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-10T20:07:45.735236] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-10T20:07:45.735291] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-10T20:07:45.911900] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-10T20:07:46.098770] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:07:46.689397] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-10T20:07:46.697750] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-10T20:07:47.186750] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-10T20:07:47.489403] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-10T20:07:48.289413] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-10T20:07:48.604865] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T20:07:48.746012] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-10T20:07:48.747371] [INFO ] [REMOTE ] MFAN: Full fetch complete (5878 records). [2025-10-10T20:07:48.747447] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-10T20:07:49.092308] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-10T20:07:49.137999] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-10T20:07:49.138124] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-10T20:07:49.138371] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-10T20:07:49.138449] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-10T20:07:49.139048] [DEBUG] [LOCAL ] MFAN: Trimmed 5878 records to 4428 (keeping 200 days of data) [2025-10-10T20:07:49.168201] [DEBUG] [LOCAL ] MFAN: Primary data saved (4428 records). [2025-10-10T20:07:49.168405] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-10T20:07:49.168520] [INFO ] [MAIN ] Update Progress: 1332/2373 symbols completed. MFAN took 23.4s. Estimated remaining: 2h 26m 44s. Rate: 7.1 symbols/min [2025-10-10T20:07:49.356150] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:07:49.389301] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T20:07:49.443040] [DEBUG] [LOCAL ] MFC: Loaded 51462 existing records from primary storage. [2025-10-10T20:07:49.443417] [INFO ] [MAIN ] MFC: Loaded 51462 existing records. [2025-10-10T20:07:49.618761] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:07:49.619051] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-10T20:07:49.619099] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-10T20:07:49.619369] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-10T20:07:49.619426] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-10T20:07:49.894532] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-10-10T20:07:49.973629] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:07:50.604064] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-10T20:07:50.689398] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-10T20:07:51.005914] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T20:07:51.344857] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-10T20:07:51.489407] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-10T20:07:52.115547] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-10T20:07:52.289373] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-10T20:07:52.833610] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-10T20:07:53.089378] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-10T20:07:53.889402] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-10T20:07:54.689390] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-10-10T20:07:54.803321] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-10T20:07:54.808899] [INFO ] [REMOTE ] MET: Full fetch complete (77114 records). [2025-10-10T20:07:54.809067] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-10T20:07:55.227617] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-10T20:07:55.227965] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-10T20:07:55.229253] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-10T20:07:55.229320] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-10T20:07:55.231282] [DEBUG] [LOCAL ] MET: Trimmed 77114 records to 54096 (keeping 200 days of data) [2025-10-10T20:07:55.489485] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-10T20:07:55.599312] [DEBUG] [LOCAL ] MET: Primary data saved (54096 records). [2025-10-10T20:07:55.599496] [INFO ] [MAIN ] MET: Full history saved. [2025-10-10T20:07:55.599594] [INFO ] [MAIN ] Update Progress: 1333/2373 symbols completed. MET took 44.2s. Estimated remaining: 2h 26m 34s. Rate: 7.1 symbols/min [2025-10-10T20:07:55.779691] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:07:55.780075] [DEBUG] [LOCAL ] MFG: No existing data file found in primary storage. [2025-10-10T20:07:55.780170] [WARN ] [MAIN ] MFG: No existing data found, performing full refresh instead. [2025-10-10T20:07:55.781683] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-10T20:07:55.781743] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-10T20:07:55.781789] [DEBUG] [LOCAL ] MFG: No primary data file found to delete. [2025-10-10T20:07:55.781823] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-10T20:07:55.952940] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-10T20:07:56.263350] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:07:56.283425] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-10T20:07:56.289328] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-10T20:07:56.482120] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T20:07:56.962269] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-10T20:07:57.089396] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-10T20:07:57.737453] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-10T20:07:57.889355] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-10T20:07:58.689423] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-10T20:07:59.489428] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-10-10T20:07:59.663972] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T20:08:00.289384] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-10T20:08:00.462544] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T20:08:01.089363] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-10T20:08:01.230325] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-10T20:08:01.889513] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-10T20:08:02.400949] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T20:08:02.657824] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T20:08:02.689405] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-10T20:08:03.489411] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-10T20:08:03.761436] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T20:08:04.289425] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-10T20:08:04.397073] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T20:08:05.089402] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-10T20:08:05.541638] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T20:08:05.739571] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-10T20:08:05.889400] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-10T20:08:05.982978] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T20:08:06.242832] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-10T20:08:06.689514] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-10T20:08:07.489431] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-10T20:08:08.289373] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-10T20:08:08.514158] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T20:08:08.826473] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-10T20:08:09.089399] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-10T20:08:09.546402] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-10T20:08:09.889391] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-10T20:08:10.689353] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-10T20:08:10.922171] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T20:08:11.161279] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T20:08:11.389889] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-10T20:08:11.391067] [INFO ] [REMOTE ] MFAO: Full fetch complete (5422 records). [2025-10-10T20:08:11.391139] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-10T20:08:11.494574] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-10T20:08:11.791542] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-10T20:08:11.791620] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-10T20:08:11.791829] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-10T20:08:11.791882] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-10T20:08:11.792236] [DEBUG] [LOCAL ] MFAO: Trimmed 5422 records to 4008 (keeping 200 days of data) [2025-10-10T20:08:11.817872] [DEBUG] [LOCAL ] MFAO: Primary data saved (4008 records). [2025-10-10T20:08:11.817984] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-10T20:08:11.818063] [INFO ] [MAIN ] Update Progress: 1334/2373 symbols completed. MFAO took 26.4s. Estimated remaining: 2h 26m 32s. Rate: 7.1 symbols/min [2025-10-10T20:08:11.980342] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:08:11.995748] [DEBUG] [LOCAL ] MFM: Loaded 14939 existing records from primary storage. [2025-10-10T20:08:11.995980] [INFO ] [MAIN ] MFM: Loaded 14939 existing records. [2025-10-10T20:08:12.169128] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:08:12.169332] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-10T20:08:12.169379] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-10T20:08:12.169600] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-10T20:08:12.169692] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-10T20:08:12.302776] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-10T20:08:12.528257] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:08:13.089363] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-10T20:08:13.467282] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T20:08:13.708889] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-10T20:08:13.889367] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-10T20:08:14.472843] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T20:08:14.477507] [INFO ] [REMOTE ] MFA: Full fetch complete (65334 records). [2025-10-10T20:08:14.477606] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-10T20:08:14.694599] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-10T20:08:14.853811] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-10T20:08:14.853885] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-10T20:08:14.854794] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-10T20:08:14.854857] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-10T20:08:14.856072] [DEBUG] [LOCAL ] MFA: Trimmed 65334 records to 46366 (keeping 200 days of data) [2025-10-10T20:08:15.123107] [DEBUG] [LOCAL ] MFA: Primary data saved (46366 records). [2025-10-10T20:08:15.123226] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-10T20:08:15.123347] [INFO ] [MAIN ] Update Progress: 1335/2373 symbols completed. MFA took 53.0s. Estimated remaining: 2h 26m 19s. Rate: 7.1 symbols/min [2025-10-10T20:08:15.289216] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:08:15.289353] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-10T20:08:15.289388] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-10T20:08:15.289498] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-10T20:08:15.289538] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-10T20:08:15.289576] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-10T20:08:15.289608] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-10T20:08:15.494557] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-10-10T20:08:15.640753] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:08:15.676945] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T20:08:16.289338] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-10-10T20:08:16.524155] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T20:08:16.623208] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-10T20:08:16.631464] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-10T20:08:17.089429] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-10T20:08:17.889342] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-10T20:08:17.932755] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-10T20:08:18.150958] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-10T20:08:18.689398] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-10T20:08:18.945346] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-10T20:08:19.489363] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-10T20:08:19.852049] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-10T20:08:20.289338] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-10T20:08:21.089386] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-10T20:08:21.277908] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-10T20:08:21.889372] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-10T20:08:22.689406] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-10T20:08:22.820064] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-10T20:08:22.985792] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T20:08:23.083266] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-10T20:08:23.489397] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-10T20:08:23.751594] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-10T20:08:24.289393] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-10T20:08:24.670630] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-10T20:08:25.089389] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-10T20:08:25.889392] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-10T20:08:26.299924] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-10T20:08:26.689424] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-10T20:08:27.078106] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T20:08:27.489418] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-10T20:08:27.962258] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-10T20:08:28.038953] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-10T20:08:28.289371] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-10T20:08:29.089372] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-10T20:08:29.261565] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-10T20:08:29.758666] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-10T20:08:29.889384] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-10T20:08:30.689384] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-10T20:08:30.975399] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T20:08:31.179399] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-10T20:08:31.180319] [INFO ] [REMOTE ] MFSB: Full fetch complete (1760 records). [2025-10-10T20:08:31.180385] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-10T20:08:31.370553] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-10T20:08:31.370819] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:08:31.370923] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:08:31.371016] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-10T20:08:31.371095] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-10T20:08:31.371149] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-10T20:08:31.371232] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-10T20:08:31.371331] [INFO ] [MAIN ] Update Progress: 1336/2373 symbols completed. MFSB took 16.2s. Estimated remaining: 2h 26m 17s. Rate: 7.1 symbols/min [2025-10-10T20:08:31.494476] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-10T20:08:31.540895] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:08:31.549100] [DEBUG] [LOCAL ] MFSG: Loaded 5647 existing records from primary storage. [2025-10-10T20:08:31.549358] [INFO ] [MAIN ] MFSG: Loaded 5647 existing records. [2025-10-10T20:08:31.726669] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:08:31.726883] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-10T20:08:31.726936] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-10T20:08:31.727156] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-10T20:08:31.727233] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-10T20:08:32.072532] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:08:32.289366] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-10-10T20:08:32.869807] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-10T20:08:33.089374] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-10T20:08:33.397699] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-10T20:08:33.445507] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-10T20:08:33.889387] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-10T20:08:34.689436] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-10T20:08:35.489388] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-10T20:08:35.789325] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T20:08:36.289414] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-10T20:08:36.633033] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-10T20:08:36.636463] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-10T20:08:37.089377] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-10T20:08:37.889373] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-10T20:08:37.986930] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-10T20:08:37.992048] [INFO ] [REMOTE ] MFG: Full fetch complete (69274 records). [2025-10-10T20:08:37.992187] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-10T20:08:38.395956] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-10T20:08:38.396070] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-10T20:08:38.397664] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-10T20:08:38.397746] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-10T20:08:38.399717] [DEBUG] [LOCAL ] MFG: Trimmed 69274 records to 50100 (keeping 200 days of data) [2025-10-10T20:08:38.695726] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-10T20:08:38.718418] [DEBUG] [LOCAL ] MFG: Primary data saved (50100 records). [2025-10-10T20:08:38.718736] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-10T20:08:38.718865] [INFO ] [MAIN ] Update Progress: 1337/2373 symbols completed. MFG took 43.1s. Estimated remaining: 2h 26m 7s. Rate: 7.1 symbols/min [2025-10-10T20:08:38.913992] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:08:38.916131] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-10T20:08:38.931918] [DEBUG] [LOCAL ] MFSI: Loaded 11854 existing records from primary storage. [2025-10-10T20:08:38.932374] [INFO ] [MAIN ] MFSI: Loaded 11854 existing records. [2025-10-10T20:08:39.033781] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-10T20:08:39.151123] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-10T20:08:39.183251] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:08:39.183721] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-10T20:08:39.183895] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-10T20:08:39.184088] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-10T20:08:39.184129] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-10T20:08:39.494471] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-10T20:08:39.568892] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:08:40.289405] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-10-10T20:08:40.531707] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-10T20:08:40.687088] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-10T20:08:41.089400] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-10T20:08:41.606814] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-10T20:08:41.889403] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-10T20:08:42.588709] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-10T20:08:42.689393] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-10T20:08:43.489421] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-10T20:08:43.832128] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T20:08:43.834483] [INFO ] [REMOTE ] MFM: Full fetch complete (19586 records). [2025-10-10T20:08:43.834585] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-10T20:08:44.240726] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-10T20:08:44.240885] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-10T20:08:44.241958] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-10T20:08:44.242028] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-10T20:08:44.242952] [DEBUG] [LOCAL ] MFM: Trimmed 19586 records to 14970 (keeping 200 days of data) [2025-10-10T20:08:44.309693] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-10T20:08:44.330696] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-10T20:08:44.352396] [DEBUG] [LOCAL ] MFM: Primary data saved (14970 records). [2025-10-10T20:08:44.353090] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-10T20:08:44.353210] [INFO ] [MAIN ] Update Progress: 1338/2373 symbols completed. MFM took 32.5s. Estimated remaining: 2h 25m 57s. Rate: 7.1 symbols/min [2025-10-10T20:08:44.533042] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:08:44.539176] [DEBUG] [LOCAL ] MFSV: Loaded 2715 existing records from primary storage. [2025-10-10T20:08:44.539437] [INFO ] [MAIN ] MFSV: Loaded 2715 existing records. [2025-10-10T20:08:44.731665] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:08:44.732054] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-10T20:08:44.732143] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-10T20:08:44.732364] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-10T20:08:44.732439] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-10T20:08:45.096180] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-10T20:08:45.103251] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:08:45.749713] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-10T20:08:45.889385] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-10T20:08:46.570539] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-10T20:08:46.689429] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-10T20:08:46.926182] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-10T20:08:46.931766] [INFO ] [REMOTE ] MFC: Full fetch complete (74123 records). [2025-10-10T20:08:46.931934] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-10T20:08:47.349694] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-10T20:08:47.349807] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-10T20:08:47.351357] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-10T20:08:47.351429] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-10T20:08:47.354920] [DEBUG] [LOCAL ] MFC: Trimmed 74123 records to 51842 (keeping 200 days of data) [2025-10-10T20:08:47.456095] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-10T20:08:47.489691] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-10T20:08:47.709346] [DEBUG] [LOCAL ] MFC: Primary data saved (51842 records). [2025-10-10T20:08:47.709537] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-10T20:08:47.709661] [INFO ] [MAIN ] Update Progress: 1339/2373 symbols completed. MFC took 58.5s. Estimated remaining: 2h 25m 44s. Rate: 7.1 symbols/min [2025-10-10T20:08:47.882705] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:08:47.900839] [DEBUG] [LOCAL ] MG: Loaded 16256 existing records from primary storage. [2025-10-10T20:08:47.901148] [INFO ] [MAIN ] MG: Loaded 16256 existing records. [2025-10-10T20:08:48.084891] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:08:48.085175] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-10T20:08:48.085228] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-10T20:08:48.085757] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-10T20:08:48.085817] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-10T20:08:48.294556] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-10-10T20:08:48.348748] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-10T20:08:48.475294] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:08:48.735596] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-10T20:08:49.089380] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-10-10T20:08:49.889383] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-10T20:08:50.324154] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-10T20:08:50.599557] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-10T20:08:50.689407] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-10T20:08:51.489403] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-10T20:08:51.592278] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-10T20:08:52.289402] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-10T20:08:52.666398] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-10T20:08:53.089408] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-10T20:08:53.120399] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-10T20:08:53.889370] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-10T20:08:54.032495] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-10T20:08:54.689385] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-10T20:08:54.737843] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-10T20:08:55.489364] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-10T20:08:55.840094] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T20:08:56.289396] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-10T20:08:56.399355] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-10T20:08:57.089393] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-10T20:08:57.120851] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T20:08:57.122207] [INFO ] [REMOTE ] MFSG: Full fetch complete (6418 records). [2025-10-10T20:08:57.122275] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-10T20:08:57.472862] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-10T20:08:57.472956] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-10T20:08:57.473131] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-10T20:08:57.473169] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-10T20:08:57.473633] [DEBUG] [LOCAL ] MFSG: Trimmed 6418 records to 5694 (keeping 200 days of data) [2025-10-10T20:08:57.507281] [DEBUG] [LOCAL ] MFSG: Primary data saved (5694 records). [2025-10-10T20:08:57.507412] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-10T20:08:57.507495] [INFO ] [MAIN ] Update Progress: 1340/2373 symbols completed. MFSG took 26.1s. Estimated remaining: 2h 25m 37s. Rate: 7.1 symbols/min [2025-10-10T20:08:57.675529] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:08:57.722975] [DEBUG] [LOCAL ] MGA: Loaded 51027 existing records from primary storage. [2025-10-10T20:08:57.723318] [INFO ] [MAIN ] MGA: Loaded 51027 existing records. [2025-10-10T20:08:57.890694] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-10T20:08:57.905144] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:08:57.905469] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-10T20:08:57.905518] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-10T20:08:57.906594] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-10T20:08:57.906680] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-10T20:08:58.059562] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-10T20:08:58.290715] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:08:58.333234] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-10T20:08:58.689412] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-10T20:08:59.489444] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-10T20:08:59.896716] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T20:09:00.289404] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-10-10T20:09:00.563574] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-10T20:09:01.089374] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-10T20:09:01.593973] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-10T20:09:01.889434] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-10T20:09:02.333688] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-10T20:09:02.689413] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-10T20:09:03.320203] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-10T20:09:03.489457] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-10T20:09:03.611384] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-10T20:09:04.289424] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-10T20:09:05.089408] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-10T20:09:05.463780] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T20:09:05.480119] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-10T20:09:05.493880] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-10T20:09:05.889411] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-10T20:09:06.497275] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-10T20:09:06.689498] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-10T20:09:07.489464] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-10T20:09:08.289404] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-10T20:09:08.620447] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-10T20:09:08.627947] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-10T20:09:08.783060] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-10T20:09:09.089396] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-10T20:09:09.889397] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-10T20:09:10.689389] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-10T20:09:11.052002] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-10T20:09:11.058504] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T20:09:11.189307] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-10T20:09:11.489398] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-10T20:09:12.289371] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-10T20:09:12.671715] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T20:09:13.089398] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-10T20:09:13.889387] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-10T20:09:14.228554] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T20:09:14.230594] [INFO ] [REMOTE ] MG: Full fetch complete (23699 records). [2025-10-10T20:09:14.230858] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-10T20:09:14.557527] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-10T20:09:14.615034] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-10T20:09:14.694664] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-10T20:09:14.707570] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-10T20:09:14.707732] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-10T20:09:14.708479] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-10T20:09:14.708528] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-10T20:09:14.709779] [DEBUG] [LOCAL ] MG: Trimmed 23699 records to 16369 (keeping 200 days of data) [2025-10-10T20:09:14.819446] [DEBUG] [LOCAL ] MG: Primary data saved (16369 records). [2025-10-10T20:09:14.819614] [INFO ] [MAIN ] MG: Full history saved. [2025-10-10T20:09:14.819736] [INFO ] [MAIN ] Update Progress: 1341/2373 symbols completed. MG took 27.1s. Estimated remaining: 2h 25m 35s. Rate: 7.1 symbols/min [2025-10-10T20:09:14.990580] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:09:14.996505] [DEBUG] [LOCAL ] MGF: Loaded 4311 existing records from primary storage. [2025-10-10T20:09:14.996714] [INFO ] [MAIN ] MGF: Loaded 4311 existing records. [2025-10-10T20:09:15.176145] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:09:15.176368] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-10T20:09:15.176417] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-10T20:09:15.176758] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-10T20:09:15.176819] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-10T20:09:15.494750] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-10T20:09:15.537463] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:09:16.289421] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-10-10T20:09:16.645336] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T20:09:16.779156] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T20:09:17.038188] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-10T20:09:17.089365] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-10T20:09:17.889421] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-10T20:09:18.590802] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-10T20:09:18.689390] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-10T20:09:18.980825] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T20:09:19.476309] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-10T20:09:19.489389] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-10T20:09:20.289407] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-10T20:09:21.023603] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T20:09:21.024620] [INFO ] [REMOTE ] MFSV: Full fetch complete (3407 records). [2025-10-10T20:09:21.024711] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-10T20:09:21.094227] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-10T20:09:21.391105] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-10T20:09:21.391205] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-10T20:09:21.391413] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-10T20:09:21.391528] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-10T20:09:21.392099] [DEBUG] [LOCAL ] MFSV: Trimmed 3407 records to 2755 (keeping 200 days of data) [2025-10-10T20:09:21.409499] [DEBUG] [LOCAL ] MFSV: Primary data saved (2755 records). [2025-10-10T20:09:21.409605] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-10T20:09:21.409838] [INFO ] [MAIN ] Update Progress: 1342/2373 symbols completed. MFSV took 37.1s. Estimated remaining: 2h 25m 25s. Rate: 7.1 symbols/min [2025-10-10T20:09:21.550529] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-10T20:09:21.632610] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:09:21.680976] [DEBUG] [LOCAL ] MGM: Loaded 53997 existing records from primary storage. [2025-10-10T20:09:21.681341] [INFO ] [MAIN ] MGM: Loaded 53997 existing records. [2025-10-10T20:09:21.856133] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:09:21.856786] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-10T20:09:21.856857] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-10T20:09:21.858083] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-10T20:09:21.858143] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-10T20:09:21.894491] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-10T20:09:22.250108] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:09:22.295921] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T20:09:22.297925] [INFO ] [REMOTE ] MFSI: Full fetch complete (14259 records). [2025-10-10T20:09:22.297998] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-10T20:09:22.655065] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-10T20:09:22.655138] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-10T20:09:22.655497] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-10T20:09:22.655536] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-10T20:09:22.656046] [DEBUG] [LOCAL ] MFSI: Trimmed 14259 records to 11975 (keeping 200 days of data) [2025-10-10T20:09:22.690795] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-10T20:09:22.730264] [DEBUG] [LOCAL ] MFSI: Primary data saved (11975 records). [2025-10-10T20:09:22.730363] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-10T20:09:22.730443] [INFO ] [MAIN ] Update Progress: 1343/2373 symbols completed. MFSI took 44.0s. Estimated remaining: 2h 25m 11s. Rate: 7.1 symbols/min [2025-10-10T20:09:22.898726] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:09:22.905453] [DEBUG] [LOCAL ] MGR: Loaded 5676 existing records from primary storage. [2025-10-10T20:09:22.905684] [INFO ] [MAIN ] MGR: Loaded 5676 existing records. [2025-10-10T20:09:23.079106] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:09:23.079310] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-10T20:09:23.079357] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-10T20:09:23.079582] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-10T20:09:23.079639] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-10T20:09:23.432164] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:09:23.489369] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-10-10T20:09:23.662855] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T20:09:23.814532] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T20:09:24.289387] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-10-10T20:09:24.370768] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-10T20:09:25.089420] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-10T20:09:25.889382] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-10T20:09:26.339760] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T20:09:26.559082] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-10T20:09:26.689414] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-10T20:09:27.270060] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-10T20:09:27.416180] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-10T20:09:27.489397] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-10T20:09:28.289387] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-10T20:09:28.975693] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-10T20:09:29.089332] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-10T20:09:29.531496] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T20:09:29.808215] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-10T20:09:29.889375] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-10T20:09:30.541614] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-10T20:09:30.689377] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-10T20:09:31.434712] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-10T20:09:31.489397] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-10T20:09:32.194568] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-10T20:09:32.289352] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-10T20:09:32.966788] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-10T20:09:33.089364] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-10T20:09:33.889378] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-10T20:09:34.689418] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-10T20:09:35.025560] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-10T20:09:35.030396] [INFO ] [REMOTE ] MGA: Full fetch complete (73668 records). [2025-10-10T20:09:35.030541] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-10T20:09:35.210495] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-10T20:09:35.429195] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-10T20:09:35.429275] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-10T20:09:35.430278] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-10T20:09:35.430343] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-10T20:09:35.431762] [DEBUG] [LOCAL ] MGA: Trimmed 73668 records to 51404 (keeping 200 days of data) [2025-10-10T20:09:35.492702] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-10T20:09:35.746152] [DEBUG] [LOCAL ] MGA: Primary data saved (51404 records). [2025-10-10T20:09:35.746316] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-10T20:09:35.746461] [INFO ] [MAIN ] Update Progress: 1344/2373 symbols completed. MGA took 38.2s. Estimated remaining: 2h 25m 6s. Rate: 7.1 symbols/min [2025-10-10T20:09:35.931604] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:09:35.945957] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-10T20:09:35.960823] [DEBUG] [LOCAL ] MGRB: Loaded 4084 existing records from primary storage. [2025-10-10T20:09:35.961027] [INFO ] [MAIN ] MGRB: Loaded 4084 existing records. [2025-10-10T20:09:36.135102] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:09:36.135332] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-10T20:09:36.135379] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-10T20:09:36.135696] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-10T20:09:36.135754] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-10T20:09:36.305364] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-10T20:09:36.388326] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-10T20:09:36.503884] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:09:37.089383] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-10T20:09:37.788046] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-10T20:09:37.889379] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-10T20:09:38.338019] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T20:09:38.591888] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-10T20:09:38.689395] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-10-10T20:09:39.489368] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-10T20:09:39.542329] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-10T20:09:40.023507] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-10T20:09:40.289362] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-10T20:09:41.007319] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-10T20:09:41.089426] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-10T20:09:41.889371] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-10T20:09:41.969100] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-10T20:09:42.650672] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-10T20:09:42.689370] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-10T20:09:43.349301] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-10T20:09:43.489415] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-10T20:09:44.176280] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-10T20:09:44.289388] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-10T20:09:45.007408] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-10T20:09:45.089394] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-10T20:09:45.889395] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-10T20:09:46.689432] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-10T20:09:46.758037] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T20:09:46.759256] [INFO ] [REMOTE ] MGF: Full fetch complete (5877 records). [2025-10-10T20:09:46.759375] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-10T20:09:47.132463] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-10T20:09:47.132696] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-10T20:09:47.133134] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-10T20:09:47.133311] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-10T20:09:47.134002] [DEBUG] [LOCAL ] MGF: Trimmed 5877 records to 4333 (keeping 200 days of data) [2025-10-10T20:09:47.161942] [DEBUG] [LOCAL ] MGF: Primary data saved (4333 records). [2025-10-10T20:09:47.162226] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-10T20:09:47.162378] [INFO ] [MAIN ] Update Progress: 1345/2373 symbols completed. MGF took 32.3s. Estimated remaining: 2h 25m 0s. Rate: 7.1 symbols/min [2025-10-10T20:09:47.319811] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-10T20:09:47.402483] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:09:47.403430] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T20:09:47.405239] [INFO ] [REMOTE ] MGR: Full fetch complete (8001 records). [2025-10-10T20:09:47.405497] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-10T20:09:47.490099] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-10T20:09:47.507073] [DEBUG] [LOCAL ] MGRD: Loaded 2259 existing records from primary storage. [2025-10-10T20:09:47.515890] [INFO ] [MAIN ] MGRD: Loaded 2259 existing records. [2025-10-10T20:09:47.947886] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:09:47.958589] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-10T20:09:47.969000] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-10T20:09:47.992087] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-10T20:09:48.001681] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-10T20:09:48.089590] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-10T20:09:48.118474] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-10T20:09:48.141242] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-10T20:09:48.141412] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-10T20:09:48.166681] [DEBUG] [LOCAL ] MGR: Trimmed 8001 records to 5704 (keeping 200 days of data) [2025-10-10T20:09:48.290605] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-10T20:09:48.376347] [DEBUG] [LOCAL ] MGR: Primary data saved (5704 records). [2025-10-10T20:09:48.380048] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-10T20:09:48.380319] [INFO ] [MAIN ] Update Progress: 1346/2373 symbols completed. MGR took 25.6s. Estimated remaining: 2h 24m 46s. Rate: 7.1 symbols/min [2025-10-10T20:09:48.576300] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:09:48.650876] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:09:48.660673] [DEBUG] [LOCAL ] MGRE: Loaded 6738 existing records from primary storage. [2025-10-10T20:09:48.660981] [INFO ] [MAIN ] MGRE: Loaded 6738 existing records. [2025-10-10T20:09:48.845179] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:09:48.845521] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-10T20:09:48.845577] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-10T20:09:48.845936] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-10T20:09:48.845998] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-10T20:09:48.957586] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-10T20:09:49.100126] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-10T20:09:49.232379] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:09:49.674190] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-10T20:09:49.889373] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-10-10T20:09:49.934623] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-10T20:09:50.616147] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-10T20:09:50.689431] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-10-10T20:09:51.367389] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-10T20:09:51.489400] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-10T20:09:52.046146] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-10T20:09:52.289401] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-10T20:09:53.083183] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-10T20:09:53.089323] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-10T20:09:53.829985] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-10T20:09:53.889387] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-10T20:09:54.617319] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-10T20:09:54.689408] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-10T20:09:55.324694] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-10T20:09:55.489364] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-10T20:09:56.207302] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-10T20:09:56.289363] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-10T20:09:56.856468] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-10T20:09:57.089364] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-10T20:09:57.513400] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-10T20:09:57.889437] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-10T20:09:58.609392] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-10T20:09:58.689438] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-10T20:09:59.489372] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-10T20:09:59.513971] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-10T20:09:59.989107] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-10T20:09:59.989950] [INFO ] [REMOTE ] MGRB: Full fetch complete (5804 records). [2025-10-10T20:09:59.990018] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-10T20:10:00.300150] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-10T20:10:00.343631] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-10T20:10:00.343726] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-10T20:10:00.343923] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-10T20:10:00.343968] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-10T20:10:00.344319] [DEBUG] [LOCAL ] MGRB: Trimmed 5804 records to 4095 (keeping 200 days of data) [2025-10-10T20:10:00.369555] [DEBUG] [LOCAL ] MGRB: Primary data saved (4095 records). [2025-10-10T20:10:00.369676] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-10T20:10:00.369803] [INFO ] [MAIN ] Update Progress: 1347/2373 symbols completed. MGRB took 24.6s. Estimated remaining: 2h 24m 41s. Rate: 7.1 symbols/min [2025-10-10T20:10:00.533912] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:10:00.580865] [DEBUG] [LOCAL ] MGY: Loaded 52781 existing records from primary storage. [2025-10-10T20:10:00.581203] [INFO ] [MAIN ] MGY: Loaded 52781 existing records. [2025-10-10T20:10:00.752010] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:10:00.752227] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-10T20:10:00.752273] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-10T20:10:00.753623] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-10T20:10:00.753713] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-10T20:10:01.095493] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-10T20:10:01.100212] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:10:01.808823] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T20:10:01.889353] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-10T20:10:02.275088] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-10T20:10:02.591199] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-10T20:10:02.689393] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-10-10T20:10:03.489415] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-10T20:10:04.023633] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-10T20:10:04.289430] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-10T20:10:04.572059] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T20:10:05.089354] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-10T20:10:05.149494] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-10T20:10:05.889400] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-10T20:10:06.689384] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-10T20:10:07.148396] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-10T20:10:07.376755] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-10T20:10:07.489365] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-10T20:10:08.128346] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-10T20:10:08.289418] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-10T20:10:08.419004] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-10T20:10:09.089366] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-10T20:10:09.152389] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-10T20:10:09.889401] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-10T20:10:10.689450] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-10T20:10:10.929449] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-10T20:10:10.962001] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-10T20:10:11.489423] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-10T20:10:12.063637] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-10T20:10:12.100346] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T20:10:12.289409] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-10T20:10:12.790842] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-10T20:10:13.089371] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-10T20:10:13.611262] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-10T20:10:13.889388] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-10T20:10:14.422482] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-10T20:10:14.689404] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-10T20:10:15.489426] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-10T20:10:16.289445] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-10T20:10:16.459989] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-10T20:10:16.797092] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-10T20:10:17.089544] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-10T20:10:17.782321] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T20:10:17.783566] [INFO ] [REMOTE ] MGRE: Full fetch complete (9397 records). [2025-10-10T20:10:17.783664] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-10T20:10:17.894581] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-10T20:10:18.225999] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-10T20:10:18.226105] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-10T20:10:18.226669] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-10T20:10:18.226737] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-10T20:10:18.227304] [DEBUG] [LOCAL ] MGRE: Trimmed 9397 records to 6773 (keeping 200 days of data) [2025-10-10T20:10:18.272430] [DEBUG] [LOCAL ] MGRE: Primary data saved (6773 records). [2025-10-10T20:10:18.272612] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-10T20:10:18.272748] [INFO ] [MAIN ] Update Progress: 1348/2373 symbols completed. MGRE took 29.9s. Estimated remaining: 2h 24m 39s. Rate: 7.1 symbols/min [2025-10-10T20:10:18.452693] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:10:18.453038] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-10T20:10:18.453111] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-10T20:10:18.453312] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-10T20:10:18.453463] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-10T20:10:18.453538] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-10T20:10:18.453751] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-10T20:10:18.539500] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-10T20:10:18.564692] [INFO ] [REMOTE ] MGRD: Full fetch complete (3515 records). [2025-10-10T20:10:18.565037] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-10T20:10:18.695175] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-10T20:10:18.899244] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-10T20:10:19.202664] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:10:19.312086] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-10T20:10:19.312183] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-10T20:10:19.312326] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-10T20:10:19.312401] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-10T20:10:19.312798] [DEBUG] [LOCAL ] MGRD: Trimmed 3515 records to 2282 (keeping 200 days of data) [2025-10-10T20:10:19.326865] [DEBUG] [LOCAL ] MGRD: Primary data saved (2282 records). [2025-10-10T20:10:19.326923] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-10T20:10:19.327028] [INFO ] [MAIN ] Update Progress: 1349/2373 symbols completed. MGRD took 32.2s. Estimated remaining: 2h 24m 25s. Rate: 7.1 symbols/min [2025-10-10T20:10:19.495952] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:10:19.494338] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-10-10T20:10:19.512236] [DEBUG] [LOCAL ] MHD: Loaded 12533 existing records from primary storage. [2025-10-10T20:10:19.512502] [INFO ] [MAIN ] MHD: Loaded 12533 existing records. [2025-10-10T20:10:19.690198] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:10:19.690514] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-10T20:10:19.690572] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-10T20:10:19.691122] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-10T20:10:19.691185] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-10T20:10:19.765875] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:10:19.787502] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-10-10T20:10:19.797781] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:10:19.797964] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-10T20:10:19.803764] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:10:19.814159] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-10T20:10:19.842299] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-10T20:10:19.848286] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-10T20:10:19.874210] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-10T20:10:19.951969] [INFO ] [MAIN ] Update Progress: 1350/2373 symbols completed. MH took 1.7s. Estimated remaining: 2h 24m 11s. Rate: 7.1 symbols/min [2025-10-10T20:10:20.191281] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:10:20.258273] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:10:20.268635] [DEBUG] [LOCAL ] MHF: Loaded 8854 existing records from primary storage. [2025-10-10T20:10:20.268924] [INFO ] [MAIN ] MHF: Loaded 8854 existing records. [2025-10-10T20:10:20.296212] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-10T20:10:20.463471] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:10:20.463798] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-10T20:10:20.463851] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-10T20:10:20.464480] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-10T20:10:20.464537] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-10T20:10:20.849250] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:10:20.888630] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-10T20:10:21.089386] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-10-10T20:10:21.889374] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-10-10T20:10:21.996879] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-10T20:10:22.348047] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-10T20:10:22.353228] [INFO ] [REMOTE ] MGM: Full fetch complete (77604 records). [2025-10-10T20:10:22.353400] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-10T20:10:22.694181] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-10T20:10:22.743933] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-10T20:10:22.744034] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-10T20:10:22.745099] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-10T20:10:22.745170] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-10T20:10:22.746734] [DEBUG] [LOCAL ] MGM: Trimmed 77604 records to 54387 (keeping 200 days of data) [2025-10-10T20:10:23.057086] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-10T20:10:23.085720] [DEBUG] [LOCAL ] MGM: Primary data saved (54387 records). [2025-10-10T20:10:23.085865] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-10T20:10:23.085996] [INFO ] [MAIN ] Update Progress: 1351/2373 symbols completed. MGM took 1m 2s. Estimated remaining: 2h 23m 58s. Rate: 7.1 symbols/min [2025-10-10T20:10:23.251696] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:10:23.290735] [DEBUG] [LOCAL ] MHK: Loaded 42490 existing records from primary storage. [2025-10-10T20:10:23.291059] [INFO ] [MAIN ] MHK: Loaded 42490 existing records. [2025-10-10T20:10:23.468491] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:10:23.468777] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-10T20:10:23.468827] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-10T20:10:23.469489] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-10T20:10:23.469546] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-10T20:10:23.499691] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-10T20:10:23.760425] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-10T20:10:23.838516] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:10:24.289370] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-10T20:10:25.089364] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-10T20:10:25.190780] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T20:10:25.516632] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-10T20:10:25.889391] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-10-10T20:10:26.237462] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-10T20:10:26.689386] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-10T20:10:27.489362] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-10T20:10:27.603494] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T20:10:28.289429] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-10T20:10:28.575406] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T20:10:28.620471] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-10T20:10:29.089397] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-10T20:10:29.889391] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-10T20:10:30.054684] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T20:10:30.689353] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-10T20:10:30.926060] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-10T20:10:30.992488] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-10T20:10:31.489383] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-10T20:10:32.289347] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-10T20:10:32.373874] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-10T20:10:32.399384] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T20:10:33.089436] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-10T20:10:33.889404] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-10T20:10:34.179373] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T20:10:34.286457] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-10T20:10:34.689378] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-10T20:10:35.071846] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-10T20:10:35.489440] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-10T20:10:35.583895] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-10T20:10:36.289361] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-10T20:10:36.415349] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-10T20:10:37.076505] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-10T20:10:37.089325] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-10T20:10:37.889352] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-10T20:10:38.022615] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-10T20:10:38.689396] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-10T20:10:39.489388] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-10T20:10:39.629690] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-10T20:10:39.817040] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T20:10:40.289340] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-10T20:10:40.397711] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-10T20:10:41.089401] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-10T20:10:41.236667] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-10T20:10:41.889359] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-10T20:10:41.979804] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-10T20:10:42.689395] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-10T20:10:43.489458] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-10T20:10:43.748736] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T20:10:43.753618] [INFO ] [REMOTE ] MGY: Full fetch complete (75733 records). [2025-10-10T20:10:43.753771] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-10T20:10:44.079957] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-10T20:10:44.163848] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-10T20:10:44.164000] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-10T20:10:44.165063] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-10T20:10:44.165173] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-10T20:10:44.166559] [DEBUG] [LOCAL ] MGY: Trimmed 75733 records to 53170 (keeping 200 days of data) [2025-10-10T20:10:44.347512] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-10T20:10:44.510963] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T20:10:44.532594] [DEBUG] [LOCAL ] MGY: Primary data saved (53170 records). [2025-10-10T20:10:44.532755] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-10T20:10:44.532847] [INFO ] [MAIN ] Update Progress: 1352/2373 symbols completed. MGY took 44.2s. Estimated remaining: 2h 23m 60s. Rate: 7.1 symbols/min [2025-10-10T20:10:44.697768] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:10:44.697912] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-10T20:10:44.697993] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-10T20:10:44.698070] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-10T20:10:44.698107] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-10T20:10:44.698147] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-10T20:10:44.698178] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-10T20:10:45.041231] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:10:45.089331] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-10-10T20:10:45.503362] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-10T20:10:45.511123] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-10T20:10:45.889392] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-10T20:10:46.689409] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-10T20:10:46.845047] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-10T20:10:47.489357] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-10T20:10:48.289430] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-10T20:10:48.469022] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-10T20:10:48.494186] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T20:10:48.496033] [INFO ] [REMOTE ] MHD: Full fetch complete (18448 records). [2025-10-10T20:10:48.496114] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-10T20:10:48.776083] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-10T20:10:48.868320] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-10T20:10:48.868431] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-10T20:10:48.868941] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-10T20:10:48.869004] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-10T20:10:48.869543] [DEBUG] [LOCAL ] MHD: Trimmed 18448 records to 12585 (keeping 200 days of data) [2025-10-10T20:10:48.945686] [DEBUG] [LOCAL ] MHD: Primary data saved (12585 records). [2025-10-10T20:10:48.945844] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-10T20:10:48.945943] [INFO ] [MAIN ] Update Progress: 1353/2373 symbols completed. MHD took 29.6s. Estimated remaining: 2h 23m 48s. Rate: 7.1 symbols/min [2025-10-10T20:10:49.089572] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-10T20:10:49.112485] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:10:49.123111] [DEBUG] [LOCAL ] MHN: Loaded 7623 existing records from primary storage. [2025-10-10T20:10:49.123366] [INFO ] [MAIN ] MHN: Loaded 7623 existing records. [2025-10-10T20:10:49.298079] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:10:49.298376] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-10T20:10:49.298432] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-10T20:10:49.298902] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-10T20:10:49.298959] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-10T20:10:49.649721] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:10:49.889384] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-10T20:10:50.275310] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-10T20:10:50.689372] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-10-10T20:10:50.895867] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-10T20:10:51.203169] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-10T20:10:51.489382] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-10T20:10:52.289371] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-10T20:10:52.393747] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-10T20:10:52.801515] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-10T20:10:53.089401] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-10T20:10:53.599460] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-10T20:10:53.889372] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-10T20:10:54.689473] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-10T20:10:54.859712] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T20:10:55.375456] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T20:10:55.377108] [INFO ] [REMOTE ] MHF: Full fetch complete (12741 records). [2025-10-10T20:10:55.377183] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-10T20:10:55.494572] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-10T20:10:55.763180] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-10T20:10:55.763280] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-10T20:10:55.763631] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-10T20:10:55.763710] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-10T20:10:55.764222] [DEBUG] [LOCAL ] MHF: Trimmed 12741 records to 8952 (keeping 200 days of data) [2025-10-10T20:10:55.819913] [DEBUG] [LOCAL ] MHF: Primary data saved (8952 records). [2025-10-10T20:10:55.820074] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-10T20:10:55.820156] [INFO ] [MAIN ] Update Progress: 1354/2373 symbols completed. MHF took 35.8s. Estimated remaining: 2h 23m 38s. Rate: 7.1 symbols/min [2025-10-10T20:10:56.026362] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:10:56.050279] [DEBUG] [LOCAL ] MHO: Loaded 23931 existing records from primary storage. [2025-10-10T20:10:56.050569] [INFO ] [MAIN ] MHO: Loaded 23931 existing records. [2025-10-10T20:10:56.245447] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:10:56.245740] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-10T20:10:56.245813] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-10T20:10:56.246483] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-10T20:10:56.246573] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-10T20:10:56.294784] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-10T20:10:56.508439] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-10T20:10:56.622195] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:10:57.089442] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-10T20:10:57.889417] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-10T20:10:58.090024] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-10T20:10:58.121409] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T20:10:58.438840] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-10T20:10:58.689375] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-10T20:10:59.063706] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-10T20:10:59.489366] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-10T20:11:00.289729] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-10T20:11:01.089387] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-10T20:11:01.123686] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-10T20:11:01.229111] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T20:11:01.342695] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-10T20:11:01.889402] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-10T20:11:02.689384] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-10T20:11:02.708799] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-10T20:11:03.489393] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-10-10T20:11:04.289460] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-10T20:11:04.428882] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-10T20:11:04.756277] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-10T20:11:05.015030] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-10T20:11:05.089397] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-10T20:11:05.889437] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-10T20:11:06.602266] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T20:11:06.689336] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-10T20:11:07.489422] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-10T20:11:07.625884] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T20:11:07.629885] [INFO ] [REMOTE ] MHK: Full fetch complete (60804 records). [2025-10-10T20:11:07.629988] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-10T20:11:07.897189] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-10T20:11:08.040020] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-10T20:11:08.040167] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-10T20:11:08.041924] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-10T20:11:08.042020] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-10T20:11:08.043941] [DEBUG] [LOCAL ] MHK: Trimmed 60804 records to 42752 (keeping 200 days of data) [2025-10-10T20:11:08.289940] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-10T20:11:08.294702] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T20:11:08.351162] [DEBUG] [LOCAL ] MHK: Primary data saved (42752 records). [2025-10-10T20:11:08.351322] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-10T20:11:08.351414] [INFO ] [MAIN ] Update Progress: 1355/2373 symbols completed. MHK took 45.3s. Estimated remaining: 2h 23m 33s. Rate: 7.1 symbols/min [2025-10-10T20:11:08.517781] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:11:08.517984] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-10T20:11:08.518022] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-10T20:11:08.518133] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-10T20:11:08.518173] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-10T20:11:08.518213] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-10T20:11:08.518243] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-10T20:11:08.771434] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-10T20:11:08.871491] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:11:09.089371] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-10T20:11:09.889440] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-10T20:11:10.326914] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-10T20:11:10.327660] [INFO ] [REMOTE ] MHLA: Full fetch complete (1518 records). [2025-10-10T20:11:10.327733] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-10T20:11:10.510956] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-10T20:11:10.511372] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:11:10.511467] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:11:10.511714] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-10T20:11:10.511927] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-10T20:11:10.512124] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-10T20:11:10.517435] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-10T20:11:10.526418] [INFO ] [MAIN ] Update Progress: 1356/2373 symbols completed. MHLA took 26.0s. Estimated remaining: 2h 23m 20s. Rate: 7.1 symbols/min [2025-10-10T20:11:10.594252] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T20:11:10.710364] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:11:10.707144] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-10T20:11:10.725429] [DEBUG] [LOCAL ] MIN: Loaded 13702 existing records from primary storage. [2025-10-10T20:11:10.725707] [INFO ] [MAIN ] MIN: Loaded 13702 existing records. [2025-10-10T20:11:10.902799] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:11:10.903065] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-10T20:11:10.903112] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-10T20:11:10.903463] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-10T20:11:10.903521] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-10T20:11:11.261092] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:11:11.489373] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-10-10T20:11:11.594951] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-10T20:11:11.744178] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:11:11.744585] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-10-10T20:11:11.744742] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:11:11.744817] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-10T20:11:11.744883] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:11:11.744956] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-10T20:11:11.745021] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-10T20:11:11.745057] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-10T20:11:11.745098] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-10T20:11:11.745146] [INFO ] [MAIN ] Update Progress: 1357/2373 symbols completed. MIAX took 3.4s. Estimated remaining: 2h 23m 6s. Rate: 7.1 symbols/min [2025-10-10T20:11:12.289378] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-10T20:11:13.089345] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-10T20:11:13.750363] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-10T20:11:13.889390] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-10T20:11:13.984733] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-10T20:11:14.689365] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-10T20:11:15.207026] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T20:11:15.486489] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-10T20:11:15.487705] [INFO ] [REMOTE ] MHN: Full fetch complete (11612 records). [2025-10-10T20:11:15.487785] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-10T20:11:15.499492] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-10T20:11:15.869836] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-10T20:11:15.869920] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-10T20:11:15.870201] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-10T20:11:15.870241] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-10T20:11:15.870729] [DEBUG] [LOCAL ] MHN: Trimmed 11612 records to 7667 (keeping 200 days of data) [2025-10-10T20:11:15.919416] [DEBUG] [LOCAL ] MHN: Primary data saved (7667 records). [2025-10-10T20:11:15.919583] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-10T20:11:15.919697] [INFO ] [MAIN ] Update Progress: 1358/2373 symbols completed. MHN took 27.0s. Estimated remaining: 2h 22m 54s. Rate: 7.1 symbols/min [2025-10-10T20:11:16.289379] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-10-10T20:11:16.839833] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-10T20:11:17.089386] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-10T20:11:17.400686] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-10T20:11:17.889398] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-10T20:11:18.663019] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T20:11:18.689329] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-10T20:11:18.794892] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-10T20:11:19.489371] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-10T20:11:20.067461] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-10T20:11:20.079050] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-10T20:11:20.289406] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-10T20:11:21.089455] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-10T20:11:21.550495] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T20:11:21.889433] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-10T20:11:21.974679] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-10T20:11:22.689431] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-10T20:11:23.115672] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-10T20:11:23.118033] [INFO ] [REMOTE ] MHO: Full fetch complete (36738 records). [2025-10-10T20:11:23.118110] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-10T20:11:23.488888] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-10T20:11:23.488978] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-10T20:11:23.489973] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-10T20:11:23.490036] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-10T20:11:23.490874] [DEBUG] [LOCAL ] MHO: Trimmed 36738 records to 24089 (keeping 200 days of data) [2025-10-10T20:11:23.641352] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-10T20:11:23.645485] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-10T20:11:23.648288] [DEBUG] [LOCAL ] MHO: Primary data saved (24089 records). [2025-10-10T20:11:23.648490] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-10T20:11:23.648584] [INFO ] [MAIN ] Update Progress: 1359/2373 symbols completed. MHO took 27.8s. Estimated remaining: 2h 22m 45s. Rate: 7.1 symbols/min [2025-10-10T20:11:24.632855] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-10T20:11:24.635925] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-10T20:11:25.707284] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-10T20:11:25.710747] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-10T20:11:26.980937] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-10T20:11:26.986293] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-10T20:11:28.128726] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-10T20:11:28.132585] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-10T20:11:29.108221] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T20:11:29.110875] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-10T20:11:30.190443] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T20:11:30.192817] [INFO ] [REMOTE ] MIN: Full fetch complete (18231 records). [2025-10-10T20:11:30.192890] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-10T20:11:30.568941] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-10T20:11:30.569046] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-10T20:11:30.569489] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-10T20:11:30.569534] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-10T20:11:30.570118] [DEBUG] [LOCAL ] MIN: Trimmed 18231 records to 13950 (keeping 200 days of data) [2025-10-10T20:11:30.649565] [DEBUG] [LOCAL ] MIN: Primary data saved (13950 records). [2025-10-10T20:11:30.649740] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-10T20:11:30.649827] [INFO ] [MAIN ] Update Progress: 1360/2373 symbols completed. MIN took 20.1s. Estimated remaining: 2h 22m 36s. Rate: 7.1 symbols/min [2025-10-10T20:11:31.293069] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:11:31.287890] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:11:31.431138] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:11:31.428922] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:11:31.431688] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-10T20:11:31.432129] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-10T20:11:31.434015] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-10T20:11:31.434121] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-10T20:11:31.434360] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-10T20:11:31.437288] [DEBUG] [LOCAL ] MITP: Loaded 2367 existing records from primary storage. [2025-10-10T20:11:31.437748] [INFO ] [MAIN ] MITP: Loaded 2367 existing records. [2025-10-10T20:11:31.437163] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-10T20:11:31.649895] [DEBUG] [LOCAL ] MITT: Loaded 22868 existing records from primary storage. [2025-10-10T20:11:31.680506] [INFO ] [MAIN ] MITT: Loaded 22868 existing records. [2025-10-10T20:11:31.889947] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:11:31.932847] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-10T20:11:31.949701] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-10T20:11:31.949584] [DEBUG] [LOCAL ] MIR: Loaded 51525 existing records from primary storage. [2025-10-10T20:11:32.003225] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-10T20:11:32.003378] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-10T20:11:32.038185] [INFO ] [MAIN ] MIR: Loaded 51525 existing records. [2025-10-10T20:11:32.200674] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:11:32.325245] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-10T20:11:32.325856] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-10T20:11:32.387055] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-10T20:11:32.424449] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-10T20:11:32.832217] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:11:32.868958] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:11:32.899780] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-10-10T20:11:32.899951] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-10T20:11:32.917248] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-10T20:11:32.956589] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-10T20:11:33.063080] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-10T20:11:33.065994] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:11:33.074971] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-10-10T20:11:33.486042] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-10T20:11:33.475271] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:11:33.486411] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-10-10T20:11:33.512127] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-10T20:11:33.681189] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:11:33.681515] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-10-10T20:11:33.931108] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-10T20:11:33.932402] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-10T20:11:34.031241] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-10T20:11:34.032251] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-10T20:11:34.448243] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-10T20:11:34.449434] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-10T20:11:34.567595] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-10T20:11:34.689403] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-10T20:11:34.885180] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T20:11:34.977825] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-10T20:11:35.034015] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T20:11:35.342435] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-10T20:11:35.489359] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-10T20:11:36.289372] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-10T20:11:36.893370] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-10T20:11:36.967585] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-10T20:11:37.089366] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-10T20:11:37.640751] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-10T20:11:37.889394] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-10T20:11:38.689384] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-10T20:11:39.325562] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-10T20:11:39.489360] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-10T20:11:39.750308] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T20:11:40.289348] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-10T20:11:40.734798] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T20:11:40.970185] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-10T20:11:41.089337] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-10T20:11:41.462794] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-10T20:11:41.889387] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-10T20:11:42.689444] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-10T20:11:43.177941] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-10T20:11:43.489351] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-10T20:11:43.675936] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T20:11:44.289387] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-10T20:11:44.894142] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-10T20:11:44.978115] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-10T20:11:45.089406] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-10T20:11:45.600633] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-10T20:11:45.889390] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-10T20:11:46.425895] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-10T20:11:46.689379] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-10T20:11:47.199849] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-10T20:11:47.489356] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-10T20:11:47.951568] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-10T20:11:48.289369] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-10T20:11:49.089391] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-10T20:11:49.889409] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-10T20:11:50.118200] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-10T20:11:50.643348] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-10T20:11:50.659470] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-10T20:11:50.689357] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-10T20:11:51.055543] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-10T20:11:51.489390] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-10T20:11:52.289398] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-10T20:11:52.627630] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-10T20:11:53.089715] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-10T20:11:53.545407] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-10T20:11:53.889400] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-10T20:11:54.350761] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-10T20:11:54.351906] [INFO ] [REMOTE ] MITN: Full fetch complete (2358 records). [2025-10-10T20:11:54.352045] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-10T20:11:54.472802] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T20:11:54.564768] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-10T20:11:54.564993] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:11:54.565063] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:11:54.565132] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-10T20:11:54.565196] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-10T20:11:54.565232] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-10T20:11:54.565272] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-10T20:11:54.565329] [INFO ] [MAIN ] Update Progress: 1361/2373 symbols completed. MITN took 23.9s. Estimated remaining: 2h 22m 39s. Rate: 7.1 symbols/min [2025-10-10T20:11:54.700804] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-10T20:11:54.732907] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:11:54.741121] [DEBUG] [LOCAL ] MIY: Loaded 6177 existing records from primary storage. [2025-10-10T20:11:54.741424] [INFO ] [MAIN ] MIY: Loaded 6177 existing records. [2025-10-10T20:11:54.914175] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:11:54.914360] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-10T20:11:54.914428] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-10T20:11:54.914719] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-10T20:11:54.914776] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-10T20:11:55.259960] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:11:55.344186] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-10T20:11:55.345015] [INFO ] [REMOTE ] MITP: Full fetch complete (3299 records). [2025-10-10T20:11:55.345083] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-10T20:11:55.495296] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-10T20:11:55.705506] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-10T20:11:55.705592] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-10T20:11:55.705782] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-10T20:11:55.705844] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-10T20:11:55.706180] [DEBUG] [LOCAL ] MITP: Trimmed 3299 records to 2369 (keeping 200 days of data) [2025-10-10T20:11:55.719783] [DEBUG] [LOCAL ] MITP: Primary data saved (2369 records). [2025-10-10T20:11:55.719843] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-10T20:11:55.719911] [INFO ] [MAIN ] Update Progress: 1362/2373 symbols completed. MITP took 25.1s. Estimated remaining: 2h 22m 25s. Rate: 7.1 symbols/min [2025-10-10T20:11:55.885950] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:11:55.933423] [DEBUG] [LOCAL ] MKC: Loaded 52908 existing records from primary storage. [2025-10-10T20:11:55.933825] [INFO ] [MAIN ] MKC: Loaded 52908 existing records. [2025-10-10T20:11:56.111913] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:11:56.112157] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-10T20:11:56.112205] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-10T20:11:56.113145] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-10T20:11:56.113203] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-10T20:11:56.291348] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-10-10T20:11:56.442292] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-10T20:11:56.501835] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:11:57.089397] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-10T20:11:57.294753] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T20:11:57.889400] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-10-10T20:11:58.307949] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T20:11:58.689434] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-10T20:11:58.827600] [DEBUG] [REMOTE ] MIR: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-10T20:11:58.828067] [WARN ] [REMOTE ] MIR: No data returned for month 2025-05 [2025-10-10T20:11:58.828179] [FATAL] [REMOTE ] MIR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:11:58.828291] [FATAL] [MAIN ] MIR: Failed to fetch primary data. [2025-10-10T20:11:58.828372] [WARN ] [MAIN ] MIR: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:11:58.828444] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-10T20:11:58.828515] [DEBUG] [LOCAL ] MIR: No primary data file found to delete. [2025-10-10T20:11:58.828583] [INFO ] [LOCAL ] MIR: Starting deletion of derivative data. [2025-10-10T20:11:58.828817] [DEBUG] [LOCAL ] MIR: Deleted derivative data file. [2025-10-10T20:11:58.828921] [INFO ] [MAIN ] Update Progress: 1363/2373 symbols completed. MIR took 28.2s. Estimated remaining: 2h 22m 13s. Rate: 7.1 symbols/min [2025-10-10T20:11:59.009431] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:11:59.042565] [DEBUG] [LOCAL ] MKL: Loaded 34417 existing records from primary storage. [2025-10-10T20:11:59.042918] [INFO ] [MAIN ] MKL: Loaded 34417 existing records. [2025-10-10T20:11:59.219699] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:11:59.219986] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-10T20:11:59.220063] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-10T20:11:59.220793] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-10T20:11:59.220854] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-10T20:11:59.494452] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-10T20:11:59.613584] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:11:59.644998] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T20:12:00.289398] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-10T20:12:00.980694] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T20:12:01.063214] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-10T20:12:01.089358] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-10T20:12:01.889404] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-10T20:12:01.939368] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-10T20:12:02.689480] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-10-10T20:12:03.165275] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T20:12:03.167918] [INFO ] [REMOTE ] MITT: Full fetch complete (34282 records). [2025-10-10T20:12:03.168051] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-10T20:12:03.494589] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-10T20:12:03.545140] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-10T20:12:03.545226] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-10T20:12:03.545943] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-10T20:12:03.546007] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-10T20:12:03.546945] [DEBUG] [LOCAL ] MITT: Trimmed 34282 records to 23128 (keeping 200 days of data) [2025-10-10T20:12:03.682468] [DEBUG] [LOCAL ] MITT: Primary data saved (23128 records). [2025-10-10T20:12:03.682624] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-10T20:12:03.682768] [INFO ] [MAIN ] Update Progress: 1364/2373 symbols completed. MITT took 33.0s. Estimated remaining: 2h 22m 2s. Rate: 7.1 symbols/min [2025-10-10T20:12:03.850325] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:12:03.889273] [DEBUG] [LOCAL ] MLI: Loaded 43753 existing records from primary storage. [2025-10-10T20:12:03.889605] [INFO ] [MAIN ] MLI: Loaded 43753 existing records. [2025-10-10T20:12:04.065926] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:12:04.066276] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-10T20:12:04.066440] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-10T20:12:04.067383] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-10T20:12:04.067445] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-10T20:12:04.294506] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-10T20:12:04.438897] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-10T20:12:04.487916] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:12:05.089426] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-10-10T20:12:05.485600] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-10T20:12:05.543484] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-10T20:12:05.889403] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-10T20:12:06.689350] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-10T20:12:06.834753] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-10T20:12:07.489452] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-10T20:12:07.554911] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T20:12:08.289386] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-10T20:12:08.333985] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-10T20:12:08.546638] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T20:12:09.089491] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-10T20:12:09.667344] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-10T20:12:09.889355] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-10T20:12:10.454723] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-10T20:12:10.696688] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-10T20:12:10.702639] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-10T20:12:11.489400] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-10T20:12:11.556840] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-10T20:12:12.289365] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-10T20:12:13.089431] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-10T20:12:13.405021] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T20:12:13.889372] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-10T20:12:13.964531] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-10T20:12:14.694964] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-10T20:12:14.710280] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T20:12:15.499993] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-10T20:12:15.505491] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-10T20:12:15.759805] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-10T20:12:16.289383] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-10T20:12:17.089364] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-10T20:12:17.171026] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-10T20:12:17.889403] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-10T20:12:18.168107] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T20:12:18.689337] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-10T20:12:19.056905] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-10T20:12:19.489360] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-10T20:12:19.736174] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-10T20:12:20.289392] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-10T20:12:20.447442] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T20:12:21.089425] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-10T20:12:21.556105] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T20:12:21.575743] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T20:12:21.621286] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-10T20:12:21.889376] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-10T20:12:22.689396] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-10T20:12:23.489362] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-10T20:12:23.782670] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T20:12:24.001688] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T20:12:24.289444] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-10T20:12:24.688295] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T20:12:25.089412] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-10T20:12:25.831014] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-10T20:12:25.889384] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-10T20:12:26.011822] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T20:12:26.689346] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-10T20:12:26.794198] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T20:12:26.796359] [INFO ] [REMOTE ] MIY: Full fetch complete (9048 records). [2025-10-10T20:12:26.796464] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-10T20:12:27.168214] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-10T20:12:27.168299] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-10T20:12:27.168580] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-10T20:12:27.168692] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-10T20:12:27.169110] [DEBUG] [LOCAL ] MIY: Trimmed 9048 records to 6272 (keeping 200 days of data) [2025-10-10T20:12:27.206398] [DEBUG] [LOCAL ] MIY: Primary data saved (6272 records). [2025-10-10T20:12:27.206485] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-10T20:12:27.206569] [INFO ] [MAIN ] Update Progress: 1365/2373 symbols completed. MIY took 32.6s. Estimated remaining: 2h 22m 4s. Rate: 7.1 symbols/min [2025-10-10T20:12:27.378810] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:12:27.406504] [DEBUG] [LOCAL ] MLM: Loaded 29591 existing records from primary storage. [2025-10-10T20:12:27.406830] [INFO ] [MAIN ] MLM: Loaded 29591 existing records. [2025-10-10T20:12:27.497571] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-10T20:12:27.598545] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:12:27.598873] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-10T20:12:27.598924] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-10T20:12:27.599682] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-10T20:12:27.599760] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-10T20:12:27.976123] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:12:28.170346] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-10T20:12:28.289396] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-10T20:12:29.089405] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-10-10T20:12:29.556899] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-10T20:12:29.889348] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-10T20:12:30.013496] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T20:12:30.689431] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-10T20:12:31.012503] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T20:12:31.489368] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-10T20:12:31.914723] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-10T20:12:31.935671] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-10T20:12:31.940781] [INFO ] [REMOTE ] MKC: Full fetch complete (75691 records). [2025-10-10T20:12:31.940961] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-10T20:12:32.308304] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-10T20:12:32.332793] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-10T20:12:32.332864] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-10T20:12:32.333859] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-10T20:12:32.333921] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-10T20:12:32.335637] [DEBUG] [LOCAL ] MKC: Trimmed 75691 records to 53297 (keeping 200 days of data) [2025-10-10T20:12:32.665233] [DEBUG] [LOCAL ] MKC: Primary data saved (53297 records). [2025-10-10T20:12:32.665412] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-10T20:12:32.665935] [INFO ] [MAIN ] Update Progress: 1366/2373 symbols completed. MKC took 36.9s. Estimated remaining: 2h 21m 54s. Rate: 7.1 symbols/min [2025-10-10T20:12:32.873767] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:12:32.900284] [DEBUG] [LOCAL ] MLNK: Loaded 26036 existing records from primary storage. [2025-10-10T20:12:32.900560] [INFO ] [MAIN ] MLNK: Loaded 26036 existing records. [2025-10-10T20:12:33.094507] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-10T20:12:33.085473] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:12:33.099006] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-10T20:12:33.099093] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-10T20:12:33.099749] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-10T20:12:33.101131] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-10T20:12:33.107489] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-10T20:12:33.514275] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-10T20:12:33.518057] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:12:33.522083] [INFO ] [REMOTE ] MKL: Full fetch complete (49697 records). [2025-10-10T20:12:33.522177] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-10T20:12:33.896417] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-10-10T20:12:33.897277] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-10T20:12:33.898283] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-10T20:12:33.899211] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-10T20:12:33.899276] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-10T20:12:33.900479] [DEBUG] [LOCAL ] MKL: Trimmed 49697 records to 34596 (keeping 200 days of data) [2025-10-10T20:12:34.109286] [DEBUG] [LOCAL ] MKL: Primary data saved (34596 records). [2025-10-10T20:12:34.109427] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-10T20:12:34.109508] [INFO ] [MAIN ] Update Progress: 1367/2373 symbols completed. MKL took 35.3s. Estimated remaining: 2h 21m 40s. Rate: 7.1 symbols/min [2025-10-10T20:12:34.274444] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:12:34.278855] [DEBUG] [LOCAL ] MLP: Loaded 3019 existing records from primary storage. [2025-10-10T20:12:34.279008] [INFO ] [MAIN ] MLP: Loaded 3019 existing records. [2025-10-10T20:12:34.458072] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:12:34.458338] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-10T20:12:34.458394] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-10T20:12:34.458703] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-10T20:12:34.458761] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-10T20:12:34.696752] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-10T20:12:34.815739] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:12:35.004800] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T20:12:35.084736] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T20:12:35.489420] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-10-10T20:12:36.082261] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-10T20:12:36.194803] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-10T20:12:36.289375] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-10T20:12:37.089396] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-10T20:12:37.537120] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T20:12:37.889400] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-10T20:12:38.689429] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-10T20:12:38.817434] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T20:12:39.031315] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-10T20:12:39.489380] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-10T20:12:40.289465] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-10T20:12:40.398842] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T20:12:40.489248] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-10T20:12:41.021690] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-10T20:12:41.089413] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-10T20:12:41.889387] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-10T20:12:42.455211] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-10T20:12:42.583315] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T20:12:42.689385] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-10T20:12:43.489451] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-10T20:12:44.289344] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-10T20:12:44.342294] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-10T20:12:44.346467] [INFO ] [REMOTE ] MLI: Full fetch complete (63085 records). [2025-10-10T20:12:44.346566] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-10T20:12:44.727701] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-10T20:12:44.727790] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-10T20:12:44.728718] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-10T20:12:44.728780] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-10T20:12:44.730029] [DEBUG] [LOCAL ] MLI: Trimmed 63085 records to 44093 (keeping 200 days of data) [2025-10-10T20:12:44.998376] [DEBUG] [LOCAL ] MLI: Primary data saved (44093 records). [2025-10-10T20:12:44.998513] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-10T20:12:44.998590] [INFO ] [MAIN ] Update Progress: 1368/2373 symbols completed. MLI took 41.3s. Estimated remaining: 2h 21m 33s. Rate: 7.1 symbols/min [2025-10-10T20:12:45.098254] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-10T20:12:45.169348] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:12:45.181803] [DEBUG] [LOCAL ] MLR: Loaded 12506 existing records from primary storage. [2025-10-10T20:12:45.182060] [INFO ] [MAIN ] MLR: Loaded 12506 existing records. [2025-10-10T20:12:45.368765] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T20:12:45.388217] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:12:45.396253] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-10T20:12:45.396632] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-10T20:12:45.403148] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-10T20:12:45.414957] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-10T20:12:45.448511] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-10T20:12:45.684179] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-10T20:12:45.778487] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:12:45.889339] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-10T20:12:46.631937] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-10T20:12:46.689408] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-10T20:12:47.184388] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-10T20:12:47.489453] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-10T20:12:48.289409] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-10T20:12:48.700040] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-10T20:12:49.089385] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-10-10T20:12:49.342681] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-10T20:12:49.889417] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-10T20:12:50.095243] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-10T20:12:50.477188] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-10T20:12:50.689381] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-10T20:12:51.489395] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-10T20:12:51.896480] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-10T20:12:52.289403] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-10T20:12:52.450378] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-10T20:12:53.089415] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-10T20:12:53.424974] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-10T20:12:53.889356] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-10T20:12:54.055932] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T20:12:54.689365] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-10T20:12:55.429447] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-10T20:12:55.489336] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-10T20:12:55.950506] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T20:12:56.289407] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-10T20:12:56.948158] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T20:12:57.089337] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-10T20:12:57.752222] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-10T20:12:57.889414] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-10T20:12:58.379454] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T20:12:58.454790] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-10T20:12:58.689404] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-10T20:12:59.236007] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-10T20:12:59.489461] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-10T20:13:00.224227] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-10T20:13:00.289369] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-10T20:13:01.089466] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-10T20:13:01.471514] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-10T20:13:01.680590] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-10T20:13:01.681608] [INFO ] [REMOTE ] MLP: Full fetch complete (4464 records). [2025-10-10T20:13:01.681709] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-10T20:13:01.896903] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-10T20:13:02.044340] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-10T20:13:02.044425] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-10T20:13:02.044584] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-10T20:13:02.044624] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-10T20:13:02.044991] [DEBUG] [LOCAL ] MLP: Trimmed 4464 records to 3045 (keeping 200 days of data) [2025-10-10T20:13:02.065740] [DEBUG] [LOCAL ] MLP: Primary data saved (3045 records). [2025-10-10T20:13:02.065812] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-10T20:13:02.065885] [INFO ] [MAIN ] Update Progress: 1369/2373 symbols completed. MLP took 28.0s. Estimated remaining: 2h 21m 31s. Rate: 7.1 symbols/min [2025-10-10T20:13:02.228739] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:13:02.278299] [DEBUG] [LOCAL ] MMC: Loaded 52256 existing records from primary storage. [2025-10-10T20:13:02.278679] [INFO ] [MAIN ] MMC: Loaded 52256 existing records. [2025-10-10T20:13:02.449381] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:13:02.449612] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-10T20:13:02.449715] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-10T20:13:02.450136] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-10T20:13:02.450193] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-10T20:13:02.694583] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-10T20:13:02.801620] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:13:03.489386] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-10-10T20:13:03.617981] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-10T20:13:04.289398] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-10T20:13:04.346982] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-10T20:13:04.350585] [INFO ] [REMOTE ] MLNK: Full fetch complete (36321 records). [2025-10-10T20:13:04.350718] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-10T20:13:04.729762] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-10T20:13:04.729867] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-10T20:13:04.730918] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-10T20:13:04.730983] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-10T20:13:04.731918] [DEBUG] [LOCAL ] MLNK: Trimmed 36321 records to 26322 (keeping 200 days of data) [2025-10-10T20:13:04.886168] [DEBUG] [LOCAL ] MLNK: Primary data saved (26322 records). [2025-10-10T20:13:04.886323] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-10T20:13:04.886407] [INFO ] [MAIN ] Update Progress: 1370/2373 symbols completed. MLNK took 32.2s. Estimated remaining: 2h 21m 19s. Rate: 7.1 symbols/min [2025-10-10T20:13:05.061295] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:13:05.073425] [DEBUG] [LOCAL ] MMD: Loaded 11288 existing records from primary storage. [2025-10-10T20:13:05.073756] [INFO ] [MAIN ] MMD: Loaded 11288 existing records. [2025-10-10T20:13:05.105315] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-10T20:13:05.264368] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:13:05.264676] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-10T20:13:05.264742] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-10T20:13:05.265102] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-10T20:13:05.265161] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-10T20:13:05.670738] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:13:05.675018] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-10T20:13:05.714391] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-10T20:13:05.889405] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-10-10T20:13:06.060977] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T20:13:06.689396] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-10T20:13:07.015265] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T20:13:07.489405] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-10T20:13:07.630686] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-10T20:13:08.289414] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-10T20:13:08.571017] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T20:13:09.089398] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-10T20:13:09.260710] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-10T20:13:09.889393] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-10T20:13:10.689417] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-10T20:13:10.818947] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-10T20:13:11.072430] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T20:13:11.350171] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-10T20:13:11.489358] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-10T20:13:12.289370] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-10T20:13:12.568519] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-10T20:13:13.089426] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-10T20:13:13.889415] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-10T20:13:14.142742] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T20:13:14.144706] [INFO ] [REMOTE ] MLR: Full fetch complete (18977 records). [2025-10-10T20:13:14.144782] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-10T20:13:14.438350] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-10T20:13:14.555922] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-10T20:13:14.556008] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-10T20:13:14.556591] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-10T20:13:14.556675] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-10T20:13:14.557252] [DEBUG] [LOCAL ] MLR: Trimmed 18977 records to 12698 (keeping 200 days of data) [2025-10-10T20:13:14.633049] [DEBUG] [LOCAL ] MLR: Primary data saved (12698 records). [2025-10-10T20:13:14.633183] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-10T20:13:14.633266] [INFO ] [MAIN ] Update Progress: 1371/2373 symbols completed. MLR took 29.6s. Estimated remaining: 2h 21m 11s. Rate: 7.1 symbols/min [2025-10-10T20:13:14.694530] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-10T20:13:14.803043] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:13:14.819087] [DEBUG] [LOCAL ] MMI: Loaded 15336 existing records from primary storage. [2025-10-10T20:13:14.819298] [INFO ] [MAIN ] MMI: Loaded 15336 existing records. [2025-10-10T20:13:14.992999] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:13:14.993944] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-10T20:13:14.994039] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-10T20:13:14.994509] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-10T20:13:14.994577] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-10T20:13:15.314445] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T20:13:15.338813] [INFO ] [REMOTE ] MLM: Full fetch complete (45194 records). [2025-10-10T20:13:15.363406] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-10T20:13:15.501051] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-10T20:13:15.515330] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:13:15.838792] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-10T20:13:15.838901] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-10T20:13:15.840069] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-10T20:13:15.840185] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-10T20:13:15.841564] [DEBUG] [LOCAL ] MLM: Trimmed 45194 records to 29814 (keeping 200 days of data) [2025-10-10T20:13:16.038287] [DEBUG] [LOCAL ] MLM: Primary data saved (29814 records). [2025-10-10T20:13:16.038463] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-10T20:13:16.038572] [INFO ] [MAIN ] Update Progress: 1372/2373 symbols completed. MLM took 48.8s. Estimated remaining: 2h 20m 57s. Rate: 7.1 symbols/min [2025-10-10T20:13:16.217759] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:13:16.217973] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-10T20:13:16.218011] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-10T20:13:16.218135] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-10T20:13:16.218180] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-10T20:13:16.218223] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-10T20:13:16.218257] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-10T20:13:16.298026] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-10-10T20:13:16.630831] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-10T20:13:16.630095] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:13:16.769877] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T20:13:16.870923] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-10T20:13:17.089414] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-10-10T20:13:17.315716] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:13:17.316172] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-10-10T20:13:17.316272] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:13:17.316322] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-10T20:13:17.316383] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:13:17.316459] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-10T20:13:17.316533] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-10T20:13:17.316570] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-10T20:13:17.316611] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-10T20:13:17.316689] [INFO ] [MAIN ] Update Progress: 1373/2373 symbols completed. MMID took 1.3s. Estimated remaining: 2h 20m 44s. Rate: 7.1 symbols/min [2025-10-10T20:13:17.500784] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:13:17.501004] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-10T20:13:17.501045] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-10T20:13:17.501172] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-10T20:13:17.501219] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-10T20:13:17.501268] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-10T20:13:17.501312] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-10T20:13:17.871846] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:13:17.889325] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-10-10T20:13:18.430733] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-10T20:13:18.689416] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-10T20:13:19.489395] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-10T20:13:19.810542] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-10T20:13:20.289401] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-10T20:13:21.028787] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-10T20:13:21.089338] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-10T20:13:21.458409] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T20:13:21.615856] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-10T20:13:21.889370] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-10T20:13:22.400259] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-10T20:13:22.689385] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-10T20:13:23.213289] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-10T20:13:23.489365] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-10T20:13:24.289391] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-10T20:13:25.089374] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-10T20:13:25.203130] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-10T20:13:25.403602] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-10T20:13:25.539679] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T20:13:25.889381] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-10T20:13:26.689391] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-10T20:13:27.489402] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-10T20:13:27.836600] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T20:13:27.895759] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-10T20:13:27.909977] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-10T20:13:28.289398] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-10T20:13:29.089377] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-10T20:13:29.157461] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-10T20:13:29.889398] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-10T20:13:30.233638] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-10T20:13:30.689395] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-10T20:13:31.076448] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-10T20:13:31.489369] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-10T20:13:31.820730] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-10T20:13:31.861028] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-10T20:13:32.289438] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-10T20:13:32.680997] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-10T20:13:33.089406] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-10T20:13:33.889392] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-10T20:13:33.987680] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-10T20:13:34.582348] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T20:13:34.583548] [INFO ] [REMOTE ] MMKT: Full fetch complete (2121 records). [2025-10-10T20:13:34.583638] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-10T20:13:34.694583] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-10T20:13:34.777396] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-10T20:13:34.777610] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:13:34.778248] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:13:34.778357] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-10T20:13:34.778422] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-10T20:13:34.778459] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-10T20:13:34.778498] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-10T20:13:34.778559] [INFO ] [MAIN ] Update Progress: 1374/2373 symbols completed. MMKT took 17.5s. Estimated remaining: 2h 20m 42s. Rate: 7.1 symbols/min [2025-10-10T20:13:34.948122] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:13:35.000167] [DEBUG] [LOCAL ] MMM: Loaded 53509 existing records from primary storage. [2025-10-10T20:13:35.000506] [INFO ] [MAIN ] MMM: Loaded 53509 existing records. [2025-10-10T20:13:35.181054] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:13:35.181296] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-10T20:13:35.181344] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-10T20:13:35.182712] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-10T20:13:35.182774] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-10T20:13:35.503091] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-10T20:13:35.544865] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:13:36.289443] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-10-10T20:13:36.601820] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-10T20:13:36.753184] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-10T20:13:37.089393] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-10T20:13:37.889399] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-10T20:13:38.440297] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-10T20:13:38.575493] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T20:13:38.689377] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-10T20:13:38.824761] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-10T20:13:39.489396] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-10T20:13:40.289357] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-10T20:13:40.590504] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-10T20:13:40.834159] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-10T20:13:41.089468] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-10T20:13:41.889410] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-10T20:13:41.965295] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-10T20:13:41.970719] [INFO ] [REMOTE ] MMC: Full fetch complete (74784 records). [2025-10-10T20:13:41.970864] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-10T20:13:42.065169] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T20:13:42.094536] [INFO ] [REMOTE ] MMD: Full fetch complete (17567 records). [2025-10-10T20:13:42.110697] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-10T20:13:42.702747] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-10T20:13:42.747735] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-10T20:13:42.785025] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-10T20:13:42.824599] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-10T20:13:42.836315] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-10T20:13:42.837309] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-10T20:13:42.837415] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-10T20:13:42.837680] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-10T20:13:42.837745] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-10T20:13:42.839410] [DEBUG] [LOCAL ] MMD: Trimmed 17567 records to 11341 (keeping 200 days of data) [2025-10-10T20:13:42.840154] [DEBUG] [LOCAL ] MMC: Trimmed 74784 records to 52646 (keeping 200 days of data) [2025-10-10T20:13:43.052012] [DEBUG] [LOCAL ] MMD: Primary data saved (11341 records). [2025-10-10T20:13:43.052217] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-10T20:13:43.052332] [INFO ] [MAIN ] Update Progress: 1375/2373 symbols completed. MMD took 38.2s. Estimated remaining: 2h 20m 33s. Rate: 7.1 symbols/min [2025-10-10T20:13:43.412970] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:13:43.468000] [DEBUG] [LOCAL ] MMC: Primary data saved (52646 records). [2025-10-10T20:13:43.468198] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-10T20:13:43.468310] [INFO ] [MAIN ] Update Progress: 1376/2373 symbols completed. MMC took 41.4s. Estimated remaining: 2h 20m 19s. Rate: 7.1 symbols/min [2025-10-10T20:13:43.678264] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:13:43.691717] [DEBUG] [LOCAL ] MMS: Loaded 34085 existing records from primary storage. [2025-10-10T20:13:43.692490] [INFO ] [MAIN ] MMS: Loaded 34085 existing records. [2025-10-10T20:13:43.852682] [DEBUG] [LOCAL ] MMT: Loaded 10601 existing records from primary storage. [2025-10-10T20:13:43.881013] [INFO ] [MAIN ] MMT: Loaded 10601 existing records. [2025-10-10T20:13:43.940878] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-10T20:13:43.981391] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:13:43.987862] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-10T20:13:43.988014] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-10T20:13:44.015952] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-10T20:13:44.016139] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-10T20:13:44.052245] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-10T20:13:44.187038] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-10T20:13:44.291119] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-10T20:13:44.296110] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:13:44.318789] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-10T20:13:44.335065] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-10T20:13:44.352061] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-10T20:13:44.391466] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-10T20:13:44.711003] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:13:44.931960] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:13:45.089380] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-10-10T20:13:45.495760] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T20:13:45.889362] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-10T20:13:45.985578] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-10T20:13:46.416020] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-10T20:13:46.689396] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-10T20:13:47.037381] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-10T20:13:47.489407] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-10T20:13:47.623840] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-10T20:13:48.289388] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-10T20:13:48.583462] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-10T20:13:49.089406] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-10T20:13:49.205879] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-10T20:13:49.889384] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-10-10T20:13:50.186808] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-10T20:13:50.689423] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-10T20:13:51.489397] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-10T20:13:51.562884] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-10T20:13:51.640953] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-10T20:13:52.289430] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-10T20:13:52.533904] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-10T20:13:53.089410] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-10T20:13:53.889488] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-10T20:13:54.045188] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-10T20:13:54.616275] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-10T20:13:54.689389] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-10T20:13:55.040500] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-10T20:13:55.042869] [INFO ] [REMOTE ] MMI: Full fetch complete (21489 records). [2025-10-10T20:13:55.042946] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-10T20:13:55.451267] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-10T20:13:55.451418] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-10T20:13:55.452202] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-10T20:13:55.452277] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-10T20:13:55.453471] [DEBUG] [LOCAL ] MMI: Trimmed 21489 records to 15496 (keeping 200 days of data) [2025-10-10T20:13:55.496304] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-10T20:13:55.569085] [DEBUG] [LOCAL ] MMI: Primary data saved (15496 records). [2025-10-10T20:13:55.569343] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-10T20:13:55.569521] [INFO ] [MAIN ] Update Progress: 1377/2373 symbols completed. MMI took 40.9s. Estimated remaining: 2h 20m 13s. Rate: 7.1 symbols/min [2025-10-10T20:13:55.707402] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-10T20:13:55.774335] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:13:55.793730] [DEBUG] [LOCAL ] MMU: Loaded 16913 existing records from primary storage. [2025-10-10T20:13:55.794043] [INFO ] [MAIN ] MMU: Loaded 16913 existing records. [2025-10-10T20:13:55.991623] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:13:55.992150] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-10T20:13:55.992228] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-10T20:13:55.993047] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-10T20:13:55.993115] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-10T20:13:56.294635] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-10T20:13:56.370493] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:13:57.089369] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-10T20:13:57.251569] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-10T20:13:57.763292] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-10T20:13:57.889353] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-10T20:13:58.547385] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T20:13:58.689442] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-10T20:13:59.489347] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-10-10T20:13:59.809834] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-10T20:13:59.849758] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T20:14:00.289425] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-10T20:14:00.792685] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-10T20:14:00.890001] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-10T20:14:01.089440] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-10T20:14:01.889475] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-10T20:14:02.336207] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T20:14:02.689387] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-10T20:14:03.138412] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T20:14:03.374087] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-10T20:14:03.489335] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-10T20:14:04.289399] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-10T20:14:04.640726] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T20:14:05.089366] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-10T20:14:05.889399] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-10T20:14:06.028055] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-10T20:14:06.335317] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-10T20:14:06.463077] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T20:14:06.689407] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-10T20:14:07.489398] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-10T20:14:07.568682] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T20:14:07.570124] [INFO ] [REMOTE ] MMT: Full fetch complete (16053 records). [2025-10-10T20:14:07.570192] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-10T20:14:07.928872] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-10T20:14:07.928962] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-10T20:14:07.929399] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-10T20:14:07.929461] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-10T20:14:07.929988] [DEBUG] [LOCAL ] MMT: Trimmed 16053 records to 10630 (keeping 200 days of data) [2025-10-10T20:14:07.990348] [DEBUG] [LOCAL ] MMT: Primary data saved (10630 records). [2025-10-10T20:14:07.990487] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-10T20:14:07.990568] [INFO ] [MAIN ] Update Progress: 1378/2373 symbols completed. MMT took 24.5s. Estimated remaining: 2h 20m 8s. Rate: 7.1 symbols/min [2025-10-10T20:14:08.156482] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:14:08.179845] [DEBUG] [LOCAL ] MNR: Loaded 24748 existing records from primary storage. [2025-10-10T20:14:08.180132] [INFO ] [MAIN ] MNR: Loaded 24748 existing records. [2025-10-10T20:14:08.294522] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-10T20:14:08.361851] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:14:08.362577] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-10T20:14:08.362831] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-10T20:14:08.372875] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-10T20:14:08.373114] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-10T20:14:08.410458] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-10T20:14:08.744196] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:14:09.089410] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-10-10T20:14:09.889385] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-10T20:14:10.279517] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T20:14:10.689358] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-10T20:14:10.737397] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-10T20:14:11.489428] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-10T20:14:11.583291] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T20:14:11.772828] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-10T20:14:12.289390] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-10T20:14:13.089412] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-10T20:14:13.444748] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T20:14:13.514318] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-10T20:14:13.889387] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-10T20:14:14.689370] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-10T20:14:14.782241] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-10T20:14:14.965444] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-10T20:14:15.489444] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-10T20:14:16.289425] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-10T20:14:16.981086] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-10T20:14:17.066123] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T20:14:17.089360] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-10T20:14:17.458143] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T20:14:17.889385] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-10T20:14:18.679423] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T20:14:18.689330] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-10T20:14:19.489433] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-10T20:14:19.886762] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-10T20:14:19.892013] [INFO ] [REMOTE ] MMM: Full fetch complete (77052 records). [2025-10-10T20:14:19.892196] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-10T20:14:20.308858] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-10T20:14:20.338089] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-10T20:14:20.343311] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-10T20:14:20.344110] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-10T20:14:20.351311] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-10T20:14:20.352529] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-10T20:14:20.357152] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-10T20:14:20.359465] [DEBUG] [LOCAL ] MMM: Trimmed 77052 records to 53899 (keeping 200 days of data) [2025-10-10T20:14:20.695134] [DEBUG] [LOCAL ] MMM: Primary data saved (53899 records). [2025-10-10T20:14:20.695282] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-10T20:14:20.695362] [INFO ] [MAIN ] Update Progress: 1379/2373 symbols completed. MMM took 45.9s. Estimated remaining: 2h 20m 2s. Rate: 7.1 symbols/min [2025-10-10T20:14:20.860118] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:14:20.899696] [DEBUG] [LOCAL ] MNSO: Loaded 44553 existing records from primary storage. [2025-10-10T20:14:20.900048] [INFO ] [MAIN ] MNSO: Loaded 44553 existing records. [2025-10-10T20:14:21.096932] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-10T20:14:21.096819] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:14:21.098201] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-10T20:14:21.098276] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-10T20:14:21.099224] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-10T20:14:21.099287] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-10T20:14:21.474528] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:14:21.889427] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-10-10T20:14:21.949531] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-10T20:14:22.230750] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-10T20:14:22.689411] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-10T20:14:23.489383] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-10T20:14:23.804441] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T20:14:24.289417] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-10T20:14:24.380520] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T20:14:24.410852] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T20:14:24.413260] [INFO ] [REMOTE ] MMU: Full fetch complete (25199 records). [2025-10-10T20:14:24.413524] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-10T20:14:24.826317] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-10T20:14:24.826481] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-10T20:14:24.827384] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-10T20:14:24.827451] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-10T20:14:24.828344] [DEBUG] [LOCAL ] MMU: Trimmed 25199 records to 17024 (keeping 200 days of data) [2025-10-10T20:14:24.939008] [DEBUG] [LOCAL ] MMU: Primary data saved (17024 records). [2025-10-10T20:14:24.939210] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-10T20:14:24.939318] [INFO ] [MAIN ] Update Progress: 1380/2373 symbols completed. MMU took 29.4s. Estimated remaining: 2h 19m 51s. Rate: 7.1 symbols/min [2025-10-10T20:14:25.094920] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-10T20:14:25.132336] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:14:25.132803] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-10T20:14:25.132975] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-10T20:14:25.133250] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-10T20:14:25.133441] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-10T20:14:25.133541] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-10T20:14:25.133689] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-10T20:14:25.226831] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-10T20:14:25.563465] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:14:25.889408] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-10T20:14:26.689420] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-10T20:14:26.846350] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T20:14:26.938729] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-10T20:14:27.489380] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-10T20:14:28.276876] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-10T20:14:28.280579] [INFO ] [REMOTE ] MMS: Full fetch complete (51551 records). [2025-10-10T20:14:28.280749] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-10T20:14:28.294559] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-10-10T20:14:28.625861] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:14:28.662177] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-10-10T20:14:28.704701] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:14:28.704845] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-10T20:14:28.705091] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-10T20:14:28.705019] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:14:28.705238] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-10T20:14:28.705326] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-10T20:14:28.706584] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-10T20:14:28.705461] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-10T20:14:28.706693] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-10T20:14:28.706848] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-10T20:14:28.707131] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-10T20:14:28.707196] [INFO ] [MAIN ] Update Progress: 1381/2373 symbols completed. MNTN took 3.8s. Estimated remaining: 2h 19m 39s. Rate: 7.1 symbols/min [2025-10-10T20:14:28.752768] [DEBUG] [LOCAL ] MMS: Trimmed 51551 records to 34358 (keeping 200 days of data) [2025-10-10T20:14:28.979996] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:14:29.009828] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-10T20:14:29.012085] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-10T20:14:29.010571] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T20:14:29.013195] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-10T20:14:29.017022] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-10T20:14:29.030034] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-10T20:14:29.039804] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-10T20:14:29.112322] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-10T20:14:29.268162] [DEBUG] [LOCAL ] MMS: Primary data saved (34358 records). [2025-10-10T20:14:29.284691] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-10T20:14:29.290718] [INFO ] [MAIN ] Update Progress: 1382/2373 symbols completed. MMS took 46.2s. Estimated remaining: 2h 19m 25s. Rate: 7.1 symbols/min [2025-10-10T20:14:29.679204] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:14:29.703574] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:14:29.743807] [DEBUG] [LOCAL ] MOD: Loaded 45257 existing records from primary storage. [2025-10-10T20:14:29.744160] [INFO ] [MAIN ] MOD: Loaded 45257 existing records. [2025-10-10T20:14:29.894676] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-10T20:14:29.926425] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:14:29.927035] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-10T20:14:29.927093] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-10T20:14:29.927950] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-10T20:14:29.928007] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-10T20:14:30.285187] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:14:30.689386] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-10-10T20:14:30.930383] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T20:14:31.334321] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-10T20:14:31.489395] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-10-10T20:14:32.289434] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-10T20:14:32.880298] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-10T20:14:33.089362] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-10T20:14:33.323269] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T20:14:33.549038] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T20:14:33.889389] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-10T20:14:34.689410] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-10T20:14:35.450422] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-10T20:14:35.489467] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-10T20:14:35.742379] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-10T20:14:36.226751] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-10T20:14:36.289331] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-10T20:14:36.481728] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T20:14:37.089390] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-10T20:14:37.586268] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T20:14:37.889373] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-10T20:14:38.689431] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-10T20:14:39.157445] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-10T20:14:39.226785] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T20:14:39.234034] [INFO ] [REMOTE ] MNR: Full fetch complete (36659 records). [2025-10-10T20:14:39.234218] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-10T20:14:39.494609] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-10T20:14:39.617455] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-10T20:14:39.617560] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-10T20:14:39.618665] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-10T20:14:39.618732] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-10T20:14:39.619767] [DEBUG] [LOCAL ] MNR: Trimmed 36659 records to 24984 (keeping 200 days of data) [2025-10-10T20:14:39.779816] [DEBUG] [LOCAL ] MNR: Primary data saved (24984 records). [2025-10-10T20:14:39.779991] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-10T20:14:39.780109] [INFO ] [MAIN ] Update Progress: 1383/2373 symbols completed. MNR took 31.8s. Estimated remaining: 2h 19m 18s. Rate: 7.1 symbols/min [2025-10-10T20:14:39.963154] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:14:40.020909] [DEBUG] [LOCAL ] MODG: Loaded 51924 existing records from primary storage. [2025-10-10T20:14:40.021306] [INFO ] [MAIN ] MODG: Loaded 51924 existing records. [2025-10-10T20:14:40.209127] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:14:40.209727] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-10T20:14:40.209820] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-10T20:14:40.220395] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-10T20:14:40.233410] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-10T20:14:40.299360] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-10T20:14:40.299225] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-10T20:14:40.635186] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:14:41.089365] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-10-10T20:14:41.491058] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-10T20:14:41.889395] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-10T20:14:42.689342] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-10T20:14:42.803498] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-10T20:14:43.028582] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T20:14:43.125768] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T20:14:43.489444] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-10T20:14:44.046846] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-10T20:14:44.289397] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-10T20:14:45.089403] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-10T20:14:45.478341] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T20:14:45.889490] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-10T20:14:46.147321] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T20:14:46.689469] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-10T20:14:47.030305] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T20:14:47.252584] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T20:14:47.489493] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-10T20:14:48.289408] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-10T20:14:48.483780] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T20:14:49.089431] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-10T20:14:49.889451] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-10T20:14:50.024476] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-10T20:14:50.689406] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-10T20:14:50.761075] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-10T20:14:50.925482] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T20:14:51.020746] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T20:14:51.489395] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-10T20:14:52.289410] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-10T20:14:53.011373] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-10T20:14:53.089357] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-10T20:14:53.269601] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T20:14:53.889381] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-10T20:14:54.018070] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T20:14:54.689383] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-10T20:14:55.354112] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-10T20:14:55.489347] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-10T20:14:55.737039] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-10T20:14:55.741859] [INFO ] [REMOTE ] MNSO: Full fetch complete (64364 records). [2025-10-10T20:14:55.741982] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-10T20:14:56.137527] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-10T20:14:56.137822] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-10T20:14:56.139505] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-10T20:14:56.139591] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-10T20:14:56.141568] [DEBUG] [LOCAL ] MNSO: Trimmed 64364 records to 44943 (keeping 200 days of data) [2025-10-10T20:14:56.298311] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-10T20:14:56.264816] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-10T20:14:56.471744] [DEBUG] [LOCAL ] MNSO: Primary data saved (44943 records). [2025-10-10T20:14:56.471920] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-10T20:14:56.472042] [INFO ] [MAIN ] Update Progress: 1384/2373 symbols completed. MNSO took 35.8s. Estimated remaining: 2h 19m 15s. Rate: 7.1 symbols/min [2025-10-10T20:14:56.651058] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:14:56.695882] [DEBUG] [LOCAL ] MOH: Loaded 42442 existing records from primary storage. [2025-10-10T20:14:56.696260] [INFO ] [MAIN ] MOH: Loaded 42442 existing records. [2025-10-10T20:14:56.888973] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:14:56.889279] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-10T20:14:56.889333] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-10T20:14:56.890791] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-10T20:14:56.890860] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-10T20:14:57.102363] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-10T20:14:57.256268] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:14:57.889406] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-10-10T20:14:57.979856] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-10T20:14:58.038993] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T20:14:58.689450] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-10T20:14:58.987964] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T20:14:59.494549] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-10T20:14:59.509244] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T20:15:00.289427] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-10T20:15:00.624548] [DEBUG] [REMOTE ] MOH: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-10T20:15:00.624987] [WARN ] [REMOTE ] MOH: No data returned for month 2025-01 [2025-10-10T20:15:00.625109] [FATAL] [REMOTE ] MOH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:15:00.625206] [FATAL] [MAIN ] MOH: Failed to fetch primary data. [2025-10-10T20:15:00.625270] [WARN ] [MAIN ] MOH: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:15:00.625352] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-10T20:15:00.625459] [DEBUG] [LOCAL ] MOH: No primary data file found to delete. [2025-10-10T20:15:00.625514] [INFO ] [LOCAL ] MOH: Starting deletion of derivative data. [2025-10-10T20:15:00.625823] [DEBUG] [LOCAL ] MOH: Deleted derivative data file. [2025-10-10T20:15:00.625919] [INFO ] [MAIN ] Update Progress: 1385/2373 symbols completed. MOH took 4.2s. Estimated remaining: 2h 19m 4s. Rate: 7.1 symbols/min [2025-10-10T20:15:00.822560] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:15:00.859437] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-10T20:15:00.922767] [DEBUG] [LOCAL ] MOS: Loaded 53894 existing records from primary storage. [2025-10-10T20:15:00.923168] [INFO ] [MAIN ] MOS: Loaded 53894 existing records. [2025-10-10T20:15:01.112301] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:15:01.112907] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-10T20:15:01.101358] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-10T20:15:01.113135] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-10T20:15:01.115968] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-10T20:15:01.116061] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-10T20:15:01.551741] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:15:01.556596] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-10T20:15:01.889442] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-10T20:15:02.689415] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-10-10T20:15:03.489421] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-10T20:15:03.672553] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-10T20:15:03.848443] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-10T20:15:03.853098] [INFO ] [REMOTE ] MOD: Full fetch complete (66168 records). [2025-10-10T20:15:03.853274] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-10T20:15:04.262351] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-10T20:15:04.262472] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-10T20:15:04.263776] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-10T20:15:04.263871] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-10T20:15:04.265928] [DEBUG] [LOCAL ] MOD: Trimmed 66168 records to 45599 (keeping 200 days of data) [2025-10-10T20:15:04.316799] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-10T20:15:04.551221] [DEBUG] [LOCAL ] MOD: Primary data saved (45599 records). [2025-10-10T20:15:04.551521] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-10T20:15:04.551616] [INFO ] [MAIN ] Update Progress: 1386/2373 symbols completed. MOD took 35.2s. Estimated remaining: 2h 18m 52s. Rate: 7.1 symbols/min [2025-10-10T20:15:04.693365] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T20:15:04.782549] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:15:04.804248] [DEBUG] [LOCAL ] MOV: Loaded 21950 existing records from primary storage. [2025-10-10T20:15:04.804522] [INFO ] [MAIN ] MOV: Loaded 21950 existing records. [2025-10-10T20:15:04.991745] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:15:04.992021] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-10T20:15:04.992070] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-10T20:15:04.992718] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-10T20:15:04.992777] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-10T20:15:05.091678] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-10T20:15:05.373141] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:15:05.406321] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-10T20:15:05.889375] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-10-10T20:15:06.594436] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-10T20:15:06.599909] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-10-10T20:15:06.600070] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-10T20:15:06.692993] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-10T20:15:06.842150] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T20:15:06.845020] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:15:06.857124] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:15:06.858083] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-10T20:15:06.859126] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-10T20:15:06.861344] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-10T20:15:06.861633] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-10T20:15:06.867450] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-10T20:15:06.867737] [INFO ] [MAIN ] Update Progress: 1387/2373 symbols completed. MO took 38.2s. Estimated remaining: 2h 18m 39s. Rate: 7.1 symbols/min [2025-10-10T20:15:07.070348] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T20:15:07.073079] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:15:07.134133] [DEBUG] [LOCAL ] MP: Loaded 54081 existing records from primary storage. [2025-10-10T20:15:07.134498] [INFO ] [MAIN ] MP: Loaded 54081 existing records. [2025-10-10T20:15:07.321573] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:15:07.321831] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-10T20:15:07.321880] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-10T20:15:07.323028] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-10-10T20:15:07.323088] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-10T20:15:07.498770] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-10T20:15:07.704388] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:15:08.289393] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-10-10T20:15:08.833744] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T20:15:09.089376] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-10T20:15:09.205244] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-10T20:15:09.813707] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T20:15:09.889365] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-10T20:15:10.199955] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T20:15:10.689386] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-10T20:15:11.489387] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-10T20:15:11.982750] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-10T20:15:12.289362] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-10T20:15:12.610860] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T20:15:12.908267] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-10T20:15:13.089381] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-10T20:15:13.889462] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-10T20:15:14.248092] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T20:15:14.689391] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-10T20:15:14.751348] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T20:15:15.489362] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-10T20:15:15.797317] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-10T20:15:16.289426] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-10T20:15:16.680312] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-10T20:15:16.779230] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T20:15:17.089380] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-10T20:15:17.796457] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-10T20:15:17.889352] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-10T20:15:18.303630] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-10T20:15:18.689385] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-10T20:15:19.489367] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-10T20:15:19.759634] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T20:15:19.764389] [INFO ] [REMOTE ] MODG: Full fetch complete (74760 records). [2025-10-10T20:15:19.764524] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-10T20:15:20.153953] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-10T20:15:20.154038] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-10T20:15:20.155029] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-10T20:15:20.155091] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-10T20:15:20.156559] [DEBUG] [LOCAL ] MODG: Trimmed 74760 records to 52294 (keeping 200 days of data) [2025-10-10T20:15:20.318267] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-10T20:15:20.456247] [DEBUG] [LOCAL ] MODG: Primary data saved (52294 records). [2025-10-10T20:15:20.456556] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-10T20:15:20.456724] [INFO ] [MAIN ] Update Progress: 1388/2373 symbols completed. MODG took 40.7s. Estimated remaining: 2h 18m 35s. Rate: 7.1 symbols/min [2025-10-10T20:15:20.623181] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:15:20.630144] [DEBUG] [LOCAL ] MPA: Loaded 5342 existing records from primary storage. [2025-10-10T20:15:20.630359] [INFO ] [MAIN ] MPA: Loaded 5342 existing records. [2025-10-10T20:15:20.805884] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T20:15:20.806122] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-10T20:15:20.806263] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-10T20:15:20.806633] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-10T20:15:20.806723] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-10T20:15:21.000041] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-10T20:15:21.120798] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-10T20:15:21.211275] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:15:21.497696] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-10T20:15:21.533587] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T20:15:21.889401] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-10T20:15:22.689392] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-10-10T20:15:23.354661] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-10T20:15:23.397399] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-10T20:15:23.489351] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-10T20:15:23.905767] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-10T20:15:24.289427] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-10T20:15:25.089404] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-10T20:15:25.898800] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-10T20:15:25.922069] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-10T20:15:26.108246] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T20:15:26.252511] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-10T20:15:26.309555] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T20:15:26.689357] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-10T20:15:27.489394] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-10T20:15:27.848385] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-10T20:15:28.289395] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-10T20:15:29.001992] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T20:15:29.089423] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-10T20:15:29.586744] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T20:15:29.751959] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-10T20:15:29.889367] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-10T20:15:30.689398] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-10T20:15:31.489356] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-10T20:15:31.555108] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T20:15:31.907982] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-10T20:15:32.289361] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-10T20:15:32.594261] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-10T20:15:32.596398] [INFO ] [REMOTE ] MOV: Full fetch complete (30582 records). [2025-10-10T20:15:32.596473] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-10T20:15:32.974096] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-10T20:15:32.974190] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-10T20:15:32.974873] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-10T20:15:32.974936] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-10T20:15:32.975796] [DEBUG] [LOCAL ] MOV: Trimmed 30582 records to 22106 (keeping 200 days of data) [2025-10-10T20:15:33.089354] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-10T20:15:33.109751] [DEBUG] [LOCAL ] MOV: Primary data saved (22106 records). [2025-10-10T20:15:33.109836] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-10T20:15:33.109911] [INFO ] [MAIN ] Update Progress: 1389/2373 symbols completed. MOV took 28.6s. Estimated remaining: 2h 18m 29s. Rate: 7.1 symbols/min [2025-10-10T20:15:33.282272] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:15:33.282526] [DEBUG] [LOCAL ] MPC: No existing data file found in primary storage. [2025-10-10T20:15:33.282590] [WARN ] [MAIN ] MPC: No existing data found, performing full refresh instead. [2025-10-10T20:15:33.282755] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-10T20:15:33.282810] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-10T20:15:33.282889] [DEBUG] [LOCAL ] MPC: No primary data file found to delete. [2025-10-10T20:15:33.282983] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-10T20:15:33.651783] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:15:33.861816] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-10T20:15:33.889327] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-10T20:15:34.379910] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-10T20:15:34.596331] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-10T20:15:34.689389] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-10T20:15:35.489433] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-10T20:15:36.190555] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-10T20:15:36.289352] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-10T20:15:36.695821] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-10T20:15:36.701057] [INFO ] [REMOTE ] MOS: Full fetch complete (77456 records). [2025-10-10T20:15:36.701250] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-10T20:15:37.093779] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-10T20:15:37.093453] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-10-10T20:15:37.094686] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-10T20:15:37.095854] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-10T20:15:37.096050] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-10T20:15:37.098547] [DEBUG] [LOCAL ] MOS: Trimmed 77456 records to 54284 (keeping 200 days of data) [2025-10-10T20:15:37.428536] [DEBUG] [LOCAL ] MOS: Primary data saved (54284 records). [2025-10-10T20:15:37.428733] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-10T20:15:37.428833] [INFO ] [MAIN ] Update Progress: 1390/2373 symbols completed. MOS took 36.8s. Estimated remaining: 2h 18m 18s. Rate: 7.1 symbols/min [2025-10-10T20:15:37.597916] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:15:37.598106] [DEBUG] [LOCAL ] MPLX: No existing data file found in primary storage. [2025-10-10T20:15:37.598145] [WARN ] [MAIN ] MPLX: No existing data found, performing full refresh instead. [2025-10-10T20:15:37.598259] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-10T20:15:37.598300] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-10T20:15:37.598340] [DEBUG] [LOCAL ] MPLX: No primary data file found to delete. [2025-10-10T20:15:37.598372] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-10T20:15:37.894558] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-10T20:15:37.953707] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:15:38.651824] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T20:15:38.686565] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-10T20:15:38.708355] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-10-10T20:15:39.145249] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T20:15:39.489418] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-10T20:15:40.207705] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-10T20:15:40.289437] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-10T20:15:40.652373] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T20:15:41.089423] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-10T20:15:41.139136] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T20:15:41.140236] [INFO ] [REMOTE ] MPA: Full fetch complete (7105 records). [2025-10-10T20:15:41.140304] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-10T20:15:41.527188] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-10T20:15:41.527295] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-10T20:15:41.527523] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-10T20:15:41.527563] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-10T20:15:41.527988] [DEBUG] [LOCAL ] MPA: Trimmed 7105 records to 5365 (keeping 200 days of data) [2025-10-10T20:15:41.559542] [DEBUG] [LOCAL ] MPA: Primary data saved (5365 records). [2025-10-10T20:15:41.559624] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-10T20:15:41.559732] [INFO ] [MAIN ] Update Progress: 1391/2373 symbols completed. MPA took 21.1s. Estimated remaining: 2h 18m 6s. Rate: 7.1 symbols/min [2025-10-10T20:15:41.722458] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:15:41.722685] [DEBUG] [LOCAL ] MPV: No existing data file found in primary storage. [2025-10-10T20:15:41.722739] [WARN ] [MAIN ] MPV: No existing data found, performing full refresh instead. [2025-10-10T20:15:41.722848] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-10T20:15:41.722888] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-10T20:15:41.722936] [DEBUG] [LOCAL ] MPV: No primary data file found to delete. [2025-10-10T20:15:41.722967] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-10T20:15:41.891248] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-10T20:15:42.076853] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:15:42.689365] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-10T20:15:42.952986] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T20:15:43.489400] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-10-10T20:15:43.894822] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-10T20:15:44.289405] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-10T20:15:44.399382] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-10T20:15:44.897574] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-10T20:15:45.089382] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-10T20:15:45.889387] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-10T20:15:46.032038] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-10T20:15:46.595506] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-10T20:15:46.689373] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-10T20:15:47.489400] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-10T20:15:47.957982] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-10-10T20:15:48.289382] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-10T20:15:48.848827] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-10T20:15:49.089372] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-10T20:15:49.408224] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T20:15:49.889394] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-10T20:15:50.689422] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-10T20:15:50.820277] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-10T20:15:51.282577] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-10T20:15:51.448343] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-10T20:15:51.489333] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-10T20:15:51.781676] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T20:15:52.289413] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-10T20:15:52.392101] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-10T20:15:53.089369] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-10T20:15:53.807721] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-10T20:15:53.889395] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-10T20:15:54.689356] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-10T20:15:54.910105] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-10T20:15:54.915347] [INFO ] [REMOTE ] MP: Full fetch complete (77380 records). [2025-10-10T20:15:54.915548] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-10T20:15:55.327539] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-10T20:15:55.327634] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-10T20:15:55.328739] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-10T20:15:55.328805] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-10T20:15:55.330337] [DEBUG] [LOCAL ] MP: Trimmed 77380 records to 54471 (keeping 200 days of data) [2025-10-10T20:15:55.424794] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-10T20:15:55.506176] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-10T20:15:55.665439] [DEBUG] [LOCAL ] MP: Primary data saved (54471 records). [2025-10-10T20:15:55.665575] [INFO ] [MAIN ] MP: Full history saved. [2025-10-10T20:15:55.665677] [INFO ] [MAIN ] Update Progress: 1392/2373 symbols completed. MP took 48.8s. Estimated remaining: 2h 18m 2s. Rate: 7.1 symbols/min [2025-10-10T20:15:55.848166] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:15:55.848461] [DEBUG] [LOCAL ] MPW: No existing data file found in primary storage. [2025-10-10T20:15:55.848570] [WARN ] [MAIN ] MPW: No existing data found, performing full refresh instead. [2025-10-10T20:15:55.848794] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-10T20:15:55.848859] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-10T20:15:55.849000] [DEBUG] [LOCAL ] MPW: No primary data file found to delete. [2025-10-10T20:15:55.849114] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-10T20:15:56.252813] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:15:56.254582] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-10T20:15:56.289336] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-10T20:15:57.089367] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-10T20:15:57.478631] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T20:15:57.613312] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-10T20:15:57.882739] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-10T20:15:57.889326] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-10T20:15:58.548630] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-10T20:15:58.689418] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-10-10T20:15:59.489365] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-10T20:16:00.289349] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-10T20:16:00.965147] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-10T20:16:01.089347] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-10T20:16:01.573457] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-10T20:16:01.889373] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-10T20:16:02.689380] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-10T20:16:02.838254] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-10T20:16:02.888551] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-10T20:16:02.924201] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-10T20:16:03.489376] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-10T20:16:04.289373] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-10T20:16:04.828678] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-10T20:16:05.089470] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-10T20:16:05.605543] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-10T20:16:05.889353] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-10T20:16:05.943033] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-10T20:16:06.395470] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-10T20:16:06.689376] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-10T20:16:07.489370] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-10T20:16:08.205912] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-10T20:16:08.289382] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-10T20:16:08.633605] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T20:16:09.023842] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-10T20:16:09.089344] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-10T20:16:09.889399] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-10T20:16:10.570070] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-10T20:16:10.571716] [INFO ] [REMOTE ] MPV: Full fetch complete (7906 records). [2025-10-10T20:16:10.571829] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-10T20:16:10.693455] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-10T20:16:10.914832] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-10T20:16:11.011911] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-10T20:16:11.012186] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-10T20:16:11.012682] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-10T20:16:11.012883] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-10T20:16:11.013349] [DEBUG] [LOCAL ] MPV: Trimmed 7906 records to 4937 (keeping 200 days of data) [2025-10-10T20:16:11.045449] [DEBUG] [LOCAL ] MPV: Primary data saved (4937 records). [2025-10-10T20:16:11.045622] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-10T20:16:11.045751] [INFO ] [MAIN ] Update Progress: 1393/2373 symbols completed. MPV took 29.5s. Estimated remaining: 2h 17m 58s. Rate: 7.1 symbols/min [2025-10-10T20:16:11.229379] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:16:11.229668] [DEBUG] [LOCAL ] MPX: No existing data file found in primary storage. [2025-10-10T20:16:11.229824] [WARN ] [MAIN ] MPX: No existing data found, performing full refresh instead. [2025-10-10T20:16:11.230002] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-10T20:16:11.230078] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-10T20:16:11.230194] [DEBUG] [LOCAL ] MPX: No primary data file found to delete. [2025-10-10T20:16:11.230342] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-10T20:16:11.498162] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-10T20:16:11.529778] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-10T20:16:11.697354] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:16:11.769382] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T20:16:11.773844] [INFO ] [REMOTE ] MPC: Full fetch complete (75387 records). [2025-10-10T20:16:11.773982] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-10T20:16:11.774842] [FATAL] [VALIDATOR ] MPC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:16:11.774932] [FATAL] [MAIN ] MPC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:16:11.774975] [WARN ] [MAIN ] MPC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:16:11.775022] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-10T20:16:11.775078] [DEBUG] [LOCAL ] MPC: No primary data file found to delete. [2025-10-10T20:16:11.775113] [INFO ] [LOCAL ] MPC: Starting deletion of derivative data. [2025-10-10T20:16:11.775151] [DEBUG] [LOCAL ] MPC: No derivative data file found to delete. [2025-10-10T20:16:11.775209] [INFO ] [MAIN ] Update Progress: 1394/2373 symbols completed. MPC took 38.7s. Estimated remaining: 2h 17m 44s. Rate: 7.1 symbols/min [2025-10-10T20:16:11.939054] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:16:11.939241] [DEBUG] [LOCAL ] MQT: No existing data file found in primary storage. [2025-10-10T20:16:11.939278] [WARN ] [MAIN ] MQT: No existing data found, performing full refresh instead. [2025-10-10T20:16:11.939388] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-10T20:16:11.939429] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-10T20:16:11.939473] [DEBUG] [LOCAL ] MQT: No primary data file found to delete. [2025-10-10T20:16:11.939504] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-10T20:16:12.295765] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-10T20:16:12.327151] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:16:13.089445] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-10-10T20:16:13.565093] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T20:16:13.889373] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-10T20:16:14.265477] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-10T20:16:14.306418] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T20:16:14.689373] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-10T20:16:15.489354] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-10-10T20:16:15.749118] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-10T20:16:15.754312] [INFO ] [REMOTE ] MPLX: Full fetch complete (73678 records). [2025-10-10T20:16:15.754502] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-10T20:16:15.755368] [FATAL] [VALIDATOR ] MPLX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:16:15.755462] [FATAL] [MAIN ] MPLX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:16:15.755531] [WARN ] [MAIN ] MPLX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:16:15.755600] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-10T20:16:15.755690] [DEBUG] [LOCAL ] MPLX: No primary data file found to delete. [2025-10-10T20:16:15.755745] [INFO ] [LOCAL ] MPLX: Starting deletion of derivative data. [2025-10-10T20:16:15.755789] [DEBUG] [LOCAL ] MPLX: No derivative data file found to delete. [2025-10-10T20:16:15.755868] [INFO ] [MAIN ] Update Progress: 1395/2373 symbols completed. MPLX took 38.3s. Estimated remaining: 2h 17m 33s. Rate: 7.1 symbols/min [2025-10-10T20:16:15.933571] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:16:15.933908] [DEBUG] [LOCAL ] MQY: No existing data file found in primary storage. [2025-10-10T20:16:15.934013] [WARN ] [MAIN ] MQY: No existing data found, performing full refresh instead. [2025-10-10T20:16:15.934155] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-10T20:16:15.934264] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-10T20:16:15.934325] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-10T20:16:15.934359] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-10T20:16:16.320826] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-10T20:16:16.362840] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:16:16.369100] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-10T20:16:16.456775] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-10T20:16:17.089397] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-10T20:16:17.756399] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T20:16:17.889378] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-10T20:16:18.689366] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-10-10T20:16:18.950773] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-10T20:16:19.491886] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-10T20:16:19.495438] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-10T20:16:19.917841] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-10T20:16:20.289356] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-10T20:16:20.432680] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-10T20:16:21.089380] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-10T20:16:21.705560] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-10T20:16:21.719668] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-10T20:16:21.889424] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-10T20:16:22.689382] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-10T20:16:22.834851] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-10T20:16:23.489390] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-10T20:16:23.999084] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T20:16:24.289399] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-10T20:16:24.333427] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-10T20:16:25.089374] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-10T20:16:25.889383] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-10T20:16:25.960483] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-10T20:16:26.397224] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-10T20:16:26.689405] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-10T20:16:27.168856] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T20:16:27.460355] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-10T20:16:27.489336] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-10T20:16:28.033567] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-10T20:16:28.289383] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-10T20:16:28.944573] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-10T20:16:29.089397] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-10T20:16:29.889412] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-10T20:16:30.689383] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-10T20:16:30.939713] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-10T20:16:31.175777] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-10T20:16:31.474812] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-10T20:16:31.489452] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-10T20:16:32.289421] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-10T20:16:33.089390] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-10T20:16:33.125554] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-10T20:16:33.271499] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T20:16:33.277262] [INFO ] [REMOTE ] MPW: Full fetch complete (77506 records). [2025-10-10T20:16:33.277445] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-10T20:16:33.707453] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-10T20:16:33.707566] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-10T20:16:33.708910] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-10T20:16:33.708986] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-10T20:16:33.711047] [DEBUG] [LOCAL ] MPW: Trimmed 77506 records to 54273 (keeping 200 days of data) [2025-10-10T20:16:33.895904] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-10T20:16:34.068594] [DEBUG] [LOCAL ] MPW: Primary data saved (54273 records). [2025-10-10T20:16:34.068811] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-10T20:16:34.068911] [INFO ] [MAIN ] Update Progress: 1396/2373 symbols completed. MPW took 38.4s. Estimated remaining: 2h 17m 31s. Rate: 7.1 symbols/min [2025-10-10T20:16:34.262929] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:16:34.263139] [DEBUG] [LOCAL ] MRC: No existing data file found in primary storage. [2025-10-10T20:16:34.263181] [WARN ] [MAIN ] MRC: No existing data found, performing full refresh instead. [2025-10-10T20:16:34.263307] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-10T20:16:34.263351] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-10T20:16:34.263393] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-10T20:16:34.263429] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-10T20:16:34.387059] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T20:16:34.680726] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:16:34.689344] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-10-10T20:16:34.694629] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-10T20:16:35.489410] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-10T20:16:36.283953] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-10T20:16:36.289396] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-10T20:16:36.384067] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T20:16:37.089410] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-10T20:16:37.353437] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-10T20:16:37.889408] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-10T20:16:38.689435] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-10T20:16:38.842034] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T20:16:38.856501] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-10T20:16:39.438009] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-10T20:16:39.489396] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-10T20:16:40.289401] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-10T20:16:40.399687] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T20:16:41.089399] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-10T20:16:41.786418] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-10T20:16:41.787548] [INFO ] [REMOTE ] MPX: Full fetch complete (6640 records). [2025-10-10T20:16:41.787617] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-10T20:16:41.895043] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-10T20:16:42.141959] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T20:16:42.219761] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-10T20:16:42.219846] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-10T20:16:42.220053] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-10T20:16:42.220135] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-10T20:16:42.220576] [DEBUG] [LOCAL ] MPX: Trimmed 6640 records to 4084 (keeping 200 days of data) [2025-10-10T20:16:42.246479] [DEBUG] [LOCAL ] MPX: Primary data saved (4084 records). [2025-10-10T20:16:42.246697] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-10T20:16:42.246802] [INFO ] [MAIN ] Update Progress: 1397/2373 symbols completed. MPX took 31.2s. Estimated remaining: 2h 17m 23s. Rate: 7.1 symbols/min [2025-10-10T20:16:42.689524] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-10T20:16:43.133705] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T20:16:43.489469] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-10T20:16:44.289415] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-10T20:16:44.525829] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T20:16:44.822000] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T20:16:45.089422] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-10T20:16:45.250290] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-10T20:16:45.889403] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-10T20:16:46.689476] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-10T20:16:46.736231] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T20:16:46.737898] [INFO ] [REMOTE ] MQT: Full fetch complete (13277 records). [2025-10-10T20:16:46.738288] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-10T20:16:47.045750] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T20:16:47.389199] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-10T20:16:47.389324] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-10T20:16:47.389929] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-10T20:16:47.390009] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-10T20:16:47.390925] [DEBUG] [LOCAL ] MQT: Trimmed 13277 records to 8745 (keeping 200 days of data) [2025-10-10T20:16:47.471500] [DEBUG] [LOCAL ] MQT: Primary data saved (8745 records). [2025-10-10T20:16:47.471710] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-10T20:16:47.471838] [INFO ] [MAIN ] Update Progress: 1398/2373 symbols completed. MQT took 35.7s. Estimated remaining: 2h 17m 12s. Rate: 7.1 symbols/min [2025-10-10T20:16:47.489590] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-10T20:16:47.906994] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T20:16:48.289465] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-10T20:16:48.957399] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T20:16:48.959992] [INFO ] [REMOTE ] MQY: Full fetch complete (26706 records). [2025-10-10T20:16:48.960138] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-10T20:16:48.960769] [FATAL] [VALIDATOR ] MQY: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:16:48.960860] [FATAL] [MAIN ] MQY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:16:48.960904] [WARN ] [MAIN ] MQY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:16:48.960946] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-10T20:16:48.961009] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-10T20:16:48.961048] [INFO ] [LOCAL ] MQY: Starting deletion of derivative data. [2025-10-10T20:16:48.961090] [DEBUG] [LOCAL ] MQY: No derivative data file found to delete. [2025-10-10T20:16:48.961203] [INFO ] [MAIN ] Update Progress: 1399/2373 symbols completed. MQY took 33.2s. Estimated remaining: 2h 16m 59s. Rate: 7.1 symbols/min [2025-10-10T20:16:49.460094] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T20:16:49.469332] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-10T20:16:51.094914] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T20:16:51.103151] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-10T20:16:52.646229] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-10T20:16:52.656555] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-10T20:16:54.343864] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T20:16:54.352524] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-10T20:16:56.248149] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T20:16:56.261364] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-10T20:16:57.052114] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-10T20:16:57.055292] [INFO ] [REMOTE ] MRC: Full fetch complete (54496 records). [2025-10-10T20:16:57.055381] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-10T20:16:57.055918] [FATAL] [VALIDATOR ] MRC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:16:57.056052] [FATAL] [MAIN ] MRC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:16:57.056093] [WARN ] [MAIN ] MRC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:16:57.056153] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-10T20:16:57.056221] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-10T20:16:57.056302] [INFO ] [LOCAL ] MRC: Starting deletion of derivative data. [2025-10-10T20:16:57.056402] [DEBUG] [LOCAL ] MRC: No derivative data file found to delete. [2025-10-10T20:16:57.056507] [INFO ] [MAIN ] Update Progress: 1400/2373 symbols completed. MRC took 23.0s. Estimated remaining: 2h 16m 50s. Rate: 7.1 symbols/min [2025-10-10T20:16:57.684136] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:16:57.767879] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-10-10T20:16:57.745536] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:16:57.768791] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:16:57.766306] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:16:57.768960] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-10T20:16:57.769238] [DEBUG] [LOCAL ] MS: No existing data file found in primary storage. [2025-10-10T20:16:57.769036] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-10-10T20:16:57.769303] [DEBUG] [LOCAL ] MSA: No existing data file found in primary storage. [2025-10-10T20:16:57.769695] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-10T20:16:57.769500] [WARN ] [MAIN ] MSA: No existing data found, performing full refresh instead. [2025-10-10T20:16:57.769174] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-10T20:16:57.769803] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-10T20:16:57.769455] [WARN ] [MAIN ] MS: No existing data found, performing full refresh instead. [2025-10-10T20:16:57.770047] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-10T20:16:57.770314] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-10T20:16:57.770272] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-10T20:16:57.770443] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-10T20:16:57.770555] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-10T20:16:57.770514] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-10T20:16:57.770754] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-10T20:16:57.782270] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-10T20:16:57.770699] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-10T20:16:57.787548] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-10T20:16:57.782363] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-10T20:16:57.840192] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-10T20:16:57.868157] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-10T20:16:57.854000] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-10T20:16:59.060247] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:16:59.122536] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:16:59.113155] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-10-10T20:16:59.122982] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-10-10T20:16:59.321879] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:16:59.339289] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-10-10T20:16:59.347041] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:16:59.347708] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-10-10T20:16:59.664868] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:16:59.665335] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-10-10T20:16:59.665439] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:16:59.665488] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-10T20:16:59.665540] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:16:59.665600] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-10T20:16:59.665703] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-10T20:16:59.665761] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-10T20:16:59.666060] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-10T20:16:59.666404] [INFO ] [MAIN ] Update Progress: 1401/2373 symbols completed. MRP took 2.6s. Estimated remaining: 2h 16m 38s. Rate: 7.1 symbols/min [2025-10-10T20:16:59.837142] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:16:59.837367] [DEBUG] [LOCAL ] MSB: No existing data file found in primary storage. [2025-10-10T20:16:59.837407] [WARN ] [MAIN ] MSB: No existing data found, performing full refresh instead. [2025-10-10T20:16:59.837526] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-10T20:16:59.837567] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-10T20:16:59.837610] [DEBUG] [LOCAL ] MSB: No primary data file found to delete. [2025-10-10T20:16:59.837665] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-10T20:17:00.220729] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:17:00.221330] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-10-10T20:17:00.268087] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-10T20:17:00.272374] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-10T20:17:00.765353] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-10T20:17:00.767258] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-10T20:17:01.567566] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T20:17:01.571579] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-10T20:17:01.730371] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-10T20:17:01.741988] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-10T20:17:01.757309] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-10T20:17:01.761730] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-10T20:17:01.911685] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-10-10T20:17:01.922514] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-10T20:17:02.841998] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-10T20:17:02.845347] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-10T20:17:02.940670] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T20:17:02.944414] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-10T20:17:03.643233] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T20:17:03.654116] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-10T20:17:03.897737] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-10T20:17:04.069694] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-10T20:17:04.199062] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-10T20:17:04.289435] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-10T20:17:05.089373] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-10T20:17:05.295884] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-10T20:17:05.484559] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T20:17:05.889431] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-10T20:17:06.689372] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-10T20:17:06.917864] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-10T20:17:07.489406] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-10T20:17:07.687735] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-10T20:17:08.116026] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-10T20:17:08.289357] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-10T20:17:09.089381] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-10T20:17:09.601894] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-10T20:17:09.889344] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-10T20:17:10.056132] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-10T20:17:10.689345] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-10T20:17:10.899717] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-10T20:17:11.489344] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-10T20:17:11.751704] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-10T20:17:12.214752] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-10T20:17:12.289337] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-10T20:17:13.089342] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-10T20:17:13.288029] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-10T20:17:13.881174] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-10T20:17:13.892012] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-10T20:17:13.961483] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-10T20:17:14.689348] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-10T20:17:14.853517] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-10T20:17:15.489472] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-10T20:17:16.289370] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-10T20:17:16.319333] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T20:17:16.321052] [INFO ] [REMOTE ] MSB: Full fetch complete (12927 records). [2025-10-10T20:17:16.321125] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-10T20:17:16.679888] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-10T20:17:16.679999] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-10T20:17:16.680418] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-10T20:17:16.680575] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-10T20:17:16.681252] [DEBUG] [LOCAL ] MSB: Trimmed 12927 records to 7881 (keeping 200 days of data) [2025-10-10T20:17:16.737085] [DEBUG] [LOCAL ] MSB: Primary data saved (7881 records). [2025-10-10T20:17:16.737268] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-10T20:17:16.737366] [INFO ] [MAIN ] Update Progress: 1402/2373 symbols completed. MSB took 17.1s. Estimated remaining: 2h 16m 35s. Rate: 7.1 symbols/min [2025-10-10T20:17:16.948262] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-10T20:17:16.952586] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:17:16.964857] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-10T20:17:16.965032] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-10T20:17:16.965598] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-10T20:17:16.965678] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-10T20:17:16.965747] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-10T20:17:16.965787] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-10T20:17:17.094561] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-10T20:17:17.341121] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:17:17.461526] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-10T20:17:17.889388] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-10-10T20:17:18.449512] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-10T20:17:18.689377] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-10T20:17:19.243633] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-10T20:17:19.489403] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-10T20:17:19.960832] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-10T20:17:20.289379] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-10T20:17:21.089382] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-10T20:17:21.890141] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-10T20:17:21.913359] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-10T20:17:21.974003] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-10T20:17:22.577027] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-10T20:17:22.689346] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-10T20:17:22.835241] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-10T20:17:23.489426] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-10T20:17:23.975332] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T20:17:24.289380] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-10T20:17:25.089453] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-10T20:17:25.572219] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T20:17:25.756512] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T20:17:25.761744] [INFO ] [REMOTE ] MSA: Full fetch complete (25572 records). [2025-10-10T20:17:25.761879] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-10T20:17:25.762395] [FATAL] [VALIDATOR ] MSA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:17:25.762478] [FATAL] [MAIN ] MSA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:17:25.762543] [WARN ] [MAIN ] MSA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:17:25.762616] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-10T20:17:25.762710] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-10T20:17:25.762759] [INFO ] [LOCAL ] MSA: Starting deletion of derivative data. [2025-10-10T20:17:25.762800] [DEBUG] [LOCAL ] MSA: No derivative data file found to delete. [2025-10-10T20:17:25.762857] [INFO ] [MAIN ] Update Progress: 1403/2373 symbols completed. MSA took 28.7s. Estimated remaining: 2h 16m 27s. Rate: 7.1 symbols/min [2025-10-10T20:17:25.902800] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-10T20:17:25.935155] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:17:25.935355] [DEBUG] [LOCAL ] MSCI: No existing data file found in primary storage. [2025-10-10T20:17:25.935398] [WARN ] [MAIN ] MSCI: No existing data found, performing full refresh instead. [2025-10-10T20:17:25.935508] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-10T20:17:25.935549] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-10T20:17:25.935588] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-10T20:17:25.935619] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-10T20:17:26.298029] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:17:26.689368] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-10-10T20:17:26.909689] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-10T20:17:27.489375] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-10T20:17:28.261786] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-10T20:17:28.289341] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-10T20:17:28.408354] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T20:17:29.089352] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-10T20:17:29.203381] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T20:17:29.209509] [INFO ] [REMOTE ] MS: Full fetch complete (77325 records). [2025-10-10T20:17:29.209802] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-10T20:17:29.210841] [FATAL] [VALIDATOR ] MS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:17:29.210937] [FATAL] [MAIN ] MS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:17:29.210984] [WARN ] [MAIN ] MS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:17:29.211028] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-10T20:17:29.211096] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-10T20:17:29.211135] [INFO ] [LOCAL ] MS: Starting deletion of derivative data. [2025-10-10T20:17:29.211177] [DEBUG] [LOCAL ] MS: No derivative data file found to delete. [2025-10-10T20:17:29.211250] [INFO ] [MAIN ] Update Progress: 1404/2373 symbols completed. MS took 32.1s. Estimated remaining: 2h 16m 15s. Rate: 7.1 symbols/min [2025-10-10T20:17:29.388271] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:17:29.388536] [DEBUG] [LOCAL ] MSD: No existing data file found in primary storage. [2025-10-10T20:17:29.388577] [WARN ] [MAIN ] MSD: No existing data found, performing full refresh instead. [2025-10-10T20:17:29.388739] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-10T20:17:29.388788] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-10T20:17:29.388879] [DEBUG] [LOCAL ] MSD: No primary data file found to delete. [2025-10-10T20:17:29.388916] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-10T20:17:29.760165] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:17:29.841517] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-10T20:17:29.889393] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-10T20:17:30.033810] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-10T20:17:30.689386] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-10T20:17:31.269261] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-10T20:17:31.489449] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-10T20:17:31.759169] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T20:17:32.289461] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-10-10T20:17:33.089416] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-10T20:17:33.427288] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-10T20:17:33.595310] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-10T20:17:33.889355] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-10T20:17:34.109353] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-10T20:17:34.389604] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-10T20:17:34.689434] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-10T20:17:35.489350] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-10T20:17:35.803517] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-10T20:17:35.864081] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-10T20:17:36.289397] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-10T20:17:36.886206] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-10T20:17:37.089381] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-10T20:17:37.889393] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-10T20:17:38.344721] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T20:17:38.689394] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-10T20:17:39.489467] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-10T20:17:39.757497] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-10T20:17:40.118663] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-10T20:17:40.289401] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-10T20:17:41.094587] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-10T20:17:41.110262] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-10T20:17:41.545617] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T20:17:41.889354] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-10T20:17:42.689365] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-10T20:17:42.987564] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-10T20:17:43.013734] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T20:17:43.489343] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-10T20:17:43.577999] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-10T20:17:43.582987] [INFO ] [REMOTE ] MRK: Full fetch complete (77467 records). [2025-10-10T20:17:43.583095] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-10T20:17:43.583918] [FATAL] [VALIDATOR ] MRK: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:17:43.584022] [FATAL] [MAIN ] MRK: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:17:43.584092] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:17:43.584183] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-10T20:17:43.584259] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-10T20:17:43.584297] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-10-10T20:17:43.584335] [DEBUG] [LOCAL ] MRK: No derivative data file found to delete. [2025-10-10T20:17:43.584395] [INFO ] [MAIN ] Update Progress: 1405/2373 symbols completed. MRK took 46.5s. Estimated remaining: 2h 16m 11s. Rate: 7.1 symbols/min [2025-10-10T20:17:43.749522] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:17:43.749686] [DEBUG] [LOCAL ] MSDL: No existing data file found in primary storage. [2025-10-10T20:17:43.749737] [WARN ] [MAIN ] MSDL: No existing data found, performing full refresh instead. [2025-10-10T20:17:43.749872] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-10T20:17:43.749932] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-10T20:17:43.749977] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-10T20:17:43.750010] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-10T20:17:44.101953] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:17:44.289347] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-10-10T20:17:44.715159] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-10T20:17:45.089370] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-10T20:17:45.864493] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-10T20:17:45.886564] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T20:17:45.893708] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-10T20:17:46.689357] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-10T20:17:47.471609] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-10T20:17:47.489334] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-10T20:17:48.289366] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-10T20:17:48.667148] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T20:17:49.100376] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-10T20:17:49.104986] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T20:17:49.302897] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-10T20:17:49.889404] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-10T20:17:50.689422] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-10T20:17:50.738927] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T20:17:51.176234] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T20:17:51.215116] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-10T20:17:51.216070] [INFO ] [REMOTE ] MSC: Full fetch complete (2537 records). [2025-10-10T20:17:51.216185] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-10T20:17:51.401864] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-10T20:17:51.402132] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:17:51.402205] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:17:51.402278] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-10T20:17:51.402350] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-10T20:17:51.402389] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-10T20:17:51.402429] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-10T20:17:51.402495] [INFO ] [MAIN ] Update Progress: 1406/2373 symbols completed. MSC took 34.7s. Estimated remaining: 2h 16m 2s. Rate: 7.1 symbols/min [2025-10-10T20:17:51.494604] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-10T20:17:51.586829] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:17:51.587086] [DEBUG] [LOCAL ] MSGE: No existing data file found in primary storage. [2025-10-10T20:17:51.587134] [WARN ] [MAIN ] MSGE: No existing data found, performing full refresh instead. [2025-10-10T20:17:51.587256] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-10T20:17:51.587298] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-10T20:17:51.587339] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-10T20:17:51.587372] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-10T20:17:51.968699] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:17:52.289436] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-10-10T20:17:53.035944] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-10T20:17:53.089364] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-10T20:17:53.847968] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-10T20:17:53.889350] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-10T20:17:54.360692] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T20:17:54.689438] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-10T20:17:55.489385] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-10T20:17:55.568798] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-10T20:17:56.289375] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-10T20:17:56.475528] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T20:17:56.587687] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-10T20:17:56.590509] [INFO ] [REMOTE ] MSD: Full fetch complete (22992 records). [2025-10-10T20:17:56.590578] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-10T20:17:56.956181] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-10T20:17:56.956289] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-10T20:17:56.956809] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-10T20:17:56.956870] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-10T20:17:56.957489] [DEBUG] [LOCAL ] MSD: Trimmed 22992 records to 16643 (keeping 200 days of data) [2025-10-10T20:17:57.053727] [DEBUG] [LOCAL ] MSD: Primary data saved (16643 records). [2025-10-10T20:17:57.053870] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-10T20:17:57.053943] [INFO ] [MAIN ] Update Progress: 1407/2373 symbols completed. MSD took 27.8s. Estimated remaining: 2h 15m 52s. Rate: 7.1 symbols/min [2025-10-10T20:17:57.098282] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-10T20:17:57.226117] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:17:57.226328] [DEBUG] [LOCAL ] MSGS: No existing data file found in primary storage. [2025-10-10T20:17:57.226366] [WARN ] [MAIN ] MSGS: No existing data found, performing full refresh instead. [2025-10-10T20:17:57.226495] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-10T20:17:57.226543] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-10T20:17:57.226586] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-10T20:17:57.226618] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-10T20:17:57.581628] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:17:57.705992] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T20:17:57.889400] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-10T20:17:58.484091] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T20:17:58.689410] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-10T20:17:59.396015] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-10T20:17:59.489381] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-10T20:18:00.257854] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-10T20:18:00.289339] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-10T20:18:01.089408] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-10T20:18:01.125536] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T20:18:01.889406] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-10T20:18:02.064396] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T20:18:02.689395] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-10-10T20:18:02.785786] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-10T20:18:02.929076] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-10T20:18:03.293329] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-10T20:18:03.489407] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-10T20:18:04.289420] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-10T20:18:05.089406] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-10T20:18:05.375457] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-10T20:18:05.497465] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-10T20:18:05.889392] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-10T20:18:06.513222] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-10T20:18:06.644383] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-10T20:18:06.689385] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-10T20:18:07.489400] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-10T20:18:08.289401] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-10T20:18:08.359131] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-10T20:18:08.775183] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T20:18:09.089406] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-10T20:18:09.786246] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T20:18:09.889410] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-10T20:18:10.689476] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-10T20:18:10.941691] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T20:18:11.489416] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-10T20:18:11.804539] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T20:18:12.095548] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-10T20:18:12.286923] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-10T20:18:12.289730] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-10T20:18:12.290948] [INFO ] [REMOTE ] MSCI: Full fetch complete (50065 records). [2025-10-10T20:18:12.291038] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-10T20:18:12.291843] [FATAL] [VALIDATOR ] MSCI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:18:12.292013] [FATAL] [MAIN ] MSCI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:18:12.292083] [WARN ] [MAIN ] MSCI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:18:12.292157] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-10T20:18:12.292224] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-10T20:18:12.292261] [INFO ] [LOCAL ] MSCI: Starting deletion of derivative data. [2025-10-10T20:18:12.292301] [DEBUG] [LOCAL ] MSCI: No derivative data file found to delete. [2025-10-10T20:18:12.292367] [INFO ] [MAIN ] Update Progress: 1408/2373 symbols completed. MSCI took 46.5s. Estimated remaining: 2h 15m 48s. Rate: 7.1 symbols/min [2025-10-10T20:18:12.475103] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:18:12.475363] [DEBUG] [LOCAL ] MSI: No existing data file found in primary storage. [2025-10-10T20:18:12.475422] [WARN ] [MAIN ] MSI: No existing data found, performing full refresh instead. [2025-10-10T20:18:12.475550] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-10T20:18:12.475594] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-10T20:18:12.475637] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-10T20:18:12.475719] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-10T20:18:12.849151] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:18:13.089448] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-10T20:18:13.889368] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-10T20:18:13.968994] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T20:18:14.445301] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-10T20:18:14.689431] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-10T20:18:15.150994] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-10T20:18:15.489400] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-10-10T20:18:15.650870] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T20:18:15.655431] [INFO ] [REMOTE ] MSDL: Full fetch complete (55140 records). [2025-10-10T20:18:15.655564] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-10T20:18:15.656347] [FATAL] [VALIDATOR ] MSDL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:18:15.656440] [FATAL] [MAIN ] MSDL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:18:15.656542] [WARN ] [MAIN ] MSDL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:18:15.656620] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-10T20:18:15.656727] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-10T20:18:15.656775] [INFO ] [LOCAL ] MSDL: Starting deletion of derivative data. [2025-10-10T20:18:15.656817] [DEBUG] [LOCAL ] MSDL: No derivative data file found to delete. [2025-10-10T20:18:15.656900] [INFO ] [MAIN ] Update Progress: 1409/2373 symbols completed. MSDL took 32.1s. Estimated remaining: 2h 15m 36s. Rate: 7.1 symbols/min [2025-10-10T20:18:15.830519] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:18:15.830757] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-10T20:18:15.830810] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-10T20:18:15.830922] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-10T20:18:15.830963] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-10T20:18:15.831003] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-10T20:18:15.831035] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-10T20:18:16.183216] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:18:16.289434] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-10-10T20:18:16.622713] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:18:16.623054] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-10-10T20:18:16.623145] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:18:16.623192] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-10-10T20:18:16.623253] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:18:16.623323] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-10T20:18:16.623385] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-10T20:18:16.623424] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-10T20:18:16.623480] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-10T20:18:16.623549] [INFO ] [MAIN ] Update Progress: 1410/2373 symbols completed. MSIF took 1.0s. Estimated remaining: 2h 15m 22s. Rate: 7.1 symbols/min [2025-10-10T20:18:16.817369] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:18:16.826891] [DEBUG] [LOCAL ] MSM: No existing data file found in primary storage. [2025-10-10T20:18:16.827689] [WARN ] [MAIN ] MSM: No existing data found, performing full refresh instead. [2025-10-10T20:18:16.827849] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-10T20:18:16.829113] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-10T20:18:16.828913] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T20:18:16.829319] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-10T20:18:16.837717] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-10T20:18:17.094591] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-10T20:18:17.193416] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:18:17.889405] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-10-10T20:18:18.228929] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-10T20:18:18.689403] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-10T20:18:19.289055] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T20:18:19.489386] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-10T20:18:20.295463] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-10T20:18:20.299082] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-10T20:18:20.550928] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-10T20:18:21.060836] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-10T20:18:21.089429] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-10T20:18:21.773133] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-10T20:18:21.776605] [INFO ] [REMOTE ] MSGE: Full fetch complete (39969 records). [2025-10-10T20:18:21.776976] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-10T20:18:21.777951] [FATAL] [VALIDATOR ] MSGE: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:18:21.778044] [FATAL] [MAIN ] MSGE: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:18:21.778093] [WARN ] [MAIN ] MSGE: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:18:21.778167] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-10T20:18:21.778241] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-10T20:18:21.778281] [INFO ] [LOCAL ] MSGE: Starting deletion of derivative data. [2025-10-10T20:18:21.778320] [DEBUG] [LOCAL ] MSGE: No derivative data file found to delete. [2025-10-10T20:18:21.778388] [INFO ] [MAIN ] Update Progress: 1411/2373 symbols completed. MSGE took 30.4s. Estimated remaining: 2h 15m 12s. Rate: 7.1 symbols/min [2025-10-10T20:18:21.894505] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-10T20:18:21.986520] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:18:21.986791] [DEBUG] [LOCAL ] MT: No existing data file found in primary storage. [2025-10-10T20:18:21.986839] [WARN ] [MAIN ] MT: No existing data found, performing full refresh instead. [2025-10-10T20:18:21.986993] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-10T20:18:21.987050] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-10T20:18:21.987095] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-10T20:18:21.987130] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-10T20:18:22.374903] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:18:22.689361] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-10T20:18:23.037689] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-10T20:18:23.489402] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-10T20:18:24.289451] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-10-10T20:18:24.345991] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-10T20:18:24.460743] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-10T20:18:25.089421] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-10T20:18:25.889402] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-10T20:18:26.238902] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-10T20:18:26.281695] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-10T20:18:26.689414] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-10T20:18:26.838940] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-10T20:18:27.489431] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-10T20:18:28.289450] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-10T20:18:28.615268] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-10T20:18:28.724985] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T20:18:29.089471] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-10T20:18:29.889373] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-10T20:18:29.988435] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-10T20:18:30.290022] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T20:18:30.689433] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-10T20:18:31.268434] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-10T20:18:31.380898] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T20:18:31.489460] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-10T20:18:32.277488] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-10T20:18:32.289436] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-10T20:18:33.089390] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-10T20:18:33.882295] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-10T20:18:33.890368] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-10T20:18:34.040841] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T20:18:34.689387] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-10T20:18:35.223344] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T20:18:35.489385] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-10T20:18:36.289413] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-10T20:18:36.971574] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-10T20:18:37.098234] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-10T20:18:37.122402] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T20:18:37.129659] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T20:18:37.129770] [INFO ] [REMOTE ] MSGS: Full fetch complete (23344 records). [2025-10-10T20:18:37.137080] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-10T20:18:37.138751] [FATAL] [VALIDATOR ] MSGS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:18:37.138855] [FATAL] [MAIN ] MSGS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:18:37.138944] [WARN ] [MAIN ] MSGS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:18:37.139044] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-10T20:18:37.139181] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-10T20:18:37.139271] [INFO ] [LOCAL ] MSGS: Starting deletion of derivative data. [2025-10-10T20:18:37.139354] [DEBUG] [LOCAL ] MSGS: No derivative data file found to delete. [2025-10-10T20:18:37.139421] [INFO ] [MAIN ] Update Progress: 1412/2373 symbols completed. MSGS took 40.1s. Estimated remaining: 2h 15m 8s. Rate: 7.1 symbols/min [2025-10-10T20:18:37.311630] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:18:37.311868] [DEBUG] [LOCAL ] MTAL: No existing data file found in primary storage. [2025-10-10T20:18:37.311976] [WARN ] [MAIN ] MTAL: No existing data found, performing full refresh instead. [2025-10-10T20:18:37.312105] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-10-10T20:18:37.312150] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-10-10T20:18:37.312195] [DEBUG] [LOCAL ] MTAL: No primary data file found to delete. [2025-10-10T20:18:37.312228] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-10-10T20:18:37.667543] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:18:37.889390] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-10-10T20:18:38.687343] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-10T20:18:38.692466] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-10-10T20:18:38.801489] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-10T20:18:39.489375] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-10T20:18:39.609049] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-10T20:18:40.289372] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-10T20:18:40.753015] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T20:18:41.089428] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-10-10T20:18:41.766088] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-10T20:18:41.889374] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-10T20:18:42.200439] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T20:18:42.689433] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-10T20:18:43.463447] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T20:18:43.489338] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-10T20:18:44.041739] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T20:18:44.289386] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-10-10T20:18:45.089370] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-10T20:18:45.664234] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T20:18:45.857392] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T20:18:45.889354] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-10-10T20:18:46.638042] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T20:18:46.689338] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-10T20:18:47.489358] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-10T20:18:47.700274] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T20:18:48.289378] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-10-10T20:18:48.315444] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T20:18:48.601181] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-10T20:18:49.089440] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-10T20:18:49.889377] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-10T20:18:49.992059] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T20:18:50.124046] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-10T20:18:50.689351] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-10-10T20:18:51.489425] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-10T20:18:51.897820] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T20:18:52.289359] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-10T20:18:52.451055] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T20:18:52.465869] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T20:18:52.469051] [INFO ] [REMOTE ] MSM: Full fetch complete (51628 records). [2025-10-10T20:18:52.469134] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-10T20:18:52.469625] [FATAL] [VALIDATOR ] MSM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:18:52.469727] [FATAL] [MAIN ] MSM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:18:52.469770] [WARN ] [MAIN ] MSM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:18:52.469832] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-10T20:18:52.469893] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-10T20:18:52.469927] [INFO ] [LOCAL ] MSM: Starting deletion of derivative data. [2025-10-10T20:18:52.469991] [DEBUG] [LOCAL ] MSM: No derivative data file found to delete. [2025-10-10T20:18:52.470069] [INFO ] [MAIN ] Update Progress: 1413/2373 symbols completed. MSM took 35.8s. Estimated remaining: 2h 15m 4s. Rate: 7.1 symbols/min [2025-10-10T20:18:52.638717] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:18:52.638949] [DEBUG] [LOCAL ] MTB: No existing data file found in primary storage. [2025-10-10T20:18:52.638989] [WARN ] [MAIN ] MTB: No existing data found, performing full refresh instead. [2025-10-10T20:18:52.639110] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-10T20:18:52.639153] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-10T20:18:52.639195] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-10T20:18:52.639229] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-10T20:18:53.000274] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:18:53.089353] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-10-10T20:18:53.889353] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-10-10T20:18:54.373596] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T20:18:54.689427] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-10T20:18:55.081352] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-10T20:18:55.475786] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-10T20:18:55.478940] [INFO ] [REMOTE ] MSI: Full fetch complete (57622 records). [2025-10-10T20:18:55.479040] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-10T20:18:55.479766] [FATAL] [VALIDATOR ] MSI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:18:55.479860] [FATAL] [MAIN ] MSI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:18:55.479934] [WARN ] [MAIN ] MSI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:18:55.480027] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-10T20:18:55.480133] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-10T20:18:55.480190] [INFO ] [LOCAL ] MSI: Starting deletion of derivative data. [2025-10-10T20:18:55.480234] [DEBUG] [LOCAL ] MSI: No derivative data file found to delete. [2025-10-10T20:18:55.480293] [INFO ] [MAIN ] Update Progress: 1414/2373 symbols completed. MSI took 43.2s. Estimated remaining: 2h 14m 52s. Rate: 7.1 symbols/min [2025-10-10T20:18:55.494429] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-10T20:18:55.692077] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:18:55.688683] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-10T20:18:55.701929] [DEBUG] [LOCAL ] MTD: No existing data file found in primary storage. [2025-10-10T20:18:55.702306] [WARN ] [MAIN ] MTD: No existing data found, performing full refresh instead. [2025-10-10T20:18:55.703319] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-10T20:18:55.703425] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-10T20:18:55.703507] [DEBUG] [LOCAL ] MTD: No primary data file found to delete. [2025-10-10T20:18:55.703554] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-10T20:18:56.095997] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:18:56.289390] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-10T20:18:57.089346] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-10-10T20:18:57.382867] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T20:18:57.387199] [INFO ] [REMOTE ] MT: Full fetch complete (73150 records). [2025-10-10T20:18:57.387319] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-10T20:18:57.388116] [FATAL] [VALIDATOR ] MT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:18:57.388206] [FATAL] [MAIN ] MT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:18:57.388250] [WARN ] [MAIN ] MT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:18:57.388317] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-10T20:18:57.388382] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-10T20:18:57.388422] [INFO ] [LOCAL ] MT: Starting deletion of derivative data. [2025-10-10T20:18:57.388513] [DEBUG] [LOCAL ] MT: No derivative data file found to delete. [2025-10-10T20:18:57.388604] [INFO ] [MAIN ] Update Progress: 1415/2373 symbols completed. MT took 35.6s. Estimated remaining: 2h 14m 39s. Rate: 7.1 symbols/min [2025-10-10T20:18:57.569015] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:18:57.569356] [DEBUG] [LOCAL ] MTDR: No existing data file found in primary storage. [2025-10-10T20:18:57.569440] [WARN ] [MAIN ] MTDR: No existing data found, performing full refresh instead. [2025-10-10T20:18:57.569788] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-10T20:18:57.570035] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-10T20:18:57.570126] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-10T20:18:57.570414] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-10T20:18:57.748433] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-10T20:18:57.898867] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-10T20:18:58.010982] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:18:58.146699] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-10T20:18:58.689384] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-10T20:18:59.489426] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-10-10T20:18:59.660611] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T20:18:59.742317] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T20:19:00.289375] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-10T20:19:00.929130] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T20:19:01.089369] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-10T20:19:01.504953] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-10T20:19:01.889425] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-10-10T20:19:02.689357] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-10-10T20:19:03.233738] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T20:19:03.489354] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-10T20:19:04.009236] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-10T20:19:04.095087] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T20:19:04.289386] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-10T20:19:05.013017] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-10T20:19:05.089428] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-10T20:19:05.889378] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-10. [2025-10-10T20:19:06.150451] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T20:19:06.223918] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-10T20:19:06.689380] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-10T20:19:06.722322] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T20:19:06.726293] [INFO ] [REMOTE ] MTAL: Full fetch complete (48301 records). [2025-10-10T20:19:06.726409] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-10-10T20:19:06.727014] [FATAL] [VALIDATOR ] MTAL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:19:06.727099] [FATAL] [MAIN ] MTAL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:19:06.727199] [WARN ] [MAIN ] MTAL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:19:06.727250] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-10-10T20:19:06.727335] [DEBUG] [LOCAL ] MTAL: No primary data file found to delete. [2025-10-10T20:19:06.727375] [INFO ] [LOCAL ] MTAL: Starting deletion of derivative data. [2025-10-10T20:19:06.727416] [DEBUG] [LOCAL ] MTAL: No derivative data file found to delete. [2025-10-10T20:19:06.727472] [INFO ] [MAIN ] Update Progress: 1416/2373 symbols completed. MTAL took 29.6s. Estimated remaining: 2h 14m 31s. Rate: 7.1 symbols/min [2025-10-10T20:19:06.894743] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:19:06.894960] [DEBUG] [LOCAL ] MTG: No existing data file found in primary storage. [2025-10-10T20:19:06.894999] [WARN ] [MAIN ] MTG: No existing data found, performing full refresh instead. [2025-10-10T20:19:06.895111] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-10T20:19:06.895152] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-10T20:19:06.895199] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-10T20:19:06.895236] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-10T20:19:07.268496] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:19:07.489413] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-10-10T20:19:07.911307] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-10T20:19:08.289429] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-10T20:19:09.089357] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-10T20:19:09.464156] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T20:19:09.889449] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-10T20:19:10.423315] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-10T20:19:10.689368] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-10T20:19:11.085753] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T20:19:11.197912] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T20:19:11.489374] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-10T20:19:11.657321] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-10T20:19:12.289378] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-10T20:19:13.089368] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-10T20:19:13.413178] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T20:19:13.889421] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-10T20:19:14.113778] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T20:19:14.455953] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T20:19:14.689398] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-10T20:19:15.489397] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-10T20:19:15.696802] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T20:19:16.289412] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-10T20:19:16.906829] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-10T20:19:17.033283] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-10T20:19:17.089360] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-10T20:19:17.590146] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-10T20:19:17.889426] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-10T20:19:18.670075] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-10T20:19:18.689443] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-10T20:19:19.082622] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T20:19:19.489402] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-10T20:19:20.289428] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-10T20:19:20.753024] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-10T20:19:21.089411] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-10T20:19:21.527385] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-10T20:19:21.889382] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-10T20:19:22.323385] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T20:19:22.689355] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-10T20:19:23.002994] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-10T20:19:23.489360] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-10T20:19:23.545944] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-10T20:19:24.291573] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-10T20:19:24.291683] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-10T20:19:25.089419] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-10T20:19:25.110421] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-10T20:19:25.395446] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-10T20:19:25.889371] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-10T20:19:26.689430] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-10T20:19:26.995402] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-10T20:19:27.489395] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-10T20:19:27.797456] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-10T20:19:27.820948] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T20:19:28.289397] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-10T20:19:29.089439] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-10T20:19:29.417524] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-10T20:19:29.423105] [INFO ] [REMOTE ] MTDR: Full fetch complete (73397 records). [2025-10-10T20:19:29.423695] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-10T20:19:29.425141] [FATAL] [VALIDATOR ] MTDR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:19:29.425265] [FATAL] [MAIN ] MTDR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:19:29.425311] [WARN ] [MAIN ] MTDR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:19:29.425384] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-10T20:19:29.425462] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-10T20:19:29.425500] [INFO ] [LOCAL ] MTDR: Starting deletion of derivative data. [2025-10-10T20:19:29.425542] [DEBUG] [LOCAL ] MTDR: No derivative data file found to delete. [2025-10-10T20:19:29.425626] [INFO ] [MAIN ] Update Progress: 1417/2373 symbols completed. MTDR took 32.0s. Estimated remaining: 2h 14m 33s. Rate: 7.1 symbols/min [2025-10-10T20:19:29.660551] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:19:29.661180] [DEBUG] [LOCAL ] MTH: No existing data file found in primary storage. [2025-10-10T20:19:29.661236] [WARN ] [MAIN ] MTH: No existing data found, performing full refresh instead. [2025-10-10T20:19:29.661375] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-10T20:19:29.661454] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-10T20:19:29.680511] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-10T20:19:29.694031] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-10T20:19:29.767741] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-10T20:19:29.849063] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T20:19:29.876888] [INFO ] [REMOTE ] MTD: Full fetch complete (21240 records). [2025-10-10T20:19:29.883602] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-10T20:19:29.911539] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-10T20:19:30.372483] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:19:30.529396] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-10-10T20:19:30.529501] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-10-10T20:19:30.530183] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-10-10T20:19:30.530267] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-10-10T20:19:30.531350] [DEBUG] [LOCAL ] MTD: Trimmed 21240 records to 15526 (keeping 200 days of data) [2025-10-10T20:19:30.644473] [DEBUG] [LOCAL ] MTD: Primary data saved (15526 records). [2025-10-10T20:19:30.644898] [INFO ] [MAIN ] MTD: Full history saved. [2025-10-10T20:19:30.644998] [INFO ] [MAIN ] Update Progress: 1418/2373 symbols completed. MTD took 35.2s. Estimated remaining: 2h 14m 19s. Rate: 7.1 symbols/min [2025-10-10T20:19:30.694690] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-10T20:19:30.832612] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:19:30.833038] [DEBUG] [LOCAL ] MTN: No existing data file found in primary storage. [2025-10-10T20:19:30.833081] [WARN ] [MAIN ] MTN: No existing data found, performing full refresh instead. [2025-10-10T20:19:30.833209] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-10T20:19:30.833251] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-10T20:19:30.833293] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-10T20:19:30.833326] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-10T20:19:31.200337] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:19:31.489450] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-10-10T20:19:31.743613] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T20:19:31.748167] [INFO ] [REMOTE ] MTB: Full fetch complete (67454 records). [2025-10-10T20:19:31.748291] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-10T20:19:31.749214] [FATAL] [VALIDATOR ] MTB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:19:31.749303] [FATAL] [MAIN ] MTB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:19:31.749367] [WARN ] [MAIN ] MTB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:19:31.749453] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-10T20:19:31.749546] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-10T20:19:31.749606] [INFO ] [LOCAL ] MTB: Starting deletion of derivative data. [2025-10-10T20:19:31.749680] [DEBUG] [LOCAL ] MTB: No derivative data file found to delete. [2025-10-10T20:19:31.749759] [INFO ] [MAIN ] Update Progress: 1419/2373 symbols completed. MTB took 39.3s. Estimated remaining: 2h 14m 6s. Rate: 7.1 symbols/min [2025-10-10T20:19:31.931983] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:19:31.932163] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-10T20:19:31.932202] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-10T20:19:31.932345] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-10T20:19:31.932416] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-10T20:19:31.932470] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-10T20:19:31.932505] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-10T20:19:32.284181] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-10T20:19:32.346045] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-10-10T20:19:32.352189] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:19:33.064923] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-10T20:19:33.089352] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-10T20:19:33.889378] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-10-10T20:19:34.145449] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T20:19:34.583005] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-10T20:19:34.689444] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-10T20:19:35.045187] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T20:19:35.489388] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-10T20:19:36.289371] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-10T20:19:36.643542] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T20:19:36.908755] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-10T20:19:37.089371] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-10T20:19:37.382298] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T20:19:37.472021] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-10T20:19:37.889436] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-10T20:19:38.689389] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-10T20:19:39.489402] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-10T20:19:39.709754] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T20:19:39.988857] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T20:19:40.289400] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-10T20:19:41.089446] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-10T20:19:41.474476] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-10T20:19:41.889421] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-10T20:19:42.585870] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-10T20:19:42.689420] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-10T20:19:42.885603] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T20:19:42.891791] [INFO ] [REMOTE ] MTG: Full fetch complete (73626 records). [2025-10-10T20:19:42.892030] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-10T20:19:42.893291] [FATAL] [VALIDATOR ] MTG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:19:42.893393] [FATAL] [MAIN ] MTG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:19:42.893505] [WARN ] [MAIN ] MTG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:19:42.893612] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-10T20:19:42.893762] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-10T20:19:42.893821] [INFO ] [LOCAL ] MTG: Starting deletion of derivative data. [2025-10-10T20:19:42.893868] [DEBUG] [LOCAL ] MTG: No derivative data file found to delete. [2025-10-10T20:19:42.893984] [INFO ] [MAIN ] Update Progress: 1420/2373 symbols completed. MTG took 36.2s. Estimated remaining: 2h 13m 59s. Rate: 7.1 symbols/min [2025-10-10T20:19:43.117218] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T20:19:43.121182] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:19:43.130712] [DEBUG] [LOCAL ] MTRN: No existing data file found in primary storage. [2025-10-10T20:19:43.130781] [WARN ] [MAIN ] MTRN: No existing data found, performing full refresh instead. [2025-10-10T20:19:43.130924] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-10T20:19:43.130990] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-10T20:19:43.131065] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-10T20:19:43.131101] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-10T20:19:43.502182] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-10T20:19:43.508882] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:19:44.289441] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-10T20:19:44.693548] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T20:19:44.798998] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-10T20:19:44.822746] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T20:19:45.089384] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-10T20:19:45.889417] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-10-10T20:19:46.689415] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-10T20:19:46.830382] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T20:19:47.023106] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T20:19:47.110523] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-10T20:19:47.489376] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-10T20:19:48.289374] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-10T20:19:48.541156] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-10T20:19:49.089380] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-10T20:19:49.889400] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-10T20:19:50.160676] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T20:19:50.171025] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-10T20:19:50.384199] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-10T20:19:50.689407] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-10T20:19:51.489384] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-10T20:19:52.289358] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-10T20:19:52.405350] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T20:19:52.405523] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-10T20:19:53.089367] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-10T20:19:53.750262] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-10T20:19:53.889369] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-10T20:19:53.958805] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T20:19:54.330081] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-10T20:19:54.689367] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-10T20:19:55.489385] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-10T20:19:55.739068] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-10T20:19:56.289370] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-10T20:19:57.089385] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-10T20:19:57.154365] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T20:19:57.486866] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-10T20:19:57.487624] [INFO ] [REMOTE ] MTR: Full fetch complete (2445 records). [2025-10-10T20:19:57.487719] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-10T20:19:57.672822] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T20:19:57.673372] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:19:57.673445] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:19:57.673518] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-10T20:19:57.673585] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-10T20:19:57.673621] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-10T20:19:57.673704] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-10T20:19:57.673807] [INFO ] [MAIN ] Update Progress: 1421/2373 symbols completed. MTR took 25.9s. Estimated remaining: 2h 13m 55s. Rate: 7.1 symbols/min [2025-10-10T20:19:57.843431] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:19:57.843593] [DEBUG] [LOCAL ] MTUS: No existing data file found in primary storage. [2025-10-10T20:19:57.843631] [WARN ] [MAIN ] MTUS: No existing data found, performing full refresh instead. [2025-10-10T20:19:57.843762] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-10T20:19:57.843804] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-10T20:19:57.843845] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-10T20:19:57.843878] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-10T20:19:57.896761] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-10T20:19:58.153917] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T20:19:58.237453] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:19:58.689437] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-10T20:19:59.489406] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-10T20:19:59.817032] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T20:20:00.289353] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-10T20:20:00.463182] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T20:20:00.795458] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-10T20:20:01.089373] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-10-10T20:20:01.889453] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-10T20:20:02.689409] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-10T20:20:03.417312] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-10T20:20:03.422218] [INFO ] [REMOTE ] MTN: Full fetch complete (56262 records). [2025-10-10T20:20:03.422426] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-10T20:20:03.423158] [FATAL] [VALIDATOR ] MTN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:20:03.423291] [FATAL] [MAIN ] MTN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:20:03.423335] [WARN ] [MAIN ] MTN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:20:03.423376] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-10T20:20:03.423435] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-10T20:20:03.423470] [INFO ] [LOCAL ] MTN: Starting deletion of derivative data. [2025-10-10T20:20:03.423512] [DEBUG] [LOCAL ] MTN: No derivative data file found to delete. [2025-10-10T20:20:03.423572] [INFO ] [MAIN ] Update Progress: 1422/2373 symbols completed. MTN took 32.8s. Estimated remaining: 2h 13m 45s. Rate: 7.1 symbols/min [2025-10-10T20:20:03.647615] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:20:03.648298] [DEBUG] [LOCAL ] MTW: No existing data file found in primary storage. [2025-10-10T20:20:03.648485] [WARN ] [MAIN ] MTW: No existing data found, performing full refresh instead. [2025-10-10T20:20:03.648748] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-10T20:20:03.648797] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-10T20:20:03.648841] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-10T20:20:03.648874] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-10T20:20:04.009171] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (2.92 seconds). [2025-10-10T20:20:04.044661] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (3.76 seconds). [2025-10-10T20:20:04.084579] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-10T20:20:04.119996] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-10T20:20:04.148340] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:20:04.289328] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-10T20:20:05.089387] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-10-10T20:20:05.651581] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T20:20:05.722772] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T20:20:05.889440] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-10T20:20:06.195365] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-10T20:20:06.579201] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-10T20:20:06.689375] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-10T20:20:07.489442] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-10T20:20:08.106997] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-10T20:20:08.289382] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-10T20:20:09.022952] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-10T20:20:09.089408] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-10T20:20:09.135729] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T20:20:09.140032] [INFO ] [REMOTE ] MTH: Full fetch complete (63106 records). [2025-10-10T20:20:09.140230] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-10T20:20:09.141226] [FATAL] [VALIDATOR ] MTH: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:20:09.141324] [FATAL] [MAIN ] MTH: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:20:09.141372] [WARN ] [MAIN ] MTH: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:20:09.141452] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-10T20:20:09.141564] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-10T20:20:09.141680] [INFO ] [LOCAL ] MTH: Starting deletion of derivative data. [2025-10-10T20:20:09.141749] [DEBUG] [LOCAL ] MTH: No derivative data file found to delete. [2025-10-10T20:20:09.141835] [INFO ] [MAIN ] Update Progress: 1423/2373 symbols completed. MTH took 39.7s. Estimated remaining: 2h 13m 35s. Rate: 7.1 symbols/min [2025-10-10T20:20:09.337745] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:20:09.337929] [DEBUG] [LOCAL ] MTX: No existing data file found in primary storage. [2025-10-10T20:20:09.337997] [WARN ] [MAIN ] MTX: No existing data found, performing full refresh instead. [2025-10-10T20:20:09.338119] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-10T20:20:09.338163] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-10T20:20:09.338207] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-10T20:20:09.338244] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-10T20:20:09.734045] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:20:09.889446] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-10T20:20:10.520291] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-10T20:20:10.660833] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-10T20:20:10.689408] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-10T20:20:11.489416] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-10-10T20:20:12.289366] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-10T20:20:12.389054] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-10T20:20:12.723922] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-10T20:20:13.089394] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-10T20:20:13.869300] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T20:20:13.889348] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-10T20:20:14.631061] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-10T20:20:14.689427] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-10T20:20:15.347178] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-10T20:20:15.489425] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-10T20:20:16.289376] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-10T20:20:16.331939] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T20:20:16.831369] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T20:20:17.089373] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-10T20:20:17.425055] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-10T20:20:17.889359] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-10T20:20:18.570636] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-10T20:20:18.689357] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-10T20:20:18.889437] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-10T20:20:19.489374] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-10T20:20:19.912528] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T20:20:20.289413] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-10T20:20:21.088323] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-10T20:20:21.094909] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-10T20:20:21.719225] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-10T20:20:21.889457] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-10T20:20:22.690044] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-10T20:20:22.692271] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-10T20:20:23.424689] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-10T20:20:23.489372] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-10T20:20:24.126562] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-10T20:20:24.289384] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-10T20:20:25.089400] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-10T20:20:25.152179] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-10T20:20:25.733466] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-10T20:20:25.889370] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-10T20:20:26.471471] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T20:20:26.689392] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-10T20:20:27.489344] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-10T20:20:27.563550] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T20:20:27.713590] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-10T20:20:28.289356] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-10T20:20:28.777105] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T20:20:29.089404] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-10T20:20:29.720023] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-10T20:20:29.889399] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-10T20:20:30.460921] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-10T20:20:30.462823] [INFO ] [REMOTE ] MTRN: Full fetch complete (23563 records). [2025-10-10T20:20:30.462952] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-10T20:20:30.463517] [FATAL] [VALIDATOR ] MTRN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:20:30.463597] [FATAL] [MAIN ] MTRN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:20:30.463678] [WARN ] [MAIN ] MTRN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:20:30.463761] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-10T20:20:30.463843] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-10T20:20:30.463891] [INFO ] [LOCAL ] MTRN: Starting deletion of derivative data. [2025-10-10T20:20:30.463932] [DEBUG] [LOCAL ] MTRN: No derivative data file found to delete. [2025-10-10T20:20:30.464001] [INFO ] [MAIN ] Update Progress: 1424/2373 symbols completed. MTRN took 47.6s. Estimated remaining: 2h 13m 35s. Rate: 7.1 symbols/min [2025-10-10T20:20:30.636352] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T20:20:30.653991] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:20:30.658908] [DEBUG] [LOCAL ] MTZ: No existing data file found in primary storage. [2025-10-10T20:20:30.658965] [WARN ] [MAIN ] MTZ: No existing data found, performing full refresh instead. [2025-10-10T20:20:30.659369] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-10T20:20:30.659416] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-10T20:20:30.659504] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-10T20:20:30.659543] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-10T20:20:30.694502] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-10T20:20:31.015421] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:20:31.489361] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-10T20:20:32.044827] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T20:20:32.289381] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-10-10T20:20:32.823063] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T20:20:33.089378] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-10T20:20:33.827062] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T20:20:33.830748] [INFO ] [REMOTE ] MTW: Full fetch complete (38018 records). [2025-10-10T20:20:33.830973] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-10T20:20:33.831874] [FATAL] [VALIDATOR ] MTW: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:20:33.832007] [FATAL] [MAIN ] MTW: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:20:33.832071] [WARN ] [MAIN ] MTW: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:20:33.832157] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-10T20:20:33.832248] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-10T20:20:33.832308] [INFO ] [LOCAL ] MTW: Starting deletion of derivative data. [2025-10-10T20:20:33.832374] [DEBUG] [LOCAL ] MTW: No derivative data file found to delete. [2025-10-10T20:20:33.832484] [INFO ] [MAIN ] Update Progress: 1425/2373 symbols completed. MTW took 30.4s. Estimated remaining: 2h 13m 23s. Rate: 7.1 symbols/min [2025-10-10T20:20:33.894701] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-10T20:20:34.069171] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:20:34.069621] [DEBUG] [LOCAL ] MUA: No existing data file found in primary storage. [2025-10-10T20:20:34.069779] [WARN ] [MAIN ] MUA: No existing data found, performing full refresh instead. [2025-10-10T20:20:34.069957] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-10T20:20:34.070029] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-10T20:20:34.070133] [DEBUG] [LOCAL ] MUA: No primary data file found to delete. [2025-10-10T20:20:34.070197] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-10T20:20:34.288234] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T20:20:34.496519] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:20:34.689404] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-10T20:20:34.939938] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T20:20:34.942240] [INFO ] [REMOTE ] MTUS: Full fetch complete (41378 records). [2025-10-10T20:20:34.942326] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-10T20:20:34.942883] [FATAL] [VALIDATOR ] MTUS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:20:34.942981] [FATAL] [MAIN ] MTUS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:20:34.943027] [WARN ] [MAIN ] MTUS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:20:34.943094] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-10T20:20:34.943168] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-10T20:20:34.943329] [INFO ] [LOCAL ] MTUS: Starting deletion of derivative data. [2025-10-10T20:20:34.943422] [DEBUG] [LOCAL ] MTUS: No derivative data file found to delete. [2025-10-10T20:20:34.943490] [INFO ] [MAIN ] Update Progress: 1426/2373 symbols completed. MTUS took 37.3s. Estimated remaining: 2h 13m 10s. Rate: 7.1 symbols/min [2025-10-10T20:20:35.121046] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:20:35.121263] [DEBUG] [LOCAL ] MUC: No existing data file found in primary storage. [2025-10-10T20:20:35.121314] [WARN ] [MAIN ] MUC: No existing data found, performing full refresh instead. [2025-10-10T20:20:35.121449] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-10T20:20:35.121501] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-10T20:20:35.121553] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-10T20:20:35.121593] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-10T20:20:35.482161] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:20:35.489390] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-10-10T20:20:36.289366] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-10-10T20:20:36.475971] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T20:20:36.526996] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-10T20:20:37.089403] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-10T20:20:37.795791] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-10T20:20:37.889342] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-10T20:20:38.689403] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-10T20:20:38.902935] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T20:20:39.200027] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T20:20:39.489367] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-10T20:20:39.551785] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-10T20:20:40.289353] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-10T20:20:40.778091] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T20:20:41.089347] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-10T20:20:41.452501] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T20:20:41.889534] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-10T20:20:42.689352] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-10T20:20:43.084002] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T20:20:43.105585] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-10T20:20:43.107586] [INFO ] [REMOTE ] MTX: Full fetch complete (31043 records). [2025-10-10T20:20:43.107691] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-10T20:20:43.108149] [FATAL] [VALIDATOR ] MTX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:20:43.108234] [FATAL] [MAIN ] MTX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:20:43.108305] [WARN ] [MAIN ] MTX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:20:43.108391] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-10T20:20:43.108472] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-10T20:20:43.108536] [INFO ] [LOCAL ] MTX: Starting deletion of derivative data. [2025-10-10T20:20:43.108596] [DEBUG] [LOCAL ] MTX: No derivative data file found to delete. [2025-10-10T20:20:43.108715] [INFO ] [MAIN ] Update Progress: 1427/2373 symbols completed. MTX took 34.0s. Estimated remaining: 2h 13m 1s. Rate: 7.1 symbols/min [2025-10-10T20:20:43.253618] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-10T20:20:43.300722] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:20:43.300882] [DEBUG] [LOCAL ] MUE: No existing data file found in primary storage. [2025-10-10T20:20:43.300918] [WARN ] [MAIN ] MUE: No existing data found, performing full refresh instead. [2025-10-10T20:20:43.301030] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-10T20:20:43.301126] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-10T20:20:43.301190] [DEBUG] [LOCAL ] MUE: No primary data file found to delete. [2025-10-10T20:20:43.301234] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-10T20:20:43.498934] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-10T20:20:43.662042] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:20:44.289365] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-10T20:20:45.089378] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-10T20:20:45.496627] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T20:20:45.651396] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T20:20:45.796560] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-10T20:20:45.889365] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-10T20:20:46.689399] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-10-10T20:20:47.100435] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T20:20:47.489428] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-10T20:20:47.896135] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-10T20:20:48.289377] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-10T20:20:49.089400] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-10T20:20:49.234956] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-10T20:20:49.431682] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-10T20:20:49.890203] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-10T20:20:49.893928] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-10T20:20:50.689399] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-10T20:20:51.489350] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-10T20:20:51.517512] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T20:20:52.051367] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-10T20:20:52.289343] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-10T20:20:52.434899] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-10T20:20:53.089381] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-10T20:20:53.889380] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-10T20:20:54.212244] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T20:20:54.293164] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-10T20:20:54.624997] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-10T20:20:54.689339] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-10T20:20:55.489368] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-10T20:20:56.092940] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-10T20:20:56.183920] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-10T20:20:56.289364] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-10T20:20:57.089340] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-10T20:20:57.889354] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-10T20:20:58.143817] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-10T20:20:58.238248] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-10T20:20:58.689351] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-10T20:20:59.254234] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-10T20:20:59.489403] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-10T20:21:00.155701] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T20:21:00.157730] [INFO ] [REMOTE ] MUC: Full fetch complete (29604 records). [2025-10-10T20:21:00.157803] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-10T20:21:00.158273] [FATAL] [VALIDATOR ] MUC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:21:00.158368] [FATAL] [MAIN ] MUC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:21:00.158457] [WARN ] [MAIN ] MUC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:21:00.158575] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-10T20:21:00.158698] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-10T20:21:00.158766] [INFO ] [LOCAL ] MUC: Starting deletion of derivative data. [2025-10-10T20:21:00.158815] [DEBUG] [LOCAL ] MUC: No derivative data file found to delete. [2025-10-10T20:21:00.158870] [INFO ] [MAIN ] Update Progress: 1428/2373 symbols completed. MUC took 25.2s. Estimated remaining: 2h 12m 58s. Rate: 7.1 symbols/min [2025-10-10T20:21:00.297741] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-10T20:21:00.334390] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:21:00.334629] [DEBUG] [LOCAL ] MUFG: No existing data file found in primary storage. [2025-10-10T20:21:00.334750] [WARN ] [MAIN ] MUFG: No existing data found, performing full refresh instead. [2025-10-10T20:21:00.334933] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-10T20:21:00.334982] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-10T20:21:00.335027] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-10T20:21:00.335062] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-10T20:21:00.770710] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T20:21:00.775810] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:21:01.089356] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-10T20:21:01.435573] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-10T20:21:01.889345] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-10T20:21:01.966738] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T20:21:01.970701] [INFO ] [REMOTE ] MTZ: Full fetch complete (63092 records). [2025-10-10T20:21:01.970810] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-10T20:21:01.971396] [FATAL] [VALIDATOR ] MTZ: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:21:01.971483] [FATAL] [MAIN ] MTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:21:01.971525] [WARN ] [MAIN ] MTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:21:01.971587] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-10T20:21:01.971665] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-10T20:21:01.971722] [INFO ] [LOCAL ] MTZ: Starting deletion of derivative data. [2025-10-10T20:21:01.971775] [DEBUG] [LOCAL ] MTZ: No derivative data file found to delete. [2025-10-10T20:21:01.971831] [INFO ] [MAIN ] Update Progress: 1429/2373 symbols completed. MTZ took 31.5s. Estimated remaining: 2h 12m 45s. Rate: 7.1 symbols/min [2025-10-10T20:21:02.138525] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:21:02.138762] [DEBUG] [LOCAL ] MUJ: No existing data file found in primary storage. [2025-10-10T20:21:02.138853] [WARN ] [MAIN ] MUJ: No existing data found, performing full refresh instead. [2025-10-10T20:21:02.138933] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-10T20:21:02.138970] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-10T20:21:02.139009] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-10T20:21:02.139041] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-10T20:21:02.485782] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:21:02.672145] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-10T20:21:02.689340] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-10-10T20:21:03.489341] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-10T20:21:04.025009] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T20:21:04.289346] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-10T20:21:04.492225] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-10T20:21:05.089391] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-10T20:21:05.356425] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-10T20:21:05.889402] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-10T20:21:06.306459] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T20:21:06.689394] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-10-10T20:21:07.200294] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T20:21:07.489445] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-10T20:21:08.289410] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-10T20:21:08.511700] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-10T20:21:08.821971] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-10T20:21:08.963319] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-10T20:21:09.089397] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-10T20:21:09.889347] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-10T20:21:09.960495] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T20:21:09.962161] [INFO ] [REMOTE ] MUA: Full fetch complete (18677 records). [2025-10-10T20:21:09.962233] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-10T20:21:10.321943] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-10T20:21:10.322028] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-10T20:21:10.322512] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-10T20:21:10.322553] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-10T20:21:10.323148] [DEBUG] [LOCAL ] MUA: Trimmed 18677 records to 11966 (keeping 200 days of data) [2025-10-10T20:21:10.395702] [DEBUG] [LOCAL ] MUA: Primary data saved (11966 records). [2025-10-10T20:21:10.395853] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-10T20:21:10.395926] [INFO ] [MAIN ] Update Progress: 1430/2373 symbols completed. MUA took 36.6s. Estimated remaining: 2h 12m 37s. Rate: 7.1 symbols/min [2025-10-10T20:21:10.563607] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:21:10.563850] [DEBUG] [LOCAL ] MUR: No existing data file found in primary storage. [2025-10-10T20:21:10.563892] [WARN ] [MAIN ] MUR: No existing data found, performing full refresh instead. [2025-10-10T20:21:10.564009] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-10T20:21:10.564050] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-10T20:21:10.564091] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-10T20:21:10.564122] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-10T20:21:10.702001] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-10T20:21:10.918847] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:21:11.489451] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-10T20:21:11.784528] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-10T20:21:11.912950] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T20:21:12.289437] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-10-10T20:21:12.716639] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-10T20:21:13.089459] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-10T20:21:13.889359] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-10T20:21:14.134481] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-10T20:21:14.136487] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T20:21:14.689349] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-10T20:21:15.021076] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T20:21:15.489411] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-10T20:21:15.842987] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T20:21:16.289388] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-10T20:21:17.089472] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-10T20:21:17.246999] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T20:21:17.248498] [INFO ] [REMOTE ] MUE: Full fetch complete (15867 records). [2025-10-10T20:21:17.248567] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-10T20:21:17.695312] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-10T20:21:17.695489] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-10T20:21:17.696317] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-10T20:21:17.696398] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-10T20:21:17.698361] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-10T20:21:17.709835] [DEBUG] [LOCAL ] MUE: Trimmed 15867 records to 12230 (keeping 200 days of data) [2025-10-10T20:21:17.787818] [DEBUG] [LOCAL ] MUE: Primary data saved (12230 records). [2025-10-10T20:21:17.787988] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-10T20:21:17.788068] [INFO ] [MAIN ] Update Progress: 1431/2373 symbols completed. MUE took 34.7s. Estimated remaining: 2h 12m 28s. Rate: 7.1 symbols/min [2025-10-10T20:21:17.897278] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-10T20:21:17.981336] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:21:17.982819] [DEBUG] [LOCAL ] MUSA: No existing data file found in primary storage. [2025-10-10T20:21:17.982684] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-10T20:21:17.982920] [WARN ] [MAIN ] MUSA: No existing data found, performing full refresh instead. [2025-10-10T20:21:17.986276] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-10T20:21:17.986843] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-10T20:21:17.986912] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-10T20:21:17.986991] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-10T20:21:18.340615] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:21:18.689406] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-10T20:21:19.489355] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-10T20:21:19.929381] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T20:21:20.118459] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-10T20:21:20.289419] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-10-10T20:21:21.089404] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-10T20:21:21.487437] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-10T20:21:21.778355] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-10T20:21:21.889391] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-10T20:21:22.347573] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-10T20:21:22.689366] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-10T20:21:23.272401] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-10T20:21:23.387323] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-10T20:21:23.489373] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-10T20:21:24.289384] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-10T20:21:24.780797] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T20:21:25.089429] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-10T20:21:25.889377] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-10T20:21:26.542524] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-10T20:21:26.544601] [INFO ] [REMOTE ] MUJ: Full fetch complete (19830 records). [2025-10-10T20:21:26.544714] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-10T20:21:26.580739] [FATAL] [VALIDATOR ] MUJ: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:21:26.584221] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-10T20:21:26.581520] [FATAL] [MAIN ] MUJ: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:21:26.595427] [WARN ] [MAIN ] MUJ: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:21:26.595903] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-10T20:21:26.596003] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-10T20:21:26.596062] [INFO ] [LOCAL ] MUJ: Starting deletion of derivative data. [2025-10-10T20:21:26.596118] [DEBUG] [LOCAL ] MUJ: No derivative data file found to delete. [2025-10-10T20:21:26.596207] [INFO ] [MAIN ] Update Progress: 1432/2373 symbols completed. MUJ took 24.6s. Estimated remaining: 2h 12m 20s. Rate: 7.1 symbols/min [2025-10-10T20:21:26.691877] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-10T20:21:26.790430] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:21:26.790778] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-10T20:21:26.790887] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-10T20:21:26.791007] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-10T20:21:26.791049] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-10T20:21:26.791091] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-10T20:21:26.791124] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-10T20:21:27.187367] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:21:27.232978] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-10T20:21:27.489496] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-10T20:21:28.289341] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-10-10T20:21:28.640413] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-10T20:21:28.801923] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-10T20:21:29.089361] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-10T20:21:29.442258] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:21:29.442581] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-10T20:21:29.442719] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:21:29.442802] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-10T20:21:29.442863] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:21:29.442935] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-10T20:21:29.442996] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-10T20:21:29.443030] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-10T20:21:29.443071] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-10T20:21:29.443124] [INFO ] [MAIN ] Update Progress: 1433/2373 symbols completed. MUSE took 2.8s. Estimated remaining: 2h 12m 8s. Rate: 7.1 symbols/min [2025-10-10T20:21:29.631721] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T20:21:29.699926] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:21:29.700157] [DEBUG] [LOCAL ] MUX: No existing data file found in primary storage. [2025-10-10T20:21:29.700202] [WARN ] [MAIN ] MUX: No existing data found, performing full refresh instead. [2025-10-10T20:21:29.700319] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-10T20:21:29.700362] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-10T20:21:29.700403] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-10T20:21:29.700436] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-10T20:21:29.895141] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-10T20:21:30.096977] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:21:30.689384] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-10T20:21:31.489431] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-10T20:21:32.107729] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-10T20:21:32.289349] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-10-10T20:21:32.723372] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T20:21:32.982398] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T20:21:33.089374] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-10T20:21:33.326794] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-10T20:21:33.889373] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-10T20:21:34.689356] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-10T20:21:34.758949] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T20:21:35.489396] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-10T20:21:35.682835] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-10T20:21:35.962283] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T20:21:36.289442] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-10T20:21:36.729934] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T20:21:37.089408] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-10T20:21:37.889395] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-10T20:21:38.038756] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T20:21:38.619993] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T20:21:38.689404] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-10T20:21:39.489433] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-10T20:21:40.289152] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-10T20:21:40.289726] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-10T20:21:40.528510] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T20:21:41.089385] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-10T20:21:41.187014] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T20:21:41.889401] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-10T20:21:42.506596] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-10T20:21:42.689458] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-10T20:21:43.161190] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-10T20:21:43.489401] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-10T20:21:43.685006] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-10T20:21:43.783882] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T20:21:44.289400] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-10T20:21:44.344787] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T20:21:44.349137] [INFO ] [REMOTE ] MUFG: Full fetch complete (75241 records). [2025-10-10T20:21:44.349281] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-10T20:21:44.349972] [FATAL] [VALIDATOR ] MUFG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:21:44.350066] [FATAL] [MAIN ] MUFG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:21:44.350110] [WARN ] [MAIN ] MUFG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:21:44.350149] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-10T20:21:44.350531] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-10T20:21:44.350784] [INFO ] [LOCAL ] MUFG: Starting deletion of derivative data. [2025-10-10T20:21:44.350849] [DEBUG] [LOCAL ] MUFG: No derivative data file found to delete. [2025-10-10T20:21:44.350973] [INFO ] [MAIN ] Update Progress: 1434/2373 symbols completed. MUFG took 44.2s. Estimated remaining: 2h 12m 3s. Rate: 7.1 symbols/min [2025-10-10T20:21:44.532625] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:21:44.532877] [DEBUG] [LOCAL ] MVF: No existing data file found in primary storage. [2025-10-10T20:21:44.532921] [WARN ] [MAIN ] MVF: No existing data found, performing full refresh instead. [2025-10-10T20:21:44.533050] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-10T20:21:44.533093] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-10T20:21:44.533136] [DEBUG] [LOCAL ] MVF: No primary data file found to delete. [2025-10-10T20:21:44.533171] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-10T20:21:44.920736] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:21:45.089383] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-10-10T20:21:45.717840] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-10T20:21:45.889360] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-10T20:21:46.393456] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-10T20:21:46.689381] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-10T20:21:47.489348] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-10T20:21:47.942520] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-10T20:21:48.289384] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-10T20:21:48.472240] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-10T20:21:48.503668] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T20:21:49.089385] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-10T20:21:49.370840] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T20:21:49.889395] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-10T20:21:50.689405] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-10T20:21:50.889582] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-10T20:21:51.327384] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-10T20:21:51.489374] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-10T20:21:51.735520] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-10T20:21:52.289366] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-10T20:21:53.089365] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-10T20:21:53.230333] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T20:21:53.246484] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-10T20:21:53.802419] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T20:21:53.804384] [INFO ] [REMOTE ] MUSA: Full fetch complete (34895 records). [2025-10-10T20:21:53.804455] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-10T20:21:53.804921] [FATAL] [VALIDATOR ] MUSA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:21:53.805113] [FATAL] [MAIN ] MUSA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:21:53.805210] [WARN ] [MAIN ] MUSA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:21:53.805284] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-10T20:21:53.805359] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-10T20:21:53.805400] [INFO ] [LOCAL ] MUSA: Starting deletion of derivative data. [2025-10-10T20:21:53.805441] [DEBUG] [LOCAL ] MUSA: No derivative data file found to delete. [2025-10-10T20:21:53.805497] [INFO ] [MAIN ] Update Progress: 1435/2373 symbols completed. MUSA took 36.0s. Estimated remaining: 2h 11m 56s. Rate: 7.1 symbols/min [2025-10-10T20:21:53.894515] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-10T20:21:53.979213] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:21:53.979363] [DEBUG] [LOCAL ] MVO: No existing data file found in primary storage. [2025-10-10T20:21:53.979399] [WARN ] [MAIN ] MVO: No existing data found, performing full refresh instead. [2025-10-10T20:21:53.979531] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-10T20:21:53.979590] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-10T20:21:53.979636] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-10-10T20:21:53.979749] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-10T20:21:54.328452] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:21:54.689410] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-10T20:21:55.489348] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-10T20:21:55.978371] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T20:21:56.091100] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-10T20:21:56.289392] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-10T20:21:56.754256] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-10T20:21:57.089380] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-10-10T20:21:57.889362] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-10T20:21:58.158040] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-10T20:21:58.195245] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-10T20:21:58.624824] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-10T20:21:58.689375] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-10T20:21:59.489383] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-10T20:22:00.286927] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-10T20:22:00.296397] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-10T20:22:00.587718] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-10T20:22:00.861855] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-10T20:22:00.866317] [INFO ] [REMOTE ] MUR: Full fetch complete (76175 records). [2025-10-10T20:22:00.866454] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-10T20:22:00.867168] [FATAL] [VALIDATOR ] MUR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:22:00.867252] [FATAL] [MAIN ] MUR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:22:00.867295] [WARN ] [MAIN ] MUR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:22:00.867333] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-10T20:22:00.867386] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-10T20:22:00.867444] [INFO ] [LOCAL ] MUR: Starting deletion of derivative data. [2025-10-10T20:22:00.867484] [DEBUG] [LOCAL ] MUR: No derivative data file found to delete. [2025-10-10T20:22:00.867540] [INFO ] [MAIN ] Update Progress: 1436/2373 symbols completed. MUR took 50.5s. Estimated remaining: 2h 11m 46s. Rate: 7.1 symbols/min [2025-10-10T20:22:01.034512] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:22:01.034728] [DEBUG] [LOCAL ] MVT: No existing data file found in primary storage. [2025-10-10T20:22:01.034777] [WARN ] [MAIN ] MVT: No existing data found, performing full refresh instead. [2025-10-10T20:22:01.034891] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-10T20:22:01.034933] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-10T20:22:01.034979] [DEBUG] [LOCAL ] MVT: No primary data file found to delete. [2025-10-10T20:22:01.035013] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-10T20:22:01.094631] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-10T20:22:01.403626] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:22:01.889375] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-10-10T20:22:02.503367] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-10T20:22:02.689398] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-10T20:22:03.228349] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T20:22:03.345679] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-10T20:22:03.349992] [INFO ] [REMOTE ] MUX: Full fetch complete (59794 records). [2025-10-10T20:22:03.350081] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-10T20:22:03.350621] [FATAL] [VALIDATOR ] MUX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:22:03.350727] [FATAL] [MAIN ] MUX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:22:03.350770] [WARN ] [MAIN ] MUX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:22:03.350808] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-10T20:22:03.350867] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-10T20:22:03.350900] [INFO ] [LOCAL ] MUX: Starting deletion of derivative data. [2025-10-10T20:22:03.350938] [DEBUG] [LOCAL ] MUX: No derivative data file found to delete. [2025-10-10T20:22:03.350989] [INFO ] [MAIN ] Update Progress: 1437/2373 symbols completed. MUX took 33.9s. Estimated remaining: 2h 11m 34s. Rate: 7.1 symbols/min [2025-10-10T20:22:03.489458] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-10T20:22:04.289446] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-10T20:22:04.578829] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-10T20:22:04.678883] [DEBUG] [REMOTE ] MVO: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-10T20:22:04.679253] [WARN ] [REMOTE ] MVO: No data returned for month 2025-02 [2025-10-10T20:22:04.679344] [FATAL] [REMOTE ] MVO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:22:04.679429] [FATAL] [MAIN ] MVO: Failed to fetch primary data. [2025-10-10T20:22:04.679488] [WARN ] [MAIN ] MVO: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:22:04.679537] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-10T20:22:04.679594] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-10-10T20:22:04.679637] [INFO ] [LOCAL ] MVO: Starting deletion of derivative data. [2025-10-10T20:22:04.679750] [DEBUG] [LOCAL ] MVO: No derivative data file found to delete. [2025-10-10T20:22:04.679804] [INFO ] [MAIN ] Update Progress: 1438/2373 symbols completed. MVO took 10.9s. Estimated remaining: 2h 11m 21s. Rate: 7.1 symbols/min [2025-10-10T20:22:05.089354] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-10T20:22:05.889487] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-10T20:22:06.165659] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T20:22:06.689402] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-10T20:22:06.877888] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-10T20:22:07.487202] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-10T20:22:07.490279] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-10T20:22:08.289341] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-10T20:22:08.300140] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-10T20:22:09.089366] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-10T20:22:09.251263] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T20:22:09.253301] [INFO ] [REMOTE ] MVF: Full fetch complete (18605 records). [2025-10-10T20:22:09.253388] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-10T20:22:09.627634] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-10T20:22:09.627748] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-10T20:22:09.628235] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-10T20:22:09.628275] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-10T20:22:09.628832] [DEBUG] [LOCAL ] MVF: Trimmed 18605 records to 13305 (keeping 200 days of data) [2025-10-10T20:22:09.706634] [DEBUG] [LOCAL ] MVF: Primary data saved (13305 records). [2025-10-10T20:22:09.706839] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-10T20:22:09.706918] [INFO ] [MAIN ] Update Progress: 1439/2373 symbols completed. MVF took 25.4s. Estimated remaining: 2h 11m 10s. Rate: 7.1 symbols/min [2025-10-10T20:22:10.095836] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-10T20:22:10.098587] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-10T20:22:10.758661] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-10T20:22:10.761810] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-10T20:22:11.757388] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-10T20:22:11.760060] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-10T20:22:12.401066] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-10T20:22:12.404412] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-10T20:22:13.443598] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-10T20:22:13.446162] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-10T20:22:14.542166] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-10T20:22:14.545142] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-10T20:22:15.605394] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-10T20:22:15.608627] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-10T20:22:16.415930] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T20:22:16.417413] [INFO ] [REMOTE ] MVT: Full fetch complete (14168 records). [2025-10-10T20:22:16.417491] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-10T20:22:16.807212] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-10T20:22:16.807350] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-10T20:22:16.807986] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-10T20:22:16.808063] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-10T20:22:16.808814] [DEBUG] [LOCAL ] MVT: Trimmed 14168 records to 10278 (keeping 200 days of data) [2025-10-10T20:22:16.885213] [DEBUG] [LOCAL ] MVT: Primary data saved (10278 records). [2025-10-10T20:22:16.885427] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-10T20:22:16.885525] [INFO ] [MAIN ] Update Progress: 1440/2373 symbols completed. MVT took 16.0s. Estimated remaining: 2h 11m 1s. Rate: 7.1 symbols/min [2025-10-10T20:22:17.539225] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:22:17.535844] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:22:17.572479] [DEBUG] [LOCAL ] MXF: No existing data file found in primary storage. [2025-10-10T20:22:17.572634] [WARN ] [MAIN ] MXF: No existing data found, performing full refresh instead. [2025-10-10T20:22:17.565582] [DEBUG] [LOCAL ] MX: No existing data file found in primary storage. [2025-10-10T20:22:17.603244] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-10T20:22:17.607618] [WARN ] [MAIN ] MX: No existing data found, performing full refresh instead. [2025-10-10T20:22:17.572321] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:22:17.623123] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-10T20:22:17.623030] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-10T20:22:17.623254] [DEBUG] [LOCAL ] MWA: No existing data file found in primary storage. [2025-10-10T20:22:17.629615] [DEBUG] [LOCAL ] MXF: No primary data file found to delete. [2025-10-10T20:22:17.629705] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-10T20:22:17.629966] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-10T20:22:17.629518] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:22:17.635441] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-10T20:22:17.630143] [WARN ] [MAIN ] MWA: No existing data found, performing full refresh instead. [2025-10-10T20:22:17.641366] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-10T20:22:17.650837] [DEBUG] [LOCAL ] MX: No primary data file found to delete. [2025-10-10T20:22:17.675244] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-10T20:22:17.675376] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-10T20:22:17.697436] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-10T20:22:17.702636] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-10T20:22:17.708002] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-10T20:22:17.723934] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-10T20:22:17.751456] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-10T20:22:17.763373] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-10T20:22:17.837244] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-10T20:22:18.990851] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:22:19.028479] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:22:19.048399] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-10-10T20:22:19.054989] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-10-10T20:22:19.118130] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:22:19.121361] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:22:19.122069] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-10-10T20:22:19.121741] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-10-10T20:22:19.773389] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-10T20:22:19.775158] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-10T20:22:20.129840] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-10T20:22:20.133730] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-10T20:22:20.349358] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-10T20:22:20.356517] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-10T20:22:20.425403] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-10T20:22:20.678011] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T20:22:21.089420] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-10T20:22:21.145735] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-10T20:22:21.490624] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-10T20:22:21.576530] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-10T20:22:21.889385] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-10T20:22:22.689366] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-10T20:22:23.272324] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T20:22:23.295255] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-10T20:22:23.489410] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-10T20:22:24.289413] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-10T20:22:24.554532] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-10T20:22:25.089393] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-10T20:22:25.889391] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-10T20:22:26.058284] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-10T20:22:26.171341] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-10T20:22:26.317018] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-10T20:22:26.689417] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-10T20:22:27.489719] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-10T20:22:27.715104] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-10T20:22:28.007049] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-10T20:22:28.289386] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-10T20:22:29.089417] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-10T20:22:29.626250] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-10T20:22:29.889360] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-10T20:22:29.921278] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T20:22:30.575543] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-10T20:22:30.689424] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-10T20:22:31.342121] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-10T20:22:31.489387] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-10T20:22:32.289394] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-10T20:22:32.935889] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-10T20:22:33.089460] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-10T20:22:33.383968] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T20:22:33.889349] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-10T20:22:34.093468] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-10T20:22:34.689364] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-10T20:22:35.269102] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-10T20:22:35.288783] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-10T20:22:35.489414] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-10T20:22:36.289398] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-10T20:22:37.089423] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-10T20:22:37.580314] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T20:22:37.698321] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-10T20:22:37.889376] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-10T20:22:37.967295] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-10T20:22:38.400031] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-10T20:22:38.400929] [INFO ] [REMOTE ] MXE: Full fetch complete (2640 records). [2025-10-10T20:22:38.400995] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-10T20:22:38.586808] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-10T20:22:38.587089] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:22:38.587137] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:22:38.587214] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-10T20:22:38.587278] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-10T20:22:38.587314] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-10T20:22:38.587351] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-10T20:22:38.587407] [INFO ] [MAIN ] Update Progress: 1441/2373 symbols completed. MXE took 21.7s. Estimated remaining: 2h 11m 1s. Rate: 7.1 symbols/min [2025-10-10T20:22:38.694639] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-10T20:22:38.782969] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:22:38.783303] [DEBUG] [LOCAL ] MYD: No existing data file found in primary storage. [2025-10-10T20:22:38.783347] [WARN ] [MAIN ] MYD: No existing data found, performing full refresh instead. [2025-10-10T20:22:38.783466] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-10T20:22:38.783529] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-10T20:22:38.783589] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-10T20:22:38.783622] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-10T20:22:39.138913] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:22:39.441026] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-10T20:22:39.489384] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-10T20:22:40.072938] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-10T20:22:40.289389] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-10T20:22:41.089376] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-10-10T20:22:41.571255] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T20:22:41.889381] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-10T20:22:42.357673] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-10T20:22:42.689341] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-10T20:22:43.175195] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T20:22:43.489422] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-10T20:22:43.718121] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-10T20:22:44.208789] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-10T20:22:44.209894] [INFO ] [REMOTE ] MXF: Full fetch complete (10030 records). [2025-10-10T20:22:44.209971] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-10T20:22:44.294732] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-10T20:22:44.596803] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-10T20:22:44.596915] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-10T20:22:44.597526] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-10T20:22:44.597583] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-10T20:22:44.598125] [DEBUG] [LOCAL ] MXF: Trimmed 10030 records to 5767 (keeping 200 days of data) [2025-10-10T20:22:44.641569] [DEBUG] [LOCAL ] MXF: Primary data saved (5767 records). [2025-10-10T20:22:44.641855] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-10T20:22:44.641981] [INFO ] [MAIN ] Update Progress: 1442/2373 symbols completed. MXF took 27.7s. Estimated remaining: 2h 10m 51s. Rate: 7.1 symbols/min [2025-10-10T20:22:44.839689] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:22:44.839930] [DEBUG] [LOCAL ] MYE: No existing data file found in primary storage. [2025-10-10T20:22:44.839969] [WARN ] [MAIN ] MYE: No existing data found, performing full refresh instead. [2025-10-10T20:22:44.840102] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-10T20:22:44.840165] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-10T20:22:44.840246] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-10T20:22:44.840317] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-10T20:22:45.094555] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-10T20:22:45.219383] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:22:45.889384] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-10T20:22:46.416596] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-10T20:22:46.689380] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-10T20:22:46.982497] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T20:22:47.055835] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-10T20:22:47.489451] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-10-10T20:22:48.289355] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-10T20:22:48.644406] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T20:22:48.997691] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-10T20:22:49.089339] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-10T20:22:49.701355] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T20:22:49.889385] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-10T20:22:50.482344] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-10T20:22:50.689386] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-10T20:22:51.086996] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T20:22:51.089436] [INFO ] [REMOTE ] MX: Full fetch complete (31749 records). [2025-10-10T20:22:51.089525] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-10T20:22:51.484848] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-10T20:22:51.484980] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-10T20:22:51.485746] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-10T20:22:51.485810] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-10T20:22:51.486753] [DEBUG] [LOCAL ] MX: Trimmed 31749 records to 22681 (keeping 200 days of data) [2025-10-10T20:22:51.531209] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-10T20:22:51.620280] [DEBUG] [LOCAL ] MX: Primary data saved (22681 records). [2025-10-10T20:22:51.620427] [INFO ] [MAIN ] MX: Full history saved. [2025-10-10T20:22:51.620499] [INFO ] [MAIN ] Update Progress: 1443/2373 symbols completed. MX took 34.7s. Estimated remaining: 2h 10m 42s. Rate: 7.1 symbols/min [2025-10-10T20:22:51.815428] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:22:51.815630] [DEBUG] [LOCAL ] MYI: No existing data file found in primary storage. [2025-10-10T20:22:51.815705] [WARN ] [MAIN ] MYI: No existing data found, performing full refresh instead. [2025-10-10T20:22:51.815824] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-10T20:22:51.815865] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-10T20:22:51.815906] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-10T20:22:51.815938] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-10T20:22:52.172966] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:22:52.289398] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-10T20:22:52.508359] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T20:22:53.089375] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-10T20:22:53.889371] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-10-10T20:23:05.812290] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (11.92 seconds). [2025-10-10T20:23:05.818293] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-10T20:23:06.408909] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (14.12 seconds). [2025-10-10T20:23:06.413204] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-10T20:23:06.460600] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (13.37 seconds). [2025-10-10T20:23:06.473570] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-10T20:23:06.804770] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (15.27 seconds). [2025-10-10T20:23:06.809824] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-10T20:23:07.615745] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T20:23:07.620186] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-10T20:23:07.890487] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-10T20:23:07.896008] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-10T20:23:08.033359] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T20:23:08.043503] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-10T20:23:08.595324] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T20:23:08.605352] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-10T20:23:08.975710] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-10T20:23:08.980435] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-10T20:23:09.035842] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-10T20:23:09.043803] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-10T20:23:09.436625] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-10T20:23:09.446126] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-10T20:23:09.803620] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-10T20:23:09.810300] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-10T20:23:09.932317] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-10T20:23:09.936037] [INFO ] [REMOTE ] MWA: Full fetch complete (67303 records). [2025-10-10T20:23:09.936133] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-10T20:23:09.937115] [FATAL] [VALIDATOR ] MWA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:23:09.937194] [FATAL] [MAIN ] MWA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:23:09.937262] [WARN ] [MAIN ] MWA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:23:09.937343] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-10T20:23:09.937421] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-10T20:23:09.937458] [INFO ] [LOCAL ] MWA: Starting deletion of derivative data. [2025-10-10T20:23:09.937496] [DEBUG] [LOCAL ] MWA: No derivative data file found to delete. [2025-10-10T20:23:09.937563] [INFO ] [MAIN ] Update Progress: 1444/2373 symbols completed. MWA took 53.1s. Estimated remaining: 2h 10m 40s. Rate: 7.1 symbols/min [2025-10-10T20:23:10.124053] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:23:10.127064] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T20:23:10.126511] [DEBUG] [LOCAL ] MYN: No existing data file found in primary storage. [2025-10-10T20:23:10.131537] [WARN ] [MAIN ] MYN: No existing data found, performing full refresh instead. [2025-10-10T20:23:10.132363] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-10T20:23:10.133205] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-10T20:23:10.133258] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-10T20:23:10.133304] [DEBUG] [LOCAL ] MYN: No primary data file found to delete. [2025-10-10T20:23:10.133337] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-10T20:23:10.266218] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T20:23:10.307202] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-10T20:23:10.502445] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:23:10.502762] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-10-10T20:23:11.251403] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-10T20:23:11.257409] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-10T20:23:11.467891] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T20:23:11.471106] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-10T20:23:11.527847] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-10T20:23:11.530709] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-10T20:23:11.732476] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-10T20:23:11.738778] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-10T20:23:12.230757] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-10T20:23:12.231876] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T20:23:12.237728] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-10T20:23:12.239303] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-10T20:23:12.668020] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T20:23:12.673971] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-10T20:23:12.869945] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-10T20:23:12.875724] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-10T20:23:12.936469] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T20:23:12.954056] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T20:23:13.089474] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-10T20:23:13.547926] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T20:23:13.550550] [INFO ] [REMOTE ] MYD: Full fetch complete (20291 records). [2025-10-10T20:23:13.550736] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-10T20:23:13.551736] [FATAL] [VALIDATOR ] MYD: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:23:13.552057] [FATAL] [MAIN ] MYD: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:23:13.552106] [WARN ] [MAIN ] MYD: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:23:13.552156] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-10T20:23:13.552228] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-10T20:23:13.552267] [INFO ] [LOCAL ] MYD: Starting deletion of derivative data. [2025-10-10T20:23:13.552308] [DEBUG] [LOCAL ] MYD: No derivative data file found to delete. [2025-10-10T20:23:13.552396] [INFO ] [MAIN ] Update Progress: 1445/2373 symbols completed. MYD took 35.0s. Estimated remaining: 2h 10m 28s. Rate: 7.1 symbols/min [2025-10-10T20:23:13.789453] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:23:13.789844] [DEBUG] [LOCAL ] NABL: No existing data file found in primary storage. [2025-10-10T20:23:13.789911] [WARN ] [MAIN ] NABL: No existing data found, performing full refresh instead. [2025-10-10T20:23:13.790069] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-10T20:23:13.790142] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-10T20:23:13.790368] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-10T20:23:13.790457] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-10T20:23:13.906380] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-10T20:23:13.971580] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T20:23:13.985187] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-10T20:23:14.202485] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:23:14.689373] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-10T20:23:15.272064] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T20:23:15.489425] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-10T20:23:15.835028] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T20:23:16.289398] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-10T20:23:16.776272] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T20:23:17.089355] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-10-10T20:23:17.512535] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-10T20:23:17.889382] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-10T20:23:18.689349] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-10T20:23:18.809398] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T20:23:19.183475] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T20:23:19.489391] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-10T20:23:19.664335] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-10T20:23:20.289388] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-10T20:23:20.679564] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-10T20:23:21.089424] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-10T20:23:21.374993] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-10T20:23:21.889391] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-10T20:23:22.491832] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-10T20:23:22.493803] [INFO ] [REMOTE ] MYI: Full fetch complete (28850 records). [2025-10-10T20:23:22.493881] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-10T20:23:22.494318] [FATAL] [VALIDATOR ] MYI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:23:22.494393] [FATAL] [MAIN ] MYI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:23:22.494458] [WARN ] [MAIN ] MYI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:23:22.494528] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-10T20:23:22.494589] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-10T20:23:22.494624] [INFO ] [LOCAL ] MYI: Starting deletion of derivative data. [2025-10-10T20:23:22.494700] [DEBUG] [LOCAL ] MYI: No derivative data file found to delete. [2025-10-10T20:23:22.494767] [INFO ] [MAIN ] Update Progress: 1446/2373 symbols completed. MYI took 30.9s. Estimated remaining: 2h 10m 20s. Rate: 7.1 symbols/min [2025-10-10T20:23:22.662586] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:23:22.662818] [DEBUG] [LOCAL ] NAC: No existing data file found in primary storage. [2025-10-10T20:23:22.662860] [WARN ] [MAIN ] NAC: No existing data found, performing full refresh instead. [2025-10-10T20:23:22.662970] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-10T20:23:22.663010] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-10T20:23:22.663049] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-10T20:23:22.663080] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-10T20:23:22.695904] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-10T20:23:22.805946] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-10T20:23:23.051480] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:23:23.489463] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-10-10T20:23:24.077105] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-10T20:23:24.289391] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-10T20:23:25.089428] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-10T20:23:25.180044] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T20:23:25.466231] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-10T20:23:25.889399] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-10T20:23:26.226873] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-10T20:23:26.689361] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-10T20:23:26.906996] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-10T20:23:27.402921] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T20:23:27.405057] [INFO ] [REMOTE ] MYE: Full fetch complete (36031 records). [2025-10-10T20:23:27.405130] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-10T20:23:27.405567] [FATAL] [VALIDATOR ] MYE: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:23:27.405681] [FATAL] [MAIN ] MYE: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:23:27.405734] [WARN ] [MAIN ] MYE: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:23:27.405800] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-10T20:23:27.405874] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-10T20:23:27.405928] [INFO ] [LOCAL ] MYE: Starting deletion of derivative data. [2025-10-10T20:23:27.405969] [DEBUG] [LOCAL ] MYE: No derivative data file found to delete. [2025-10-10T20:23:27.406022] [INFO ] [MAIN ] Update Progress: 1447/2373 symbols completed. MYE took 42.8s. Estimated remaining: 2h 10m 9s. Rate: 7.1 symbols/min [2025-10-10T20:23:27.494514] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-10T20:23:27.577916] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:23:27.578080] [DEBUG] [LOCAL ] NAD: No existing data file found in primary storage. [2025-10-10T20:23:27.578117] [WARN ] [MAIN ] NAD: No existing data found, performing full refresh instead. [2025-10-10T20:23:27.578224] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-10T20:23:27.578263] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-10T20:23:27.578302] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-10T20:23:27.578334] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-10T20:23:27.924877] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:23:28.289363] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-10T20:23:29.096922] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-10T20:23:29.117660] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T20:23:29.135017] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T20:23:29.136757] [INFO ] [REMOTE ] MYN: Full fetch complete (15110 records). [2025-10-10T20:23:29.136836] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-10T20:23:29.533579] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-10T20:23:29.533690] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-10T20:23:29.534128] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-10T20:23:29.534246] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-10T20:23:29.535020] [DEBUG] [LOCAL ] MYN: Trimmed 15110 records to 9975 (keeping 200 days of data) [2025-10-10T20:23:29.596424] [DEBUG] [LOCAL ] MYN: Primary data saved (9975 records). [2025-10-10T20:23:29.596578] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-10T20:23:29.596673] [INFO ] [MAIN ] Update Progress: 1448/2373 symbols completed. MYN took 19.7s. Estimated remaining: 2h 9m 57s. Rate: 7.1 symbols/min [2025-10-10T20:23:29.767582] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:23:29.767789] [DEBUG] [LOCAL ] NAN: No existing data file found in primary storage. [2025-10-10T20:23:29.767832] [WARN ] [MAIN ] NAN: No existing data found, performing full refresh instead. [2025-10-10T20:23:29.767952] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-10T20:23:29.767992] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-10T20:23:29.768032] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-10T20:23:29.768064] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-10T20:23:29.894605] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-10T20:23:30.133196] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:23:30.412417] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T20:23:30.689380] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-10T20:23:31.489359] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-10-10T20:23:31.880580] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T20:23:31.902520] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T20:23:32.289428] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-10T20:23:33.089423] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-10-10T20:23:33.182755] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T20:23:33.675272] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-10T20:23:33.769881] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-10T20:23:33.889360] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-10T20:23:34.689348] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-10T20:23:34.835013] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-10T20:23:35.489419] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-10T20:23:36.289417] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-10T20:23:36.343079] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T20:23:36.459514] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T20:23:37.089381] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-10T20:23:37.799779] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-10T20:23:37.889339] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-10T20:23:37.950015] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-10T20:23:38.689340] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-10T20:23:39.189851] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T20:23:39.489393] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-10T20:23:40.248952] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-10T20:23:40.289347] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-10T20:23:41.089362] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-10T20:23:41.229557] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T20:23:41.889376] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-10T20:23:41.981231] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T20:23:42.447683] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-10T20:23:42.689389] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-10T20:23:43.078851] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-10T20:23:43.482568] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-10T20:23:43.489332] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-10T20:23:44.289356] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-10T20:23:44.815243] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T20:23:45.089380] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-10T20:23:45.889401] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-10T20:23:45.972854] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-10T20:23:46.516558] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-10T20:23:46.689373] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-10T20:23:46.986223] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-10T20:23:47.445203] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T20:23:47.447687] [INFO ] [REMOTE ] NAC: Full fetch complete (35596 records). [2025-10-10T20:23:47.447820] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-10T20:23:47.448440] [FATAL] [VALIDATOR ] NAC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:23:47.448530] [FATAL] [MAIN ] NAC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:23:47.448573] [WARN ] [MAIN ] NAC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:23:47.448612] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-10T20:23:47.448696] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-10T20:23:47.448752] [INFO ] [LOCAL ] NAC: Starting deletion of derivative data. [2025-10-10T20:23:47.448795] [DEBUG] [LOCAL ] NAC: No derivative data file found to delete. [2025-10-10T20:23:47.448854] [INFO ] [MAIN ] Update Progress: 1449/2373 symbols completed. NAC took 25.0s. Estimated remaining: 2h 9m 55s. Rate: 7.1 symbols/min [2025-10-10T20:23:47.494449] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-10T20:23:47.630071] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:23:47.630286] [DEBUG] [LOCAL ] NAT: No existing data file found in primary storage. [2025-10-10T20:23:47.630325] [WARN ] [MAIN ] NAT: No existing data found, performing full refresh instead. [2025-10-10T20:23:47.630443] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-10T20:23:47.630485] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-10T20:23:47.630528] [DEBUG] [LOCAL ] NAT: No primary data file found to delete. [2025-10-10T20:23:47.630562] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-10T20:23:47.990138] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:23:48.289376] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-10T20:23:48.522865] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-10T20:23:49.089367] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-10T20:23:49.889390] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-10-10T20:23:49.929263] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T20:23:50.689389] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-10T20:23:50.873335] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T20:23:51.294279] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-10T20:23:51.489386] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-10T20:23:51.908503] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T20:23:52.289379] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-10T20:23:53.025212] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-10T20:23:53.089339] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-10T20:23:53.416585] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-10T20:23:53.889374] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-10T20:23:54.689368] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-10T20:23:54.866091] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T20:23:55.493814] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-10T20:23:55.495323] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-10T20:23:56.035830] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-10T20:23:56.289443] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-10T20:23:56.561237] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-10T20:23:57.089446] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-10T20:23:57.327213] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-10T20:23:57.889404] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-10T20:23:58.694738] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-10T20:23:58.706769] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-10T20:23:58.890085] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T20:23:58.893639] [INFO ] [REMOTE ] NABL: Full fetch complete (56568 records). [2025-10-10T20:23:58.893825] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-10T20:23:58.894443] [FATAL] [VALIDATOR ] NABL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:23:58.894528] [FATAL] [MAIN ] NABL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:23:58.894570] [WARN ] [MAIN ] NABL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:23:58.894633] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-10T20:23:58.894750] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-10T20:23:58.894790] [INFO ] [LOCAL ] NABL: Starting deletion of derivative data. [2025-10-10T20:23:58.894830] [DEBUG] [LOCAL ] NABL: No derivative data file found to delete. [2025-10-10T20:23:58.894887] [INFO ] [MAIN ] Update Progress: 1450/2373 symbols completed. NABL took 45.3s. Estimated remaining: 2h 9m 48s. Rate: 7.1 symbols/min [2025-10-10T20:23:59.080445] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:23:59.080613] [DEBUG] [LOCAL ] NATL: No existing data file found in primary storage. [2025-10-10T20:23:59.080686] [WARN ] [MAIN ] NATL: No existing data found, performing full refresh instead. [2025-10-10T20:23:59.080849] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-10T20:23:59.080915] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-10T20:23:59.080978] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-10T20:23:59.081013] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-10T20:23:59.481781] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:23:59.489342] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-10-10T20:23:59.754821] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-10T20:24:00.289387] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-10T20:24:01.089349] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-10T20:24:01.211518] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T20:24:01.407935] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T20:24:01.889435] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-10T20:24:02.266637] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T20:24:02.689373] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-10T20:24:03.172158] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-10T20:24:03.173366] [INFO ] [REMOTE ] NAN: Full fetch complete (13453 records). [2025-10-10T20:24:03.173442] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-10T20:24:03.173863] [FATAL] [VALIDATOR ] NAN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:24:03.173947] [FATAL] [MAIN ] NAN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:24:03.173990] [WARN ] [MAIN ] NAN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:24:03.174055] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-10T20:24:03.174116] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-10T20:24:03.174152] [INFO ] [LOCAL ] NAN: Starting deletion of derivative data. [2025-10-10T20:24:03.174192] [DEBUG] [LOCAL ] NAN: No derivative data file found to delete. [2025-10-10T20:24:03.174246] [INFO ] [MAIN ] Update Progress: 1451/2373 symbols completed. NAN took 33.6s. Estimated remaining: 2h 9m 37s. Rate: 7.1 symbols/min [2025-10-10T20:24:03.348209] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:24:03.348395] [DEBUG] [LOCAL ] NAZ: No existing data file found in primary storage. [2025-10-10T20:24:03.348432] [WARN ] [MAIN ] NAZ: No existing data found, performing full refresh instead. [2025-10-10T20:24:03.348550] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-10T20:24:03.348592] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-10T20:24:03.348633] [DEBUG] [LOCAL ] NAZ: No primary data file found to delete. [2025-10-10T20:24:03.348706] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-10T20:24:03.493588] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-10T20:24:03.599832] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T20:24:03.773110] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:24:04.289345] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-10T20:24:04.373901] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T20:24:04.377053] [INFO ] [REMOTE ] NAD: Full fetch complete (48965 records). [2025-10-10T20:24:04.377196] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-10T20:24:04.377961] [FATAL] [VALIDATOR ] NAD: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:24:04.378060] [FATAL] [MAIN ] NAD: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:24:04.378103] [WARN ] [MAIN ] NAD: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:24:04.378166] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-10T20:24:04.378228] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-10T20:24:04.378262] [INFO ] [LOCAL ] NAD: Starting deletion of derivative data. [2025-10-10T20:24:04.378300] [DEBUG] [LOCAL ] NAD: No derivative data file found to delete. [2025-10-10T20:24:04.378356] [INFO ] [MAIN ] Update Progress: 1452/2373 symbols completed. NAD took 37.0s. Estimated remaining: 2h 9m 24s. Rate: 7.1 symbols/min [2025-10-10T20:24:04.557158] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:24:04.557417] [DEBUG] [LOCAL ] NBB: No existing data file found in primary storage. [2025-10-10T20:24:04.557468] [WARN ] [MAIN ] NBB: No existing data found, performing full refresh instead. [2025-10-10T20:24:04.557587] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-10T20:24:04.557630] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-10T20:24:04.557712] [DEBUG] [LOCAL ] NBB: No primary data file found to delete. [2025-10-10T20:24:04.557754] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-10T20:24:04.906405] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:24:05.089425] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-10-10T20:24:05.889374] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-10-10T20:24:06.169451] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T20:24:06.286568] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-10T20:24:06.689484] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-10T20:24:06.706499] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-10T20:24:07.489371] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-10T20:24:07.671011] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-10T20:24:08.202750] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-10T20:24:08.289342] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-10T20:24:09.029078] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-10T20:24:09.089334] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-10T20:24:09.845242] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-10T20:24:09.889335] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-10T20:24:10.537445] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-10T20:24:10.689399] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-10T20:24:11.489439] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-10T20:24:12.055606] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T20:24:12.289388] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-10T20:24:13.089394] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-10T20:24:13.172605] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T20:24:13.864746] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-10T20:24:13.889380] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-10T20:24:14.048715] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T20:24:14.689361] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-10T20:24:15.489409] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-10T20:24:15.630529] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T20:24:15.650031] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T20:24:16.289374] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-10T20:24:16.509246] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-10T20:24:17.089413] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-10T20:24:17.889409] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-10T20:24:18.222959] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-10T20:24:18.426845] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-10T20:24:18.572246] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-10T20:24:18.689376] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-10T20:24:19.489351] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-10T20:24:19.672598] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-10T20:24:20.222808] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-10T20:24:20.289342] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-10T20:24:21.089392] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-10T20:24:21.251251] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-10T20:24:21.889401] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-10T20:24:22.689378] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-10T20:24:22.730491] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-10T20:24:23.070593] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T20:24:23.489373] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-10T20:24:24.149780] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-10T20:24:24.228182] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-10T20:24:24.289345] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-10T20:24:24.836333] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-10T20:24:24.837461] [INFO ] [REMOTE ] NAZ: Full fetch complete (4246 records). [2025-10-10T20:24:24.837535] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-10T20:24:25.095109] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-10T20:24:25.231994] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-10T20:24:25.232089] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-10T20:24:25.232313] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-10T20:24:25.232368] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-10T20:24:25.232787] [DEBUG] [LOCAL ] NAZ: Trimmed 4246 records to 2677 (keeping 200 days of data) [2025-10-10T20:24:25.250107] [DEBUG] [LOCAL ] NAZ: Primary data saved (2677 records). [2025-10-10T20:24:25.250193] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-10T20:24:25.250263] [INFO ] [MAIN ] Update Progress: 1453/2373 symbols completed. NAZ took 22.1s. Estimated remaining: 2h 9m 23s. Rate: 7.1 symbols/min [2025-10-10T20:24:25.430334] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:24:25.430564] [DEBUG] [LOCAL ] NBHC: No existing data file found in primary storage. [2025-10-10T20:24:25.430602] [WARN ] [MAIN ] NBHC: No existing data found, performing full refresh instead. [2025-10-10T20:24:25.430743] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-10T20:24:25.430786] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-10T20:24:25.430826] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-10T20:24:25.430857] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-10T20:24:25.810612] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:24:25.889345] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-10T20:24:25.995083] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-10T20:24:26.689390] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-10T20:24:27.390399] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-10T20:24:27.489381] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-10-10T20:24:28.289395] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-10T20:24:28.727595] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T20:24:28.811456] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T20:24:29.089396] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-10T20:24:29.888978] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-10T20:24:29.896076] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-10T20:24:30.372580] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T20:24:30.689443] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-10T20:24:31.489428] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-10T20:24:31.788473] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-10T20:24:32.165879] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-10T20:24:32.185576] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-10T20:24:32.289416] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-10T20:24:33.089386] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-10T20:24:33.889410] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-10T20:24:33.957831] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-10T20:24:34.464338] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T20:24:34.689388] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-10T20:24:34.879264] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-10T20:24:35.489394] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-10T20:24:36.115626] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-10T20:24:36.289400] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-10T20:24:36.341071] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T20:24:36.342681] [INFO ] [REMOTE ] NBB: Full fetch complete (13686 records). [2025-10-10T20:24:36.342764] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-10T20:24:36.725831] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-10T20:24:36.725913] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-10T20:24:36.726300] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-10T20:24:36.726339] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-10T20:24:36.726874] [DEBUG] [LOCAL ] NBB: Trimmed 13686 records to 9169 (keeping 200 days of data) [2025-10-10T20:24:36.783059] [DEBUG] [LOCAL ] NBB: Primary data saved (9169 records). [2025-10-10T20:24:36.783198] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-10T20:24:36.783271] [INFO ] [MAIN ] Update Progress: 1454/2373 symbols completed. NBB took 32.4s. Estimated remaining: 2h 9m 17s. Rate: 7.1 symbols/min [2025-10-10T20:24:36.952087] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:24:36.952303] [DEBUG] [LOCAL ] NBR: No existing data file found in primary storage. [2025-10-10T20:24:36.952341] [WARN ] [MAIN ] NBR: No existing data found, performing full refresh instead. [2025-10-10T20:24:36.952459] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-10T20:24:36.952500] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-10T20:24:36.952542] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-10T20:24:36.952574] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-10T20:24:37.094686] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-10T20:24:37.320251] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:24:37.889342] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-10-10T20:24:38.086379] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T20:24:38.113589] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T20:24:38.116297] [INFO ] [REMOTE ] NATL: Full fetch complete (45052 records). [2025-10-10T20:24:38.116375] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-10T20:24:38.116890] [FATAL] [VALIDATOR ] NATL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:24:38.116993] [FATAL] [MAIN ] NATL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:24:38.117038] [WARN ] [MAIN ] NATL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:24:38.117106] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-10T20:24:38.117170] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-10T20:24:38.117206] [INFO ] [LOCAL ] NATL: Starting deletion of derivative data. [2025-10-10T20:24:38.117246] [DEBUG] [LOCAL ] NATL: No derivative data file found to delete. [2025-10-10T20:24:38.117321] [INFO ] [MAIN ] Update Progress: 1455/2373 symbols completed. NATL took 39.2s. Estimated remaining: 2h 9m 4s. Rate: 7.1 symbols/min [2025-10-10T20:24:38.300620] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:24:38.300889] [DEBUG] [LOCAL ] NBXG: No existing data file found in primary storage. [2025-10-10T20:24:38.300931] [WARN ] [MAIN ] NBXG: No existing data found, performing full refresh instead. [2025-10-10T20:24:38.301059] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-10T20:24:38.301103] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-10T20:24:38.301145] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-10T20:24:38.301180] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-10T20:24:38.671083] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:24:38.689349] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-10T20:24:39.489344] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-10-10T20:24:39.676033] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T20:24:39.997630] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-10T20:24:40.289453] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-10T20:24:40.873008] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T20:24:41.089389] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-10T20:24:41.523125] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T20:24:41.889353] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-10T20:24:42.681092] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T20:24:42.689325] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-10T20:24:43.489431] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-10T20:24:43.905474] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-10T20:24:44.035418] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T20:24:44.289398] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-10T20:24:45.077520] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T20:24:45.089332] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-10T20:24:45.751504] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-10T20:24:45.889333] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-10T20:24:46.442590] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-10T20:24:46.689352] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-10T20:24:47.489349] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-10T20:24:47.633872] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-10T20:24:48.048056] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-10T20:24:48.289379] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-10T20:24:48.886247] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-10T20:24:49.089390] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-10T20:24:49.889360] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-10T20:24:49.993555] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-10T20:24:50.591127] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-10T20:24:50.593901] [INFO ] [REMOTE ] NBHC: Full fetch complete (32388 records). [2025-10-10T20:24:50.593993] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-10T20:24:50.594518] [FATAL] [VALIDATOR ] NBHC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:24:50.594604] [FATAL] [MAIN ] NBHC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:24:50.594695] [WARN ] [MAIN ] NBHC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:24:50.594770] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-10T20:24:50.594902] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-10T20:24:50.594968] [INFO ] [LOCAL ] NBHC: Starting deletion of derivative data. [2025-10-10T20:24:50.595027] [DEBUG] [LOCAL ] NBHC: No derivative data file found to delete. [2025-10-10T20:24:50.595100] [INFO ] [MAIN ] Update Progress: 1456/2373 symbols completed. NBHC took 25.3s. Estimated remaining: 2h 8m 58s. Rate: 7.1 symbols/min [2025-10-10T20:24:50.695557] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-10T20:24:50.771900] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:24:50.772094] [DEBUG] [LOCAL ] NC: No existing data file found in primary storage. [2025-10-10T20:24:50.772159] [WARN ] [MAIN ] NC: No existing data found, performing full refresh instead. [2025-10-10T20:24:50.772279] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-10T20:24:50.772329] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-10T20:24:50.772408] [DEBUG] [LOCAL ] NC: No primary data file found to delete. [2025-10-10T20:24:50.772460] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-10T20:24:51.188370] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:24:51.192636] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-10T20:24:51.489369] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-10T20:24:52.289372] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-10T20:24:52.377871] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T20:24:52.944341] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-10T20:24:53.089392] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-10T20:24:53.889350] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-10-10T20:24:53.991039] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-10T20:24:53.996057] [INFO ] [REMOTE ] NAT: Full fetch complete (72074 records). [2025-10-10T20:24:53.996220] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-10T20:24:54.403350] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-10T20:24:54.403441] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-10T20:24:54.404551] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-10T20:24:54.404624] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-10T20:24:54.406175] [DEBUG] [LOCAL ] NAT: Trimmed 72074 records to 49886 (keeping 200 days of data) [2025-10-10T20:24:54.627981] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-10T20:24:54.690108] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-10T20:24:54.712527] [DEBUG] [LOCAL ] NAT: Primary data saved (49886 records). [2025-10-10T20:24:54.715751] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T20:24:54.715207] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-10T20:24:54.721519] [INFO ] [MAIN ] Update Progress: 1457/2373 symbols completed. NAT took 1m 7s. Estimated remaining: 2h 8m 47s. Rate: 7.1 symbols/min [2025-10-10T20:24:54.897525] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:24:54.897715] [DEBUG] [LOCAL ] NCA: No existing data file found in primary storage. [2025-10-10T20:24:54.897764] [WARN ] [MAIN ] NCA: No existing data found, performing full refresh instead. [2025-10-10T20:24:54.897874] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-10T20:24:54.897921] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-10T20:24:54.897977] [DEBUG] [LOCAL ] NCA: No primary data file found to delete. [2025-10-10T20:24:54.898018] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-10T20:24:55.257850] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:24:55.489358] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-10-10T20:24:56.290806] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-10T20:24:56.292229] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-10T20:24:56.733380] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T20:24:57.089353] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-10T20:24:57.438223] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-10T20:24:57.889357] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-10T20:24:58.689344] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-10T20:24:58.787847] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-10T20:24:59.150336] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T20:24:59.489355] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-10T20:24:59.671213] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-10T20:25:00.222317] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-10T20:25:00.289365] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-10T20:25:01.089404] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-10T20:25:01.753943] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-10T20:25:01.766106] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-10T20:25:01.889391] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-10T20:25:02.689397] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-10T20:25:03.250220] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-10T20:25:03.489444] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-10T20:25:03.674227] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T20:25:04.289398] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-10T20:25:04.829781] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-10T20:25:05.089369] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-10T20:25:05.730364] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-10T20:25:05.889341] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-10T20:25:06.206001] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T20:25:06.656212] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T20:25:06.658344] [INFO ] [REMOTE ] NBXG: Full fetch complete (32498 records). [2025-10-10T20:25:06.658429] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-10T20:25:06.658925] [FATAL] [VALIDATOR ] NBXG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:25:06.659009] [FATAL] [MAIN ] NBXG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:25:06.659053] [WARN ] [MAIN ] NBXG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:25:06.659094] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-10T20:25:06.659148] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-10T20:25:06.659183] [INFO ] [LOCAL ] NBXG: Starting deletion of derivative data. [2025-10-10T20:25:06.659224] [DEBUG] [LOCAL ] NBXG: No derivative data file found to delete. [2025-10-10T20:25:06.659336] [INFO ] [MAIN ] Update Progress: 1458/2373 symbols completed. NBXG took 28.5s. Estimated remaining: 2h 8m 41s. Rate: 7.1 symbols/min [2025-10-10T20:25:06.694441] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-10T20:25:06.836433] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:25:06.836594] [DEBUG] [LOCAL ] NCDL: No existing data file found in primary storage. [2025-10-10T20:25:06.836631] [WARN ] [MAIN ] NCDL: No existing data found, performing full refresh instead. [2025-10-10T20:25:06.836758] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-10T20:25:06.836840] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-10T20:25:06.836902] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-10T20:25:06.836971] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-10T20:25:07.205228] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:25:07.489342] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-10-10T20:25:07.678112] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-10T20:25:08.289372] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-10T20:25:08.881506] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T20:25:08.967418] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-10T20:25:09.089373] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-10T20:25:09.726118] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-10T20:25:09.889358] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-10T20:25:10.689429] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-10T20:25:11.489380] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-10T20:25:11.640940] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-10T20:25:11.662938] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T20:25:12.289383] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-10T20:25:12.638065] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T20:25:12.957411] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-10T20:25:13.089371] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-10T20:25:13.646165] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-10T20:25:13.889374] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-10T20:25:14.689450] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-10T20:25:14.860759] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-10T20:25:14.865187] [INFO ] [REMOTE ] NBR: Full fetch complete (49065 records). [2025-10-10T20:25:14.865435] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-10T20:25:14.866910] [FATAL] [VALIDATOR ] NBR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:25:14.867270] [FATAL] [MAIN ] NBR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:25:14.867361] [WARN ] [MAIN ] NBR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:25:14.867461] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-10T20:25:14.867583] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-10T20:25:14.867692] [INFO ] [LOCAL ] NBR: Starting deletion of derivative data. [2025-10-10T20:25:14.867777] [DEBUG] [LOCAL ] NBR: No derivative data file found to delete. [2025-10-10T20:25:14.867895] [INFO ] [MAIN ] Update Progress: 1459/2373 symbols completed. NBR took 38.1s. Estimated remaining: 2h 8m 32s. Rate: 7.1 symbols/min [2025-10-10T20:25:15.125744] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:25:15.126017] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-10-10T20:25:15.126090] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-10-10T20:25:15.126253] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-10T20:25:15.126315] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-10T20:25:15.126412] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-10T20:25:15.126465] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-10T20:25:15.185101] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-10T20:25:15.494570] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-10T20:25:15.703013] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:25:16.289403] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-10T20:25:17.089359] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-10T20:25:17.145159] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T20:25:17.381235] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-10T20:25:17.610114] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-10T20:25:17.610951] [INFO ] [REMOTE ] NC: Full fetch complete (2741 records). [2025-10-10T20:25:17.611019] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-10T20:25:17.890144] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-10T20:25:17.981085] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-10T20:25:17.981191] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-10T20:25:17.981439] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-10T20:25:17.981507] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-10T20:25:17.981979] [DEBUG] [LOCAL ] NC: Trimmed 2741 records to 1965 (keeping 200 days of data) [2025-10-10T20:25:17.996293] [DEBUG] [LOCAL ] NC: Primary data saved (1965 records). [2025-10-10T20:25:17.996480] [INFO ] [MAIN ] NC: Full history saved. [2025-10-10T20:25:17.996571] [INFO ] [MAIN ] Update Progress: 1460/2373 symbols completed. NC took 27.4s. Estimated remaining: 2h 8m 20s. Rate: 7.1 symbols/min [2025-10-10T20:25:18.191551] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:25:18.191838] [DEBUG] [LOCAL ] NCV: No existing data file found in primary storage. [2025-10-10T20:25:18.191881] [WARN ] [MAIN ] NCV: No existing data found, performing full refresh instead. [2025-10-10T20:25:18.192010] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-10T20:25:18.192060] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-10T20:25:18.192105] [DEBUG] [LOCAL ] NCV: No primary data file found to delete. [2025-10-10T20:25:18.192139] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-10T20:25:18.624589] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:25:18.689382] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-10-10T20:25:19.034581] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T20:25:19.489417] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-10-10T20:25:20.289453] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-10T20:25:20.970142] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T20:25:21.089373] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-10T20:25:21.182296] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-10T20:25:21.640810] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T20:25:21.889373] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-10T20:25:22.088836] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-10T20:25:22.689363] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-10T20:25:23.194028] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T20:25:23.288951] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-10T20:25:23.489398] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-10T20:25:24.289378] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-10T20:25:24.962383] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-10T20:25:25.089441] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-10T20:25:25.466063] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-10T20:25:25.889397] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-10T20:25:26.454479] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T20:25:26.689437] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-10T20:25:27.118554] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-10T20:25:27.489386] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-10T20:25:27.718734] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-10T20:25:28.289355] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-10T20:25:28.735095] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T20:25:29.089359] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-10T20:25:29.624284] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-10T20:25:29.889444] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-10T20:25:30.162444] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-10T20:25:30.689392] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-10T20:25:31.489402] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-10T20:25:32.030300] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-10T20:25:32.197885] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-10T20:25:32.289367] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-10T20:25:32.465551] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T20:25:33.089395] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-10T20:25:33.889386] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-10T20:25:34.378141] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T20:25:34.471260] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-10T20:25:34.689350] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-10T20:25:35.155307] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-10T20:25:35.489381] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-10T20:25:35.865360] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-10T20:25:36.289390] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-10T20:25:37.089349] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-10T20:25:37.486032] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T20:25:37.889360] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-10T20:25:37.937014] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-10T20:25:37.951713] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T20:25:37.953146] [INFO ] [REMOTE ] NCA: Full fetch complete (14914 records). [2025-10-10T20:25:37.953234] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-10T20:25:38.312349] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-10T20:25:38.312424] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-10T20:25:38.312803] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-10T20:25:38.312865] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-10T20:25:38.313351] [DEBUG] [LOCAL ] NCA: Trimmed 14914 records to 10086 (keeping 200 days of data) [2025-10-10T20:25:38.371784] [DEBUG] [LOCAL ] NCA: Primary data saved (10086 records). [2025-10-10T20:25:38.371914] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-10T20:25:38.371987] [INFO ] [MAIN ] Update Progress: 1461/2373 symbols completed. NCA took 43.7s. Estimated remaining: 2h 8m 19s. Rate: 7.1 symbols/min [2025-10-10T20:25:38.538244] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:25:38.538410] [DEBUG] [LOCAL ] NCZ: No existing data file found in primary storage. [2025-10-10T20:25:38.538448] [WARN ] [MAIN ] NCZ: No existing data found, performing full refresh instead. [2025-10-10T20:25:38.538563] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-10T20:25:38.538604] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-10T20:25:38.538672] [DEBUG] [LOCAL ] NCZ: No primary data file found to delete. [2025-10-10T20:25:38.538726] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-10T20:25:38.691542] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-10T20:25:38.895201] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:25:39.264678] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T20:25:39.489354] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-10T20:25:39.974810] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T20:25:40.289360] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-10T20:25:40.990892] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-10T20:25:40.993542] [INFO ] [REMOTE ] NCDL: Full fetch complete (32676 records). [2025-10-10T20:25:40.993621] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-10T20:25:40.994217] [FATAL] [VALIDATOR ] NCDL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:25:40.994314] [FATAL] [MAIN ] NCDL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:25:40.994386] [WARN ] [MAIN ] NCDL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:25:40.994472] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-10T20:25:40.994549] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-10T20:25:40.994587] [INFO ] [LOCAL ] NCDL: Starting deletion of derivative data. [2025-10-10T20:25:40.994629] [DEBUG] [LOCAL ] NCDL: No derivative data file found to delete. [2025-10-10T20:25:40.994737] [INFO ] [MAIN ] Update Progress: 1462/2373 symbols completed. NCDL took 34.3s. Estimated remaining: 2h 8m 7s. Rate: 7.1 symbols/min [2025-10-10T20:25:41.093179] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-10T20:25:41.165723] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:25:41.165944] [DEBUG] [LOCAL ] NDMO: No existing data file found in primary storage. [2025-10-10T20:25:41.165996] [WARN ] [MAIN ] NDMO: No existing data found, performing full refresh instead. [2025-10-10T20:25:41.166112] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-10T20:25:41.166154] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-10T20:25:41.166196] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-10T20:25:41.166252] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-10T20:25:41.535739] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:25:41.719344] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-10T20:25:41.889356] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-10-10T20:25:42.282373] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-10T20:25:42.284738] [INFO ] [REMOTE ] NCV: Full fetch complete (22510 records). [2025-10-10T20:25:42.284824] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-10T20:25:42.664583] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-10T20:25:42.664713] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-10T20:25:42.665310] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-10T20:25:42.665400] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-10T20:25:42.666143] [DEBUG] [LOCAL ] NCV: Trimmed 22510 records to 14204 (keeping 200 days of data) [2025-10-10T20:25:42.702120] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-10-10T20:25:42.755768] [DEBUG] [LOCAL ] NCV: Primary data saved (14204 records). [2025-10-10T20:25:42.755898] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-10T20:25:42.755986] [INFO ] [MAIN ] Update Progress: 1463/2373 symbols completed. NCV took 24.8s. Estimated remaining: 2h 7m 55s. Rate: 7.1 symbols/min [2025-10-10T20:25:42.932135] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:25:42.932355] [DEBUG] [LOCAL ] NE: No existing data file found in primary storage. [2025-10-10T20:25:42.932417] [WARN ] [MAIN ] NE: No existing data found, performing full refresh instead. [2025-10-10T20:25:42.932559] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-10T20:25:42.932636] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-10T20:25:42.932742] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-10T20:25:42.932787] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-10T20:25:43.294598] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:25:43.366580] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T20:25:43.489332] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-10T20:25:44.029313] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T20:25:44.289352] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-10-10T20:25:44.772024] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T20:25:45.089387] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-10T20:25:45.889359] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-10T20:25:46.318577] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-10T20:25:46.338926] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T20:25:46.689403] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-10T20:25:47.489394] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-10T20:25:47.796722] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-10T20:25:48.297911] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-10T20:25:48.327626] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-10T20:25:49.089397] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-10T20:25:49.418262] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T20:25:49.506230] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-10T20:25:49.889330] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-10T20:25:50.689425] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-10T20:25:51.483501] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-10T20:25:51.493716] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-10T20:25:51.912916] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T20:25:51.932310] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T20:25:52.289344] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-10T20:25:52.805888] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T20:25:53.089410] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-10T20:25:53.343809] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-10T20:25:53.889348] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-10T20:25:54.285843] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T20:25:54.689375] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-10T20:25:55.489407] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-10T20:25:55.712475] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-10T20:25:56.289418] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-10T20:25:56.545428] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-10T20:25:57.089341] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-10T20:25:57.543120] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T20:25:57.563452] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-10T20:25:57.889377] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-10T20:25:58.689353] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-10T20:25:59.012452] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T20:25:59.041566] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-10T20:25:59.489378] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-10T20:25:59.984602] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T20:26:00.289385] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-10T20:26:00.322453] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-10T20:26:01.089448] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-10T20:26:01.889345] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-10T20:26:02.534813] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-10T20:26:02.689370] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-10T20:26:02.890454] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T20:26:02.984668] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-10T20:26:03.489401] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-10T20:26:03.901182] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-10T20:26:03.902907] [INFO ] [REMOTE ] NDMO: Full fetch complete (23934 records). [2025-10-10T20:26:03.902995] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-10T20:26:03.903764] [FATAL] [VALIDATOR ] NDMO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:26:03.903923] [FATAL] [MAIN ] NDMO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:26:03.903977] [WARN ] [MAIN ] NDMO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:26:03.904018] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-10T20:26:03.904071] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-10T20:26:03.904106] [INFO ] [LOCAL ] NDMO: Starting deletion of derivative data. [2025-10-10T20:26:03.904160] [DEBUG] [LOCAL ] NDMO: No derivative data file found to delete. [2025-10-10T20:26:03.904249] [INFO ] [MAIN ] Update Progress: 1464/2373 symbols completed. NDMO took 22.9s. Estimated remaining: 2h 7m 54s. Rate: 7.1 symbols/min [2025-10-10T20:26:04.073316] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:26:04.073524] [DEBUG] [LOCAL ] NEA: No existing data file found in primary storage. [2025-10-10T20:26:04.073561] [WARN ] [MAIN ] NEA: No existing data found, performing full refresh instead. [2025-10-10T20:26:04.073703] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-10T20:26:04.073754] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-10T20:26:04.073796] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-10T20:26:04.073826] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-10T20:26:04.294708] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-10T20:26:04.433434] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:26:04.853688] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T20:26:05.089392] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-10-10T20:26:05.222341] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T20:26:05.226757] [INFO ] [REMOTE ] NCLH: Full fetch complete (77420 records). [2025-10-10T20:26:05.226868] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-10T20:26:05.227533] [FATAL] [VALIDATOR ] NCLH: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:26:05.227621] [FATAL] [MAIN ] NCLH: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:26:05.227706] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:26:05.227757] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-10T20:26:05.227814] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-10T20:26:05.227849] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-10-10T20:26:05.227888] [DEBUG] [LOCAL ] NCLH: No derivative data file found to delete. [2025-10-10T20:26:05.227943] [INFO ] [MAIN ] Update Progress: 1465/2373 symbols completed. NCLH took 50.4s. Estimated remaining: 2h 7m 41s. Rate: 7.1 symbols/min [2025-10-10T20:26:05.394803] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:26:05.395006] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-10-10T20:26:05.395043] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-10-10T20:26:05.395154] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-10T20:26:05.395195] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-10T20:26:05.395236] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-10T20:26:05.395269] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-10T20:26:05.742189] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:26:05.889381] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-10-10T20:26:06.694797] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-10T20:26:06.700073] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-10T20:26:07.489426] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-10T20:26:07.631907] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-10T20:26:07.988281] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-10T20:26:08.289387] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-10T20:26:09.055954] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-10T20:26:09.089340] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-10T20:26:09.217059] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T20:26:09.889420] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-10T20:26:10.129717] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-10T20:26:10.689375] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-10T20:26:11.333280] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-10T20:26:11.489396] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-10T20:26:12.289365] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-10T20:26:12.799316] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-10T20:26:13.089414] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-10T20:26:13.182220] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T20:26:13.439983] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-10T20:26:13.889392] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-10T20:26:14.689424] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-10T20:26:15.466805] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-10T20:26:15.489371] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-10T20:26:15.751857] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T20:26:16.233432] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-10T20:26:16.289342] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-10T20:26:17.089389] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-10T20:26:17.769248] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-10T20:26:17.886822] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T20:26:17.890331] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-10T20:26:18.171698] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T20:26:18.173964] [INFO ] [REMOTE ] NCZ: Full fetch complete (21396 records). [2025-10-10T20:26:18.174038] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-10T20:26:18.532455] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-10T20:26:18.532533] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-10T20:26:18.533064] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-10T20:26:18.533127] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-10T20:26:18.533727] [DEBUG] [LOCAL ] NCZ: Trimmed 21396 records to 12549 (keeping 200 days of data) [2025-10-10T20:26:18.610228] [DEBUG] [LOCAL ] NCZ: Primary data saved (12549 records). [2025-10-10T20:26:18.610360] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-10T20:26:18.610432] [INFO ] [MAIN ] Update Progress: 1466/2373 symbols completed. NCZ took 40.2s. Estimated remaining: 2h 7m 36s. Rate: 7.1 symbols/min [2025-10-10T20:26:18.694454] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-10T20:26:18.796758] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:26:18.797021] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-10-10T20:26:18.797095] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-10-10T20:26:18.797249] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-10T20:26:18.797307] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-10T20:26:18.797372] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-10T20:26:18.797425] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-10T20:26:19.179010] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:26:19.489350] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-10T20:26:19.598200] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T20:26:20.289337] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-10T20:26:21.033191] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-10T20:26:21.089352] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-10T20:26:21.139335] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-10T20:26:21.838758] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T20:26:21.889352] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-10-10T20:26:22.689445] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-10T20:26:23.500466] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-10T20:26:23.507121] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-10T20:26:23.612344] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T20:26:23.616782] [INFO ] [REMOTE ] NE: Full fetch complete (75135 records). [2025-10-10T20:26:23.616946] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-10T20:26:23.617705] [FATAL] [VALIDATOR ] NE: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:26:23.617797] [FATAL] [MAIN ] NE: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:26:23.617845] [WARN ] [MAIN ] NE: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:26:23.617929] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-10T20:26:23.618006] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-10T20:26:23.618054] [INFO ] [LOCAL ] NE: Starting deletion of derivative data. [2025-10-10T20:26:23.618107] [DEBUG] [LOCAL ] NE: No derivative data file found to delete. [2025-10-10T20:26:23.618215] [INFO ] [MAIN ] Update Progress: 1467/2373 symbols completed. NE took 40.9s. Estimated remaining: 2h 7m 25s. Rate: 7.1 symbols/min [2025-10-10T20:26:23.785679] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:26:23.785849] [DEBUG] [LOCAL ] NET: No existing data file found in primary storage. [2025-10-10T20:26:23.785886] [WARN ] [MAIN ] NET: No existing data found, performing full refresh instead. [2025-10-10T20:26:23.786000] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-10T20:26:23.786069] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-10T20:26:23.786171] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-10T20:26:23.786217] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-10T20:26:24.141910] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:26:24.289349] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-10T20:26:24.330422] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-10T20:26:24.609014] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-10T20:26:25.089366] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-10-10T20:26:25.889390] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-10T20:26:26.563567] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-10T20:26:26.689370] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-10T20:26:27.309800] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-10T20:26:27.489339] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-10T20:26:28.184891] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-10T20:26:28.289386] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-10T20:26:29.089404] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-10T20:26:29.217381] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-10T20:26:29.605956] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-10T20:26:29.889384] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-10T20:26:30.328868] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-10T20:26:30.689401] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-10T20:26:31.285285] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (3.00 seconds). [2025-10-10T20:26:31.489389] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-10T20:26:32.123625] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-10T20:26:32.289395] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-10T20:26:32.708393] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T20:26:33.089418] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-10T20:26:33.889369] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-10T20:26:34.094053] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-10T20:26:34.689361] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-10T20:26:34.747829] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-10T20:26:34.835816] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T20:26:35.489484] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-10T20:26:36.289416] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-10T20:26:36.358114] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-10T20:26:37.064989] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T20:26:37.068085] [INFO ] [REMOTE ] NEA: Full fetch complete (51209 records). [2025-10-10T20:26:37.068218] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-10T20:26:37.068919] [FATAL] [VALIDATOR ] NEA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:26:37.069003] [FATAL] [MAIN ] NEA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:26:37.069046] [WARN ] [MAIN ] NEA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:26:37.069109] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-10T20:26:37.069215] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-10T20:26:37.069276] [INFO ] [LOCAL ] NEA: Starting deletion of derivative data. [2025-10-10T20:26:37.069319] [DEBUG] [LOCAL ] NEA: No derivative data file found to delete. [2025-10-10T20:26:37.069376] [INFO ] [MAIN ] Update Progress: 1468/2373 symbols completed. NEA took 33.2s. Estimated remaining: 2h 7m 20s. Rate: 7.1 symbols/min [2025-10-10T20:26:37.101476] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-10T20:26:37.246122] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:26:37.246293] [DEBUG] [LOCAL ] NEU: No existing data file found in primary storage. [2025-10-10T20:26:37.246329] [WARN ] [MAIN ] NEU: No existing data found, performing full refresh instead. [2025-10-10T20:26:37.246443] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-10T20:26:37.246485] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-10T20:26:37.246527] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-10T20:26:37.246560] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-10T20:26:37.611917] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:26:37.641829] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-10-10T20:26:37.889341] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-10T20:26:38.016700] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-10T20:26:38.689376] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-10T20:26:39.489373] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-10-10T20:26:39.726852] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-10T20:26:40.289416] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-10T20:26:40.348112] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-10T20:26:40.458676] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-10T20:26:40.897457] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-10T20:26:40.902011] [INFO ] [REMOTE ] NEE: Full fetch complete (77369 records). [2025-10-10T20:26:40.902164] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-10T20:26:40.902883] [FATAL] [VALIDATOR ] NEE: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:26:40.902976] [FATAL] [MAIN ] NEE: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:26:40.903019] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:26:40.903056] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-10T20:26:40.903113] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-10T20:26:40.903149] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-10-10T20:26:40.903188] [DEBUG] [LOCAL ] NEE: No derivative data file found to delete. [2025-10-10T20:26:40.903246] [INFO ] [MAIN ] Update Progress: 1469/2373 symbols completed. NEE took 35.7s. Estimated remaining: 2h 7m 9s. Rate: 7.1 symbols/min [2025-10-10T20:26:41.075384] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:26:41.075621] [DEBUG] [LOCAL ] NEXA: No existing data file found in primary storage. [2025-10-10T20:26:41.075749] [WARN ] [MAIN ] NEXA: No existing data found, performing full refresh instead. [2025-10-10T20:26:41.075918] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-10T20:26:41.075963] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-10T20:26:41.076006] [DEBUG] [LOCAL ] NEXA: No primary data file found to delete. [2025-10-10T20:26:41.076060] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-10T20:26:41.097156] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-10T20:26:41.418137] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-10-10T20:26:41.500153] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:26:41.889418] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-10-10T20:26:42.117086] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-10T20:26:42.689396] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-10T20:26:42.935845] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-10T20:26:43.489394] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-10T20:26:44.289389] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-10T20:26:44.434682] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-10T20:26:44.880612] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-10T20:26:45.089377] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-10T20:26:45.334488] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-10T20:26:45.889376] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-10T20:26:46.013397] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-10T20:26:46.689372] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-10T20:26:46.780405] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-10T20:26:47.489374] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-10T20:26:48.289401] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-10T20:26:48.443900] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-10T20:26:49.089413] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-10T20:26:49.225763] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-10T20:26:49.889410] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-10T20:26:49.938566] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-10T20:26:50.396062] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-10T20:26:50.689462] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-10T20:26:50.740029] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-10T20:26:51.489402] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-10T20:26:51.953010] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T20:26:52.289413] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-10T20:26:53.027211] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-10T20:26:53.089401] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-10T20:26:53.889385] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-10T20:26:54.018827] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-10T20:26:54.120736] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-10T20:26:54.384959] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-10T20:26:54.689441] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-10T20:26:55.479238] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-10T20:26:55.489329] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-10T20:26:56.289442] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-10T20:26:56.327899] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-10T20:26:57.089374] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-10T20:26:57.889430] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-10T20:26:58.097276] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-10T20:26:58.415025] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-10T20:26:58.445555] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-10T20:26:58.689398] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-10T20:26:59.489366] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-10T20:27:00.289437] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-10T20:27:00.386545] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T20:27:00.392269] [INFO ] [REMOTE ] NET: Full fetch complete (76376 records). [2025-10-10T20:27:00.392516] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-10T20:27:00.393576] [FATAL] [VALIDATOR ] NET: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:27:00.393716] [FATAL] [MAIN ] NET: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:27:00.393766] [WARN ] [MAIN ] NET: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:27:00.393813] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-10T20:27:00.393884] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-10T20:27:00.393920] [INFO ] [LOCAL ] NET: Starting deletion of derivative data. [2025-10-10T20:27:00.393960] [DEBUG] [LOCAL ] NET: No derivative data file found to delete. [2025-10-10T20:27:00.394030] [INFO ] [MAIN ] Update Progress: 1470/2373 symbols completed. NET took 36.8s. Estimated remaining: 2h 7m 7s. Rate: 7.1 symbols/min [2025-10-10T20:27:00.660993] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:27:00.661274] [DEBUG] [LOCAL ] NFG: No existing data file found in primary storage. [2025-10-10T20:27:00.661332] [WARN ] [MAIN ] NFG: No existing data found, performing full refresh instead. [2025-10-10T20:27:00.661464] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-10T20:27:00.661508] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-10T20:27:00.661550] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-10T20:27:00.661585] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-10T20:27:01.094587] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-10T20:27:01.179251] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:27:01.558155] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-10T20:27:01.579222] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T20:27:01.889447] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-10T20:27:02.344742] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-10T20:27:02.346195] [INFO ] [REMOTE ] NEU: Full fetch complete (10679 records). [2025-10-10T20:27:02.346467] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-10T20:27:02.347081] [FATAL] [VALIDATOR ] NEU: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:27:02.347226] [FATAL] [MAIN ] NEU: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:27:02.350776] [WARN ] [MAIN ] NEU: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:27:02.353672] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-10T20:27:02.354400] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-10T20:27:02.354637] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T20:27:02.354953] [INFO ] [LOCAL ] NEU: Starting deletion of derivative data. [2025-10-10T20:27:02.357742] [DEBUG] [LOCAL ] NEU: No derivative data file found to delete. [2025-10-10T20:27:02.357831] [INFO ] [MAIN ] Update Progress: 1471/2373 symbols completed. NEU took 25.3s. Estimated remaining: 2h 6m 55s. Rate: 7.1 symbols/min [2025-10-10T20:27:02.522310] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:27:02.522453] [DEBUG] [LOCAL ] NFJ: No existing data file found in primary storage. [2025-10-10T20:27:02.522490] [WARN ] [MAIN ] NFJ: No existing data found, performing full refresh instead. [2025-10-10T20:27:02.522596] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-10T20:27:02.522637] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-10T20:27:02.522723] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-10T20:27:02.522759] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-10T20:27:02.689989] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-10-10T20:27:02.868594] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:27:03.489422] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-10-10T20:27:04.289362] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-10T20:27:04.547477] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T20:27:04.845755] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T20:27:05.089397] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-10T20:27:05.889353] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-10T20:27:06.595810] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T20:27:06.647858] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-10T20:27:06.689352] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-10T20:27:07.489410] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-10T20:27:07.750459] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T20:27:08.289415] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-10T20:27:08.800550] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T20:27:09.089425] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-10T20:27:09.459911] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-10T20:27:09.464896] [INFO ] [REMOTE ] NEXA: Full fetch complete (7763 records). [2025-10-10T20:27:09.464745] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-10T20:27:09.476120] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-10T20:27:09.861465] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-10-10T20:27:09.861585] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-10-10T20:27:09.862002] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-10-10T20:27:09.862067] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-10-10T20:27:09.862518] [DEBUG] [LOCAL ] NEXA: Trimmed 7763 records to 4821 (keeping 200 days of data) [2025-10-10T20:27:09.889456] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-10T20:27:09.893613] [DEBUG] [LOCAL ] NEXA: Primary data saved (4821 records). [2025-10-10T20:27:09.893830] [INFO ] [MAIN ] NEXA: Full history saved. [2025-10-10T20:27:09.893926] [INFO ] [MAIN ] Update Progress: 1472/2373 symbols completed. NEXA took 29.0s. Estimated remaining: 2h 6m 46s. Rate: 7.1 symbols/min [2025-10-10T20:27:10.079935] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:27:10.080274] [DEBUG] [LOCAL ] NGG: No existing data file found in primary storage. [2025-10-10T20:27:10.080318] [WARN ] [MAIN ] NGG: No existing data found, performing full refresh instead. [2025-10-10T20:27:10.080406] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-10T20:27:10.080446] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-10T20:27:10.080487] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-10T20:27:10.080521] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-10T20:27:10.463310] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:27:10.689391] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-10T20:27:10.853983] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T20:27:10.858897] [INFO ] [REMOTE ] NEM: Full fetch complete (77359 records). [2025-10-10T20:27:10.859063] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-10T20:27:10.860205] [FATAL] [VALIDATOR ] NEM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:27:10.860301] [FATAL] [MAIN ] NEM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:27:10.860345] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:27:10.860417] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-10T20:27:10.860490] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-10T20:27:10.860528] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-10-10T20:27:10.860568] [DEBUG] [LOCAL ] NEM: No derivative data file found to delete. [2025-10-10T20:27:10.860636] [INFO ] [MAIN ] Update Progress: 1473/2373 symbols completed. NEM took 52.3s. Estimated remaining: 2h 6m 33s. Rate: 7.1 symbols/min [2025-10-10T20:27:11.051676] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:27:11.052073] [DEBUG] [LOCAL ] NGL: No existing data file found in primary storage. [2025-10-10T20:27:11.052188] [WARN ] [MAIN ] NGL: No existing data found, performing full refresh instead. [2025-10-10T20:27:11.052504] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-10T20:27:11.052684] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-10T20:27:11.052865] [DEBUG] [LOCAL ] NGL: No primary data file found to delete. [2025-10-10T20:27:11.052935] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-10T20:27:11.186373] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-10T20:27:11.477550] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:27:11.489366] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-10-10T20:27:11.597041] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-10T20:27:12.289439] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-10-10T20:27:12.727197] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T20:27:13.089371] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-10T20:27:13.889475] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-10T20:27:14.251406] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-10T20:27:14.689404] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-10T20:27:14.924488] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-10T20:27:15.002867] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-10T20:27:15.489457] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-10T20:27:16.289408] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-10T20:27:16.730131] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T20:27:16.824987] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T20:27:17.089440] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-10T20:27:17.809986] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-10T20:27:17.889432] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-10T20:27:18.401542] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T20:27:18.689409] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-10T20:27:19.489428] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-10T20:27:19.534197] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T20:27:20.289378] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-10T20:27:20.433278] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T20:27:20.930901] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-10T20:27:21.089394] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-10T20:27:21.889361] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-10T20:27:22.189517] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T20:27:22.492295] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-10T20:27:22.689399] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-10T20:27:22.991440] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-10T20:27:23.489385] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-10T20:27:23.995383] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T20:27:24.289353] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-10T20:27:24.758500] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-10T20:27:25.089401] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-10T20:27:25.889393] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-10T20:27:26.114704] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T20:27:26.437172] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T20:27:26.689380] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-10T20:27:27.489366] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-10T20:27:27.505391] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T20:27:27.507562] [INFO ] [REMOTE ] NFJ: Full fetch complete (30137 records). [2025-10-10T20:27:27.507636] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-10T20:27:27.508109] [FATAL] [VALIDATOR ] NFJ: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:27:27.508189] [FATAL] [MAIN ] NFJ: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:27:27.508233] [WARN ] [MAIN ] NFJ: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:27:27.508320] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-10T20:27:27.508382] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-10T20:27:27.508417] [INFO ] [LOCAL ] NFJ: Starting deletion of derivative data. [2025-10-10T20:27:27.508455] [DEBUG] [LOCAL ] NFJ: No derivative data file found to delete. [2025-10-10T20:27:27.508506] [INFO ] [MAIN ] Update Progress: 1474/2373 symbols completed. NFJ took 25.2s. Estimated remaining: 2h 6m 29s. Rate: 7.1 symbols/min [2025-10-10T20:27:27.717596] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T20:27:27.721691] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:27:27.731843] [DEBUG] [LOCAL ] NGS: No existing data file found in primary storage. [2025-10-10T20:27:27.732288] [WARN ] [MAIN ] NGS: No existing data found, performing full refresh instead. [2025-10-10T20:27:27.732604] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-10T20:27:27.733049] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-10T20:27:27.733125] [DEBUG] [LOCAL ] NGS: No primary data file found to delete. [2025-10-10T20:27:27.733165] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-10T20:27:28.096175] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:27:28.289384] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-10-10T20:27:29.089378] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-10T20:27:29.360128] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-10T20:27:29.378293] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-10T20:27:29.889423] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-10T20:27:30.072010] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-10T20:27:30.689371] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-10T20:27:31.489389] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-10T20:27:31.768455] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T20:27:31.943574] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T20:27:32.289420] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-10T20:27:32.580952] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-10T20:27:32.848015] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-10T20:27:33.089417] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-10T20:27:33.889360] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-10T20:27:34.689412] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-10T20:27:35.127164] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-10T20:27:35.190498] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-10T20:27:35.489434] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-10T20:27:35.937771] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-10T20:27:36.289435] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-10T20:27:37.089371] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-10T20:27:37.213570] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-10T20:27:37.501038] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T20:27:37.889416] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-10T20:27:38.689397] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-10T20:27:39.164914] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-10T20:27:39.489395] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-10T20:27:39.542094] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T20:27:39.564809] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T20:27:39.568607] [INFO ] [REMOTE ] NFG: Full fetch complete (56671 records). [2025-10-10T20:27:39.568776] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-10T20:27:39.569410] [FATAL] [VALIDATOR ] NFG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:27:39.569500] [FATAL] [MAIN ] NFG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:27:39.569541] [WARN ] [MAIN ] NFG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:27:39.569581] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-10T20:27:39.569682] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-10T20:27:39.569739] [INFO ] [LOCAL ] NFG: Starting deletion of derivative data. [2025-10-10T20:27:39.569782] [DEBUG] [LOCAL ] NFG: No derivative data file found to delete. [2025-10-10T20:27:39.569839] [INFO ] [MAIN ] Update Progress: 1475/2373 symbols completed. NFG took 39.2s. Estimated remaining: 2h 6m 23s. Rate: 7.1 symbols/min [2025-10-10T20:27:39.738388] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:27:39.738634] [DEBUG] [LOCAL ] NGVC: No existing data file found in primary storage. [2025-10-10T20:27:39.738712] [WARN ] [MAIN ] NGVC: No existing data found, performing full refresh instead. [2025-10-10T20:27:39.738832] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-10T20:27:39.738873] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-10T20:27:39.738916] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-10T20:27:39.738948] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-10T20:27:40.103095] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:27:40.289369] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-10T20:27:41.089375] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-10T20:27:41.476134] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T20:27:41.882737] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T20:27:41.890168] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-10T20:27:42.215171] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T20:27:42.689434] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-10-10T20:27:43.489345] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-10T20:27:43.659327] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T20:27:43.711532] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T20:27:44.289337] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-10T20:27:44.561992] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-10T20:27:45.089413] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-10T20:27:45.203226] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T20:27:45.207113] [INFO ] [REMOTE ] NGG: Full fetch complete (65979 records). [2025-10-10T20:27:45.207220] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-10T20:27:45.207844] [FATAL] [VALIDATOR ] NGG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:27:45.207949] [FATAL] [MAIN ] NGG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:27:45.207992] [WARN ] [MAIN ] NGG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:27:45.208057] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-10T20:27:45.208120] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-10T20:27:45.208155] [INFO ] [LOCAL ] NGG: Starting deletion of derivative data. [2025-10-10T20:27:45.208193] [DEBUG] [LOCAL ] NGG: No derivative data file found to delete. [2025-10-10T20:27:45.208270] [INFO ] [MAIN ] Update Progress: 1476/2373 symbols completed. NGG took 35.3s. Estimated remaining: 2h 6m 13s. Rate: 7.1 symbols/min [2025-10-10T20:27:45.379466] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:27:45.379635] [DEBUG] [LOCAL ] NGVT: No existing data file found in primary storage. [2025-10-10T20:27:45.379709] [WARN ] [MAIN ] NGVT: No existing data found, performing full refresh instead. [2025-10-10T20:27:45.379824] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-10T20:27:45.379865] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-10T20:27:45.379948] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-10T20:27:45.379988] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-10T20:27:45.748015] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:27:45.889425] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-10-10T20:27:46.268686] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-10T20:27:46.689387] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-10T20:27:47.303072] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T20:27:47.489445] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-10T20:27:47.782726] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-10T20:27:48.289445] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-10T20:27:48.731011] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T20:27:48.967500] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-10T20:27:49.089331] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-10T20:27:49.889380] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-10T20:27:50.364489] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T20:27:50.689438] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-10T20:27:50.921670] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-10T20:27:51.489403] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-10T20:27:52.152388] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-10T20:27:52.289404] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-10T20:27:53.094947] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-10T20:27:53.104367] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-10T20:27:53.157215] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-10T20:27:53.889383] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-10T20:27:54.659724] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T20:27:54.689330] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-10T20:27:54.712869] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T20:27:54.714211] [INFO ] [REMOTE ] NGS: Full fetch complete (17119 records). [2025-10-10T20:27:54.714277] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-10T20:27:55.087957] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-10T20:27:55.088062] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-10T20:27:55.088784] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-10T20:27:55.088849] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-10T20:27:55.089438] [DEBUG] [LOCAL ] NGS: Trimmed 17119 records to 11435 (keeping 200 days of data) [2025-10-10T20:27:55.165624] [DEBUG] [LOCAL ] NGS: Primary data saved (11435 records). [2025-10-10T20:27:55.165837] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-10T20:27:55.165932] [INFO ] [MAIN ] Update Progress: 1477/2373 symbols completed. NGS took 27.7s. Estimated remaining: 2h 6m 5s. Rate: 7.1 symbols/min [2025-10-10T20:27:55.489431] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-10T20:27:56.130962] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-10T20:27:56.284882] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-10T20:27:56.289514] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-10T20:27:57.089375] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-10T20:27:57.540483] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-10T20:27:57.542944] [INFO ] [REMOTE ] NGL: Full fetch complete (41334 records). [2025-10-10T20:27:57.543020] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-10T20:27:57.897186] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-10T20:27:57.911425] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-10T20:27:57.911504] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-10T20:27:57.912983] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-10T20:27:57.913135] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-10T20:27:57.914165] [DEBUG] [LOCAL ] NGL: Trimmed 41334 records to 30298 (keeping 200 days of data) [2025-10-10T20:27:58.084223] [DEBUG] [LOCAL ] NGL: Primary data saved (30298 records). [2025-10-10T20:27:58.084507] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-10T20:27:58.084599] [INFO ] [MAIN ] Update Progress: 1478/2373 symbols completed. NGL took 47.2s. Estimated remaining: 2h 5m 54s. Rate: 7.1 symbols/min [2025-10-10T20:27:58.413100] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T20:27:58.689361] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-10T20:27:59.200996] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-10T20:27:59.489339] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-10T20:28:00.044466] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T20:28:00.289345] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-10T20:28:00.356174] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-10T20:28:01.089377] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-10T20:28:01.748920] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-10T20:28:01.889394] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-10T20:28:02.168700] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T20:28:02.689388] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-10T20:28:03.256845] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T20:28:03.489375] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-10T20:28:04.104802] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-10T20:28:04.289398] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-10T20:28:04.924991] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-10T20:28:05.089425] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-10T20:28:05.096418] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T20:28:05.098982] [INFO ] [REMOTE ] NGVT: Full fetch complete (34230 records). [2025-10-10T20:28:05.099069] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-10T20:28:05.099674] [FATAL] [VALIDATOR ] NGVT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:28:05.099757] [FATAL] [MAIN ] NGVT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:28:05.099800] [WARN ] [MAIN ] NGVT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:28:05.099838] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-10T20:28:05.099938] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-10T20:28:05.099981] [INFO ] [LOCAL ] NGVT: Starting deletion of derivative data. [2025-10-10T20:28:05.100036] [DEBUG] [LOCAL ] NGVT: No derivative data file found to delete. [2025-10-10T20:28:05.100111] [INFO ] [MAIN ] Update Progress: 1479/2373 symbols completed. NGVT took 19.9s. Estimated remaining: 2h 5m 44s. Rate: 7.1 symbols/min [2025-10-10T20:28:06.602058] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T20:28:06.610223] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-10T20:28:08.032406] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-10T20:28:08.037658] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-10T20:28:09.004823] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-10T20:28:09.007002] [INFO ] [REMOTE ] NGVC: Full fetch complete (30580 records). [2025-10-10T20:28:09.007076] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-10T20:28:09.007511] [FATAL] [VALIDATOR ] NGVC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:28:09.007593] [FATAL] [MAIN ] NGVC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:28:09.007635] [WARN ] [MAIN ] NGVC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:28:09.007719] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-10T20:28:09.007776] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-10T20:28:09.007811] [INFO ] [LOCAL ] NGVC: Starting deletion of derivative data. [2025-10-10T20:28:09.007850] [DEBUG] [LOCAL ] NGVC: No derivative data file found to delete. [2025-10-10T20:28:09.007901] [INFO ] [MAIN ] Update Progress: 1480/2373 symbols completed. NGVC took 29.4s. Estimated remaining: 2h 5m 33s. Rate: 7.1 symbols/min [2025-10-10T20:28:09.733009] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:28:09.760630] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-10-10T20:28:09.781372] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:28:09.767772] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:28:09.795298] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-10-10T20:28:09.795457] [DEBUG] [LOCAL ] NIC: No existing data file found in primary storage. [2025-10-10T20:28:09.804990] [DEBUG] [LOCAL ] NHI: No existing data file found in primary storage. [2025-10-10T20:28:09.823957] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:28:09.824110] [WARN ] [MAIN ] NHI: No existing data found, performing full refresh instead. [2025-10-10T20:28:09.822969] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-10T20:28:09.824364] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-10T20:28:09.822842] [WARN ] [MAIN ] NIC: No existing data found, performing full refresh instead. [2025-10-10T20:28:09.824483] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-10T20:28:09.824773] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-10T20:28:09.824883] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-10T20:28:09.825036] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-10T20:28:09.825304] [DEBUG] [LOCAL ] NIE: No existing data file found in primary storage. [2025-10-10T20:28:09.825083] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-10T20:28:09.825222] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-10T20:28:09.825637] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-10T20:28:09.825491] [WARN ] [MAIN ] NIE: No existing data found, performing full refresh instead. [2025-10-10T20:28:09.825838] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-10T20:28:09.855603] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-10T20:28:09.850429] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-10T20:28:09.850339] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-10T20:28:09.910708] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-10T20:28:10.037165] [DEBUG] [LOCAL ] NIE: No primary data file found to delete. [2025-10-10T20:28:10.091515] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-10T20:28:11.467332] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:28:11.470260] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:28:11.554260] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-10-10T20:28:11.555028] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-10-10T20:28:11.630686] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:28:11.671983] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-10-10T20:28:11.694473] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:28:11.695053] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-10-10T20:28:12.669481] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T20:28:12.671824] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-10T20:28:12.795433] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-10T20:28:12.798282] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-10T20:28:12.892415] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T20:28:12.897499] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-10T20:28:13.278492] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-10T20:28:13.280476] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-10T20:28:13.696617] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-10T20:28:13.782582] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T20:28:13.889354] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-10T20:28:13.924482] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-10T20:28:14.026580] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-10T20:28:14.689345] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-10T20:28:15.147034] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T20:28:15.489346] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-10T20:28:15.805224] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-10T20:28:16.289406] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-10T20:28:16.937965] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-10T20:28:17.089381] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-10T20:28:17.347624] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-10T20:28:17.889393] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-10T20:28:18.689357] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-10T20:28:18.907015] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-10T20:28:19.138683] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-10T20:28:19.240851] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-10T20:28:19.489370] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-10T20:28:20.289375] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-10T20:28:21.010261] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-10T20:28:21.089391] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-10T20:28:21.253010] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-10T20:28:21.889343] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-10T20:28:22.429327] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T20:28:22.689392] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-10T20:28:23.489426] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-10T20:28:23.864915] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-10T20:28:24.151622] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T20:28:24.256980] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-10T20:28:24.289361] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-10T20:28:25.089387] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-10T20:28:25.272664] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-10T20:28:25.889331] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-10T20:28:26.418760] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-10T20:28:26.689384] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-10T20:28:26.978392] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-10T20:28:27.489357] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-10T20:28:27.639841] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-10T20:28:28.289376] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-10T20:28:28.709722] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-10T20:28:29.089422] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-10T20:28:29.316024] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-10T20:28:29.889343] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-10T20:28:30.170014] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-10T20:28:30.511757] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T20:28:30.513018] [INFO ] [REMOTE ] NIC: Full fetch complete (12249 records). [2025-10-10T20:28:30.513107] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-10T20:28:30.513568] [FATAL] [VALIDATOR ] NIC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:28:30.513696] [FATAL] [MAIN ] NIC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:28:30.513745] [WARN ] [MAIN ] NIC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:28:30.513784] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-10T20:28:30.513838] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-10T20:28:30.513872] [INFO ] [LOCAL ] NIC: Starting deletion of derivative data. [2025-10-10T20:28:30.513909] [DEBUG] [LOCAL ] NIC: No derivative data file found to delete. [2025-10-10T20:28:30.513963] [INFO ] [MAIN ] Update Progress: 1481/2373 symbols completed. NIC took 21.5s. Estimated remaining: 2h 5m 33s. Rate: 7.1 symbols/min [2025-10-10T20:28:30.695147] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-10T20:28:30.698135] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:28:30.698308] [DEBUG] [LOCAL ] NIM: No existing data file found in primary storage. [2025-10-10T20:28:30.699108] [WARN ] [MAIN ] NIM: No existing data found, performing full refresh instead. [2025-10-10T20:28:30.699226] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-10T20:28:30.699269] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-10T20:28:30.699311] [DEBUG] [LOCAL ] NIM: No primary data file found to delete. [2025-10-10T20:28:30.699344] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-10T20:28:31.105419] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:28:31.489379] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-10T20:28:31.898987] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-10T20:28:32.289446] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-10-10T20:28:33.089339] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-10T20:28:33.276483] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-10T20:28:33.628289] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T20:28:33.889394] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-10T20:28:34.291583] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-10T20:28:34.654839] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-10T20:28:34.689381] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-10T20:28:35.489388] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-10T20:28:35.522519] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-10T20:28:36.289339] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-10T20:28:36.819119] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T20:28:36.910224] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-10T20:28:37.089395] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-10T20:28:37.889382] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-10T20:28:38.689426] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-10T20:28:38.740918] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-10T20:28:39.310662] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-10T20:28:39.489404] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-10T20:28:39.743028] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-10T20:28:40.177074] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T20:28:40.179032] [INFO ] [REMOTE ] NHI: Full fetch complete (31140 records). [2025-10-10T20:28:40.179100] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-10T20:28:40.179561] [FATAL] [VALIDATOR ] NHI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:28:40.179662] [FATAL] [MAIN ] NHI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:28:40.179720] [WARN ] [MAIN ] NHI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:28:40.179786] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-10T20:28:40.179847] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-10T20:28:40.179880] [INFO ] [LOCAL ] NHI: Starting deletion of derivative data. [2025-10-10T20:28:40.179919] [DEBUG] [LOCAL ] NHI: No derivative data file found to delete. [2025-10-10T20:28:40.179971] [INFO ] [MAIN ] Update Progress: 1482/2373 symbols completed. NHI took 31.2s. Estimated remaining: 2h 5m 25s. Rate: 7.1 symbols/min [2025-10-10T20:28:40.294739] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-10T20:28:40.353002] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:28:40.353228] [DEBUG] [LOCAL ] NINE: No existing data file found in primary storage. [2025-10-10T20:28:40.353266] [WARN ] [MAIN ] NINE: No existing data found, performing full refresh instead. [2025-10-10T20:28:40.353383] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-10T20:28:40.353423] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-10T20:28:40.353464] [DEBUG] [LOCAL ] NINE: No primary data file found to delete. [2025-10-10T20:28:40.353498] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-10T20:28:40.718709] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:28:41.089429] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-10T20:28:41.351078] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-10T20:28:41.573784] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-10T20:28:41.889403] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-10T20:28:42.689393] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-10-10T20:28:42.795721] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T20:28:42.798093] [INFO ] [REMOTE ] NIE: Full fetch complete (16766 records). [2025-10-10T20:28:42.798190] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-10T20:28:43.179695] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-10T20:28:43.179809] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-10T20:28:43.180685] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-10T20:28:43.180753] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-10T20:28:43.181441] [DEBUG] [LOCAL ] NIE: Trimmed 16766 records to 12219 (keeping 200 days of data) [2025-10-10T20:28:43.269528] [DEBUG] [LOCAL ] NIE: Primary data saved (12219 records). [2025-10-10T20:28:43.269822] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-10T20:28:43.269972] [INFO ] [MAIN ] Update Progress: 1483/2373 symbols completed. NIE took 34.2s. Estimated remaining: 2h 5m 13s. Rate: 7.1 symbols/min [2025-10-10T20:28:43.457499] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:28:43.457793] [DEBUG] [LOCAL ] NIO: No existing data file found in primary storage. [2025-10-10T20:28:43.457851] [WARN ] [MAIN ] NIO: No existing data found, performing full refresh instead. [2025-10-10T20:28:43.457982] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-10T20:28:43.458026] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-10T20:28:43.458068] [DEBUG] [LOCAL ] NIO: No primary data file found to delete. [2025-10-10T20:28:43.458126] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-10T20:28:43.494475] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-10T20:28:43.841407] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:28:44.289341] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-10T20:28:44.487877] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-10T20:28:44.508058] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-10T20:28:45.089498] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-10T20:28:45.850063] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-10T20:28:45.889335] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-10T20:28:46.446359] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T20:28:46.480950] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-10T20:28:46.689371] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-10T20:28:47.489439] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-10-10T20:28:48.289407] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-10T20:28:48.692728] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-10T20:28:49.089408] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-10T20:28:49.889360] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-10T20:28:50.007886] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T20:28:50.088608] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-10T20:28:50.259496] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-10-10T20:28:50.470978] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-10T20:28:50.689386] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-10T20:28:51.489401] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-10T20:28:52.289440] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-10T20:28:52.900675] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-10T20:28:52.973521] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-10T20:28:52.974328] [INFO ] [REMOTE ] NIM: Full fetch complete (6468 records). [2025-10-10T20:28:52.974396] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-10T20:28:53.094473] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-10T20:28:53.347478] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-10T20:28:53.347665] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-10T20:28:53.347875] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-10T20:28:53.347918] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-10T20:28:53.348342] [DEBUG] [LOCAL ] NIM: Trimmed 6468 records to 3923 (keeping 200 days of data) [2025-10-10T20:28:53.371493] [DEBUG] [LOCAL ] NIM: Primary data saved (3923 records). [2025-10-10T20:28:53.371575] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-10T20:28:53.371674] [INFO ] [MAIN ] Update Progress: 1484/2373 symbols completed. NIM took 22.9s. Estimated remaining: 2h 5m 6s. Rate: 7.1 symbols/min [2025-10-10T20:28:53.545955] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:28:53.546148] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-10T20:28:53.546195] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-10T20:28:53.546362] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-10T20:28:53.546403] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-10T20:28:53.546446] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-10T20:28:53.546479] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-10T20:28:53.891500] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-10T20:28:53.914307] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:28:54.276945] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-10-10T20:28:54.689359] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-10-10T20:28:55.266637] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:28:55.267121] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-10-10T20:28:55.267212] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:28:55.267259] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-10T20:28:55.267515] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:28:55.267713] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-10T20:28:55.267817] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-10T20:28:55.267938] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-10T20:28:55.268007] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-10T20:28:55.268057] [INFO ] [MAIN ] Update Progress: 1485/2373 symbols completed. NIQ took 1.9s. Estimated remaining: 2h 4m 53s. Rate: 7.1 symbols/min [2025-10-10T20:28:55.449524] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:28:55.449980] [DEBUG] [LOCAL ] NJR: No existing data file found in primary storage. [2025-10-10T20:28:55.450058] [WARN ] [MAIN ] NJR: No existing data found, performing full refresh instead. [2025-10-10T20:28:55.480590] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-10T20:28:55.481071] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-10T20:28:55.483074] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-10T20:28:55.483208] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-10T20:28:55.482963] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-10T20:28:55.506238] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-10T20:28:55.638271] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T20:28:55.922663] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:28:56.289409] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-10T20:28:57.089420] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-10-10T20:28:57.889407] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-10T20:28:58.297595] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-10-10T20:28:58.468301] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-10T20:28:58.689341] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-10T20:28:58.784799] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T20:28:59.489367] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-10T20:28:59.523173] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T20:29:00.289359] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-10T20:29:00.400518] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T20:29:00.404901] [INFO ] [REMOTE ] NI: Full fetch complete (76876 records). [2025-10-10T20:29:00.405016] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-10T20:29:00.405847] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:29:00.405946] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:29:00.405988] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:29:00.406054] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-10T20:29:00.406117] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-10T20:29:00.406152] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-10-10T20:29:00.406191] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-10-10T20:29:00.406266] [INFO ] [MAIN ] Update Progress: 1486/2373 symbols completed. NI took 51.4s. Estimated remaining: 2h 4m 43s. Rate: 7.1 symbols/min [2025-10-10T20:29:00.571058] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:29:00.571225] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-10T20:29:00.571261] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-10T20:29:00.571372] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-10T20:29:00.571414] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-10T20:29:00.571454] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-10T20:29:00.571485] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-10T20:29:00.922389] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:29:01.089391] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-10-10T20:29:01.889414] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-10T20:29:02.409998] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (3.72 seconds). [2025-10-10T20:29:02.492414] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-10T20:29:02.689506] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-10T20:29:03.489403] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-10T20:29:04.031639] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-10T20:29:04.289440] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-10T20:29:04.803874] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (3.71 seconds). [2025-10-10T20:29:05.089398] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-10T20:29:05.210678] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T20:29:05.347494] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-10T20:29:05.889431] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-10T20:29:06.363243] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-10T20:29:06.689364] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-10T20:29:07.489593] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-10T20:29:07.638167] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T20:29:07.866346] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-10-10T20:29:08.289388] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-10T20:29:09.089353] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-10T20:29:09.257299] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T20:29:09.411361] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-10T20:29:09.889384] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-10T20:29:10.689371] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-10T20:29:10.881123] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T20:29:11.019067] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.73 seconds). [2025-10-10T20:29:11.464762] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-10T20:29:11.489331] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-10T20:29:12.289380] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-10T20:29:13.089415] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-10T20:29:13.387687] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-10T20:29:13.469087] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T20:29:13.889376] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-10T20:29:14.601421] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-10T20:29:14.689370] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-10T20:29:15.199523] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-10-10T20:29:15.489386] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-10T20:29:15.966481] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T20:29:15.969146] [INFO ] [REMOTE ] NINE: Full fetch complete (43343 records). [2025-10-10T20:29:15.969252] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-10T20:29:16.356686] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-10T20:29:16.357094] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-10T20:29:16.358157] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-10T20:29:16.353962] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-10T20:29:16.358466] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-10T20:29:16.361268] [DEBUG] [LOCAL ] NINE: Trimmed 43343 records to 28496 (keeping 200 days of data) [2025-10-10T20:29:16.481825] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-10T20:29:16.572362] [DEBUG] [LOCAL ] NINE: Primary data saved (28496 records). [2025-10-10T20:29:16.572514] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-10T20:29:16.572591] [INFO ] [MAIN ] Update Progress: 1487/2373 symbols completed. NINE took 36.4s. Estimated remaining: 2h 4m 39s. Rate: 7.1 symbols/min [2025-10-10T20:29:16.744097] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:29:16.744269] [DEBUG] [LOCAL ] NKX: No existing data file found in primary storage. [2025-10-10T20:29:16.744333] [WARN ] [MAIN ] NKX: No existing data found, performing full refresh instead. [2025-10-10T20:29:16.744446] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-10T20:29:16.744489] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-10T20:29:16.744533] [DEBUG] [LOCAL ] NKX: No primary data file found to delete. [2025-10-10T20:29:16.744568] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-10T20:29:17.089698] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-10T20:29:17.111215] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:29:17.199782] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-10T20:29:17.889382] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-10-10T20:29:18.689352] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-10T20:29:19.100209] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-10T20:29:19.455891] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (3.10 seconds). [2025-10-10T20:29:19.489337] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-10T20:29:19.907826] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-10-10T20:29:20.179983] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-10T20:29:20.289364] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-10T20:29:21.089405] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-10T20:29:21.702784] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T20:29:21.874950] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-10T20:29:21.889340] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-10T20:29:22.689380] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-10T20:29:23.489427] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-10T20:29:23.991461] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.90 seconds). [2025-10-10T20:29:24.059877] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-10T20:29:24.289406] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-10T20:29:24.380876] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-10T20:29:24.467770] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T20:29:25.089349] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-10T20:29:25.232451] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T20:29:25.238187] [INFO ] [REMOTE ] NIO: Full fetch complete (77974 records). [2025-10-10T20:29:25.238399] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-10T20:29:25.645971] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-10T20:29:25.646103] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-10T20:29:25.647853] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-10T20:29:25.647925] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-10T20:29:25.649868] [DEBUG] [LOCAL ] NIO: Trimmed 77974 records to 54582 (keeping 200 days of data) [2025-10-10T20:29:25.893840] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-10T20:29:25.993704] [DEBUG] [LOCAL ] NIO: Primary data saved (54582 records). [2025-10-10T20:29:25.993864] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-10T20:29:25.993943] [INFO ] [MAIN ] Update Progress: 1488/2373 symbols completed. NIO took 42.7s. Estimated remaining: 2h 4m 31s. Rate: 7.1 symbols/min [2025-10-10T20:29:26.163990] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:29:26.164196] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-10T20:29:26.164234] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-10T20:29:26.164346] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-10T20:29:26.164391] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-10T20:29:26.164431] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-10T20:29:26.164465] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-10T20:29:26.542219] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:29:26.689416] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-10T20:29:26.929980] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-10T20:29:27.489345] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-10T20:29:27.611213] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T20:29:27.616222] [INFO ] [REMOTE ] NJR: Full fetch complete (54493 records). [2025-10-10T20:29:27.616390] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-10T20:29:27.617229] [FATAL] [VALIDATOR ] NJR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:29:27.617324] [FATAL] [MAIN ] NJR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:29:27.617372] [WARN ] [MAIN ] NJR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:29:27.617447] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-10T20:29:27.617520] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-10T20:29:27.617562] [INFO ] [LOCAL ] NJR: Starting deletion of derivative data. [2025-10-10T20:29:27.617603] [DEBUG] [LOCAL ] NJR: No derivative data file found to delete. [2025-10-10T20:29:27.617771] [INFO ] [MAIN ] Update Progress: 1489/2373 symbols completed. NJR took 32.3s. Estimated remaining: 2h 4m 19s. Rate: 7.1 symbols/min [2025-10-10T20:29:27.807137] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:29:27.807406] [DEBUG] [LOCAL ] NLOP: No existing data file found in primary storage. [2025-10-10T20:29:27.807543] [WARN ] [MAIN ] NLOP: No existing data found, performing full refresh instead. [2025-10-10T20:29:27.807824] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-10T20:29:27.807956] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-10T20:29:27.808149] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-10T20:29:27.808220] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-10T20:29:28.230825] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:29:28.234100] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (3.14 seconds). [2025-10-10T20:29:28.244215] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-10T20:29:28.289347] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-10T20:29:29.089352] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-10-10T20:29:29.412288] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-10T20:29:29.883146] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-10T20:29:29.889328] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-10T20:29:30.675819] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-10T20:29:30.689330] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-10T20:29:31.489360] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-10T20:29:31.516763] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-10T20:29:32.289368] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-10T20:29:32.461099] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-10T20:29:33.070780] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-10T20:29:33.089326] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-10T20:29:33.889347] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-10-10T20:29:33.915256] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-10T20:29:34.689362] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-10T20:29:34.947619] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-10T20:29:35.489398] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-10T20:29:35.499052] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-10T20:29:36.289385] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-10T20:29:37.089412] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-10T20:29:37.104826] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-10T20:29:37.889365] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-10T20:29:38.143626] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-10T20:29:38.254062] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-10T20:29:38.689360] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-10T20:29:38.766999] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-10T20:29:39.489389] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-10T20:29:40.289344] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-10T20:29:40.690050] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-10T20:29:41.089405] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-10T20:29:41.103201] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-10T20:29:41.210492] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-10T20:29:41.889344] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-10T20:29:42.236749] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-10T20:29:42.689337] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-10T20:29:42.916579] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-10T20:29:43.489351] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-10T20:29:43.923966] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-10T20:29:44.289349] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-10T20:29:44.592760] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-10T20:29:45.089348] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-10T20:29:45.174306] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T20:29:45.178956] [INFO ] [REMOTE ] NKE: Full fetch complete (76807 records). [2025-10-10T20:29:45.179088] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-10T20:29:45.179867] [FATAL] [VALIDATOR ] NKE: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:29:45.179955] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:29:45.180020] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:29:45.180083] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-10T20:29:45.180146] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-10T20:29:45.180181] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-10T20:29:45.180220] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-10T20:29:45.180299] [INFO ] [MAIN ] Update Progress: 1490/2373 symbols completed. NKE took 44.8s. Estimated remaining: 2h 4m 16s. Rate: 7.1 symbols/min [2025-10-10T20:29:45.362881] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:29:45.363110] [DEBUG] [LOCAL ] NLY: No existing data file found in primary storage. [2025-10-10T20:29:45.363149] [WARN ] [MAIN ] NLY: No existing data found, performing full refresh instead. [2025-10-10T20:29:45.363270] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-10T20:29:45.363311] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-10T20:29:45.363356] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-10T20:29:45.363389] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-10T20:29:45.737176] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:29:45.889382] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-10T20:29:46.153565] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-10T20:29:46.155206] [INFO ] [REMOTE ] NKX: Full fetch complete (19256 records). [2025-10-10T20:29:46.155277] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-10T20:29:46.506172] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-10T20:29:46.506254] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-10T20:29:46.506716] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-10T20:29:46.506815] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-10T20:29:46.507383] [DEBUG] [LOCAL ] NKX: Trimmed 19256 records to 13828 (keeping 200 days of data) [2025-10-10T20:29:46.591704] [DEBUG] [LOCAL ] NKX: Primary data saved (13828 records). [2025-10-10T20:29:46.591857] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-10T20:29:46.591931] [INFO ] [MAIN ] Update Progress: 1491/2373 symbols completed. NKX took 30.0s. Estimated remaining: 2h 4m 3s. Rate: 7.1 symbols/min [2025-10-10T20:29:46.689441] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-10-10T20:29:46.794234] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:29:46.794431] [DEBUG] [LOCAL ] NMAI: No existing data file found in primary storage. [2025-10-10T20:29:46.794468] [WARN ] [MAIN ] NMAI: No existing data found, performing full refresh instead. [2025-10-10T20:29:46.794590] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-10T20:29:46.794630] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-10T20:29:46.794710] [DEBUG] [LOCAL ] NMAI: No primary data file found to delete. [2025-10-10T20:29:46.794752] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-10T20:29:47.145140] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:29:47.155903] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-10T20:29:47.489378] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-10T20:29:48.289379] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-10-10T20:29:48.511962] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-10T20:29:48.867125] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-10T20:29:49.089411] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-10T20:29:49.510723] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T20:29:49.889407] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-10T20:29:50.149813] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-10T20:29:50.689356] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-10T20:29:51.140304] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T20:29:51.489386] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-10T20:29:51.621677] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-10T20:29:52.289411] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-10T20:29:52.543036] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-10T20:29:53.089402] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-10T20:29:53.889394] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-10T20:29:54.425106] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-10T20:29:54.476950] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-10T20:29:54.689376] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-10T20:29:54.708745] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-10T20:29:55.489459] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-10T20:29:56.289348] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-10T20:29:56.509110] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-10T20:29:56.886049] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-10T20:29:57.089344] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-10T20:29:57.520398] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-10T20:29:57.889376] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-10T20:29:58.533772] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-10T20:29:58.689328] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-10T20:29:59.475754] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-10T20:29:59.489339] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-10T20:29:59.550227] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-10T20:30:00.289431] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-10T20:30:00.600838] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-10T20:30:01.089412] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-10T20:30:01.675415] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-10T20:30:01.889378] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-10T20:30:02.692031] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-10T20:30:02.692280] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-10T20:30:02.693667] [INFO ] [REMOTE ] NL: Full fetch complete (6800 records). [2025-10-10T20:30:02.693782] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-10T20:30:02.858420] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-10T20:30:02.934946] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T20:30:02.935206] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:30:02.935298] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:30:02.935369] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-10T20:30:02.935431] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-10T20:30:02.935466] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-10T20:30:02.935505] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-10T20:30:02.935561] [INFO ] [MAIN ] Update Progress: 1492/2373 symbols completed. NL took 36.9s. Estimated remaining: 2h 3m 59s. Rate: 7.1 symbols/min [2025-10-10T20:30:03.103287] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:30:03.103452] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-10T20:30:03.103488] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-10T20:30:03.103597] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-10T20:30:03.103665] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-10T20:30:03.103733] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-10T20:30:03.103766] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-10T20:30:03.449972] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:30:03.455556] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T20:30:03.456779] [INFO ] [REMOTE ] NLOP: Full fetch complete (17652 records). [2025-10-10T20:30:03.456847] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-10T20:30:03.457230] [FATAL] [VALIDATOR ] NLOP: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:30:03.457311] [FATAL] [MAIN ] NLOP: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:30:03.457353] [WARN ] [MAIN ] NLOP: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:30:03.457391] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-10T20:30:03.457444] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-10T20:30:03.457478] [INFO ] [LOCAL ] NLOP: Starting deletion of derivative data. [2025-10-10T20:30:03.457565] [DEBUG] [LOCAL ] NLOP: No derivative data file found to delete. [2025-10-10T20:30:03.457668] [INFO ] [MAIN ] Update Progress: 1493/2373 symbols completed. NLOP took 35.8s. Estimated remaining: 2h 3m 46s. Rate: 7.1 symbols/min [2025-10-10T20:30:03.495394] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-10T20:30:03.631035] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:30:03.631200] [DEBUG] [LOCAL ] NMCO: No existing data file found in primary storage. [2025-10-10T20:30:03.631236] [WARN ] [MAIN ] NMCO: No existing data found, performing full refresh instead. [2025-10-10T20:30:03.631345] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-10T20:30:03.631385] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-10T20:30:03.631426] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-10T20:30:03.631458] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-10T20:30:04.016131] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:30:04.289382] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-10-10T20:30:04.626866] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:30:04.627294] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-10-10T20:30:04.627403] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:30:04.627502] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-10T20:30:04.627589] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:30:04.627707] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-10T20:30:04.627790] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-10T20:30:04.627830] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-10T20:30:04.627871] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-10T20:30:04.627918] [INFO ] [MAIN ] Update Progress: 1494/2373 symbols completed. NMAX took 1.7s. Estimated remaining: 2h 3m 34s. Rate: 7.1 symbols/min [2025-10-10T20:30:04.800959] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:30:04.801151] [DEBUG] [LOCAL ] NMG: No existing data file found in primary storage. [2025-10-10T20:30:04.801188] [WARN ] [MAIN ] NMG: No existing data found, performing full refresh instead. [2025-10-10T20:30:04.801327] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-10T20:30:04.801397] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-10T20:30:04.801451] [DEBUG] [LOCAL ] NMG: No primary data file found to delete. [2025-10-10T20:30:04.801484] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-10T20:30:05.094494] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-10-10T20:30:05.158056] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:30:05.889338] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-10-10T20:30:05.985932] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-10T20:30:06.570414] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T20:30:06.689388] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-10T20:30:06.972034] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-10T20:30:07.489414] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-10T20:30:07.922262] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-10T20:30:08.289445] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-10T20:30:08.752599] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-10T20:30:09.089380] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-10T20:30:09.386085] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-10T20:30:09.889383] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-10T20:30:10.111632] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-10T20:30:10.689387] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-10T20:30:11.489368] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-10T20:30:11.598730] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-10T20:30:11.973328] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-10T20:30:12.221600] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-10T20:30:12.289412] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-10T20:30:13.089367] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-10T20:30:13.432248] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-10T20:30:13.889368] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-10T20:30:14.608030] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T20:30:14.689378] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-10T20:30:14.980209] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-10T20:30:15.489399] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-10T20:30:16.289433] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-10T20:30:16.951019] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-10T20:30:17.094481] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-10T20:30:17.111161] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-10T20:30:17.550409] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T20:30:17.889357] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-10T20:30:18.311018] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-10T20:30:18.689383] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-10T20:30:19.489372] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-10T20:30:19.639279] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T20:30:19.641085] [INFO ] [REMOTE ] NMAI: Full fetch complete (19798 records). [2025-10-10T20:30:19.641156] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-10T20:30:19.849764] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T20:30:20.055331] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-10T20:30:20.055416] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-10T20:30:20.055919] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-10T20:30:20.055980] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-10T20:30:20.056496] [DEBUG] [LOCAL ] NMAI: Trimmed 19798 records to 13086 (keeping 200 days of data) [2025-10-10T20:30:20.133954] [DEBUG] [LOCAL ] NMAI: Primary data saved (13086 records). [2025-10-10T20:30:20.134095] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-10T20:30:20.134168] [INFO ] [MAIN ] Update Progress: 1495/2373 symbols completed. NMAI took 33.5s. Estimated remaining: 2h 3m 29s. Rate: 7.1 symbols/min [2025-10-10T20:30:20.271073] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-10T20:30:20.299983] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-10T20:30:20.326564] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:30:20.326709] [DEBUG] [LOCAL ] NMI: No existing data file found in primary storage. [2025-10-10T20:30:20.326757] [WARN ] [MAIN ] NMI: No existing data found, performing full refresh instead. [2025-10-10T20:30:20.326866] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-10T20:30:20.326908] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-10T20:30:20.326984] [DEBUG] [LOCAL ] NMI: No primary data file found to delete. [2025-10-10T20:30:20.327027] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-10T20:30:20.676520] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:30:21.089367] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-10-10T20:30:21.128681] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-10T20:30:21.889360] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-10T20:30:21.998481] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-10T20:30:22.689376] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-10T20:30:22.734755] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-10T20:30:23.434985] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-10T20:30:23.489388] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-10T20:30:24.273389] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-10T20:30:24.289331] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-10T20:30:25.089354] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-10T20:30:25.189516] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T20:30:25.193917] [INFO ] [REMOTE ] NLY: Full fetch complete (77172 records). [2025-10-10T20:30:25.194026] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-10T20:30:25.194821] [FATAL] [VALIDATOR ] NLY: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:30:25.194911] [FATAL] [MAIN ] NLY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:30:25.194955] [WARN ] [MAIN ] NLY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:30:25.195020] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-10T20:30:25.195084] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-10T20:30:25.195120] [INFO ] [LOCAL ] NLY: Starting deletion of derivative data. [2025-10-10T20:30:25.195161] [DEBUG] [LOCAL ] NLY: No derivative data file found to delete. [2025-10-10T20:30:25.195220] [INFO ] [MAIN ] Update Progress: 1496/2373 symbols completed. NLY took 40.0s. Estimated remaining: 2h 3m 19s. Rate: 7.1 symbols/min [2025-10-10T20:30:25.378754] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:30:25.379001] [DEBUG] [LOCAL ] NMM: No existing data file found in primary storage. [2025-10-10T20:30:25.379041] [WARN ] [MAIN ] NMM: No existing data found, performing full refresh instead. [2025-10-10T20:30:25.379171] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-10T20:30:25.379215] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-10T20:30:25.379257] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-10T20:30:25.379292] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-10T20:30:25.750726] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:30:25.889378] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-10-10T20:30:26.356374] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-10T20:30:26.689389] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-10T20:30:27.275295] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T20:30:27.489344] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-10T20:30:27.913510] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T20:30:28.289406] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-10T20:30:28.871134] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-10T20:30:28.886018] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-10T20:30:29.089381] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-10T20:30:29.889380] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-10T20:30:30.422792] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T20:30:30.689374] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-10T20:30:31.167898] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T20:30:31.489401] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-10T20:30:32.059254] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-10T20:30:32.060892] [INFO ] [REMOTE ] NMCO: Full fetch complete (23522 records). [2025-10-10T20:30:32.060975] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-10T20:30:32.061426] [FATAL] [VALIDATOR ] NMCO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:30:32.061509] [FATAL] [MAIN ] NMCO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:30:32.061551] [WARN ] [MAIN ] NMCO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:30:32.061590] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-10T20:30:32.061679] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-10T20:30:32.061735] [INFO ] [LOCAL ] NMCO: Starting deletion of derivative data. [2025-10-10T20:30:32.061779] [DEBUG] [LOCAL ] NMCO: No derivative data file found to delete. [2025-10-10T20:30:32.061835] [INFO ] [MAIN ] Update Progress: 1497/2373 symbols completed. NMCO took 28.6s. Estimated remaining: 2h 3m 10s. Rate: 7.1 symbols/min [2025-10-10T20:30:32.164747] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-10T20:30:32.250567] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:30:32.250802] [DEBUG] [LOCAL ] NMR: No existing data file found in primary storage. [2025-10-10T20:30:32.250848] [WARN ] [MAIN ] NMR: No existing data found, performing full refresh instead. [2025-10-10T20:30:32.250966] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-10T20:30:32.251008] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-10T20:30:32.251050] [DEBUG] [LOCAL ] NMR: No primary data file found to delete. [2025-10-10T20:30:32.251087] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-10T20:30:32.294527] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-10T20:30:32.652931] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:30:33.089382] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-10-10T20:30:33.215332] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-10T20:30:33.889421] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-10T20:30:34.689946] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-10T20:30:34.690738] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-10T20:30:34.764036] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-10T20:30:35.489347] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-10T20:30:36.018398] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-10T20:30:36.258725] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-10T20:30:36.289374] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-10T20:30:37.089359] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-10T20:30:37.132535] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-10T20:30:37.889377] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-10T20:30:37.899624] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-10T20:30:38.689352] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-10T20:30:38.974724] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-10T20:30:39.475629] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-10T20:30:39.489322] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-10T20:30:40.289388] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-10T20:30:40.728731] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T20:30:41.089361] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-10T20:30:41.889357] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-10T20:30:41.979802] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T20:30:42.218605] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-10T20:30:42.445329] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-10T20:30:42.689381] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-10T20:30:43.489449] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-10T20:30:43.943906] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-10T20:30:44.289364] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-10T20:30:44.614994] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T20:30:45.089426] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-10T20:30:45.537923] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T20:30:45.889368] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-10T20:30:46.249015] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-10T20:30:46.251920] [INFO ] [REMOTE ] NMG: Full fetch complete (14151 records). [2025-10-10T20:30:46.251988] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-10T20:30:46.607229] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-10T20:30:46.607343] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-10T20:30:46.607741] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-10T20:30:46.607804] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-10T20:30:46.608342] [DEBUG] [LOCAL ] NMG: Trimmed 14151 records to 9690 (keeping 200 days of data) [2025-10-10T20:30:46.662830] [DEBUG] [LOCAL ] NMG: Primary data saved (9690 records). [2025-10-10T20:30:46.662971] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-10T20:30:46.663045] [INFO ] [MAIN ] Update Progress: 1498/2373 symbols completed. NMG took 42.0s. Estimated remaining: 2h 3m 5s. Rate: 7.1 symbols/min [2025-10-10T20:30:46.694447] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-10T20:30:46.837091] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:30:46.837249] [DEBUG] [LOCAL ] NMS: No existing data file found in primary storage. [2025-10-10T20:30:46.837285] [WARN ] [MAIN ] NMS: No existing data found, performing full refresh instead. [2025-10-10T20:30:46.837394] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-10T20:30:46.837455] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-10T20:30:46.837526] [DEBUG] [LOCAL ] NMS: No primary data file found to delete. [2025-10-10T20:30:46.837571] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-10T20:30:47.210430] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:30:47.217823] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-10T20:30:47.219472] [INFO ] [REMOTE ] NMM: Full fetch complete (21592 records). [2025-10-10T20:30:47.219550] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-10T20:30:47.220048] [FATAL] [VALIDATOR ] NMM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:30:47.220198] [FATAL] [MAIN ] NMM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:30:47.220290] [WARN ] [MAIN ] NMM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:30:47.220385] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-10T20:30:47.220468] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-10T20:30:47.220508] [INFO ] [LOCAL ] NMM: Starting deletion of derivative data. [2025-10-10T20:30:47.220546] [DEBUG] [LOCAL ] NMM: No derivative data file found to delete. [2025-10-10T20:30:47.220604] [INFO ] [MAIN ] Update Progress: 1499/2373 symbols completed. NMM took 22.0s. Estimated remaining: 2h 2m 52s. Rate: 7.1 symbols/min [2025-10-10T20:30:47.420606] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:30:47.420827] [DEBUG] [LOCAL ] NMT: No existing data file found in primary storage. [2025-10-10T20:30:47.420888] [WARN ] [MAIN ] NMT: No existing data found, performing full refresh instead. [2025-10-10T20:30:47.421011] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-10T20:30:47.421055] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-10T20:30:47.421097] [DEBUG] [LOCAL ] NMT: No primary data file found to delete. [2025-10-10T20:30:47.421132] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-10T20:30:47.499575] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-10-10T20:30:47.848034] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-10T20:30:48.000352] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:30:48.184168] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-10T20:30:48.289402] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-10T20:30:48.950311] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-10T20:30:49.089457] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-10T20:30:49.860165] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-10T20:30:49.889382] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-10T20:30:50.689475] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-10T20:30:50.715152] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-10T20:30:51.461824] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-10T20:30:51.489373] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-10T20:30:52.289383] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-10T20:30:52.905264] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-10T20:30:53.089355] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-10T20:30:53.203054] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T20:30:53.712965] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-10T20:30:53.889386] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-10T20:30:54.689442] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-10-10T20:30:54.712292] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-10T20:30:55.489347] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-10T20:30:55.591247] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-10T20:30:56.055262] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-10T20:30:56.056224] [INFO ] [REMOTE ] NMI: Full fetch complete (5877 records). [2025-10-10T20:30:56.056298] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-10T20:30:56.294746] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-10T20:30:56.416753] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-10T20:30:56.416827] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-10T20:30:56.417013] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-10T20:30:56.417077] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-10T20:30:56.417445] [DEBUG] [LOCAL ] NMI: Trimmed 5877 records to 4095 (keeping 200 days of data) [2025-10-10T20:30:56.441507] [DEBUG] [LOCAL ] NMI: Primary data saved (4095 records). [2025-10-10T20:30:56.441568] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-10T20:30:56.441630] [INFO ] [MAIN ] Update Progress: 1500/2373 symbols completed. NMI took 36.3s. Estimated remaining: 2h 2m 44s. Rate: 7.1 symbols/min [2025-10-10T20:30:56.608112] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:30:56.608327] [DEBUG] [LOCAL ] NMZ: No existing data file found in primary storage. [2025-10-10T20:30:56.608363] [WARN ] [MAIN ] NMZ: No existing data found, performing full refresh instead. [2025-10-10T20:30:56.608506] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-10T20:30:56.608547] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-10T20:30:56.608587] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-10T20:30:56.608619] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-10T20:30:56.953883] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:30:57.089348] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-10-10T20:30:57.099810] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-10T20:30:57.889441] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-10T20:30:58.455412] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T20:30:58.547048] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-10T20:30:58.689412] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-10T20:30:59.324164] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-10T20:30:59.489425] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-10T20:31:00.188127] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-10T20:31:00.289405] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-10T20:31:01.036968] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-10T20:31:01.089409] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-10T20:31:01.889377] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-10T20:31:02.504302] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-10T20:31:02.505179] [INFO ] [REMOTE ] NMS: Full fetch complete (4075 records). [2025-10-10T20:31:02.505246] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-10T20:31:02.634671] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-10T20:31:02.695986] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-10T20:31:02.876902] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-10T20:31:02.877015] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-10T20:31:02.877149] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-10T20:31:02.877189] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-10T20:31:02.877520] [DEBUG] [LOCAL ] NMS: Trimmed 4075 records to 2908 (keeping 200 days of data) [2025-10-10T20:31:02.895089] [DEBUG] [LOCAL ] NMS: Primary data saved (2908 records). [2025-10-10T20:31:02.895150] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-10T20:31:02.895211] [INFO ] [MAIN ] Update Progress: 1501/2373 symbols completed. NMS took 16.2s. Estimated remaining: 2h 2m 34s. Rate: 7.1 symbols/min [2025-10-10T20:31:03.058302] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:31:03.058470] [DEBUG] [LOCAL ] NNI: No existing data file found in primary storage. [2025-10-10T20:31:03.058506] [WARN ] [MAIN ] NNI: No existing data found, performing full refresh instead. [2025-10-10T20:31:03.058620] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-10T20:31:03.058692] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-10T20:31:03.058748] [DEBUG] [LOCAL ] NNI: No primary data file found to delete. [2025-10-10T20:31:03.058789] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-10T20:31:03.405888] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:31:03.489350] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-10-10T20:31:04.180123] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-10T20:31:04.289357] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-10T20:31:04.500707] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-10T20:31:04.931366] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-10T20:31:05.089378] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-10T20:31:05.889343] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-10T20:31:06.443148] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-10T20:31:06.565194] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-10T20:31:06.689356] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-10T20:31:07.489432] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-10T20:31:08.289389] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-10T20:31:08.518479] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-10T20:31:08.546384] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T20:31:09.089396] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-10T20:31:09.167982] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-10T20:31:09.284450] [DEBUG] [REMOTE ] NMR: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-10T20:31:09.285034] [WARN ] [REMOTE ] NMR: No data returned for month 2025-05 [2025-10-10T20:31:09.285159] [FATAL] [REMOTE ] NMR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:31:09.285308] [FATAL] [MAIN ] NMR: Failed to fetch primary data. [2025-10-10T20:31:09.285395] [WARN ] [MAIN ] NMR: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:31:09.285489] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-10T20:31:09.285576] [DEBUG] [LOCAL ] NMR: No primary data file found to delete. [2025-10-10T20:31:09.285615] [INFO ] [LOCAL ] NMR: Starting deletion of derivative data. [2025-10-10T20:31:09.285693] [DEBUG] [LOCAL ] NMR: No derivative data file found to delete. [2025-10-10T20:31:09.285768] [INFO ] [MAIN ] Update Progress: 1502/2373 symbols completed. NMR took 37.2s. Estimated remaining: 2h 2m 24s. Rate: 7.1 symbols/min [2025-10-10T20:31:09.471570] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:31:09.471880] [DEBUG] [LOCAL ] NNN: No existing data file found in primary storage. [2025-10-10T20:31:09.471926] [WARN ] [MAIN ] NNN: No existing data found, performing full refresh instead. [2025-10-10T20:31:09.472062] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-10T20:31:09.472111] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-10T20:31:09.472154] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-10T20:31:09.472189] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-10T20:31:09.894846] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-10T20:31:09.900110] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:31:10.683116] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-10T20:31:10.689321] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-10T20:31:11.372126] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-10T20:31:11.489393] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-10T20:31:12.289422] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-10T20:31:13.014526] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-10T20:31:13.018546] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T20:31:13.089399] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-10T20:31:13.889399] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-10T20:31:14.048917] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-10T20:31:14.689379] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-10T20:31:15.211673] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T20:31:15.489382] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-10T20:31:15.861086] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-10T20:31:16.074115] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-10T20:31:16.289391] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-10T20:31:17.089533] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-10-10T20:31:17.543702] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-10T20:31:17.889380] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-10T20:31:18.689362] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-10T20:31:18.971556] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-10T20:31:19.037339] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T20:31:19.489436] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-10T20:31:20.125412] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-10T20:31:20.289392] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-10T20:31:20.919886] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-10T20:31:21.089360] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-10T20:31:21.406152] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-10T20:31:21.889394] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-10T20:31:22.313259] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T20:31:22.689373] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-10T20:31:23.238797] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-10T20:31:23.489359] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-10T20:31:23.931968] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-10T20:31:23.969241] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-10T20:31:24.289389] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-10T20:31:25.089375] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-10T20:31:25.889356] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-10T20:31:26.108592] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T20:31:26.197704] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-10T20:31:26.689349] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-10T20:31:26.902612] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-10T20:31:27.299533] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-10T20:31:27.300339] [INFO ] [REMOTE ] NMT: Full fetch complete (4044 records). [2025-10-10T20:31:27.300406] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-10T20:31:27.497026] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-10T20:31:27.654850] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-10T20:31:27.654925] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-10T20:31:27.655069] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-10T20:31:27.655156] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-10T20:31:27.655515] [DEBUG] [LOCAL ] NMT: Trimmed 4044 records to 2879 (keeping 200 days of data) [2025-10-10T20:31:27.673074] [DEBUG] [LOCAL ] NMT: Primary data saved (2879 records). [2025-10-10T20:31:27.673135] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-10T20:31:27.673204] [INFO ] [MAIN ] Update Progress: 1503/2373 symbols completed. NMT took 40.5s. Estimated remaining: 2h 2m 22s. Rate: 7.1 symbols/min [2025-10-10T20:31:27.848413] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:31:27.848718] [DEBUG] [LOCAL ] NNY: No existing data file found in primary storage. [2025-10-10T20:31:27.848773] [WARN ] [MAIN ] NNY: No existing data found, performing full refresh instead. [2025-10-10T20:31:27.848892] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-10T20:31:27.848934] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-10T20:31:27.848976] [DEBUG] [LOCAL ] NNY: No primary data file found to delete. [2025-10-10T20:31:27.849010] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-10T20:31:28.198622] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:31:28.289378] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-10-10T20:31:29.089351] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-10T20:31:29.326541] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-10T20:31:29.527143] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T20:31:29.889345] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-10T20:31:30.221394] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-10T20:31:30.691120] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-10T20:31:30.693072] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-10T20:31:31.489473] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-10T20:31:32.289363] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-10T20:31:32.804885] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T20:31:32.806236] [INFO ] [REMOTE ] NNI: Full fetch complete (12908 records). [2025-10-10T20:31:32.806352] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-10T20:31:32.960687] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T20:31:33.115615] [INFO ] [REMOTE ] NMZ: Full fetch complete (31372 records). [2025-10-10T20:31:33.106272] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-10T20:31:33.134569] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-10T20:31:33.134452] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-10T20:31:33.169349] [FATAL] [VALIDATOR ] NMZ: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:31:33.186038] [FATAL] [MAIN ] NMZ: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:31:33.196412] [WARN ] [MAIN ] NMZ: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:31:33.209542] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-10T20:31:33.219737] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-10T20:31:33.229466] [INFO ] [LOCAL ] NMZ: Starting deletion of derivative data. [2025-10-10T20:31:33.246134] [DEBUG] [LOCAL ] NMZ: No derivative data file found to delete. [2025-10-10T20:31:33.246718] [INFO ] [MAIN ] Update Progress: 1504/2373 symbols completed. NMZ took 36.8s. Estimated remaining: 2h 2m 12s. Rate: 7.1 symbols/min [2025-10-10T20:31:33.297831] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-10T20:31:33.324995] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-10T20:31:33.346729] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-10T20:31:33.355239] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-10T20:31:33.359148] [DEBUG] [LOCAL ] NNI: Trimmed 12908 records to 10443 (keeping 200 days of data) [2025-10-10T20:31:33.479856] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:31:33.497975] [DEBUG] [LOCAL ] NOA: No existing data file found in primary storage. [2025-10-10T20:31:33.502074] [WARN ] [MAIN ] NOA: No existing data found, performing full refresh instead. [2025-10-10T20:31:33.501984] [DEBUG] [LOCAL ] NNI: Primary data saved (10443 records). [2025-10-10T20:31:33.502268] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-10T20:31:33.502468] [INFO ] [MAIN ] Update Progress: 1505/2373 symbols completed. NNI took 30.6s. Estimated remaining: 2h 1m 59s. Rate: 7.1 symbols/min [2025-10-10T20:31:33.534543] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-10T20:31:33.560696] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-10T20:31:33.560830] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-10T20:31:33.570052] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-10T20:31:33.848136] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:31:33.862674] [DEBUG] [LOCAL ] NOAH: No existing data file found in primary storage. [2025-10-10T20:31:33.865899] [WARN ] [MAIN ] NOAH: No existing data found, performing full refresh instead. [2025-10-10T20:31:33.866734] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-10T20:31:33.877051] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-10T20:31:33.890427] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-10T20:31:33.890332] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-10T20:31:33.907175] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-10T20:31:34.132912] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-10T20:31:34.269773] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:31:34.482951] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:31:34.689411] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-10-10T20:31:35.489370] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-10-10T20:31:35.698564] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T20:31:36.187750] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-10T20:31:36.289364] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-10T20:31:36.471029] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-10T20:31:37.089387] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-10T20:31:37.472096] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-10T20:31:37.889401] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-10T20:31:38.139698] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-10T20:31:38.689384] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-10T20:31:39.489482] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-10T20:31:39.920410] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T20:31:39.951109] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T20:31:40.289345] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-10T20:31:40.316895] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-10T20:31:41.089374] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-10T20:31:41.889379] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-10T20:31:42.335293] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-10T20:31:42.401896] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-10T20:31:42.414954] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-10T20:31:42.689404] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-10T20:31:43.489377] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-10T20:31:43.767774] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-10T20:31:44.289445] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-10T20:31:45.089369] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-10T20:31:45.427937] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T20:31:45.667602] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-10T20:31:45.872158] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-10T20:31:45.889352] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-10T20:31:46.675864] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-10T20:31:46.689349] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-10T20:31:47.489396] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-10T20:31:47.720782] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-10T20:31:48.289383] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-10T20:31:48.839201] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T20:31:48.838763] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-10T20:31:49.089387] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-10T20:31:49.889387] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-10T20:31:50.689377] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-10T20:31:51.061059] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T20:31:51.082512] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-10T20:31:51.213487] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-10T20:31:51.489397] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-10T20:31:51.974179] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-10T20:31:51.975210] [INFO ] [REMOTE ] NNY: Full fetch complete (8518 records). [2025-10-10T20:31:51.975279] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-10T20:31:52.297971] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-10T20:31:52.330362] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-10T20:31:52.330435] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-10T20:31:52.330682] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-10T20:31:52.330741] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-10T20:31:52.331130] [DEBUG] [LOCAL ] NNY: Trimmed 8518 records to 5676 (keeping 200 days of data) [2025-10-10T20:31:52.366114] [DEBUG] [LOCAL ] NNY: Primary data saved (5676 records). [2025-10-10T20:31:52.366229] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-10T20:31:52.366315] [INFO ] [MAIN ] Update Progress: 1506/2373 symbols completed. NNY took 24.7s. Estimated remaining: 2h 1m 56s. Rate: 7.1 symbols/min [2025-10-10T20:31:52.537575] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:31:52.537814] [DEBUG] [LOCAL ] NOC: No existing data file found in primary storage. [2025-10-10T20:31:52.537869] [WARN ] [MAIN ] NOC: No existing data found, performing full refresh instead. [2025-10-10T20:31:52.537997] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-10T20:31:52.538039] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-10T20:31:52.538081] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-10T20:31:52.538114] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-10T20:31:52.891446] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:31:53.089335] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-10T20:31:53.459722] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-10T20:31:53.889373] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-10T20:31:54.668440] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T20:31:54.689326] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-10T20:31:54.836736] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T20:31:54.841015] [INFO ] [REMOTE ] NNN: Full fetch complete (69874 records). [2025-10-10T20:31:54.841139] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-10T20:31:54.841822] [FATAL] [VALIDATOR ] NNN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:31:54.841909] [FATAL] [MAIN ] NNN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:31:54.841953] [WARN ] [MAIN ] NNN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:31:54.842022] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-10T20:31:54.842087] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-10T20:31:54.842123] [INFO ] [LOCAL ] NNN: Starting deletion of derivative data. [2025-10-10T20:31:54.842164] [DEBUG] [LOCAL ] NNN: No derivative data file found to delete. [2025-10-10T20:31:54.842238] [INFO ] [MAIN ] Update Progress: 1507/2373 symbols completed. NNN took 45.6s. Estimated remaining: 2h 1m 44s. Rate: 7.1 symbols/min [2025-10-10T20:31:55.028584] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:31:55.028762] [DEBUG] [LOCAL ] NOG: No existing data file found in primary storage. [2025-10-10T20:31:55.028806] [WARN ] [MAIN ] NOG: No existing data found, performing full refresh instead. [2025-10-10T20:31:55.028919] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-10T20:31:55.028962] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-10T20:31:55.029007] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-10T20:31:55.029040] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-10T20:31:55.414706] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:31:55.489458] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-10-10T20:31:55.722408] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-10T20:31:56.289428] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-10-10T20:31:57.089415] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-10T20:31:57.352103] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T20:31:57.889412] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-10T20:31:58.041461] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-10T20:31:58.501133] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T20:31:58.689428] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-10T20:31:59.489361] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-10T20:31:59.913863] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T20:32:00.027169] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-10T20:32:00.289346] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-10T20:32:01.089385] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-10T20:32:01.588013] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T20:32:01.615273] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-10T20:32:01.889420] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-10T20:32:02.689345] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-10T20:32:02.825611] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-10T20:32:03.286042] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-10T20:32:03.489389] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-10T20:32:03.839769] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-10T20:32:04.289373] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-10T20:32:05.089374] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-10T20:32:05.316892] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T20:32:05.889477] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-10T20:32:06.297560] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-10T20:32:06.509245] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-10T20:32:06.689369] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-10T20:32:07.489359] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-10T20:32:07.579317] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T20:32:07.889321] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T20:32:08.233215] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T20:32:08.235220] [INFO ] [REMOTE ] NOAH: Full fetch complete (27911 records). [2025-10-10T20:32:08.235303] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-10T20:32:08.235810] [FATAL] [VALIDATOR ] NOAH: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:32:08.235891] [FATAL] [MAIN ] NOAH: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:32:08.235934] [WARN ] [MAIN ] NOAH: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:32:08.235971] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-10T20:32:08.236025] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-10T20:32:08.236059] [INFO ] [LOCAL ] NOAH: Starting deletion of derivative data. [2025-10-10T20:32:08.236097] [DEBUG] [LOCAL ] NOAH: No derivative data file found to delete. [2025-10-10T20:32:08.236148] [INFO ] [MAIN ] Update Progress: 1508/2373 symbols completed. NOAH took 34.7s. Estimated remaining: 2h 1m 39s. Rate: 7.1 symbols/min [2025-10-10T20:32:08.297863] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-10T20:32:08.410942] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:32:08.411121] [DEBUG] [LOCAL ] NOK: No existing data file found in primary storage. [2025-10-10T20:32:08.411157] [WARN ] [MAIN ] NOK: No existing data found, performing full refresh instead. [2025-10-10T20:32:08.411269] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-10T20:32:08.411309] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-10T20:32:08.411350] [DEBUG] [LOCAL ] NOK: No primary data file found to delete. [2025-10-10T20:32:08.411381] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-10T20:32:08.757229] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:32:09.089396] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-10T20:32:09.786252] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-10T20:32:09.788166] [INFO ] [REMOTE ] NOA: Full fetch complete (22168 records). [2025-10-10T20:32:09.788241] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-10T20:32:09.788725] [FATAL] [VALIDATOR ] NOA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:32:09.788807] [FATAL] [MAIN ] NOA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:32:09.788850] [WARN ] [MAIN ] NOA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:32:09.788890] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-10T20:32:09.788945] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-10T20:32:09.788979] [INFO ] [LOCAL ] NOA: Starting deletion of derivative data. [2025-10-10T20:32:09.789016] [DEBUG] [LOCAL ] NOA: No derivative data file found to delete. [2025-10-10T20:32:09.789070] [INFO ] [MAIN ] Update Progress: 1509/2373 symbols completed. NOA took 36.5s. Estimated remaining: 2h 1m 26s. Rate: 7.1 symbols/min [2025-10-10T20:32:09.890790] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-10T20:32:09.965374] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:32:09.966019] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-10T20:32:09.966085] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-10T20:32:09.966193] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-10T20:32:09.966234] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-10T20:32:09.966274] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-10T20:32:09.966305] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-10T20:32:10.338759] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:32:10.559190] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-10T20:32:10.689343] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-10T20:32:11.453615] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T20:32:11.489335] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-10T20:32:12.289445] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-10-10T20:32:12.676972] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T20:32:13.084683] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-10T20:32:13.089324] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-10T20:32:13.556391] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T20:32:13.702184] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-10T20:32:13.889368] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-10T20:32:14.689381] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-10-10T20:32:15.489377] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-10T20:32:16.080591] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-10T20:32:16.289401] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-10T20:32:16.831580] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-10T20:32:17.089399] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-10T20:32:17.204102] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-10T20:32:17.675682] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-10T20:32:17.715572] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-10T20:32:17.889435] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-10T20:32:18.689394] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-10T20:32:19.489402] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-10T20:32:19.990481] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T20:32:20.289359] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-10T20:32:20.811561] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-10T20:32:21.089420] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-10T20:32:21.288569] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T20:32:21.889338] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-10T20:32:22.435720] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-10T20:32:22.551256] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-10T20:32:22.689392] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-10T20:32:23.489407] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-10T20:32:23.745052] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T20:32:24.017284] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-10T20:32:24.289375] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-10T20:32:24.578000] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T20:32:25.089351] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-10T20:32:25.836726] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-10T20:32:25.840745] [INFO ] [REMOTE ] NOC: Full fetch complete (61419 records). [2025-10-10T20:32:25.840919] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-10T20:32:25.841853] [FATAL] [VALIDATOR ] NOC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:32:25.841959] [FATAL] [MAIN ] NOC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:32:25.842003] [WARN ] [MAIN ] NOC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:32:25.842043] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-10T20:32:25.842101] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-10T20:32:25.842138] [INFO ] [LOCAL ] NOC: Starting deletion of derivative data. [2025-10-10T20:32:25.842178] [DEBUG] [LOCAL ] NOC: No derivative data file found to delete. [2025-10-10T20:32:25.842238] [INFO ] [MAIN ] Update Progress: 1510/2373 symbols completed. NOC took 33.5s. Estimated remaining: 2h 1m 22s. Rate: 7.1 symbols/min [2025-10-10T20:32:25.896863] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-10T20:32:26.018206] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:32:26.018527] [DEBUG] [LOCAL ] NOMD: No existing data file found in primary storage. [2025-10-10T20:32:26.018584] [WARN ] [MAIN ] NOMD: No existing data found, performing full refresh instead. [2025-10-10T20:32:26.018740] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-10T20:32:26.018786] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-10T20:32:26.018829] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-10T20:32:26.018862] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-10T20:32:26.390948] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:32:26.414625] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-10T20:32:26.418276] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-10T20:32:26.689379] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-10T20:32:27.194556] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-10T20:32:27.489369] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-10T20:32:28.136250] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-10T20:32:28.289384] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-10T20:32:29.089428] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-10-10T20:32:29.889413] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-10T20:32:30.377033] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-10T20:32:30.689357] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-10T20:32:30.833955] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-10T20:32:31.343843] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-10T20:32:31.489344] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-10T20:32:31.880494] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T20:32:32.289365] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-10T20:32:32.537152] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T20:32:32.541459] [INFO ] [REMOTE ] NOG: Full fetch complete (73543 records). [2025-10-10T20:32:32.541577] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-10T20:32:32.542256] [FATAL] [VALIDATOR ] NOG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:32:32.542342] [FATAL] [MAIN ] NOG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:32:32.542384] [WARN ] [MAIN ] NOG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:32:32.542424] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-10T20:32:32.542478] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-10T20:32:32.542511] [INFO ] [LOCAL ] NOG: Starting deletion of derivative data. [2025-10-10T20:32:32.542549] [DEBUG] [LOCAL ] NOG: No derivative data file found to delete. [2025-10-10T20:32:32.542605] [INFO ] [MAIN ] Update Progress: 1511/2373 symbols completed. NOG took 37.7s. Estimated remaining: 2h 1m 13s. Rate: 7.1 symbols/min [2025-10-10T20:32:32.709852] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:32:32.710012] [DEBUG] [LOCAL ] NOTE: No existing data file found in primary storage. [2025-10-10T20:32:32.710049] [WARN ] [MAIN ] NOTE: No existing data found, performing full refresh instead. [2025-10-10T20:32:32.710158] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-10T20:32:32.710204] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-10T20:32:32.710245] [DEBUG] [LOCAL ] NOTE: No primary data file found to delete. [2025-10-10T20:32:32.710276] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-10T20:32:32.984776] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-10T20:32:33.061771] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:32:33.089334] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-10-10T20:32:33.889431] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-10T20:32:34.497902] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-10T20:32:34.498733] [INFO ] [REMOTE ] NOM: Full fetch complete (1563 records). [2025-10-10T20:32:34.498804] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-10T20:32:34.690480] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-10T20:32:34.693337] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-10T20:32:34.694535] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:32:34.694610] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:32:34.694689] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-10T20:32:34.694762] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-10T20:32:34.694800] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-10T20:32:34.694839] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-10T20:32:34.694922] [INFO ] [MAIN ] Update Progress: 1512/2373 symbols completed. NOM took 24.9s. Estimated remaining: 2h 1m 1s. Rate: 7.1 symbols/min [2025-10-10T20:32:34.884204] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:32:34.884387] [DEBUG] [LOCAL ] NOV: No existing data file found in primary storage. [2025-10-10T20:32:34.884426] [WARN ] [MAIN ] NOV: No existing data found, performing full refresh instead. [2025-10-10T20:32:34.884599] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-10T20:32:34.884676] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-10T20:32:34.884774] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-10T20:32:34.884825] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-10T20:32:35.270178] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:32:35.296281] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-10T20:32:35.489361] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-10T20:32:36.289442] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-10-10T20:32:36.579066] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-10T20:32:37.089377] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-10T20:32:37.634710] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-10T20:32:37.889379] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-10T20:32:38.421271] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-10T20:32:38.689398] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-10T20:32:38.734717] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-10T20:32:39.489382] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-10T20:32:40.158775] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-10T20:32:40.289388] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-10T20:32:40.811565] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-10T20:32:41.089395] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-10T20:32:41.370721] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T20:32:41.889387] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-10T20:32:42.519232] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-10T20:32:42.689391] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-10T20:32:43.405625] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-10T20:32:43.490232] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-10T20:32:43.647248] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T20:32:44.204875] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-10T20:32:44.289395] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-10T20:32:45.089419] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-10T20:32:45.596908] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T20:32:45.889356] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-10T20:32:46.167877] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T20:32:46.689349] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-10T20:32:47.144625] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-10T20:32:47.489371] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-10T20:32:48.004084] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-10T20:32:48.089336] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-10T20:32:48.289491] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-10T20:32:49.089444] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-10T20:32:49.275457] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T20:32:49.889466] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-10T20:32:50.283336] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T20:32:50.689426] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-10T20:32:51.282587] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-10T20:32:51.489365] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-10T20:32:52.277310] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-10T20:32:52.289363] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-10T20:32:52.770295] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-10T20:32:53.089350] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-10T20:32:53.570148] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-10T20:32:53.889396] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-10T20:32:54.040692] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-10T20:32:54.689381] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-10T20:32:55.334635] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-10T20:32:55.339630] [INFO ] [REMOTE ] NOK: Full fetch complete (77643 records). [2025-10-10T20:32:55.339784] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-10T20:32:55.491410] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-10T20:32:55.734740] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-10-10T20:32:55.734837] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-10-10T20:32:55.735968] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-10-10T20:32:55.736030] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-10-10T20:32:55.737661] [DEBUG] [LOCAL ] NOK: Trimmed 77643 records to 54402 (keeping 200 days of data) [2025-10-10T20:32:56.078287] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-10T20:32:56.100825] [DEBUG] [LOCAL ] NOK: Primary data saved (54402 records). [2025-10-10T20:32:56.100977] [INFO ] [MAIN ] NOK: Full history saved. [2025-10-10T20:32:56.101057] [INFO ] [MAIN ] Update Progress: 1513/2373 symbols completed. NOK took 47.9s. Estimated remaining: 2h 0m 60s. Rate: 7.1 symbols/min [2025-10-10T20:32:56.271812] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:32:56.272130] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-10-10T20:32:56.272218] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-10-10T20:32:56.272367] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-10T20:32:56.272439] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-10T20:32:56.272515] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-10T20:32:56.272553] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-10T20:32:56.294574] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-10T20:32:56.599166] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T20:32:56.676262] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:32:57.089430] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-10-10T20:32:57.423452] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T20:32:57.889348] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-10T20:32:58.368237] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-10T20:32:58.689371] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-10T20:32:59.187757] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-10T20:32:59.489398] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-10T20:32:59.887148] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-10T20:33:00.289387] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-10T20:33:00.904620] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-10T20:33:01.089379] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-10T20:33:01.685888] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-10T20:33:01.889396] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-10T20:33:02.163848] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T20:33:02.689381] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-10T20:33:03.030182] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T20:33:03.371518] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T20:33:03.489346] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-10T20:33:04.289399] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-10T20:33:05.089346] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-10T20:33:05.131823] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-10T20:33:05.596831] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-10T20:33:05.650147] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-10T20:33:05.652964] [INFO ] [REMOTE ] NOTE: Full fetch complete (62537 records). [2025-10-10T20:33:05.653080] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-10T20:33:05.898591] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-10T20:33:05.991776] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T20:33:06.041348] [INFO ] [REMOTE ] NOMD: Full fetch complete (59383 records). [2025-10-10T20:33:06.063324] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-10T20:33:06.078922] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-10T20:33:06.079101] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-10T20:33:06.080122] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-10T20:33:06.080205] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-10T20:33:06.080981] [FATAL] [VALIDATOR ] NOMD: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:33:06.081525] [FATAL] [MAIN ] NOMD: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:33:06.081812] [WARN ] [MAIN ] NOMD: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:33:06.082031] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-10T20:33:06.082108] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-10T20:33:06.082203] [DEBUG] [LOCAL ] NOTE: Trimmed 62537 records to 41512 (keeping 200 days of data) [2025-10-10T20:33:06.082369] [INFO ] [LOCAL ] NOMD: Starting deletion of derivative data. [2025-10-10T20:33:06.082773] [DEBUG] [LOCAL ] NOMD: No derivative data file found to delete. [2025-10-10T20:33:06.083117] [INFO ] [MAIN ] Update Progress: 1514/2373 symbols completed. NOMD took 40.2s. Estimated remaining: 2h 0m 52s. Rate: 7.1 symbols/min [2025-10-10T20:33:06.461789] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:33:06.497137] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-10T20:33:06.497769] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-10T20:33:06.498743] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-10T20:33:06.498815] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-10T20:33:06.499512] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-10T20:33:06.500391] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-10T20:33:06.696530] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-10T20:33:06.885440] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:33:06.909020] [DEBUG] [LOCAL ] NOTE: Primary data saved (41512 records). [2025-10-10T20:33:06.909134] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-10T20:33:06.909202] [INFO ] [MAIN ] Update Progress: 1515/2373 symbols completed. NOTE took 34.4s. Estimated remaining: 2h 0m 39s. Rate: 7.1 symbols/min [2025-10-10T20:33:07.080269] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:33:07.080422] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-10T20:33:07.080461] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-10T20:33:07.080572] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-10T20:33:07.080613] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-10T20:33:07.080692] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-10T20:33:07.080742] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-10T20:33:07.454312] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:33:07.489343] [INFO ] [REMOTE ] NP: Fetching primary data for 2024-12. [2025-10-10T20:33:07.615454] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T20:33:07.619931] [INFO ] [REMOTE ] NOV: Full fetch complete (76598 records). [2025-10-10T20:33:07.620047] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-10T20:33:07.620843] [FATAL] [VALIDATOR ] NOV: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:33:07.620932] [FATAL] [MAIN ] NOV: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:33:07.620975] [WARN ] [MAIN ] NOV: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:33:07.621014] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-10T20:33:07.621086] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-10T20:33:07.621148] [INFO ] [LOCAL ] NOV: Starting deletion of derivative data. [2025-10-10T20:33:07.621190] [DEBUG] [LOCAL ] NOV: No derivative data file found to delete. [2025-10-10T20:33:07.621250] [INFO ] [MAIN ] Update Progress: 1516/2373 symbols completed. NOV took 32.9s. Estimated remaining: 2h 0m 27s. Rate: 7.1 symbols/min [2025-10-10T20:33:07.794754] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:33:07.794902] [DEBUG] [LOCAL ] NPCT: No existing data file found in primary storage. [2025-10-10T20:33:07.794938] [WARN ] [MAIN ] NPCT: No existing data found, performing full refresh instead. [2025-10-10T20:33:07.795043] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-10T20:33:07.795083] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-10T20:33:07.795123] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-10T20:33:07.795154] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-10T20:33:07.863850] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:33:07.879914] [WARN ] [REMOTE ] NP: No data returned for month 2024-12 [2025-10-10T20:33:07.896235] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:33:07.896342] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-10T20:33:07.896415] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:33:07.896792] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-10T20:33:07.907423] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-10T20:33:07.917713] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-10T20:33:07.945359] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-10T20:33:07.954106] [INFO ] [MAIN ] Update Progress: 1517/2373 symbols completed. NP took 1.9s. Estimated remaining: 2h 0m 14s. Rate: 7.1 symbols/min [2025-10-10T20:33:08.168342] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:33:08.289353] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-10-10T20:33:08.369289] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-10T20:33:08.622530] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:33:08.622909] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-10-10T20:33:08.623012] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:33:08.623061] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-10T20:33:08.623094] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:33:08.623130] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-10T20:33:08.623184] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-10T20:33:08.623219] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-10T20:33:08.623264] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-10T20:33:08.623311] [INFO ] [MAIN ] Update Progress: 1518/2373 symbols completed. NPB took 1.7s. Estimated remaining: 2h 0m 1s. Rate: 7.1 symbols/min [2025-10-10T20:33:09.089385] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-10T20:33:09.889442] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-10-10T20:33:11.172806] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T20:33:11.176872] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-10T20:33:11.679425] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-10T20:33:11.690483] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-10T20:33:12.524766] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-10T20:33:12.529776] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-10T20:33:13.737772] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T20:33:13.741261] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-10T20:33:13.918814] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-10T20:33:13.929142] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-10T20:33:15.021307] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T20:33:15.025233] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-10T20:33:16.112068] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-10T20:33:16.121275] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-10T20:33:16.289555] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-10T20:33:16.293524] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-10T20:33:17.623247] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-10T20:33:17.628038] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-10T20:33:18.610361] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-10T20:33:18.621027] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-10T20:33:18.940877] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T20:33:18.945341] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-10T20:33:20.324560] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-10T20:33:20.331173] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-10T20:33:21.057814] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-10T20:33:21.068415] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-10T20:33:21.574439] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-10T20:33:21.578074] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-10T20:33:22.861178] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T20:33:22.865119] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-10T20:33:23.335903] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-10T20:33:23.346106] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-10T20:33:23.351129] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-10T20:33:23.353081] [INFO ] [REMOTE ] NPCT: Full fetch complete (24813 records). [2025-10-10T20:33:23.353155] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-10T20:33:23.353694] [FATAL] [VALIDATOR ] NPCT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:33:23.353779] [FATAL] [MAIN ] NPCT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:33:23.353825] [WARN ] [MAIN ] NPCT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:33:23.353893] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-10T20:33:23.353958] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-10T20:33:23.353994] [INFO ] [LOCAL ] NPCT: Starting deletion of derivative data. [2025-10-10T20:33:23.354033] [DEBUG] [LOCAL ] NPCT: No derivative data file found to delete. [2025-10-10T20:33:23.354088] [INFO ] [MAIN ] Update Progress: 1519/2373 symbols completed. NPCT took 15.7s. Estimated remaining: 1h 59m 56s. Rate: 7.1 symbols/min [2025-10-10T20:33:24.341310] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T20:33:24.345351] [INFO ] [REMOTE ] NOW: Full fetch complete (70255 records). [2025-10-10T20:33:24.345464] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-10T20:33:24.346142] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:33:24.346233] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:33:24.346280] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:33:24.346349] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-10T20:33:24.346474] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-10T20:33:24.346549] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-10-10T20:33:24.346623] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-10-10T20:33:24.346722] [INFO ] [MAIN ] Update Progress: 1520/2373 symbols completed. NOW took 28.2s. Estimated remaining: 1h 59m 43s. Rate: 7.1 symbols/min [2025-10-10T20:33:25.079043] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:33:25.073108] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:33:25.083544] [DEBUG] [LOCAL ] NPO: No existing data file found in primary storage. [2025-10-10T20:33:25.083383] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:33:25.085067] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:33:25.085716] [DEBUG] [LOCAL ] NPFD: No existing data file found in primary storage. [2025-10-10T20:33:25.085453] [DEBUG] [LOCAL ] NPK: No existing data file found in primary storage. [2025-10-10T20:33:25.085897] [WARN ] [MAIN ] NPK: No existing data found, performing full refresh instead. [2025-10-10T20:33:25.085237] [WARN ] [MAIN ] NPO: No existing data found, performing full refresh instead. [2025-10-10T20:33:25.086334] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-10T20:33:25.086538] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-10-10T20:33:25.086025] [WARN ] [MAIN ] NPFD: No existing data found, performing full refresh instead. [2025-10-10T20:33:25.086782] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-10T20:33:25.087397] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-10-10T20:33:25.087293] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-10T20:33:25.087212] [DEBUG] [LOCAL ] NPK: No primary data file found to delete. [2025-10-10T20:33:25.087810] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-10T20:33:25.087104] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-10T20:33:25.088121] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-10T20:33:25.087940] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-10T20:33:25.088715] [DEBUG] [LOCAL ] NPFD: No primary data file found to delete. [2025-10-10T20:33:25.088815] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-10T20:33:25.088482] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-10T20:33:25.118505] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-10T20:33:25.139512] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-10T20:33:25.129048] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-10T20:33:25.200884] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-10T20:33:25.253562] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-10T20:33:26.221794] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:33:26.262716] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-10-10T20:33:26.567943] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:33:26.602978] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-10-10T20:33:26.751286] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:33:26.752560] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-10-10T20:33:26.723162] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:33:26.754282] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-10-10T20:33:27.541072] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T20:33:27.543517] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-10T20:33:27.845484] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T20:33:27.849107] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-10T20:33:27.887228] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T20:33:27.993253] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T20:33:28.289386] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-10T20:33:28.408200] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-10T20:33:28.625539] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-10T20:33:29.089406] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-10T20:33:29.462054] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T20:33:29.889371] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-10T20:33:29.934102] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-10T20:33:30.689361] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-10T20:33:31.085046] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-10T20:33:31.489398] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-10T20:33:31.803188] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-10T20:33:32.289420] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-10T20:33:32.554967] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-10T20:33:33.089363] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-10T20:33:33.624389] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T20:33:33.889397] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-10T20:33:34.446836] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T20:33:34.689375] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-10T20:33:35.489342] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-10T20:33:35.661879] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T20:33:35.997977] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-10T20:33:36.289391] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-10T20:33:36.500841] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-10T20:33:37.089380] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-10T20:33:37.889359] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-10T20:33:38.134544] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-10T20:33:38.172954] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T20:33:38.689381] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-10T20:33:39.044318] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-10T20:33:39.489358] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-10T20:33:39.545671] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-10T20:33:40.289437] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-10T20:33:40.529849] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-10T20:33:41.089457] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-10T20:33:41.366554] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-10T20:33:41.889404] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-10T20:33:42.689411] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-10T20:33:42.886312] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-10T20:33:42.914869] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T20:33:43.489415] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-10T20:33:43.792067] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-10T20:33:44.014317] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-10T20:33:44.289406] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-10T20:33:45.089370] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-10T20:33:45.631860] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-10T20:33:45.889477] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-10T20:33:46.689346] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-10T20:33:46.791278] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-10T20:33:46.980214] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-10T20:33:47.344516] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-10T20:33:47.346489] [INFO ] [REMOTE ] NPO: Full fetch complete (18247 records). [2025-10-10T20:33:47.346560] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-10T20:33:47.347056] [FATAL] [VALIDATOR ] NPO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:33:47.347139] [FATAL] [MAIN ] NPO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:33:47.347202] [WARN ] [MAIN ] NPO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:33:47.347275] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-10T20:33:47.347339] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-10T20:33:47.347376] [INFO ] [LOCAL ] NPO: Starting deletion of derivative data. [2025-10-10T20:33:47.347417] [DEBUG] [LOCAL ] NPO: No derivative data file found to delete. [2025-10-10T20:33:47.347472] [INFO ] [MAIN ] Update Progress: 1521/2373 symbols completed. NPO took 23.0s. Estimated remaining: 1h 59m 43s. Rate: 7.1 symbols/min [2025-10-10T20:33:47.515294] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-10T20:33:47.518937] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:33:47.519146] [DEBUG] [LOCAL ] NPV: No existing data file found in primary storage. [2025-10-10T20:33:47.519229] [WARN ] [MAIN ] NPV: No existing data found, performing full refresh instead. [2025-10-10T20:33:47.520248] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-10T20:33:47.520298] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-10T20:33:47.520341] [DEBUG] [LOCAL ] NPV: No primary data file found to delete. [2025-10-10T20:33:47.520372] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-10T20:33:47.886868] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:33:48.289353] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-10T20:33:48.532757] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-10T20:33:49.089382] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-10T20:33:49.889418] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-10T20:33:50.152540] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T20:33:50.374009] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T20:33:50.502288] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-10T20:33:50.689416] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-10-10T20:33:51.489381] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-10T20:33:51.788022] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-10T20:33:52.289354] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-10T20:33:52.480702] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-10T20:33:53.089365] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-10T20:33:53.139332] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-10T20:33:53.889356] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-10T20:33:54.128686] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-10T20:33:54.689394] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-10T20:33:55.077490] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T20:33:55.489371] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-10T20:33:56.174669] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-10T20:33:56.199587] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T20:33:56.289366] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-10T20:33:57.087287] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-10T20:33:57.089322] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-10T20:33:57.889346] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-10T20:33:57.977355] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-10T20:33:58.581160] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-10T20:33:58.689376] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-10T20:33:59.489344] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-10T20:33:59.595427] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-10T20:34:00.289381] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-10T20:34:01.089396] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-10T20:34:01.457442] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T20:34:01.469745] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T20:34:01.889420] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-10T20:34:02.061959] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-10T20:34:02.064153] [INFO ] [REMOTE ] NPFD: Full fetch complete (14612 records). [2025-10-10T20:34:02.064256] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-10T20:34:02.439735] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-10T20:34:02.439906] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-10T20:34:02.440319] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-10T20:34:02.440364] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-10T20:34:02.441085] [DEBUG] [LOCAL ] NPFD: Trimmed 14612 records to 10119 (keeping 200 days of data) [2025-10-10T20:34:02.505126] [DEBUG] [LOCAL ] NPFD: Primary data saved (10119 records). [2025-10-10T20:34:02.505299] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-10T20:34:02.505391] [INFO ] [MAIN ] Update Progress: 1522/2373 symbols completed. NPFD took 38.2s. Estimated remaining: 1h 59m 38s. Rate: 7.1 symbols/min [2025-10-10T20:34:02.693158] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-10T20:34:02.697387] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T20:34:02.696744] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:34:02.702042] [DEBUG] [LOCAL ] NPWR: No existing data file found in primary storage. [2025-10-10T20:34:02.702147] [WARN ] [MAIN ] NPWR: No existing data found, performing full refresh instead. [2025-10-10T20:34:02.702506] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-10T20:34:02.702583] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-10T20:34:02.702701] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-10T20:34:02.702832] [INFO ] [REMOTE ] NPKI: Full fetch complete (55354 records). [2025-10-10T20:34:02.703032] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-10T20:34:02.702937] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-10T20:34:02.704047] [FATAL] [VALIDATOR ] NPKI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:34:02.742728] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:34:02.778591] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:34:02.808612] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-10T20:34:02.811190] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-10T20:34:02.811253] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-10-10T20:34:02.811576] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-10-10T20:34:02.822191] [INFO ] [MAIN ] Update Progress: 1523/2373 symbols completed. NPKI took 38.5s. Estimated remaining: 1h 59m 25s. Rate: 7.1 symbols/min [2025-10-10T20:34:03.251536] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:34:03.254907] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:34:03.255265] [DEBUG] [LOCAL ] NQP: No existing data file found in primary storage. [2025-10-10T20:34:03.255320] [WARN ] [MAIN ] NQP: No existing data found, performing full refresh instead. [2025-10-10T20:34:03.255437] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-10T20:34:03.255503] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-10T20:34:03.255562] [DEBUG] [LOCAL ] NQP: No primary data file found to delete. [2025-10-10T20:34:03.255607] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-10T20:34:03.495663] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-10T20:34:03.552196] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-10T20:34:03.632139] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:34:04.289422] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-10T20:34:04.460360] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T20:34:04.462316] [INFO ] [REMOTE ] NPK: Full fetch complete (10914 records). [2025-10-10T20:34:04.462408] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-10T20:34:04.824314] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-10T20:34:04.824405] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-10T20:34:04.824703] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-10T20:34:04.824788] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-10T20:34:04.825251] [DEBUG] [LOCAL ] NPK: Trimmed 10914 records to 8253 (keeping 200 days of data) [2025-10-10T20:34:04.873977] [DEBUG] [LOCAL ] NPK: Primary data saved (8253 records). [2025-10-10T20:34:04.874093] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-10T20:34:04.874161] [INFO ] [MAIN ] Update Progress: 1524/2373 symbols completed. NPK took 40.5s. Estimated remaining: 1h 59m 13s. Rate: 7.1 symbols/min [2025-10-10T20:34:05.043369] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:34:05.043567] [DEBUG] [LOCAL ] NRDY: No existing data file found in primary storage. [2025-10-10T20:34:05.043611] [WARN ] [MAIN ] NRDY: No existing data found, performing full refresh instead. [2025-10-10T20:34:05.043745] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-10T20:34:05.043787] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-10T20:34:05.043829] [DEBUG] [LOCAL ] NRDY: No primary data file found to delete. [2025-10-10T20:34:05.043861] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-10T20:34:05.098049] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-10-10T20:34:05.150871] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-10T20:34:05.412794] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:34:05.889364] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-10-10T20:34:06.604991] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-10T20:34:06.689361] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-10T20:34:07.489366] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-10-10T20:34:07.766207] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T20:34:07.791986] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T20:34:08.289367] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-10T20:34:09.089374] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-10T20:34:09.256957] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T20:34:09.660067] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-10T20:34:09.694666] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-10T20:34:09.889426] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-10T20:34:10.689402] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-10T20:34:11.103003] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-10T20:34:11.489385] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-10T20:34:12.115739] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-10T20:34:12.289376] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-10T20:34:12.472976] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T20:34:13.089434] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-10T20:34:13.889413] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-10T20:34:14.099835] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T20:34:14.689438] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-10T20:34:14.881215] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-10T20:34:15.195060] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-10T20:34:15.489369] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-10T20:34:15.780668] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-10T20:34:16.248117] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T20:34:16.249885] [INFO ] [REMOTE ] NPV: Full fetch complete (7059 records). [2025-10-10T20:34:16.249978] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-10T20:34:16.296083] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-10T20:34:16.629785] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-10T20:34:16.629936] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-10T20:34:16.630146] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-10T20:34:16.630262] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-10T20:34:16.630762] [DEBUG] [LOCAL ] NPV: Trimmed 7059 records to 5337 (keeping 200 days of data) [2025-10-10T20:34:16.663954] [DEBUG] [LOCAL ] NPV: Primary data saved (5337 records). [2025-10-10T20:34:16.664083] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-10T20:34:16.664174] [INFO ] [MAIN ] Update Progress: 1525/2373 symbols completed. NPV took 29.3s. Estimated remaining: 1h 59m 7s. Rate: 7.1 symbols/min [2025-10-10T20:34:16.830303] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:34:16.830543] [DEBUG] [LOCAL ] NREF: No existing data file found in primary storage. [2025-10-10T20:34:16.830586] [WARN ] [MAIN ] NREF: No existing data found, performing full refresh instead. [2025-10-10T20:34:16.830721] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-10T20:34:16.830767] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-10T20:34:16.830809] [DEBUG] [LOCAL ] NREF: No primary data file found to delete. [2025-10-10T20:34:16.830840] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-10T20:34:17.094504] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-10T20:34:17.182993] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:34:17.479098] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-10T20:34:17.889422] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-10-10T20:34:18.689370] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-10T20:34:18.873288] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T20:34:19.061682] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-10T20:34:19.489400] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-10T20:34:20.289414] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-10T20:34:20.339849] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-10T20:34:20.658021] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T20:34:21.089419] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-10T20:34:21.889342] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-10T20:34:21.940725] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-10T20:34:21.985803] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-10T20:34:22.689395] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-10T20:34:23.497867] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-10T20:34:23.521174] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T20:34:24.289433] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-10T20:34:24.376207] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-10T20:34:24.540364] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-10T20:34:25.089377] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-10T20:34:25.265900] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-10T20:34:25.889401] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-10T20:34:26.599042] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-10T20:34:26.610814] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-10T20:34:26.689369] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-10T20:34:27.489373] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-10T20:34:27.517818] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-10T20:34:28.289379] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-10T20:34:29.089363] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-10T20:34:29.222149] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-10T20:34:29.408590] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-10T20:34:29.889373] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-10T20:34:30.689384] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-10T20:34:30.891726] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-10T20:34:31.138228] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-10T20:34:31.489382] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-10T20:34:31.651364] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-10T20:34:32.289374] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-10T20:34:33.089405] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-10T20:34:33.155514] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-10T20:34:33.178167] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-10T20:34:33.889448] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-10T20:34:34.035323] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-10T20:34:34.689385] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-10T20:34:35.494459] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-10T20:34:35.506195] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-10T20:34:35.916342] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-10T20:34:36.289393] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-10T20:34:36.534422] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-10T20:34:37.089352] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-10T20:34:37.269564] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T20:34:37.270873] [INFO ] [REMOTE ] NREF: Full fetch complete (10970 records). [2025-10-10T20:34:37.270943] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-10T20:34:37.653052] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-10T20:34:37.653444] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-10T20:34:37.653761] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-10T20:34:37.653823] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-10T20:34:37.654270] [DEBUG] [LOCAL ] NREF: Trimmed 10970 records to 8112 (keeping 200 days of data) [2025-10-10T20:34:37.703905] [DEBUG] [LOCAL ] NREF: Primary data saved (8112 records). [2025-10-10T20:34:37.704002] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-10T20:34:37.704070] [INFO ] [MAIN ] Update Progress: 1526/2373 symbols completed. NREF took 21.0s. Estimated remaining: 1h 59m 5s. Rate: 7.1 symbols/min [2025-10-10T20:34:37.870243] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:34:37.870385] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-10T20:34:37.870422] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-10T20:34:37.870576] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-10T20:34:37.870616] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-10T20:34:37.870694] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-10T20:34:37.870756] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-10T20:34:37.900491] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-10T20:34:38.219049] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:34:38.573030] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-10T20:34:38.576591] [INFO ] [REMOTE ] NRDY: Full fetch complete (50944 records). [2025-10-10T20:34:38.576755] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-10T20:34:38.694535] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-10-10T20:34:38.957545] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-10T20:34:38.957622] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-10T20:34:38.958493] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-10T20:34:38.958556] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-10T20:34:38.959548] [DEBUG] [LOCAL ] NRDY: Trimmed 50944 records to 33215 (keeping 200 days of data) [2025-10-10T20:34:39.148702] [DEBUG] [LOCAL ] NRDY: Primary data saved (33215 records). [2025-10-10T20:34:39.148848] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-10T20:34:39.148921] [INFO ] [MAIN ] Update Progress: 1527/2373 symbols completed. NRDY took 34.3s. Estimated remaining: 1h 58m 53s. Rate: 7.1 symbols/min [2025-10-10T20:34:39.314546] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:34:39.314735] [DEBUG] [LOCAL ] NRGV: No existing data file found in primary storage. [2025-10-10T20:34:39.314783] [WARN ] [MAIN ] NRGV: No existing data found, performing full refresh instead. [2025-10-10T20:34:39.314895] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-10T20:34:39.314935] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-10T20:34:39.314977] [DEBUG] [LOCAL ] NRGV: No primary data file found to delete. [2025-10-10T20:34:39.315011] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-10T20:34:39.499531] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-10T20:34:39.672458] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:34:40.057848] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-10T20:34:40.289408] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-10T20:34:40.567352] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-10T20:34:41.044616] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-10T20:34:41.089337] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-10T20:34:41.889371] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-10T20:34:42.077573] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T20:34:42.689384] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-10-10T20:34:42.732196] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T20:34:42.733341] [INFO ] [REMOTE ] NQP: Full fetch complete (13114 records). [2025-10-10T20:34:42.733408] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-10T20:34:43.097667] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-10T20:34:43.097752] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-10T20:34:43.098075] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-10T20:34:43.098113] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-10T20:34:43.098556] [DEBUG] [LOCAL ] NQP: Trimmed 13114 records to 9329 (keeping 200 days of data) [2025-10-10T20:34:43.159295] [DEBUG] [LOCAL ] NQP: Primary data saved (9329 records). [2025-10-10T20:34:43.159455] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-10T20:34:43.159532] [INFO ] [MAIN ] Update Progress: 1528/2373 symbols completed. NQP took 40.3s. Estimated remaining: 1h 58m 42s. Rate: 7.1 symbols/min [2025-10-10T20:34:43.339387] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:34:43.339669] [DEBUG] [LOCAL ] NRK: No existing data file found in primary storage. [2025-10-10T20:34:43.339739] [WARN ] [MAIN ] NRK: No existing data found, performing full refresh instead. [2025-10-10T20:34:43.339969] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-10T20:34:43.340031] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-10T20:34:43.340108] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-10T20:34:43.340220] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-10T20:34:43.492884] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-10T20:34:43.522291] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-10T20:34:43.744579] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:34:44.289363] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-10T20:34:44.808118] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-10T20:34:44.917362] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-10T20:34:45.089404] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-10-10T20:34:45.891167] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-10T20:34:45.893886] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-10T20:34:46.464943] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T20:34:46.689374] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-10T20:34:46.714135] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T20:34:46.718040] [INFO ] [REMOTE ] NPWR: Full fetch complete (59632 records). [2025-10-10T20:34:46.718139] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-10T20:34:46.718793] [FATAL] [VALIDATOR ] NPWR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:34:46.718880] [FATAL] [MAIN ] NPWR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:34:46.718927] [WARN ] [MAIN ] NPWR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:34:46.718969] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-10T20:34:46.719024] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-10T20:34:46.719060] [INFO ] [LOCAL ] NPWR: Starting deletion of derivative data. [2025-10-10T20:34:46.719121] [DEBUG] [LOCAL ] NPWR: No derivative data file found to delete. [2025-10-10T20:34:46.719179] [INFO ] [MAIN ] Update Progress: 1529/2373 symbols completed. NPWR took 44.2s. Estimated remaining: 1h 58m 31s. Rate: 7.1 symbols/min [2025-10-10T20:34:46.886307] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:34:46.886463] [DEBUG] [LOCAL ] NRP: No existing data file found in primary storage. [2025-10-10T20:34:46.886499] [WARN ] [MAIN ] NRP: No existing data found, performing full refresh instead. [2025-10-10T20:34:46.886608] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-10T20:34:46.886672] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-10T20:34:46.886736] [DEBUG] [LOCAL ] NRP: No primary data file found to delete. [2025-10-10T20:34:46.886769] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-10T20:34:47.240613] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:34:47.489339] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-10-10T20:34:47.828396] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-10T20:34:48.289390] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-10T20:34:48.631705] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-10T20:34:49.089386] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-10T20:34:49.889397] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-10T20:34:49.914370] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-10T20:34:50.544913] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-10T20:34:50.689362] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-10T20:34:51.489407] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-10T20:34:51.544429] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-10T20:34:51.749265] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T20:34:52.289348] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-10T20:34:52.725285] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T20:34:53.089372] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-10T20:34:53.889370] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-10T20:34:54.387072] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T20:34:54.567314] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-10T20:34:54.689407] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-10T20:34:54.706187] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-10T20:34:55.489378] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-10T20:34:56.273441] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-10T20:34:56.298530] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-10T20:34:56.300474] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T20:34:57.037085] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-10T20:34:57.089367] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-10T20:34:57.889374] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-10T20:34:58.689371] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-10T20:34:59.395381] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-10T20:34:59.491387] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-10T20:34:59.500776] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-10T20:34:59.505857] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T20:35:00.289358] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-10T20:35:00.885732] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T20:35:01.089368] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-10T20:35:01.295950] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-10T20:35:01.889418] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-10T20:35:02.689355] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-10T20:35:03.244304] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-10T20:35:03.326898] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-10T20:35:03.425389] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-10T20:35:03.489359] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-10T20:35:04.289480] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-10T20:35:05.089389] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-10T20:35:05.573460] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-10T20:35:05.889432] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-10T20:35:05.910725] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-10T20:35:06.056386] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-10T20:35:06.689369] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-10T20:35:07.347112] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T20:35:07.354836] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T20:35:07.355632] [INFO ] [REMOTE ] NRP: Full fetch complete (6373 records). [2025-10-10T20:35:07.355737] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-10T20:35:07.494552] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-10T20:35:07.716768] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-10T20:35:07.716848] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-10T20:35:07.717045] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-10T20:35:07.717106] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-10T20:35:07.717469] [DEBUG] [LOCAL ] NRP: Trimmed 6373 records to 4136 (keeping 200 days of data) [2025-10-10T20:35:07.742785] [DEBUG] [LOCAL ] NRP: Primary data saved (4136 records). [2025-10-10T20:35:07.742898] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-10T20:35:07.742969] [INFO ] [MAIN ] Update Progress: 1530/2373 symbols completed. NRP took 21.0s. Estimated remaining: 1h 58m 30s. Rate: 7.1 symbols/min [2025-10-10T20:35:07.909306] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:35:07.909466] [DEBUG] [LOCAL ] NRT: No existing data file found in primary storage. [2025-10-10T20:35:07.909504] [WARN ] [MAIN ] NRT: No existing data found, performing full refresh instead. [2025-10-10T20:35:07.909614] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-10T20:35:07.909681] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-10T20:35:07.909741] [DEBUG] [LOCAL ] NRT: No primary data file found to delete. [2025-10-10T20:35:07.909776] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-10T20:35:08.255214] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:35:08.289327] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-10-10T20:35:09.089365] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-10T20:35:09.174861] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-10T20:35:09.356620] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-10T20:35:09.889380] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-10T20:35:10.689417] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-10T20:35:11.276688] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-10T20:35:11.489341] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-10T20:35:11.724847] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-10T20:35:12.039536] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T20:35:12.289349] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-10T20:35:12.508826] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-10T20:35:13.089387] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-10T20:35:13.889341] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-10T20:35:13.989802] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T20:35:14.649477] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-10T20:35:14.689338] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-10T20:35:15.489350] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-10T20:35:15.888084] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-10T20:35:16.274601] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-10T20:35:16.289357] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-10T20:35:17.089424] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-10T20:35:17.639075] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T20:35:17.889334] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-10T20:35:17.977694] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-10T20:35:18.477923] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-10T20:35:18.480573] [INFO ] [REMOTE ] NRK: Full fetch complete (27438 records). [2025-10-10T20:35:18.480709] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-10T20:35:18.481309] [FATAL] [VALIDATOR ] NRK: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:35:18.481416] [FATAL] [MAIN ] NRK: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:35:18.481461] [WARN ] [MAIN ] NRK: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:35:18.481503] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-10T20:35:18.481568] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-10T20:35:18.481604] [INFO ] [LOCAL ] NRK: Starting deletion of derivative data. [2025-10-10T20:35:18.482134] [DEBUG] [LOCAL ] NRK: No derivative data file found to delete. [2025-10-10T20:35:18.482456] [INFO ] [MAIN ] Update Progress: 1531/2373 symbols completed. NRK took 35.3s. Estimated remaining: 1h 58m 23s. Rate: 7.1 symbols/min [2025-10-10T20:35:18.649451] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:35:18.649738] [DEBUG] [LOCAL ] NRUC: No existing data file found in primary storage. [2025-10-10T20:35:18.649788] [WARN ] [MAIN ] NRUC: No existing data found, performing full refresh instead. [2025-10-10T20:35:18.649923] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-10T20:35:18.649966] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-10T20:35:18.650007] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-10T20:35:18.650041] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-10T20:35:18.694623] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-10T20:35:19.009608] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:35:19.227637] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T20:35:19.304283] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-10T20:35:19.308942] [INFO ] [REMOTE ] NRG: Full fetch complete (76224 records). [2025-10-10T20:35:19.309102] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-10T20:35:19.309880] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:35:19.309989] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:35:19.310031] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:35:19.310070] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-10T20:35:19.310125] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-10T20:35:19.310160] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-10-10T20:35:19.310198] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-10-10T20:35:19.310256] [INFO ] [MAIN ] Update Progress: 1532/2373 symbols completed. NRG took 41.6s. Estimated remaining: 1h 58m 10s. Rate: 7.1 symbols/min [2025-10-10T20:35:19.491379] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-10T20:35:19.491297] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:35:19.491733] [DEBUG] [LOCAL ] NSA: No existing data file found in primary storage. [2025-10-10T20:35:19.492538] [WARN ] [MAIN ] NSA: No existing data found, performing full refresh instead. [2025-10-10T20:35:19.492682] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-10T20:35:19.492737] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-10T20:35:19.492782] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-10T20:35:19.492815] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-10T20:35:19.849630] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:35:20.289374] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-10-10T20:35:20.430288] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-10T20:35:21.089385] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-10T20:35:21.890517] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-10-10T20:35:21.891475] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-10T20:35:21.963970] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-10T20:35:22.689385] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-10T20:35:22.948900] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-10T20:35:23.489369] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-10T20:35:23.628454] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T20:35:24.289413] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-10T20:35:24.295014] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-10T20:35:25.064228] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-10T20:35:25.089340] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-10T20:35:25.889356] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-10T20:35:25.904699] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-10T20:35:26.689418] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-10T20:35:27.489356] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-10T20:35:27.613795] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-10T20:35:27.696062] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-10T20:35:28.265361] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-10T20:35:28.289341] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-10T20:35:29.083923] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-10T20:35:29.089335] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-10T20:35:29.860614] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-10T20:35:29.889345] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-10T20:35:30.687450] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-10T20:35:30.689324] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-10T20:35:31.383164] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T20:35:31.384188] [INFO ] [REMOTE ] NRT: Full fetch complete (7951 records). [2025-10-10T20:35:31.384257] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-10T20:35:31.494527] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-10T20:35:31.752464] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-10T20:35:31.752567] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-10T20:35:31.752887] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-10T20:35:31.752966] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-10T20:35:31.753416] [DEBUG] [LOCAL ] NRT: Trimmed 7951 records to 4934 (keeping 200 days of data) [2025-10-10T20:35:31.781890] [DEBUG] [LOCAL ] NRT: Primary data saved (4934 records). [2025-10-10T20:35:31.782019] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-10T20:35:31.782093] [INFO ] [MAIN ] Update Progress: 1533/2373 symbols completed. NRT took 24.0s. Estimated remaining: 1h 58m 4s. Rate: 7.1 symbols/min [2025-10-10T20:35:31.949594] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:35:31.949819] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-10T20:35:31.949863] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-10T20:35:31.949976] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-10T20:35:31.950018] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-10T20:35:31.950059] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-10T20:35:31.950093] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-10T20:35:32.299396] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-10T20:35:32.305191] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:35:32.346624] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-10T20:35:33.089383] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-10-10T20:35:33.889417] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-10T20:35:34.038350] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T20:35:34.043478] [INFO ] [REMOTE ] NRGV: Full fetch complete (62275 records). [2025-10-10T20:35:34.043672] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-10T20:35:34.482545] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-10T20:35:34.482665] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-10T20:35:34.483702] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-10T20:35:34.483767] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-10T20:35:34.485160] [DEBUG] [LOCAL ] NRGV: Trimmed 62275 records to 44207 (keeping 200 days of data) [2025-10-10T20:35:34.595283] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-10T20:35:34.693354] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-10T20:35:34.756595] [DEBUG] [LOCAL ] NRGV: Primary data saved (44207 records). [2025-10-10T20:35:34.756897] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-10T20:35:34.757036] [INFO ] [MAIN ] Update Progress: 1534/2373 symbols completed. NRGV took 55.6s. Estimated remaining: 1h 57m 52s. Rate: 7.1 symbols/min [2025-10-10T20:35:34.938938] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:35:34.939112] [DEBUG] [LOCAL ] NSP: No existing data file found in primary storage. [2025-10-10T20:35:34.939150] [WARN ] [MAIN ] NSP: No existing data found, performing full refresh instead. [2025-10-10T20:35:34.939262] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-10T20:35:34.939304] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-10T20:35:34.939347] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-10T20:35:34.939378] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-10T20:35:35.315576] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:35:35.354484] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-10T20:35:35.489437] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-10T20:35:36.289392] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-10T20:35:36.495199] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T20:35:36.916661] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-10T20:35:37.089333] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-10T20:35:37.453183] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T20:35:37.846366] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T20:35:37.889349] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-10T20:35:38.689388] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-10T20:35:39.461249] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-10T20:35:39.489325] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-10T20:35:39.913933] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T20:35:39.979862] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-10T20:35:39.981269] [INFO ] [REMOTE ] NRUC: Full fetch complete (5393 records). [2025-10-10T20:35:39.981380] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-10T20:35:39.982150] [FATAL] [VALIDATOR ] NRUC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:35:39.982244] [FATAL] [MAIN ] NRUC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:35:39.982289] [WARN ] [MAIN ] NRUC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:35:39.982463] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-10T20:35:39.982571] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-10T20:35:39.982673] [INFO ] [LOCAL ] NRUC: Starting deletion of derivative data. [2025-10-10T20:35:39.982743] [DEBUG] [LOCAL ] NRUC: No derivative data file found to delete. [2025-10-10T20:35:39.982812] [INFO ] [MAIN ] Update Progress: 1535/2373 symbols completed. NRUC took 21.5s. Estimated remaining: 1h 57m 42s. Rate: 7.1 symbols/min [2025-10-10T20:35:40.182807] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:35:40.183072] [DEBUG] [LOCAL ] NTB: No existing data file found in primary storage. [2025-10-10T20:35:40.183122] [WARN ] [MAIN ] NTB: No existing data found, performing full refresh instead. [2025-10-10T20:35:40.183282] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-10T20:35:40.183338] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-10T20:35:40.183449] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-10T20:35:40.183494] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-10T20:35:40.293880] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-10T20:35:40.575429] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:35:41.089597] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-10-10T20:35:41.889406] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-10-10T20:35:42.470625] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-10T20:35:42.612107] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T20:35:42.689335] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-10T20:35:43.420986] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-10T20:35:43.489380] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-10T20:35:43.948586] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-10T20:35:44.289454] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-10T20:35:45.089352] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-10T20:35:45.427874] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T20:35:45.889354] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-10T20:35:46.454439] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T20:35:46.494876] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-10T20:35:46.689454] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-10T20:35:47.489383] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-10T20:35:47.523816] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T20:35:48.289360] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-10T20:35:48.514680] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T20:35:49.089421] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-10T20:35:49.411828] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T20:35:49.889397] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-10T20:35:50.053980] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T20:35:50.456369] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-10T20:35:50.689380] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-10T20:35:51.344505] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-10T20:35:51.489370] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-10T20:35:52.289370] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-10T20:35:52.376307] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T20:35:53.089361] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-10T20:35:53.222436] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T20:35:53.744508] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-10T20:35:53.889421] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-10T20:35:54.689363] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-10T20:35:54.908147] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T20:35:55.489351] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-10T20:35:55.528016] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-10T20:35:55.994497] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T20:35:56.289370] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-10T20:35:57.089359] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-10T20:35:57.167551] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-10T20:35:57.894467] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-10T20:35:57.910046] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T20:35:58.367720] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T20:35:58.689375] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-10T20:35:59.489359] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-10T20:35:59.650845] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T20:36:00.289477] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-10T20:36:00.510110] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T20:36:01.075979] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T20:36:01.089329] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-10T20:36:01.889378] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-10T20:36:02.145288] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-10T20:36:02.689419] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-10T20:36:03.205189] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-10T20:36:03.489417] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-10T20:36:03.591271] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-10T20:36:04.214994] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-10T20:36:04.289339] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-10T20:36:04.343294] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T20:36:05.089404] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-10T20:36:05.107611] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T20:36:05.110178] [INFO ] [REMOTE ] NTB: Full fetch complete (30400 records). [2025-10-10T20:36:05.110281] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-10T20:36:05.111006] [FATAL] [VALIDATOR ] NTB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:36:05.111098] [FATAL] [MAIN ] NTB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:36:05.111163] [WARN ] [MAIN ] NTB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:36:05.111232] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-10T20:36:05.111295] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-10T20:36:05.111331] [INFO ] [LOCAL ] NTB: Starting deletion of derivative data. [2025-10-10T20:36:05.111371] [DEBUG] [LOCAL ] NTB: No derivative data file found to delete. [2025-10-10T20:36:05.111451] [INFO ] [MAIN ] Update Progress: 1536/2373 symbols completed. NTB took 25.1s. Estimated remaining: 1h 57m 43s. Rate: 7.1 symbols/min [2025-10-10T20:36:05.289813] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:36:05.289972] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-10T20:36:05.290056] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-10T20:36:05.290138] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-10T20:36:05.290175] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-10T20:36:05.290216] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-10T20:36:05.290247] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-10T20:36:05.634968] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:36:05.889373] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-10T20:36:06.689463] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-10T20:36:06.880787] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T20:36:06.882310] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T20:36:06.898006] [INFO ] [REMOTE ] NSA: Full fetch complete (61866 records). [2025-10-10T20:36:06.898200] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-10T20:36:06.899008] [FATAL] [VALIDATOR ] NSA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:36:06.899100] [FATAL] [MAIN ] NSA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:36:06.899143] [WARN ] [MAIN ] NSA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:36:06.899184] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-10T20:36:06.899244] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-10T20:36:06.899280] [INFO ] [LOCAL ] NSA: Starting deletion of derivative data. [2025-10-10T20:36:06.899319] [DEBUG] [LOCAL ] NSA: No derivative data file found to delete. [2025-10-10T20:36:06.899379] [INFO ] [MAIN ] Update Progress: 1537/2373 symbols completed. NSA took 47.6s. Estimated remaining: 1h 57m 31s. Rate: 7.1 symbols/min [2025-10-10T20:36:07.069665] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:36:07.069890] [DEBUG] [LOCAL ] NTR: No existing data file found in primary storage. [2025-10-10T20:36:07.069933] [WARN ] [MAIN ] NTR: No existing data found, performing full refresh instead. [2025-10-10T20:36:07.070044] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-10T20:36:07.070084] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-10T20:36:07.070124] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-10T20:36:07.070156] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-10T20:36:07.414404] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:36:07.489333] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-10-10T20:36:08.289407] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-10T20:36:08.532462] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T20:36:09.089384] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-10-10T20:36:09.796230] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-10T20:36:09.889362] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-10T20:36:10.006441] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-10T20:36:10.033384] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-10T20:36:10.689406] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-10T20:36:11.489402] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-10T20:36:11.544388] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T20:36:11.547904] [INFO ] [REMOTE ] NSP: Full fetch complete (49508 records). [2025-10-10T20:36:11.548024] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-10T20:36:11.548624] [FATAL] [VALIDATOR ] NSP: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:36:11.548739] [FATAL] [MAIN ] NSP: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:36:11.548784] [WARN ] [MAIN ] NSP: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:36:11.548824] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-10T20:36:11.548883] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-10T20:36:11.548920] [INFO ] [LOCAL ] NSP: Starting deletion of derivative data. [2025-10-10T20:36:11.548986] [DEBUG] [LOCAL ] NSP: No derivative data file found to delete. [2025-10-10T20:36:11.549069] [INFO ] [MAIN ] Update Progress: 1538/2373 symbols completed. NSP took 36.8s. Estimated remaining: 1h 57m 20s. Rate: 7.1 symbols/min [2025-10-10T20:36:11.722989] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:36:11.723242] [DEBUG] [LOCAL ] NTST: No existing data file found in primary storage. [2025-10-10T20:36:11.723374] [WARN ] [MAIN ] NTST: No existing data found, performing full refresh instead. [2025-10-10T20:36:11.723569] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-10T20:36:11.723623] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-10T20:36:11.723711] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-10T20:36:11.723756] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-10T20:36:12.047968] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-10T20:36:12.090061] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:36:12.117553] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-10T20:36:12.289444] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-10T20:36:12.991704] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T20:36:13.089388] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-10T20:36:13.702813] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-10T20:36:13.889362] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-10T20:36:14.689402] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-10-10T20:36:15.489362] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-10T20:36:15.878206] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-10T20:36:16.155863] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-10T20:36:16.289384] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-10T20:36:16.663271] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T20:36:17.089371] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-10T20:36:17.889431] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-10T20:36:17.948494] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T20:36:17.952465] [INFO ] [REMOTE ] NSC: Full fetch complete (70410 records). [2025-10-10T20:36:17.952583] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-10T20:36:17.953328] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:36:17.953415] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:36:17.953458] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:36:17.953524] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-10T20:36:17.953586] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-10T20:36:17.953622] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-10-10T20:36:17.953706] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-10-10T20:36:17.953779] [INFO ] [MAIN ] Update Progress: 1539/2373 symbols completed. NSC took 46.2s. Estimated remaining: 1h 57m 11s. Rate: 7.1 symbols/min [2025-10-10T20:36:18.127481] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:36:18.127730] [DEBUG] [LOCAL ] NU: No existing data file found in primary storage. [2025-10-10T20:36:18.127819] [WARN ] [MAIN ] NU: No existing data found, performing full refresh instead. [2025-10-10T20:36:18.127902] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-10T20:36:18.127941] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-10T20:36:18.127984] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-10T20:36:18.128016] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-10T20:36:18.521208] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:36:18.523209] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-10T20:36:18.689357] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-10T20:36:19.489416] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-10T20:36:19.600021] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T20:36:20.289386] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-10T20:36:20.728417] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-10T20:36:20.823290] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-10T20:36:21.089389] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-10T20:36:21.889404] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-10-10T20:36:21.981419] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T20:36:22.689411] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-10T20:36:23.140948] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-10T20:36:23.489377] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-10T20:36:24.124225] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-10T20:36:24.289351] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-10T20:36:24.590532] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T20:36:24.666159] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-10-10T20:36:25.089415] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-10T20:36:25.889413] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-10T20:36:26.408174] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-10T20:36:26.689424] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-10T20:36:26.932485] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-10T20:36:26.982266] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-10T20:36:27.489375] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-10T20:36:28.132254] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-10T20:36:28.289379] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-10T20:36:28.724478] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T20:36:29.089427] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-10T20:36:29.889366] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-10T20:36:30.446381] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-10T20:36:30.681564] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-10T20:36:30.689418] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-10T20:36:30.864279] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-10T20:36:31.489382] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-10T20:36:32.289415] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-10T20:36:32.760813] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T20:36:32.817345] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-10T20:36:32.818000] [INFO ] [REMOTE ] NTEST: Full fetch complete (1995 records). [2025-10-10T20:36:32.818070] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-10T20:36:32.818447] [FATAL] [VALIDATOR ] NTEST: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:36:32.818557] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:36:32.818634] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:36:32.818751] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-10T20:36:32.818838] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-10T20:36:32.818879] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-10T20:36:32.818921] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-10T20:36:32.818985] [INFO ] [MAIN ] Update Progress: 1540/2373 symbols completed. NTEST took 27.7s. Estimated remaining: 1h 57m 6s. Rate: 7.1 symbols/min [2025-10-10T20:36:32.997521] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:36:32.997861] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-10T20:36:32.997934] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-10T20:36:32.998077] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-10T20:36:32.998138] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-10T20:36:32.998376] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-10T20:36:32.998481] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-10T20:36:33.094453] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-10T20:36:33.205082] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T20:36:33.409453] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:36:33.889455] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-10-10T20:36:34.689406] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-10T20:36:35.489396] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-10T20:36:35.547372] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-10T20:36:36.289407] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-10T20:36:36.459518] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-10-10T20:36:36.586203] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T20:36:36.915408] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-10T20:36:37.089366] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-10T20:36:37.889446] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-10T20:36:38.689421] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-10T20:36:38.930412] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-10T20:36:38.971609] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T20:36:39.489375] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-10T20:36:39.938823] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-10T20:36:40.019096] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T20:36:40.289475] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-10T20:36:41.089381] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-10T20:36:41.198413] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T20:36:41.203631] [INFO ] [REMOTE ] NTR: Full fetch complete (75909 records). [2025-10-10T20:36:41.203870] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-10T20:36:41.204768] [FATAL] [VALIDATOR ] NTR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:36:41.204864] [FATAL] [MAIN ] NTR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:36:41.204907] [WARN ] [MAIN ] NTR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:36:41.204951] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-10T20:36:41.205018] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-10T20:36:41.205054] [INFO ] [LOCAL ] NTR: Starting deletion of derivative data. [2025-10-10T20:36:41.205093] [DEBUG] [LOCAL ] NTR: No derivative data file found to delete. [2025-10-10T20:36:41.205158] [INFO ] [MAIN ] Update Progress: 1541/2373 symbols completed. NTR took 34.3s. Estimated remaining: 1h 56m 57s. Rate: 7.1 symbols/min [2025-10-10T20:36:41.390464] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:36:41.390789] [DEBUG] [LOCAL ] NUS: No existing data file found in primary storage. [2025-10-10T20:36:41.390837] [WARN ] [MAIN ] NUS: No existing data found, performing full refresh instead. [2025-10-10T20:36:41.390964] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-10T20:36:41.391007] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-10T20:36:41.391048] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-10T20:36:41.391082] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-10T20:36:41.792243] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:36:41.894534] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-10-10T20:36:41.919515] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-10T20:36:42.689343] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-10T20:36:42.893083] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T20:36:43.434632] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T20:36:43.489462] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-10T20:36:44.289382] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-10T20:36:45.089423] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-10T20:36:45.145780] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-10T20:36:45.399771] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-10T20:36:45.889404] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-10T20:36:46.226164] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T20:36:46.689427] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-10T20:36:46.735763] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T20:36:46.739806] [INFO ] [REMOTE ] NTST: Full fetch complete (61099 records). [2025-10-10T20:36:46.739905] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-10T20:36:46.740732] [FATAL] [VALIDATOR ] NTST: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:36:46.740819] [FATAL] [MAIN ] NTST: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:36:46.740887] [WARN ] [MAIN ] NTST: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:36:46.740955] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-10T20:36:46.741032] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-10T20:36:46.741070] [INFO ] [LOCAL ] NTST: Starting deletion of derivative data. [2025-10-10T20:36:46.741141] [DEBUG] [LOCAL ] NTST: No derivative data file found to delete. [2025-10-10T20:36:46.741254] [INFO ] [MAIN ] Update Progress: 1542/2373 symbols completed. NTST took 35.2s. Estimated remaining: 1h 56m 47s. Rate: 7.1 symbols/min [2025-10-10T20:36:46.948291] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T20:36:46.950636] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:36:46.958353] [DEBUG] [LOCAL ] NUV: No existing data file found in primary storage. [2025-10-10T20:36:46.959348] [WARN ] [MAIN ] NUV: No existing data found, performing full refresh instead. [2025-10-10T20:36:46.959487] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-10T20:36:46.959532] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-10T20:36:46.959576] [DEBUG] [LOCAL ] NUV: No primary data file found to delete. [2025-10-10T20:36:46.959610] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-10T20:36:47.343939] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:36:47.489431] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-10-10T20:36:48.289391] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-10T20:36:49.059004] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-10T20:36:49.089333] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-10T20:36:49.255765] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T20:36:49.498393] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T20:36:49.889434] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-10T20:36:50.689434] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-10T20:36:51.339057] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-10T20:36:51.489373] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-10T20:36:51.595453] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T20:36:51.725051] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-10T20:36:52.289392] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-10T20:36:53.089412] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-10T20:36:53.810537] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-10T20:36:53.889343] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-10T20:36:54.027418] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T20:36:54.689372] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-10T20:36:55.288804] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-10T20:36:55.453935] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-10T20:36:55.489334] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-10T20:36:56.289403] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-10T20:36:57.012662] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-10T20:36:57.089340] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-10T20:36:57.495290] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-10T20:36:57.514712] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-10T20:36:57.519413] [INFO ] [REMOTE ] NU: Full fetch complete (77490 records). [2025-10-10T20:36:57.519524] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-10T20:36:57.520469] [FATAL] [VALIDATOR ] NU: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:36:57.520558] [FATAL] [MAIN ] NU: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:36:57.520600] [WARN ] [MAIN ] NU: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:36:57.520639] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-10T20:36:57.520766] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-10T20:36:57.520807] [INFO ] [LOCAL ] NU: Starting deletion of derivative data. [2025-10-10T20:36:57.520847] [DEBUG] [LOCAL ] NU: No derivative data file found to delete. [2025-10-10T20:36:57.520916] [INFO ] [MAIN ] Update Progress: 1543/2373 symbols completed. NU took 39.6s. Estimated remaining: 1h 56m 40s. Rate: 7.1 symbols/min [2025-10-10T20:36:57.694558] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:36:57.694845] [DEBUG] [LOCAL ] NUVB: No existing data file found in primary storage. [2025-10-10T20:36:57.694909] [WARN ] [MAIN ] NUVB: No existing data found, performing full refresh instead. [2025-10-10T20:36:57.695088] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-10T20:36:57.695155] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-10T20:36:57.695312] [DEBUG] [LOCAL ] NUVB: No primary data file found to delete. [2025-10-10T20:36:57.695375] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-10T20:36:57.902167] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-10T20:36:57.903482] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-10T20:36:58.100174] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:36:58.689417] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-10-10T20:36:59.259509] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-10T20:36:59.489355] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-10T20:37:00.289348] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-10T20:37:00.413340] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T20:37:01.089402] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-10T20:37:01.310880] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T20:37:01.889444] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-10T20:37:02.304413] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T20:37:02.487911] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-10T20:37:02.689377] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-10T20:37:03.489347] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-10T20:37:03.521053] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T20:37:04.265066] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T20:37:04.289335] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-10T20:37:05.089395] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-10T20:37:05.415161] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T20:37:05.542035] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-10T20:37:05.889386] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-10T20:37:06.689366] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-10T20:37:07.040223] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-10T20:37:07.489417] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-10T20:37:07.998191] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-10T20:37:08.067288] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T20:37:08.289368] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-10T20:37:09.089410] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-10T20:37:09.240842] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T20:37:09.654788] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-10T20:37:09.889361] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-10T20:37:10.689362] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-10T20:37:11.006537] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-10T20:37:11.126011] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-10T20:37:11.406588] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-10T20:37:11.409948] [INFO ] [REMOTE ] NUS: Full fetch complete (53473 records). [2025-10-10T20:37:11.410043] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-10T20:37:11.410633] [FATAL] [VALIDATOR ] NUS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:37:11.410784] [FATAL] [MAIN ] NUS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:37:11.410866] [WARN ] [MAIN ] NUS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:37:11.410942] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-10T20:37:11.411025] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-10T20:37:11.411072] [INFO ] [LOCAL ] NUS: Starting deletion of derivative data. [2025-10-10T20:37:11.411113] [DEBUG] [LOCAL ] NUS: No derivative data file found to delete. [2025-10-10T20:37:11.411184] [INFO ] [MAIN ] Update Progress: 1544/2373 symbols completed. NUS took 30.2s. Estimated remaining: 1h 56m 35s. Rate: 7.1 symbols/min [2025-10-10T20:37:11.494489] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-10T20:37:11.579589] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:37:11.579776] [DEBUG] [LOCAL ] NUW: No existing data file found in primary storage. [2025-10-10T20:37:11.579822] [WARN ] [MAIN ] NUW: No existing data found, performing full refresh instead. [2025-10-10T20:37:11.579933] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-10T20:37:11.579974] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-10T20:37:11.580017] [DEBUG] [LOCAL ] NUW: No primary data file found to delete. [2025-10-10T20:37:11.580050] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-10T20:37:11.962722] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:37:12.289375] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-10-10T20:37:12.587884] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T20:37:12.592087] [INFO ] [REMOTE ] NUE: Full fetch complete (74384 records). [2025-10-10T20:37:12.592226] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-10T20:37:12.593042] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:37:12.593133] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:37:12.593175] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:37:12.593213] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-10T20:37:12.593268] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-10T20:37:12.593302] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-10T20:37:12.593340] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-10T20:37:12.593434] [INFO ] [MAIN ] Update Progress: 1545/2373 symbols completed. NUE took 39.8s. Estimated remaining: 1h 56m 22s. Rate: 7.1 symbols/min [2025-10-10T20:37:12.757176] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:37:12.757385] [DEBUG] [LOCAL ] NVG: No existing data file found in primary storage. [2025-10-10T20:37:12.757429] [WARN ] [MAIN ] NVG: No existing data found, performing full refresh instead. [2025-10-10T20:37:12.757541] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-10T20:37:12.757598] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-10T20:37:12.757638] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-10T20:37:12.757715] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-10T20:37:13.106867] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:37:13.102333] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-10T20:37:13.580860] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T20:37:13.889393] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-10T20:37:14.104232] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-10T20:37:14.689422] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-10T20:37:15.439574] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-10T20:37:15.489350] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-10-10T20:37:15.812436] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-10T20:37:16.289395] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-10T20:37:17.089421] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-10T20:37:17.270553] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T20:37:17.345795] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T20:37:17.889379] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-10T20:37:18.257073] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-10T20:37:18.260032] [INFO ] [REMOTE ] NUV: Full fetch complete (34175 records). [2025-10-10T20:37:18.260124] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-10T20:37:18.625449] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-10T20:37:18.625525] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-10T20:37:18.626223] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-10T20:37:18.626284] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-10T20:37:18.627082] [DEBUG] [LOCAL ] NUV: Trimmed 34175 records to 24018 (keeping 200 days of data) [2025-10-10T20:37:18.715193] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-10T20:37:18.773288] [DEBUG] [LOCAL ] NUV: Primary data saved (24018 records). [2025-10-10T20:37:18.773416] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-10T20:37:18.773486] [INFO ] [MAIN ] Update Progress: 1546/2373 symbols completed. NUV took 32.0s. Estimated remaining: 1h 56m 13s. Rate: 7.1 symbols/min [2025-10-10T20:37:18.944570] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:37:18.944761] [DEBUG] [LOCAL ] NVGS: No existing data file found in primary storage. [2025-10-10T20:37:18.944804] [WARN ] [MAIN ] NVGS: No existing data found, performing full refresh instead. [2025-10-10T20:37:18.944913] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-10T20:37:18.944955] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-10T20:37:18.944995] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-10T20:37:18.945027] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-10T20:37:19.296973] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:37:19.489381] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-10T20:37:19.920749] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T20:37:20.228787] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T20:37:20.289353] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-10T20:37:20.517532] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-10T20:37:21.089373] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-10-10T20:37:21.657403] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T20:37:21.877858] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-10T20:37:21.889327] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-10T20:37:22.689415] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-10T20:37:23.279362] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-10T20:37:23.489391] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-10T20:37:24.039335] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T20:37:24.289362] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-10T20:37:24.833016] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T20:37:25.089368] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-10T20:37:25.889439] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-10T20:37:26.299026] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T20:37:26.490762] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-10T20:37:26.689413] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-10T20:37:27.049168] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-10T20:37:27.489344] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-10T20:37:27.714352] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-10T20:37:28.289375] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-10T20:37:28.794489] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T20:37:29.089379] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-10T20:37:29.889401] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-10T20:37:30.162773] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-10T20:37:30.406274] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-10T20:37:30.689455] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-10T20:37:31.489347] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-10T20:37:31.612011] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T20:37:31.651631] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-10T20:37:32.289370] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-10T20:37:33.089376] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-10T20:37:33.160817] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-10T20:37:33.802412] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-10T20:37:33.889347] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-10T20:37:34.689449] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-10T20:37:34.862214] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T20:37:35.170510] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-10T20:37:35.489358] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-10T20:37:36.052445] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-10T20:37:36.289446] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-10T20:37:37.082913] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-10T20:37:37.089319] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-10T20:37:37.225168] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-10T20:37:37.732352] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-10T20:37:37.733308] [INFO ] [REMOTE ] NUW: Full fetch complete (11180 records). [2025-10-10T20:37:37.733377] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-10T20:37:37.903872] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-10T20:37:38.094686] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-10T20:37:38.094773] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-10T20:37:38.095090] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-10T20:37:38.095129] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-10T20:37:38.095548] [DEBUG] [LOCAL ] NUW: Trimmed 11180 records to 7200 (keeping 200 days of data) [2025-10-10T20:37:38.139792] [DEBUG] [LOCAL ] NUW: Primary data saved (7200 records). [2025-10-10T20:37:38.139913] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-10T20:37:38.139986] [INFO ] [MAIN ] Update Progress: 1547/2373 symbols completed. NUW took 26.7s. Estimated remaining: 1h 56m 10s. Rate: 7.1 symbols/min [2025-10-10T20:37:38.313702] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:37:38.313890] [DEBUG] [LOCAL ] NVO: No existing data file found in primary storage. [2025-10-10T20:37:38.313934] [WARN ] [MAIN ] NVO: No existing data found, performing full refresh instead. [2025-10-10T20:37:38.314048] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-10T20:37:38.314088] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-10T20:37:38.314128] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-10T20:37:38.314160] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-10T20:37:38.665927] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:37:38.689340] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-10-10T20:37:39.489371] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-10T20:37:39.590965] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T20:37:40.289418] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-10T20:37:41.089467] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-10T20:37:41.559727] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-10-10T20:37:41.611735] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-10T20:37:41.647401] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T20:37:41.889422] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-10T20:37:42.636065] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T20:37:42.689340] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-10T20:37:43.489428] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-10T20:37:43.938450] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T20:37:44.289615] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-10T20:37:44.682065] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-10-10T20:37:45.040276] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-10T20:37:45.042761] [INFO ] [REMOTE ] NVGS: Full fetch complete (41489 records). [2025-10-10T20:37:45.042838] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-10T20:37:45.043304] [FATAL] [VALIDATOR ] NVGS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:37:45.043386] [FATAL] [MAIN ] NVGS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:37:45.043429] [WARN ] [MAIN ] NVGS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:37:45.043467] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-10T20:37:45.043522] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-10T20:37:45.043881] [INFO ] [LOCAL ] NVGS: Starting deletion of derivative data. [2025-10-10T20:37:45.044148] [DEBUG] [LOCAL ] NVGS: No derivative data file found to delete. [2025-10-10T20:37:45.044278] [INFO ] [MAIN ] Update Progress: 1548/2373 symbols completed. NVGS took 26.3s. Estimated remaining: 1h 56m 1s. Rate: 7.1 symbols/min [2025-10-10T20:37:45.094554] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-10T20:37:45.236666] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:37:45.236961] [DEBUG] [LOCAL ] NVR: No existing data file found in primary storage. [2025-10-10T20:37:45.237017] [WARN ] [MAIN ] NVR: No existing data found, performing full refresh instead. [2025-10-10T20:37:45.237168] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-10T20:37:45.237238] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-10T20:37:45.237294] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-10T20:37:45.237328] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-10T20:37:45.582261] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-10T20:37:45.636542] [INFO ] [REMOTE ] NUVB: Full fetch complete (72950 records). [2025-10-10T20:37:45.648707] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-10T20:37:45.766449] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:37:45.894706] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-10T20:37:46.073920] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-10-10T20:37:46.074003] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-10-10T20:37:46.075177] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-10-10T20:37:46.075240] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-10-10T20:37:46.076638] [DEBUG] [LOCAL ] NUVB: Trimmed 72950 records to 52137 (keeping 200 days of data) [2025-10-10T20:37:46.364827] [DEBUG] [LOCAL ] NUVB: Primary data saved (52137 records). [2025-10-10T20:37:46.364960] [INFO ] [MAIN ] NUVB: Full history saved. [2025-10-10T20:37:46.365049] [INFO ] [MAIN ] Update Progress: 1549/2373 symbols completed. NUVB took 48.8s. Estimated remaining: 1h 55m 49s. Rate: 7.1 symbols/min [2025-10-10T20:37:46.535927] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:37:46.536237] [DEBUG] [LOCAL ] NVRI: No existing data file found in primary storage. [2025-10-10T20:37:46.536290] [WARN ] [MAIN ] NVRI: No existing data found, performing full refresh instead. [2025-10-10T20:37:46.536419] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-10T20:37:46.536465] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-10T20:37:46.536562] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-10T20:37:46.536604] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-10T20:37:46.692205] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-10-10T20:37:46.906961] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:37:47.356710] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T20:37:47.489350] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-10-10T20:37:47.782886] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-10-10T20:37:48.289356] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-10T20:37:48.590984] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T20:37:49.050953] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-10T20:37:49.089374] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-10T20:37:49.889390] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-10T20:37:50.689457] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-10T20:37:50.879017] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T20:37:51.204667] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-10-10T20:37:51.309848] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-10T20:37:51.489346] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-10T20:37:51.764231] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-10T20:37:52.289433] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-10T20:37:53.089357] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-10T20:37:53.245060] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T20:37:53.887158] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T20:37:53.892878] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-10T20:37:54.522991] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-10T20:37:54.689377] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-10T20:37:55.489423] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-10T20:37:56.289398] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-10T20:37:56.392997] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-10T20:37:56.685857] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-10T20:37:56.714118] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T20:37:57.089436] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-10T20:37:57.889347] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-10T20:37:58.178431] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T20:37:58.401736] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T20:37:58.689379] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-10T20:37:59.489354] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-10T20:38:00.047316] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T20:38:00.289378] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-10T20:38:00.610694] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-10T20:38:00.855312] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T20:38:01.089393] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-10T20:38:01.634258] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-10T20:38:01.889421] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-10T20:38:02.668183] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T20:38:02.672585] [INFO ] [REMOTE ] NVG: Full fetch complete (40052 records). [2025-10-10T20:38:02.672986] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-10T20:38:02.673975] [FATAL] [VALIDATOR ] NVG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:38:02.674091] [FATAL] [MAIN ] NVG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:38:02.674154] [WARN ] [MAIN ] NVG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:38:02.674251] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-10T20:38:02.674402] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-10T20:38:02.674477] [INFO ] [LOCAL ] NVG: Starting deletion of derivative data. [2025-10-10T20:38:02.674564] [DEBUG] [LOCAL ] NVG: No derivative data file found to delete. [2025-10-10T20:38:02.674690] [INFO ] [MAIN ] Update Progress: 1550/2373 symbols completed. NVG took 50.1s. Estimated remaining: 1h 55m 44s. Rate: 7.1 symbols/min [2025-10-10T20:38:02.694516] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-10T20:38:02.890554] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:38:02.891162] [DEBUG] [LOCAL ] NVS: No existing data file found in primary storage. [2025-10-10T20:38:02.891338] [WARN ] [MAIN ] NVS: No existing data found, performing full refresh instead. [2025-10-10T20:38:02.891553] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-10T20:38:02.891624] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-10T20:38:02.891743] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-10T20:38:02.891812] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-10T20:38:03.207474] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-10T20:38:03.367032] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:38:03.489403] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-10T20:38:04.160866] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-10T20:38:04.289388] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-10-10T20:38:05.070772] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T20:38:05.089351] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-10T20:38:05.889419] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-10T20:38:06.394232] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-10T20:38:06.689403] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-10T20:38:07.494565] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-10T20:38:07.510101] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T20:38:07.875399] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T20:38:08.081437] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.99 seconds). [2025-10-10T20:38:08.289390] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-10T20:38:09.089367] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-10T20:38:09.409438] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T20:38:09.889381] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-10T20:38:10.402123] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T20:38:10.689454] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-10T20:38:11.403799] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (3.11 seconds). [2025-10-10T20:38:11.495065] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-10T20:38:11.506234] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-10T20:38:11.553315] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T20:38:11.555697] [INFO ] [REMOTE ] NVR: Full fetch complete (28998 records). [2025-10-10T20:38:11.555811] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-10T20:38:11.939182] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-10-10T20:38:11.939288] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-10-10T20:38:11.940394] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-10-10T20:38:11.940467] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-10-10T20:38:11.941409] [DEBUG] [LOCAL ] NVR: Trimmed 28998 records to 18768 (keeping 200 days of data) [2025-10-10T20:38:12.073174] [DEBUG] [LOCAL ] NVR: Primary data saved (18768 records). [2025-10-10T20:38:12.073384] [INFO ] [MAIN ] NVR: Full history saved. [2025-10-10T20:38:12.073480] [INFO ] [MAIN ] Update Progress: 1551/2373 symbols completed. NVR took 27.0s. Estimated remaining: 1h 55m 36s. Rate: 7.1 symbols/min [2025-10-10T20:38:12.254149] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:38:12.254396] [DEBUG] [LOCAL ] NVST: No existing data file found in primary storage. [2025-10-10T20:38:12.254448] [WARN ] [MAIN ] NVST: No existing data found, performing full refresh instead. [2025-10-10T20:38:12.254573] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-10T20:38:12.254615] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-10T20:38:12.254691] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-10T20:38:12.254741] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-10T20:38:12.297578] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-10T20:38:12.629843] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:38:13.089447] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-10-10T20:38:13.889374] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-10T20:38:14.341906] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-10-10T20:38:14.383920] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-10T20:38:14.689381] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-10T20:38:15.207408] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-10T20:38:15.424051] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-10T20:38:15.489393] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-10T20:38:16.289371] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-10T20:38:16.454723] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T20:38:16.710269] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-10T20:38:16.714075] [INFO ] [REMOTE ] NVRI: Full fetch complete (55473 records). [2025-10-10T20:38:16.714176] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-10T20:38:16.714833] [FATAL] [VALIDATOR ] NVRI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:38:16.714916] [FATAL] [MAIN ] NVRI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:38:16.714958] [WARN ] [MAIN ] NVRI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:38:16.715000] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-10T20:38:16.715055] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-10T20:38:16.715090] [INFO ] [LOCAL ] NVRI: Starting deletion of derivative data. [2025-10-10T20:38:16.715127] [DEBUG] [LOCAL ] NVRI: No derivative data file found to delete. [2025-10-10T20:38:16.715180] [INFO ] [MAIN ] Update Progress: 1552/2373 symbols completed. NVRI took 30.4s. Estimated remaining: 1h 55m 26s. Rate: 7.1 symbols/min [2025-10-10T20:38:16.883249] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:38:16.883453] [DEBUG] [LOCAL ] NVT: No existing data file found in primary storage. [2025-10-10T20:38:16.883491] [WARN ] [MAIN ] NVT: No existing data found, performing full refresh instead. [2025-10-10T20:38:16.883672] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-10T20:38:16.883728] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-10T20:38:16.883772] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-10T20:38:16.883803] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-10T20:38:17.098033] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-10T20:38:17.292220] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:38:17.467584] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T20:38:17.889402] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-10T20:38:18.689382] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-10T20:38:19.489357] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-10-10T20:38:19.751623] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T20:38:20.251350] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (3.15 seconds). [2025-10-10T20:38:20.289372] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-10T20:38:20.422704] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T20:38:21.089381] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-10T20:38:21.170398] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T20:38:21.175178] [INFO ] [REMOTE ] NVO: Full fetch complete (77566 records). [2025-10-10T20:38:21.175297] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-10T20:38:21.176001] [FATAL] [VALIDATOR ] NVO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:38:21.176086] [FATAL] [MAIN ] NVO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:38:21.176128] [WARN ] [MAIN ] NVO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:38:21.176192] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-10T20:38:21.176255] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-10T20:38:21.176290] [INFO ] [LOCAL ] NVO: Starting deletion of derivative data. [2025-10-10T20:38:21.176330] [DEBUG] [LOCAL ] NVO: No derivative data file found to delete. [2025-10-10T20:38:21.176384] [INFO ] [MAIN ] Update Progress: 1553/2373 symbols completed. NVO took 43.0s. Estimated remaining: 1h 55m 15s. Rate: 7.1 symbols/min [2025-10-10T20:38:21.344326] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:38:21.344624] [DEBUG] [LOCAL ] NWG: No existing data file found in primary storage. [2025-10-10T20:38:21.344873] [WARN ] [MAIN ] NWG: No existing data found, performing full refresh instead. [2025-10-10T20:38:21.344989] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-10T20:38:21.345031] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-10T20:38:21.345071] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-10T20:38:21.345143] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-10T20:38:21.702968] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-10T20:38:21.743982] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:38:21.889387] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-10-10T20:38:22.689384] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-10T20:38:23.144344] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T20:38:23.489382] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-10T20:38:23.677575] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T20:38:24.251120] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-10T20:38:24.289357] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-10T20:38:25.089396] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-10T20:38:25.310971] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T20:38:25.889357] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-10T20:38:26.160407] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T20:38:26.465872] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-10T20:38:26.689373] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-10T20:38:27.489384] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-10T20:38:27.919470] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T20:38:28.104140] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-10T20:38:28.289373] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-10T20:38:29.089393] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-10T20:38:29.456966] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-10T20:38:29.889432] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-10T20:38:30.263901] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-10T20:38:30.689389] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-10T20:38:30.836703] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-10T20:38:31.489366] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-10T20:38:32.011095] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-10T20:38:32.187048] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-10T20:38:32.289369] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-10T20:38:33.089436] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-10T20:38:33.143335] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T20:38:33.721672] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-10T20:38:33.889363] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-10T20:38:34.689365] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-10T20:38:35.101519] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T20:38:35.489363] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-10T20:38:36.118157] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-10T20:38:36.294498] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-10T20:38:36.307868] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-10T20:38:37.047499] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-10T20:38:37.089359] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-10T20:38:37.889398] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-10T20:38:38.466300] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-10T20:38:38.689385] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-10T20:38:38.936464] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T20:38:39.489383] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-10T20:38:40.057371] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-10T20:38:40.183453] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-10T20:38:40.289334] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-10T20:38:41.089414] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-10T20:38:41.385091] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T20:38:41.460638] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-10T20:38:41.464857] [INFO ] [REMOTE ] NVS: Full fetch complete (74433 records). [2025-10-10T20:38:41.464973] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-10T20:38:41.465739] [FATAL] [VALIDATOR ] NVS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:38:41.465822] [FATAL] [MAIN ] NVS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:38:41.465865] [WARN ] [MAIN ] NVS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:38:41.465931] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-10T20:38:41.465993] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-10T20:38:41.466029] [INFO ] [LOCAL ] NVS: Starting deletion of derivative data. [2025-10-10T20:38:41.466068] [DEBUG] [LOCAL ] NVS: No derivative data file found to delete. [2025-10-10T20:38:41.466122] [INFO ] [MAIN ] Update Progress: 1554/2373 symbols completed. NVS took 38.8s. Estimated remaining: 1h 55m 13s. Rate: 7.1 symbols/min [2025-10-10T20:38:41.630352] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:38:41.630491] [DEBUG] [LOCAL ] NWN: No existing data file found in primary storage. [2025-10-10T20:38:41.630527] [WARN ] [MAIN ] NWN: No existing data found, performing full refresh instead. [2025-10-10T20:38:41.630627] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-10T20:38:41.630700] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-10T20:38:41.630755] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-10T20:38:41.630787] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-10T20:38:41.894554] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-10T20:38:41.984470] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:38:42.143507] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T20:38:42.689346] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-10-10T20:38:43.489369] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-10T20:38:44.057950] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-10T20:38:44.289349] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-10T20:38:44.415908] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T20:38:45.063116] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T20:38:45.089325] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-10T20:38:45.316259] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-10T20:38:45.320568] [INFO ] [REMOTE ] NVST: Full fetch complete (73723 records). [2025-10-10T20:38:45.320704] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-10T20:38:45.321336] [FATAL] [VALIDATOR ] NVST: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:38:45.321421] [FATAL] [MAIN ] NVST: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:38:45.321504] [WARN ] [MAIN ] NVST: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:38:45.321563] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-10T20:38:45.321619] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-10T20:38:45.321703] [INFO ] [LOCAL ] NVST: Starting deletion of derivative data. [2025-10-10T20:38:45.321762] [DEBUG] [LOCAL ] NVST: No derivative data file found to delete. [2025-10-10T20:38:45.321821] [INFO ] [MAIN ] Update Progress: 1555/2373 symbols completed. NVST took 33.2s. Estimated remaining: 1h 55m 2s. Rate: 7.1 symbols/min [2025-10-10T20:38:45.486166] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:38:45.486316] [DEBUG] [LOCAL ] NX: No existing data file found in primary storage. [2025-10-10T20:38:45.486352] [WARN ] [MAIN ] NX: No existing data found, performing full refresh instead. [2025-10-10T20:38:45.486459] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-10T20:38:45.486498] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-10T20:38:45.486539] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-10T20:38:45.486570] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-10T20:38:45.826423] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:38:45.889335] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-10-10T20:38:46.489029] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-10T20:38:46.689381] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-10T20:38:47.489359] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-10T20:38:47.981538] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-10T20:38:48.289371] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-10T20:38:48.911637] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-10T20:38:49.089373] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-10T20:38:49.519590] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T20:38:49.889401] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-10T20:38:49.969051] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-10T20:38:50.378965] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T20:38:50.689383] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-10T20:38:50.981089] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T20:38:50.986604] [INFO ] [REMOTE ] NVT: Full fetch complete (74185 records). [2025-10-10T20:38:50.986874] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-10T20:38:50.988067] [FATAL] [VALIDATOR ] NVT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:38:50.988164] [FATAL] [MAIN ] NVT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:38:50.988230] [WARN ] [MAIN ] NVT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:38:50.988285] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-10T20:38:50.988354] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-10T20:38:50.988393] [INFO ] [LOCAL ] NVT: Starting deletion of derivative data. [2025-10-10T20:38:50.988434] [DEBUG] [LOCAL ] NVT: No derivative data file found to delete. [2025-10-10T20:38:50.988503] [INFO ] [MAIN ] Update Progress: 1556/2373 symbols completed. NVT took 34.3s. Estimated remaining: 1h 54m 52s. Rate: 7.1 symbols/min [2025-10-10T20:38:51.189739] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:38:51.190004] [DEBUG] [LOCAL ] NXC: No existing data file found in primary storage. [2025-10-10T20:38:51.190045] [WARN ] [MAIN ] NXC: No existing data found, performing full refresh instead. [2025-10-10T20:38:51.190171] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-10T20:38:51.190215] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-10T20:38:51.190257] [DEBUG] [LOCAL ] NXC: No primary data file found to delete. [2025-10-10T20:38:51.190291] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-10T20:38:51.494786] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-10T20:38:51.590244] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:38:52.089042] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-10T20:38:52.289396] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-10T20:38:53.089355] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-10T20:38:53.151247] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-10T20:38:53.663459] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T20:38:53.889375] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-10-10T20:38:54.689419] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-10T20:38:54.849764] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-10T20:38:54.918994] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-10T20:38:55.489358] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-10T20:38:55.968118] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-10T20:38:56.289408] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-10T20:38:57.089352] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-10T20:38:57.640790] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-10T20:38:57.832774] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-10T20:38:57.889365] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-10T20:38:58.352088] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T20:38:58.689385] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-10T20:38:59.489348] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-10T20:38:59.652473] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-10T20:39:00.121635] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-10T20:39:00.289340] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-10T20:39:00.407284] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-10T20:39:01.089476] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-10T20:39:01.592925] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T20:39:01.889361] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-10T20:39:02.113441] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T20:39:02.120137] [INFO ] [REMOTE ] NWG: Full fetch complete (73242 records). [2025-10-10T20:39:02.120302] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-10T20:39:02.121235] [FATAL] [VALIDATOR ] NWG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:39:02.121335] [FATAL] [MAIN ] NWG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:39:02.121454] [WARN ] [MAIN ] NWG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:39:02.121547] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-10T20:39:02.121676] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-10T20:39:02.121753] [INFO ] [LOCAL ] NWG: Starting deletion of derivative data. [2025-10-10T20:39:02.121823] [DEBUG] [LOCAL ] NWG: No derivative data file found to delete. [2025-10-10T20:39:02.121907] [INFO ] [MAIN ] Update Progress: 1557/2373 symbols completed. NWG took 40.9s. Estimated remaining: 1h 54m 45s. Rate: 7.1 symbols/min [2025-10-10T20:39:02.689400] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-10T20:39:02.762547] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-10T20:39:03.489385] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-10T20:39:04.289407] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-10T20:39:04.308211] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-10T20:39:04.360815] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-10T20:39:05.089437] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-10T20:39:05.698587] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T20:39:05.878829] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-10T20:39:05.889323] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-10T20:39:06.536388] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-10T20:39:06.689368] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-10T20:39:07.150766] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-10T20:39:07.152912] [INFO ] [REMOTE ] NWN: Full fetch complete (37031 records). [2025-10-10T20:39:07.153007] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-10T20:39:07.153526] [FATAL] [VALIDATOR ] NWN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:39:07.153609] [FATAL] [MAIN ] NWN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:39:07.153688] [WARN ] [MAIN ] NWN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:39:07.153769] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-10T20:39:07.153847] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-10T20:39:07.153896] [INFO ] [LOCAL ] NWN: Starting deletion of derivative data. [2025-10-10T20:39:07.153951] [DEBUG] [LOCAL ] NWN: No derivative data file found to delete. [2025-10-10T20:39:07.154027] [INFO ] [MAIN ] Update Progress: 1558/2373 symbols completed. NWN took 25.7s. Estimated remaining: 1h 54m 35s. Rate: 7.1 symbols/min [2025-10-10T20:39:07.489382] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-10T20:39:08.081835] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-10T20:39:08.289401] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-10T20:39:09.089402] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-10T20:39:09.196682] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-10T20:39:09.889347] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-10T20:39:10.591629] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-10T20:39:10.689382] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-10T20:39:10.845865] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T20:39:11.489415] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-10T20:39:11.516283] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-10T20:39:12.289393] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-10T20:39:12.956065] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T20:39:12.957140] [INFO ] [REMOTE ] NXC: Full fetch complete (5740 records). [2025-10-10T20:39:12.957212] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-10T20:39:13.138255] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T20:39:13.207949] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-10T20:39:13.360852] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-10T20:39:13.360949] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-10T20:39:13.361177] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-10T20:39:13.361219] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-10T20:39:13.361722] [DEBUG] [LOCAL ] NXC: Trimmed 5740 records to 4152 (keeping 200 days of data) [2025-10-10T20:39:13.387830] [DEBUG] [LOCAL ] NXC: Primary data saved (4152 records). [2025-10-10T20:39:13.387969] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-10T20:39:13.388048] [INFO ] [MAIN ] Update Progress: 1559/2373 symbols completed. NXC took 22.4s. Estimated remaining: 1h 54m 26s. Rate: 7.1 symbols/min [2025-10-10T20:39:14.813246] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-10T20:39:14.819984] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-10T20:39:16.768509] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T20:39:16.777114] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-10T20:39:17.516933] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T20:39:17.520007] [INFO ] [REMOTE ] NX: Full fetch complete (47723 records). [2025-10-10T20:39:17.520090] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-10T20:39:17.520569] [FATAL] [VALIDATOR ] NX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:39:17.520671] [FATAL] [MAIN ] NX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:39:17.520726] [WARN ] [MAIN ] NX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:39:17.520765] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-10T20:39:17.520818] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-10T20:39:17.520852] [INFO ] [LOCAL ] NX: Starting deletion of derivative data. [2025-10-10T20:39:17.520891] [DEBUG] [LOCAL ] NX: No derivative data file found to delete. [2025-10-10T20:39:17.520944] [INFO ] [MAIN ] Update Progress: 1560/2373 symbols completed. NX took 32.2s. Estimated remaining: 1h 54m 15s. Rate: 7.1 symbols/min [2025-10-10T20:39:18.215365] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:39:18.201890] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:39:18.225294] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:39:18.227008] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-10T20:39:18.225440] [DEBUG] [LOCAL ] NXG: No existing data file found in primary storage. [2025-10-10T20:39:18.227241] [DEBUG] [LOCAL ] NXDT: No existing data file found in primary storage. [2025-10-10T20:39:18.228165] [WARN ] [MAIN ] NXG: No existing data found, performing full refresh instead. [2025-10-10T20:39:18.228068] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:39:18.228373] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-10T20:39:18.228565] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-10T20:39:18.228702] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-10T20:39:18.229018] [DEBUG] [LOCAL ] NXG: No primary data file found to delete. [2025-10-10T20:39:18.229209] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-10T20:39:18.228934] [DEBUG] [LOCAL ] NXE: No existing data file found in primary storage. [2025-10-10T20:39:18.229552] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-10T20:39:18.229490] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-10T20:39:18.228450] [WARN ] [MAIN ] NXDT: No existing data found, performing full refresh instead. [2025-10-10T20:39:18.229425] [WARN ] [MAIN ] NXE: No existing data found, performing full refresh instead. [2025-10-10T20:39:18.249812] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-10T20:39:18.258581] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-10T20:39:18.249876] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-10T20:39:18.263900] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-10T20:39:18.269208] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-10T20:39:18.269148] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-10T20:39:18.363202] [DEBUG] [LOCAL ] NXE: No primary data file found to delete. [2025-10-10T20:39:18.363368] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-10T20:39:18.363078] [DEBUG] [LOCAL ] NXDT: No primary data file found to delete. [2025-10-10T20:39:18.376117] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-10T20:39:19.487562] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:39:19.542527] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:39:19.542897] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-10-10T20:39:19.585745] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-10-10T20:39:19.697385] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:39:19.699394] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-10-10T20:39:19.702843] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:39:19.703850] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-10-10T20:39:20.064469] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:39:20.064842] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-10-10T20:39:20.064928] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:39:20.064980] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-10T20:39:20.065016] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:39:20.065053] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-10T20:39:20.065108] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-10T20:39:20.065143] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-10T20:39:20.065180] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-10T20:39:20.065226] [INFO ] [MAIN ] Update Progress: 1561/2373 symbols completed. NXDR took 2.5s. Estimated remaining: 1h 54m 3s. Rate: 7.1 symbols/min [2025-10-10T20:39:20.236161] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:39:20.236316] [DEBUG] [LOCAL ] NXJ: No existing data file found in primary storage. [2025-10-10T20:39:20.236382] [WARN ] [MAIN ] NXJ: No existing data found, performing full refresh instead. [2025-10-10T20:39:20.236505] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-10T20:39:20.236546] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-10T20:39:20.236586] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-10T20:39:20.236617] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-10T20:39:20.591855] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:39:20.592156] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-10-10T20:39:20.790423] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-10T20:39:20.793093] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-10T20:39:21.138009] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T20:39:21.143065] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-10T20:39:21.730708] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-10T20:39:21.733550] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-10T20:39:21.872766] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T20:39:21.889325] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-10T20:39:22.007748] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-10T20:39:22.178755] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T20:39:22.382871] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-10T20:39:22.689380] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-10T20:39:23.489373] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-10T20:39:23.855326] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T20:39:23.910432] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T20:39:24.289384] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-10T20:39:24.740174] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-10T20:39:25.089354] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-10T20:39:25.564088] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-10T20:39:25.889371] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-10T20:39:26.689469] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-10T20:39:27.035136] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T20:39:27.164538] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T20:39:27.489361] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-10T20:39:27.713956] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-10T20:39:28.289379] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-10T20:39:29.089376] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-10T20:39:29.261548] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-10T20:39:29.582718] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T20:39:29.719912] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-10T20:39:29.889427] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-10T20:39:30.689558] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-10T20:39:31.339887] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-10T20:39:31.489371] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-10T20:39:31.822828] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T20:39:32.289448] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-10T20:39:33.089353] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-10T20:39:33.591200] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T20:39:33.613729] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T20:39:33.776614] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-10T20:39:33.889371] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-10T20:39:34.689348] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-10T20:39:35.116816] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-10T20:39:35.489360] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-10T20:39:35.723164] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-10T20:39:36.289378] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-10T20:39:36.437832] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-10T20:39:37.089459] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-10T20:39:37.889388] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-10T20:39:38.274028] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T20:39:38.348080] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T20:39:38.689418] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-10T20:39:39.099303] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-10T20:39:39.489371] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-10T20:39:40.027434] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-10T20:39:40.289395] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-10T20:39:41.076448] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-10T20:39:41.089333] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-10T20:39:41.562715] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-10T20:39:41.889369] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-10T20:39:42.689364] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-10T20:39:42.965326] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-10T20:39:43.188471] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T20:39:43.300906] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-10T20:39:43.489383] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-10T20:39:44.289359] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-10T20:39:44.535211] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-10T20:39:45.089374] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-10T20:39:45.889356] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-10T20:39:46.139862] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-10T20:39:46.406969] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-10T20:39:46.689371] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-10T20:39:47.040409] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-10T20:39:47.234252] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-10T20:39:47.236131] [INFO ] [REMOTE ] NXDT: Full fetch complete (24454 records). [2025-10-10T20:39:47.236230] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-10T20:39:47.495539] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-10T20:39:47.672911] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-10T20:39:47.672991] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-10T20:39:47.673802] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-10T20:39:47.673885] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-10T20:39:47.674547] [DEBUG] [LOCAL ] NXDT: Trimmed 24454 records to 15274 (keeping 200 days of data) [2025-10-10T20:39:47.763775] [DEBUG] [LOCAL ] NXDT: Primary data saved (15274 records). [2025-10-10T20:39:47.763922] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-10T20:39:47.764001] [INFO ] [MAIN ] Update Progress: 1562/2373 symbols completed. NXDT took 30.2s. Estimated remaining: 1h 54m 5s. Rate: 7.1 symbols/min [2025-10-10T20:39:47.929765] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:39:47.929964] [DEBUG] [LOCAL ] NXN: No existing data file found in primary storage. [2025-10-10T20:39:47.930001] [WARN ] [MAIN ] NXN: No existing data found, performing full refresh instead. [2025-10-10T20:39:47.930112] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-10T20:39:47.930151] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-10T20:39:47.930191] [DEBUG] [LOCAL ] NXN: No primary data file found to delete. [2025-10-10T20:39:47.930222] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-10T20:39:48.303249] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-10T20:39:48.308846] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:39:48.642892] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-10T20:39:49.089409] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-10T20:39:49.889420] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-10T20:39:49.953022] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T20:39:49.954525] [INFO ] [REMOTE ] NXG: Full fetch complete (14427 records). [2025-10-10T20:39:49.954603] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-10T20:39:50.335164] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-10-10T20:39:50.335330] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-10-10T20:39:50.335855] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-10-10T20:39:50.335946] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-10-10T20:39:50.337014] [DEBUG] [LOCAL ] NXG: Trimmed 14427 records to 10588 (keeping 200 days of data) [2025-10-10T20:39:50.421736] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-10T20:39:50.457458] [DEBUG] [LOCAL ] NXG: Primary data saved (10588 records). [2025-10-10T20:39:50.457772] [INFO ] [MAIN ] NXG: Full history saved. [2025-10-10T20:39:50.457888] [INFO ] [MAIN ] Update Progress: 1563/2373 symbols completed. NXG took 32.9s. Estimated remaining: 1h 53m 54s. Rate: 7.1 symbols/min [2025-10-10T20:39:50.583956] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T20:39:50.624999] [INFO ] [REMOTE ] NXJ: Full fetch complete (20570 records). [2025-10-10T20:39:50.647883] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:39:50.648080] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-10T20:39:50.648428] [DEBUG] [LOCAL ] NXP: No existing data file found in primary storage. [2025-10-10T20:39:50.649087] [WARN ] [MAIN ] NXP: No existing data found, performing full refresh instead. [2025-10-10T20:39:50.649812] [FATAL] [VALIDATOR ] NXJ: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:39:50.649997] [FATAL] [MAIN ] NXJ: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:39:50.650152] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-10T20:39:50.650326] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-10T20:39:50.650551] [DEBUG] [LOCAL ] NXP: No primary data file found to delete. [2025-10-10T20:39:50.650667] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-10T20:39:50.650431] [WARN ] [MAIN ] NXJ: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:39:50.655991] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-10T20:39:50.707393] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-10T20:39:50.716149] [INFO ] [LOCAL ] NXJ: Starting deletion of derivative data. [2025-10-10T20:39:50.694622] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-10T20:39:50.745371] [DEBUG] [LOCAL ] NXJ: No derivative data file found to delete. [2025-10-10T20:39:50.745619] [INFO ] [MAIN ] Update Progress: 1564/2373 symbols completed. NXJ took 30.7s. Estimated remaining: 1h 53m 41s. Rate: 7.1 symbols/min [2025-10-10T20:39:51.130769] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:39:51.136950] [DEBUG] [LOCAL ] NXRT: No existing data file found in primary storage. [2025-10-10T20:39:51.137008] [WARN ] [MAIN ] NXRT: No existing data found, performing full refresh instead. [2025-10-10T20:39:51.137149] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-10T20:39:51.137220] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-10T20:39:51.137728] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-10T20:39:51.137796] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-10T20:39:51.321761] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:39:51.492448] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-10-10T20:39:51.571379] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:39:52.289388] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-10-10T20:39:52.837737] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T20:39:53.005135] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-10T20:39:53.010757] [INFO ] [REMOTE ] NXE: Full fetch complete (76746 records). [2025-10-10T20:39:53.010923] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-10T20:39:53.094733] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-10-10T20:39:53.430156] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-10-10T20:39:53.430282] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-10-10T20:39:53.431874] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-10-10T20:39:53.431945] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-10-10T20:39:53.433989] [DEBUG] [LOCAL ] NXE: Trimmed 76746 records to 53783 (keeping 200 days of data) [2025-10-10T20:39:53.823373] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-10T20:39:53.833518] [DEBUG] [LOCAL ] NXE: Primary data saved (53783 records). [2025-10-10T20:39:53.833829] [INFO ] [MAIN ] NXE: Full history saved. [2025-10-10T20:39:53.833947] [INFO ] [MAIN ] Update Progress: 1565/2373 symbols completed. NXE took 36.3s. Estimated remaining: 1h 53m 30s. Rate: 7.1 symbols/min [2025-10-10T20:39:53.900225] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-10T20:39:54.015585] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:39:54.015887] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-10T20:39:54.015939] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-10T20:39:54.016082] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-10T20:39:54.016125] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-10T20:39:54.016166] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-10T20:39:54.016199] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-10T20:39:54.387878] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:39:54.475505] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T20:39:54.578559] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-10T20:39:54.689337] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-10T20:39:55.489336] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-10T20:39:55.680842] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-10T20:39:56.170749] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-10T20:39:56.289386] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-10T20:39:56.983198] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-10T20:39:57.089391] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-10-10T20:39:57.797607] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-10T20:39:57.889338] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-10T20:39:58.485247] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-10T20:39:58.689365] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-10T20:39:59.334507] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-10T20:39:59.489359] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-10T20:40:00.289350] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-10T20:40:00.620990] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-10T20:40:01.089411] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-10T20:40:01.341452] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-10T20:40:01.725627] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-10T20:40:01.889421] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-10T20:40:02.602299] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-10T20:40:02.689372] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-10T20:40:03.317939] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-10T20:40:03.489412] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-10T20:40:04.289417] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-10T20:40:04.682821] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-10T20:40:05.061982] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-10T20:40:05.089390] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-10T20:40:05.752906] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-10T20:40:05.889357] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-10T20:40:06.602322] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-10T20:40:06.689408] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-10T20:40:07.489383] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-10T20:40:08.041175] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T20:40:08.289418] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-10T20:40:08.378217] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-10T20:40:09.089357] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-10T20:40:09.614283] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T20:40:09.700820] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-10T20:40:09.889377] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-10T20:40:10.689377] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-10T20:40:10.888821] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-10T20:40:11.489387] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-10T20:40:12.266514] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-10T20:40:12.289368] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-10T20:40:12.541092] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-10T20:40:13.089379] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-10T20:40:13.726005] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-10T20:40:13.825848] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-10T20:40:13.889332] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-10T20:40:14.689391] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-10T20:40:14.998919] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-10T20:40:15.489337] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-10T20:40:15.997937] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-10T20:40:16.289391] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-10T20:40:16.712788] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T20:40:16.958805] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-10T20:40:17.089348] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-10T20:40:17.619305] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-10T20:40:17.620096] [INFO ] [REMOTE ] NXN: Full fetch complete (3586 records). [2025-10-10T20:40:17.620165] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-10T20:40:17.894582] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-10T20:40:17.987603] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-10T20:40:17.987729] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-10T20:40:17.987922] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-10T20:40:17.987966] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-10T20:40:17.988333] [DEBUG] [LOCAL ] NXN: Trimmed 3586 records to 2354 (keeping 200 days of data) [2025-10-10T20:40:18.004544] [DEBUG] [LOCAL ] NXN: Primary data saved (2354 records). [2025-10-10T20:40:18.004676] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-10T20:40:18.004790] [INFO ] [MAIN ] Update Progress: 1566/2373 symbols completed. NXN took 30.2s. Estimated remaining: 1h 53m 29s. Rate: 7.1 symbols/min [2025-10-10T20:40:18.168858] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:40:18.169036] [DEBUG] [LOCAL ] NYT: No existing data file found in primary storage. [2025-10-10T20:40:18.169075] [WARN ] [MAIN ] NYT: No existing data found, performing full refresh instead. [2025-10-10T20:40:18.169191] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-10T20:40:18.169233] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-10T20:40:18.169273] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-10T20:40:18.169306] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-10T20:40:18.514740] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:40:18.549860] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-10T20:40:18.689431] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-10T20:40:19.489470] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-10-10T20:40:20.009565] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T20:40:20.011261] [INFO ] [REMOTE ] NXP: Full fetch complete (16868 records). [2025-10-10T20:40:20.011332] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-10T20:40:20.294470] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-10T20:40:20.381252] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-10T20:40:20.381333] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-10T20:40:20.381824] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-10T20:40:20.381887] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-10T20:40:20.382433] [DEBUG] [LOCAL ] NXP: Trimmed 16868 records to 12605 (keeping 200 days of data) [2025-10-10T20:40:20.460485] [DEBUG] [LOCAL ] NXP: Primary data saved (12605 records). [2025-10-10T20:40:20.460631] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-10T20:40:20.460748] [INFO ] [MAIN ] Update Progress: 1567/2373 symbols completed. NXP took 30.0s. Estimated remaining: 1h 53m 18s. Rate: 7.1 symbols/min [2025-10-10T20:40:20.627993] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:40:20.628151] [DEBUG] [LOCAL ] NZF: No existing data file found in primary storage. [2025-10-10T20:40:20.628189] [WARN ] [MAIN ] NZF: No existing data found, performing full refresh instead. [2025-10-10T20:40:20.628299] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-10T20:40:20.628343] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-10T20:40:20.628383] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-10T20:40:20.628416] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-10T20:40:20.905829] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-10T20:40:20.983301] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:40:21.089402] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-10-10T20:40:21.513141] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T20:40:21.889375] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-10T20:40:22.689355] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-10T20:40:23.130952] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-10T20:40:23.489372] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-10T20:40:23.541724] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-10T20:40:23.829203] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T20:40:24.289395] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-10T20:40:24.617193] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-10T20:40:24.762390] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-10T20:40:25.089399] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-10T20:40:25.734491] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-10T20:40:25.889387] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-10T20:40:26.689391] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-10T20:40:27.096778] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-10T20:40:27.097891] [INFO ] [REMOTE ] NYC: Full fetch complete (1885 records). [2025-10-10T20:40:27.097987] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-10T20:40:27.303897] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-10T20:40:27.304220] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:40:27.304297] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:40:27.304375] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-10T20:40:27.304452] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-10T20:40:27.304493] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-10T20:40:27.304533] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-10T20:40:27.304602] [INFO ] [MAIN ] Update Progress: 1568/2373 symbols completed. NYC took 33.5s. Estimated remaining: 1h 53m 9s. Rate: 7.1 symbols/min [2025-10-10T20:40:27.496435] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-10T20:40:27.500490] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:40:27.501692] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-10T20:40:27.501784] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-10T20:40:27.501919] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-10T20:40:27.501964] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-10T20:40:27.502010] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-10T20:40:27.502046] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-10T20:40:27.877320] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:40:27.905385] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T20:40:28.289421] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-10-10T20:40:28.864295] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-10T20:40:29.089397] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-10T20:40:29.889446] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-10T20:40:30.396104] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-10T20:40:30.689375] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-10T20:40:31.265294] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.98 seconds). [2025-10-10T20:40:31.459729] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T20:40:31.477351] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-10T20:40:31.489338] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-10T20:40:32.289355] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-10T20:40:33.026256] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T20:40:33.028394] [INFO ] [REMOTE ] NXRT: Full fetch complete (25524 records). [2025-10-10T20:40:33.028552] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-10T20:40:33.029097] [FATAL] [VALIDATOR ] NXRT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:40:33.029189] [FATAL] [MAIN ] NXRT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:40:33.029234] [WARN ] [MAIN ] NXRT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:40:33.029296] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-10T20:40:33.029382] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-10T20:40:33.029449] [INFO ] [LOCAL ] NXRT: Starting deletion of derivative data. [2025-10-10T20:40:33.029519] [DEBUG] [LOCAL ] NXRT: No derivative data file found to delete. [2025-10-10T20:40:33.029595] [INFO ] [MAIN ] Update Progress: 1569/2373 symbols completed. NXRT took 42.3s. Estimated remaining: 1h 52m 59s. Rate: 7.1 symbols/min [2025-10-10T20:40:33.094461] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-10T20:40:33.154075] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T20:40:33.229826] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:40:33.229979] [DEBUG] [LOCAL ] OBDC: No existing data file found in primary storage. [2025-10-10T20:40:33.230015] [WARN ] [MAIN ] OBDC: No existing data found, performing full refresh instead. [2025-10-10T20:40:33.230127] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-10T20:40:33.230192] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-10T20:40:33.230254] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-10T20:40:33.230298] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-10T20:40:33.608491] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:40:33.889364] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-10-10T20:40:34.689348] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-10T20:40:35.150184] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-10T20:40:35.489409] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-10T20:40:36.072922] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-10T20:40:36.289377] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-10T20:40:37.089413] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-10T20:40:37.180331] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T20:40:37.489720] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.80 seconds). [2025-10-10T20:40:37.889345] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-10T20:40:38.338614] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-10T20:40:38.689349] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-10T20:40:38.831860] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T20:40:38.875170] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-10T20:40:39.489395] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-10T20:40:40.289403] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-10T20:40:40.672451] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-10T20:40:41.089376] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-10T20:40:41.320386] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-10T20:40:41.889383] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-10T20:40:42.206072] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-10-10T20:40:42.689413] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-10T20:40:43.197113] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-10T20:40:43.489420] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-10T20:40:43.553413] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T20:40:44.266339] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-10T20:40:44.289337] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-10T20:40:45.089358] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-10T20:40:45.420731] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T20:40:45.889343] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-10T20:40:46.298240] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T20:40:46.689424] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-10T20:40:47.489356] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-10T20:40:47.634815] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-10T20:40:48.029808] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.94 seconds). [2025-10-10T20:40:48.191677] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-10T20:40:48.289417] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-10T20:40:49.089344] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-10T20:40:49.174639] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T20:40:49.889372] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-10T20:40:50.339713] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-10T20:40:50.689372] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-10T20:40:51.122174] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T20:40:51.413418] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T20:40:51.489331] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-10T20:40:52.233559] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T20:40:52.236284] [INFO ] [REMOTE ] NZF: Full fetch complete (42594 records). [2025-10-10T20:40:52.236356] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-10T20:40:52.236844] [FATAL] [VALIDATOR ] NZF: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:40:52.236951] [FATAL] [MAIN ] NZF: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:40:52.237013] [WARN ] [MAIN ] NZF: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:40:52.237083] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-10T20:40:52.237144] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-10T20:40:52.237177] [INFO ] [LOCAL ] NZF: Starting deletion of derivative data. [2025-10-10T20:40:52.237215] [DEBUG] [LOCAL ] NZF: No derivative data file found to delete. [2025-10-10T20:40:52.237266] [INFO ] [MAIN ] Update Progress: 1570/2373 symbols completed. NZF took 31.8s. Estimated remaining: 1h 52m 56s. Rate: 7.1 symbols/min [2025-10-10T20:40:52.298451] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-10T20:40:52.404059] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:40:52.404222] [DEBUG] [LOCAL ] OBK: No existing data file found in primary storage. [2025-10-10T20:40:52.404258] [WARN ] [MAIN ] OBK: No existing data found, performing full refresh instead. [2025-10-10T20:40:52.404362] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-10T20:40:52.404402] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-10T20:40:52.404443] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-10T20:40:52.404473] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-10T20:40:52.752216] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:40:52.974992] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-10T20:40:53.089335] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-10T20:40:53.889355] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-10-10T20:40:54.384208] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-10T20:40:54.689400] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-10T20:40:55.227301] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-10T20:40:55.384169] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-10T20:40:55.492428] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-10T20:40:55.494366] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-10T20:40:55.498795] [INFO ] [REMOTE ] NYT: Full fetch complete (71651 records). [2025-10-10T20:40:55.498890] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-10T20:40:55.499677] [FATAL] [VALIDATOR ] NYT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:40:55.499758] [FATAL] [MAIN ] NYT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:40:55.499802] [WARN ] [MAIN ] NYT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:40:55.499867] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-10T20:40:55.499928] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-10T20:40:55.499965] [INFO ] [LOCAL ] NYT: Starting deletion of derivative data. [2025-10-10T20:40:55.500003] [DEBUG] [LOCAL ] NYT: No derivative data file found to delete. [2025-10-10T20:40:55.500060] [INFO ] [MAIN ] Update Progress: 1571/2373 symbols completed. NYT took 37.5s. Estimated remaining: 1h 52m 45s. Rate: 7.1 symbols/min [2025-10-10T20:40:55.674852] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:40:55.675020] [DEBUG] [LOCAL ] OC: No existing data file found in primary storage. [2025-10-10T20:40:55.675059] [WARN ] [MAIN ] OC: No existing data found, performing full refresh instead. [2025-10-10T20:40:55.675170] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-10T20:40:55.675212] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-10T20:40:55.675257] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-10T20:40:55.675291] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-10T20:40:56.031909] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:40:56.289344] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-10-10T20:40:56.807238] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T20:40:57.089408] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-10T20:40:57.889371] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-10T20:40:58.222372] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T20:40:58.388736] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T20:40:58.689403] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-10T20:40:59.489369] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-10T20:40:59.936122] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T20:41:00.289371] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-10T20:41:00.502732] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T20:41:00.657892] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-10T20:41:00.870328] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-10T20:41:00.874913] [INFO ] [REMOTE ] OBDC: Full fetch complete (74696 records). [2025-10-10T20:41:00.875064] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-10T20:41:00.875808] [FATAL] [VALIDATOR ] OBDC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:41:00.875904] [FATAL] [MAIN ] OBDC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:41:00.875946] [WARN ] [MAIN ] OBDC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:41:00.875984] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-10T20:41:00.876039] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-10T20:41:00.876075] [INFO ] [LOCAL ] OBDC: Starting deletion of derivative data. [2025-10-10T20:41:00.876114] [DEBUG] [LOCAL ] OBDC: No derivative data file found to delete. [2025-10-10T20:41:00.876178] [INFO ] [MAIN ] Update Progress: 1572/2373 symbols completed. OBDC took 27.8s. Estimated remaining: 1h 52m 35s. Rate: 7.1 symbols/min [2025-10-10T20:41:01.042943] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:41:01.043140] [DEBUG] [LOCAL ] OCFT: No existing data file found in primary storage. [2025-10-10T20:41:01.043178] [WARN ] [MAIN ] OCFT: No existing data found, performing full refresh instead. [2025-10-10T20:41:01.043290] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-10T20:41:01.043330] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-10T20:41:01.043370] [DEBUG] [LOCAL ] OCFT: No primary data file found to delete. [2025-10-10T20:41:01.043401] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-10T20:41:01.094567] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-10T20:41:01.389628] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:41:01.889413] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-10T20:41:02.079398] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-10T20:41:02.689405] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-10T20:41:03.489400] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-10T20:41:04.289368] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-10-10T20:41:04.646011] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-10T20:41:04.803078] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-10-10T20:41:04.824140] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-10T20:41:05.089344] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-10T20:41:05.190381] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-10T20:41:05.889399] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-10T20:41:06.689383] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-10T20:41:07.483984] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-10T20:41:07.489328] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-10T20:41:07.938563] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T20:41:07.980779] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-10-10T20:41:08.289397] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-10T20:41:08.522160] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-10T20:41:09.089441] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-10T20:41:09.889348] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-10T20:41:10.239286] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T20:41:10.350453] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T20:41:10.630393] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-10T20:41:10.689337] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-10T20:41:11.489554] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-10T20:41:11.920710] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-10T20:41:12.289371] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-10T20:41:13.089389] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-10T20:41:13.451081] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-10T20:41:13.481733] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T20:41:13.889373] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-10T20:41:14.689385] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-10T20:41:15.170709] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T20:41:15.489335] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-10T20:41:15.581017] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-10T20:41:15.623575] [DEBUG] [REMOTE ] OBK: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-10T20:41:15.623870] [WARN ] [REMOTE ] OBK: No data returned for month 2025-10 [2025-10-10T20:41:15.623961] [FATAL] [REMOTE ] OBK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:41:15.624061] [FATAL] [MAIN ] OBK: Failed to fetch primary data. [2025-10-10T20:41:15.624129] [WARN ] [MAIN ] OBK: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:41:15.624202] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-10T20:41:15.624265] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-10T20:41:15.624301] [INFO ] [LOCAL ] OBK: Starting deletion of derivative data. [2025-10-10T20:41:15.624341] [DEBUG] [LOCAL ] OBK: No derivative data file found to delete. [2025-10-10T20:41:15.624403] [INFO ] [MAIN ] Update Progress: 1573/2373 symbols completed. OBK took 23.4s. Estimated remaining: 1h 52m 30s. Rate: 7.1 symbols/min [2025-10-10T20:41:15.793038] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:41:15.793205] [DEBUG] [LOCAL ] ODC: No existing data file found in primary storage. [2025-10-10T20:41:15.793242] [WARN ] [MAIN ] ODC: No existing data found, performing full refresh instead. [2025-10-10T20:41:15.793353] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-10T20:41:15.793414] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-10T20:41:15.793456] [DEBUG] [LOCAL ] ODC: No primary data file found to delete. [2025-10-10T20:41:15.793490] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-10T20:41:15.902422] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T20:41:16.164186] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:41:16.289362] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-10-10T20:41:17.089439] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-10T20:41:17.486999] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-10T20:41:17.889424] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-10T20:41:18.689513] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-10T20:41:18.937179] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-10T20:41:19.462494] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-10T20:41:19.489388] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-10T20:41:19.986144] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-10T20:41:20.289425] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-10T20:41:20.311150] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-10T20:41:21.089363] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-10T20:41:21.889338] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-10T20:41:22.038340] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T20:41:22.161973] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-10T20:41:22.689377] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-10T20:41:23.489412] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-10T20:41:23.709348] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-10T20:41:24.021240] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-10T20:41:24.289345] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-10T20:41:24.419572] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-10T20:41:25.089345] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-10T20:41:25.193884] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-10T20:41:25.889379] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-10T20:41:26.015884] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-10T20:41:26.689382] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-10T20:41:26.734024] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-10T20:41:27.489356] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-10T20:41:27.779371] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T20:41:28.289368] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-10T20:41:28.301931] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-10T20:41:29.089395] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-10T20:41:29.889356] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-10T20:41:30.072123] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T20:41:30.115361] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T20:41:30.689385] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-10T20:41:31.489425] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-10T20:41:32.289351] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-10T20:41:32.402120] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T20:41:32.445698] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-10T20:41:32.550835] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-10T20:41:32.698824] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-10T20:41:32.699694] [INFO ] [REMOTE ] OCFT: Full fetch complete (11639 records). [2025-10-10T20:41:32.699764] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-10T20:41:33.058854] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-10T20:41:33.058940] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-10T20:41:33.059212] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-10T20:41:33.059250] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-10T20:41:33.059705] [DEBUG] [LOCAL ] OCFT: Trimmed 11639 records to 7771 (keeping 200 days of data) [2025-10-10T20:41:33.090010] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-10T20:41:33.103010] [DEBUG] [LOCAL ] OCFT: Primary data saved (7771 records). [2025-10-10T20:41:33.103079] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-10T20:41:33.103143] [INFO ] [MAIN ] Update Progress: 1574/2373 symbols completed. OCFT took 32.2s. Estimated remaining: 1h 52m 26s. Rate: 7.1 symbols/min [2025-10-10T20:41:33.272866] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:41:33.273080] [DEBUG] [LOCAL ] ODV: No existing data file found in primary storage. [2025-10-10T20:41:33.273119] [WARN ] [MAIN ] ODV: No existing data found, performing full refresh instead. [2025-10-10T20:41:33.273235] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-10T20:41:33.273277] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-10T20:41:33.273318] [DEBUG] [LOCAL ] ODV: No primary data file found to delete. [2025-10-10T20:41:33.273350] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-10T20:41:33.641950] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:41:33.889364] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-10T20:41:34.025969] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-10T20:41:34.689435] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-10T20:41:35.489364] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-10-10T20:41:35.598055] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T20:41:35.602929] [INFO ] [REMOTE ] O: Full fetch complete (77169 records). [2025-10-10T20:41:35.603063] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-10T20:41:35.603875] [FATAL] [VALIDATOR ] O: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:41:35.603960] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:41:35.604003] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:41:35.604042] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-10T20:41:35.604107] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-10T20:41:35.604148] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-10T20:41:35.604187] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-10T20:41:35.604248] [INFO ] [MAIN ] Update Progress: 1575/2373 symbols completed. O took 1m 8s. Estimated remaining: 1h 52m 14s. Rate: 7.1 symbols/min [2025-10-10T20:41:35.782859] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:41:35.783157] [DEBUG] [LOCAL ] OEC: No existing data file found in primary storage. [2025-10-10T20:41:35.783225] [WARN ] [MAIN ] OEC: No existing data found, performing full refresh instead. [2025-10-10T20:41:35.783444] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-10T20:41:35.783516] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-10T20:41:35.783612] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-10T20:41:35.783742] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-10T20:41:36.068678] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-10T20:41:36.179285] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:41:36.289339] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-10-10T20:41:36.964914] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T20:41:37.089354] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-10T20:41:37.863242] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-10T20:41:37.889380] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-10T20:41:38.191561] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-10T20:41:38.689367] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-10T20:41:38.732405] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T20:41:38.737407] [INFO ] [REMOTE ] OC: Full fetch complete (63830 records). [2025-10-10T20:41:38.737598] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-10T20:41:38.738421] [FATAL] [VALIDATOR ] OC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:41:38.738523] [FATAL] [MAIN ] OC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:41:38.738591] [WARN ] [MAIN ] OC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:41:38.738692] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-10T20:41:38.738767] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-10T20:41:38.738804] [INFO ] [LOCAL ] OC: Starting deletion of derivative data. [2025-10-10T20:41:38.738850] [DEBUG] [LOCAL ] OC: No derivative data file found to delete. [2025-10-10T20:41:38.738939] [INFO ] [MAIN ] Update Progress: 1576/2373 symbols completed. OC took 43.2s. Estimated remaining: 1h 52m 3s. Rate: 7.1 symbols/min [2025-10-10T20:41:38.949597] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:41:38.949796] [DEBUG] [LOCAL ] OFG: No existing data file found in primary storage. [2025-10-10T20:41:38.949841] [WARN ] [MAIN ] OFG: No existing data found, performing full refresh instead. [2025-10-10T20:41:38.949953] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-10T20:41:38.949996] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-10T20:41:38.950039] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-10T20:41:38.950071] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-10T20:41:39.353581] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:41:39.489449] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-10-10T20:41:39.693035] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-10T20:41:40.289371] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-10T20:41:40.971174] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T20:41:41.069801] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-10T20:41:41.089323] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-10T20:41:41.889334] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-10T20:41:42.335549] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T20:41:42.689382] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-10T20:41:43.454145] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-10T20:41:43.489341] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-10T20:41:44.041725] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-10T20:41:44.289393] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-10T20:41:44.903008] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-10T20:41:45.089423] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-10T20:41:45.103220] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T20:41:45.104548] [INFO ] [REMOTE ] ODC: Full fetch complete (11015 records). [2025-10-10T20:41:45.104617] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-10T20:41:45.480383] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-10T20:41:45.480489] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-10T20:41:45.480830] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-10T20:41:45.480891] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-10T20:41:45.481322] [DEBUG] [LOCAL ] ODC: Trimmed 11015 records to 8491 (keeping 200 days of data) [2025-10-10T20:41:45.532163] [DEBUG] [LOCAL ] ODC: Primary data saved (8491 records). [2025-10-10T20:41:45.532287] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-10T20:41:45.532360] [INFO ] [MAIN ] Update Progress: 1577/2373 symbols completed. ODC took 29.9s. Estimated remaining: 1h 51m 54s. Rate: 7.1 symbols/min [2025-10-10T20:41:45.700131] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:41:45.700313] [DEBUG] [LOCAL ] OGE: No existing data file found in primary storage. [2025-10-10T20:41:45.700350] [WARN ] [MAIN ] OGE: No existing data found, performing full refresh instead. [2025-10-10T20:41:45.700464] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-10T20:41:45.700506] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-10T20:41:45.700547] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-10T20:41:45.700579] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-10T20:41:45.895056] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-10T20:41:46.078024] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:41:46.689389] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-10-10T20:41:46.775530] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T20:41:47.489372] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-10T20:41:47.731013] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T20:41:48.289374] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-10T20:41:48.513234] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-10T20:41:48.559753] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T20:41:49.072632] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-10T20:41:49.089334] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-10T20:41:49.889387] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-10T20:41:50.656954] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T20:41:50.689337] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-10T20:41:51.494251] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-10T20:41:51.498115] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-10T20:41:52.289396] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-10T20:41:52.602232] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T20:41:53.089403] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-10T20:41:53.373745] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-10T20:41:53.889381] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-10T20:41:53.982543] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T20:41:54.689344] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-10T20:41:54.776093] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-10T20:41:55.136122] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T20:41:55.489415] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-10T20:41:56.289372] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-10T20:41:56.444909] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T20:41:57.089366] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-10T20:41:57.270624] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T20:41:57.889398] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-10T20:41:58.470231] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-10T20:41:58.689394] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-10T20:41:58.773017] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-10T20:41:58.777530] [INFO ] [REMOTE ] ODV: Full fetch complete (34218 records). [2025-10-10T20:41:58.777620] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-10T20:41:59.156585] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-10T20:41:59.156716] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-10T20:41:59.157877] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-10T20:41:59.157948] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-10T20:41:59.158845] [DEBUG] [LOCAL ] ODV: Trimmed 34218 records to 28529 (keeping 200 days of data) [2025-10-10T20:41:59.325215] [DEBUG] [LOCAL ] ODV: Primary data saved (28529 records). [2025-10-10T20:41:59.325352] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-10T20:41:59.325425] [INFO ] [MAIN ] Update Progress: 1578/2373 symbols completed. ODV took 26.2s. Estimated remaining: 1h 51m 48s. Rate: 7.1 symbols/min [2025-10-10T20:41:59.495406] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-10T20:41:59.498496] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:41:59.499390] [DEBUG] [LOCAL ] OGN: No existing data file found in primary storage. [2025-10-10T20:41:59.499449] [WARN ] [MAIN ] OGN: No existing data found, performing full refresh instead. [2025-10-10T20:41:59.499594] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-10T20:41:59.499683] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-10T20:41:59.499759] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-10T20:41:59.499855] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-10T20:41:59.834868] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-10T20:41:59.901759] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:41:59.923931] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T20:42:00.289414] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-10-10T20:42:01.089401] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-10T20:42:01.544009] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-10T20:42:01.889410] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-10T20:42:02.401625] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-10T20:42:02.510255] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-10T20:42:02.689383] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-10T20:42:03.489429] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-10T20:42:03.723220] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T20:42:03.866703] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-10T20:42:04.289403] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-10T20:42:05.089373] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-10T20:42:05.688882] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-10T20:42:05.889363] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-10T20:42:06.182699] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T20:42:06.478544] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T20:42:06.689387] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-10T20:42:07.489365] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-10T20:42:07.991756] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-10T20:42:08.013932] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T20:42:08.289346] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-10T20:42:09.089379] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-10T20:42:09.215225] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T20:42:09.235608] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-10T20:42:09.889363] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-10T20:42:10.691362] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-10T20:42:10.699033] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-10T20:42:10.776369] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-10T20:42:10.783849] [INFO ] [REMOTE ] OEC: Full fetch complete (52486 records). [2025-10-10T20:42:10.784001] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-10T20:42:10.784905] [FATAL] [VALIDATOR ] OEC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:42:10.784996] [FATAL] [MAIN ] OEC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:42:10.785039] [WARN ] [MAIN ] OEC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:42:10.785080] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-10T20:42:10.785137] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-10T20:42:10.785194] [INFO ] [LOCAL ] OEC: Starting deletion of derivative data. [2025-10-10T20:42:10.785239] [DEBUG] [LOCAL ] OEC: No derivative data file found to delete. [2025-10-10T20:42:10.785298] [INFO ] [MAIN ] Update Progress: 1579/2373 symbols completed. OEC took 35.2s. Estimated remaining: 1h 51m 41s. Rate: 7.1 symbols/min [2025-10-10T20:42:10.961123] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:42:10.961328] [DEBUG] [LOCAL ] OGS: No existing data file found in primary storage. [2025-10-10T20:42:10.961399] [WARN ] [MAIN ] OGS: No existing data found, performing full refresh instead. [2025-10-10T20:42:10.961544] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-10T20:42:10.961595] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-10T20:42:10.961637] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-10T20:42:10.961724] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-10T20:42:11.333438] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:42:11.489346] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-10-10T20:42:12.289403] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-10T20:42:13.014088] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-10T20:42:13.089341] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-10T20:42:13.162104] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-10T20:42:13.889380] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-10T20:42:14.142008] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T20:42:14.696192] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-10T20:42:14.702260] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-10T20:42:15.455928] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-10T20:42:15.489383] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-10T20:42:16.289393] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-10T20:42:16.683583] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-10T20:42:17.089348] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-10T20:42:17.209829] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T20:42:17.889350] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-10T20:42:18.000248] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T20:42:18.004161] [INFO ] [REMOTE ] OGE: Full fetch complete (66359 records). [2025-10-10T20:42:18.004252] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-10T20:42:18.004866] [FATAL] [VALIDATOR ] OGE: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:42:18.004951] [FATAL] [MAIN ] OGE: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:42:18.004994] [WARN ] [MAIN ] OGE: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:42:18.005032] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-10T20:42:18.005088] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-10T20:42:18.005123] [INFO ] [LOCAL ] OGE: Starting deletion of derivative data. [2025-10-10T20:42:18.005162] [DEBUG] [LOCAL ] OGE: No derivative data file found to delete. [2025-10-10T20:42:18.005216] [INFO ] [MAIN ] Update Progress: 1580/2373 symbols completed. OGE took 32.5s. Estimated remaining: 1h 51m 32s. Rate: 7.1 symbols/min [2025-10-10T20:42:18.173986] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:42:18.174182] [DEBUG] [LOCAL ] OHI: No existing data file found in primary storage. [2025-10-10T20:42:18.174230] [WARN ] [MAIN ] OHI: No existing data found, performing full refresh instead. [2025-10-10T20:42:18.174342] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-10T20:42:18.174383] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-10T20:42:18.174423] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-10T20:42:18.174461] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-10T20:42:18.536075] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:42:18.624707] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-10T20:42:18.689334] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-10-10T20:42:19.490055] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-10T20:42:19.492265] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T20:42:20.289343] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-10T20:42:20.529417] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T20:42:21.089351] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-10T20:42:21.595332] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-10T20:42:21.889443] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-10T20:42:22.034175] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T20:42:22.439938] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T20:42:22.689366] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-10T20:42:23.489411] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-10T20:42:23.862226] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T20:42:24.289353] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-10T20:42:24.435418] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T20:42:25.089389] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-10T20:42:25.688421] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-10T20:42:25.707599] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T20:42:25.710432] [INFO ] [REMOTE ] OFG: Full fetch complete (33749 records). [2025-10-10T20:42:25.710535] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-10T20:42:25.711229] [FATAL] [VALIDATOR ] OFG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:42:25.711333] [FATAL] [MAIN ] OFG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:42:25.711420] [WARN ] [MAIN ] OFG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:42:25.711522] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-10T20:42:25.711617] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-10T20:42:25.711708] [INFO ] [LOCAL ] OFG: Starting deletion of derivative data. [2025-10-10T20:42:25.711781] [DEBUG] [LOCAL ] OFG: No derivative data file found to delete. [2025-10-10T20:42:25.711859] [INFO ] [MAIN ] Update Progress: 1581/2373 symbols completed. OFG took 47.0s. Estimated remaining: 1h 51m 23s. Rate: 7.1 symbols/min [2025-10-10T20:42:25.896045] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:42:25.892623] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-10T20:42:25.897179] [DEBUG] [LOCAL ] OI: No existing data file found in primary storage. [2025-10-10T20:42:25.897241] [WARN ] [MAIN ] OI: No existing data found, performing full refresh instead. [2025-10-10T20:42:25.897415] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-10T20:42:25.897460] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-10T20:42:25.897503] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-10T20:42:25.897535] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-10T20:42:26.261583] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:42:26.287218] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-10T20:42:26.689376] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-10T20:42:27.489440] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-10T20:42:27.636552] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T20:42:28.289380] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-10T20:42:28.849116] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-10T20:42:29.089355] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-10T20:42:29.658906] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-10T20:42:29.889355] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-10-10T20:42:30.001976] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-10T20:42:30.689415] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-10T20:42:31.196466] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T20:42:31.314053] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T20:42:31.489376] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-10T20:42:32.289419] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-10T20:42:32.373017] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-10T20:42:33.089386] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-10T20:42:33.419141] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T20:42:33.889377] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-10T20:42:34.246349] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T20:42:34.689379] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-10T20:42:34.763996] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-10T20:42:35.489348] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-10T20:42:35.677749] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T20:42:36.289377] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-10T20:42:36.779415] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-10T20:42:37.089416] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-10T20:42:37.560711] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-10T20:42:37.827292] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T20:42:37.830174] [INFO ] [REMOTE ] OGS: Full fetch complete (47581 records). [2025-10-10T20:42:37.830261] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-10T20:42:37.831018] [FATAL] [VALIDATOR ] OGS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:42:37.831159] [FATAL] [MAIN ] OGS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:42:37.831284] [WARN ] [MAIN ] OGS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:42:37.831390] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-10T20:42:37.831465] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-10T20:42:37.831502] [INFO ] [LOCAL ] OGS: Starting deletion of derivative data. [2025-10-10T20:42:37.831544] [DEBUG] [LOCAL ] OGS: No derivative data file found to delete. [2025-10-10T20:42:37.831633] [INFO ] [MAIN ] Update Progress: 1582/2373 symbols completed. OGS took 27.0s. Estimated remaining: 1h 51m 17s. Rate: 7.1 symbols/min [2025-10-10T20:42:37.895141] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-10T20:42:38.006436] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:42:38.006597] [DEBUG] [LOCAL ] OIA: No existing data file found in primary storage. [2025-10-10T20:42:38.006634] [WARN ] [MAIN ] OIA: No existing data found, performing full refresh instead. [2025-10-10T20:42:38.006795] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-10T20:42:38.006865] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-10T20:42:38.006942] [DEBUG] [LOCAL ] OIA: No primary data file found to delete. [2025-10-10T20:42:38.006995] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-10T20:42:38.323058] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T20:42:38.412219] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:42:38.689387] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-10T20:42:38.827004] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T20:42:38.831535] [INFO ] [REMOTE ] OGN: Full fetch complete (76401 records). [2025-10-10T20:42:38.831716] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-10T20:42:38.832429] [FATAL] [VALIDATOR ] OGN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:42:38.832529] [FATAL] [MAIN ] OGN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:42:38.832571] [WARN ] [MAIN ] OGN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:42:38.832619] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-10T20:42:38.832707] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-10T20:42:38.832755] [INFO ] [LOCAL ] OGN: Starting deletion of derivative data. [2025-10-10T20:42:38.832796] [DEBUG] [LOCAL ] OGN: No derivative data file found to delete. [2025-10-10T20:42:38.832951] [INFO ] [MAIN ] Update Progress: 1583/2373 symbols completed. OGN took 39.5s. Estimated remaining: 1h 51m 5s. Rate: 7.1 symbols/min [2025-10-10T20:42:39.011096] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:42:39.011344] [DEBUG] [LOCAL ] OII: No existing data file found in primary storage. [2025-10-10T20:42:39.011397] [WARN ] [MAIN ] OII: No existing data found, performing full refresh instead. [2025-10-10T20:42:39.011529] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-10T20:42:39.011574] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-10T20:42:39.011618] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-10T20:42:39.011684] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-10T20:42:39.372264] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:42:39.489372] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-10-10T20:42:40.245693] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T20:42:40.289386] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-10T20:42:41.089380] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-10-10T20:42:41.351829] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T20:42:41.815002] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-10T20:42:41.889345] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-10T20:42:42.437403] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T20:42:42.689376] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-10T20:42:43.056990] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T20:42:43.489365] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-10T20:42:44.289373] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-10T20:42:44.510913] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T20:42:45.089394] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-10T20:42:45.549212] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T20:42:45.603986] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-10T20:42:45.889385] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-10T20:42:46.582402] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-10T20:42:46.609031] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-10T20:42:46.689400] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-10T20:42:47.489367] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-10T20:42:47.896551] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T20:42:48.289368] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-10T20:42:49.089362] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-10T20:42:49.286742] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-10T20:42:49.325719] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T20:42:49.889378] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-10T20:42:50.689351] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-10T20:42:51.096370] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T20:42:51.489413] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-10T20:42:51.918946] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T20:42:52.160852] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-10T20:42:52.289359] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-10T20:42:52.560816] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T20:42:52.998738] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-10T20:42:53.089388] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-10T20:42:53.889355] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-10T20:42:54.401072] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-10T20:42:54.689370] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-10T20:42:55.489386] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-10T20:42:55.541345] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T20:42:55.681468] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T20:42:55.686148] [INFO ] [REMOTE ] OHI: Full fetch complete (74738 records). [2025-10-10T20:42:55.686340] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-10T20:42:55.687130] [FATAL] [VALIDATOR ] OHI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:42:55.687218] [FATAL] [MAIN ] OHI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:42:55.687263] [WARN ] [MAIN ] OHI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:42:55.687313] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-10T20:42:55.687421] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-10T20:42:55.687505] [INFO ] [LOCAL ] OHI: Starting deletion of derivative data. [2025-10-10T20:42:55.687570] [DEBUG] [LOCAL ] OHI: No derivative data file found to delete. [2025-10-10T20:42:55.687672] [INFO ] [MAIN ] Update Progress: 1584/2373 symbols completed. OHI took 37.7s. Estimated remaining: 1h 51m 1s. Rate: 7.1 symbols/min [2025-10-10T20:42:55.856741] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:42:55.856969] [DEBUG] [LOCAL ] OIS: No existing data file found in primary storage. [2025-10-10T20:42:55.857019] [WARN ] [MAIN ] OIS: No existing data found, performing full refresh instead. [2025-10-10T20:42:55.857135] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-10T20:42:55.857177] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-10T20:42:55.857219] [DEBUG] [LOCAL ] OIS: No primary data file found to delete. [2025-10-10T20:42:55.857249] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-10T20:42:56.234613] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:42:56.289418] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-10-10T20:42:57.089381] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-10T20:42:57.392633] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T20:42:57.889353] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-10T20:42:57.983683] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T20:42:58.426553] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T20:42:58.689392] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-10T20:42:58.974388] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-10T20:42:59.489365] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-10T20:43:00.289381] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-10T20:43:00.677246] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T20:43:01.089386] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-10T20:43:01.443871] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T20:43:01.889367] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-10T20:43:02.027784] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-10T20:43:02.533180] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-10T20:43:02.689406] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-10T20:43:03.489368] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-10T20:43:03.607830] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T20:43:03.611892] [INFO ] [REMOTE ] OI: Full fetch complete (67780 records). [2025-10-10T20:43:03.612022] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-10T20:43:03.612792] [FATAL] [VALIDATOR ] OI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:43:03.612896] [FATAL] [MAIN ] OI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:43:03.612962] [WARN ] [MAIN ] OI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:43:03.613036] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-10T20:43:03.613101] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-10T20:43:03.613136] [INFO ] [LOCAL ] OI: Starting deletion of derivative data. [2025-10-10T20:43:03.613175] [DEBUG] [LOCAL ] OI: No derivative data file found to delete. [2025-10-10T20:43:03.613231] [INFO ] [MAIN ] Update Progress: 1585/2373 symbols completed. OI took 37.9s. Estimated remaining: 1h 50m 52s. Rate: 7.1 symbols/min [2025-10-10T20:43:03.800064] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:43:03.800272] [DEBUG] [LOCAL ] OKE: No existing data file found in primary storage. [2025-10-10T20:43:03.800331] [WARN ] [MAIN ] OKE: No existing data found, performing full refresh instead. [2025-10-10T20:43:03.800549] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-10T20:43:03.800778] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-10T20:43:03.800897] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-10T20:43:03.801040] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-10T20:43:03.987515] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T20:43:04.237793] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:43:04.289330] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-10-10T20:43:05.089365] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-10T20:43:05.286676] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T20:43:05.889375] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-10T20:43:06.451967] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-10T20:43:06.566431] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-10T20:43:06.689382] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-10T20:43:07.489410] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-10T20:43:07.542023] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T20:43:07.543628] [INFO ] [REMOTE ] OIA: Full fetch complete (20717 records). [2025-10-10T20:43:07.543819] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-10T20:43:07.934310] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T20:43:07.933048] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-10T20:43:07.937634] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-10T20:43:07.943584] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-10T20:43:07.943762] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-10T20:43:07.944850] [DEBUG] [LOCAL ] OIA: Trimmed 20717 records to 13690 (keeping 200 days of data) [2025-10-10T20:43:08.022766] [DEBUG] [LOCAL ] OIA: Primary data saved (13690 records). [2025-10-10T20:43:08.022896] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-10T20:43:08.022966] [INFO ] [MAIN ] Update Progress: 1586/2373 symbols completed. OIA took 30.2s. Estimated remaining: 1h 50m 41s. Rate: 7.1 symbols/min [2025-10-10T20:43:08.185596] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:43:08.185765] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-10T20:43:08.185807] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-10T20:43:08.185951] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-10T20:43:08.185999] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-10T20:43:08.186041] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-10T20:43:08.186072] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-10T20:43:08.294536] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-10T20:43:08.528564] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:43:08.835165] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T20:43:09.089393] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-10T20:43:09.889378] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-10-10T20:43:09.998965] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T20:43:10.002547] [INFO ] [REMOTE ] OII: Full fetch complete (61448 records). [2025-10-10T20:43:10.002639] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-10T20:43:10.003244] [FATAL] [VALIDATOR ] OII: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:43:10.003325] [FATAL] [MAIN ] OII: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:43:10.003367] [WARN ] [MAIN ] OII: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:43:10.003405] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-10T20:43:10.003458] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-10T20:43:10.003492] [INFO ] [LOCAL ] OII: Starting deletion of derivative data. [2025-10-10T20:43:10.003530] [DEBUG] [LOCAL ] OII: No derivative data file found to delete. [2025-10-10T20:43:10.003583] [INFO ] [MAIN ] Update Progress: 1587/2373 symbols completed. OII took 31.2s. Estimated remaining: 1h 50m 30s. Rate: 7.1 symbols/min [2025-10-10T20:43:10.169863] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:43:10.170000] [DEBUG] [LOCAL ] OLN: No existing data file found in primary storage. [2025-10-10T20:43:10.170036] [WARN ] [MAIN ] OLN: No existing data found, performing full refresh instead. [2025-10-10T20:43:10.170140] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-10T20:43:10.170180] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-10T20:43:10.170220] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-10T20:43:10.170251] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-10T20:43:10.546576] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:43:10.548760] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-10T20:43:10.689329] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-10T20:43:11.489372] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-10-10T20:43:12.289368] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-10T20:43:12.461287] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-10T20:43:12.947970] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (3.06 seconds). [2025-10-10T20:43:13.089424] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-10T20:43:13.533599] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-10T20:43:13.889349] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-10T20:43:14.367055] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-10T20:43:14.689389] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-10T20:43:14.819000] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T20:43:15.489421] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-10T20:43:15.863437] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T20:43:16.289418] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-10T20:43:16.813755] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-10T20:43:16.936490] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T20:43:17.089392] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-10T20:43:17.889380] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-10T20:43:18.689371] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-10T20:43:18.833927] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T20:43:18.904068] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-10T20:43:19.489351] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-10T20:43:19.814577] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T20:43:20.289397] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-10T20:43:20.670636] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T20:43:21.089413] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-10T20:43:21.889448] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-10T20:43:21.973791] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-10T20:43:22.050404] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T20:43:22.689345] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-10T20:43:22.940526] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T20:43:23.489371] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-10T20:43:23.773766] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T20:43:24.094421] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-10T20:43:24.098058] [INFO ] [REMOTE ] OIS: Full fetch complete (57009 records). [2025-10-10T20:43:24.098207] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-10T20:43:24.297627] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-10T20:43:24.477414] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-10T20:43:24.477488] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-10T20:43:24.478375] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-10T20:43:24.478435] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-10T20:43:24.479515] [DEBUG] [LOCAL ] OIS: Trimmed 57009 records to 40743 (keeping 200 days of data) [2025-10-10T20:43:24.724165] [DEBUG] [LOCAL ] OIS: Primary data saved (40743 records). [2025-10-10T20:43:24.724339] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-10T20:43:24.724440] [INFO ] [MAIN ] Update Progress: 1588/2373 symbols completed. OIS took 29.0s. Estimated remaining: 1h 50m 24s. Rate: 7.1 symbols/min [2025-10-10T20:43:24.921967] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:43:24.922255] [DEBUG] [LOCAL ] OLP: No existing data file found in primary storage. [2025-10-10T20:43:24.922301] [WARN ] [MAIN ] OLP: No existing data found, performing full refresh instead. [2025-10-10T20:43:24.922429] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-10T20:43:24.922507] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-10T20:43:24.922629] [DEBUG] [LOCAL ] OLP: No primary data file found to delete. [2025-10-10T20:43:24.922712] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-10T20:43:25.103960] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-10T20:43:25.355572] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:43:25.576069] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-10T20:43:25.889413] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-10T20:43:26.631195] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-10T20:43:26.689403] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-10-10T20:43:27.489466] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-10T20:43:27.705554] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T20:43:27.881341] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T20:43:28.289378] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-10T20:43:28.320835] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (3.22 seconds). [2025-10-10T20:43:29.089384] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-10T20:43:29.642438] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-10T20:43:29.889370] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-10T20:43:30.109876] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-10T20:43:30.336375] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-10T20:43:30.689396] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-10T20:43:31.489383] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-10T20:43:32.255413] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-10T20:43:32.289353] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-10T20:43:32.767209] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-10T20:43:33.089439] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-10T20:43:33.703423] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-10T20:43:33.889380] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-10T20:43:34.378740] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-10T20:43:34.689351] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-10T20:43:34.911366] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-10T20:43:35.309110] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-10T20:43:35.489391] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-10T20:43:36.289457] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-10T20:43:37.028729] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-10T20:43:37.045810] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-10T20:43:37.089344] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-10T20:43:37.421929] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T20:43:37.889390] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-10T20:43:38.189192] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-10T20:43:38.689362] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-10T20:43:38.807389] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T20:43:38.811981] [INFO ] [REMOTE ] OKE: Full fetch complete (77106 records). [2025-10-10T20:43:38.812142] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-10T20:43:38.812924] [FATAL] [VALIDATOR ] OKE: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:43:38.813026] [FATAL] [MAIN ] OKE: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:43:38.813068] [WARN ] [MAIN ] OKE: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:43:38.813109] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-10T20:43:38.813164] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-10T20:43:38.813198] [INFO ] [LOCAL ] OKE: Starting deletion of derivative data. [2025-10-10T20:43:38.813236] [DEBUG] [LOCAL ] OKE: No derivative data file found to delete. [2025-10-10T20:43:38.813293] [INFO ] [MAIN ] Update Progress: 1589/2373 symbols completed. OKE took 35.2s. Estimated remaining: 1h 50m 19s. Rate: 7.1 symbols/min [2025-10-10T20:43:38.977988] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:43:38.978162] [DEBUG] [LOCAL ] OMC: No existing data file found in primary storage. [2025-10-10T20:43:38.978199] [WARN ] [MAIN ] OMC: No existing data found, performing full refresh instead. [2025-10-10T20:43:38.978315] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-10T20:43:38.978362] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-10T20:43:38.978412] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-10T20:43:38.978451] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-10T20:43:39.325231] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:43:39.489353] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-10-10T20:43:40.289374] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-10T20:43:41.089349] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-10T20:43:41.299046] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-10T20:43:41.524798] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-10-10T20:43:41.655040] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T20:43:41.715933] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-10T20:43:41.721071] [INFO ] [REMOTE ] OLN: Full fetch complete (74244 records). [2025-10-10T20:43:41.721251] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-10T20:43:41.722136] [FATAL] [VALIDATOR ] OLN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:43:41.722229] [FATAL] [MAIN ] OLN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:43:41.722301] [WARN ] [MAIN ] OLN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:43:41.722380] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-10T20:43:41.722456] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-10T20:43:41.722496] [INFO ] [LOCAL ] OLN: Starting deletion of derivative data. [2025-10-10T20:43:41.722537] [DEBUG] [LOCAL ] OLN: No derivative data file found to delete. [2025-10-10T20:43:41.722730] [INFO ] [MAIN ] Update Progress: 1590/2373 symbols completed. OLN took 31.7s. Estimated remaining: 1h 50m 8s. Rate: 7.1 symbols/min [2025-10-10T20:43:41.895219] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-10T20:43:41.914801] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:43:41.914974] [DEBUG] [LOCAL ] OMF: No existing data file found in primary storage. [2025-10-10T20:43:41.915024] [WARN ] [MAIN ] OMF: No existing data found, performing full refresh instead. [2025-10-10T20:43:41.915140] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-10T20:43:41.915204] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-10T20:43:41.915262] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-10T20:43:41.915309] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-10T20:43:42.261218] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:43:42.689359] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-10T20:43:43.489343] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-10T20:43:43.713721] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-10T20:43:44.157381] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-10T20:43:44.289330] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-10T20:43:45.089384] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-10T20:43:45.432323] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T20:43:45.889380] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-10-10T20:43:46.115012] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-10T20:43:46.689346] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-10T20:43:47.457261] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (3.17 seconds). [2025-10-10T20:43:47.489349] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-10T20:43:47.604515] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T20:43:48.292140] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-10T20:43:48.299393] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T20:43:49.089377] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-10T20:43:49.889350] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-10T20:43:50.202369] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-10T20:43:50.301117] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-10T20:43:50.689352] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-10T20:43:50.919021] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-10T20:43:51.419409] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-10T20:43:51.489364] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-10T20:43:52.289359] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-10T20:43:52.501221] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-10T20:43:53.089413] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-10T20:43:53.889417] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-10T20:43:53.935330] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (3.25 seconds). [2025-10-10T20:43:54.510625] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-10T20:43:54.689343] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-10T20:43:54.892256] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T20:43:54.893994] [INFO ] [REMOTE ] OLP: Full fetch complete (14151 records). [2025-10-10T20:43:54.894079] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-10T20:43:55.209852] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-10T20:43:55.302005] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-10-10T20:43:55.302083] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-10-10T20:43:55.302491] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-10-10T20:43:55.302552] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-10-10T20:43:55.303058] [DEBUG] [LOCAL ] OLP: Trimmed 14151 records to 10232 (keeping 200 days of data) [2025-10-10T20:43:55.364913] [DEBUG] [LOCAL ] OLP: Primary data saved (10232 records). [2025-10-10T20:43:55.365035] [INFO ] [MAIN ] OLP: Full history saved. [2025-10-10T20:43:55.365112] [INFO ] [MAIN ] Update Progress: 1591/2373 symbols completed. OLP took 30.6s. Estimated remaining: 1h 50m 2s. Rate: 7.1 symbols/min [2025-10-10T20:43:55.499881] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-10T20:43:55.531803] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:43:55.531987] [DEBUG] [LOCAL ] OMI: No existing data file found in primary storage. [2025-10-10T20:43:55.532038] [WARN ] [MAIN ] OMI: No existing data found, performing full refresh instead. [2025-10-10T20:43:55.532150] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-10T20:43:55.532199] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-10T20:43:55.532239] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-10T20:43:55.532278] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-10T20:43:55.872034] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:43:56.289394] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-10-10T20:43:56.809812] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-10T20:43:57.089372] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-10T20:43:57.653880] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T20:43:57.828936] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T20:43:57.889339] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-10T20:43:57.925154] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T20:43:57.929592] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-10-10T20:43:57.929765] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-10T20:43:57.930532] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:43:57.930621] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:43:57.930698] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:43:57.930770] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-10T20:43:57.930885] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-10T20:43:57.930941] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-10T20:43:57.930983] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-10-10T20:43:57.931052] [INFO ] [MAIN ] Update Progress: 1592/2373 symbols completed. OKLO took 49.9s. Estimated remaining: 1h 49m 50s. Rate: 7.1 symbols/min [2025-10-10T20:43:58.097503] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:43:58.097701] [DEBUG] [LOCAL ] ONIT: No existing data file found in primary storage. [2025-10-10T20:43:58.097752] [WARN ] [MAIN ] ONIT: No existing data found, performing full refresh instead. [2025-10-10T20:43:58.097877] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-10T20:43:58.097963] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-10T20:43:58.098026] [DEBUG] [LOCAL ] ONIT: No primary data file found to delete. [2025-10-10T20:43:58.098061] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-10T20:43:58.445823] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:43:58.689366] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-10-10T20:43:59.427814] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-10T20:43:59.489351] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-10T20:43:59.755465] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-10T20:44:00.289400] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-10T20:44:01.089396] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-10T20:44:01.416616] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T20:44:01.889389] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-10T20:44:02.352418] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-10T20:44:02.689398] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-10T20:44:03.219669] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T20:44:03.489343] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-10T20:44:03.812969] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T20:44:04.289346] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-10T20:44:04.389809] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-10T20:44:05.009072] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-10T20:44:05.089387] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-10T20:44:05.889348] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-10T20:44:06.063089] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T20:44:06.253684] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T20:44:06.689353] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-10T20:44:07.489392] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-10T20:44:07.694086] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-10T20:44:08.090244] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-10T20:44:08.289408] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-10T20:44:09.089351] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-10T20:44:09.209982] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-10T20:44:09.380577] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-10T20:44:09.889349] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-10T20:44:10.689398] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-10T20:44:10.845510] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T20:44:11.075211] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-10T20:44:11.489380] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-10T20:44:12.004061] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-10T20:44:12.289393] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-10T20:44:12.363862] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T20:44:13.089386] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-10T20:44:13.184131] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-10T20:44:13.188591] [INFO ] [REMOTE ] OMC: Full fetch complete (76607 records). [2025-10-10T20:44:13.188736] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-10T20:44:13.189367] [FATAL] [VALIDATOR ] OMC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:44:13.189447] [FATAL] [MAIN ] OMC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:44:13.189496] [WARN ] [MAIN ] OMC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:44:13.189583] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-10T20:44:13.189688] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-10T20:44:13.189757] [INFO ] [LOCAL ] OMC: Starting deletion of derivative data. [2025-10-10T20:44:13.189846] [DEBUG] [LOCAL ] OMC: No derivative data file found to delete. [2025-10-10T20:44:13.189925] [INFO ] [MAIN ] Update Progress: 1593/2373 symbols completed. OMC took 34.4s. Estimated remaining: 1h 49m 45s. Rate: 7.1 symbols/min [2025-10-10T20:44:13.355756] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:44:13.355936] [DEBUG] [LOCAL ] ONL: No existing data file found in primary storage. [2025-10-10T20:44:13.355979] [WARN ] [MAIN ] ONL: No existing data found, performing full refresh instead. [2025-10-10T20:44:13.356087] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-10T20:44:13.356150] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-10T20:44:13.356224] [DEBUG] [LOCAL ] ONL: No primary data file found to delete. [2025-10-10T20:44:13.356269] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-10T20:44:13.704893] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:44:13.889375] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-10-10T20:44:14.074750] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-10T20:44:14.689373] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-10T20:44:15.467815] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-10T20:44:15.479808] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-10T20:44:15.489329] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-10T20:44:16.289354] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-10T20:44:16.499780] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-10T20:44:17.089380] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-10T20:44:17.847424] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T20:44:17.848568] [INFO ] [REMOTE ] ONIT: Full fetch complete (11104 records). [2025-10-10T20:44:17.848695] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-10T20:44:17.894534] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-10T20:44:18.209408] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-10-10T20:44:18.209489] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-10-10T20:44:18.209794] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-10-10T20:44:18.209857] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-10-10T20:44:18.210274] [DEBUG] [LOCAL ] ONIT: Trimmed 11104 records to 7690 (keeping 200 days of data) [2025-10-10T20:44:18.257798] [DEBUG] [LOCAL ] ONIT: Primary data saved (7690 records). [2025-10-10T20:44:18.258104] [INFO ] [MAIN ] ONIT: Full history saved. [2025-10-10T20:44:18.258204] [INFO ] [MAIN ] Update Progress: 1594/2373 symbols completed. ONIT took 20.3s. Estimated remaining: 1h 49m 35s. Rate: 7.1 symbols/min [2025-10-10T20:44:18.364401] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-10T20:44:18.466062] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:44:18.466255] [DEBUG] [LOCAL ] ONON: No existing data file found in primary storage. [2025-10-10T20:44:18.466294] [WARN ] [MAIN ] ONON: No existing data found, performing full refresh instead. [2025-10-10T20:44:18.466416] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-10T20:44:18.466457] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-10T20:44:18.466498] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-10T20:44:18.466532] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-10T20:44:18.699380] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-10T20:44:18.817173] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:44:19.489377] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-10T20:44:19.894198] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-10T20:44:20.289372] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-10T20:44:20.514396] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T20:44:21.082191] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T20:44:21.089328] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-10T20:44:21.889411] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-10T20:44:22.180500] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T20:44:22.271220] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-10T20:44:22.689374] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-10-10T20:44:23.299129] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-10T20:44:23.489376] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-10T20:44:24.289359] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-10T20:44:24.958302] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-10T20:44:25.089369] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-10T20:44:25.379557] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T20:44:25.889411] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-10T20:44:26.168975] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T20:44:26.689354] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-10T20:44:26.844108] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T20:44:27.489351] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-10T20:44:27.847906] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T20:44:28.289367] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-10T20:44:28.319235] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T20:44:28.323604] [INFO ] [REMOTE ] OMF: Full fetch complete (66857 records). [2025-10-10T20:44:28.323750] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-10T20:44:28.324815] [FATAL] [VALIDATOR ] OMF: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:44:28.325141] [FATAL] [MAIN ] OMF: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:44:28.325254] [WARN ] [MAIN ] OMF: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:44:28.325340] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-10T20:44:28.325430] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-10T20:44:28.325471] [INFO ] [LOCAL ] OMF: Starting deletion of derivative data. [2025-10-10T20:44:28.325512] [DEBUG] [LOCAL ] OMF: No derivative data file found to delete. [2025-10-10T20:44:28.325608] [INFO ] [MAIN ] Update Progress: 1595/2373 symbols completed. OMF took 46.6s. Estimated remaining: 1h 49m 28s. Rate: 7.1 symbols/min [2025-10-10T20:44:28.501734] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:44:28.502137] [DEBUG] [LOCAL ] ONTF: No existing data file found in primary storage. [2025-10-10T20:44:28.502243] [WARN ] [MAIN ] ONTF: No existing data found, performing full refresh instead. [2025-10-10T20:44:28.502466] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-10T20:44:28.502528] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-10T20:44:28.502683] [DEBUG] [LOCAL ] ONTF: No primary data file found to delete. [2025-10-10T20:44:28.502740] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-10T20:44:28.637479] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T20:44:28.912991] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:44:29.094793] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-10-10T20:44:29.095945] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T20:44:29.101997] [INFO ] [REMOTE ] OMI: Full fetch complete (64651 records). [2025-10-10T20:44:29.102120] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-10T20:44:29.102752] [FATAL] [VALIDATOR ] OMI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:44:29.102853] [FATAL] [MAIN ] OMI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:44:29.102896] [WARN ] [MAIN ] OMI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:44:29.102961] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-10T20:44:29.103042] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-10T20:44:29.103099] [INFO ] [LOCAL ] OMI: Starting deletion of derivative data. [2025-10-10T20:44:29.103141] [DEBUG] [LOCAL ] OMI: No derivative data file found to delete. [2025-10-10T20:44:29.103199] [INFO ] [MAIN ] Update Progress: 1596/2373 symbols completed. OMI took 33.7s. Estimated remaining: 1h 49m 15s. Rate: 7.1 symbols/min [2025-10-10T20:44:29.272924] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:44:29.273112] [DEBUG] [LOCAL ] ONTO: No existing data file found in primary storage. [2025-10-10T20:44:29.273151] [WARN ] [MAIN ] ONTO: No existing data found, performing full refresh instead. [2025-10-10T20:44:29.273276] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-10T20:44:29.273318] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-10T20:44:29.273360] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-10T20:44:29.273393] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-10T20:44:29.639636] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:44:29.889407] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-10-10T20:44:30.604582] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-10T20:44:30.689375] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-10T20:44:31.489386] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-10T20:44:31.723380] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T20:44:31.952505] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-10T20:44:32.289405] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-10T20:44:33.089388] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-10T20:44:33.795741] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-10T20:44:33.889340] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-10T20:44:34.350460] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T20:44:34.689382] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-10T20:44:34.858582] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T20:44:35.361476] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-10T20:44:35.489414] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-10T20:44:35.713878] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T20:44:36.289410] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-10T20:44:37.089449] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-10T20:44:37.162431] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-10T20:44:37.889405] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-10T20:44:38.689460] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-10T20:44:38.767835] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-10T20:44:38.909376] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T20:44:39.489357] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-10T20:44:39.541553] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T20:44:40.007347] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T20:44:40.289389] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-10T20:44:41.089386] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-10T20:44:41.889402] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-10T20:44:41.932258] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-10T20:44:42.307760] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-10T20:44:42.367562] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-10T20:44:42.689377] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-10T20:44:43.424706] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-10T20:44:43.489382] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-10T20:44:44.289350] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-10T20:44:44.629203] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T20:44:45.089375] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-10T20:44:45.504502] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T20:44:45.623496] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-10T20:44:45.889377] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-10T20:44:46.689389] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-10T20:44:47.394883] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-10T20:44:47.489361] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-10T20:44:48.069545] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T20:44:48.289407] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-10T20:44:48.349661] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-10T20:44:49.089352] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-10T20:44:49.510956] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T20:44:49.630418] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T20:44:49.889397] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-10T20:44:50.689440] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-10T20:44:51.289160] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-10T20:44:51.495383] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-10T20:44:51.502204] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-10T20:44:51.882325] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-10T20:44:51.885936] [INFO ] [REMOTE ] ONL: Full fetch complete (42908 records). [2025-10-10T20:44:51.886107] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-10T20:44:52.275733] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-10T20:44:52.275833] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-10T20:44:52.276613] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-10T20:44:52.276713] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-10T20:44:52.277748] [DEBUG] [LOCAL ] ONL: Trimmed 42908 records to 30363 (keeping 200 days of data) [2025-10-10T20:44:52.325752] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-10T20:44:52.454908] [DEBUG] [LOCAL ] ONL: Primary data saved (30363 records). [2025-10-10T20:44:52.455050] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-10T20:44:52.455147] [INFO ] [MAIN ] Update Progress: 1597/2373 symbols completed. ONL took 39.3s. Estimated remaining: 1h 49m 14s. Rate: 7.1 symbols/min [2025-10-10T20:44:53.089403] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-10T20:44:53.669546] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T20:44:53.752991] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-10T20:44:53.889333] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-10T20:44:54.689406] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-10T20:44:55.216224] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T20:44:55.456812] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-10T20:44:55.489335] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-10T20:44:56.289403] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-10T20:44:56.390266] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T20:44:56.394989] [INFO ] [REMOTE ] ONON: Full fetch complete (77208 records). [2025-10-10T20:44:56.395116] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-10T20:44:56.395903] [FATAL] [VALIDATOR ] ONON: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:44:56.395988] [FATAL] [MAIN ] ONON: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:44:56.396030] [WARN ] [MAIN ] ONON: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:44:56.396097] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-10T20:44:56.396208] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-10T20:44:56.396260] [INFO ] [LOCAL ] ONON: Starting deletion of derivative data. [2025-10-10T20:44:56.396301] [DEBUG] [LOCAL ] ONON: No derivative data file found to delete. [2025-10-10T20:44:56.396358] [INFO ] [MAIN ] Update Progress: 1598/2373 symbols completed. ONON took 38.1s. Estimated remaining: 1h 49m 4s. Rate: 7.1 symbols/min [2025-10-10T20:44:56.764842] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T20:44:57.089425] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-10T20:44:57.664148] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-10T20:44:57.889489] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-10T20:44:59.078194] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-10T20:44:59.081015] [INFO ] [REMOTE ] ONTF: Full fetch complete (31432 records). [2025-10-10T20:44:59.081116] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-10T20:44:59.405869] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-10T20:44:59.454776] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-10T20:44:59.555595] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-10T20:44:59.555775] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-10T20:44:59.556599] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-10T20:44:59.556686] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-10T20:44:59.557529] [DEBUG] [LOCAL ] ONTF: Trimmed 31432 records to 22763 (keeping 200 days of data) [2025-10-10T20:44:59.685537] [DEBUG] [LOCAL ] ONTF: Primary data saved (22763 records). [2025-10-10T20:44:59.685688] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-10T20:44:59.685786] [INFO ] [MAIN ] Update Progress: 1599/2373 symbols completed. ONTF took 31.4s. Estimated remaining: 1h 48m 53s. Rate: 7.1 symbols/min [2025-10-10T20:45:00.280626] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T20:45:00.284713] [INFO ] [REMOTE ] ONTO: Full fetch complete (66153 records). [2025-10-10T20:45:00.284833] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-10T20:45:00.285422] [FATAL] [VALIDATOR ] ONTO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:45:00.285547] [FATAL] [MAIN ] ONTO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:45:00.285589] [WARN ] [MAIN ] ONTO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:45:00.285626] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-10T20:45:00.285735] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-10T20:45:00.285791] [INFO ] [LOCAL ] ONTO: Starting deletion of derivative data. [2025-10-10T20:45:00.285833] [DEBUG] [LOCAL ] ONTO: No derivative data file found to delete. [2025-10-10T20:45:00.285891] [INFO ] [MAIN ] Update Progress: 1600/2373 symbols completed. ONTO took 31.2s. Estimated remaining: 1h 48m 40s. Rate: 7.1 symbols/min [2025-10-10T20:45:00.927491] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:45:00.952425] [DEBUG] [LOCAL ] OOMA: No existing data file found in primary storage. [2025-10-10T20:45:01.006845] [WARN ] [MAIN ] OOMA: No existing data found, performing full refresh instead. [2025-10-10T20:45:01.039015] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-10T20:45:01.038777] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:45:01.009471] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:45:01.062508] [DEBUG] [LOCAL ] OPP: No existing data file found in primary storage. [2025-10-10T20:45:01.060014] [DEBUG] [LOCAL ] OPAD: No existing data file found in primary storage. [2025-10-10T20:45:01.063050] [WARN ] [MAIN ] OPAD: No existing data found, performing full refresh instead. [2025-10-10T20:45:01.063209] [WARN ] [MAIN ] OPP: No existing data found, performing full refresh instead. [2025-10-10T20:45:01.062300] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:45:01.059802] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-10T20:45:01.063446] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-10T20:45:01.064129] [DEBUG] [LOCAL ] OPFI: No existing data file found in primary storage. [2025-10-10T20:45:01.064241] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-10T20:45:01.064470] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-10T20:45:01.064374] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-10T20:45:01.064905] [DEBUG] [LOCAL ] OPAD: No primary data file found to delete. [2025-10-10T20:45:01.064724] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-10T20:45:01.065292] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-10T20:45:01.065398] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-10T20:45:01.065187] [WARN ] [MAIN ] OPFI: No existing data found, performing full refresh instead. [2025-10-10T20:45:01.100501] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-10T20:45:01.083461] [DEBUG] [LOCAL ] OPP: No primary data file found to delete. [2025-10-10T20:45:01.146502] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-10T20:45:01.146691] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-10T20:45:01.214977] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-10T20:45:01.240525] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-10T20:45:02.557541] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:45:02.619896] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-10-10T20:45:02.700632] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:45:02.770113] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:45:02.737562] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-10-10T20:45:02.766782] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:45:02.771853] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-10-10T20:45:02.770747] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-10-10T20:45:03.957448] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T20:45:03.959732] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-10T20:45:04.166946] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T20:45:04.171262] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-10T20:45:04.384108] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T20:45:04.388786] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-10T20:45:04.481590] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-10T20:45:04.821637] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T20:45:04.836933] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-10T20:45:05.089353] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-10T20:45:05.616174] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-10T20:45:05.889366] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-10T20:45:06.129878] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-10T20:45:06.689381] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-10T20:45:06.773738] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-10T20:45:07.489431] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-10T20:45:08.289362] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-10T20:45:08.552101] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-10T20:45:08.946808] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-10T20:45:09.089346] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-10T20:45:09.609879] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T20:45:09.889385] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-10T20:45:10.152966] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-10T20:45:10.689368] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-10T20:45:11.198392] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T20:45:11.489371] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-10T20:45:11.507291] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-10T20:45:12.289410] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-10T20:45:12.794173] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T20:45:13.089369] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-10T20:45:13.889359] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-10T20:45:14.256345] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-10T20:45:14.379077] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-10T20:45:14.689370] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-10T20:45:15.020135] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T20:45:15.489357] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-10T20:45:15.526868] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-10T20:45:16.289360] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-10T20:45:16.902942] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-10T20:45:17.089443] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-10T20:45:17.113821] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-10T20:45:17.889383] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-10T20:45:18.067162] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-10T20:45:18.689367] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-10T20:45:18.865810] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-10T20:45:19.479808] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-10T20:45:19.489336] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-10T20:45:20.289390] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-10T20:45:20.777065] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T20:45:21.089348] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-10T20:45:21.232756] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-10T20:45:21.889394] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-10T20:45:22.689378] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-10T20:45:22.958175] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-10T20:45:23.108611] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-10T20:45:23.489447] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-10T20:45:24.289400] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-10T20:45:24.405251] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T20:45:24.567822] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T20:45:25.089375] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-10T20:45:25.889431] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-10T20:45:26.152540] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-10T20:45:26.183477] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-10T20:45:26.689396] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-10T20:45:27.489351] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-10T20:45:27.676337] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T20:45:27.724118] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-10T20:45:27.726242] [INFO ] [REMOTE ] OPP: Full fetch complete (17687 records). [2025-10-10T20:45:27.726327] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-10T20:45:28.082159] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-10T20:45:28.082235] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-10T20:45:28.082623] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-10T20:45:28.082696] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-10T20:45:28.083202] [DEBUG] [LOCAL ] OPP: Trimmed 17687 records to 12307 (keeping 200 days of data) [2025-10-10T20:45:28.153751] [DEBUG] [LOCAL ] OPP: Primary data saved (12307 records). [2025-10-10T20:45:28.153873] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-10T20:45:28.153942] [INFO ] [MAIN ] Update Progress: 1601/2373 symbols completed. OPP took 27.9s. Estimated remaining: 1h 48m 41s. Rate: 7.1 symbols/min [2025-10-10T20:45:28.320950] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:45:28.296554] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-10T20:45:28.321295] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-10T20:45:28.321938] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-10T20:45:28.322051] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-10T20:45:28.322092] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-10T20:45:28.322135] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-10T20:45:28.322166] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-10T20:45:28.671435] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:45:29.069691] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T20:45:29.071430] [INFO ] [REMOTE ] OOMA: Full fetch complete (25592 records). [2025-10-10T20:45:29.071498] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-10T20:45:29.071966] [FATAL] [VALIDATOR ] OOMA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:45:29.072073] [FATAL] [MAIN ] OOMA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:45:29.072116] [WARN ] [MAIN ] OOMA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:45:29.072154] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-10T20:45:29.072207] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-10T20:45:29.072242] [INFO ] [LOCAL ] OOMA: Starting deletion of derivative data. [2025-10-10T20:45:29.072289] [DEBUG] [LOCAL ] OOMA: No derivative data file found to delete. [2025-10-10T20:45:29.072339] [INFO ] [MAIN ] Update Progress: 1602/2373 symbols completed. OOMA took 28.8s. Estimated remaining: 1h 48m 29s. Rate: 7.1 symbols/min [2025-10-10T20:45:29.094527] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-10-10T20:45:29.256864] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:45:29.257282] [DEBUG] [LOCAL ] OR: No existing data file found in primary storage. [2025-10-10T20:45:29.257482] [WARN ] [MAIN ] OR: No existing data found, performing full refresh instead. [2025-10-10T20:45:29.257746] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-10T20:45:29.257815] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-10T20:45:29.257877] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-10T20:45:29.257997] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-10T20:45:29.617912] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:45:29.634293] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-10T20:45:29.889392] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-10-10T20:45:30.483031] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T20:45:30.689472] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-10T20:45:31.489409] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-10T20:45:31.668425] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-10T20:45:32.289430] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-10T20:45:32.882449] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-10T20:45:33.089353] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-10T20:45:33.167676] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-10T20:45:33.889354] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-10T20:45:34.115668] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-10T20:45:34.689346] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-10T20:45:34.748366] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-10T20:45:35.123004] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-10T20:45:35.489364] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-10T20:45:36.289458] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-10T20:45:36.894954] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-10T20:45:36.900277] [INFO ] [REMOTE ] OPAD: Full fetch complete (26896 records). [2025-10-10T20:45:36.900394] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-10T20:45:37.115135] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-10T20:45:37.273390] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-10T20:45:37.273502] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-10T20:45:37.274270] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-10T20:45:37.274330] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-10T20:45:37.275038] [DEBUG] [LOCAL ] OPAD: Trimmed 26896 records to 24192 (keeping 200 days of data) [2025-10-10T20:45:37.410349] [DEBUG] [LOCAL ] OPAD: Primary data saved (24192 records). [2025-10-10T20:45:37.410467] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-10T20:45:37.410550] [INFO ] [MAIN ] Update Progress: 1603/2373 symbols completed. OPAD took 37.1s. Estimated remaining: 1h 48m 21s. Rate: 7.1 symbols/min [2025-10-10T20:45:37.583246] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:45:37.598397] [DEBUG] [LOCAL ] ORA: No existing data file found in primary storage. [2025-10-10T20:45:37.605875] [WARN ] [MAIN ] ORA: No existing data found, performing full refresh instead. [2025-10-10T20:45:37.606061] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-10T20:45:37.609123] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-10T20:45:37.611180] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-10T20:45:37.611052] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-10T20:45:37.611399] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-10T20:45:37.817095] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-10T20:45:37.895325] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-10T20:45:38.014346] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:45:38.026591] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-10T20:45:38.689378] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-10T20:45:39.489438] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-10T20:45:39.776173] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-10T20:45:40.048629] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-10T20:45:40.289346] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-10T20:45:41.089406] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-10T20:45:41.337342] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-10T20:45:41.364772] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T20:45:41.603239] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-10T20:45:41.607426] [INFO ] [REMOTE ] OPFI: Full fetch complete (67973 records). [2025-10-10T20:45:41.607583] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-10T20:45:41.608410] [FATAL] [VALIDATOR ] OPFI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:45:41.608499] [FATAL] [MAIN ] OPFI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:45:41.608544] [WARN ] [MAIN ] OPFI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:45:41.608608] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-10T20:45:41.608703] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-10T20:45:41.608756] [INFO ] [LOCAL ] OPFI: Starting deletion of derivative data. [2025-10-10T20:45:41.608799] [DEBUG] [LOCAL ] OPFI: No derivative data file found to delete. [2025-10-10T20:45:41.608858] [INFO ] [MAIN ] Update Progress: 1604/2373 symbols completed. OPFI took 41.3s. Estimated remaining: 1h 48m 10s. Rate: 7.1 symbols/min [2025-10-10T20:45:41.797551] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:45:41.797824] [DEBUG] [LOCAL ] ORC: No existing data file found in primary storage. [2025-10-10T20:45:41.797874] [WARN ] [MAIN ] ORC: No existing data found, performing full refresh instead. [2025-10-10T20:45:41.797949] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-10T20:45:41.797985] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-10T20:45:41.798024] [DEBUG] [LOCAL ] ORC: No primary data file found to delete. [2025-10-10T20:45:41.798054] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-10T20:45:41.895364] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-10T20:45:42.147111] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:45:42.689364] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-10T20:45:43.030143] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-10T20:45:43.489372] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-10-10T20:45:44.289367] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-10T20:45:44.553676] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T20:45:45.089422] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-10T20:45:45.299959] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-10T20:45:45.865274] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-10T20:45:45.889326] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-10T20:45:46.689335] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-10-10T20:45:47.159592] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T20:45:47.489390] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-10T20:45:48.092147] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-10T20:45:48.289329] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-10T20:45:48.523503] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T20:45:49.089410] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-10T20:45:49.466164] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T20:45:49.889412] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-10T20:45:50.049300] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-10T20:45:50.477185] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-10T20:45:50.689453] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-10T20:45:51.489371] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-10T20:45:51.825938] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T20:45:52.289394] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-10T20:45:52.362595] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-10T20:45:52.520319] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-10T20:45:53.089382] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-10T20:45:53.889376] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-10T20:45:53.928110] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T20:45:54.689396] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-10T20:45:54.977434] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T20:45:54.978738] [INFO ] [REMOTE ] OPY: Full fetch complete (10109 records). [2025-10-10T20:45:54.978840] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-10T20:45:55.152902] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T20:45:55.193747] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T20:45:55.194380] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:45:55.194770] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:45:55.194846] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-10T20:45:55.194912] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-10T20:45:55.194949] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-10T20:45:55.194990] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-10T20:45:55.195045] [INFO ] [MAIN ] Update Progress: 1605/2373 symbols completed. OPY took 27.0s. Estimated remaining: 1h 48m 4s. Rate: 7.1 symbols/min [2025-10-10T20:45:55.361153] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:45:55.361352] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-10T20:45:55.361390] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-10T20:45:55.361526] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-10T20:45:55.361589] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-10T20:45:55.361636] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-10T20:45:55.361712] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-10T20:45:55.496519] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-10T20:45:55.714072] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:45:56.289359] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-10T20:45:56.618424] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T20:45:57.089357] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-10T20:45:57.265790] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T20:45:57.889378] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-10T20:45:58.315412] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T20:45:58.689382] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-10T20:45:59.092770] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-10T20:45:59.489366] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-10T20:45:59.647074] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T20:46:00.289414] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-10-10T20:46:00.399407] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T20:46:00.403764] [INFO ] [REMOTE ] OR: Full fetch complete (65525 records). [2025-10-10T20:46:00.403888] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-10T20:46:00.404610] [FATAL] [VALIDATOR ] OR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:46:00.404720] [FATAL] [MAIN ] OR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:46:00.404764] [WARN ] [MAIN ] OR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:46:00.404804] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-10T20:46:00.404860] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-10T20:46:00.404897] [INFO ] [LOCAL ] OR: Starting deletion of derivative data. [2025-10-10T20:46:00.404937] [DEBUG] [LOCAL ] OR: No derivative data file found to delete. [2025-10-10T20:46:00.405044] [INFO ] [MAIN ] Update Progress: 1606/2373 symbols completed. OR took 31.3s. Estimated remaining: 1h 47m 54s. Rate: 7.1 symbols/min [2025-10-10T20:46:00.583145] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:46:00.583321] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-10T20:46:00.583404] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-10T20:46:00.583490] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-10T20:46:00.583529] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-10T20:46:00.583570] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-10T20:46:00.583602] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-10T20:46:00.959529] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:46:01.089359] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-10T20:46:01.206225] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-10T20:46:01.889371] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-10T20:46:02.512799] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-10T20:46:02.689427] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-10T20:46:03.302070] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (3.01 seconds). [2025-10-10T20:46:03.489371] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-10T20:46:04.292038] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-10-10T20:46:04.304171] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-10T20:46:04.405453] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T20:46:05.089385] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-10T20:46:05.889382] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-10T20:46:06.267193] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T20:46:06.333943] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.84 seconds). [2025-10-10T20:46:06.689376] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-10T20:46:07.489421] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-10T20:46:07.586833] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-10T20:46:07.658031] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T20:46:08.289404] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-10T20:46:09.089443] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-10T20:46:09.474267] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.78 seconds). [2025-10-10T20:46:09.510159] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T20:46:09.889383] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-10T20:46:10.001939] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T20:46:10.689348] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-10T20:46:10.945709] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T20:46:11.489381] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-10T20:46:11.742592] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T20:46:12.289375] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-10T20:46:13.089504] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-10T20:46:13.586309] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-10-10T20:46:13.883033] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-10T20:46:13.893242] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-10T20:46:14.355434] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-10T20:46:14.394702] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-10T20:46:14.689404] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-10T20:46:15.489427] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-10T20:46:16.289388] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-10T20:46:16.688373] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T20:46:16.761767] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-10-10T20:46:17.089373] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-10T20:46:17.550121] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-10T20:46:17.555194] [INFO ] [REMOTE ] ORC: Full fetch complete (75408 records). [2025-10-10T20:46:17.555352] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-10T20:46:17.894591] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-10T20:46:17.996928] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-10-10T20:46:17.997155] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-10-10T20:46:17.998302] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-10-10T20:46:17.998388] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-10-10T20:46:17.999963] [DEBUG] [LOCAL ] ORC: Trimmed 75408 records to 53224 (keeping 200 days of data) [2025-10-10T20:46:18.107448] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T20:46:18.335964] [DEBUG] [LOCAL ] ORC: Primary data saved (53224 records). [2025-10-10T20:46:18.336116] [INFO ] [MAIN ] ORC: Full history saved. [2025-10-10T20:46:18.336205] [INFO ] [MAIN ] Update Progress: 1607/2373 symbols completed. ORC took 36.7s. Estimated remaining: 1h 47m 50s. Rate: 7.1 symbols/min [2025-10-10T20:46:18.498676] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:46:18.498847] [DEBUG] [LOCAL ] ORN: No existing data file found in primary storage. [2025-10-10T20:46:18.498885] [WARN ] [MAIN ] ORN: No existing data found, performing full refresh instead. [2025-10-10T20:46:18.498997] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-10T20:46:18.499038] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-10T20:46:18.499080] [DEBUG] [LOCAL ] ORN: No primary data file found to delete. [2025-10-10T20:46:18.499114] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-10T20:46:18.700371] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-10T20:46:18.851100] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:46:19.054282] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T20:46:19.489372] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-10T20:46:19.555343] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T20:46:19.561890] [INFO ] [REMOTE ] ORA: Full fetch complete (48692 records). [2025-10-10T20:46:19.562094] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-10T20:46:19.562767] [FATAL] [VALIDATOR ] ORA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:46:19.562855] [FATAL] [MAIN ] ORA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:46:19.562963] [WARN ] [MAIN ] ORA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:46:19.563023] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-10T20:46:19.563099] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-10T20:46:19.563158] [INFO ] [LOCAL ] ORA: Starting deletion of derivative data. [2025-10-10T20:46:19.563254] [DEBUG] [LOCAL ] ORA: No derivative data file found to delete. [2025-10-10T20:46:19.563332] [INFO ] [MAIN ] Update Progress: 1608/2373 symbols completed. ORA took 42.2s. Estimated remaining: 1h 47m 39s. Rate: 7.1 symbols/min [2025-10-10T20:46:19.742091] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:46:19.742395] [DEBUG] [LOCAL ] OSCR: No existing data file found in primary storage. [2025-10-10T20:46:19.742528] [WARN ] [MAIN ] OSCR: No existing data found, performing full refresh instead. [2025-10-10T20:46:19.742665] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-10T20:46:19.742722] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-10T20:46:19.742767] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-10T20:46:19.742800] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-10T20:46:20.124259] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:46:20.126278] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-10T20:46:20.289371] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-10-10T20:46:21.089397] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-10T20:46:21.889418] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-10-10T20:46:22.356301] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.87 seconds). [2025-10-10T20:46:22.454373] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T20:46:22.580819] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T20:46:22.689372] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-10T20:46:22.880748] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-10T20:46:23.489393] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-10T20:46:24.289384] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-10T20:46:24.915617] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-10T20:46:25.089380] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-10T20:46:25.860669] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-10T20:46:25.889333] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-10T20:46:26.689412] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-10T20:46:26.730778] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (3.24 seconds). [2025-10-10T20:46:27.329951] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-10T20:46:27.489420] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-10T20:46:27.495258] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-10T20:46:28.289417] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-10T20:46:28.803580] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T20:46:28.873869] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-10T20:46:29.089377] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-10T20:46:29.889420] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-10T20:46:30.689348] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-10T20:46:30.742790] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T20:46:31.390783] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-10T20:46:31.417971] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (3.13 seconds). [2025-10-10T20:46:31.489404] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-10T20:46:32.289428] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-10T20:46:32.948432] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-10T20:46:33.035178] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-10T20:46:33.089376] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-10T20:46:33.889363] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-10T20:46:34.156282] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T20:46:34.453465] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-10T20:46:34.689385] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-10T20:46:35.489419] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-10T20:46:36.289401] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-10T20:46:36.336058] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T20:46:36.388864] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T20:46:36.393004] [INFO ] [REMOTE ] ORI: Full fetch complete (69829 records). [2025-10-10T20:46:36.393127] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-10T20:46:36.393907] [FATAL] [VALIDATOR ] ORI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:46:36.394154] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:46:36.394245] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:46:36.394321] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-10T20:46:36.394388] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-10T20:46:36.394425] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-10T20:46:36.394466] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-10T20:46:36.394525] [INFO ] [MAIN ] Update Progress: 1609/2373 symbols completed. ORI took 36.0s. Estimated remaining: 1h 47m 34s. Rate: 7.1 symbols/min [2025-10-10T20:46:36.561830] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:46:36.561985] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-10T20:46:36.562022] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-10T20:46:36.562130] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-10T20:46:36.562171] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-10T20:46:36.562211] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-10T20:46:36.562243] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-10T20:46:36.952112] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:46:36.982408] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (3.09 seconds). [2025-10-10T20:46:37.089391] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-10T20:46:37.889346] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-10-10T20:46:38.588820] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-10T20:46:38.698040] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-10T20:46:38.702189] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-10T20:46:39.489349] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-10T20:46:39.668052] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-10T20:46:39.672853] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-10-10T20:46:39.672980] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-10T20:46:39.673635] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:46:39.673744] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:46:39.673786] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:46:39.673824] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-10T20:46:39.673878] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-10T20:46:39.673923] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-10T20:46:39.674013] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-10T20:46:39.674120] [INFO ] [MAIN ] Update Progress: 1610/2373 symbols completed. ORCL took 44.5s. Estimated remaining: 1h 47m 23s. Rate: 7.1 symbols/min [2025-10-10T20:46:39.883213] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:46:39.885761] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T20:46:39.884078] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-10T20:46:39.894853] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-10T20:46:39.895543] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-10T20:46:39.895586] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-10T20:46:39.895629] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-10T20:46:39.895703] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-10T20:46:40.271682] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:46:40.289353] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-10-10T20:46:40.609597] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:46:40.609966] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-10-10T20:46:40.610057] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:46:40.610104] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-10T20:46:40.610164] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:46:40.610234] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-10T20:46:40.610299] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-10T20:46:40.610333] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-10T20:46:40.610372] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-10T20:46:40.610418] [INFO ] [MAIN ] Update Progress: 1611/2373 symbols completed. OTF took 0.9s. Estimated remaining: 1h 47m 11s. Rate: 7.1 symbols/min [2025-10-10T20:46:40.778364] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:46:40.778563] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-10-10T20:46:40.778623] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-10-10T20:46:40.778858] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-10T20:46:40.778924] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-10T20:46:40.778990] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-10T20:46:40.779043] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-10T20:46:41.094614] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-10T20:46:41.175207] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:46:41.889370] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-10T20:46:41.937026] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-10T20:46:42.689376] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-10T20:46:43.069033] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T20:46:43.489408] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-10T20:46:43.851768] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T20:46:44.289371] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-10T20:46:45.089346] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-10-10T20:46:45.310324] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T20:46:45.349696] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-10T20:46:45.625283] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T20:46:45.628194] [INFO ] [REMOTE ] ORN: Full fetch complete (45270 records). [2025-10-10T20:46:45.628274] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-10T20:46:45.895085] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-10T20:46:46.012112] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-10T20:46:46.012190] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-10T20:46:46.012943] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-10T20:46:46.013003] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-10T20:46:46.014033] [DEBUG] [LOCAL ] ORN: Trimmed 45270 records to 31322 (keeping 200 days of data) [2025-10-10T20:46:46.188701] [DEBUG] [LOCAL ] ORN: Primary data saved (31322 records). [2025-10-10T20:46:46.188833] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-10T20:46:46.188905] [INFO ] [MAIN ] Update Progress: 1612/2373 symbols completed. ORN took 27.9s. Estimated remaining: 1h 47m 1s. Rate: 7.1 symbols/min [2025-10-10T20:46:46.356123] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:46:46.356278] [DEBUG] [LOCAL ] OUT: No existing data file found in primary storage. [2025-10-10T20:46:46.356316] [WARN ] [MAIN ] OUT: No existing data found, performing full refresh instead. [2025-10-10T20:46:46.356427] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-10T20:46:46.356467] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-10T20:46:46.356508] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-10T20:46:46.356540] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-10T20:46:46.694884] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-10T20:46:46.718847] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:46:47.061856] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T20:46:47.489369] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-10-10T20:46:48.289379] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-10T20:46:48.588869] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T20:46:49.094435] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-10T20:46:49.111556] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (3.22 seconds). [2025-10-10T20:46:49.210943] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T20:46:49.889387] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-10T20:46:50.350037] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T20:46:50.556377] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-10T20:46:50.689343] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-10T20:46:51.489447] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-10T20:46:52.289438] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-10T20:46:52.596234] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T20:46:52.772371] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-10-10T20:46:52.823208] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T20:46:53.089372] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-10T20:46:53.889392] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-10T20:46:54.269528] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-10T20:46:54.689422] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-10T20:46:54.915523] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T20:46:55.489381] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-10T20:46:55.715478] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T20:46:56.289403] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-10T20:46:57.089386] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-10T20:46:57.441299] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-10T20:46:57.519427] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-10T20:46:57.889345] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-10T20:46:58.462959] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-10T20:46:58.689368] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-10T20:46:59.085428] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T20:46:59.489386] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-10T20:46:59.753307] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T20:47:00.295636] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-10T20:47:00.332875] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T20:47:01.023016] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T20:47:01.089346] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-10T20:47:01.195966] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T20:47:01.200449] [INFO ] [REMOTE ] OSCR: Full fetch complete (77144 records). [2025-10-10T20:47:01.200567] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-10T20:47:01.201500] [FATAL] [VALIDATOR ] OSCR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:47:01.201590] [FATAL] [MAIN ] OSCR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:47:01.201634] [WARN ] [MAIN ] OSCR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:47:01.201758] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-10T20:47:01.201836] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-10T20:47:01.201872] [INFO ] [LOCAL ] OSCR: Starting deletion of derivative data. [2025-10-10T20:47:01.201910] [DEBUG] [LOCAL ] OSCR: No derivative data file found to delete. [2025-10-10T20:47:01.201968] [INFO ] [MAIN ] Update Progress: 1613/2373 symbols completed. OSCR took 41.6s. Estimated remaining: 1h 46m 56s. Rate: 7.1 symbols/min [2025-10-10T20:47:01.371123] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:47:01.371311] [DEBUG] [LOCAL ] OVV: No existing data file found in primary storage. [2025-10-10T20:47:01.371347] [WARN ] [MAIN ] OVV: No existing data found, performing full refresh instead. [2025-10-10T20:47:01.371467] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-10T20:47:01.371507] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-10T20:47:01.371548] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-10T20:47:01.371580] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-10T20:47:01.726129] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:47:01.889373] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-10-10T20:47:02.689346] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-10T20:47:03.167977] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-10T20:47:03.489383] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-10T20:47:04.072111] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-10T20:47:04.289439] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-10T20:47:04.526094] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T20:47:05.089364] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-10T20:47:05.802764] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-10T20:47:05.850400] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-10T20:47:05.889327] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-10T20:47:06.067060] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T20:47:06.070829] [INFO ] [REMOTE ] OSK: Full fetch complete (60936 records). [2025-10-10T20:47:06.070939] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-10T20:47:06.071519] [FATAL] [VALIDATOR ] OSK: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:47:06.071605] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:47:06.071678] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:47:06.071738] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-10T20:47:06.071796] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-10T20:47:06.071830] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-10T20:47:06.071868] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-10T20:47:06.071923] [INFO ] [MAIN ] Update Progress: 1614/2373 symbols completed. OSK took 29.7s. Estimated remaining: 1h 46m 46s. Rate: 7.1 symbols/min [2025-10-10T20:47:06.235252] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:47:06.235425] [DEBUG] [LOCAL ] OWL: No existing data file found in primary storage. [2025-10-10T20:47:06.235509] [WARN ] [MAIN ] OWL: No existing data found, performing full refresh instead. [2025-10-10T20:47:06.235625] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-10T20:47:06.235698] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-10T20:47:06.235751] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-10T20:47:06.235785] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-10T20:47:06.583674] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:47:06.689395] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-10T20:47:07.489456] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-10T20:47:07.927026] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-10T20:47:08.294815] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-10T20:47:08.301264] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-10T20:47:09.089348] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-10-10T20:47:09.444941] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T20:47:09.889336] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-10T20:47:10.269500] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T20:47:10.689350] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-10T20:47:11.307210] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-10T20:47:11.489355] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-10T20:47:12.290063] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-10T20:47:12.307909] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T20:47:12.647974] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-10T20:47:13.089370] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-10T20:47:13.798215] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-10T20:47:13.889351] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-10T20:47:14.276905] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-10T20:47:14.689444] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-10T20:47:15.117390] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-10T20:47:15.122208] [INFO ] [REMOTE ] OUT: Full fetch complete (68575 records). [2025-10-10T20:47:15.122451] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-10T20:47:15.123605] [FATAL] [VALIDATOR ] OUT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:47:15.123736] [FATAL] [MAIN ] OUT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:47:15.123806] [WARN ] [MAIN ] OUT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:47:15.123892] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-10T20:47:15.123977] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-10T20:47:15.124029] [INFO ] [LOCAL ] OUT: Starting deletion of derivative data. [2025-10-10T20:47:15.124096] [DEBUG] [LOCAL ] OUT: No derivative data file found to delete. [2025-10-10T20:47:15.124173] [INFO ] [MAIN ] Update Progress: 1615/2373 symbols completed. OUT took 28.9s. Estimated remaining: 1h 46m 38s. Rate: 7.1 symbols/min [2025-10-10T20:47:15.341435] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:47:15.341911] [DEBUG] [LOCAL ] OWLT: No existing data file found in primary storage. [2025-10-10T20:47:15.342069] [WARN ] [MAIN ] OWLT: No existing data found, performing full refresh instead. [2025-10-10T20:47:15.342400] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-10T20:47:15.342502] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-10T20:47:15.342622] [DEBUG] [LOCAL ] OWLT: No primary data file found to delete. [2025-10-10T20:47:15.344870] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-10T20:47:15.343142] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-10T20:47:15.502856] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-10T20:47:15.732705] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:47:15.982558] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-10T20:47:16.289373] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-10T20:47:17.089371] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-10-10T20:47:17.738497] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-10T20:47:17.795863] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-10T20:47:17.889376] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-10T20:47:18.431332] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-10T20:47:18.435681] [INFO ] [REMOTE ] OTIS: Full fetch complete (75570 records). [2025-10-10T20:47:18.435795] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-10T20:47:18.436426] [FATAL] [VALIDATOR ] OTIS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:47:18.436512] [FATAL] [MAIN ] OTIS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:47:18.436554] [WARN ] [MAIN ] OTIS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:47:18.436621] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-10T20:47:18.436723] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-10T20:47:18.436768] [INFO ] [LOCAL ] OTIS: Starting deletion of derivative data. [2025-10-10T20:47:18.436809] [DEBUG] [LOCAL ] OTIS: No derivative data file found to delete. [2025-10-10T20:47:18.437076] [INFO ] [MAIN ] Update Progress: 1616/2373 symbols completed. OTIS took 37.8s. Estimated remaining: 1h 46m 27s. Rate: 7.1 symbols/min [2025-10-10T20:47:18.587438] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-10T20:47:18.669745] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:47:18.670050] [DEBUG] [LOCAL ] OXM: No existing data file found in primary storage. [2025-10-10T20:47:18.670111] [WARN ] [MAIN ] OXM: No existing data found, performing full refresh instead. [2025-10-10T20:47:18.670326] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-10T20:47:18.670378] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-10T20:47:18.670422] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-10T20:47:18.670456] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-10T20:47:18.699298] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-10T20:47:19.033967] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:47:19.489399] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-10-10T20:47:20.289369] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-10T20:47:21.089444] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-10T20:47:21.177079] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-10T20:47:21.289217] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T20:47:21.848997] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-10T20:47:21.889372] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-10T20:47:22.294028] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T20:47:22.689377] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-10T20:47:23.489357] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-10T20:47:24.027060] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-10T20:47:24.055090] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T20:47:24.289400] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-10T20:47:25.089408] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-10T20:47:25.676517] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-10T20:47:25.731564] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-10T20:47:25.889381] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-10T20:47:26.661523] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-10T20:47:26.689366] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-10T20:47:27.288733] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-10T20:47:27.489380] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-10T20:47:27.632839] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-10T20:47:28.289377] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-10T20:47:29.089372] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-10T20:47:29.096977] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-10T20:47:29.580744] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-10T20:47:29.889374] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-10T20:47:30.689420] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-10T20:47:30.703852] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-10T20:47:31.201154] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-10T20:47:31.489405] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-10T20:47:32.289301] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-10T20:47:32.502527] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T20:47:33.089339] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-10T20:47:33.387767] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-10T20:47:33.660420] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T20:47:33.889371] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-10T20:47:34.689352] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-10T20:47:35.004567] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T20:47:35.489378] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-10T20:47:35.677444] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-10T20:47:35.940376] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-10T20:47:36.289382] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-10T20:47:36.617328] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T20:47:37.089376] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-10T20:47:37.889365] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-10T20:47:38.145913] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T20:47:38.689348] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-10T20:47:38.852146] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T20:47:38.953500] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-10T20:47:39.489398] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-10T20:47:40.289338] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-10T20:47:40.915323] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-10T20:47:41.089335] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-10T20:47:41.229016] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-10T20:47:41.399984] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-10T20:47:41.889430] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-10T20:47:42.051755] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T20:47:42.056151] [INFO ] [REMOTE ] OVV: Full fetch complete (76941 records). [2025-10-10T20:47:42.056267] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-10T20:47:42.057076] [FATAL] [VALIDATOR ] OVV: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:47:42.057185] [FATAL] [MAIN ] OVV: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:47:42.057253] [WARN ] [MAIN ] OVV: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:47:42.057324] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-10T20:47:42.057414] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-10T20:47:42.057468] [INFO ] [LOCAL ] OVV: Starting deletion of derivative data. [2025-10-10T20:47:42.057511] [DEBUG] [LOCAL ] OVV: No derivative data file found to delete. [2025-10-10T20:47:42.057568] [INFO ] [MAIN ] Update Progress: 1617/2373 symbols completed. OVV took 40.9s. Estimated remaining: 1h 46m 26s. Rate: 7.1 symbols/min [2025-10-10T20:47:42.220475] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:47:42.220685] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-10T20:47:42.220737] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-10T20:47:42.220846] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-10T20:47:42.220887] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-10T20:47:42.220929] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-10T20:47:42.220960] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-10T20:47:42.567729] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:47:42.689371] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-10-10T20:47:43.011444] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-10T20:47:43.013212] [INFO ] [REMOTE ] OWLT: Full fetch complete (11842 records). [2025-10-10T20:47:43.013287] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-10T20:47:43.381803] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-10T20:47:43.381908] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-10T20:47:43.382553] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-10T20:47:43.382664] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-10T20:47:43.383202] [DEBUG] [LOCAL ] OWLT: Trimmed 11842 records to 9274 (keeping 200 days of data) [2025-10-10T20:47:43.445528] [DEBUG] [LOCAL ] OWLT: Primary data saved (9274 records). [2025-10-10T20:47:43.445758] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-10T20:47:43.445864] [INFO ] [MAIN ] Update Progress: 1618/2373 symbols completed. OWLT took 28.3s. Estimated remaining: 1h 46m 14s. Rate: 7.1 symbols/min [2025-10-10T20:47:43.494610] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-10T20:47:43.626763] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:47:43.627049] [DEBUG] [LOCAL ] PAAS: No existing data file found in primary storage. [2025-10-10T20:47:43.627098] [WARN ] [MAIN ] PAAS: No existing data found, performing full refresh instead. [2025-10-10T20:47:43.627224] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-10T20:47:43.627265] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-10T20:47:43.627306] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-10T20:47:43.627340] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-10T20:47:43.997977] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:47:44.289412] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-10T20:47:45.089384] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-10-10T20:47:45.556546] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-10-10T20:47:45.648538] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-10T20:47:45.721877] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-10T20:47:45.889421] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-10T20:47:46.689477] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-10T20:47:46.724710] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-10T20:47:47.489395] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-10T20:47:48.289387] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-10T20:47:48.509513] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T20:47:48.710603] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.82 seconds). [2025-10-10T20:47:49.048359] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-10T20:47:49.089481] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-10T20:47:49.889383] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-10T20:47:50.039989] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T20:47:50.634087] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T20:47:50.637131] [INFO ] [REMOTE ] OXM: Full fetch complete (45887 records). [2025-10-10T20:47:50.637218] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-10T20:47:50.637765] [FATAL] [VALIDATOR ] OXM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:47:50.637848] [FATAL] [MAIN ] OXM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:47:50.637894] [WARN ] [MAIN ] OXM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:47:50.637966] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-10T20:47:50.638051] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-10T20:47:50.638090] [INFO ] [LOCAL ] OXM: Starting deletion of derivative data. [2025-10-10T20:47:50.638130] [DEBUG] [LOCAL ] OXM: No derivative data file found to delete. [2025-10-10T20:47:50.638236] [INFO ] [MAIN ] Update Progress: 1619/2373 symbols completed. OXM took 32.2s. Estimated remaining: 1h 46m 5s. Rate: 7.1 symbols/min [2025-10-10T20:47:50.700719] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-10T20:47:50.845129] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:47:50.845304] [DEBUG] [LOCAL ] PAC: No existing data file found in primary storage. [2025-10-10T20:47:50.845345] [WARN ] [MAIN ] PAC: No existing data found, performing full refresh instead. [2025-10-10T20:47:50.845457] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-10T20:47:50.845500] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-10T20:47:50.845543] [DEBUG] [LOCAL ] PAC: No primary data file found to delete. [2025-10-10T20:47:50.845576] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-10T20:47:51.201161] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:47:51.396967] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-10T20:47:51.489416] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-10T20:47:52.289475] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-10-10T20:47:53.089370] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-10T20:47:53.478252] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.78 seconds). [2025-10-10T20:47:53.548559] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T20:47:53.889407] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-10T20:47:53.933469] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-10T20:47:53.956297] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T20:47:53.960838] [INFO ] [REMOTE ] OWL: Full fetch complete (77142 records). [2025-10-10T20:47:53.960953] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-10T20:47:53.961571] [FATAL] [VALIDATOR ] OWL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:47:53.961679] [FATAL] [MAIN ] OWL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:47:53.961733] [WARN ] [MAIN ] OWL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:47:53.961801] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-10T20:47:53.961863] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-10T20:47:53.961899] [INFO ] [LOCAL ] OWL: Starting deletion of derivative data. [2025-10-10T20:47:53.961938] [DEBUG] [LOCAL ] OWL: No derivative data file found to delete. [2025-10-10T20:47:53.961994] [INFO ] [MAIN ] Update Progress: 1620/2373 symbols completed. OWL took 47.9s. Estimated remaining: 1h 45m 54s. Rate: 7.1 symbols/min [2025-10-10T20:47:54.127172] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:47:54.127345] [DEBUG] [LOCAL ] PACK: No existing data file found in primary storage. [2025-10-10T20:47:54.127383] [WARN ] [MAIN ] PACK: No existing data found, performing full refresh instead. [2025-10-10T20:47:54.127494] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-10T20:47:54.127537] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-10T20:47:54.127580] [DEBUG] [LOCAL ] PACK: No primary data file found to delete. [2025-10-10T20:47:54.127613] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-10T20:47:54.473195] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:47:54.689393] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-10-10T20:47:55.489408] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-10T20:47:56.022751] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T20:47:56.289754] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-10T20:47:56.538902] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-10T20:47:56.724100] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-10-10T20:47:57.089348] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-10T20:47:57.119436] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-10T20:47:57.889413] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-10T20:47:58.689431] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-10T20:47:59.348011] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T20:47:59.489384] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-10T20:48:00.080030] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.99 seconds). [2025-10-10T20:48:00.289429] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-10T20:48:00.402242] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T20:48:01.089359] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-10T20:48:01.220813] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T20:48:01.405040] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-10T20:48:01.889436] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-10T20:48:02.689385] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-10T20:48:02.991155] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-10T20:48:03.501370] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-10T20:48:03.527191] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-10T20:48:04.289418] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-10T20:48:04.450281] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T20:48:04.896880] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-10T20:48:05.089383] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-10T20:48:05.889389] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-10T20:48:06.591102] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-10T20:48:06.689341] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-10T20:48:06.768914] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T20:48:07.045943] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-10T20:48:07.489430] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-10T20:48:08.289400] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-10T20:48:08.587910] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-10T20:48:09.089404] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-10T20:48:09.133793] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-10T20:48:09.696282] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T20:48:09.889378] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-10T20:48:10.305807] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T20:48:10.689421] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-10T20:48:11.489388] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-10T20:48:12.289358] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-10T20:48:12.622541] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-10-10T20:48:12.758214] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-10T20:48:13.043049] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-10T20:48:13.089329] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-10T20:48:13.370554] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T20:48:13.889381] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-10T20:48:14.689340] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-10T20:48:14.715592] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-10T20:48:14.768264] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-10T20:48:15.489369] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-10T20:48:16.289413] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-10T20:48:16.403552] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T20:48:16.405112] [INFO ] [REMOTE ] PAC: Full fetch complete (16593 records). [2025-10-10T20:48:16.405185] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-10T20:48:16.766352] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-10-10T20:48:16.766455] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-10-10T20:48:16.766865] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-10-10T20:48:16.766948] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-10-10T20:48:16.767458] [DEBUG] [LOCAL ] PAC: Trimmed 16593 records to 11728 (keeping 200 days of data) [2025-10-10T20:48:16.841785] [DEBUG] [LOCAL ] PAC: Primary data saved (11728 records). [2025-10-10T20:48:16.841913] [INFO ] [MAIN ] PAC: Full history saved. [2025-10-10T20:48:16.841983] [INFO ] [MAIN ] Update Progress: 1621/2373 symbols completed. PAC took 26.2s. Estimated remaining: 1h 45m 52s. Rate: 7.1 symbols/min [2025-10-10T20:48:17.010662] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:48:17.010886] [DEBUG] [LOCAL ] PACS: No existing data file found in primary storage. [2025-10-10T20:48:17.011087] [WARN ] [MAIN ] PACS: No existing data found, performing full refresh instead. [2025-10-10T20:48:17.011786] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-10T20:48:17.011841] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-10T20:48:17.011887] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-10T20:48:17.011922] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-10T20:48:17.101254] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-10T20:48:17.381047] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:48:17.418330] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-10-10T20:48:17.452356] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-10T20:48:17.889387] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-10T20:48:18.689395] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-10T20:48:19.313411] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-10T20:48:19.316906] [INFO ] [REMOTE ] PACK: Full fetch complete (44539 records). [2025-10-10T20:48:19.317027] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-10T20:48:19.496962] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-10-10T20:48:19.681410] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T20:48:19.732200] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-10T20:48:19.733060] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-10T20:48:19.734049] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-10T20:48:19.734317] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-10T20:48:19.734223] [INFO ] [REMOTE ] PAAS: Full fetch complete (77026 records). [2025-10-10T20:48:19.734791] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-10T20:48:19.736707] [DEBUG] [LOCAL ] PACK: Trimmed 44539 records to 32336 (keeping 200 days of data) [2025-10-10T20:48:19.736188] [FATAL] [VALIDATOR ] PAAS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:48:19.737242] [FATAL] [MAIN ] PAAS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:48:19.737602] [WARN ] [MAIN ] PAAS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:48:19.737736] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-10T20:48:19.737915] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-10T20:48:19.737996] [INFO ] [LOCAL ] PAAS: Starting deletion of derivative data. [2025-10-10T20:48:19.738189] [DEBUG] [LOCAL ] PAAS: No derivative data file found to delete. [2025-10-10T20:48:19.738284] [INFO ] [MAIN ] Update Progress: 1622/2373 symbols completed. PAAS took 36.3s. Estimated remaining: 1h 45m 41s. Rate: 7.1 symbols/min [2025-10-10T20:48:19.931995] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-10-10T20:48:20.055391] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:48:20.056855] [DEBUG] [LOCAL ] PAG: No existing data file found in primary storage. [2025-10-10T20:48:20.057265] [WARN ] [MAIN ] PAG: No existing data found, performing full refresh instead. [2025-10-10T20:48:20.058260] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-10T20:48:20.058611] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-10T20:48:20.059264] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-10T20:48:20.059665] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-10T20:48:20.299948] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-10T20:48:20.470677] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:48:20.513632] [DEBUG] [LOCAL ] PACK: Primary data saved (32336 records). [2025-10-10T20:48:20.513765] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-10T20:48:20.513835] [INFO ] [MAIN ] Update Progress: 1623/2373 symbols completed. PACK took 26.6s. Estimated remaining: 1h 45m 29s. Rate: 7.1 symbols/min [2025-10-10T20:48:20.678768] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:48:20.678877] [DEBUG] [LOCAL ] PAGS: No existing data file found in primary storage. [2025-10-10T20:48:20.678914] [WARN ] [MAIN ] PAGS: No existing data found, performing full refresh instead. [2025-10-10T20:48:20.679017] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-10T20:48:20.679057] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-10T20:48:20.679097] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-10T20:48:20.679129] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-10T20:48:21.023075] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:48:21.089327] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-10-10T20:48:21.434578] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T20:48:21.889381] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-10-10T20:48:22.689370] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-10T20:48:22.808219] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-10T20:48:23.135292] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-10T20:48:23.235344] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-10T20:48:23.489371] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-10T20:48:24.289389] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-10T20:48:24.438619] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T20:48:24.766550] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T20:48:25.089371] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-10T20:48:25.889352] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-10T20:48:26.369485] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-10T20:48:26.391910] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T20:48:26.689368] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-10T20:48:27.489390] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-10T20:48:28.289379] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-10T20:48:28.542006] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-10T20:48:28.583867] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T20:48:28.643436] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-10T20:48:29.089373] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-10T20:48:29.327488] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-10T20:48:29.889404] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-10T20:48:30.689356] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-10T20:48:30.769375] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T20:48:31.489379] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-10T20:48:32.047196] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T20:48:32.289359] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-10T20:48:32.512851] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-10T20:48:33.089412] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-10T20:48:33.157459] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-10T20:48:33.889393] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-10T20:48:33.927667] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T20:48:34.451095] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T20:48:34.689406] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-10T20:48:34.774126] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T20:48:34.778482] [INFO ] [REMOTE ] OXY: Full fetch complete (77180 records). [2025-10-10T20:48:34.778591] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-10T20:48:34.779325] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:48:34.779436] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:48:34.779508] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:48:34.779578] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-10T20:48:34.779669] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-10T20:48:34.779727] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-10T20:48:34.779771] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-10T20:48:34.779834] [INFO ] [MAIN ] Update Progress: 1624/2373 symbols completed. OXY took 52.7s. Estimated remaining: 1h 45m 23s. Rate: 7.1 symbols/min [2025-10-10T20:48:34.944244] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:48:34.944404] [DEBUG] [LOCAL ] PAI: No existing data file found in primary storage. [2025-10-10T20:48:34.944440] [WARN ] [MAIN ] PAI: No existing data found, performing full refresh instead. [2025-10-10T20:48:34.944554] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-10T20:48:34.944594] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-10T20:48:34.944634] [DEBUG] [LOCAL ] PAI: No primary data file found to delete. [2025-10-10T20:48:34.944726] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-10T20:48:35.299233] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:48:35.489353] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-10-10T20:48:36.056402] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T20:48:36.289387] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-10T20:48:36.308782] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-10T20:48:37.089386] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-10T20:48:37.711200] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-10T20:48:37.889381] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-10T20:48:38.689358] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-10T20:48:38.815596] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T20:48:39.296585] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T20:48:39.489346] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-10T20:48:40.289404] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-10T20:48:40.593106] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T20:48:40.788744] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T20:48:41.017333] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-10T20:48:41.089410] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-10T20:48:41.863970] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T20:48:41.866735] [INFO ] [REMOTE ] PAG: Full fetch complete (30229 records). [2025-10-10T20:48:41.866838] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-10T20:48:41.867452] [FATAL] [VALIDATOR ] PAG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:48:41.867540] [FATAL] [MAIN ] PAG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:48:41.867586] [WARN ] [MAIN ] PAG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:48:41.867628] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-10T20:48:41.867731] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-10T20:48:41.867886] [INFO ] [LOCAL ] PAG: Starting deletion of derivative data. [2025-10-10T20:48:41.867968] [DEBUG] [LOCAL ] PAG: No derivative data file found to delete. [2025-10-10T20:48:41.868058] [INFO ] [MAIN ] Update Progress: 1625/2373 symbols completed. PAG took 22.1s. Estimated remaining: 1h 45m 14s. Rate: 7.1 symbols/min [2025-10-10T20:48:41.894545] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-10T20:48:42.068363] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:48:42.068782] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-10T20:48:42.068875] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-10T20:48:42.069012] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-10T20:48:42.069058] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-10T20:48:42.069103] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-10T20:48:42.069137] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-10T20:48:42.445922] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:48:42.689403] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-10-10T20:48:43.005014] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:48:43.005489] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-10-10T20:48:43.005593] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:48:43.005666] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-10T20:48:43.005728] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:48:43.005809] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-10T20:48:43.005883] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-10T20:48:43.005925] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-10T20:48:43.005973] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-10T20:48:43.006035] [INFO ] [MAIN ] Update Progress: 1626/2373 symbols completed. PAII took 1.1s. Estimated remaining: 1h 45m 3s. Rate: 7.1 symbols/min [2025-10-10T20:48:43.181017] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:48:43.181197] [DEBUG] [LOCAL ] PAM: No existing data file found in primary storage. [2025-10-10T20:48:43.181235] [WARN ] [MAIN ] PAM: No existing data found, performing full refresh instead. [2025-10-10T20:48:43.181347] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-10T20:48:43.181389] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-10T20:48:43.181431] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-10T20:48:43.181464] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-10T20:48:43.505355] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-10T20:48:43.548977] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:48:43.675906] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-10T20:48:44.289426] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-10T20:48:44.933008] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-10T20:48:45.089410] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-10T20:48:45.426509] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-10T20:48:45.815174] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-10T20:48:45.889403] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-10T20:48:46.689426] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-10-10T20:48:47.489348] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-10T20:48:48.045786] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-10T20:48:48.129013] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-10T20:48:48.289373] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-10T20:48:49.068822] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T20:48:49.089386] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-10T20:48:49.889350] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-10T20:48:50.330533] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-10T20:48:50.400219] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T20:48:50.689352] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-10T20:48:50.955710] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-10T20:48:51.489381] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-10T20:48:52.174963] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-10T20:48:52.289380] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-10T20:48:52.365994] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-10T20:48:53.089370] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-10T20:48:53.889378] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-10T20:48:54.689411] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-10T20:48:54.924946] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-10T20:48:55.288089] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-10T20:48:55.489354] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-10T20:48:55.511404] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-10T20:48:55.924119] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T20:48:56.289373] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-10T20:48:56.570338] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T20:48:56.576895] [INFO ] [REMOTE ] PAGS: Full fetch complete (75917 records). [2025-10-10T20:48:56.577132] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-10T20:48:56.578192] [FATAL] [VALIDATOR ] PAGS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:48:56.578334] [FATAL] [MAIN ] PAGS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:48:56.578417] [WARN ] [MAIN ] PAGS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:48:56.578508] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-10T20:48:56.578595] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-10T20:48:56.578689] [INFO ] [LOCAL ] PAGS: Starting deletion of derivative data. [2025-10-10T20:48:56.578778] [DEBUG] [LOCAL ] PAGS: No derivative data file found to delete. [2025-10-10T20:48:56.578870] [INFO ] [MAIN ] Update Progress: 1627/2373 symbols completed. PAGS took 36.1s. Estimated remaining: 1h 44m 57s. Rate: 7.1 symbols/min [2025-10-10T20:48:56.756571] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:48:56.756787] [DEBUG] [LOCAL ] PAR: No existing data file found in primary storage. [2025-10-10T20:48:56.756833] [WARN ] [MAIN ] PAR: No existing data found, performing full refresh instead. [2025-10-10T20:48:56.756976] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-10T20:48:56.757026] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-10T20:48:56.757069] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-10T20:48:56.757101] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-10T20:48:57.096335] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-10T20:48:57.128375] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:48:57.889411] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-10T20:48:58.175629] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T20:48:58.689378] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-10T20:48:58.755705] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T20:48:58.755821] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-10T20:48:59.448818] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T20:48:59.452265] [INFO ] [REMOTE ] PACS: Full fetch complete (50413 records). [2025-10-10T20:48:59.452371] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-10T20:48:59.453009] [FATAL] [VALIDATOR ] PACS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:48:59.453107] [FATAL] [MAIN ] PACS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:48:59.453149] [WARN ] [MAIN ] PACS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:48:59.453187] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-10T20:48:59.453242] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-10T20:48:59.453275] [INFO ] [LOCAL ] PACS: Starting deletion of derivative data. [2025-10-10T20:48:59.453314] [DEBUG] [LOCAL ] PACS: No derivative data file found to delete. [2025-10-10T20:48:59.453370] [INFO ] [MAIN ] Update Progress: 1628/2373 symbols completed. PACS took 42.6s. Estimated remaining: 1h 44m 46s. Rate: 7.1 symbols/min [2025-10-10T20:48:59.494606] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-10-10T20:48:59.631927] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:48:59.632129] [DEBUG] [LOCAL ] PARR: No existing data file found in primary storage. [2025-10-10T20:48:59.632165] [WARN ] [MAIN ] PARR: No existing data found, performing full refresh instead. [2025-10-10T20:48:59.632279] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-10T20:48:59.632319] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-10T20:48:59.632359] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-10T20:48:59.632390] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-10T20:48:59.998700] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:49:00.289389] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-10-10T20:49:01.089401] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-10T20:49:01.241502] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-10T20:49:01.750699] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-10T20:49:01.889362] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-10T20:49:02.151570] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T20:49:02.647782] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T20:49:02.689334] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-10T20:49:03.489352] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-10T20:49:03.573737] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-10T20:49:04.289418] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-10T20:49:04.941926] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-10T20:49:05.089360] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-10T20:49:05.889395] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-10T20:49:06.241763] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T20:49:06.689345] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-10T20:49:06.832222] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-10T20:49:06.832893] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-10T20:49:07.159586] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-10T20:49:07.160412] [INFO ] [REMOTE ] PAI: Full fetch complete (4058 records). [2025-10-10T20:49:07.160482] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-10T20:49:07.513982] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-10T20:49:07.521138] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-10T20:49:07.521941] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-10T20:49:07.522108] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-10T20:49:07.522150] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-10T20:49:07.522562] [DEBUG] [LOCAL ] PAI: Trimmed 4058 records to 2718 (keeping 200 days of data) [2025-10-10T20:49:07.540741] [DEBUG] [LOCAL ] PAI: Primary data saved (2718 records). [2025-10-10T20:49:07.540858] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-10T20:49:07.540929] [INFO ] [MAIN ] Update Progress: 1629/2373 symbols completed. PAI took 32.8s. Estimated remaining: 1h 44m 37s. Rate: 7.1 symbols/min [2025-10-10T20:49:07.730672] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:49:07.730957] [DEBUG] [LOCAL ] PATH: No existing data file found in primary storage. [2025-10-10T20:49:07.731011] [WARN ] [MAIN ] PATH: No existing data found, performing full refresh instead. [2025-10-10T20:49:07.731120] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-10T20:49:07.731161] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-10T20:49:07.731206] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-10T20:49:07.731248] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-10T20:49:08.076192] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:49:08.289368] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-10T20:49:09.089418] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-10-10T20:49:09.362982] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T20:49:09.889367] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-10T20:49:09.964882] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-10T20:49:10.689376] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-10T20:49:11.489346] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-10T20:49:11.658335] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-10-10T20:49:11.752167] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-10T20:49:11.831464] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T20:49:12.289383] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-10T20:49:13.089354] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-10T20:49:13.151781] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T20:49:13.823209] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-10T20:49:13.889335] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-10T20:49:14.689342] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-10T20:49:15.158673] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T20:49:15.189106] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T20:49:15.489423] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-10T20:49:16.289361] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-10T20:49:16.403144] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T20:49:16.406158] [INFO ] [REMOTE ] PAM: Full fetch complete (41682 records). [2025-10-10T20:49:16.406240] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-10T20:49:16.406836] [FATAL] [VALIDATOR ] PAM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:49:16.406958] [FATAL] [MAIN ] PAM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:49:16.407012] [WARN ] [MAIN ] PAM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:49:16.407054] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-10T20:49:16.407108] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-10T20:49:16.407142] [INFO ] [LOCAL ] PAM: Starting deletion of derivative data. [2025-10-10T20:49:16.407179] [DEBUG] [LOCAL ] PAM: No derivative data file found to delete. [2025-10-10T20:49:16.407233] [INFO ] [MAIN ] Update Progress: 1630/2373 symbols completed. PAM took 33.4s. Estimated remaining: 1h 44m 29s. Rate: 7.1 symbols/min [2025-10-10T20:49:16.554435] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T20:49:16.608600] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:49:16.608800] [DEBUG] [LOCAL ] PAXS: No existing data file found in primary storage. [2025-10-10T20:49:16.608843] [WARN ] [MAIN ] PAXS: No existing data found, performing full refresh instead. [2025-10-10T20:49:16.608955] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-10T20:49:16.608997] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-10T20:49:16.609041] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-10T20:49:16.609074] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-10T20:49:16.970617] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:49:17.089368] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-10-10T20:49:17.889342] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-10T20:49:18.118537] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T20:49:18.689409] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-10T20:49:18.838971] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-10T20:49:19.066066] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-10T20:49:19.489394] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-10T20:49:20.289429] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-10T20:49:20.904359] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T20:49:21.089359] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-10T20:49:21.320047] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-10T20:49:21.889349] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-10T20:49:22.285248] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-10T20:49:22.441434] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-10T20:49:22.689436] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-10T20:49:23.451923] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-10T20:49:23.489436] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-10T20:49:24.131141] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-10T20:49:24.289430] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-10T20:49:25.089344] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-10T20:49:25.505910] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-10T20:49:25.569596] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T20:49:25.889363] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-10T20:49:26.689342] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-10T20:49:27.232306] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-10T20:49:27.466025] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-10T20:49:27.489330] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-10T20:49:28.220961] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-10T20:49:28.289340] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-10T20:49:29.089375] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-10T20:49:29.889358] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-10T20:49:30.096833] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T20:49:30.137429] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-10T20:49:30.689374] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-10T20:49:30.852238] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T20:49:31.025701] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T20:49:31.489389] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-10T20:49:31.517612] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T20:49:31.521285] [INFO ] [REMOTE ] PAR: Full fetch complete (48116 records). [2025-10-10T20:49:31.521373] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-10T20:49:31.522080] [FATAL] [VALIDATOR ] PAR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:49:31.522166] [FATAL] [MAIN ] PAR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:49:31.522229] [WARN ] [MAIN ] PAR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:49:31.522322] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-10T20:49:31.522403] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-10T20:49:31.522441] [INFO ] [LOCAL ] PAR: Starting deletion of derivative data. [2025-10-10T20:49:31.522497] [DEBUG] [LOCAL ] PAR: No derivative data file found to delete. [2025-10-10T20:49:31.522552] [INFO ] [MAIN ] Update Progress: 1631/2373 symbols completed. PAR took 34.9s. Estimated remaining: 1h 44m 23s. Rate: 7.1 symbols/min [2025-10-10T20:49:31.689712] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:49:31.689907] [DEBUG] [LOCAL ] PAY: No existing data file found in primary storage. [2025-10-10T20:49:31.689945] [WARN ] [MAIN ] PAY: No existing data found, performing full refresh instead. [2025-10-10T20:49:31.690054] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-10T20:49:31.690096] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-10T20:49:31.690136] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-10T20:49:31.690168] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-10T20:49:32.034571] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:49:32.289374] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-10-10T20:49:33.089428] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-10T20:49:33.889425] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-10T20:49:34.625615] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-10T20:49:34.689350] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-10T20:49:34.954558] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (3.47 seconds). [2025-10-10T20:49:35.489468] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-10T20:49:35.654094] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-10T20:49:36.289394] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-10T20:49:36.579265] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-10T20:49:36.819144] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-10T20:49:37.089458] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-10T20:49:37.170748] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T20:49:37.177675] [INFO ] [REMOTE ] PARR: Full fetch complete (68590 records). [2025-10-10T20:49:37.177962] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-10T20:49:37.179262] [FATAL] [VALIDATOR ] PARR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:49:37.179403] [FATAL] [MAIN ] PARR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:49:37.179468] [WARN ] [MAIN ] PARR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:49:37.179536] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-10T20:49:37.179634] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-10T20:49:37.179759] [INFO ] [LOCAL ] PARR: Starting deletion of derivative data. [2025-10-10T20:49:37.179849] [DEBUG] [LOCAL ] PARR: No derivative data file found to delete. [2025-10-10T20:49:37.179957] [INFO ] [MAIN ] Update Progress: 1632/2373 symbols completed. PARR took 37.7s. Estimated remaining: 1h 44m 14s. Rate: 7.1 symbols/min [2025-10-10T20:49:37.462923] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:49:37.463348] [DEBUG] [LOCAL ] PAYC: No existing data file found in primary storage. [2025-10-10T20:49:37.463406] [WARN ] [MAIN ] PAYC: No existing data found, performing full refresh instead. [2025-10-10T20:49:37.463565] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-10T20:49:37.463626] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-10T20:49:37.463756] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-10T20:49:37.463818] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-10T20:49:37.876229] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:49:37.889362] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-10T20:49:38.091625] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-10T20:49:38.689355] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-10T20:49:38.724125] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T20:49:39.313812] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-10T20:49:39.489399] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-10T20:49:40.289392] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-10T20:49:40.901883] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T20:49:41.089333] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-10T20:49:41.138598] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-10T20:49:41.889392] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-10T20:49:42.203971] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-10T20:49:42.338238] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T20:49:42.689406] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-10T20:49:43.489388] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-10T20:49:43.560365] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T20:49:43.563400] [INFO ] [REMOTE ] PAXS: Full fetch complete (30139 records). [2025-10-10T20:49:43.563500] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-10T20:49:43.564140] [FATAL] [VALIDATOR ] PAXS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:49:43.564360] [FATAL] [MAIN ] PAXS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:49:43.564446] [WARN ] [MAIN ] PAXS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:49:43.564539] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-10T20:49:43.564628] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-10T20:49:43.564721] [INFO ] [LOCAL ] PAXS: Starting deletion of derivative data. [2025-10-10T20:49:43.564792] [DEBUG] [LOCAL ] PAXS: No derivative data file found to delete. [2025-10-10T20:49:43.564894] [INFO ] [MAIN ] Update Progress: 1633/2373 symbols completed. PAXS took 27.2s. Estimated remaining: 1h 44m 4s. Rate: 7.1 symbols/min [2025-10-10T20:49:43.743038] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:49:43.743226] [DEBUG] [LOCAL ] PB: No existing data file found in primary storage. [2025-10-10T20:49:43.743266] [WARN ] [MAIN ] PB: No existing data found, performing full refresh instead. [2025-10-10T20:49:43.743405] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-10T20:49:43.743473] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-10T20:49:43.743526] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-10T20:49:43.743558] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-10T20:49:44.143725] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:49:44.289367] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-10-10T20:49:44.530734] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-10T20:49:45.089373] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-10T20:49:45.228458] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T20:49:45.889390] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-10-10T20:49:46.111029] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-10T20:49:46.689378] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-10T20:49:47.413914] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-10T20:49:47.489368] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-10T20:49:47.658806] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T20:49:47.955722] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-10T20:49:48.289355] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-10T20:49:49.089401] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-10T20:49:49.889348] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-10T20:49:49.966418] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-10T20:49:50.270342] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-10T20:49:50.689430] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-10T20:49:50.956360] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T20:49:51.489360] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-10T20:49:51.637118] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T20:49:51.943127] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T20:49:52.289368] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-10T20:49:52.718727] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-10T20:49:53.089372] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-10T20:49:53.889345] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-10T20:49:53.939537] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-10T20:49:54.499541] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-10T20:49:54.503969] [INFO ] [REMOTE ] PATH: Full fetch complete (77374 records). [2025-10-10T20:49:54.504082] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-10T20:49:54.505008] [FATAL] [VALIDATOR ] PATH: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:49:54.505100] [FATAL] [MAIN ] PATH: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:49:54.505142] [WARN ] [MAIN ] PATH: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:49:54.505179] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-10T20:49:54.505238] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-10T20:49:54.505275] [INFO ] [LOCAL ] PATH: Starting deletion of derivative data. [2025-10-10T20:49:54.505314] [DEBUG] [LOCAL ] PATH: No derivative data file found to delete. [2025-10-10T20:49:54.505370] [INFO ] [MAIN ] Update Progress: 1634/2373 symbols completed. PATH took 47.0s. Estimated remaining: 1h 43m 57s. Rate: 7.1 symbols/min [2025-10-10T20:49:54.677759] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:49:54.678009] [DEBUG] [LOCAL ] PBA: No existing data file found in primary storage. [2025-10-10T20:49:54.678062] [WARN ] [MAIN ] PBA: No existing data found, performing full refresh instead. [2025-10-10T20:49:54.678194] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-10T20:49:54.678244] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-10T20:49:54.678295] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-10T20:49:54.678333] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-10T20:49:54.698420] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-10T20:49:55.036133] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:49:55.061214] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T20:49:55.489369] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-10T20:49:56.289379] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-10T20:49:56.596939] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T20:49:57.089352] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-10T20:49:57.372350] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T20:49:57.889406] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-10T20:49:58.507237] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-10T20:49:58.689346] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-10-10T20:49:59.041563] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T20:49:59.349201] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-10T20:49:59.489376] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-10T20:50:00.289421] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-10T20:50:00.689740] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T20:50:01.089377] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-10T20:50:01.220047] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T20:50:01.224126] [INFO ] [REMOTE ] PAY: Full fetch complete (53208 records). [2025-10-10T20:50:01.224305] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-10T20:50:01.225090] [FATAL] [VALIDATOR ] PAY: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:50:01.225192] [FATAL] [MAIN ] PAY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:50:01.225238] [WARN ] [MAIN ] PAY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:50:01.225283] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-10T20:50:01.225354] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-10T20:50:01.225394] [INFO ] [LOCAL ] PAY: Starting deletion of derivative data. [2025-10-10T20:50:01.225436] [DEBUG] [LOCAL ] PAY: No derivative data file found to delete. [2025-10-10T20:50:01.225527] [INFO ] [MAIN ] Update Progress: 1635/2373 symbols completed. PAY took 29.7s. Estimated remaining: 1h 43m 48s. Rate: 7.1 symbols/min [2025-10-10T20:50:01.399477] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:50:01.399784] [DEBUG] [LOCAL ] PBF: No existing data file found in primary storage. [2025-10-10T20:50:01.399839] [WARN ] [MAIN ] PBF: No existing data found, performing full refresh instead. [2025-10-10T20:50:01.399989] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-10T20:50:01.400058] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-10T20:50:01.400280] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-10T20:50:01.400334] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-10T20:50:01.807111] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:50:01.809289] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-10T20:50:01.889341] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-10T20:50:02.689366] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-10T20:50:02.984323] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T20:50:03.489362] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-10-10T20:50:03.563516] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-10T20:50:04.289397] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-10T20:50:05.047130] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-10T20:50:05.089325] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-10T20:50:05.502295] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T20:50:05.889352] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-10T20:50:06.182525] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-10T20:50:06.689398] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-10T20:50:07.222341] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-10T20:50:07.330049] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-10T20:50:07.489376] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-10T20:50:08.289342] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-10T20:50:08.900198] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-10T20:50:09.089382] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-10T20:50:09.471122] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T20:50:09.889374] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-10T20:50:10.422865] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-10T20:50:10.689404] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-10T20:50:11.182624] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-10T20:50:11.489403] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-10T20:50:11.909137] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T20:50:12.289424] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-10T20:50:12.595607] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T20:50:13.089366] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-10T20:50:13.867622] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-10T20:50:13.889330] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-10T20:50:14.547015] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-10T20:50:14.601177] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T20:50:14.689366] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-10T20:50:15.489345] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-10T20:50:16.295111] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-10T20:50:16.298316] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-10T20:50:17.089407] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-10T20:50:17.201277] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-10T20:50:17.236200] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T20:50:17.653751] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-10T20:50:17.889419] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-10T20:50:18.689424] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-10T20:50:18.710727] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T20:50:18.714678] [INFO ] [REMOTE ] PB: Full fetch complete (58648 records). [2025-10-10T20:50:18.714840] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-10T20:50:18.715556] [FATAL] [VALIDATOR ] PB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:50:18.715730] [FATAL] [MAIN ] PB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:50:18.715815] [WARN ] [MAIN ] PB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:50:18.715911] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-10T20:50:18.715992] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-10T20:50:18.716031] [INFO ] [LOCAL ] PB: Starting deletion of derivative data. [2025-10-10T20:50:18.716072] [DEBUG] [LOCAL ] PB: No derivative data file found to delete. [2025-10-10T20:50:18.716148] [INFO ] [MAIN ] Update Progress: 1636/2373 symbols completed. PB took 35.2s. Estimated remaining: 1h 43m 43s. Rate: 7.1 symbols/min [2025-10-10T20:50:18.889028] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:50:18.889235] [DEBUG] [LOCAL ] PBH: No existing data file found in primary storage. [2025-10-10T20:50:18.889274] [WARN ] [MAIN ] PBH: No existing data found, performing full refresh instead. [2025-10-10T20:50:18.889387] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-10T20:50:18.889429] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-10T20:50:18.889470] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-10T20:50:18.889502] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-10T20:50:19.251317] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:50:19.469831] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-10T20:50:19.489336] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-10T20:50:20.289384] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-10-10T20:50:21.026124] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-10T20:50:21.089419] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-10T20:50:21.617783] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-10T20:50:21.700909] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T20:50:21.889371] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-10T20:50:22.689366] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-10T20:50:23.124100] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T20:50:23.264809] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-10T20:50:23.489390] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-10T20:50:24.289355] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-10T20:50:24.554360] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T20:50:25.060752] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T20:50:25.089335] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-10T20:50:25.889404] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-10T20:50:26.338362] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T20:50:26.670496] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-10T20:50:26.689401] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-10T20:50:27.489465] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-10T20:50:27.948350] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-10T20:50:27.990456] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-10T20:50:28.289355] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-10T20:50:28.404933] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T20:50:28.409414] [INFO ] [REMOTE ] PBA: Full fetch complete (71034 records). [2025-10-10T20:50:28.409557] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-10T20:50:28.410364] [FATAL] [VALIDATOR ] PBA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:50:28.410458] [FATAL] [MAIN ] PBA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:50:28.410502] [WARN ] [MAIN ] PBA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:50:28.410575] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-10T20:50:28.410685] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-10T20:50:28.410741] [INFO ] [LOCAL ] PBA: Starting deletion of derivative data. [2025-10-10T20:50:28.410788] [DEBUG] [LOCAL ] PBA: No derivative data file found to delete. [2025-10-10T20:50:28.410877] [INFO ] [MAIN ] Update Progress: 1637/2373 symbols completed. PBA took 33.9s. Estimated remaining: 1h 43m 35s. Rate: 7.1 symbols/min [2025-10-10T20:50:29.079221] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-10T20:50:29.084430] [INFO ] [REMOTE ] PAYC: Full fetch complete (52660 records). [2025-10-10T20:50:29.084671] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-10T20:50:29.085511] [FATAL] [VALIDATOR ] PAYC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:50:29.085622] [FATAL] [MAIN ] PAYC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:50:29.085723] [WARN ] [MAIN ] PAYC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:50:29.085814] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-10T20:50:29.085917] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-10T20:50:29.085986] [INFO ] [LOCAL ] PAYC: Starting deletion of derivative data. [2025-10-10T20:50:29.086057] [DEBUG] [LOCAL ] PAYC: No derivative data file found to delete. [2025-10-10T20:50:29.086141] [INFO ] [MAIN ] Update Progress: 1638/2373 symbols completed. PAYC took 51.9s. Estimated remaining: 1h 43m 24s. Rate: 7.1 symbols/min [2025-10-10T20:50:29.089326] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-10T20:50:29.889369] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-10T20:50:30.676275] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-10T20:50:30.689320] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-10T20:50:31.924514] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-10T20:50:31.935822] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-10T20:50:32.149461] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T20:50:32.289386] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-10T20:50:32.858331] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T20:50:32.862850] [INFO ] [REMOTE ] PBF: Full fetch complete (76223 records). [2025-10-10T20:50:32.862974] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-10T20:50:32.863596] [FATAL] [VALIDATOR ] PBF: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:50:32.863701] [FATAL] [MAIN ] PBF: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:50:32.863746] [WARN ] [MAIN ] PBF: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:50:32.863811] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-10T20:50:32.863873] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-10T20:50:32.863907] [INFO ] [LOCAL ] PBF: Starting deletion of derivative data. [2025-10-10T20:50:32.863945] [DEBUG] [LOCAL ] PBF: No derivative data file found to delete. [2025-10-10T20:50:32.864002] [INFO ] [MAIN ] Update Progress: 1639/2373 symbols completed. PBF took 31.6s. Estimated remaining: 1h 43m 13s. Rate: 7.1 symbols/min [2025-10-10T20:50:34.422993] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-10T20:50:34.434948] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-10T20:50:37.319092] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-10-10T20:50:37.327051] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-10T20:50:39.015216] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T20:50:39.023705] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-10T20:50:39.724392] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-10T20:50:39.727383] [INFO ] [REMOTE ] PBH: Full fetch complete (43751 records). [2025-10-10T20:50:39.727464] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-10T20:50:39.728045] [FATAL] [VALIDATOR ] PBH: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:50:39.728125] [FATAL] [MAIN ] PBH: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:50:39.728167] [WARN ] [MAIN ] PBH: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:50:39.728232] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-10T20:50:39.728292] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-10T20:50:39.728327] [INFO ] [LOCAL ] PBH: Starting deletion of derivative data. [2025-10-10T20:50:39.728365] [DEBUG] [LOCAL ] PBH: No derivative data file found to delete. [2025-10-10T20:50:39.728420] [INFO ] [MAIN ] Update Progress: 1640/2373 symbols completed. PBH took 21.0s. Estimated remaining: 1h 43m 4s. Rate: 7.1 symbols/min [2025-10-10T20:50:40.348260] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:50:40.416504] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:50:40.398619] [DEBUG] [LOCAL ] PBI: No existing data file found in primary storage. [2025-10-10T20:50:40.419132] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:50:40.420670] [WARN ] [MAIN ] PBI: No existing data found, performing full refresh instead. [2025-10-10T20:50:40.422299] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:50:40.422392] [DEBUG] [LOCAL ] PBR: No existing data file found in primary storage. [2025-10-10T20:50:40.423078] [DEBUG] [LOCAL ] PBT: No existing data file found in primary storage. [2025-10-10T20:50:40.422800] [DEBUG] [LOCAL ] PCF: No existing data file found in primary storage. [2025-10-10T20:50:40.422866] [WARN ] [MAIN ] PBR: No existing data found, performing full refresh instead. [2025-10-10T20:50:40.422978] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-10T20:50:40.423228] [WARN ] [MAIN ] PCF: No existing data found, performing full refresh instead. [2025-10-10T20:50:40.423286] [WARN ] [MAIN ] PBT: No existing data found, performing full refresh instead. [2025-10-10T20:50:40.423409] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-10T20:50:40.423868] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-10T20:50:40.424105] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-10T20:50:40.423613] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-10T20:50:40.424228] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-10T20:50:40.424500] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-10T20:50:40.424608] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-10T20:50:40.424434] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-10T20:50:40.444683] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-10T20:50:40.424031] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-10T20:50:40.463696] [DEBUG] [LOCAL ] PCF: No primary data file found to delete. [2025-10-10T20:50:40.485768] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-10T20:50:40.485680] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-10T20:50:40.491026] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-10T20:50:40.496408] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-10T20:50:41.677844] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:50:41.709797] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-10-10T20:50:41.864442] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:50:41.917961] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:50:41.918317] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-10-10T20:50:41.914106] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:50:41.918764] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-10-10T20:50:41.920417] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-10-10T20:50:43.154043] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T20:50:43.157949] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-10T20:50:43.291793] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T20:50:43.296370] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-10T20:50:43.609627] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T20:50:43.619951] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-10T20:50:43.861478] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T20:50:43.872580] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-10T20:50:44.235011] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T20:50:44.237607] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-10T20:50:44.629215] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T20:50:44.635509] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-10T20:50:45.345910] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T20:50:45.349557] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-10T20:50:45.681262] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T20:50:45.690796] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-10T20:50:46.144216] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-10T20:50:46.146881] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-10T20:50:46.176558] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-10T20:50:46.187486] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-10T20:50:46.246696] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T20:50:46.689386] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-10T20:50:46.770870] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-10T20:50:47.376817] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T20:50:47.475535] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-10T20:50:47.489393] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-10T20:50:48.289403] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-10T20:50:48.464532] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-10T20:50:48.531560] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-10T20:50:49.089353] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-10T20:50:49.470536] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-10T20:50:49.889385] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-10T20:50:50.689371] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-10T20:50:50.938831] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-10T20:50:51.395942] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-10T20:50:51.489361] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-10T20:50:51.664090] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-10T20:50:52.289370] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-10T20:50:53.089372] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-10T20:50:53.490722] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-10T20:50:53.573152] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T20:50:53.670099] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-10T20:50:53.889373] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-10T20:50:54.689371] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-10T20:50:54.942195] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-10T20:50:55.489372] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-10T20:50:56.289352] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-10T20:50:56.568241] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-10T20:50:56.813634] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-10T20:50:57.089348] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-10T20:50:57.240492] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-10T20:50:57.889371] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-10T20:50:58.689401] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-10T20:50:58.771438] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T20:50:58.772872] [INFO ] [REMOTE ] PCF: Full fetch complete (13833 records). [2025-10-10T20:50:58.772939] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-10T20:50:59.179362] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-10T20:50:59.179638] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-10T20:50:59.180099] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-10T20:50:59.180185] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-10T20:50:59.182700] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-10T20:50:59.193686] [DEBUG] [LOCAL ] PCF: Trimmed 13833 records to 9140 (keeping 200 days of data) [2025-10-10T20:50:59.248437] [DEBUG] [LOCAL ] PCF: Primary data saved (9140 records). [2025-10-10T20:50:59.248590] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-10T20:50:59.248701] [INFO ] [MAIN ] Update Progress: 1641/2373 symbols completed. PCF took 19.5s. Estimated remaining: 1h 43m 0s. Rate: 7.1 symbols/min [2025-10-10T20:50:59.419834] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:50:59.420009] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-10T20:50:59.420047] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-10T20:50:59.420163] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-10T20:50:59.420205] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-10T20:50:59.420249] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-10T20:50:59.420327] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-10T20:50:59.494525] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-10T20:50:59.806262] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:51:00.289378] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-10T20:51:01.089429] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-10-10T20:51:01.581800] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-10T20:51:01.889393] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-10T20:51:03.287774] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (4.60 seconds). [2025-10-10T20:51:03.299088] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-10T20:51:04.581173] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (4.29 seconds). [2025-10-10T20:51:04.590953] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-10T20:51:05.754476] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (3.87 seconds). [2025-10-10T20:51:05.758842] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-10T20:51:06.154889] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-10T20:51:06.156709] [INFO ] [REMOTE ] PBT: Full fetch complete (24848 records). [2025-10-10T20:51:06.156783] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-10T20:51:06.157251] [FATAL] [VALIDATOR ] PBT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:51:06.157333] [FATAL] [MAIN ] PBT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:51:06.157376] [WARN ] [MAIN ] PBT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:51:06.157439] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-10T20:51:06.157502] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-10T20:51:06.157538] [INFO ] [LOCAL ] PBT: Starting deletion of derivative data. [2025-10-10T20:51:06.157621] [DEBUG] [LOCAL ] PBT: No derivative data file found to delete. [2025-10-10T20:51:06.157724] [INFO ] [MAIN ] Update Progress: 1642/2373 symbols completed. PBT took 26.4s. Estimated remaining: 1h 42m 51s. Rate: 7.1 symbols/min [2025-10-10T20:51:06.328800] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:51:06.329070] [DEBUG] [LOCAL ] PCM: No existing data file found in primary storage. [2025-10-10T20:51:06.329128] [WARN ] [MAIN ] PCM: No existing data found, performing full refresh instead. [2025-10-10T20:51:06.344795] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-10T20:51:06.357617] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-10T20:51:06.358150] [DEBUG] [LOCAL ] PCM: No primary data file found to delete. [2025-10-10T20:51:06.359844] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (5.27 seconds). [2025-10-10T20:51:06.358585] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-10T20:51:06.391175] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-10T20:51:06.793493] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:51:06.794363] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-10-10T20:51:06.856628] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (3.56 seconds). [2025-10-10T20:51:06.873847] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-10T20:51:06.872617] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-10T20:51:07.489391] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-10T20:51:07.744166] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-10T20:51:08.289375] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-10T20:51:08.569302] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-10T20:51:09.089342] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-10T20:51:09.402704] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-10T20:51:09.468010] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-10T20:51:09.669803] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-10T20:51:09.889342] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-10T20:51:10.689342] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-10T20:51:10.976733] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T20:51:11.322216] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-10T20:51:11.489370] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-10T20:51:12.289350] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-10T20:51:12.395992] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T20:51:12.401638] [INFO ] [REMOTE ] PBI: Full fetch complete (71785 records). [2025-10-10T20:51:12.401891] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-10T20:51:12.402812] [FATAL] [VALIDATOR ] PBI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:51:12.402908] [FATAL] [MAIN ] PBI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:51:12.402974] [WARN ] [MAIN ] PBI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:51:12.403049] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-10T20:51:12.403117] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-10T20:51:12.403155] [INFO ] [LOCAL ] PBI: Starting deletion of derivative data. [2025-10-10T20:51:12.403255] [DEBUG] [LOCAL ] PBI: No derivative data file found to delete. [2025-10-10T20:51:12.403334] [INFO ] [MAIN ] Update Progress: 1643/2373 symbols completed. PBI took 32.7s. Estimated remaining: 1h 42m 42s. Rate: 7.1 symbols/min [2025-10-10T20:51:12.586378] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:51:12.586575] [DEBUG] [LOCAL ] PCN: No existing data file found in primary storage. [2025-10-10T20:51:12.586626] [WARN ] [MAIN ] PCN: No existing data found, performing full refresh instead. [2025-10-10T20:51:12.586757] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-10T20:51:12.586798] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-10T20:51:12.586839] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-10T20:51:12.586871] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-10T20:51:12.961333] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:51:13.089334] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-10-10T20:51:13.144784] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-10T20:51:13.203796] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-10T20:51:13.889373] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-10T20:51:14.217939] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T20:51:14.689417] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-10T20:51:15.489340] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-10T20:51:15.939982] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T20:51:16.177571] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-10T20:51:16.271319] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-10T20:51:16.289319] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-10T20:51:17.089361] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-10T20:51:17.371037] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-10T20:51:17.889355] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-10T20:51:18.102310] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-10T20:51:18.689362] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-10T20:51:19.489404] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-10T20:51:20.069103] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-10T20:51:20.289374] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-10T20:51:20.343449] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-10T20:51:20.410254] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-10T20:51:21.089387] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-10T20:51:21.898012] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-10T20:51:21.901708] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-10T20:51:22.689399] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-10T20:51:23.358784] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-10T20:51:23.489394] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-10T20:51:23.666566] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T20:51:23.781275] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T20:51:24.289369] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-10T20:51:24.826134] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T20:51:25.089422] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-10T20:51:25.328806] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-10T20:51:25.333794] [INFO ] [REMOTE ] PBR: Full fetch complete (77385 records). [2025-10-10T20:51:25.333977] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-10T20:51:25.334860] [FATAL] [VALIDATOR ] PBR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:51:25.334955] [FATAL] [MAIN ] PBR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:51:25.334999] [WARN ] [MAIN ] PBR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:51:25.335041] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-10T20:51:25.335134] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-10T20:51:25.335192] [INFO ] [LOCAL ] PBR: Starting deletion of derivative data. [2025-10-10T20:51:25.335243] [DEBUG] [LOCAL ] PBR: No derivative data file found to delete. [2025-10-10T20:51:25.335308] [INFO ] [MAIN ] Update Progress: 1644/2373 symbols completed. PBR took 45.6s. Estimated remaining: 1h 42m 35s. Rate: 7.1 symbols/min [2025-10-10T20:51:25.535460] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:51:25.535729] [DEBUG] [LOCAL ] PCOR: No existing data file found in primary storage. [2025-10-10T20:51:25.535805] [WARN ] [MAIN ] PCOR: No existing data found, performing full refresh instead. [2025-10-10T20:51:25.535960] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-10T20:51:25.536015] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-10T20:51:25.536061] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-10T20:51:25.536110] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-10T20:51:25.895223] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-10T20:51:25.927300] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:51:26.543080] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-10T20:51:26.689424] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-10-10T20:51:27.489418] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-10T20:51:28.289469] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-10T20:51:28.407190] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-10T20:51:28.586302] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-10T20:51:28.768115] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-10T20:51:29.089353] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-10T20:51:29.173944] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-10T20:51:29.889409] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-10T20:51:30.689390] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-10T20:51:31.072311] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T20:51:31.489387] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-10T20:51:32.194193] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-10T20:51:32.276713] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-10T20:51:32.289320] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-10T20:51:33.089393] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-10T20:51:33.373071] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T20:51:33.889364] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-10T20:51:34.548353] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T20:51:34.689371] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-10T20:51:34.810352] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-10T20:51:34.823326] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T20:51:35.489368] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-10T20:51:35.530049] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T20:51:35.532635] [INFO ] [REMOTE ] PCN: Full fetch complete (33926 records). [2025-10-10T20:51:35.532740] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-10T20:51:35.533241] [FATAL] [VALIDATOR ] PCN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:51:35.533325] [FATAL] [MAIN ] PCN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:51:35.533368] [WARN ] [MAIN ] PCN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:51:35.533408] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-10T20:51:35.533470] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-10T20:51:35.533509] [INFO ] [LOCAL ] PCN: Starting deletion of derivative data. [2025-10-10T20:51:35.533547] [DEBUG] [LOCAL ] PCN: No derivative data file found to delete. [2025-10-10T20:51:35.533606] [INFO ] [MAIN ] Update Progress: 1645/2373 symbols completed. PCN took 23.1s. Estimated remaining: 1h 42m 28s. Rate: 7.1 symbols/min [2025-10-10T20:51:35.711967] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:51:35.712221] [DEBUG] [LOCAL ] PCQ: No existing data file found in primary storage. [2025-10-10T20:51:35.712271] [WARN ] [MAIN ] PCQ: No existing data found, performing full refresh instead. [2025-10-10T20:51:35.712398] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-10T20:51:35.712441] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-10T20:51:35.712484] [DEBUG] [LOCAL ] PCQ: No primary data file found to delete. [2025-10-10T20:51:35.712522] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-10T20:51:36.089083] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:51:36.289410] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-10T20:51:37.089401] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-10-10T20:51:37.442778] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-10T20:51:37.516875] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T20:51:37.889432] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-10T20:51:38.644150] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T20:51:38.667618] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T20:51:38.669079] [INFO ] [REMOTE ] PCM: Full fetch complete (10415 records). [2025-10-10T20:51:38.669150] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-10T20:51:38.694561] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-10T20:51:39.103701] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-10T20:51:39.103887] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-10T20:51:39.104331] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-10T20:51:39.104396] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-10T20:51:39.105389] [DEBUG] [LOCAL ] PCM: Trimmed 10415 records to 6856 (keeping 200 days of data) [2025-10-10T20:51:39.148412] [DEBUG] [LOCAL ] PCM: Primary data saved (6856 records). [2025-10-10T20:51:39.148591] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-10T20:51:39.148708] [INFO ] [MAIN ] Update Progress: 1646/2373 symbols completed. PCM took 33.0s. Estimated remaining: 1h 42m 17s. Rate: 7.1 symbols/min [2025-10-10T20:51:39.323793] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:51:39.324077] [DEBUG] [LOCAL ] PD: No existing data file found in primary storage. [2025-10-10T20:51:39.324119] [WARN ] [MAIN ] PD: No existing data found, performing full refresh instead. [2025-10-10T20:51:39.324261] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-10T20:51:39.324316] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-10T20:51:39.324361] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-10T20:51:39.324396] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-10T20:51:39.499834] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-10T20:51:39.738451] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:51:40.189947] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-10T20:51:40.289385] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-10-10T20:51:40.733447] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T20:51:41.089392] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-10T20:51:41.685625] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T20:51:41.889395] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-10T20:51:42.689408] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-10T20:51:42.944195] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T20:51:43.489405] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-10T20:51:43.674432] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-10T20:51:44.017903] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-10T20:51:44.289445] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-10T20:51:45.089369] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-10T20:51:45.332704] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T20:51:45.372094] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-10T20:51:45.889367] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-10T20:51:46.689366] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-10T20:51:46.926892] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T20:51:47.489477] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-10T20:51:47.768956] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T20:51:48.289408] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-10T20:51:48.967740] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-10T20:51:48.996053] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-10T20:51:49.089393] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-10T20:51:49.889375] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-10T20:51:50.087417] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-10T20:51:50.314447] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T20:51:50.689397] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-10T20:51:50.896149] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-10T20:51:50.901175] [INFO ] [REMOTE ] PCG: Full fetch complete (77348 records). [2025-10-10T20:51:50.901331] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-10T20:51:50.902427] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:51:50.902521] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:51:50.902566] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:51:50.902609] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-10T20:51:50.902701] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-10T20:51:50.902759] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-10-10T20:51:50.902804] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-10-10T20:51:50.902870] [INFO ] [MAIN ] Update Progress: 1647/2373 symbols completed. PCG took 51.7s. Estimated remaining: 1h 42m 10s. Rate: 7.1 symbols/min [2025-10-10T20:51:51.082391] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:51:51.082665] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-10T20:51:51.082723] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-10T20:51:51.082852] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-10T20:51:51.082894] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-10T20:51:51.082934] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-10T20:51:51.082967] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-10T20:51:51.452560] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:51:51.489350] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-10-10T20:51:51.855024] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-10T20:51:52.289383] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-10T20:51:52.469550] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T20:51:53.089384] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-10T20:51:53.294670] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-10T20:51:53.889386] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-10T20:51:54.689391] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-10T20:51:54.845178] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-10T20:51:54.875632] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T20:51:55.489378] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-10T20:51:55.548087] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T20:51:55.552350] [INFO ] [REMOTE ] PCOR: Full fetch complete (69046 records). [2025-10-10T20:51:55.552490] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-10T20:51:55.553277] [FATAL] [VALIDATOR ] PCOR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:51:55.553371] [FATAL] [MAIN ] PCOR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:51:55.553414] [WARN ] [MAIN ] PCOR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:51:55.553518] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-10T20:51:55.553601] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-10T20:51:55.553640] [INFO ] [LOCAL ] PCOR: Starting deletion of derivative data. [2025-10-10T20:51:55.553741] [DEBUG] [LOCAL ] PCOR: No derivative data file found to delete. [2025-10-10T20:51:55.553810] [INFO ] [MAIN ] Update Progress: 1648/2373 symbols completed. PCOR took 30.2s. Estimated remaining: 1h 42m 0s. Rate: 7.1 symbols/min [2025-10-10T20:51:55.738543] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:51:55.738886] [DEBUG] [LOCAL ] PDI: No existing data file found in primary storage. [2025-10-10T20:51:55.738944] [WARN ] [MAIN ] PDI: No existing data found, performing full refresh instead. [2025-10-10T20:51:55.739078] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-10T20:51:55.739122] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-10T20:51:55.739208] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-10T20:51:55.739253] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-10T20:51:56.116729] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:51:56.289405] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-10-10T20:51:56.836718] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-10T20:51:57.089390] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-10T20:51:57.889437] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-10T20:51:58.353581] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T20:51:58.645505] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-10T20:51:58.689337] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-10T20:51:59.445449] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-10T20:51:59.489359] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-10T20:51:59.692728] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T20:51:59.694423] [INFO ] [REMOTE ] PCQ: Full fetch complete (16995 records). [2025-10-10T20:51:59.694497] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-10T20:52:00.111306] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-10T20:52:00.111397] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-10T20:52:00.111872] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-10T20:52:00.111954] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-10T20:52:00.112502] [DEBUG] [LOCAL ] PCQ: Trimmed 16995 records to 12219 (keeping 200 days of data) [2025-10-10T20:52:00.186546] [DEBUG] [LOCAL ] PCQ: Primary data saved (12219 records). [2025-10-10T20:52:00.186714] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-10T20:52:00.186800] [INFO ] [MAIN ] Update Progress: 1649/2373 symbols completed. PCQ took 24.7s. Estimated remaining: 1h 41m 50s. Rate: 7.1 symbols/min [2025-10-10T20:52:00.289479] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-10T20:52:00.374476] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:52:00.374686] [DEBUG] [LOCAL ] PDM: No existing data file found in primary storage. [2025-10-10T20:52:00.374742] [WARN ] [MAIN ] PDM: No existing data found, performing full refresh instead. [2025-10-10T20:52:00.374861] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-10T20:52:00.374905] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-10T20:52:00.374977] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-10T20:52:00.375042] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-10T20:52:00.728767] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:52:01.089412] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-10-10T20:52:01.889425] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-10T20:52:02.391157] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (2.90 seconds). [2025-10-10T20:52:02.416531] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-10T20:52:02.491283] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T20:52:02.689354] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-10T20:52:02.806895] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-10T20:52:03.489433] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-10T20:52:03.972396] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T20:52:04.289392] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-10T20:52:05.089422] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-10T20:52:05.623141] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-10T20:52:05.658273] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-10T20:52:05.889362] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-10T20:52:06.001883] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T20:52:06.689463] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-10T20:52:07.489431] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-10T20:52:08.026196] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T20:52:08.127900] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-10T20:52:08.289413] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-10T20:52:08.789332] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T20:52:09.089398] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-10T20:52:09.675449] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-10T20:52:09.889399] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-10T20:52:10.135499] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-10T20:52:10.689403] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-10T20:52:11.489457] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-10T20:52:12.267709] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-10T20:52:12.289348] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-10T20:52:12.541566] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T20:52:12.858908] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T20:52:13.089401] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-10T20:52:13.889435] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-10T20:52:13.972795] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T20:52:14.210372] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-10T20:52:14.689486] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-10T20:52:15.354823] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-10T20:52:15.489434] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-10T20:52:15.909043] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T20:52:15.977835] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-10T20:52:16.289395] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-10T20:52:16.824613] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-10T20:52:17.089412] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-10T20:52:17.889410] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-10T20:52:18.461996] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-10T20:52:18.689437] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-10T20:52:19.229272] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-10T20:52:19.489440] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-10T20:52:19.984975] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-10T20:52:20.289419] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-10T20:52:20.582305] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T20:52:21.089399] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-10T20:52:21.452702] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-10T20:52:21.834852] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-10T20:52:21.889459] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-10T20:52:22.689414] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-10T20:52:23.081089] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-10T20:52:23.082262] [INFO ] [REMOTE ] PDCC: Full fetch complete (1343 records). [2025-10-10T20:52:23.082337] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-10T20:52:23.266952] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-10T20:52:23.267209] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:52:23.267278] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:52:23.267372] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-10T20:52:23.267436] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-10T20:52:23.267472] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-10T20:52:23.267510] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-10T20:52:23.267590] [INFO ] [MAIN ] Update Progress: 1650/2373 symbols completed. PDCC took 32.4s. Estimated remaining: 1h 41m 48s. Rate: 7.1 symbols/min [2025-10-10T20:52:23.443225] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:52:23.443484] [DEBUG] [LOCAL ] PDO: No existing data file found in primary storage. [2025-10-10T20:52:23.443540] [WARN ] [MAIN ] PDO: No existing data found, performing full refresh instead. [2025-10-10T20:52:23.443696] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-10T20:52:23.443750] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-10T20:52:23.443795] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-10T20:52:23.443828] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-10T20:52:23.491377] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-10T20:52:23.847061] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:52:24.046421] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-10T20:52:24.289392] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-10-10T20:52:24.896844] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-10T20:52:25.089416] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-10T20:52:25.889468] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-10T20:52:26.142599] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T20:52:26.689477] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-10T20:52:26.977945] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T20:52:27.489404] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-10T20:52:28.072938] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-10T20:52:28.289413] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-10T20:52:28.359581] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T20:52:28.364595] [INFO ] [REMOTE ] PD: Full fetch complete (67611 records). [2025-10-10T20:52:28.364751] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-10T20:52:28.365951] [FATAL] [VALIDATOR ] PD: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:52:28.366046] [FATAL] [MAIN ] PD: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:52:28.366114] [WARN ] [MAIN ] PD: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:52:28.366198] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-10T20:52:28.366304] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-10T20:52:28.366386] [INFO ] [LOCAL ] PD: Starting deletion of derivative data. [2025-10-10T20:52:28.366461] [DEBUG] [LOCAL ] PD: No derivative data file found to delete. [2025-10-10T20:52:28.366532] [INFO ] [MAIN ] Update Progress: 1651/2373 symbols completed. PD took 49.2s. Estimated remaining: 1h 41m 38s. Rate: 7.1 symbols/min [2025-10-10T20:52:28.547425] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T20:52:28.582134] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:52:28.582390] [DEBUG] [LOCAL ] PDS: No existing data file found in primary storage. [2025-10-10T20:52:28.582431] [WARN ] [MAIN ] PDS: No existing data found, performing full refresh instead. [2025-10-10T20:52:28.582555] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-10T20:52:28.582598] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-10T20:52:28.582664] [DEBUG] [LOCAL ] PDS: No primary data file found to delete. [2025-10-10T20:52:28.582727] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-10T20:52:28.976541] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:52:29.089446] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-10T20:52:29.890143] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-10-10T20:52:29.889963] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T20:52:29.938276] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T20:52:29.945431] [INFO ] [REMOTE ] PDI: Full fetch complete (72567 records). [2025-10-10T20:52:29.945763] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-10T20:52:29.947125] [FATAL] [VALIDATOR ] PDI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:52:29.947256] [FATAL] [MAIN ] PDI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:52:29.947357] [WARN ] [MAIN ] PDI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:52:29.947459] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-10T20:52:29.947571] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-10T20:52:29.947638] [INFO ] [LOCAL ] PDI: Starting deletion of derivative data. [2025-10-10T20:52:29.947764] [DEBUG] [LOCAL ] PDI: No derivative data file found to delete. [2025-10-10T20:52:29.947903] [INFO ] [MAIN ] Update Progress: 1652/2373 symbols completed. PDI took 34.4s. Estimated remaining: 1h 41m 27s. Rate: 7.1 symbols/min [2025-10-10T20:52:30.233893] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:52:30.234093] [DEBUG] [LOCAL ] PDT: No existing data file found in primary storage. [2025-10-10T20:52:30.234130] [WARN ] [MAIN ] PDT: No existing data found, performing full refresh instead. [2025-10-10T20:52:30.234254] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-10T20:52:30.234296] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-10T20:52:30.234337] [DEBUG] [LOCAL ] PDT: No primary data file found to delete. [2025-10-10T20:52:30.234369] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-10T20:52:30.694729] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-10T20:52:30.701708] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:52:31.078973] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T20:52:31.489398] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-10-10T20:52:32.289376] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-10T20:52:32.409383] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T20:52:33.012287] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T20:52:33.089386] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-10T20:52:33.889424] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-10T20:52:33.978804] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T20:52:33.995846] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-10T20:52:34.689416] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-10T20:52:35.161681] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-10T20:52:35.489425] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-10T20:52:36.255966] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T20:52:36.259974] [INFO ] [REMOTE ] PDM: Full fetch complete (56787 records). [2025-10-10T20:52:36.260129] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-10T20:52:36.261136] [FATAL] [VALIDATOR ] PDM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:52:36.261251] [FATAL] [MAIN ] PDM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:52:36.261306] [WARN ] [MAIN ] PDM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:52:36.261366] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-10T20:52:36.261450] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-10T20:52:36.261503] [INFO ] [LOCAL ] PDM: Starting deletion of derivative data. [2025-10-10T20:52:36.261567] [DEBUG] [LOCAL ] PDM: No derivative data file found to delete. [2025-10-10T20:52:36.261699] [INFO ] [MAIN ] Update Progress: 1653/2373 symbols completed. PDM took 36.1s. Estimated remaining: 1h 41m 17s. Rate: 7.1 symbols/min [2025-10-10T20:52:36.300143] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-10T20:52:36.460573] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T20:52:36.488109] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:52:36.495196] [DEBUG] [LOCAL ] PDX: No existing data file found in primary storage. [2025-10-10T20:52:36.495380] [WARN ] [MAIN ] PDX: No existing data found, performing full refresh instead. [2025-10-10T20:52:36.495853] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-10T20:52:36.495899] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-10T20:52:36.495944] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-10T20:52:36.495980] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-10T20:52:36.932171] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:52:37.089428] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-10T20:52:37.575513] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T20:52:37.889354] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-10T20:52:38.415372] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T20:52:38.689637] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-10T20:52:39.221224] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-10T20:52:39.489362] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-10T20:52:40.072377] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-10T20:52:40.289392] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-10T20:52:40.711381] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-10T20:52:41.089391] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-10T20:52:41.776152] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-10T20:52:41.889372] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-10T20:52:42.352042] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T20:52:42.689356] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-10T20:52:43.079861] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-10T20:52:43.489359] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-10-10T20:52:43.902976] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-10T20:52:44.289383] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-10T20:52:44.767011] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T20:52:45.089380] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-10T20:52:45.622467] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-10T20:52:45.889457] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-10T20:52:46.456053] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-10T20:52:46.689392] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-10T20:52:47.447260] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-10T20:52:47.489398] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-10T20:52:48.289400] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-10T20:52:48.505549] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T20:52:48.782584] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T20:52:49.055770] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-10T20:52:49.089364] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-10T20:52:49.889394] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-10T20:52:50.256244] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T20:52:50.689379] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-10T20:52:51.176120] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T20:52:51.489341] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-10T20:52:51.701724] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-10T20:52:52.289369] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-10T20:52:53.089409] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-10T20:52:53.119151] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T20:52:53.237598] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T20:52:53.239468] [INFO ] [REMOTE ] PDS: Full fetch complete (25537 records). [2025-10-10T20:52:53.239547] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-10T20:52:53.610930] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-10T20:52:53.611010] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-10T20:52:53.611601] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-10T20:52:53.611663] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-10T20:52:53.612386] [DEBUG] [LOCAL ] PDS: Trimmed 25537 records to 17700 (keeping 200 days of data) [2025-10-10T20:52:53.716297] [DEBUG] [LOCAL ] PDS: Primary data saved (17700 records). [2025-10-10T20:52:53.716443] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-10T20:52:53.716516] [INFO ] [MAIN ] Update Progress: 1654/2373 symbols completed. PDS took 25.3s. Estimated remaining: 1h 41m 13s. Rate: 7.1 symbols/min [2025-10-10T20:52:53.891106] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-10T20:52:53.891026] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:52:53.892081] [DEBUG] [LOCAL ] PEB: No existing data file found in primary storage. [2025-10-10T20:52:53.892136] [WARN ] [MAIN ] PEB: No existing data found, performing full refresh instead. [2025-10-10T20:52:53.892279] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-10T20:52:53.892335] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-10T20:52:53.892381] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-10T20:52:53.892414] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-10T20:52:54.262196] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:52:54.360963] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T20:52:54.689368] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-10T20:52:55.395371] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-10T20:52:55.489401] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-10T20:52:55.872117] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-10T20:52:55.874421] [INFO ] [REMOTE ] PDT: Full fetch complete (25315 records). [2025-10-10T20:52:55.874497] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-10T20:52:56.250773] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-10T20:52:56.250850] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-10T20:52:56.251409] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-10T20:52:56.251520] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-10T20:52:56.252212] [DEBUG] [LOCAL ] PDT: Trimmed 25315 records to 17761 (keeping 200 days of data) [2025-10-10T20:52:56.298130] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-10T20:52:56.364579] [DEBUG] [LOCAL ] PDT: Primary data saved (17761 records). [2025-10-10T20:52:56.364730] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-10T20:52:56.364809] [INFO ] [MAIN ] Update Progress: 1655/2373 symbols completed. PDT took 26.4s. Estimated remaining: 1h 41m 2s. Rate: 7.1 symbols/min [2025-10-10T20:52:56.538740] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:52:56.538906] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-10T20:52:56.538944] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-10T20:52:56.539076] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-10T20:52:56.539117] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-10T20:52:56.539170] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-10T20:52:56.539203] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-10T20:52:56.901605] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:52:57.012193] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T20:52:57.089386] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-10T20:52:57.426080] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-10T20:52:57.889411] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-10T20:52:58.686578] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T20:52:58.693273] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-10-10T20:52:59.116059] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T20:52:59.489361] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-10-10T20:53:00.289360] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-10T20:53:00.763948] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-10T20:53:01.089417] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-10T20:53:01.889377] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-10T20:53:01.904831] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-10T20:53:02.689390] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-10T20:53:02.997818] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (3.51 seconds). [2025-10-10T20:53:03.489382] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-10T20:53:04.281785] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (3.19 seconds). [2025-10-10T20:53:04.292365] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-10T20:53:04.446667] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T20:53:04.550188] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-10T20:53:05.089331] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-10T20:53:05.675529] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-10T20:53:05.830674] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T20:53:05.833621] [INFO ] [REMOTE ] PDO: Full fetch complete (46930 records). [2025-10-10T20:53:05.833740] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-10T20:53:05.834267] [FATAL] [VALIDATOR ] PDO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:53:05.834372] [FATAL] [MAIN ] PDO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:53:05.834418] [WARN ] [MAIN ] PDO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:53:05.834483] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-10T20:53:05.834545] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-10T20:53:05.834580] [INFO ] [LOCAL ] PDO: Starting deletion of derivative data. [2025-10-10T20:53:05.834619] [DEBUG] [LOCAL ] PDO: No derivative data file found to delete. [2025-10-10T20:53:05.834706] [INFO ] [MAIN ] Update Progress: 1656/2373 symbols completed. PDO took 42.6s. Estimated remaining: 1h 40m 54s. Rate: 7.1 symbols/min [2025-10-10T20:53:05.895047] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-10T20:53:06.010288] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:53:06.010533] [DEBUG] [LOCAL ] PEN: No existing data file found in primary storage. [2025-10-10T20:53:06.010669] [WARN ] [MAIN ] PEN: No existing data found, performing full refresh instead. [2025-10-10T20:53:06.010844] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-10T20:53:06.010895] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-10T20:53:06.010940] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-10T20:53:06.010973] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-10T20:53:06.373072] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:53:06.399498] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-10T20:53:06.689367] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-10T20:53:07.489343] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-10T20:53:07.918833] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T20:53:08.010449] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T20:53:08.289373] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-10T20:53:09.089340] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-10T20:53:09.726232] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-10T20:53:09.889339] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-10T20:53:10.435974] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T20:53:10.511673] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-10T20:53:10.689387] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-10T20:53:11.489412] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-10T20:53:12.019137] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T20:53:12.289401] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-10-10T20:53:12.801736] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T20:53:12.863367] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-10T20:53:13.089383] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-10T20:53:13.274945] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-10T20:53:13.889384] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-10T20:53:14.689376] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-10T20:53:15.136198] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-10T20:53:15.137627] [INFO ] [REMOTE ] PDX: Full fetch complete (23720 records). [2025-10-10T20:53:15.137748] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-10T20:53:15.138174] [FATAL] [VALIDATOR ] PDX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:53:15.138255] [FATAL] [MAIN ] PDX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:53:15.138297] [WARN ] [MAIN ] PDX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:53:15.138361] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-10T20:53:15.138422] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-10T20:53:15.138458] [INFO ] [LOCAL ] PDX: Starting deletion of derivative data. [2025-10-10T20:53:15.138496] [DEBUG] [LOCAL ] PDX: No derivative data file found to delete. [2025-10-10T20:53:15.138547] [INFO ] [MAIN ] Update Progress: 1657/2373 symbols completed. PDX took 38.9s. Estimated remaining: 1h 40m 46s. Rate: 7.1 symbols/min [2025-10-10T20:53:15.313974] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:53:15.314208] [DEBUG] [LOCAL ] PEO: No existing data file found in primary storage. [2025-10-10T20:53:15.314276] [WARN ] [MAIN ] PEO: No existing data found, performing full refresh instead. [2025-10-10T20:53:15.314410] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-10T20:53:15.314476] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-10T20:53:15.314713] [DEBUG] [LOCAL ] PEO: No primary data file found to delete. [2025-10-10T20:53:15.314802] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-10T20:53:15.489793] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-10T20:53:15.502035] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-10T20:53:15.633696] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-10T20:53:15.776795] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:53:16.289396] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-10-10T20:53:16.910747] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-10T20:53:17.089358] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-10T20:53:17.730301] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-10T20:53:17.889353] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-10T20:53:18.164604] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-10T20:53:18.689448] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-10T20:53:19.170363] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T20:53:19.489385] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-10T20:53:19.891771] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-10T20:53:20.289393] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-10T20:53:21.089378] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-10T20:53:21.471204] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T20:53:21.889449] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-10T20:53:22.446414] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-10T20:53:22.689368] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-10T20:53:22.811509] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T20:53:23.326393] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T20:53:23.489357] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-10T20:53:24.289361] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-10T20:53:24.688225] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-10T20:53:25.089425] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-10T20:53:25.357604] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T20:53:25.889410] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-10T20:53:26.033066] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T20:53:26.118687] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-10T20:53:26.689394] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-10T20:53:26.770752] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T20:53:26.774872] [INFO ] [REMOTE ] PEB: Full fetch complete (72552 records). [2025-10-10T20:53:26.774962] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-10T20:53:26.775688] [FATAL] [VALIDATOR ] PEB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:53:26.775773] [FATAL] [MAIN ] PEB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:53:26.775816] [WARN ] [MAIN ] PEB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:53:26.775868] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-10T20:53:26.775960] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-10T20:53:26.776007] [INFO ] [LOCAL ] PEB: Starting deletion of derivative data. [2025-10-10T20:53:26.776060] [DEBUG] [LOCAL ] PEB: No derivative data file found to delete. [2025-10-10T20:53:26.776132] [INFO ] [MAIN ] Update Progress: 1658/2373 symbols completed. PEB took 33.1s. Estimated remaining: 1h 40m 39s. Rate: 7.1 symbols/min [2025-10-10T20:53:26.940439] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:53:26.940572] [DEBUG] [LOCAL ] PERF: No existing data file found in primary storage. [2025-10-10T20:53:26.940607] [WARN ] [MAIN ] PERF: No existing data found, performing full refresh instead. [2025-10-10T20:53:26.940748] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-10T20:53:26.940803] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-10T20:53:26.940881] [DEBUG] [LOCAL ] PERF: No primary data file found to delete. [2025-10-10T20:53:26.940932] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-10T20:53:27.285785] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:53:27.489350] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-10-10T20:53:28.289403] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-10T20:53:28.590048] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T20:53:28.843399] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T20:53:29.089339] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-10T20:53:29.299176] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-10T20:53:29.889381] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-10T20:53:30.642806] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T20:53:30.689363] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-10T20:53:31.259026] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T20:53:31.489403] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-10T20:53:32.289417] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-10T20:53:32.540892] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-10T20:53:32.874549] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-10T20:53:33.089399] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-10T20:53:33.809583] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T20:53:33.889331] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-10T20:53:34.385583] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T20:53:34.689356] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-10T20:53:35.489392] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-10T20:53:35.525675] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-10T20:53:35.757172] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-10T20:53:36.289402] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-10T20:53:36.557779] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-10T20:53:37.089379] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-10T20:53:37.889354] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-10T20:53:38.183000] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T20:53:38.447007] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-10T20:53:38.689387] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-10T20:53:38.945350] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-10T20:53:39.411108] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-10T20:53:39.413891] [INFO ] [REMOTE ] PEN: Full fetch complete (43895 records). [2025-10-10T20:53:39.413968] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-10T20:53:39.414511] [FATAL] [VALIDATOR ] PEN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:53:39.414601] [FATAL] [MAIN ] PEN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:53:39.414677] [WARN ] [MAIN ] PEN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:53:39.414737] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-10T20:53:39.414793] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-10T20:53:39.414828] [INFO ] [LOCAL ] PEN: Starting deletion of derivative data. [2025-10-10T20:53:39.414880] [DEBUG] [LOCAL ] PEN: No derivative data file found to delete. [2025-10-10T20:53:39.414935] [INFO ] [MAIN ] Update Progress: 1659/2373 symbols completed. PEN took 33.6s. Estimated remaining: 1h 40m 32s. Rate: 7.1 symbols/min [2025-10-10T20:53:39.494548] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-10T20:53:39.585801] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:53:39.585940] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-10T20:53:39.585977] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-10T20:53:39.586110] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-10T20:53:39.586167] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-10T20:53:39.586213] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-10T20:53:39.586247] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-10T20:53:39.936377] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:53:40.289461] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-10T20:53:40.575297] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-10T20:53:41.089437] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-10T20:53:41.386744] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-10T20:53:41.889406] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-10T20:53:42.280766] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T20:53:42.392722] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-10T20:53:42.397379] [INFO ] [REMOTE ] PEG: Full fetch complete (76333 records). [2025-10-10T20:53:42.397532] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-10T20:53:42.398235] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:53:42.398326] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:53:42.398369] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:53:42.398409] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-10T20:53:42.398464] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-10T20:53:42.398499] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-10-10T20:53:42.398538] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-10-10T20:53:42.398595] [INFO ] [MAIN ] Update Progress: 1660/2373 symbols completed. PEG took 46.0s. Estimated remaining: 1h 40m 21s. Rate: 7.1 symbols/min [2025-10-10T20:53:42.572212] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:53:42.572383] [DEBUG] [LOCAL ] PFD: No existing data file found in primary storage. [2025-10-10T20:53:42.572420] [WARN ] [MAIN ] PFD: No existing data found, performing full refresh instead. [2025-10-10T20:53:42.572544] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-10T20:53:42.572586] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-10T20:53:42.572628] [DEBUG] [LOCAL ] PFD: No primary data file found to delete. [2025-10-10T20:53:42.572697] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-10T20:53:42.694600] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-10-10T20:53:42.934904] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:53:43.134703] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T20:53:43.135030] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-10-10T20:53:43.135116] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T20:53:43.135161] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-10T20:53:43.135197] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T20:53:43.135234] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-10T20:53:43.135288] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-10T20:53:43.135322] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-10T20:53:43.135360] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-10T20:53:43.135440] [INFO ] [MAIN ] Update Progress: 1661/2373 symbols completed. PEW took 3.7s. Estimated remaining: 1h 40m 9s. Rate: 7.1 symbols/min [2025-10-10T20:53:43.302801] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:53:43.303039] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-10T20:53:43.303089] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-10T20:53:43.303197] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-10T20:53:43.303237] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-10T20:53:43.303278] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-10T20:53:43.303310] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-10T20:53:43.497629] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-10T20:53:43.659482] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:53:44.289351] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-10-10T20:53:44.633278] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-10T20:53:45.089429] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-10T20:53:45.889352] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-10-10T20:53:46.066424] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T20:53:46.689367] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-10T20:53:46.715076] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-10T20:53:47.083503] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-10-10T20:53:47.489400] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-10T20:53:47.878903] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-10T20:53:47.880447] [INFO ] [REMOTE ] PEO: Full fetch complete (16246 records). [2025-10-10T20:53:47.880515] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-10T20:53:48.233661] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-10T20:53:48.233752] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-10T20:53:48.234151] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-10T20:53:48.234191] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-10T20:53:48.234698] [DEBUG] [LOCAL ] PEO: Trimmed 16246 records to 11325 (keeping 200 days of data) [2025-10-10T20:53:48.290432] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-10T20:53:48.303563] [DEBUG] [LOCAL ] PEO: Primary data saved (11325 records). [2025-10-10T20:53:48.303981] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-10T20:53:48.304068] [INFO ] [MAIN ] Update Progress: 1662/2373 symbols completed. PEO took 33.2s. Estimated remaining: 1h 39m 60s. Rate: 7.1 symbols/min [2025-10-10T20:53:48.470914] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:53:48.471257] [DEBUG] [LOCAL ] PFGC: No existing data file found in primary storage. [2025-10-10T20:53:48.471309] [WARN ] [MAIN ] PFGC: No existing data found, performing full refresh instead. [2025-10-10T20:53:48.471415] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-10T20:53:48.471456] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-10T20:53:48.471496] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-10T20:53:48.471527] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-10T20:53:48.823588] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:53:48.835004] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-10T20:53:49.089407] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-10-10T20:53:49.253527] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-10T20:53:49.889357] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-10T20:53:50.689378] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-10T20:53:50.891754] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T20:53:51.398297] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-10T20:53:51.489404] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-10T20:53:52.289448] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-10T20:53:53.089348] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-10T20:53:53.341056] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-10-10T20:53:53.456853] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T20:53:53.543965] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-10T20:53:53.642040] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-10T20:53:53.889381] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-10T20:53:54.689372] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-10T20:53:55.072520] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T20:53:55.489408] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-10T20:53:56.289383] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-10T20:53:56.575156] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T20:53:56.577082] [INFO ] [REMOTE ] PERF: Full fetch complete (22061 records). [2025-10-10T20:53:56.577164] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-10T20:53:56.972854] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-10T20:53:56.973098] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-10T20:53:56.973670] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-10T20:53:56.973782] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-10T20:53:56.974609] [DEBUG] [LOCAL ] PERF: Trimmed 22061 records to 14504 (keeping 200 days of data) [2025-10-10T20:53:57.054044] [DEBUG] [LOCAL ] PERF: Primary data saved (14504 records). [2025-10-10T20:53:57.054179] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-10T20:53:57.054252] [INFO ] [MAIN ] Update Progress: 1663/2373 symbols completed. PERF took 30.3s. Estimated remaining: 1h 39m 51s. Rate: 7.1 symbols/min [2025-10-10T20:53:57.093123] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-10T20:53:57.112869] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-10T20:53:57.245348] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:53:57.245666] [DEBUG] [LOCAL ] PFH: No existing data file found in primary storage. [2025-10-10T20:53:57.245799] [WARN ] [MAIN ] PFH: No existing data found, performing full refresh instead. [2025-10-10T20:53:57.246012] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-10T20:53:57.246069] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-10T20:53:57.246113] [DEBUG] [LOCAL ] PFH: No primary data file found to delete. [2025-10-10T20:53:57.246145] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-10T20:53:57.568827] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-10-10T20:53:57.651611] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:53:57.889401] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-10T20:53:58.689360] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-10-10T20:53:58.951535] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T20:53:59.489364] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-10T20:53:59.885212] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-10T20:54:00.289363] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-10T20:54:00.824594] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.94 seconds). [2025-10-10T20:54:01.089368] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-10T20:54:01.375475] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-10T20:54:01.454396] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T20:54:01.889385] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-10T20:54:02.689372] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-10T20:54:02.963674] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-10T20:54:03.489451] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-10T20:54:04.228712] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (3.14 seconds). [2025-10-10T20:54:04.289328] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-10T20:54:04.340791] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-10T20:54:04.688507] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T20:54:05.089349] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-10T20:54:05.889332] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-10T20:54:06.106069] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-10T20:54:06.594541] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-10T20:54:06.689343] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-10T20:54:07.252999] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-10-10T20:54:07.490735] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-10T20:54:07.490489] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-10T20:54:08.289472] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-10T20:54:09.089483] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-10T20:54:09.889374] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-10T20:54:10.039397] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-10T20:54:10.080859] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-10T20:54:10.352940] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-10T20:54:10.689364] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-10T20:54:10.880940] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-10T20:54:11.489474] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-10T20:54:12.289391] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-10T20:54:12.425219] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-10T20:54:13.089480] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-10T20:54:13.852096] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (3.16 seconds). [2025-10-10T20:54:13.889327] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-10T20:54:14.028351] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T20:54:14.136575] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T20:54:14.689450] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-10T20:54:15.489349] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-10T20:54:15.664272] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-10T20:54:16.289401] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-10T20:54:16.725376] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-10-10T20:54:17.089459] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-10T20:54:17.492062] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-10T20:54:17.544358] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-10T20:54:17.625729] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-10T20:54:17.626967] [INFO ] [REMOTE ] PFD: Full fetch complete (7628 records). [2025-10-10T20:54:17.627038] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-10T20:54:17.894634] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-10T20:54:17.990103] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-10T20:54:17.990203] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-10T20:54:17.990460] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-10T20:54:17.990520] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-10T20:54:17.991007] [DEBUG] [LOCAL ] PFD: Trimmed 7628 records to 5461 (keeping 200 days of data) [2025-10-10T20:54:18.025113] [DEBUG] [LOCAL ] PFD: Primary data saved (5461 records). [2025-10-10T20:54:18.025258] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-10T20:54:18.025347] [INFO ] [MAIN ] Update Progress: 1664/2373 symbols completed. PFD took 35.6s. Estimated remaining: 1h 39m 48s. Rate: 7.1 symbols/min [2025-10-10T20:54:18.196052] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:54:18.196248] [DEBUG] [LOCAL ] PFL: No existing data file found in primary storage. [2025-10-10T20:54:18.196285] [WARN ] [MAIN ] PFL: No existing data found, performing full refresh instead. [2025-10-10T20:54:18.196401] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-10T20:54:18.196471] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-10T20:54:18.196535] [DEBUG] [LOCAL ] PFL: No primary data file found to delete. [2025-10-10T20:54:18.196570] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-10T20:54:18.565997] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:54:18.679780] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-10T20:54:18.689328] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-10T20:54:19.489385] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-10-10T20:54:20.289355] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-10T20:54:20.656201] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-10T20:54:20.770156] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-10T20:54:21.089357] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-10T20:54:21.836056] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (3.15 seconds). [2025-10-10T20:54:21.865904] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-10T20:54:21.889327] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-10T20:54:22.559359] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T20:54:22.560293] [INFO ] [REMOTE ] PFH: Full fetch complete (10043 records). [2025-10-10T20:54:22.560359] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-10T20:54:22.697610] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-10T20:54:22.942179] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-10-10T20:54:22.942266] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-10-10T20:54:22.942541] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-10-10T20:54:22.942581] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-10-10T20:54:22.943072] [DEBUG] [LOCAL ] PFH: Trimmed 10043 records to 6837 (keeping 200 days of data) [2025-10-10T20:54:22.992042] [DEBUG] [LOCAL ] PFH: Primary data saved (6837 records). [2025-10-10T20:54:22.992178] [INFO ] [MAIN ] PFH: Full history saved. [2025-10-10T20:54:22.992250] [INFO ] [MAIN ] Update Progress: 1665/2373 symbols completed. PFH took 25.9s. Estimated remaining: 1h 39m 38s. Rate: 7.1 symbols/min [2025-10-10T20:54:23.164146] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:54:23.164382] [DEBUG] [LOCAL ] PFLT: No existing data file found in primary storage. [2025-10-10T20:54:23.164437] [WARN ] [MAIN ] PFLT: No existing data found, performing full refresh instead. [2025-10-10T20:54:23.164549] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-10T20:54:23.164592] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-10T20:54:23.164638] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-10T20:54:23.164724] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-10T20:54:23.497479] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-10T20:54:23.540999] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:54:23.950907] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T20:54:24.289331] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-10T20:54:24.398570] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T20:54:24.403043] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-10-10T20:54:24.403155] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-10T20:54:24.403849] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:54:24.403940] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:54:24.404016] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:54:24.404105] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-10T20:54:24.404184] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-10T20:54:24.404221] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-10-10T20:54:24.404260] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-10-10T20:54:24.404316] [INFO ] [MAIN ] Update Progress: 1666/2373 symbols completed. PFE took 41.3s. Estimated remaining: 1h 39m 27s. Rate: 7.1 symbols/min [2025-10-10T20:54:24.574593] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:54:24.574780] [DEBUG] [LOCAL ] PFN: No existing data file found in primary storage. [2025-10-10T20:54:24.574824] [WARN ] [MAIN ] PFN: No existing data found, performing full refresh instead. [2025-10-10T20:54:24.574966] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-10T20:54:24.575036] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-10T20:54:24.575086] [DEBUG] [LOCAL ] PFN: No primary data file found to delete. [2025-10-10T20:54:24.575120] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-10T20:54:24.927598] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:54:25.089374] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-10T20:54:25.480739] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-10T20:54:25.889369] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-10-10T20:54:26.689371] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-10-10T20:54:27.068986] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T20:54:27.264235] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T20:54:27.489378] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-10T20:54:28.289390] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-10T20:54:28.596126] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-10T20:54:28.743701] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T20:54:29.089417] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-10T20:54:29.889426] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-10T20:54:30.280699] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-10T20:54:30.641032] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-10T20:54:30.689431] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-10T20:54:30.835450] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-10T20:54:31.489435] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-10T20:54:32.289356] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-10T20:54:32.400436] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T20:54:32.404848] [INFO ] [REMOTE ] PFGC: Full fetch complete (67130 records). [2025-10-10T20:54:32.404944] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-10T20:54:32.405633] [FATAL] [VALIDATOR ] PFGC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:54:32.405743] [FATAL] [MAIN ] PFGC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:54:32.405808] [WARN ] [MAIN ] PFGC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:54:32.405880] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-10T20:54:32.405942] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-10T20:54:32.405978] [INFO ] [LOCAL ] PFGC: Starting deletion of derivative data. [2025-10-10T20:54:32.406017] [DEBUG] [LOCAL ] PFGC: No derivative data file found to delete. [2025-10-10T20:54:32.406075] [INFO ] [MAIN ] Update Progress: 1667/2373 symbols completed. PFGC took 44.1s. Estimated remaining: 1h 39m 18s. Rate: 7.1 symbols/min [2025-10-10T20:54:32.602193] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:54:32.602381] [DEBUG] [LOCAL ] PFO: No existing data file found in primary storage. [2025-10-10T20:54:32.602434] [WARN ] [MAIN ] PFO: No existing data found, performing full refresh instead. [2025-10-10T20:54:32.602572] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-10T20:54:32.602769] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-10T20:54:32.603582] [DEBUG] [LOCAL ] PFO: No primary data file found to delete. [2025-10-10T20:54:32.605131] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-10T20:54:32.605263] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-10T20:54:32.955891] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:54:33.089346] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-10T20:54:33.196861] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-10T20:54:33.889432] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-10T20:54:34.689402] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-10T20:54:34.922376] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-10T20:54:34.991300] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T20:54:35.489350] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-10-10T20:54:35.991207] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T20:54:36.289382] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-10T20:54:36.346755] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-10T20:54:37.089475] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-10T20:54:37.114529] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-10T20:54:37.889363] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-10T20:54:38.689453] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-10T20:54:38.947870] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-10T20:54:39.106745] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-10T20:54:39.489358] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-10T20:54:39.507326] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-10T20:54:40.289442] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-10T20:54:40.764561] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T20:54:41.089846] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-10T20:54:41.090777] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-10T20:54:41.889401] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-10T20:54:42.520475] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-10T20:54:42.654385] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-10T20:54:42.689349] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-10T20:54:43.489370] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-10T20:54:44.289352] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-10T20:54:44.318788] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-10T20:54:44.845201] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-10T20:54:45.011344] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-10T20:54:45.089335] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-10T20:54:45.889451] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-10T20:54:46.343590] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-10T20:54:46.689358] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-10T20:54:47.489364] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-10T20:54:47.831888] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-10T20:54:47.883717] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-10T20:54:48.289385] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-10T20:54:48.338849] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-10T20:54:49.089381] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-10T20:54:49.462980] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-10T20:54:49.465259] [INFO ] [REMOTE ] PFL: Full fetch complete (20360 records). [2025-10-10T20:54:49.465333] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-10T20:54:49.820085] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-10T20:54:49.820161] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-10T20:54:49.820620] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-10T20:54:49.820690] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-10T20:54:49.821234] [DEBUG] [LOCAL ] PFL: Trimmed 20360 records to 14264 (keeping 200 days of data) [2025-10-10T20:54:49.889415] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-10T20:54:49.905116] [DEBUG] [LOCAL ] PFL: Primary data saved (14264 records). [2025-10-10T20:54:49.905210] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-10T20:54:49.905278] [INFO ] [MAIN ] Update Progress: 1668/2373 symbols completed. PFL took 31.9s. Estimated remaining: 1h 39m 14s. Rate: 7.1 symbols/min [2025-10-10T20:54:50.076677] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:54:50.076813] [DEBUG] [LOCAL ] PFS: No existing data file found in primary storage. [2025-10-10T20:54:50.076851] [WARN ] [MAIN ] PFS: No existing data found, performing full refresh instead. [2025-10-10T20:54:50.076993] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-10T20:54:50.077057] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-10T20:54:50.077115] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-10T20:54:50.077159] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-10T20:54:50.439779] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:54:50.499257] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-10T20:54:50.689357] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-10T20:54:51.283434] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T20:54:51.489385] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-10T20:54:52.137270] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-10T20:54:52.286288] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-10T20:54:52.289322] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-10T20:54:53.089421] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-10T20:54:53.129816] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-10T20:54:53.889381] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-10T20:54:54.689429] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-10-10T20:54:54.917941] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T20:54:55.303992] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T20:54:55.489344] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-10T20:54:56.210599] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T20:54:56.289404] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-10T20:54:57.089390] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-10T20:54:57.889487] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-10T20:54:58.382592] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-10T20:54:58.385328] [INFO ] [REMOTE ] PFN: Full fetch complete (31064 records). [2025-10-10T20:54:58.385407] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-10T20:54:58.596410] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T20:54:58.694688] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-10T20:54:58.838840] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-10T20:54:58.839191] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-10T20:54:58.840608] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-10T20:54:58.842743] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-10T20:54:58.842607] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (3.35 seconds). [2025-10-10T20:54:58.854719] [DEBUG] [LOCAL ] PFN: Trimmed 31064 records to 22464 (keeping 200 days of data) [2025-10-10T20:54:58.989287] [DEBUG] [LOCAL ] PFN: Primary data saved (22464 records). [2025-10-10T20:54:58.989419] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-10T20:54:58.989489] [INFO ] [MAIN ] Update Progress: 1669/2373 symbols completed. PFN took 34.6s. Estimated remaining: 1h 39m 5s. Rate: 7.1 symbols/min [2025-10-10T20:54:59.154108] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:54:59.154279] [DEBUG] [LOCAL ] PFSI: No existing data file found in primary storage. [2025-10-10T20:54:59.154315] [WARN ] [MAIN ] PFSI: No existing data found, performing full refresh instead. [2025-10-10T20:54:59.154425] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-10T20:54:59.154465] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-10T20:54:59.154503] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-10T20:54:59.154534] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-10T20:54:59.502686] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-10T20:54:59.508808] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:54:59.779891] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-10T20:54:59.894914] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-10T20:55:00.289415] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-10T20:55:01.089464] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-10-10T20:55:01.521134] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-10T20:55:01.889449] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-10T20:55:02.397557] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-10T20:55:02.689376] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-10T20:55:02.888243] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T20:55:03.094307] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T20:55:03.098583] [INFO ] [REMOTE ] PFLT: Full fetch complete (63563 records). [2025-10-10T20:55:03.098756] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-10T20:55:03.099536] [FATAL] [VALIDATOR ] PFLT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:55:03.099621] [FATAL] [MAIN ] PFLT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:55:03.099704] [WARN ] [MAIN ] PFLT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:55:03.099799] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-10T20:55:03.099874] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-10T20:55:03.099909] [INFO ] [LOCAL ] PFLT: Starting deletion of derivative data. [2025-10-10T20:55:03.099947] [DEBUG] [LOCAL ] PFLT: No derivative data file found to delete. [2025-10-10T20:55:03.100003] [INFO ] [MAIN ] Update Progress: 1670/2373 symbols completed. PFLT took 40.1s. Estimated remaining: 1h 38m 55s. Rate: 7.1 symbols/min [2025-10-10T20:55:03.271730] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:55:03.271939] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-10T20:55:03.271994] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-10T20:55:03.272095] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-10T20:55:03.272150] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-10T20:55:03.272196] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-10T20:55:03.272229] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-10T20:55:03.494484] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-10T20:55:03.630945] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:55:04.289375] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-10-10T20:55:05.037231] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-10T20:55:05.089355] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-10T20:55:05.894444] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-10T20:55:05.905002] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-10T20:55:06.689436] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-10T20:55:06.910375] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T20:55:06.911812] [INFO ] [REMOTE ] PFO: Full fetch complete (7896 records). [2025-10-10T20:55:06.911904] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-10T20:55:07.275861] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-10T20:55:07.275996] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-10T20:55:07.276313] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-10T20:55:07.276435] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-10T20:55:07.277176] [DEBUG] [LOCAL ] PFO: Trimmed 7896 records to 6137 (keeping 200 days of data) [2025-10-10T20:55:07.312630] [DEBUG] [LOCAL ] PFO: Primary data saved (6137 records). [2025-10-10T20:55:07.312735] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-10T20:55:07.312805] [INFO ] [MAIN ] Update Progress: 1671/2373 symbols completed. PFO took 34.9s. Estimated remaining: 1h 38m 45s. Rate: 7.1 symbols/min [2025-10-10T20:55:07.487118] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:55:07.487804] [DEBUG] [LOCAL ] PGP: No existing data file found in primary storage. [2025-10-10T20:55:07.488131] [WARN ] [MAIN ] PGP: No existing data found, performing full refresh instead. [2025-10-10T20:55:07.488430] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-10T20:55:07.512530] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-10T20:55:07.512709] [DEBUG] [LOCAL ] PGP: No primary data file found to delete. [2025-10-10T20:55:07.512780] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-10T20:55:07.557807] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-10T20:55:07.608947] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-10T20:55:07.883924] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:55:07.913068] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (3.62 seconds). [2025-10-10T20:55:08.289395] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-10-10T20:55:09.001139] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-10T20:55:09.089347] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-10T20:55:09.458967] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-10T20:55:09.895065] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-10T20:55:09.905024] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-10T20:55:10.689429] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-10T20:55:10.777357] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T20:55:10.810112] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-10T20:55:11.489384] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-10T20:55:12.289389] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-10T20:55:12.424150] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T20:55:12.814152] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-10T20:55:13.089355] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-10T20:55:13.601184] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-10T20:55:13.889433] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-10T20:55:14.160931] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-10T20:55:14.689351] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-10T20:55:15.489427] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-10T20:55:15.715688] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-10T20:55:16.244235] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-10T20:55:16.289343] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-10T20:55:17.089422] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-10T20:55:17.471894] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T20:55:17.889386] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-10T20:55:18.430263] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T20:55:18.689432] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-10T20:55:18.713626] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-10T20:55:18.736519] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T20:55:19.489393] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-10T20:55:20.289421] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-10T20:55:20.475589] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T20:55:21.089386] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-10T20:55:21.095505] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-10T20:55:21.889403] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-10T20:55:22.219304] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-10T20:55:22.263458] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-10T20:55:22.689446] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-10T20:55:22.824845] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T20:55:23.489447] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-10T20:55:23.552347] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-10T20:55:24.086707] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-10T20:55:24.090686] [INFO ] [REMOTE ] PFS: Full fetch complete (51427 records). [2025-10-10T20:55:24.090860] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-10T20:55:24.091577] [FATAL] [VALIDATOR ] PFS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:55:24.091683] [FATAL] [MAIN ] PFS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:55:24.091750] [WARN ] [MAIN ] PFS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:55:24.091832] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-10T20:55:24.091913] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-10T20:55:24.091952] [INFO ] [LOCAL ] PFS: Starting deletion of derivative data. [2025-10-10T20:55:24.091991] [DEBUG] [LOCAL ] PFS: No derivative data file found to delete. [2025-10-10T20:55:24.092067] [INFO ] [MAIN ] Update Progress: 1672/2373 symbols completed. PFS took 34.2s. Estimated remaining: 1h 38m 40s. Rate: 7.1 symbols/min [2025-10-10T20:55:24.273855] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:55:24.274022] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-10T20:55:24.274058] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-10T20:55:24.274167] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-10T20:55:24.274208] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-10T20:55:24.274249] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-10T20:55:24.274280] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-10T20:55:24.289677] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-10T20:55:24.626638] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:55:25.089356] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-10-10T20:55:25.889426] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-10T20:55:26.462569] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-10T20:55:26.689354] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-10T20:55:26.790707] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-10T20:55:27.489665] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-10T20:55:27.492340] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-10T20:55:27.967353] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T20:55:28.172141] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-10T20:55:28.289402] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-10T20:55:29.089375] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-10T20:55:29.853593] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T20:55:29.854957] [INFO ] [REMOTE ] PGP: Full fetch complete (7905 records). [2025-10-10T20:55:29.855040] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-10T20:55:29.894548] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-10T20:55:30.240822] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-10T20:55:30.240923] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-10T20:55:30.241159] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-10T20:55:30.241199] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-10T20:55:30.241606] [DEBUG] [LOCAL ] PGP: Trimmed 7905 records to 5760 (keeping 200 days of data) [2025-10-10T20:55:30.275428] [DEBUG] [LOCAL ] PGP: Primary data saved (5760 records). [2025-10-10T20:55:30.275554] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-10T20:55:30.275668] [INFO ] [MAIN ] Update Progress: 1673/2373 symbols completed. PGP took 23.0s. Estimated remaining: 1h 38m 31s. Rate: 7.1 symbols/min [2025-10-10T20:55:30.481088] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:55:30.481563] [DEBUG] [LOCAL ] PGRE: No existing data file found in primary storage. [2025-10-10T20:55:30.481620] [WARN ] [MAIN ] PGRE: No existing data found, performing full refresh instead. [2025-10-10T20:55:30.481781] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-10T20:55:30.481845] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-10T20:55:30.481921] [DEBUG] [LOCAL ] PGRE: No primary data file found to delete. [2025-10-10T20:55:30.481959] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-10T20:55:30.691748] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-10T20:55:30.919945] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:55:30.926963] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-10T20:55:31.489397] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-10-10T20:55:31.910984] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T20:55:32.289375] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-10T20:55:32.659372] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-10T20:55:33.089372] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-10T20:55:33.204624] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T20:55:33.889413] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-10T20:55:34.569938] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-10T20:55:34.689411] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-10T20:55:34.834059] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T20:55:35.489379] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-10T20:55:36.289489] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-10T20:55:36.721559] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-10-10T20:55:37.089352] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-10T20:55:37.152326] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-10T20:55:37.284636] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T20:55:37.889415] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-10T20:55:37.946981] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T20:55:38.689371] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-10T20:55:39.118460] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T20:55:39.489405] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-10T20:55:39.528030] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T20:55:40.289405] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-10T20:55:40.994587] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T20:55:40.997709] [INFO ] [REMOTE ] PFSI: Full fetch complete (41113 records). [2025-10-10T20:55:40.997809] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-10T20:55:40.998368] [FATAL] [VALIDATOR ] PFSI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:55:40.998490] [FATAL] [MAIN ] PFSI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:55:40.998555] [WARN ] [MAIN ] PFSI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:55:40.998594] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-10T20:55:40.998692] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-10T20:55:40.998745] [INFO ] [LOCAL ] PFSI: Starting deletion of derivative data. [2025-10-10T20:55:40.998787] [DEBUG] [LOCAL ] PFSI: No derivative data file found to delete. [2025-10-10T20:55:40.998843] [INFO ] [MAIN ] Update Progress: 1674/2373 symbols completed. PFSI took 42.0s. Estimated remaining: 1h 38m 23s. Rate: 7.1 symbols/min [2025-10-10T20:55:41.092117] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-10T20:55:41.175367] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:55:41.175583] [DEBUG] [LOCAL ] PGZ: No existing data file found in primary storage. [2025-10-10T20:55:41.175662] [WARN ] [MAIN ] PGZ: No existing data found, performing full refresh instead. [2025-10-10T20:55:41.175787] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-10T20:55:41.175851] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-10T20:55:41.175986] [DEBUG] [LOCAL ] PGZ: No primary data file found to delete. [2025-10-10T20:55:41.176080] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-10T20:55:41.500069] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-10-10T20:55:41.593351] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:55:41.889351] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-10T20:55:41.969691] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-10T20:55:42.244072] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T20:55:42.689450] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-10T20:55:43.489334] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-10T20:55:43.708148] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T20:55:43.712546] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-10-10T20:55:43.712691] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-10T20:55:43.713339] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:55:43.713444] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:55:43.713519] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:55:43.713607] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-10T20:55:43.713714] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-10T20:55:43.713761] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-10T20:55:43.713803] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-10T20:55:43.713860] [INFO ] [MAIN ] Update Progress: 1675/2373 symbols completed. PG took 40.6s. Estimated remaining: 1h 38m 12s. Rate: 7.1 symbols/min [2025-10-10T20:55:43.878189] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:55:43.878326] [DEBUG] [LOCAL ] PH: No existing data file found in primary storage. [2025-10-10T20:55:43.878364] [WARN ] [MAIN ] PH: No existing data found, performing full refresh instead. [2025-10-10T20:55:43.878468] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-10T20:55:43.878511] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-10T20:55:43.878554] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-10T20:55:43.878606] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-10T20:55:44.225119] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:55:44.267626] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-10T20:55:44.289341] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-10T20:55:45.089338] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-10-10T20:55:45.390250] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T20:55:45.889334] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-10-10T20:55:46.165453] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-10T20:55:46.356729] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-10T20:55:46.689391] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-10T20:55:47.489411] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-10T20:55:47.739388] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T20:55:48.289382] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-10T20:55:48.492268] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-10T20:55:48.624575] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-10T20:55:49.089412] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-10T20:55:49.865195] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-10T20:55:49.889332] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-10T20:55:50.232731] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T20:55:50.534859] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-10T20:55:50.689399] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-10T20:55:51.489370] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-10T20:55:52.289396] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-10T20:55:52.364163] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T20:55:52.822906] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-10T20:55:53.089367] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-10T20:55:53.889380] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-10T20:55:54.689429] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-10T20:55:55.034745] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T20:55:55.489451] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-10T20:55:55.572163] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (3.28 seconds). [2025-10-10T20:55:55.787695] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T20:55:56.148966] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-10T20:55:56.289438] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-10T20:55:57.012569] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-10T20:55:57.089386] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-10T20:55:57.889405] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-10T20:55:57.957384] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T20:55:57.964181] [INFO ] [REMOTE ] PGR: Full fetch complete (76111 records). [2025-10-10T20:55:57.964375] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-10T20:55:57.965333] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:55:57.965473] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:55:57.965559] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:55:57.965676] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-10T20:55:57.965779] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-10T20:55:57.965845] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-10-10T20:55:57.965960] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-10-10T20:55:57.966051] [INFO ] [MAIN ] Update Progress: 1676/2373 symbols completed. PGR took 33.9s. Estimated remaining: 1h 38m 6s. Rate: 7.1 symbols/min [2025-10-10T20:55:58.170332] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:55:58.173025] [DEBUG] [LOCAL ] PHD: No existing data file found in primary storage. [2025-10-10T20:55:58.173122] [WARN ] [MAIN ] PHD: No existing data found, performing full refresh instead. [2025-10-10T20:55:58.173942] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-10-10T20:55:58.175009] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T20:55:58.175117] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-10-10T20:55:58.183966] [DEBUG] [LOCAL ] PHD: No primary data file found to delete. [2025-10-10T20:55:58.184497] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-10-10T20:55:58.516976] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-10T20:55:58.585508] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:55:58.689378] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-10-10T20:55:59.489357] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-10T20:55:59.959987] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-10T20:56:00.289454] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-10-10T20:56:01.089387] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-10T20:56:01.889371] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-10T20:56:01.898290] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-10T20:56:02.419452] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (2.93 seconds). [2025-10-10T20:56:02.689380] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-10T20:56:03.207564] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-10T20:56:03.489393] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-10-10T20:56:03.921786] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-10-10T20:56:04.048859] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-10T20:56:04.289371] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-10T20:56:04.661427] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T20:56:05.089384] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-10T20:56:05.111562] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-10T20:56:05.889374] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-10T20:56:06.594526] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T20:56:06.596035] [INFO ] [REMOTE ] PGZ: Full fetch complete (8782 records). [2025-10-10T20:56:06.596125] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-10T20:56:06.698112] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-10T20:56:06.966554] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-10T20:56:06.966822] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-10T20:56:06.967155] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-10T20:56:06.967242] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-10T20:56:06.967934] [DEBUG] [LOCAL ] PGZ: Trimmed 8782 records to 5545 (keeping 200 days of data) [2025-10-10T20:56:07.000592] [DEBUG] [LOCAL ] PGZ: Primary data saved (5545 records). [2025-10-10T20:56:07.000727] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-10T20:56:07.000805] [INFO ] [MAIN ] Update Progress: 1677/2373 symbols completed. PGZ took 26.0s. Estimated remaining: 1h 37m 58s. Rate: 7.1 symbols/min [2025-10-10T20:56:07.106164] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-10T20:56:07.489382] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-10-10T20:56:08.289356] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-10T20:56:08.478989] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T20:56:08.529218] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-10T20:56:09.089347] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-10T20:56:09.889347] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-10-10T20:56:10.051261] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-10T20:56:10.055583] [INFO ] [REMOTE ] PGRE: Full fetch complete (64128 records). [2025-10-10T20:56:10.055739] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-10T20:56:10.441692] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-10T20:56:10.441781] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-10T20:56:10.442701] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-10T20:56:10.442765] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-10T20:56:10.444162] [DEBUG] [LOCAL ] PGRE: Trimmed 64128 records to 47465 (keeping 200 days of data) [2025-10-10T20:56:10.715378] [DEBUG] [LOCAL ] PGRE: Primary data saved (47465 records). [2025-10-10T20:56:10.715504] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-10T20:56:10.715578] [INFO ] [MAIN ] Update Progress: 1678/2373 symbols completed. PGRE took 40.4s. Estimated remaining: 1h 37m 48s. Rate: 7.1 symbols/min [2025-10-10T20:56:11.028446] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-10T20:56:11.031224] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-10-10T20:56:11.127420] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-10T20:56:11.489418] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-10T20:56:12.155162] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-10T20:56:12.289428] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-10-10T20:56:13.380184] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T20:56:13.382629] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-10-10T20:56:13.678979] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-10T20:56:13.889446] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-10T20:56:14.768049] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-10T20:56:14.771377] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-10-10T20:56:16.035478] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-10T20:56:16.039362] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-10-10T20:56:16.340673] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-10T20:56:16.349408] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-10T20:56:17.366697] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T20:56:17.370733] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-10. [2025-10-10T20:56:18.774950] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-10T20:56:18.777290] [INFO ] [REMOTE ] PHD: Full fetch complete (15265 records). [2025-10-10T20:56:18.777364] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-10-10T20:56:19.130350] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-10-10T20:56:19.130437] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-10-10T20:56:19.130843] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-10-10T20:56:19.130905] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-10-10T20:56:19.131397] [DEBUG] [LOCAL ] PHD: Trimmed 15265 records to 11252 (keeping 200 days of data) [2025-10-10T20:56:19.195571] [DEBUG] [LOCAL ] PHD: Primary data saved (11252 records). [2025-10-10T20:56:19.195736] [INFO ] [MAIN ] PHD: Full history saved. [2025-10-10T20:56:19.195822] [INFO ] [MAIN ] Update Progress: 1679/2373 symbols completed. PHD took 21.2s. Estimated remaining: 1h 37m 39s. Rate: 7.1 symbols/min [2025-10-10T20:56:24.672018] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (8.32 seconds). [2025-10-10T20:56:24.681141] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-10T20:56:26.389883] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T20:56:26.397033] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-10T20:56:27.089727] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T20:56:27.092393] [INFO ] [REMOTE ] PH: Full fetch complete (55544 records). [2025-10-10T20:56:27.092474] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-10T20:56:27.093018] [FATAL] [VALIDATOR ] PH: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:56:27.093099] [FATAL] [MAIN ] PH: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:56:27.093142] [WARN ] [MAIN ] PH: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:56:27.093206] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-10T20:56:27.093268] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-10T20:56:27.093304] [INFO ] [LOCAL ] PH: Starting deletion of derivative data. [2025-10-10T20:56:27.093344] [DEBUG] [LOCAL ] PH: No derivative data file found to delete. [2025-10-10T20:56:27.093396] [INFO ] [MAIN ] Update Progress: 1680/2373 symbols completed. PH took 43.4s. Estimated remaining: 1h 37m 31s. Rate: 7.1 symbols/min [2025-10-10T20:56:27.680477] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:56:27.730170] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:56:27.738691] [DEBUG] [LOCAL ] PHIN: No existing data file found in primary storage. [2025-10-10T20:56:27.738797] [DEBUG] [LOCAL ] PHI: No existing data file found in primary storage. [2025-10-10T20:56:27.738858] [WARN ] [MAIN ] PHIN: No existing data found, performing full refresh instead. [2025-10-10T20:56:27.768160] [WARN ] [MAIN ] PHI: No existing data found, performing full refresh instead. [2025-10-10T20:56:27.768073] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:56:27.781766] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-10T20:56:27.791176] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-10T20:56:27.791300] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-10T20:56:27.816187] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-10T20:56:27.816073] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:56:27.816484] [DEBUG] [LOCAL ] PHG: No existing data file found in primary storage. [2025-10-10T20:56:27.816367] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-10T20:56:27.816719] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-10T20:56:27.816800] [DEBUG] [LOCAL ] PHK: No existing data file found in primary storage. [2025-10-10T20:56:27.816669] [WARN ] [MAIN ] PHG: No existing data found, performing full refresh instead. [2025-10-10T20:56:27.828138] [WARN ] [MAIN ] PHK: No existing data found, performing full refresh instead. [2025-10-10T20:56:27.846476] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-10T20:56:27.846691] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-10T20:56:27.846254] [DEBUG] [LOCAL ] PHI: No primary data file found to delete. [2025-10-10T20:56:27.879071] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-10T20:56:27.889637] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-10T20:56:27.884429] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-10T20:56:27.879231] [DEBUG] [LOCAL ] PHK: No primary data file found to delete. [2025-10-10T20:56:27.920729] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-10T20:56:27.910399] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-10T20:56:27.939598] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-10T20:56:29.078982] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:56:29.137464] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:56:29.154101] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-10-10T20:56:29.143410] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-10-10T20:56:29.238902] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:56:29.246073] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-10-10T20:56:29.280743] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:56:29.282303] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-10-10T20:56:30.484965] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-10T20:56:30.488619] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-10T20:56:30.822160] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-10T20:56:30.828382] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-10T20:56:30.941767] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T20:56:30.950778] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-10T20:56:31.014946] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T20:56:31.023481] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-10T20:56:31.086421] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-10T20:56:31.091037] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-10T20:56:32.127050] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-10T20:56:32.130083] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-10T20:56:32.389700] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-10T20:56:32.396373] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-10T20:56:32.513116] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-10T20:56:32.519980] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-10T20:56:32.644228] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T20:56:32.652997] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-10T20:56:33.349260] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T20:56:33.352895] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-10T20:56:33.893574] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-10T20:56:33.899187] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-10T20:56:34.109277] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T20:56:34.116339] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-10T20:56:34.593879] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-10T20:56:34.597751] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-10T20:56:34.964566] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-10T20:56:34.974425] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-10T20:56:35.409535] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-10T20:56:35.415517] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-10T20:56:35.474845] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-10T20:56:35.478572] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-10T20:56:35.988447] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T20:56:35.997128] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-10T20:56:36.429673] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-10T20:56:36.440014] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-10T20:56:36.654058] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T20:56:36.793296] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-10T20:56:37.089432] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-10T20:56:37.761037] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T20:56:37.889386] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-10T20:56:38.403944] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-10T20:56:38.452633] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T20:56:38.689385] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-10T20:56:39.379405] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-10T20:56:39.489400] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-10T20:56:40.289402] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-10T20:56:40.662849] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-10T20:56:40.797810] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-10T20:56:41.089374] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-10T20:56:41.763465] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-10T20:56:41.889406] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-10T20:56:42.443846] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-10T20:56:42.689377] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-10T20:56:43.286215] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-10T20:56:43.489425] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-10T20:56:43.959302] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T20:56:44.289380] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-10T20:56:44.901186] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-10T20:56:45.089470] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-10T20:56:45.434116] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-10T20:56:45.889384] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-10T20:56:46.575117] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-10T20:56:46.689405] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-10T20:56:47.348596] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T20:56:47.489395] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-10T20:56:48.232469] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-10T20:56:48.289386] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-10T20:56:49.089400] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-10T20:56:49.501806] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-10T20:56:49.523765] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-10T20:56:49.526763] [INFO ] [REMOTE ] PHK: Full fetch complete (39392 records). [2025-10-10T20:56:49.526853] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-10T20:56:49.849584] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T20:56:49.885002] [INFO ] [REMOTE ] PHI: Full fetch complete (20908 records). [2025-10-10T20:56:49.914383] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-10T20:56:49.911552] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-10T20:56:50.003053] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-10T20:56:50.026007] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-10T20:56:50.035639] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-10T20:56:50.038329] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-10T20:56:50.084014] [DEBUG] [LOCAL ] PHK: Trimmed 39392 records to 27005 (keeping 200 days of data) [2025-10-10T20:56:50.424714] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-10-10T20:56:50.430175] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-10-10T20:56:50.430686] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-10-10T20:56:50.430766] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-10-10T20:56:50.435876] [DEBUG] [LOCAL ] PHI: Trimmed 20908 records to 15249 (keeping 200 days of data) [2025-10-10T20:56:50.551126] [DEBUG] [LOCAL ] PHK: Primary data saved (27005 records). [2025-10-10T20:56:50.551772] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-10T20:56:50.552227] [INFO ] [MAIN ] Update Progress: 1681/2373 symbols completed. PHK took 23.5s. Estimated remaining: 1h 37m 28s. Rate: 7.1 symbols/min [2025-10-10T20:56:50.699342] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-10T20:56:50.748132] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:56:50.748929] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-10T20:56:50.752354] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-10T20:56:50.754675] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-10T20:56:50.760789] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-10T20:56:50.763422] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-10T20:56:50.763720] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-10T20:56:50.763513] [DEBUG] [LOCAL ] PHI: Primary data saved (15249 records). [2025-10-10T20:56:50.763933] [INFO ] [MAIN ] PHI: Full history saved. [2025-10-10T20:56:50.764083] [INFO ] [MAIN ] Update Progress: 1682/2373 symbols completed. PHI took 23.7s. Estimated remaining: 1h 37m 16s. Rate: 7.1 symbols/min [2025-10-10T20:56:51.193379] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:56:51.240912] [DEBUG] [LOCAL ] PHR: No existing data file found in primary storage. [2025-10-10T20:56:51.269066] [WARN ] [MAIN ] PHR: No existing data found, performing full refresh instead. [2025-10-10T20:56:51.269672] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-10T20:56:51.269754] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-10T20:56:51.290556] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-10T20:56:51.319129] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-10T20:56:51.350442] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:56:51.504130] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-10-10T20:56:51.754842] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:56:52.041926] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-10T20:56:52.145817] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-10T20:56:52.289400] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-10T20:56:53.089390] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-10-10T20:56:53.816044] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-10T20:56:53.889351] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-10T20:56:54.020613] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T20:56:54.689382] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-10T20:56:54.873599] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-10T20:56:55.490155] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-10T20:56:55.490304] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-10T20:56:56.281206] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-10T20:56:56.289323] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-10T20:56:56.417896] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T20:56:56.421884] [INFO ] [REMOTE ] PHG: Full fetch complete (65161 records). [2025-10-10T20:56:56.422038] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-10T20:56:56.422791] [FATAL] [VALIDATOR ] PHG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:56:56.422885] [FATAL] [MAIN ] PHG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:56:56.422929] [WARN ] [MAIN ] PHG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:56:56.422999] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-10T20:56:56.423072] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-10T20:56:56.423109] [INFO ] [LOCAL ] PHG: Starting deletion of derivative data. [2025-10-10T20:56:56.423148] [DEBUG] [LOCAL ] PHG: No derivative data file found to delete. [2025-10-10T20:56:56.423328] [INFO ] [MAIN ] Update Progress: 1683/2373 symbols completed. PHG took 29.3s. Estimated remaining: 1h 37m 7s. Rate: 7.1 symbols/min [2025-10-10T20:56:56.609792] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:56:56.610018] [DEBUG] [LOCAL ] PII: No existing data file found in primary storage. [2025-10-10T20:56:56.610057] [WARN ] [MAIN ] PII: No existing data found, performing full refresh instead. [2025-10-10T20:56:56.610180] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-10T20:56:56.610224] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-10T20:56:56.610267] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-10T20:56:56.610300] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-10T20:56:56.986262] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:56:57.028634] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T20:56:57.031769] [INFO ] [REMOTE ] PHIN: Full fetch complete (47330 records). [2025-10-10T20:56:57.031900] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-10T20:56:57.032499] [FATAL] [VALIDATOR ] PHIN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:56:57.032590] [FATAL] [MAIN ] PHIN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:56:57.032634] [WARN ] [MAIN ] PHIN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:56:57.032721] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-10T20:56:57.032785] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-10T20:56:57.032820] [INFO ] [LOCAL ] PHIN: Starting deletion of derivative data. [2025-10-10T20:56:57.032859] [DEBUG] [LOCAL ] PHIN: No derivative data file found to delete. [2025-10-10T20:56:57.032917] [INFO ] [MAIN ] Update Progress: 1684/2373 symbols completed. PHIN took 29.9s. Estimated remaining: 1h 36m 55s. Rate: 7.1 symbols/min [2025-10-10T20:56:57.096106] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-10T20:56:57.215192] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:56:57.215409] [DEBUG] [LOCAL ] PIM: No existing data file found in primary storage. [2025-10-10T20:56:57.215448] [WARN ] [MAIN ] PIM: No existing data found, performing full refresh instead. [2025-10-10T20:56:57.215564] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-10T20:56:57.215605] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-10T20:56:57.215674] [DEBUG] [LOCAL ] PIM: No primary data file found to delete. [2025-10-10T20:56:57.215729] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-10T20:56:57.560613] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:56:57.889399] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-10-10T20:56:58.689357] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-10-10T20:56:58.698766] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-10T20:56:58.771032] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T20:56:59.489383] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-10T20:57:00.289374] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-10T20:57:00.550452] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-10T20:57:00.588548] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T20:57:01.089435] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-10T20:57:01.878497] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T20:57:01.889343] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-10T20:57:02.689447] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-10T20:57:03.169305] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-10T20:57:03.490243] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-10T20:57:03.747061] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T20:57:03.960094] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-10T20:57:04.261981] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T20:57:04.289361] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-10T20:57:05.089415] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-10T20:57:05.889399] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-10T20:57:06.411189] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-10T20:57:06.445694] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-10T20:57:06.689358] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-10T20:57:07.058336] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-10T20:57:07.489405] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-10T20:57:08.289432] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-10T20:57:08.999552] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-10T20:57:09.089383] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-10T20:57:09.409146] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-10T20:57:09.568951] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T20:57:09.889373] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-10T20:57:10.689366] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-10T20:57:11.225570] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-10T20:57:11.489425] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-10T20:57:11.622798] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T20:57:12.289442] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-10T20:57:12.789991] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T20:57:13.079299] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-10T20:57:13.089349] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-10T20:57:13.527710] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T20:57:13.889397] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-10T20:57:14.689370] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-10T20:57:14.837338] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T20:57:15.407127] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-10T20:57:15.489403] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-10T20:57:16.289408] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-10T20:57:16.980516] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-10T20:57:17.089352] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-10T20:57:17.669936] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-10T20:57:17.889428] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-10T20:57:18.092913] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-10T20:57:18.689337] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-10T20:57:19.177303] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-10T20:57:19.489430] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-10T20:57:19.909300] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T20:57:20.134135] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T20:57:20.289386] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-10T20:57:21.089387] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-10T20:57:21.633244] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T20:57:21.889432] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-10T20:57:22.212483] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T20:57:22.364021] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-10T20:57:22.689376] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-10T20:57:23.081727] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-10T20:57:23.489408] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-10T20:57:24.282773] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-10T20:57:24.289320] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-10T20:57:24.741339] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T20:57:25.089412] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-10T20:57:25.102206] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-10T20:57:25.889403] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-10T20:57:26.032833] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T20:57:26.037467] [INFO ] [REMOTE ] PII: Full fetch complete (70766 records). [2025-10-10T20:57:26.037637] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-10T20:57:26.038503] [FATAL] [VALIDATOR ] PII: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:57:26.038600] [FATAL] [MAIN ] PII: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:57:26.038674] [WARN ] [MAIN ] PII: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:57:26.038740] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-10T20:57:26.038809] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-10T20:57:26.038847] [INFO ] [LOCAL ] PII: Starting deletion of derivative data. [2025-10-10T20:57:26.038890] [DEBUG] [LOCAL ] PII: No derivative data file found to delete. [2025-10-10T20:57:26.038957] [INFO ] [MAIN ] Update Progress: 1685/2373 symbols completed. PII took 29.6s. Estimated remaining: 1h 36m 55s. Rate: 7.1 symbols/min [2025-10-10T20:57:26.220393] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:57:26.220626] [DEBUG] [LOCAL ] PINE: No existing data file found in primary storage. [2025-10-10T20:57:26.220704] [WARN ] [MAIN ] PINE: No existing data found, performing full refresh instead. [2025-10-10T20:57:26.220851] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-10T20:57:26.220938] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-10T20:57:26.220997] [DEBUG] [LOCAL ] PINE: No primary data file found to delete. [2025-10-10T20:57:26.221082] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-10T20:57:26.608430] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:57:26.689403] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-10-10T20:57:26.710512] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-10T20:57:27.489384] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-10T20:57:27.910674] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T20:57:28.069782] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-10T20:57:28.289402] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-10T20:57:29.089421] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-10T20:57:29.283224] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T20:57:29.287689] [INFO ] [REMOTE ] PHM: Full fetch complete (74543 records). [2025-10-10T20:57:29.287820] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-10T20:57:29.288619] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:57:29.288730] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:57:29.288805] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:57:29.288878] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-10T20:57:29.288948] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-10T20:57:29.288992] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-10-10T20:57:29.289042] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-10-10T20:57:29.289113] [INFO ] [MAIN ] Update Progress: 1686/2373 symbols completed. PHM took 38.7s. Estimated remaining: 1h 36m 45s. Rate: 7.1 symbols/min [2025-10-10T20:57:29.473271] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:57:29.473452] [DEBUG] [LOCAL ] PINS: No existing data file found in primary storage. [2025-10-10T20:57:29.473496] [WARN ] [MAIN ] PINS: No existing data found, performing full refresh instead. [2025-10-10T20:57:29.473614] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-10T20:57:29.473701] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-10T20:57:29.473756] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-10T20:57:29.473791] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-10T20:57:29.846297] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:57:29.889342] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-10T20:57:30.077557] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T20:57:30.081341] [INFO ] [REMOTE ] PHR: Full fetch complete (52616 records). [2025-10-10T20:57:30.081432] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-10T20:57:30.082096] [FATAL] [VALIDATOR ] PHR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:57:30.082184] [FATAL] [MAIN ] PHR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:57:30.082228] [WARN ] [MAIN ] PHR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:57:30.082303] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-10T20:57:30.082379] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-10T20:57:30.082416] [INFO ] [LOCAL ] PHR: Starting deletion of derivative data. [2025-10-10T20:57:30.082521] [DEBUG] [LOCAL ] PHR: No derivative data file found to delete. [2025-10-10T20:57:30.082596] [INFO ] [MAIN ] Update Progress: 1687/2373 symbols completed. PHR took 39.3s. Estimated remaining: 1h 36m 33s. Rate: 7.1 symbols/min [2025-10-10T20:57:30.256176] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:57:30.256615] [DEBUG] [LOCAL ] PIPR: No existing data file found in primary storage. [2025-10-10T20:57:30.256714] [WARN ] [MAIN ] PIPR: No existing data found, performing full refresh instead. [2025-10-10T20:57:30.256840] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-10T20:57:30.256882] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-10T20:57:30.256957] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-10T20:57:30.257016] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-10T20:57:30.603234] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:57:30.689339] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-10-10T20:57:31.132945] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T20:57:31.489381] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-10-10T20:57:32.289404] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-10T20:57:32.553697] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-10T20:57:32.830468] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-10T20:57:32.984877] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-10T20:57:32.985912] [INFO ] [REMOTE ] PIM: Full fetch complete (6445 records). [2025-10-10T20:57:32.985985] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-10T20:57:33.090360] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-10T20:57:33.375243] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-10T20:57:33.375349] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-10T20:57:33.375566] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-10T20:57:33.375609] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-10T20:57:33.376073] [DEBUG] [LOCAL ] PIM: Trimmed 6445 records to 4859 (keeping 200 days of data) [2025-10-10T20:57:33.405637] [DEBUG] [LOCAL ] PIM: Primary data saved (4859 records). [2025-10-10T20:57:33.405811] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-10T20:57:33.405890] [INFO ] [MAIN ] Update Progress: 1688/2373 symbols completed. PIM took 36.4s. Estimated remaining: 1h 36m 22s. Rate: 7.1 symbols/min [2025-10-10T20:57:33.573877] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:57:33.574048] [DEBUG] [LOCAL ] PJT: No existing data file found in primary storage. [2025-10-10T20:57:33.574084] [WARN ] [MAIN ] PJT: No existing data found, performing full refresh instead. [2025-10-10T20:57:33.574199] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-10T20:57:33.574240] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-10T20:57:33.574280] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-10T20:57:33.574312] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-10T20:57:33.893854] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-10T20:57:33.922976] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:57:34.217432] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-10T20:57:34.689367] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-10T20:57:35.018208] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-10T20:57:35.489378] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-10T20:57:36.289359] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-10-10T20:57:36.693222] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-10T20:57:36.874871] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-10T20:57:37.089411] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-10T20:57:37.468848] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-10T20:57:37.889379] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-10T20:57:38.356456] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-10T20:57:38.689366] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-10T20:57:38.885280] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-10T20:57:39.489404] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-10T20:57:39.870839] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-10T20:57:40.289406] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-10T20:57:41.089434] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-10T20:57:41.345388] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-10T20:57:41.708385] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-10T20:57:41.889355] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-10T20:57:42.202420] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T20:57:42.689417] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-10T20:57:43.080067] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T20:57:43.489390] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-10T20:57:44.150678] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T20:57:44.245694] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-10T20:57:44.289389] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-10T20:57:45.089439] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-10T20:57:45.879936] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-10T20:57:45.889447] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-10T20:57:46.083171] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-10T20:57:46.689414] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-10T20:57:47.489400] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-10T20:57:47.639518] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T20:57:47.642369] [INFO ] [REMOTE ] PINE: Full fetch complete (21101 records). [2025-10-10T20:57:47.642474] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-10T20:57:48.038255] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-10T20:57:48.038443] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-10T20:57:48.039451] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-10T20:57:48.039544] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-10T20:57:48.040455] [DEBUG] [LOCAL ] PINE: Trimmed 21101 records to 14423 (keeping 200 days of data) [2025-10-10T20:57:48.138396] [DEBUG] [LOCAL ] PINE: Primary data saved (14423 records). [2025-10-10T20:57:48.138816] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-10T20:57:48.138950] [INFO ] [MAIN ] Update Progress: 1689/2373 symbols completed. PINE took 22.1s. Estimated remaining: 1h 36m 17s. Rate: 7.1 symbols/min [2025-10-10T20:57:48.293329] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-10T20:57:48.313257] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-10T20:57:48.383461] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:57:48.383720] [DEBUG] [LOCAL ] PK: No existing data file found in primary storage. [2025-10-10T20:57:48.383773] [WARN ] [MAIN ] PK: No existing data found, performing full refresh instead. [2025-10-10T20:57:48.383907] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-10T20:57:48.383986] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-10T20:57:48.384054] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-10T20:57:48.384092] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-10T20:57:48.807505] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:57:48.823785] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-10T20:57:49.089447] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-10-10T20:57:49.889373] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-10T20:57:49.999799] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T20:57:50.689351] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-10T20:57:51.098763] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T20:57:51.257440] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T20:57:51.489420] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-10T20:57:52.289423] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-10T20:57:52.488321] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T20:57:52.916760] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-10T20:57:53.089409] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-10T20:57:53.889389] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-10T20:57:53.986109] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-10T20:57:54.007511] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-10T20:57:54.689389] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-10T20:57:55.489414] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-10T20:57:56.088707] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-10T20:57:56.289336] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-10T20:57:56.396051] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-10T20:57:57.089400] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-10T20:57:57.582227] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-10T20:57:57.707155] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-10T20:57:57.889357] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-10T20:57:58.689420] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-10T20:57:59.132898] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T20:57:59.489346] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-10T20:57:59.897080] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-10T20:58:00.107213] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-10T20:58:00.289388] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-10T20:58:01.089413] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-10T20:58:01.889360] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-10T20:58:01.973559] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-10T20:58:02.333625] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T20:58:02.423140] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T20:58:02.665830] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-10T20:58:02.689348] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-10T20:58:03.462952] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T20:58:03.465175] [INFO ] [REMOTE ] PJT: Full fetch complete (32011 records). [2025-10-10T20:58:03.465248] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-10T20:58:03.465773] [FATAL] [VALIDATOR ] PJT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:58:03.465854] [FATAL] [MAIN ] PJT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:58:03.465895] [WARN ] [MAIN ] PJT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:58:03.465960] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-10T20:58:03.466021] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-10T20:58:03.466056] [INFO ] [LOCAL ] PJT: Starting deletion of derivative data. [2025-10-10T20:58:03.466095] [DEBUG] [LOCAL ] PJT: No derivative data file found to delete. [2025-10-10T20:58:03.466147] [INFO ] [MAIN ] Update Progress: 1690/2373 symbols completed. PJT took 30.1s. Estimated remaining: 1h 36m 11s. Rate: 7.1 symbols/min [2025-10-10T20:58:03.494897] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-10T20:58:03.634763] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:58:03.634937] [DEBUG] [LOCAL ] PKE: No existing data file found in primary storage. [2025-10-10T20:58:03.634974] [WARN ] [MAIN ] PKE: No existing data found, performing full refresh instead. [2025-10-10T20:58:03.635084] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-10T20:58:03.635125] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-10T20:58:03.635165] [DEBUG] [LOCAL ] PKE: No primary data file found to delete. [2025-10-10T20:58:03.635196] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-10T20:58:03.996964] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:58:04.289381] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-10T20:58:05.089431] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-10-10T20:58:05.889345] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-10T20:58:06.108375] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-10T20:58:06.125849] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-10T20:58:06.551720] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-10T20:58:06.689334] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-10T20:58:07.287894] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-10T20:58:07.489409] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-10T20:58:08.289398] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-10T20:58:08.526407] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-10T20:58:08.726291] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T20:58:09.089360] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-10T20:58:09.464120] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T20:58:09.889355] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-10T20:58:10.138836] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-10T20:58:10.646458] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-10T20:58:10.689403] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-10T20:58:11.345617] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-10T20:58:11.347293] [INFO ] [REMOTE ] PIPR: Full fetch complete (20509 records). [2025-10-10T20:58:11.347361] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-10T20:58:11.347820] [FATAL] [VALIDATOR ] PIPR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:58:11.347897] [FATAL] [MAIN ] PIPR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:58:11.347960] [WARN ] [MAIN ] PIPR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:58:11.348031] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-10T20:58:11.348092] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-10T20:58:11.348127] [INFO ] [LOCAL ] PIPR: Starting deletion of derivative data. [2025-10-10T20:58:11.348166] [DEBUG] [LOCAL ] PIPR: No derivative data file found to delete. [2025-10-10T20:58:11.348220] [INFO ] [MAIN ] Update Progress: 1691/2373 symbols completed. PIPR took 41.3s. Estimated remaining: 1h 36m 2s. Rate: 7.1 symbols/min [2025-10-10T20:58:11.498183] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-10T20:58:11.518574] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:58:11.518723] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-10T20:58:11.518769] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-10T20:58:11.518876] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-10T20:58:11.518918] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-10T20:58:11.518959] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-10T20:58:11.518991] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-10T20:58:11.879528] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:58:12.289372] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-10T20:58:13.089354] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-10-10T20:58:13.269955] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-10T20:58:13.889392] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-10T20:58:14.022562] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-10T20:58:14.689339] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-10T20:58:14.864638] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-10T20:58:14.967022] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-10T20:58:15.173714] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-10T20:58:15.178317] [INFO ] [REMOTE ] PINS: Full fetch complete (77350 records). [2025-10-10T20:58:15.178433] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-10T20:58:15.179263] [FATAL] [VALIDATOR ] PINS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:58:15.179376] [FATAL] [MAIN ] PINS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:58:15.179418] [WARN ] [MAIN ] PINS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:58:15.179490] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-10T20:58:15.179553] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-10T20:58:15.179587] [INFO ] [LOCAL ] PINS: Starting deletion of derivative data. [2025-10-10T20:58:15.179626] [DEBUG] [LOCAL ] PINS: No derivative data file found to delete. [2025-10-10T20:58:15.179719] [INFO ] [MAIN ] Update Progress: 1692/2373 symbols completed. PINS took 45.9s. Estimated remaining: 1h 35m 52s. Rate: 7.1 symbols/min [2025-10-10T20:58:15.352674] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:58:15.352874] [DEBUG] [LOCAL ] PKST: No existing data file found in primary storage. [2025-10-10T20:58:15.352914] [WARN ] [MAIN ] PKST: No existing data found, performing full refresh instead. [2025-10-10T20:58:15.353034] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-10T20:58:15.353100] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-10T20:58:15.353158] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-10T20:58:15.353251] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-10T20:58:15.496982] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-10T20:58:15.717388] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:58:16.289407] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-10T20:58:17.089520] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-10-10T20:58:17.546676] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-10T20:58:17.889383] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-10T20:58:18.468159] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-10T20:58:18.505991] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-10T20:58:18.689372] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-10T20:58:18.794039] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T20:58:19.489446] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-10T20:58:19.713696] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-10T20:58:20.289447] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-10T20:58:20.911581] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-10T20:58:21.089390] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-10T20:58:21.720566] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-10T20:58:21.836221] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-10T20:58:21.889334] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-10T20:58:22.689395] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-10T20:58:23.363952] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-10T20:58:23.489383] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-10T20:58:24.289423] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-10T20:58:24.759945] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-10T20:58:24.873768] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-10T20:58:25.089370] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-10T20:58:25.889363] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-10T20:58:26.164371] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-10T20:58:26.407465] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-10T20:58:26.689403] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-10T20:58:27.489370] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-10T20:58:27.916902] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T20:58:28.289402] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-10T20:58:28.561256] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T20:58:28.729099] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T20:58:29.058261] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-10T20:58:29.089347] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-10T20:58:29.889373] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-10T20:58:30.324459] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T20:58:30.689343] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-10T20:58:31.100694] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-10T20:58:31.103399] [INFO ] [REMOTE ] PKE: Full fetch complete (17869 records). [2025-10-10T20:58:31.103469] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-10T20:58:31.476196] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-10T20:58:31.476314] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-10T20:58:31.476884] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-10T20:58:31.476992] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-10T20:58:31.477593] [DEBUG] [LOCAL ] PKE: Trimmed 17869 records to 13854 (keeping 200 days of data) [2025-10-10T20:58:31.513074] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-10T20:58:31.564245] [DEBUG] [LOCAL ] PKE: Primary data saved (13854 records). [2025-10-10T20:58:31.564392] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-10T20:58:31.564482] [INFO ] [MAIN ] Update Progress: 1693/2373 symbols completed. PKE took 28.1s. Estimated remaining: 1h 35m 47s. Rate: 7.1 symbols/min [2025-10-10T20:58:31.729604] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:58:31.729841] [DEBUG] [LOCAL ] PKX: No existing data file found in primary storage. [2025-10-10T20:58:31.729899] [WARN ] [MAIN ] PKX: No existing data found, performing full refresh instead. [2025-10-10T20:58:31.730076] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-10T20:58:31.730118] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-10T20:58:31.730160] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-10T20:58:31.730192] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-10T20:58:32.083009] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:58:32.259576] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-10T20:58:32.264269] [INFO ] [REMOTE ] PK: Full fetch complete (76005 records). [2025-10-10T20:58:32.264463] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-10T20:58:32.265309] [FATAL] [VALIDATOR ] PK: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:58:32.265473] [FATAL] [MAIN ] PK: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:58:32.265594] [WARN ] [MAIN ] PK: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:58:32.265705] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-10T20:58:32.265784] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-10T20:58:32.265824] [INFO ] [LOCAL ] PK: Starting deletion of derivative data. [2025-10-10T20:58:32.265865] [DEBUG] [LOCAL ] PK: No derivative data file found to delete. [2025-10-10T20:58:32.265941] [INFO ] [MAIN ] Update Progress: 1694/2373 symbols completed. PK took 44.1s. Estimated remaining: 1h 35m 35s. Rate: 7.1 symbols/min [2025-10-10T20:58:32.297149] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-10-10T20:58:32.438253] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:58:32.438513] [DEBUG] [LOCAL ] PL: No existing data file found in primary storage. [2025-10-10T20:58:32.438638] [WARN ] [MAIN ] PL: No existing data found, performing full refresh instead. [2025-10-10T20:58:32.438852] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-10T20:58:32.438947] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-10T20:58:32.439053] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-10T20:58:32.439154] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-10T20:58:32.636146] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T20:58:32.823832] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:58:33.089346] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-10-10T20:58:33.889348] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-10T20:58:34.083573] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T20:58:34.689381] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-10T20:58:35.489358] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-10T20:58:35.698283] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-10T20:58:35.798748] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T20:58:35.923980] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-10T20:58:36.289398] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-10T20:58:36.994792] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T20:58:37.089371] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-10T20:58:37.889392] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-10T20:58:38.037576] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T20:58:38.682089] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T20:58:38.689324] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-10T20:58:39.489433] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-10T20:58:40.248291] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-10T20:58:40.289340] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-10T20:58:40.614631] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T20:58:40.821462] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T20:58:41.089414] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-10T20:58:41.889341] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-10T20:58:42.190554] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-10T20:58:42.336161] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-10T20:58:42.689366] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-10T20:58:43.489446] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-10T20:58:44.289433] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-10T20:58:44.920164] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (3.03 seconds). [2025-10-10T20:58:45.089363] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-10T20:58:45.277555] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T20:58:45.279548] [INFO ] [REMOTE ] PKST: Full fetch complete (29032 records). [2025-10-10T20:58:45.279618] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-10T20:58:45.280077] [FATAL] [VALIDATOR ] PKST: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:58:45.280181] [FATAL] [MAIN ] PKST: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:58:45.280223] [WARN ] [MAIN ] PKST: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:58:45.280260] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-10T20:58:45.280313] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-10T20:58:45.280346] [INFO ] [LOCAL ] PKST: Starting deletion of derivative data. [2025-10-10T20:58:45.280393] [DEBUG] [LOCAL ] PKST: No derivative data file found to delete. [2025-10-10T20:58:45.280444] [INFO ] [MAIN ] Update Progress: 1695/2373 symbols completed. PKST took 30.1s. Estimated remaining: 1h 35m 28s. Rate: 7.1 symbols/min [2025-10-10T20:58:45.444114] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:58:45.444276] [DEBUG] [LOCAL ] PLD: No existing data file found in primary storage. [2025-10-10T20:58:45.444313] [WARN ] [MAIN ] PLD: No existing data found, performing full refresh instead. [2025-10-10T20:58:45.444423] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-10T20:58:45.444463] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-10T20:58:45.444503] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-10T20:58:45.444534] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-10T20:58:45.797729] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:58:45.821410] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-10T20:58:45.889340] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-10T20:58:46.689350] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-10-10T20:58:46.842413] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T20:58:47.043336] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (4.35 seconds). [2025-10-10T20:58:47.489403] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-10T20:58:47.689784] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T20:58:48.289384] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-10T20:58:48.830335] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-10T20:58:48.891686] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-10T20:58:48.894774] [INFO ] [REMOTE ] PKG: Full fetch complete (57292 records). [2025-10-10T20:58:48.894868] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-10T20:58:48.895483] [FATAL] [VALIDATOR ] PKG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:58:48.895566] [FATAL] [MAIN ] PKG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:58:48.895628] [WARN ] [MAIN ] PKG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:58:48.895714] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-10T20:58:48.895797] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-10T20:58:48.895855] [INFO ] [LOCAL ] PKG: Starting deletion of derivative data. [2025-10-10T20:58:48.895898] [DEBUG] [LOCAL ] PKG: No derivative data file found to delete. [2025-10-10T20:58:48.895954] [INFO ] [MAIN ] Update Progress: 1696/2373 symbols completed. PKG took 37.5s. Estimated remaining: 1h 35m 18s. Rate: 7.1 symbols/min [2025-10-10T20:58:49.067796] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:58:49.067968] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-10-10T20:58:49.068008] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-10-10T20:58:49.068118] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-10T20:58:49.068160] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-10T20:58:49.068201] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-10T20:58:49.068233] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-10T20:58:49.094678] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-10T20:58:49.427594] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:58:49.890512] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-10T20:58:49.890583] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-10-10T20:58:50.689382] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-10T20:58:51.489343] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-10T20:58:51.644358] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-10T20:58:51.747737] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T20:58:52.289394] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-10T20:58:52.882699] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-10T20:58:53.089339] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-10T20:58:53.104861] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-10T20:58:53.889384] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-10T20:58:54.689383] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-10T20:58:55.051381] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-10-10T20:58:55.490731] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-10T20:58:55.607345] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-10T20:58:56.177564] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (3.09 seconds). [2025-10-10T20:58:56.289339] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-10T20:58:56.705372] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T20:58:57.089417] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-10T20:58:57.834181] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-10T20:58:57.889330] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-10T20:58:58.179087] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-10T20:58:58.689346] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-10T20:58:59.089829] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-10T20:58:59.257775] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T20:58:59.489432] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-10T20:59:00.289388] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-10T20:59:01.089409] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-10T20:59:01.209140] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-10T20:59:01.235044] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T20:59:01.889359] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-10T20:59:01.950217] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T20:59:02.689372] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-10T20:59:03.489377] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-10T20:59:03.992378] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-10T20:59:04.096139] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-10T20:59:04.112708] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T20:59:04.114819] [INFO ] [REMOTE ] PKX: Full fetch complete (36180 records). [2025-10-10T20:59:04.114894] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-10T20:59:04.115459] [FATAL] [VALIDATOR ] PKX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:59:04.115544] [FATAL] [MAIN ] PKX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:59:04.115586] [WARN ] [MAIN ] PKX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:59:04.115669] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-10T20:59:04.115746] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-10T20:59:04.115782] [INFO ] [LOCAL ] PKX: Starting deletion of derivative data. [2025-10-10T20:59:04.115823] [DEBUG] [LOCAL ] PKX: No derivative data file found to delete. [2025-10-10T20:59:04.115877] [INFO ] [MAIN ] Update Progress: 1697/2373 symbols completed. PKX took 32.6s. Estimated remaining: 1h 35m 12s. Rate: 7.1 symbols/min [2025-10-10T20:59:04.311875] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:59:04.309076] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-10T20:59:04.312126] [DEBUG] [LOCAL ] PLOW: No existing data file found in primary storage. [2025-10-10T20:59:04.313033] [WARN ] [MAIN ] PLOW: No existing data found, performing full refresh instead. [2025-10-10T20:59:04.313217] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-10T20:59:04.313262] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-10T20:59:04.313304] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-10T20:59:04.313336] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-10T20:59:04.669326] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:59:04.696020] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T20:59:05.089412] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-10-10T20:59:05.889342] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-10T20:59:06.331000] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T20:59:06.689342] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-10T20:59:06.945626] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-10T20:59:07.489415] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-10T20:59:08.007356] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T20:59:08.136758] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-10T20:59:08.289353] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-10T20:59:09.089452] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-10T20:59:09.593278] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T20:59:09.889477] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-10T20:59:10.317368] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-10T20:59:10.689347] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-10T20:59:11.234219] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-10T20:59:11.489411] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-10T20:59:11.687017] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T20:59:11.691487] [INFO ] [REMOTE ] PL: Full fetch complete (76583 records). [2025-10-10T20:59:11.691600] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-10T20:59:11.692250] [FATAL] [VALIDATOR ] PL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:59:11.692337] [FATAL] [MAIN ] PL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:59:11.692381] [WARN ] [MAIN ] PL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:59:11.692419] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-10T20:59:11.692473] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-10T20:59:11.692509] [INFO ] [LOCAL ] PL: Starting deletion of derivative data. [2025-10-10T20:59:11.692548] [DEBUG] [LOCAL ] PL: No derivative data file found to delete. [2025-10-10T20:59:11.692603] [INFO ] [MAIN ] Update Progress: 1698/2373 symbols completed. PL took 39.4s. Estimated remaining: 1h 35m 4s. Rate: 7.1 symbols/min [2025-10-10T20:59:11.862317] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:59:11.862488] [DEBUG] [LOCAL ] PLYM: No existing data file found in primary storage. [2025-10-10T20:59:11.862530] [WARN ] [MAIN ] PLYM: No existing data found, performing full refresh instead. [2025-10-10T20:59:11.862600] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-10T20:59:11.862636] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-10T20:59:11.862722] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-10T20:59:11.862765] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-10T20:59:12.215567] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:59:12.289380] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-10-10T20:59:12.412783] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-10T20:59:13.001960] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-10T20:59:13.089371] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-10T20:59:13.872839] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-10T20:59:13.889348] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-10T20:59:14.689409] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-10T20:59:15.455725] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-10T20:59:15.489334] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-10T20:59:15.542043] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T20:59:16.289402] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-10T20:59:16.697404] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-10T20:59:17.089394] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-10T20:59:17.631199] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T20:59:17.860595] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T20:59:17.889346] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-10T20:59:18.689386] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-10T20:59:18.876487] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T20:59:19.489356] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-10T20:59:19.601300] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T20:59:19.619762] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T20:59:19.624289] [INFO ] [REMOTE ] PLD: Full fetch complete (76975 records). [2025-10-10T20:59:19.624415] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-10T20:59:19.625057] [FATAL] [VALIDATOR ] PLD: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:59:19.625142] [FATAL] [MAIN ] PLD: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:59:19.625187] [WARN ] [MAIN ] PLD: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:59:19.625279] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-10T20:59:19.625381] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-10T20:59:19.625448] [INFO ] [LOCAL ] PLD: Starting deletion of derivative data. [2025-10-10T20:59:19.625544] [DEBUG] [LOCAL ] PLD: No derivative data file found to delete. [2025-10-10T20:59:19.625678] [INFO ] [MAIN ] Update Progress: 1699/2373 symbols completed. PLD took 34.3s. Estimated remaining: 1h 34m 55s. Rate: 7.1 symbols/min [2025-10-10T20:59:19.813704] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:59:19.813865] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-10T20:59:19.813901] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-10T20:59:19.814038] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-10T20:59:19.814107] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-10T20:59:19.814161] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-10T20:59:19.814194] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-10T20:59:20.155989] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:59:20.289383] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-10-10T20:59:20.950544] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-10T20:59:21.089401] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-10T20:59:21.889357] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-10T20:59:22.454596] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T20:59:22.689344] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-10T20:59:23.064379] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T20:59:23.278729] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-10T20:59:23.489378] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-10T20:59:24.289380] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-10T20:59:24.944245] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-10T20:59:25.089399] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-10T20:59:25.380335] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T20:59:25.889419] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-10T20:59:25.955318] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T20:59:26.689913] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-10T20:59:26.923234] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-10T20:59:27.373474] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-10T20:59:27.451024] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T20:59:27.455587] [INFO ] [REMOTE ] PLNT: Full fetch complete (70037 records). [2025-10-10T20:59:27.455795] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-10T20:59:27.456944] [FATAL] [VALIDATOR ] PLNT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:59:27.457063] [FATAL] [MAIN ] PLNT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:59:27.457119] [WARN ] [MAIN ] PLNT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:59:27.457201] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-10T20:59:27.457277] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-10T20:59:27.457323] [INFO ] [LOCAL ] PLNT: Starting deletion of derivative data. [2025-10-10T20:59:27.457463] [DEBUG] [LOCAL ] PLNT: No derivative data file found to delete. [2025-10-10T20:59:27.457557] [INFO ] [MAIN ] Update Progress: 1700/2373 symbols completed. PLNT took 38.6s. Estimated remaining: 1h 34m 46s. Rate: 7.1 symbols/min [2025-10-10T20:59:27.494499] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-10T20:59:27.642684] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:59:27.642958] [DEBUG] [LOCAL ] PML: No existing data file found in primary storage. [2025-10-10T20:59:27.643018] [WARN ] [MAIN ] PML: No existing data found, performing full refresh instead. [2025-10-10T20:59:27.643171] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-10T20:59:27.643229] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-10T20:59:27.643296] [DEBUG] [LOCAL ] PML: No primary data file found to delete. [2025-10-10T20:59:27.643348] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-10T20:59:28.026390] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:59:28.289394] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-10-10T20:59:29.089362] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-10T20:59:29.226047] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T20:59:29.645164] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T20:59:29.889411] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-10T20:59:30.689400] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-10T20:59:31.160112] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-10T20:59:31.457028] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T20:59:31.489346] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-10T20:59:31.555125] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-10T20:59:32.289385] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-10T20:59:33.062431] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T20:59:33.089347] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-10T20:59:33.889355] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-10T20:59:34.373251] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T20:59:34.623277] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-10T20:59:34.689338] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-10T20:59:35.489346] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-10T20:59:35.731332] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T20:59:35.826867] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-10T20:59:36.289376] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-10T20:59:37.089405] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-10T20:59:37.619344] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-10T20:59:37.889365] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-10T20:59:38.021705] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T20:59:38.102934] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-10T20:59:38.689391] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-10T20:59:39.368851] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-10T20:59:39.370514] [INFO ] [REMOTE ] PLOW: Full fetch complete (28386 records). [2025-10-10T20:59:39.370584] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-10T20:59:39.371083] [FATAL] [VALIDATOR ] PLOW: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:59:39.371167] [FATAL] [MAIN ] PLOW: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:59:39.371209] [WARN ] [MAIN ] PLOW: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:59:39.371248] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-10T20:59:39.371303] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-10T20:59:39.371339] [INFO ] [LOCAL ] PLOW: Starting deletion of derivative data. [2025-10-10T20:59:39.371379] [DEBUG] [LOCAL ] PLOW: No derivative data file found to delete. [2025-10-10T20:59:39.371431] [INFO ] [MAIN ] Update Progress: 1701/2373 symbols completed. PLOW took 35.3s. Estimated remaining: 1h 34m 39s. Rate: 7.1 symbols/min [2025-10-10T20:59:39.492318] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-10T20:59:39.548141] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:59:39.548362] [DEBUG] [LOCAL ] PMM: No existing data file found in primary storage. [2025-10-10T20:59:39.548407] [WARN ] [MAIN ] PMM: No existing data found, performing full refresh instead. [2025-10-10T20:59:39.548516] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-10T20:59:39.548557] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-10T20:59:39.548600] [DEBUG] [LOCAL ] PMM: No primary data file found to delete. [2025-10-10T20:59:39.548633] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-10T20:59:39.903609] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:59:39.934938] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-10T20:59:40.289363] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-10T20:59:40.799797] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T20:59:41.089435] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-10T20:59:41.889390] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-10T20:59:41.959188] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T20:59:41.962672] [INFO ] [REMOTE ] PLYM: Full fetch complete (47089 records). [2025-10-10T20:59:41.962759] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-10T20:59:41.963260] [FATAL] [VALIDATOR ] PLYM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:59:41.963344] [FATAL] [MAIN ] PLYM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:59:41.963387] [WARN ] [MAIN ] PLYM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:59:41.963449] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-10T20:59:41.963511] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-10T20:59:41.963548] [INFO ] [LOCAL ] PLYM: Starting deletion of derivative data. [2025-10-10T20:59:41.963588] [DEBUG] [LOCAL ] PLYM: No derivative data file found to delete. [2025-10-10T20:59:41.963666] [INFO ] [MAIN ] Update Progress: 1702/2373 symbols completed. PLYM took 30.3s. Estimated remaining: 1h 34m 28s. Rate: 7.1 symbols/min [2025-10-10T20:59:42.134233] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:59:42.134469] [DEBUG] [LOCAL ] PMO: No existing data file found in primary storage. [2025-10-10T20:59:42.134541] [WARN ] [MAIN ] PMO: No existing data found, performing full refresh instead. [2025-10-10T20:59:42.134867] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-10T20:59:42.134934] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-10T20:59:42.135111] [DEBUG] [LOCAL ] PMO: No primary data file found to delete. [2025-10-10T20:59:42.135167] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-10T20:59:42.521306] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:59:42.517007] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-10T20:59:42.689331] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-10-10T20:59:43.042264] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T20:59:43.489347] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-10T20:59:43.953026] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T20:59:44.289342] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-10-10T20:59:44.730827] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-10T20:59:45.089363] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-10T20:59:45.711550] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T20:59:45.889377] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-10T20:59:46.689419] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-10T20:59:47.167822] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T20:59:47.489353] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-10T20:59:47.494562] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-10T20:59:47.510781] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-10T20:59:48.289366] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-10T20:59:48.792608] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T20:59:49.089480] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-10T20:59:49.889344] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-10T20:59:50.272498] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-10T20:59:50.482711] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-10T20:59:50.689373] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-10T20:59:50.893416] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-10T20:59:51.489351] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-10T20:59:51.502706] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T20:59:51.507103] [INFO ] [REMOTE ] PM: Full fetch complete (77325 records). [2025-10-10T20:59:51.507217] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-10T20:59:51.508265] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T20:59:51.508348] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T20:59:51.508391] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T20:59:51.508455] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-10T20:59:51.508516] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-10T20:59:51.508551] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-10-10T20:59:51.508590] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-10-10T20:59:51.508667] [INFO ] [MAIN ] Update Progress: 1703/2373 symbols completed. PM took 31.9s. Estimated remaining: 1h 34m 20s. Rate: 7.1 symbols/min [2025-10-10T20:59:51.670537] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T20:59:51.670716] [DEBUG] [LOCAL ] PMT: No existing data file found in primary storage. [2025-10-10T20:59:51.670763] [WARN ] [MAIN ] PMT: No existing data found, performing full refresh instead. [2025-10-10T20:59:51.670866] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-10T20:59:51.670907] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-10T20:59:51.670951] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-10T20:59:51.670982] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-10T20:59:52.013593] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T20:59:52.289394] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-10T20:59:52.503368] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-10T20:59:53.089403] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-10-10T20:59:53.626041] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-10T20:59:53.889367] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-10T20:59:54.689388] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-10T20:59:54.932669] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T20:59:55.251238] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T20:59:55.489416] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-10T20:59:56.172045] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-10T20:59:56.289409] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-10T20:59:56.382430] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-10T20:59:57.089447] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-10T20:59:57.342215] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-10T20:59:57.889404] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-10T20:59:58.491254] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-10T20:59:58.689355] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-10T20:59:59.489349] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-10T20:59:59.688335] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T21:00:00.254846] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T21:00:00.289351] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-10T21:00:00.733934] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-10T21:00:01.089416] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-10T21:00:01.280337] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T21:00:01.283689] [INFO ] [REMOTE ] PML: Full fetch complete (29662 records). [2025-10-10T21:00:01.283880] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-10T21:00:01.864679] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-10T21:00:01.864810] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-10T21:00:01.866295] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-10T21:00:01.866401] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-10T21:00:01.867836] [DEBUG] [LOCAL ] PML: Trimmed 29662 records to 21832 (keeping 200 days of data) [2025-10-10T21:00:01.929619] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-10T21:00:02.051535] [DEBUG] [LOCAL ] PML: Primary data saved (21832 records). [2025-10-10T21:00:02.051781] [INFO ] [MAIN ] PML: Full history saved. [2025-10-10T21:00:02.051906] [INFO ] [MAIN ] Update Progress: 1704/2373 symbols completed. PML took 34.6s. Estimated remaining: 1h 34m 13s. Rate: 7.1 symbols/min [2025-10-10T21:00:02.239577] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-10T21:00:02.281309] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:00:02.281550] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-10T21:00:02.281588] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-10T21:00:02.281743] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-10T21:00:02.281791] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-10T21:00:02.281834] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-10T21:00:02.281868] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-10T21:00:02.661269] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:00:02.689385] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-10-10T21:00:03.017592] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-10T21:00:03.243051] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-10T21:00:03.489380] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-10T21:00:04.149024] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-10T21:00:04.289386] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-10T21:00:05.089380] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-10T21:00:05.500961] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-10T21:00:05.659236] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-10T21:00:05.889375] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-10T21:00:06.689402] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-10T21:00:06.946952] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-10T21:00:07.217946] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-10T21:00:07.489392] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-10T21:00:08.289376] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-10T21:00:08.636021] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-10T21:00:09.089397] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-10T21:00:09.889400] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-10T21:00:10.051731] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-10T21:00:10.073834] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T21:00:10.689340] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-10T21:00:11.111409] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T21:00:11.489399] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-10T21:00:11.724700] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-10T21:00:12.142766] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-10T21:00:12.144043] [INFO ] [REMOTE ] PMO: Full fetch complete (16578 records). [2025-10-10T21:00:12.144121] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-10T21:00:12.297154] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-10T21:00:12.528197] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-10T21:00:12.528293] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-10T21:00:12.528765] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-10T21:00:12.528832] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-10T21:00:12.529304] [DEBUG] [LOCAL ] PMO: Trimmed 16578 records to 10158 (keeping 200 days of data) [2025-10-10T21:00:12.590703] [DEBUG] [LOCAL ] PMO: Primary data saved (10158 records). [2025-10-10T21:00:12.590842] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-10T21:00:12.590921] [INFO ] [MAIN ] Update Progress: 1705/2373 symbols completed. PMO took 30.6s. Estimated remaining: 1h 34m 5s. Rate: 7.1 symbols/min [2025-10-10T21:00:12.757059] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:00:12.757232] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-10T21:00:12.757269] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-10T21:00:12.757380] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-10T21:00:12.757421] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-10T21:00:12.757465] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-10T21:00:12.757497] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-10T21:00:13.099675] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-10T21:00:13.104359] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:00:13.723778] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-10T21:00:13.734759] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-10T21:00:13.889377] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-10T21:00:14.505561] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-10T21:00:14.689365] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-10T21:00:15.489381] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-10-10T21:00:15.562570] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-10T21:00:15.928103] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:00:15.928618] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-10-10T21:00:15.928740] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:00:15.928804] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-10T21:00:15.928862] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:00:15.928912] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-10T21:00:15.928978] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-10T21:00:15.929016] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-10T21:00:15.929056] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-10T21:00:15.929110] [INFO ] [MAIN ] Update Progress: 1706/2373 symbols completed. PMTV took 3.3s. Estimated remaining: 1h 33m 55s. Rate: 7.1 symbols/min [2025-10-10T21:00:16.117460] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:00:16.117806] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-10T21:00:16.117864] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-10T21:00:16.118008] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-10T21:00:16.118078] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-10T21:00:16.118140] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-10T21:00:16.118177] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-10T21:00:16.299249] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-10T21:00:16.495010] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:00:17.044699] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-10T21:00:17.089389] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-10T21:00:17.889411] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-10T21:00:18.175968] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T21:00:18.180835] [INFO ] [REMOTE ] PMM: Full fetch complete (17934 records). [2025-10-10T21:00:18.180981] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-10T21:00:18.284088] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-10T21:00:18.540633] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-10T21:00:18.540738] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-10T21:00:18.541140] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-10T21:00:18.541224] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-10T21:00:18.541765] [DEBUG] [LOCAL ] PMM: Trimmed 17934 records to 10748 (keeping 200 days of data) [2025-10-10T21:00:18.603418] [DEBUG] [LOCAL ] PMM: Primary data saved (10748 records). [2025-10-10T21:00:18.603549] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-10T21:00:18.603621] [INFO ] [MAIN ] Update Progress: 1707/2373 symbols completed. PMM took 39.2s. Estimated remaining: 1h 33m 44s. Rate: 7.1 symbols/min [2025-10-10T21:00:18.698219] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-10T21:00:18.770166] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:00:18.770411] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-10T21:00:18.770466] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-10T21:00:18.770577] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-10T21:00:18.770618] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-10T21:00:18.770694] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-10T21:00:18.770742] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-10T21:00:19.138069] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:00:19.249237] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-10T21:00:19.489383] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-10-10T21:00:20.289418] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-10-10T21:00:20.614177] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:00:20.614476] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-10-10T21:00:20.614567] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:00:20.614612] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-10T21:00:20.614680] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:00:20.614748] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-10T21:00:20.614819] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-10T21:00:20.614866] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-10T21:00:20.614922] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-10T21:00:20.614983] [INFO ] [MAIN ] Update Progress: 1708/2373 symbols completed. PMTW took 4.7s. Estimated remaining: 1h 33m 33s. Rate: 7.1 symbols/min [2025-10-10T21:00:20.779498] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:00:20.779708] [DEBUG] [LOCAL ] PNI: No existing data file found in primary storage. [2025-10-10T21:00:20.779759] [WARN ] [MAIN ] PNI: No existing data found, performing full refresh instead. [2025-10-10T21:00:20.779868] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-10T21:00:20.779913] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-10T21:00:20.779989] [DEBUG] [LOCAL ] PNI: No primary data file found to delete. [2025-10-10T21:00:20.780042] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-10T21:00:21.098393] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-10T21:00:21.140248] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:00:21.670945] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-10T21:00:21.889363] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-10T21:00:22.328188] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-10T21:00:22.328891] [INFO ] [REMOTE ] PMTU: Full fetch complete (1207 records). [2025-10-10T21:00:22.328956] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-10T21:00:22.507493] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-10T21:00:22.507789] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:00:22.507838] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:00:22.507923] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-10T21:00:22.508032] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-10T21:00:22.508093] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-10T21:00:22.508138] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-10T21:00:22.508196] [INFO ] [MAIN ] Update Progress: 1709/2373 symbols completed. PMTU took 20.5s. Estimated remaining: 1h 33m 22s. Rate: 7.1 symbols/min [2025-10-10T21:00:22.675942] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:00:22.676250] [DEBUG] [LOCAL ] PNNT: No existing data file found in primary storage. [2025-10-10T21:00:22.676321] [WARN ] [MAIN ] PNNT: No existing data found, performing full refresh instead. [2025-10-10T21:00:22.676455] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-10T21:00:22.676585] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-10T21:00:22.676699] [DEBUG] [LOCAL ] PNNT: No primary data file found to delete. [2025-10-10T21:00:22.676758] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-10T21:00:22.696677] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-10T21:00:23.034507] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:00:23.057992] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T21:00:23.489371] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-10T21:00:24.289357] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-10-10T21:00:24.938938] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-10T21:00:25.089365] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-10-10T21:00:25.413031] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-10T21:00:25.629260] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-10T21:00:25.889379] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-10T21:00:26.689361] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-10T21:00:26.722896] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T21:00:27.489397] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-10T21:00:27.576511] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T21:00:27.981153] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-10T21:00:28.289408] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-10T21:00:28.966876] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-10T21:00:29.089392] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-10T21:00:29.889358] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-10T21:00:30.623930] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-10T21:00:30.689354] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-10T21:00:30.769631] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-10T21:00:31.489374] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-10T21:00:31.703774] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T21:00:32.017808] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-10T21:00:32.289348] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-10T21:00:32.761752] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T21:00:33.089380] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-10T21:00:33.815060] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T21:00:33.889377] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-10T21:00:34.689360] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-10T21:00:34.797517] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T21:00:35.489385] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-10T21:00:35.509908] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-10T21:00:35.952323] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-10T21:00:36.289418] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-10T21:00:37.063929] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T21:00:37.089344] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-10T21:00:37.355632] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-10T21:00:37.889383] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-10T21:00:38.594179] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-10T21:00:38.668595] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-10T21:00:38.689334] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-10T21:00:39.489371] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-10T21:00:39.509059] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-10T21:00:40.289375] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-10T21:00:41.089375] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-10T21:00:41.144405] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-10T21:00:41.336237] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T21:00:41.889384] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-10T21:00:42.689362] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-10T21:00:42.904966] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-10T21:00:43.296255] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-10T21:00:43.489556] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-10T21:00:44.289400] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-10T21:00:44.531477] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T21:00:45.089431] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-10T21:00:45.150997] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-10T21:00:45.889347] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-10T21:00:45.907525] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T21:00:45.911350] [INFO ] [REMOTE ] PMT: Full fetch complete (58260 records). [2025-10-10T21:00:45.911477] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-10T21:00:45.912154] [FATAL] [VALIDATOR ] PMT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:00:45.912242] [FATAL] [MAIN ] PMT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:00:45.912287] [WARN ] [MAIN ] PMT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:00:45.912351] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-10T21:00:45.912413] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-10T21:00:45.912470] [INFO ] [LOCAL ] PMT: Starting deletion of derivative data. [2025-10-10T21:00:45.912512] [DEBUG] [LOCAL ] PMT: No derivative data file found to delete. [2025-10-10T21:00:45.912568] [INFO ] [MAIN ] Update Progress: 1710/2373 symbols completed. PMT took 54.4s. Estimated remaining: 1h 33m 19s. Rate: 7.1 symbols/min [2025-10-10T21:00:46.080526] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:00:46.080800] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-10T21:00:46.080932] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-10T21:00:46.081062] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-10T21:00:46.081163] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-10T21:00:46.081224] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-10T21:00:46.081259] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-10T21:00:46.438977] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:00:46.468574] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-10T21:00:46.689379] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-10T21:00:47.117602] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T21:00:47.489386] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-10T21:00:48.289504] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-10T21:00:48.774514] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-10T21:00:49.089442] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-10-10T21:00:49.263593] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-10T21:00:49.324247] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T21:00:49.889396] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-10T21:00:50.689360] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-10T21:00:51.225370] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-10T21:00:51.489452] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-10T21:00:51.958068] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-10T21:00:52.289355] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-10T21:00:52.571331] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-10T21:00:52.912071] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-10T21:00:52.986819] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-10T21:00:52.987785] [INFO ] [REMOTE ] PNI: Full fetch complete (9706 records). [2025-10-10T21:00:52.987852] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-10T21:00:53.094519] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-10T21:00:53.354831] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-10T21:00:53.354928] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-10T21:00:53.355223] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-10T21:00:53.355288] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-10T21:00:53.355751] [DEBUG] [LOCAL ] PNI: Trimmed 9706 records to 6871 (keeping 200 days of data) [2025-10-10T21:00:53.406737] [DEBUG] [LOCAL ] PNI: Primary data saved (6871 records). [2025-10-10T21:00:53.406917] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-10T21:00:53.407043] [INFO ] [MAIN ] Update Progress: 1711/2373 symbols completed. PNI took 32.8s. Estimated remaining: 1h 33m 11s. Rate: 7.1 symbols/min [2025-10-10T21:00:53.603052] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:00:53.603243] [DEBUG] [LOCAL ] PNW: No existing data file found in primary storage. [2025-10-10T21:00:53.603281] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-10-10T21:00:53.603393] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-10T21:00:53.603435] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-10T21:00:53.603477] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-10T21:00:53.603510] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-10T21:00:53.895534] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-10T21:00:53.994126] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:00:54.689440] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-10T21:00:54.928349] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-10T21:00:55.313924] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T21:00:55.489332] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-10T21:00:55.626837] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T21:00:55.631124] [INFO ] [REMOTE ] PNC: Full fetch complete (75010 records). [2025-10-10T21:00:55.631226] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-10T21:00:55.631871] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:00:55.631952] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:00:55.631995] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:00:55.632033] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-10T21:00:55.632110] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-10T21:00:55.632167] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-10-10T21:00:55.632211] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-10-10T21:00:55.632267] [INFO ] [MAIN ] Update Progress: 1712/2373 symbols completed. PNC took 37.0s. Estimated remaining: 1h 32m 60s. Rate: 7.1 symbols/min [2025-10-10T21:00:55.797472] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:00:55.797672] [DEBUG] [LOCAL ] POR: No existing data file found in primary storage. [2025-10-10T21:00:55.797727] [WARN ] [MAIN ] POR: No existing data found, performing full refresh instead. [2025-10-10T21:00:55.797838] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-10T21:00:55.797880] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-10T21:00:55.797921] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-10T21:00:55.797955] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-10T21:00:56.137763] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:00:56.289332] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-10-10T21:00:57.089438] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-10T21:00:57.572565] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T21:00:57.889376] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-10T21:00:58.253929] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-10T21:00:58.675063] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-10T21:00:58.678815] [INFO ] [REMOTE ] PNNT: Full fetch complete (47766 records). [2025-10-10T21:00:58.678926] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-10T21:00:58.699481] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-10-10T21:00:59.054238] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-10T21:00:59.054351] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-10T21:00:59.055209] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-10T21:00:59.055290] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-10T21:00:59.056288] [DEBUG] [LOCAL ] PNNT: Trimmed 47766 records to 33721 (keeping 200 days of data) [2025-10-10T21:00:59.244461] [DEBUG] [LOCAL ] PNNT: Primary data saved (33721 records). [2025-10-10T21:00:59.244595] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-10T21:00:59.244688] [INFO ] [MAIN ] Update Progress: 1713/2373 symbols completed. PNNT took 36.7s. Estimated remaining: 1h 32m 49s. Rate: 7.1 symbols/min [2025-10-10T21:00:59.413203] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:00:59.413373] [DEBUG] [LOCAL ] POST: No existing data file found in primary storage. [2025-10-10T21:00:59.413439] [WARN ] [MAIN ] POST: No existing data found, performing full refresh instead. [2025-10-10T21:00:59.413570] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-10T21:00:59.413631] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-10T21:00:59.413728] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-10T21:00:59.413869] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-10T21:00:59.497929] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-10T21:00:59.802510] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:00:59.804673] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T21:01:00.289346] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-10-10T21:01:00.682854] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T21:01:01.089387] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-10T21:01:01.565785] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-10T21:01:01.889373] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-10T21:01:02.262341] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T21:01:02.689367] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-10T21:01:03.125942] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-10T21:01:03.254866] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T21:01:03.489396] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-10T21:01:04.289411] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-10T21:01:04.666005] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T21:01:05.089346] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-10T21:01:05.441427] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T21:01:05.889422] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-10T21:01:06.429427] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T21:01:06.540100] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-10T21:01:06.689334] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-10T21:01:07.489337] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-10T21:01:07.837271] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-10T21:01:08.289363] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-10T21:01:08.460922] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T21:01:09.089429] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-10T21:01:09.303523] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T21:01:09.889364] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-10T21:01:10.402368] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T21:01:10.689349] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-10T21:01:10.828805] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-10T21:01:11.299696] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-10T21:01:11.489345] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-10T21:01:12.289377] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-10T21:01:12.536062] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T21:01:13.089398] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-10T21:01:13.496106] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T21:01:13.889390] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-10T21:01:13.982570] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T21:01:14.689369] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-10T21:01:15.058482] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-10T21:01:15.489369] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-10T21:01:15.833051] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-10T21:01:16.046162] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T21:01:16.289372] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-10T21:01:17.089442] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-10T21:01:17.636071] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T21:01:17.889342] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-10T21:01:18.084870] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-10T21:01:18.689343] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-10T21:01:18.975158] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T21:01:19.489357] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-10T21:01:19.871289] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T21:01:20.289355] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-10T21:01:20.310049] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T21:01:20.313969] [INFO ] [REMOTE ] PNR: Full fetch complete (68793 records). [2025-10-10T21:01:20.314102] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-10T21:01:20.314882] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:01:20.315019] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:01:20.315062] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:01:20.315102] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-10T21:01:20.315161] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-10T21:01:20.315196] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-10-10T21:01:20.315261] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-10-10T21:01:20.315334] [INFO ] [MAIN ] Update Progress: 1714/2373 symbols completed. PNR took 34.4s. Estimated remaining: 1h 32m 46s. Rate: 7.1 symbols/min [2025-10-10T21:01:20.456701] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T21:01:20.513496] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:01:20.513705] [DEBUG] [LOCAL ] PPG: No existing data file found in primary storage. [2025-10-10T21:01:20.513755] [WARN ] [MAIN ] PPG: No existing data found, performing full refresh instead. [2025-10-10T21:01:20.513872] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-10T21:01:20.513912] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-10T21:01:20.513952] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-10T21:01:20.513984] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-10T21:01:20.864495] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:01:21.089366] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-10-10T21:01:21.889370] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-10T21:01:22.124947] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T21:01:22.689381] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-10T21:01:23.211047] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-10T21:01:23.328059] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-10T21:01:23.489370] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-10T21:01:24.289422] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-10T21:01:24.399942] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T21:01:24.403860] [INFO ] [REMOTE ] POR: Full fetch complete (68068 records). [2025-10-10T21:01:24.403972] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-10T21:01:24.404568] [FATAL] [VALIDATOR ] POR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:01:24.404687] [FATAL] [MAIN ] POR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:01:24.404742] [WARN ] [MAIN ] POR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:01:24.404815] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-10T21:01:24.404879] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-10T21:01:24.404915] [INFO ] [LOCAL ] POR: Starting deletion of derivative data. [2025-10-10T21:01:24.404954] [DEBUG] [LOCAL ] POR: No derivative data file found to delete. [2025-10-10T21:01:24.405037] [INFO ] [MAIN ] Update Progress: 1715/2373 symbols completed. POR took 28.8s. Estimated remaining: 1h 32m 36s. Rate: 7.1 symbols/min [2025-10-10T21:01:24.602906] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:01:24.605846] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T21:01:24.605989] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-10T21:01:24.606185] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-10T21:01:24.615241] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-10T21:01:24.615448] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-10T21:01:24.615511] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-10T21:01:24.615547] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-10T21:01:24.976719] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:01:25.089367] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-10-10T21:01:25.889375] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-10T21:01:26.402541] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-10T21:01:26.689362] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-10T21:01:26.821385] [DEBUG] [REMOTE ] PPG: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-10T21:01:26.821758] [WARN ] [REMOTE ] PPG: No data returned for month 2025-02 [2025-10-10T21:01:26.821844] [FATAL] [REMOTE ] PPG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:01:26.821927] [FATAL] [MAIN ] PPG: Failed to fetch primary data. [2025-10-10T21:01:26.821988] [WARN ] [MAIN ] PPG: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:01:26.822059] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-10T21:01:26.822120] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-10T21:01:26.822156] [INFO ] [LOCAL ] PPG: Starting deletion of derivative data. [2025-10-10T21:01:26.822196] [DEBUG] [LOCAL ] PPG: No derivative data file found to delete. [2025-10-10T21:01:26.822263] [INFO ] [MAIN ] Update Progress: 1716/2373 symbols completed. PPG took 6.5s. Estimated remaining: 1h 32m 25s. Rate: 7.1 symbols/min [2025-10-10T21:01:27.021206] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:01:27.021581] [DEBUG] [LOCAL ] PPT: No existing data file found in primary storage. [2025-10-10T21:01:27.021637] [WARN ] [MAIN ] PPT: No existing data found, performing full refresh instead. [2025-10-10T21:01:27.021798] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-10T21:01:27.021840] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-10T21:01:27.021883] [DEBUG] [LOCAL ] PPT: No primary data file found to delete. [2025-10-10T21:01:27.021915] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-10T21:01:27.370613] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-10T21:01:27.454836] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:01:27.490845] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-10T21:01:27.494161] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-10T21:01:28.289378] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-10T21:01:29.089432] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-10-10T21:01:29.548406] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T21:01:29.889356] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-10T21:01:30.125737] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T21:01:30.356187] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-10T21:01:30.689364] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-10T21:01:31.489432] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-10T21:01:31.749801] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T21:01:31.916404] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-10T21:01:32.289368] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-10T21:01:33.089393] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-10T21:01:33.622457] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-10T21:01:33.645524] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-10T21:01:33.889372] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-10T21:01:34.689353] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-10T21:01:34.852738] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T21:01:35.489411] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-10T21:01:35.764188] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T21:01:35.854136] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-10T21:01:35.867894] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-10T21:01:35.871300] [INFO ] [REMOTE ] POST: Full fetch complete (55058 records). [2025-10-10T21:01:35.871422] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-10T21:01:35.872257] [FATAL] [VALIDATOR ] POST: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:01:35.872359] [FATAL] [MAIN ] POST: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:01:35.872404] [WARN ] [MAIN ] POST: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:01:35.872447] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-10T21:01:35.872501] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-10T21:01:35.872536] [INFO ] [LOCAL ] POST: Starting deletion of derivative data. [2025-10-10T21:01:35.872574] [DEBUG] [LOCAL ] POST: No derivative data file found to delete. [2025-10-10T21:01:35.872672] [INFO ] [MAIN ] Update Progress: 1717/2373 symbols completed. POST took 36.6s. Estimated remaining: 1h 32m 17s. Rate: 7.1 symbols/min [2025-10-10T21:01:36.289444] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-10T21:01:37.089466] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-10T21:01:37.889411] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-10T21:01:37.953154] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T21:01:37.957139] [INFO ] [REMOTE ] PNW: Full fetch complete (65644 records). [2025-10-10T21:01:37.957256] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-10T21:01:37.957933] [FATAL] [VALIDATOR ] PNW: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:01:37.958016] [FATAL] [MAIN ] PNW: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:01:37.958059] [WARN ] [MAIN ] PNW: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:01:37.958123] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-10T21:01:37.958184] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-10T21:01:37.958219] [INFO ] [LOCAL ] PNW: Starting deletion of derivative data. [2025-10-10T21:01:37.958258] [DEBUG] [LOCAL ] PNW: No derivative data file found to delete. [2025-10-10T21:01:37.958336] [INFO ] [MAIN ] Update Progress: 1718/2373 symbols completed. PNW took 44.6s. Estimated remaining: 1h 32m 6s. Rate: 7.1 symbols/min [2025-10-10T21:01:38.217536] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-10T21:01:38.689401] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-10T21:01:39.129587] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-10T21:01:39.489445] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-10T21:01:40.812564] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T21:01:40.818246] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-10T21:01:40.926263] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-10T21:01:41.089410] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-10T21:01:41.816837] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-10T21:01:41.889433] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-10T21:01:43.041930] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T21:01:43.053075] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-10T21:01:43.124558] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T21:01:43.489446] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-10T21:01:44.774793] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T21:01:44.780682] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-10T21:01:45.150779] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-10T21:01:45.162057] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-10T21:01:46.158632] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T21:01:46.163476] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-10T21:01:47.366074] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T21:01:47.368216] [INFO ] [REMOTE ] PPT: Full fetch complete (28778 records). [2025-10-10T21:01:47.368286] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-10T21:01:47.549696] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-10T21:01:47.660682] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-10T21:01:47.781487] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-10T21:01:47.781554] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-10T21:01:47.782183] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-10T21:01:47.782245] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-10T21:01:47.782943] [DEBUG] [LOCAL ] PPT: Trimmed 28778 records to 20141 (keeping 200 days of data) [2025-10-10T21:01:47.898310] [DEBUG] [LOCAL ] PPT: Primary data saved (20141 records). [2025-10-10T21:01:47.898429] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-10T21:01:47.898512] [INFO ] [MAIN ] Update Progress: 1719/2373 symbols completed. PPT took 21.1s. Estimated remaining: 1h 31m 58s. Rate: 7.1 symbols/min [2025-10-10T21:01:49.781873] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-10T21:01:49.793335] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-10T21:01:51.937096] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T21:01:51.948514] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-10T21:01:52.833375] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T21:01:52.837867] [INFO ] [REMOTE ] PPL: Full fetch complete (77023 records). [2025-10-10T21:01:52.837989] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-10T21:01:52.838609] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:01:52.838733] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:01:52.838784] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:01:52.838851] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-10T21:01:52.838914] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-10T21:01:52.838950] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-10-10T21:01:52.839036] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-10-10T21:01:52.839109] [INFO ] [MAIN ] Update Progress: 1720/2373 symbols completed. PPL took 28.4s. Estimated remaining: 1h 31m 48s. Rate: 7.1 symbols/min [2025-10-10T21:01:53.547829] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:01:53.585488] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:01:53.587489] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:01:53.588382] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:01:53.585798] [DEBUG] [LOCAL ] PRG: No existing data file found in primary storage. [2025-10-10T21:01:53.588541] [DEBUG] [LOCAL ] PRA: No existing data file found in primary storage. [2025-10-10T21:01:53.588703] [DEBUG] [LOCAL ] PR: No existing data file found in primary storage. [2025-10-10T21:01:53.587568] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-10-10T21:01:53.588816] [WARN ] [MAIN ] PRA: No existing data found, performing full refresh instead. [2025-10-10T21:01:53.588857] [WARN ] [MAIN ] PR: No existing data found, performing full refresh instead. [2025-10-10T21:01:53.589464] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-10T21:01:53.588929] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-10-10T21:01:53.589246] [WARN ] [MAIN ] PRG: No existing data found, performing full refresh instead. [2025-10-10T21:01:53.589953] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-10T21:01:53.590181] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-10T21:01:53.590078] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-10T21:01:53.589907] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-10T21:01:53.590503] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-10T21:01:53.590828] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-10T21:01:53.590589] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-10T21:01:53.590429] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-10T21:01:53.590724] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-10T21:01:53.591152] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-10T21:01:53.591026] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-10-10T21:01:53.591251] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-10T21:01:53.601820] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-10T21:01:53.616758] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-10T21:01:53.643340] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-10T21:01:54.913468] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:01:54.970926] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-10-10T21:01:54.974528] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:01:55.071143] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-10-10T21:01:55.080701] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:01:55.084578] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-10-10T21:01:55.106941] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:01:55.107278] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-10-10T21:01:55.752007] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-10T21:01:55.752976] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-10T21:01:56.435165] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-10T21:01:56.436434] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-10T21:01:56.592707] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T21:01:56.597610] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-10T21:01:56.711555] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-10T21:01:56.719148] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-10T21:01:56.847960] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-10T21:01:56.858996] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-10T21:01:57.119031] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-10T21:01:57.120261] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-10T21:01:57.864672] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-10T21:01:57.864786] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-10T21:01:57.869183] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-10T21:01:57.889349] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-10T21:01:58.048514] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T21:01:58.689347] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-10T21:01:59.038823] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T21:01:59.040658] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-10T21:01:59.131388] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T21:01:59.489446] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-10T21:02:00.240051] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-10T21:02:00.289336] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-10T21:02:00.355495] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-10T21:02:00.967333] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-10T21:02:01.089383] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-10T21:02:01.889475] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-10T21:02:02.545172] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-10T21:02:02.689368] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-10T21:02:03.263454] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-10T21:02:03.489409] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-10T21:02:04.289386] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-10T21:02:04.389044] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-10T21:02:05.089349] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-10T21:02:05.202686] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T21:02:05.889401] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-10T21:02:06.620331] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-10T21:02:06.689334] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-10T21:02:06.865753] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T21:02:07.489433] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-10T21:02:07.800090] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T21:02:08.289385] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-10T21:02:09.051603] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-10T21:02:09.089326] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-10T21:02:09.218365] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T21:02:09.889383] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-10T21:02:10.134996] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T21:02:10.534569] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-10T21:02:10.689379] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-10T21:02:11.303237] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T21:02:11.489434] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-10T21:02:12.175288] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-10T21:02:12.289386] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-10T21:02:12.822568] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-10T21:02:12.915635] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-10T21:02:13.089390] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-10T21:02:13.889372] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-10T21:02:14.689446] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-10T21:02:14.738421] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T21:02:15.340436] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-10T21:02:15.341425] [INFO ] [REMOTE ] PRCS: Full fetch complete (3866 records). [2025-10-10T21:02:15.341493] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-10T21:02:15.496612] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-10T21:02:15.655902] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T21:02:15.739908] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-10T21:02:15.739980] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-10T21:02:15.740130] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-10T21:02:15.740171] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-10T21:02:15.740511] [DEBUG] [LOCAL ] PRCS: Trimmed 3866 records to 2790 (keeping 200 days of data) [2025-10-10T21:02:15.756690] [DEBUG] [LOCAL ] PRCS: Primary data saved (2790 records). [2025-10-10T21:02:15.756752] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-10T21:02:15.756812] [INFO ] [MAIN ] Update Progress: 1721/2373 symbols completed. PRCS took 22.9s. Estimated remaining: 1h 31m 45s. Rate: 7.1 symbols/min [2025-10-10T21:02:15.920692] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:02:15.920840] [DEBUG] [LOCAL ] PRGO: No existing data file found in primary storage. [2025-10-10T21:02:15.920878] [WARN ] [MAIN ] PRGO: No existing data found, performing full refresh instead. [2025-10-10T21:02:15.920983] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-10T21:02:15.921024] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-10T21:02:15.921066] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-10T21:02:15.921100] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-10T21:02:16.268750] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:02:16.289326] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-10-10T21:02:17.089406] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-10T21:02:17.808107] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-10T21:02:17.853196] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-10T21:02:17.889333] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-10T21:02:18.676784] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-10T21:02:18.689329] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-10T21:02:19.489378] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-10T21:02:20.071418] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-10T21:02:20.289399] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-10T21:02:20.555844] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-10T21:02:21.037358] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-10T21:02:21.089395] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-10T21:02:21.889388] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-10T21:02:21.907830] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-10T21:02:22.689421] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-10T21:02:23.018294] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T21:02:23.471253] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T21:02:23.475965] [INFO ] [REMOTE ] PRG: Full fetch complete (44031 records). [2025-10-10T21:02:23.476100] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-10T21:02:23.476836] [FATAL] [VALIDATOR ] PRG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:02:23.476969] [FATAL] [MAIN ] PRG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:02:23.477055] [WARN ] [MAIN ] PRG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:02:23.477146] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-10T21:02:23.477232] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-10T21:02:23.477288] [INFO ] [LOCAL ] PRG: Starting deletion of derivative data. [2025-10-10T21:02:23.477350] [DEBUG] [LOCAL ] PRG: No derivative data file found to delete. [2025-10-10T21:02:23.477432] [INFO ] [MAIN ] Update Progress: 1722/2373 symbols completed. PRG took 30.6s. Estimated remaining: 1h 31m 37s. Rate: 7.1 symbols/min [2025-10-10T21:02:23.494626] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-10T21:02:23.636594] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T21:02:23.728028] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:02:23.728260] [DEBUG] [LOCAL ] PRH: No existing data file found in primary storage. [2025-10-10T21:02:23.728304] [WARN ] [MAIN ] PRH: No existing data found, performing full refresh instead. [2025-10-10T21:02:23.728419] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-10T21:02:23.728460] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-10T21:02:23.728500] [DEBUG] [LOCAL ] PRH: No primary data file found to delete. [2025-10-10T21:02:23.728532] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-10T21:02:24.075412] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:02:24.289369] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-10-10T21:02:25.089385] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-10T21:02:25.108996] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-10T21:02:25.620596] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-10T21:02:25.889359] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-10T21:02:26.689352] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-10T21:02:27.217612] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-10T21:02:27.489359] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-10T21:02:27.881745] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T21:02:27.958258] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T21:02:28.289351] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-10T21:02:28.405958] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T21:02:28.410430] [INFO ] [REMOTE ] PR: Full fetch complete (77207 records). [2025-10-10T21:02:28.410550] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-10T21:02:28.411358] [FATAL] [VALIDATOR ] PR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:02:28.411459] [FATAL] [MAIN ] PR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:02:28.411533] [WARN ] [MAIN ] PR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:02:28.411626] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-10T21:02:28.411740] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-10T21:02:28.411784] [INFO ] [LOCAL ] PR: Starting deletion of derivative data. [2025-10-10T21:02:28.411826] [DEBUG] [LOCAL ] PR: No derivative data file found to delete. [2025-10-10T21:02:28.411910] [INFO ] [MAIN ] Update Progress: 1723/2373 symbols completed. PR took 35.6s. Estimated remaining: 1h 31m 27s. Rate: 7.1 symbols/min [2025-10-10T21:02:28.576326] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:02:28.576490] [DEBUG] [LOCAL ] PRI: No existing data file found in primary storage. [2025-10-10T21:02:28.576526] [WARN ] [MAIN ] PRI: No existing data found, performing full refresh instead. [2025-10-10T21:02:28.576821] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-10T21:02:28.576879] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-10T21:02:28.576955] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-10T21:02:28.577012] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-10T21:02:28.926432] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:02:29.089378] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-10-10T21:02:29.889420] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-10T21:02:30.290720] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T21:02:30.374394] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T21:02:30.689367] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-10T21:02:30.831481] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T21:02:30.834441] [INFO ] [REMOTE ] PRA: Full fetch complete (44029 records). [2025-10-10T21:02:30.834521] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-10T21:02:30.835120] [FATAL] [VALIDATOR ] PRA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:02:30.835225] [FATAL] [MAIN ] PRA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:02:30.835268] [WARN ] [MAIN ] PRA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:02:30.835430] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-10T21:02:30.835502] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-10T21:02:30.835538] [INFO ] [LOCAL ] PRA: Starting deletion of derivative data. [2025-10-10T21:02:30.835577] [DEBUG] [LOCAL ] PRA: No derivative data file found to delete. [2025-10-10T21:02:30.835630] [INFO ] [MAIN ] Update Progress: 1724/2373 symbols completed. PRA took 38.0s. Estimated remaining: 1h 31m 16s. Rate: 7.1 symbols/min [2025-10-10T21:02:31.000307] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:02:31.000454] [DEBUG] [LOCAL ] PRIM: No existing data file found in primary storage. [2025-10-10T21:02:31.000490] [WARN ] [MAIN ] PRIM: No existing data found, performing full refresh instead. [2025-10-10T21:02:31.000597] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-10T21:02:31.000638] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-10T21:02:31.000741] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-10T21:02:31.000799] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-10T21:02:31.352512] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:02:31.489353] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-10T21:02:32.225547] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-10T21:02:32.289326] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-10T21:02:32.530506] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T21:02:33.089350] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-10T21:02:33.268312] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T21:02:33.889389] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-10T21:02:34.689353] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-10-10T21:02:34.720145] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-10T21:02:35.061259] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-10T21:02:35.489369] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-10T21:02:36.289344] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-10T21:02:36.396768] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T21:02:36.479392] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-10T21:02:37.089378] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-10T21:02:37.257292] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T21:02:37.889365] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-10T21:02:38.689384] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-10T21:02:38.930326] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T21:02:39.172887] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T21:02:39.489382] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-10T21:02:39.624709] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T21:02:40.289386] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-10T21:02:41.089347] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-10T21:02:41.541317] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-10T21:02:41.889340] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-10T21:02:42.152514] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-10T21:02:42.178246] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T21:02:42.689399] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-10T21:02:43.310621] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-10T21:02:43.489364] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-10T21:02:44.289374] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-10T21:02:44.339013] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-10T21:02:45.011115] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-10T21:02:45.089329] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-10T21:02:45.889343] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-10T21:02:46.254788] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T21:02:46.435463] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-10T21:02:46.662426] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-10T21:02:46.689384] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-10T21:02:47.489390] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-10T21:02:47.522114] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-10T21:02:48.289402] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-10T21:02:48.791181] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-10T21:02:48.996126] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-10T21:02:49.089377] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-10T21:02:49.800341] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T21:02:49.801341] [INFO ] [REMOTE ] PRH: Full fetch complete (7506 records). [2025-10-10T21:02:49.801414] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-10T21:02:49.895311] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-10T21:02:50.149475] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-10T21:02:50.149559] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-10T21:02:50.149770] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-10T21:02:50.149831] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-10T21:02:50.150210] [DEBUG] [LOCAL ] PRH: Trimmed 7506 records to 4848 (keeping 200 days of data) [2025-10-10T21:02:50.179230] [DEBUG] [LOCAL ] PRH: Primary data saved (4848 records). [2025-10-10T21:02:50.179295] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-10T21:02:50.179358] [INFO ] [MAIN ] Update Progress: 1725/2373 symbols completed. PRH took 26.7s. Estimated remaining: 1h 31m 12s. Rate: 7.1 symbols/min [2025-10-10T21:02:50.341593] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:02:50.341773] [DEBUG] [LOCAL ] PRKS: No existing data file found in primary storage. [2025-10-10T21:02:50.341818] [WARN ] [MAIN ] PRKS: No existing data found, performing full refresh instead. [2025-10-10T21:02:50.341952] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-10T21:02:50.342014] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-10T21:02:50.342061] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-10T21:02:50.342095] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-10T21:02:50.685916] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:02:50.689334] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-10-10T21:02:51.489347] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-10T21:02:51.854205] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T21:02:52.071364] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T21:02:52.289357] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-10T21:02:52.466840] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T21:02:52.471089] [INFO ] [REMOTE ] PRGO: Full fetch complete (68226 records). [2025-10-10T21:02:52.471190] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-10T21:02:52.471944] [FATAL] [VALIDATOR ] PRGO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:02:52.472043] [FATAL] [MAIN ] PRGO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:02:52.472120] [WARN ] [MAIN ] PRGO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:02:52.472209] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-10T21:02:52.472300] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-10T21:02:52.472356] [INFO ] [LOCAL ] PRGO: Starting deletion of derivative data. [2025-10-10T21:02:52.472403] [DEBUG] [LOCAL ] PRGO: No derivative data file found to delete. [2025-10-10T21:02:52.472461] [INFO ] [MAIN ] Update Progress: 1726/2373 symbols completed. PRGO took 36.7s. Estimated remaining: 1h 31m 1s. Rate: 7.1 symbols/min [2025-10-10T21:02:52.638701] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:02:52.638871] [DEBUG] [LOCAL ] PRLB: No existing data file found in primary storage. [2025-10-10T21:02:52.638907] [WARN ] [MAIN ] PRLB: No existing data found, performing full refresh instead. [2025-10-10T21:02:52.639043] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-10T21:02:52.639100] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-10T21:02:52.639146] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-10T21:02:52.639178] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-10T21:02:52.985123] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:02:53.089353] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-10-10T21:02:53.889374] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-10T21:02:54.035870] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T21:02:54.571312] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T21:02:54.689439] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-10T21:02:55.489353] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-10T21:02:55.619823] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T21:02:56.289343] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-10T21:02:56.646273] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T21:02:56.727512] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-10T21:02:57.089398] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-10T21:02:57.504241] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T21:02:57.889394] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-10T21:02:58.464748] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T21:02:58.689416] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-10T21:02:59.420452] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T21:02:59.443955] [INFO ] [REMOTE ] PRI: Full fetch complete (25346 records). [2025-10-10T21:02:59.444127] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-10T21:02:59.445579] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-10T21:02:59.446135] [FATAL] [VALIDATOR ] PRI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:02:59.454893] [FATAL] [MAIN ] PRI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:02:59.454965] [WARN ] [MAIN ] PRI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:02:59.455378] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-10T21:02:59.455447] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-10T21:02:59.455483] [INFO ] [LOCAL ] PRI: Starting deletion of derivative data. [2025-10-10T21:02:59.455522] [DEBUG] [LOCAL ] PRI: No derivative data file found to delete. [2025-10-10T21:02:59.455580] [INFO ] [MAIN ] Update Progress: 1727/2373 symbols completed. PRI took 31.0s. Estimated remaining: 1h 30m 52s. Rate: 7.1 symbols/min [2025-10-10T21:02:59.495864] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-10T21:02:59.630828] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:02:59.631023] [DEBUG] [LOCAL ] PRM: No existing data file found in primary storage. [2025-10-10T21:02:59.631072] [WARN ] [MAIN ] PRM: No existing data found, performing full refresh instead. [2025-10-10T21:02:59.631182] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-10T21:02:59.631225] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-10T21:02:59.631266] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-10T21:02:59.631298] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-10T21:02:59.977518] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:03:00.289390] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-10T21:03:00.995953] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-10T21:03:01.089431] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-10T21:03:01.889372] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-10-10T21:03:02.372899] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-10T21:03:02.546620] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T21:03:02.689368] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-10T21:03:03.489416] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-10T21:03:03.808441] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T21:03:04.289353] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-10T21:03:04.720685] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T21:03:04.879197] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-10T21:03:05.089382] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-10T21:03:05.889409] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-10T21:03:06.113725] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-10T21:03:06.689376] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-10T21:03:07.028628] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T21:03:07.489426] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-10T21:03:07.760322] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T21:03:08.289347] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-10T21:03:08.390598] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T21:03:08.394111] [INFO ] [REMOTE ] PRIM: Full fetch complete (63169 records). [2025-10-10T21:03:08.394211] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-10T21:03:08.394821] [FATAL] [VALIDATOR ] PRIM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:03:08.394904] [FATAL] [MAIN ] PRIM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:03:08.394945] [WARN ] [MAIN ] PRIM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:03:08.395008] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-10T21:03:08.395069] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-10T21:03:08.395105] [INFO ] [LOCAL ] PRIM: Starting deletion of derivative data. [2025-10-10T21:03:08.395144] [DEBUG] [LOCAL ] PRIM: No derivative data file found to delete. [2025-10-10T21:03:08.395199] [INFO ] [MAIN ] Update Progress: 1728/2373 symbols completed. PRIM took 37.6s. Estimated remaining: 1h 30m 44s. Rate: 7.1 symbols/min [2025-10-10T21:03:08.591823] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:03:08.593634] [DEBUG] [LOCAL ] PRMB: No existing data file found in primary storage. [2025-10-10T21:03:08.593549] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T21:03:08.593753] [WARN ] [MAIN ] PRMB: No existing data found, performing full refresh instead. [2025-10-10T21:03:08.606244] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-10T21:03:08.606373] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-10T21:03:08.606463] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-10T21:03:08.606947] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-10T21:03:08.959573] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:03:09.089355] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-10-10T21:03:09.896822] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-10T21:03:09.902497] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-10T21:03:10.689423] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-10T21:03:11.067319] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T21:03:11.489441] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-10T21:03:11.833013] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T21:03:12.289403] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-10T21:03:12.476299] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-10T21:03:12.510288] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T21:03:13.089366] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-10T21:03:13.761482] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-10T21:03:13.889362] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-10T21:03:14.446383] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T21:03:14.689386] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-10T21:03:15.489362] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-10T21:03:15.791166] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T21:03:16.289380] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-10T21:03:16.659561] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T21:03:16.756335] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-10T21:03:17.089373] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-10T21:03:17.889338] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-10T21:03:18.185113] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T21:03:18.412092] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T21:03:18.689345] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-10T21:03:19.489359] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-10T21:03:19.768278] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T21:03:20.069289] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-10T21:03:20.289386] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-10T21:03:21.089362] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-10T21:03:21.413865] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T21:03:21.527065] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T21:03:21.889381] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-10T21:03:22.689375] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-10T21:03:23.022786] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T21:03:23.489447] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-10T21:03:23.816066] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T21:03:24.289422] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-10T21:03:24.762243] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T21:03:24.804817] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-10T21:03:25.089381] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-10T21:03:25.380978] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-10T21:03:25.382739] [INFO ] [REMOTE ] PRLB: Full fetch complete (30060 records). [2025-10-10T21:03:25.382845] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-10T21:03:25.383406] [FATAL] [VALIDATOR ] PRLB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:03:25.383491] [FATAL] [MAIN ] PRLB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:03:25.383591] [WARN ] [MAIN ] PRLB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:03:25.383630] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-10T21:03:25.383730] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-10T21:03:25.383774] [INFO ] [LOCAL ] PRLB: Starting deletion of derivative data. [2025-10-10T21:03:25.383816] [DEBUG] [LOCAL ] PRLB: No derivative data file found to delete. [2025-10-10T21:03:25.383874] [INFO ] [MAIN ] Update Progress: 1729/2373 symbols completed. PRLB took 32.9s. Estimated remaining: 1h 30m 39s. Rate: 7.1 symbols/min [2025-10-10T21:03:25.587499] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:03:25.587902] [DEBUG] [LOCAL ] PRO: No existing data file found in primary storage. [2025-10-10T21:03:25.588022] [WARN ] [MAIN ] PRO: No existing data found, performing full refresh instead. [2025-10-10T21:03:25.588275] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-10T21:03:25.588384] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-10T21:03:25.588477] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-10T21:03:25.588536] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-10T21:03:25.889717] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-10T21:03:26.044636] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-10T21:03:26.050232] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:03:26.689400] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-10-10T21:03:27.489379] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-10T21:03:28.084088] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-10T21:03:28.196798] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-10T21:03:28.289388] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-10T21:03:28.796392] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T21:03:29.089374] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-10T21:03:29.889382] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-10T21:03:29.900295] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T21:03:29.904397] [INFO ] [REMOTE ] PRKS: Full fetch complete (61137 records). [2025-10-10T21:03:29.904511] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-10T21:03:29.905248] [FATAL] [VALIDATOR ] PRKS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:03:29.905336] [FATAL] [MAIN ] PRKS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:03:29.905379] [WARN ] [MAIN ] PRKS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:03:29.905449] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-10T21:03:29.905512] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-10T21:03:29.905548] [INFO ] [LOCAL ] PRKS: Starting deletion of derivative data. [2025-10-10T21:03:29.905587] [DEBUG] [LOCAL ] PRKS: No derivative data file found to delete. [2025-10-10T21:03:29.905711] [INFO ] [MAIN ] Update Progress: 1730/2373 symbols completed. PRKS took 39.7s. Estimated remaining: 1h 30m 29s. Rate: 7.1 symbols/min [2025-10-10T21:03:30.112346] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:03:30.112541] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-10T21:03:30.112603] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-10T21:03:30.112755] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-10T21:03:30.112797] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-10T21:03:30.112842] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-10T21:03:30.112902] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-10T21:03:30.485603] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:03:30.516773] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-10T21:03:30.689342] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-10-10T21:03:31.004700] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:03:31.005088] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-10-10T21:03:31.021070] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:03:31.021242] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-10-10T21:03:31.022328] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-10T21:03:31.022411] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:03:31.029036] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-10T21:03:31.029112] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-10T21:03:31.029148] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-10-10T21:03:31.029187] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-10-10T21:03:31.029232] [INFO ] [MAIN ] Update Progress: 1731/2373 symbols completed. PRSU took 1.1s. Estimated remaining: 1h 30m 17s. Rate: 7.1 symbols/min [2025-10-10T21:03:31.193784] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:03:31.193963] [DEBUG] [LOCAL ] PRT: No existing data file found in primary storage. [2025-10-10T21:03:31.194000] [WARN ] [MAIN ] PRT: No existing data found, performing full refresh instead. [2025-10-10T21:03:31.194116] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-10T21:03:31.194156] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-10T21:03:31.194196] [DEBUG] [LOCAL ] PRT: No primary data file found to delete. [2025-10-10T21:03:31.194227] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-10T21:03:31.494471] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-10T21:03:31.561217] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:03:32.289387] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-10T21:03:33.089403] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-10-10T21:03:33.627620] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-10T21:03:33.693563] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-10T21:03:33.889370] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-10T21:03:34.263830] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T21:03:34.689392] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-10T21:03:35.406603] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-10T21:03:35.489339] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-10T21:03:36.289385] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-10T21:03:37.008462] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-10T21:03:37.089346] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-10T21:03:37.316750] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-10T21:03:37.319721] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-10T21:03:37.889456] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-10T21:03:38.689396] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-10T21:03:39.230501] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-10T21:03:39.251347] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-10T21:03:39.255115] [INFO ] [REMOTE ] PRM: Full fetch complete (64125 records). [2025-10-10T21:03:39.255233] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-10T21:03:39.255982] [FATAL] [VALIDATOR ] PRM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:03:39.256076] [FATAL] [MAIN ] PRM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:03:39.256150] [WARN ] [MAIN ] PRM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:03:39.256241] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-10T21:03:39.256324] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-10T21:03:39.256362] [INFO ] [LOCAL ] PRM: Starting deletion of derivative data. [2025-10-10T21:03:39.256404] [DEBUG] [LOCAL ] PRM: No derivative data file found to delete. [2025-10-10T21:03:39.256462] [INFO ] [MAIN ] Update Progress: 1732/2373 symbols completed. PRM took 39.8s. Estimated remaining: 1h 30m 9s. Rate: 7.1 symbols/min [2025-10-10T21:03:39.429222] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:03:39.429425] [DEBUG] [LOCAL ] PRU: No existing data file found in primary storage. [2025-10-10T21:03:39.429486] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-10-10T21:03:39.429724] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-10T21:03:39.429828] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-10T21:03:39.429931] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-10T21:03:39.430016] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-10T21:03:39.494580] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-10T21:03:39.785412] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T21:03:39.824367] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:03:40.289440] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-10-10T21:03:41.089370] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-10T21:03:41.638205] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T21:03:41.728204] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-10T21:03:41.889338] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-10T21:03:42.089396] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-10T21:03:42.689457] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-10T21:03:43.489407] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-10T21:03:43.566536] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T21:03:44.061944] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-10T21:03:44.066366] [INFO ] [REMOTE ] PRMB: Full fetch complete (75670 records). [2025-10-10T21:03:44.066477] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-10T21:03:44.067184] [FATAL] [VALIDATOR ] PRMB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:03:44.067267] [FATAL] [MAIN ] PRMB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:03:44.067309] [WARN ] [MAIN ] PRMB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:03:44.067353] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-10T21:03:44.067446] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-10T21:03:44.067483] [INFO ] [LOCAL ] PRMB: Starting deletion of derivative data. [2025-10-10T21:03:44.067523] [DEBUG] [LOCAL ] PRMB: No derivative data file found to delete. [2025-10-10T21:03:44.067596] [INFO ] [MAIN ] Update Progress: 1733/2373 symbols completed. PRMB took 35.7s. Estimated remaining: 1h 29m 59s. Rate: 7.1 symbols/min [2025-10-10T21:03:44.239858] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:03:44.240133] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-10T21:03:44.240197] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-10T21:03:44.240428] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-10T21:03:44.240502] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-10T21:03:44.240579] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-10T21:03:44.240625] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-10T21:03:44.296835] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-10T21:03:44.566907] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-10T21:03:44.650592] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:03:45.089364] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-10T21:03:45.391702] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-10T21:03:45.889384] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-10T21:03:46.689451] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-10-10T21:03:46.791303] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-10T21:03:47.014298] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T21:03:47.265985] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-10T21:03:47.489407] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-10T21:03:48.289372] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-10T21:03:49.089473] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-10T21:03:49.712282] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-10T21:03:49.714828] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-10T21:03:49.889455] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-10T21:03:50.080797] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T21:03:50.434233] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-10T21:03:50.689376] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-10T21:03:51.489374] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-10T21:03:52.289444] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-10T21:03:52.476738] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T21:03:52.781174] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-10T21:03:53.089478] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-10T21:03:53.672320] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-10T21:03:53.889414] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-10T21:03:54.689350] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-10T21:03:54.712762] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-10T21:03:54.935916] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T21:03:55.173711] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-10T21:03:55.489381] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-10T21:03:56.289383] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-10T21:03:57.089419] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-10T21:03:57.131980] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-10T21:03:57.600859] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-10T21:03:57.619479] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-10T21:03:57.889344] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-10T21:03:58.689444] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-10T21:03:59.489338] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-10T21:03:59.824076] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T21:03:59.979859] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-10T21:04:00.289369] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-10T21:04:00.468357] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T21:04:01.089358] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-10T21:04:01.616119] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-10T21:04:01.889363] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-10T21:04:02.587981] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-10T21:04:02.689344] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-10T21:04:02.708258] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-10T21:04:03.489437] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-10T21:04:03.946104] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-10T21:04:04.246029] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T21:04:04.289337] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-10T21:04:05.089370] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-10T21:04:05.776291] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T21:04:05.777279] [INFO ] [REMOTE ] PRT: Full fetch complete (8852 records). [2025-10-10T21:04:05.777346] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-10T21:04:05.893819] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-10T21:04:06.140115] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-10-10T21:04:06.140208] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-10-10T21:04:06.140514] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-10-10T21:04:06.140595] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-10-10T21:04:06.141038] [DEBUG] [LOCAL ] PRT: Trimmed 8852 records to 5280 (keeping 200 days of data) [2025-10-10T21:04:06.172623] [DEBUG] [LOCAL ] PRT: Primary data saved (5280 records). [2025-10-10T21:04:06.172760] [INFO ] [MAIN ] PRT: Full history saved. [2025-10-10T21:04:06.172966] [INFO ] [MAIN ] Update Progress: 1734/2373 symbols completed. PRT took 35.1s. Estimated remaining: 1h 29m 56s. Rate: 7.1 symbols/min [2025-10-10T21:04:06.346594] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:04:06.346913] [DEBUG] [LOCAL ] PSA: No existing data file found in primary storage. [2025-10-10T21:04:06.347011] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-10-10T21:04:06.347297] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-10T21:04:06.347358] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-10T21:04:06.347403] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-10T21:04:06.347454] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-10T21:04:06.714964] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-10T21:04:06.699279] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-10T21:04:06.755061] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:04:06.912923] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T21:04:06.916896] [INFO ] [REMOTE ] PRO: Full fetch complete (52485 records). [2025-10-10T21:04:06.917008] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-10T21:04:06.917610] [FATAL] [VALIDATOR ] PRO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:04:06.917715] [FATAL] [MAIN ] PRO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:04:06.917794] [WARN ] [MAIN ] PRO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:04:06.917879] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-10T21:04:06.917956] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-10T21:04:06.918015] [INFO ] [LOCAL ] PRO: Starting deletion of derivative data. [2025-10-10T21:04:06.918101] [DEBUG] [LOCAL ] PRO: No derivative data file found to delete. [2025-10-10T21:04:06.918207] [INFO ] [MAIN ] Update Progress: 1735/2373 symbols completed. PRO took 41.5s. Estimated remaining: 1h 29m 45s. Rate: 7.1 symbols/min [2025-10-10T21:04:07.104172] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:04:07.104349] [DEBUG] [LOCAL ] PSBD: No existing data file found in primary storage. [2025-10-10T21:04:07.104386] [WARN ] [MAIN ] PSBD: No existing data found, performing full refresh instead. [2025-10-10T21:04:07.104497] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-10T21:04:07.104537] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-10T21:04:07.104576] [DEBUG] [LOCAL ] PSBD: No primary data file found to delete. [2025-10-10T21:04:07.104607] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-10T21:04:07.193949] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-10T21:04:07.463454] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:04:07.489325] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-10-10T21:04:08.289361] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-10T21:04:08.404370] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-10T21:04:09.064587] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T21:04:09.068760] [INFO ] [REMOTE ] PRU: Full fetch complete (73776 records). [2025-10-10T21:04:09.068860] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-10T21:04:09.069694] [FATAL] [VALIDATOR ] PRU: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:04:09.069787] [FATAL] [MAIN ] PRU: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:04:09.069837] [WARN ] [MAIN ] PRU: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:04:09.069916] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-10T21:04:09.069996] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-10T21:04:09.070044] [INFO ] [LOCAL ] PRU: Starting deletion of derivative data. [2025-10-10T21:04:09.070100] [DEBUG] [LOCAL ] PRU: No derivative data file found to delete. [2025-10-10T21:04:09.070215] [INFO ] [MAIN ] Update Progress: 1736/2373 symbols completed. PRU took 29.8s. Estimated remaining: 1h 29m 34s. Rate: 7.1 symbols/min [2025-10-10T21:04:09.099029] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-10T21:04:09.241170] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:04:09.241368] [DEBUG] [LOCAL ] PSF: No existing data file found in primary storage. [2025-10-10T21:04:09.241405] [WARN ] [MAIN ] PSF: No existing data found, performing full refresh instead. [2025-10-10T21:04:09.241517] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-10T21:04:09.241558] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-10T21:04:09.241603] [DEBUG] [LOCAL ] PSF: No primary data file found to delete. [2025-10-10T21:04:09.241689] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-10T21:04:09.600929] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:04:09.889391] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-10-10T21:04:10.151879] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-10T21:04:10.689402] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-10T21:04:10.935832] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-10T21:04:11.209876] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-10T21:04:11.489403] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-10T21:04:12.236195] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-10T21:04:12.289369] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-10T21:04:13.089364] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-10T21:04:13.146151] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-10T21:04:13.594853] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-10T21:04:13.889369] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-10-10T21:04:14.689407] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-10T21:04:15.489414] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-10T21:04:15.669747] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-10T21:04:15.745775] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T21:04:16.289362] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-10T21:04:16.399767] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-10T21:04:17.089380] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-10T21:04:17.243861] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-10T21:04:17.889416] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-10T21:04:18.673157] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-10T21:04:18.689328] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-10T21:04:18.870662] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T21:04:19.489383] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-10T21:04:19.883662] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-10T21:04:19.884369] [INFO ] [REMOTE ] PRVS: Full fetch complete (1251 records). [2025-10-10T21:04:19.884439] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-10T21:04:19.884861] [FATAL] [VALIDATOR ] PRVS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:04:19.884941] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:04:19.885004] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:04:19.885074] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-10T21:04:19.885186] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-10T21:04:19.885242] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-10T21:04:19.885285] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-10T21:04:19.885353] [INFO ] [MAIN ] Update Progress: 1737/2373 symbols completed. PRVS took 35.8s. Estimated remaining: 1h 29m 26s. Rate: 7.1 symbols/min [2025-10-10T21:04:20.052578] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:04:20.052806] [DEBUG] [LOCAL ] PSFE: No existing data file found in primary storage. [2025-10-10T21:04:20.052849] [WARN ] [MAIN ] PSFE: No existing data found, performing full refresh instead. [2025-10-10T21:04:20.052962] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-10T21:04:20.053003] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-10T21:04:20.053043] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-10T21:04:20.053074] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-10T21:04:20.297495] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-10T21:04:20.416603] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:04:20.509089] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T21:04:20.893440] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-10T21:04:21.089373] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-10T21:04:21.889418] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-10T21:04:22.056328] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-10T21:04:22.512424] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-10T21:04:22.689372] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-10T21:04:23.489352] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-10T21:04:23.632388] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-10T21:04:24.289429] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-10T21:04:24.459788] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-10T21:04:24.950257] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-10T21:04:25.089395] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-10T21:04:25.889379] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-10-10T21:04:26.060963] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-10T21:04:26.689373] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-10T21:04:27.172357] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T21:04:27.489374] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-10T21:04:27.611532] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T21:04:27.613724] [INFO ] [REMOTE ] PSBD: Full fetch complete (10089 records). [2025-10-10T21:04:27.613804] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-10T21:04:28.019316] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-10T21:04:28.019395] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-10T21:04:28.019695] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-10T21:04:28.019797] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-10T21:04:28.020441] [DEBUG] [LOCAL ] PSBD: Trimmed 10089 records to 7654 (keeping 200 days of data) [2025-10-10T21:04:28.069723] [DEBUG] [LOCAL ] PSBD: Primary data saved (7654 records). [2025-10-10T21:04:28.069869] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-10T21:04:28.069946] [INFO ] [MAIN ] Update Progress: 1738/2373 symbols completed. PSBD took 21.2s. Estimated remaining: 1h 29m 18s. Rate: 7.1 symbols/min [2025-10-10T21:04:28.244960] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:04:28.245152] [DEBUG] [LOCAL ] PSN: No existing data file found in primary storage. [2025-10-10T21:04:28.245196] [WARN ] [MAIN ] PSN: No existing data found, performing full refresh instead. [2025-10-10T21:04:28.245310] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-10T21:04:28.245353] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-10T21:04:28.245397] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-10T21:04:28.245430] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-10T21:04:28.301364] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-10T21:04:28.431606] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-10T21:04:28.616193] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:04:29.089365] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-10T21:04:29.672182] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T21:04:29.889371] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-10T21:04:30.488710] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-10T21:04:30.689374] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-10T21:04:31.099410] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-10T21:04:31.489385] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-10T21:04:32.289433] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-10T21:04:32.909337] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-10T21:04:33.043977] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-10T21:04:33.089356] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-10T21:04:33.253366] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-10T21:04:33.889473] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-10T21:04:34.689398] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-10-10T21:04:34.741970] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-10T21:04:34.884558] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-10T21:04:35.489383] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-10T21:04:36.289364] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-10T21:04:36.469216] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-10T21:04:37.062525] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T21:04:37.063633] [INFO ] [REMOTE ] PSF: Full fetch complete (9764 records). [2025-10-10T21:04:37.063749] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-10T21:04:37.094624] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-10T21:04:37.454311] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-10T21:04:37.454413] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-10T21:04:37.454874] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-10T21:04:37.454951] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-10T21:04:37.455590] [DEBUG] [LOCAL ] PSF: Trimmed 9764 records to 7034 (keeping 200 days of data) [2025-10-10T21:04:37.515374] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-10T21:04:37.536501] [DEBUG] [LOCAL ] PSF: Primary data saved (7034 records). [2025-10-10T21:04:37.536795] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-10T21:04:37.536905] [INFO ] [MAIN ] Update Progress: 1739/2373 symbols completed. PSF took 28.5s. Estimated remaining: 1h 29m 10s. Rate: 7.1 symbols/min [2025-10-10T21:04:37.702173] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:04:37.702383] [DEBUG] [LOCAL ] PSO: No existing data file found in primary storage. [2025-10-10T21:04:37.702423] [WARN ] [MAIN ] PSO: No existing data found, performing full refresh instead. [2025-10-10T21:04:37.702542] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-10T21:04:37.702585] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-10T21:04:37.702627] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-10T21:04:37.702711] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-10T21:04:37.895346] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-10T21:04:38.054251] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:04:38.689414] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-10-10T21:04:38.782179] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T21:04:39.489376] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-10T21:04:39.842007] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T21:04:39.882282] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T21:04:40.289387] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-10T21:04:40.883167] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T21:04:41.089368] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-10T21:04:41.889397] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-10T21:04:42.022285] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T21:04:42.689378] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-10T21:04:43.140701] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-10T21:04:43.489342] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-10T21:04:43.831210] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-10T21:04:43.923084] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-10T21:04:44.289335] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-10T21:04:45.089357] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-10T21:04:45.274078] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T21:04:45.889400] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-10T21:04:46.108135] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T21:04:46.255849] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T21:04:46.689374] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-10T21:04:47.489354] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-10T21:04:47.830845] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T21:04:48.277052] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-10T21:04:48.289337] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-10T21:04:49.089345] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-10T21:04:49.518042] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T21:04:49.858938] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T21:04:49.862246] [INFO ] [REMOTE ] PSA: Full fetch complete (58888 records). [2025-10-10T21:04:49.862333] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-10T21:04:49.863001] [FATAL] [VALIDATOR ] PSA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:04:49.863089] [FATAL] [MAIN ] PSA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:04:49.863133] [WARN ] [MAIN ] PSA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:04:49.863172] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-10T21:04:49.863227] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-10T21:04:49.863263] [INFO ] [LOCAL ] PSA: Starting deletion of derivative data. [2025-10-10T21:04:49.863303] [DEBUG] [LOCAL ] PSA: No derivative data file found to delete. [2025-10-10T21:04:49.863359] [INFO ] [MAIN ] Update Progress: 1740/2373 symbols completed. PSA took 43.7s. Estimated remaining: 1h 29m 3s. Rate: 7.1 symbols/min [2025-10-10T21:04:49.894512] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-10T21:04:50.033760] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:04:50.034119] [DEBUG] [LOCAL ] PSQH: No existing data file found in primary storage. [2025-10-10T21:04:50.034174] [WARN ] [MAIN ] PSQH: No existing data found, performing full refresh instead. [2025-10-10T21:04:50.042555] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-10T21:04:50.054537] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-10T21:04:50.054968] [DEBUG] [LOCAL ] PSQH: No primary data file found to delete. [2025-10-10T21:04:50.055524] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-10T21:04:50.056252] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T21:04:50.410908] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:04:50.689396] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-10T21:04:51.489423] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-10T21:04:51.821183] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-10T21:04:52.289369] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-10T21:04:52.491002] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-10T21:04:52.785048] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T21:04:53.089454] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-10T21:04:53.889441] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-10-10T21:04:54.153532] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T21:04:54.490255] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-10T21:04:54.689419] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-10T21:04:55.479855] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-10T21:04:55.483957] [INFO ] [REMOTE ] PSFE: Full fetch complete (42839 records). [2025-10-10T21:04:55.484075] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-10T21:04:55.484900] [FATAL] [VALIDATOR ] PSFE: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:04:55.484984] [FATAL] [MAIN ] PSFE: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:04:55.485065] [WARN ] [MAIN ] PSFE: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:04:55.485159] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-10T21:04:55.485260] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-10T21:04:55.485314] [INFO ] [LOCAL ] PSFE: Starting deletion of derivative data. [2025-10-10T21:04:55.485360] [DEBUG] [LOCAL ] PSFE: No derivative data file found to delete. [2025-10-10T21:04:55.485422] [INFO ] [MAIN ] Update Progress: 1741/2373 symbols completed. PSFE took 35.6s. Estimated remaining: 1h 28m 53s. Rate: 7.1 symbols/min [2025-10-10T21:04:55.497047] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-10T21:04:55.665333] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:04:55.665576] [DEBUG] [LOCAL ] PSTG: No existing data file found in primary storage. [2025-10-10T21:04:55.665615] [WARN ] [MAIN ] PSTG: No existing data found, performing full refresh instead. [2025-10-10T21:04:55.665764] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-10T21:04:55.665807] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-10T21:04:55.665850] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-10T21:04:55.665883] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-10T21:04:56.055303] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:04:56.203271] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-10T21:04:56.289412] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-10-10T21:04:57.089375] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-10T21:04:57.639503] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-10T21:04:57.889442] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-10T21:04:58.629122] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-10T21:04:58.689346] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-10T21:04:58.934785] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T21:04:59.489374] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-10T21:04:59.890634] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-10T21:05:00.289399] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-10T21:05:00.726296] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T21:05:01.089356] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-10T21:05:01.325683] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-10T21:05:01.889375] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-10T21:05:02.272952] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-10T21:05:02.689354] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-10T21:05:03.333278] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-10T21:05:03.489371] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-10T21:05:03.753888] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T21:05:03.969418] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T21:05:04.289441] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-10-10T21:05:05.089362] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-10T21:05:05.658090] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-10T21:05:05.889351] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-10T21:05:05.914965] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T21:05:06.689351] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-10. [2025-10-10T21:05:06.980715] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T21:05:07.489347] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-10T21:05:07.570918] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T21:05:07.574006] [INFO ] [REMOTE ] PSO: Full fetch complete (51824 records). [2025-10-10T21:05:07.574091] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-10T21:05:07.574704] [FATAL] [VALIDATOR ] PSO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:05:07.574809] [FATAL] [MAIN ] PSO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:05:07.574883] [WARN ] [MAIN ] PSO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:05:07.574975] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-10T21:05:07.575053] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-10T21:05:07.575089] [INFO ] [LOCAL ] PSO: Starting deletion of derivative data. [2025-10-10T21:05:07.575128] [DEBUG] [LOCAL ] PSO: No derivative data file found to delete. [2025-10-10T21:05:07.575183] [INFO ] [MAIN ] Update Progress: 1742/2373 symbols completed. PSO took 30.0s. Estimated remaining: 1h 28m 46s. Rate: 7.1 symbols/min [2025-10-10T21:05:07.750361] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:05:07.750600] [DEBUG] [LOCAL ] PSTL: No existing data file found in primary storage. [2025-10-10T21:05:07.750771] [WARN ] [MAIN ] PSTL: No existing data found, performing full refresh instead. [2025-10-10T21:05:07.751137] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-10T21:05:07.751208] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-10T21:05:07.751338] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-10T21:05:07.751434] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-10T21:05:08.132415] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-10T21:05:08.175623] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:05:08.289332] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-10-10T21:05:09.089365] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-10T21:05:09.264487] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T21:05:09.604894] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T21:05:09.889396] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-10T21:05:10.689406] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-10T21:05:11.314811] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-10T21:05:11.489442] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-10T21:05:11.731058] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T21:05:12.172278] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-10T21:05:12.289365] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-10T21:05:13.089448] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-10T21:05:13.368722] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T21:05:13.889377] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-10T21:05:14.032201] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T21:05:14.452916] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T21:05:14.689446] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-10T21:05:15.489359] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-10T21:05:15.736955] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-10T21:05:16.289344] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-10T21:05:16.731762] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-10T21:05:17.041103] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T21:05:17.089339] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-10T21:05:17.889384] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-10T21:05:18.040688] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T21:05:18.689427] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-10T21:05:18.758760] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T21:05:18.776576] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-10T21:05:19.489364] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-10T21:05:20.289429] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-10T21:05:21.045570] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T21:05:21.076251] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-10T21:05:21.089394] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-10T21:05:21.196236] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-10T21:05:21.889406] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-10T21:05:21.939407] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T21:05:21.944803] [INFO ] [REMOTE ] PSTG: Full fetch complete (76160 records). [2025-10-10T21:05:21.945047] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-10T21:05:21.945950] [FATAL] [VALIDATOR ] PSTG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:05:21.946052] [FATAL] [MAIN ] PSTG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:05:21.946130] [WARN ] [MAIN ] PSTG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:05:21.946211] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-10T21:05:21.946289] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-10T21:05:21.946328] [INFO ] [LOCAL ] PSTG: Starting deletion of derivative data. [2025-10-10T21:05:21.946371] [DEBUG] [LOCAL ] PSTG: No derivative data file found to delete. [2025-10-10T21:05:21.946442] [INFO ] [MAIN ] Update Progress: 1743/2373 symbols completed. PSTG took 26.5s. Estimated remaining: 1h 28m 40s. Rate: 7.1 symbols/min [2025-10-10T21:05:22.123127] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:05:22.123364] [DEBUG] [LOCAL ] PSX: No existing data file found in primary storage. [2025-10-10T21:05:22.123402] [WARN ] [MAIN ] PSX: No existing data found, performing full refresh instead. [2025-10-10T21:05:22.123527] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-10T21:05:22.123633] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-10T21:05:22.123726] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-10T21:05:22.123764] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-10T21:05:22.504115] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:05:22.689354] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-10T21:05:22.789968] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T21:05:22.794333] [INFO ] [REMOTE ] PSN: Full fetch complete (66651 records). [2025-10-10T21:05:22.794531] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-10T21:05:22.795764] [FATAL] [VALIDATOR ] PSN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:05:22.795870] [FATAL] [MAIN ] PSN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:05:22.795966] [WARN ] [MAIN ] PSN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:05:22.796060] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-10T21:05:22.796147] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-10T21:05:22.796188] [INFO ] [LOCAL ] PSN: Starting deletion of derivative data. [2025-10-10T21:05:22.796230] [DEBUG] [LOCAL ] PSN: No derivative data file found to delete. [2025-10-10T21:05:22.796303] [INFO ] [MAIN ] Update Progress: 1744/2373 symbols completed. PSN took 54.7s. Estimated remaining: 1h 28m 29s. Rate: 7.1 symbols/min [2025-10-10T21:05:22.977729] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:05:22.978017] [DEBUG] [LOCAL ] PTA: No existing data file found in primary storage. [2025-10-10T21:05:22.978058] [WARN ] [MAIN ] PTA: No existing data found, performing full refresh instead. [2025-10-10T21:05:22.978190] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-10T21:05:22.978234] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-10T21:05:22.978277] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-10T21:05:22.978312] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-10T21:05:23.350802] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:05:23.489431] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-10-10T21:05:24.289359] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-10-10T21:05:24.719638] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T21:05:25.089373] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-10T21:05:25.327872] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-10T21:05:25.649208] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-10T21:05:25.889375] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-10T21:05:26.689379] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-10T21:05:26.978787] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-10T21:05:26.984041] [INFO ] [REMOTE ] PSQH: Full fetch complete (53479 records). [2025-10-10T21:05:26.984211] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-10T21:05:27.314523] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-10T21:05:27.396345] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-10T21:05:27.396439] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-10T21:05:27.397312] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-10T21:05:27.397425] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-10T21:05:27.398625] [DEBUG] [LOCAL ] PSQH: Trimmed 53479 records to 35671 (keeping 200 days of data) [2025-10-10T21:05:27.490216] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-10T21:05:27.603191] [DEBUG] [LOCAL ] PSQH: Primary data saved (35671 records). [2025-10-10T21:05:27.603340] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-10T21:05:27.603417] [INFO ] [MAIN ] Update Progress: 1745/2373 symbols completed. PSQH took 37.7s. Estimated remaining: 1h 28m 19s. Rate: 7.1 symbols/min [2025-10-10T21:05:27.773258] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:05:27.773489] [DEBUG] [LOCAL ] PTY: No existing data file found in primary storage. [2025-10-10T21:05:27.773531] [WARN ] [MAIN ] PTY: No existing data found, performing full refresh instead. [2025-10-10T21:05:27.773602] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-10T21:05:27.773638] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-10T21:05:27.773727] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-10T21:05:27.773763] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-10T21:05:28.143860] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:05:28.145082] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-10T21:05:28.289336] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-10-10T21:05:28.547391] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-10T21:05:29.089423] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-10T21:05:29.889490] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-10T21:05:30.169084] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T21:05:30.411217] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T21:05:30.587922] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-10T21:05:30.689370] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-10T21:05:31.489377] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-10T21:05:31.942902] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-10T21:05:32.289449] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-10T21:05:32.776216] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-10T21:05:33.089376] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-10T21:05:33.889348] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-10T21:05:34.096057] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T21:05:34.272793] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-10T21:05:34.689354] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-10T21:05:35.214121] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T21:05:35.489386] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-10T21:05:36.289434] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-10T21:05:36.905175] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-10T21:05:37.059813] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-10T21:05:37.089373] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-10T21:05:37.268373] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T21:05:37.889413] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-10T21:05:38.364569] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T21:05:38.689392] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-10T21:05:39.114036] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T21:05:39.489415] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-10T21:05:39.675949] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T21:05:39.678222] [INFO ] [REMOTE ] PSTL: Full fetch complete (29416 records). [2025-10-10T21:05:39.678300] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-10T21:05:39.678777] [FATAL] [VALIDATOR ] PSTL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:05:39.678861] [FATAL] [MAIN ] PSTL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:05:39.678905] [WARN ] [MAIN ] PSTL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:05:39.678943] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-10T21:05:39.678998] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-10T21:05:39.679035] [INFO ] [LOCAL ] PSTL: Starting deletion of derivative data. [2025-10-10T21:05:39.679075] [DEBUG] [LOCAL ] PSTL: No derivative data file found to delete. [2025-10-10T21:05:39.679128] [INFO ] [MAIN ] Update Progress: 1746/2373 symbols completed. PSTL took 32.1s. Estimated remaining: 1h 28m 12s. Rate: 7.1 symbols/min [2025-10-10T21:05:39.848812] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:05:39.849015] [DEBUG] [LOCAL ] PUK: No existing data file found in primary storage. [2025-10-10T21:05:39.849074] [WARN ] [MAIN ] PUK: No existing data found, performing full refresh instead. [2025-10-10T21:05:39.849185] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-10T21:05:39.849225] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-10T21:05:39.849266] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-10T21:05:39.849299] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-10T21:05:40.240021] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:05:40.289371] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-10-10T21:05:41.089421] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-10T21:05:41.258872] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-10T21:05:41.889410] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-10T21:05:42.155058] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T21:05:42.689358] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-10T21:05:43.052180] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T21:05:43.224969] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-10T21:05:43.489367] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-10T21:05:44.289387] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-10T21:05:44.704233] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-10T21:05:45.089342] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-10T21:05:45.723563] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-10T21:05:45.889369] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-10T21:05:46.189875] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T21:05:46.285039] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T21:05:46.689377] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-10T21:05:47.459878] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T21:05:47.489334] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-10T21:05:47.795433] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-10T21:05:48.289408] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-10T21:05:49.089400] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-10T21:05:49.575663] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T21:05:49.889382] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-10T21:05:50.365327] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T21:05:50.513234] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-10T21:05:50.689391] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-10T21:05:51.271158] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T21:05:51.489369] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-10T21:05:52.289385] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-10T21:05:52.980757] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-10T21:05:53.089434] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-10T21:05:53.243675] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-10T21:05:53.859476] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-10T21:05:53.889348] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-10T21:05:54.689374] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-10T21:05:55.209409] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-10T21:05:55.400354] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T21:05:55.402942] [INFO ] [REMOTE ] PTA: Full fetch complete (22717 records). [2025-10-10T21:05:55.403157] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-10T21:05:55.403699] [FATAL] [VALIDATOR ] PTA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:05:55.403787] [FATAL] [MAIN ] PTA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:05:55.403832] [WARN ] [MAIN ] PTA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:05:55.403905] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-10T21:05:55.403970] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-10T21:05:55.404008] [INFO ] [LOCAL ] PTA: Starting deletion of derivative data. [2025-10-10T21:05:55.404051] [DEBUG] [LOCAL ] PTA: No derivative data file found to delete. [2025-10-10T21:05:55.404108] [INFO ] [MAIN ] Update Progress: 1747/2373 symbols completed. PTA took 32.6s. Estimated remaining: 1h 28m 6s. Rate: 7.1 symbols/min [2025-10-10T21:05:55.494467] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-10T21:05:55.580258] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:05:55.580401] [DEBUG] [LOCAL ] PUMP: No existing data file found in primary storage. [2025-10-10T21:05:55.580439] [WARN ] [MAIN ] PUMP: No existing data found, performing full refresh instead. [2025-10-10T21:05:55.580553] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-10T21:05:55.580595] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-10T21:05:55.580636] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-10T21:05:55.580751] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-10T21:05:55.869996] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T21:05:55.994706] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:05:56.289383] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-10-10T21:05:57.089401] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-10T21:05:57.328266] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-10T21:05:57.889407] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-10T21:05:57.960635] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-10T21:05:58.689387] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-10T21:05:58.939665] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-10T21:05:59.489486] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-10T21:05:59.663022] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T21:06:00.129965] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-10T21:06:00.289371] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-10T21:06:00.998205] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T21:06:01.089429] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-10T21:06:01.764403] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-10T21:06:01.889367] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-10T21:06:02.689371] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-10T21:06:02.874297] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T21:06:03.418058] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T21:06:03.423174] [INFO ] [REMOTE ] PTY: Full fetch complete (53595 records). [2025-10-10T21:06:03.423281] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-10T21:06:03.424005] [FATAL] [VALIDATOR ] PTY: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:06:03.424103] [FATAL] [MAIN ] PTY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:06:03.424156] [WARN ] [MAIN ] PTY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:06:03.424233] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-10T21:06:03.424319] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-10T21:06:03.424385] [INFO ] [LOCAL ] PTY: Starting deletion of derivative data. [2025-10-10T21:06:03.424441] [DEBUG] [LOCAL ] PTY: No derivative data file found to delete. [2025-10-10T21:06:03.424506] [INFO ] [MAIN ] Update Progress: 1748/2373 symbols completed. PTY took 35.8s. Estimated remaining: 1h 27m 57s. Rate: 7.1 symbols/min [2025-10-10T21:06:03.494461] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-10T21:06:03.596113] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:06:03.596252] [DEBUG] [LOCAL ] PVH: No existing data file found in primary storage. [2025-10-10T21:06:03.596289] [WARN ] [MAIN ] PVH: No existing data found, performing full refresh instead. [2025-10-10T21:06:03.596395] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-10T21:06:03.596436] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-10T21:06:03.596476] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-10T21:06:03.596508] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-10T21:06:03.904161] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-10T21:06:03.985009] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:06:04.289370] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-10T21:06:05.089380] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-10T21:06:05.738388] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-10T21:06:05.889360] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-10-10T21:06:06.300631] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-10T21:06:06.689452] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-10T21:06:06.988866] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T21:06:07.360407] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-10T21:06:07.489400] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-10T21:06:07.833186] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T21:06:07.838356] [INFO ] [REMOTE ] PSX: Full fetch complete (76632 records). [2025-10-10T21:06:07.838564] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-10T21:06:07.839354] [FATAL] [VALIDATOR ] PSX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:06:07.839445] [FATAL] [MAIN ] PSX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:06:07.839488] [WARN ] [MAIN ] PSX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:06:07.839528] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-10T21:06:07.839585] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-10T21:06:07.839621] [INFO ] [LOCAL ] PSX: Starting deletion of derivative data. [2025-10-10T21:06:07.839701] [DEBUG] [LOCAL ] PSX: No derivative data file found to delete. [2025-10-10T21:06:07.839778] [INFO ] [MAIN ] Update Progress: 1749/2373 symbols completed. PSX took 45.9s. Estimated remaining: 1h 27m 47s. Rate: 7.1 symbols/min [2025-10-10T21:06:08.008519] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:06:08.008752] [DEBUG] [LOCAL ] PVL: No existing data file found in primary storage. [2025-10-10T21:06:08.008801] [WARN ] [MAIN ] PVL: No existing data found, performing full refresh instead. [2025-10-10T21:06:08.008916] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-10T21:06:08.008957] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-10T21:06:08.008999] [DEBUG] [LOCAL ] PVL: No primary data file found to delete. [2025-10-10T21:06:08.009032] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-10T21:06:08.294621] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-10T21:06:08.366577] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:06:09.089357] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-10T21:06:09.370049] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-10T21:06:09.889384] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-10T21:06:10.232874] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T21:06:10.698620] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-10-10T21:06:10.723433] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T21:06:11.412524] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-10T21:06:11.489372] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-10T21:06:11.871379] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-10T21:06:12.289353] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-10T21:06:12.399047] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T21:06:12.403954] [INFO ] [REMOTE ] PUK: Full fetch complete (64792 records). [2025-10-10T21:06:12.404118] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-10T21:06:12.404968] [FATAL] [VALIDATOR ] PUK: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:06:12.405082] [FATAL] [MAIN ] PUK: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:06:12.405139] [WARN ] [MAIN ] PUK: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:06:12.405222] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-10T21:06:12.405309] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-10T21:06:12.405347] [INFO ] [LOCAL ] PUK: Starting deletion of derivative data. [2025-10-10T21:06:12.405388] [DEBUG] [LOCAL ] PUK: No derivative data file found to delete. [2025-10-10T21:06:12.405464] [INFO ] [MAIN ] Update Progress: 1750/2373 symbols completed. PUK took 32.7s. Estimated remaining: 1h 27m 38s. Rate: 7.1 symbols/min [2025-10-10T21:06:12.587566] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:06:12.587810] [DEBUG] [LOCAL ] PWR: No existing data file found in primary storage. [2025-10-10T21:06:12.587866] [WARN ] [MAIN ] PWR: No existing data found, performing full refresh instead. [2025-10-10T21:06:12.588014] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-10T21:06:12.588071] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-10T21:06:12.588118] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-10T21:06:12.588152] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-10T21:06:12.935520] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:06:13.089401] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-10T21:06:13.889444] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-10-10T21:06:14.689442] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-10T21:06:14.851314] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-10T21:06:15.258635] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-10T21:06:15.310583] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-10T21:06:15.489401] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-10T21:06:15.903785] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T21:06:16.289401] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-10T21:06:17.089365] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-10T21:06:17.889390] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-10T21:06:19.361956] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-10T21:06:19.363661] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-10T21:06:19.994309] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (3.70 seconds). [2025-10-10T21:06:20.006443] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-10T21:06:20.174943] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-10T21:06:20.289403] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-10T21:06:20.690994] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (2.80 seconds). [2025-10-10T21:06:20.865219] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (5.38 seconds). [2025-10-10T21:06:21.089395] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-10T21:06:21.110580] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-10T21:06:21.889412] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-10T21:06:22.421225] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-10T21:06:22.689418] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-10T21:06:22.733763] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T21:06:23.489397] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-10T21:06:23.992384] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T21:06:24.289410] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-10T21:06:24.340404] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T21:06:25.089358] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-10T21:06:25.804128] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-10T21:06:25.889380] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-10T21:06:26.331868] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-10T21:06:26.689411] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-10T21:06:26.790947] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-10T21:06:27.137073] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-10T21:06:27.489418] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-10T21:06:28.289424] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-10T21:06:28.385356] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T21:06:28.893237] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-10T21:06:29.089391] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-10T21:06:29.889446] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-10T21:06:30.390080] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-10T21:06:30.453525] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-10T21:06:30.689373] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-10T21:06:31.145185] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-10T21:06:31.258062] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-10T21:06:31.262383] [INFO ] [REMOTE ] PUMP: Full fetch complete (71265 records). [2025-10-10T21:06:31.262538] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-10T21:06:31.263419] [FATAL] [VALIDATOR ] PUMP: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:06:31.263518] [FATAL] [MAIN ] PUMP: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:06:31.263563] [WARN ] [MAIN ] PUMP: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:06:31.263605] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-10T21:06:31.263696] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-10T21:06:31.263755] [INFO ] [LOCAL ] PUMP: Starting deletion of derivative data. [2025-10-10T21:06:31.263804] [DEBUG] [LOCAL ] PUMP: No derivative data file found to delete. [2025-10-10T21:06:31.263869] [INFO ] [MAIN ] Update Progress: 1751/2373 symbols completed. PUMP took 35.9s. Estimated remaining: 1h 27m 33s. Rate: 7.1 symbols/min [2025-10-10T21:06:31.437608] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:06:31.437829] [DEBUG] [LOCAL ] PX: No existing data file found in primary storage. [2025-10-10T21:06:31.437874] [WARN ] [MAIN ] PX: No existing data found, performing full refresh instead. [2025-10-10T21:06:31.437987] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-10T21:06:31.438029] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-10T21:06:31.438071] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-10T21:06:31.438106] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-10T21:06:31.498750] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-10T21:06:31.806904] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:06:32.289411] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-10-10T21:06:32.369035] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-10T21:06:33.089390] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-10T21:06:33.889365] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-10T21:06:33.994256] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-10T21:06:34.017160] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T21:06:34.689368] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-10T21:06:35.489338] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-10T21:06:35.506573] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T21:06:35.507620] [INFO ] [REMOTE ] PVL: Full fetch complete (7238 records). [2025-10-10T21:06:35.507726] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-10T21:06:35.863610] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-10T21:06:35.863902] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-10T21:06:35.864193] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-10T21:06:35.864316] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-10T21:06:35.864911] [DEBUG] [LOCAL ] PVL: Trimmed 7238 records to 4749 (keeping 200 days of data) [2025-10-10T21:06:35.893570] [DEBUG] [LOCAL ] PVL: Primary data saved (4749 records). [2025-10-10T21:06:35.893713] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-10T21:06:35.893796] [INFO ] [MAIN ] Update Progress: 1752/2373 symbols completed. PVL took 28.1s. Estimated remaining: 1h 27m 23s. Rate: 7.1 symbols/min [2025-10-10T21:06:36.076842] [INFO ] [MAIN ] PXED: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:06:36.090332] [DEBUG] [LOCAL ] PXED: No existing data file found in primary storage. [2025-10-10T21:06:36.093149] [WARN ] [MAIN ] PXED: No existing data found, performing full refresh instead. [2025-10-10T21:06:36.093515] [INFO ] [MAIN ] PXED: Wiping existing primary data before full refresh. [2025-10-10T21:06:36.093588] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-10T21:06:36.094082] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-10T21:06:36.095183] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-10T21:06:36.095348] [INFO ] [MAIN ] PXED: Starting full primary refresh. [2025-10-10T21:06:36.294609] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-10T21:06:36.460331] [INFO ] [REMOTE ] PXED: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:06:37.089379] [INFO ] [REMOTE ] PXED: Fetching primary data for 2024-12. [2025-10-10T21:06:37.456097] [DEBUG] [REMOTE ] PXED: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:06:37.456411] [WARN ] [REMOTE ] PXED: No data returned for month 2024-12 [2025-10-10T21:06:37.456501] [FATAL] [REMOTE ] PXED: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:06:37.456548] [FATAL] [MAIN ] PXED: Failed to fetch primary data. [2025-10-10T21:06:37.456581] [WARN ] [MAIN ] PXED: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:06:37.456665] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-10T21:06:37.456742] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-10T21:06:37.456779] [INFO ] [LOCAL ] PXED: Starting deletion of derivative data. [2025-10-10T21:06:37.456843] [DEBUG] [LOCAL ] PXED: No derivative data file found to delete. [2025-10-10T21:06:37.456912] [INFO ] [MAIN ] Update Progress: 1753/2373 symbols completed. PXED took 1.6s. Estimated remaining: 1h 27m 12s. Rate: 7.1 symbols/min [2025-10-10T21:06:37.631239] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:06:37.631449] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-10T21:06:37.631509] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-10T21:06:37.631668] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-10T21:06:37.631782] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-10T21:06:37.631927] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-10T21:06:37.632108] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-10T21:06:37.748704] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-10T21:06:37.894467] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-10T21:06:38.003479] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T21:06:38.082801] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:06:38.689376] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-10T21:06:39.489409] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-10-10T21:06:40.000274] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-10T21:06:40.289390] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-10T21:06:40.418019] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T21:06:41.089398] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-10T21:06:41.889451] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-10T21:06:42.007758] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T21:06:42.011594] [INFO ] [REMOTE ] PVH: Full fetch complete (70511 records). [2025-10-10T21:06:42.011715] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-10T21:06:42.012312] [FATAL] [VALIDATOR ] PVH: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:06:42.012402] [FATAL] [MAIN ] PVH: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:06:42.012445] [WARN ] [MAIN ] PVH: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:06:42.012483] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-10T21:06:42.012537] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-10T21:06:42.012572] [INFO ] [LOCAL ] PVH: Starting deletion of derivative data. [2025-10-10T21:06:42.012610] [DEBUG] [LOCAL ] PVH: No derivative data file found to delete. [2025-10-10T21:06:42.012773] [INFO ] [MAIN ] Update Progress: 1754/2373 symbols completed. PVH took 38.6s. Estimated remaining: 1h 27m 2s. Rate: 7.1 symbols/min [2025-10-10T21:06:42.187032] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:06:42.187263] [DEBUG] [LOCAL ] QD: No existing data file found in primary storage. [2025-10-10T21:06:42.187316] [WARN ] [MAIN ] QD: No existing data found, performing full refresh instead. [2025-10-10T21:06:42.187434] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-10T21:06:42.187476] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-10T21:06:42.187518] [DEBUG] [LOCAL ] QD: No primary data file found to delete. [2025-10-10T21:06:42.187550] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-10T21:06:42.544180] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:06:42.572424] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-10T21:06:42.614454] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (3.13 seconds). [2025-10-10T21:06:42.689334] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-10T21:06:43.213358] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T21:06:43.489385] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-10T21:06:44.289353] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-10-10T21:06:44.772431] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T21:06:45.089410] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-10T21:06:45.894451] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-10T21:06:45.906097] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T21:06:46.434301] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-10T21:06:46.580301] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (3.09 seconds). [2025-10-10T21:06:46.689342] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-10T21:06:47.489368] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-10T21:06:47.908327] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T21:06:48.047054] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T21:06:48.289432] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-10T21:06:49.089386] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-10T21:06:49.696350] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-10T21:06:49.889395] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-10T21:06:49.959841] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T21:06:49.964040] [INFO ] [REMOTE ] PWR: Full fetch complete (68512 records). [2025-10-10T21:06:49.964135] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-10T21:06:49.964879] [FATAL] [VALIDATOR ] PWR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:06:49.964963] [FATAL] [MAIN ] PWR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:06:49.965005] [WARN ] [MAIN ] PWR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:06:49.965043] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-10T21:06:49.965098] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-10T21:06:49.965132] [INFO ] [LOCAL ] PWR: Starting deletion of derivative data. [2025-10-10T21:06:49.965231] [DEBUG] [LOCAL ] PWR: No derivative data file found to delete. [2025-10-10T21:06:49.965306] [INFO ] [MAIN ] Update Progress: 1755/2373 symbols completed. PWR took 37.6s. Estimated remaining: 1h 26m 54s. Rate: 7.1 symbols/min [2025-10-10T21:06:50.140304] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:06:50.140553] [DEBUG] [LOCAL ] QGEN: No existing data file found in primary storage. [2025-10-10T21:06:50.140623] [WARN ] [MAIN ] QGEN: No existing data found, performing full refresh instead. [2025-10-10T21:06:50.141067] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-10T21:06:50.141335] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-10T21:06:50.141407] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-10T21:06:50.141444] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-10T21:06:50.457382] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.97 seconds). [2025-10-10T21:06:50.544703] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:06:50.689347] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-10T21:06:51.394494] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-10T21:06:51.489330] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-10T21:06:52.289470] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-10-10T21:06:53.035385] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-10T21:06:53.089343] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-10T21:06:53.389610] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-10T21:06:53.889348] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-10T21:06:54.072697] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-10T21:06:54.259446] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T21:06:54.689375] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-10T21:06:55.489368] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-10T21:06:56.289334] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-10T21:06:56.536507] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-10T21:06:56.649668] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-10-10T21:06:56.733903] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-10T21:06:57.089360] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-10T21:06:57.625117] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-10T21:06:57.889398] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-10T21:06:58.689425] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-10T21:06:59.387759] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T21:06:59.489383] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-10T21:06:59.963829] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-10-10T21:06:59.999895] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T21:07:00.289403] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-10T21:07:01.089427] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-10T21:07:01.271401] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T21:07:01.889415] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-10T21:07:02.401105] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-10T21:07:02.689388] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-10T21:07:03.489423] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-10T21:07:03.764030] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-10T21:07:03.973445] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.88 seconds). [2025-10-10T21:07:04.059890] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T21:07:04.289435] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-10T21:07:05.089392] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-10T21:07:05.608111] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-10T21:07:05.899415] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-10T21:07:05.901533] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-10T21:07:06.689397] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-10T21:07:07.489408] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-10T21:07:07.559295] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-10T21:07:07.718167] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-10T21:07:08.143532] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-10T21:07:08.217808] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T21:07:08.220716] [INFO ] [REMOTE ] QD: Full fetch complete (39969 records). [2025-10-10T21:07:08.220817] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-10T21:07:08.294716] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-10T21:07:08.612276] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-10T21:07:08.612359] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-10T21:07:08.613260] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-10T21:07:08.613323] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-10T21:07:08.614283] [DEBUG] [LOCAL ] QD: Trimmed 39969 records to 28119 (keeping 200 days of data) [2025-10-10T21:07:08.771988] [DEBUG] [LOCAL ] QD: Primary data saved (28119 records). [2025-10-10T21:07:08.772132] [INFO ] [MAIN ] QD: Full history saved. [2025-10-10T21:07:08.772208] [INFO ] [MAIN ] Update Progress: 1756/2373 symbols completed. QD took 26.8s. Estimated remaining: 1h 26m 49s. Rate: 7.1 symbols/min [2025-10-10T21:07:08.939076] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:07:08.939281] [DEBUG] [LOCAL ] QS: No existing data file found in primary storage. [2025-10-10T21:07:08.939318] [WARN ] [MAIN ] QS: No existing data found, performing full refresh instead. [2025-10-10T21:07:08.939430] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-10T21:07:08.939472] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-10T21:07:08.939512] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-10T21:07:08.939546] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-10T21:07:09.091585] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-10T21:07:09.310008] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:07:09.889365] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-10T21:07:10.313166] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T21:07:10.689389] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-10-10T21:07:11.427073] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-10T21:07:11.489377] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-10T21:07:12.178523] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (3.09 seconds). [2025-10-10T21:07:12.289342] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-10T21:07:13.089412] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-10T21:07:13.422220] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T21:07:13.470460] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-10-10T21:07:13.488266] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-10T21:07:13.490855] [INFO ] [REMOTE ] PX: Full fetch complete (50117 records). [2025-10-10T21:07:13.490938] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-10T21:07:13.491459] [FATAL] [VALIDATOR ] PX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:07:13.491543] [FATAL] [MAIN ] PX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:07:13.491587] [WARN ] [MAIN ] PX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:07:13.491627] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-10T21:07:13.491720] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-10T21:07:13.491769] [INFO ] [LOCAL ] PX: Starting deletion of derivative data. [2025-10-10T21:07:13.491811] [DEBUG] [LOCAL ] PX: No derivative data file found to delete. [2025-10-10T21:07:13.491865] [INFO ] [MAIN ] Update Progress: 1757/2373 symbols completed. PX took 42.2s. Estimated remaining: 1h 26m 39s. Rate: 7.1 symbols/min [2025-10-10T21:07:13.889408] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-10T21:07:14.689443] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-10T21:07:15.592778] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (3.30 seconds). [2025-10-10T21:07:15.604698] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-10T21:07:15.925718] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-10T21:07:16.289397] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-10T21:07:16.447672] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T21:07:16.452304] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-10T21:07:16.452459] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-10T21:07:16.453251] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:07:16.453335] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:07:16.453379] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:07:16.453418] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-10T21:07:16.453474] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-10T21:07:16.453508] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-10T21:07:16.453546] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-10T21:07:16.453602] [INFO ] [MAIN ] Update Progress: 1758/2373 symbols completed. QBTS took 39.0s. Estimated remaining: 1h 26m 29s. Rate: 7.1 symbols/min [2025-10-10T21:07:17.167817] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-10T21:07:17.178266] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-10T21:07:17.780874] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T21:07:17.889336] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-10T21:07:18.825900] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T21:07:18.830015] [INFO ] [REMOTE ] QGEN: Full fetch complete (69841 records). [2025-10-10T21:07:18.830122] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-10T21:07:18.830890] [FATAL] [VALIDATOR ] QGEN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:07:18.830978] [FATAL] [MAIN ] QGEN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:07:18.831020] [WARN ] [MAIN ] QGEN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:07:18.831056] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-10T21:07:18.831112] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-10T21:07:18.831146] [INFO ] [LOCAL ] QGEN: Starting deletion of derivative data. [2025-10-10T21:07:18.831183] [DEBUG] [LOCAL ] QGEN: No derivative data file found to delete. [2025-10-10T21:07:18.831238] [INFO ] [MAIN ] Update Progress: 1759/2373 symbols completed. QGEN took 28.9s. Estimated remaining: 1h 26m 18s. Rate: 7.1 symbols/min [2025-10-10T21:07:19.188017] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-10T21:07:19.198062] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-10T21:07:21.635594] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-10T21:07:21.648015] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-10T21:07:24.214880] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-10T21:07:24.226094] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-10T21:07:26.745019] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-10T21:07:26.756401] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-10T21:07:29.353764] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-10T21:07:29.365502] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-10T21:07:32.487465] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (3.12 seconds). [2025-10-10T21:07:32.500101] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-10T21:07:35.245975] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-10-10T21:07:35.257558] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-10T21:07:38.237757] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.98 seconds). [2025-10-10T21:07:38.250306] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-10T21:07:39.144938] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-10T21:07:39.149968] [INFO ] [REMOTE ] QS: Full fetch complete (77496 records). [2025-10-10T21:07:39.150126] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-10T21:07:39.150929] [FATAL] [VALIDATOR ] QS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:07:39.151018] [FATAL] [MAIN ] QS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:07:39.151064] [WARN ] [MAIN ] QS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:07:39.151107] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-10T21:07:39.151175] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-10T21:07:39.151213] [INFO ] [LOCAL ] QS: Starting deletion of derivative data. [2025-10-10T21:07:39.151257] [DEBUG] [LOCAL ] QS: No derivative data file found to delete. [2025-10-10T21:07:39.151321] [INFO ] [MAIN ] Update Progress: 1760/2373 symbols completed. QS took 30.4s. Estimated remaining: 1h 26m 14s. Rate: 7.1 symbols/min [2025-10-10T21:07:39.692598] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:07:39.795916] [DEBUG] [LOCAL ] QTWO: No existing data file found in primary storage. [2025-10-10T21:07:39.832536] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:07:39.829439] [WARN ] [MAIN ] QTWO: No existing data found, performing full refresh instead. [2025-10-10T21:07:39.867807] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-10T21:07:39.880307] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-10T21:07:39.880559] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-10T21:07:39.905124] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-10T21:07:39.905042] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:07:39.886701] [DEBUG] [LOCAL ] QUAD: No existing data file found in primary storage. [2025-10-10T21:07:39.928734] [WARN ] [MAIN ] QUAD: No existing data found, performing full refresh instead. [2025-10-10T21:07:39.942864] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:07:39.943087] [DEBUG] [LOCAL ] QVCC: No existing data file found in primary storage. [2025-10-10T21:07:39.952747] [WARN ] [MAIN ] QVCC: No existing data found, performing full refresh instead. [2025-10-10T21:07:39.913750] [DEBUG] [LOCAL ] QSR: No existing data file found in primary storage. [2025-10-10T21:07:39.971929] [WARN ] [MAIN ] QSR: No existing data found, performing full refresh instead. [2025-10-10T21:07:39.971857] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-10T21:07:39.952665] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-10T21:07:39.977305] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-10T21:07:40.003144] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-10T21:07:40.008702] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-10T21:07:40.003259] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-10T21:07:39.997766] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-10T21:07:40.009028] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-10T21:07:40.024831] [DEBUG] [LOCAL ] QUAD: No primary data file found to delete. [2025-10-10T21:07:40.014283] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-10T21:07:40.043687] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-10T21:07:40.054450] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-10T21:07:41.375577] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:07:41.406264] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-10-10T21:07:41.454337] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:07:41.542963] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:07:41.522385] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-10-10T21:07:41.569297] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-10-10T21:07:41.592541] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:07:41.595147] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-10-10T21:07:42.639240] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-10T21:07:42.641958] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-10T21:07:43.031773] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-10T21:07:43.037525] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-10T21:07:43.513424] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-10T21:07:43.516231] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-10T21:07:43.540880] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T21:07:43.550125] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-10T21:07:43.641425] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-10T21:07:43.652450] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-10T21:07:44.043776] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-10T21:07:44.048726] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-10T21:07:44.393636] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-10T21:07:44.395358] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-10T21:07:45.129260] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-10T21:07:45.137702] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-10T21:07:45.193000] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-10T21:07:45.200635] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-10T21:07:45.425945] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-10T21:07:45.429448] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-10T21:07:45.514868] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T21:07:45.526574] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-10T21:07:46.058792] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-10T21:07:46.061549] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-10T21:07:46.419964] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T21:07:46.429130] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-10T21:07:46.604933] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-10T21:07:46.611241] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-10T21:07:47.126688] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-10T21:07:47.130360] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-10T21:07:47.612822] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-10T21:07:47.625245] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-10T21:07:48.183891] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-10T21:07:48.193586] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-10T21:07:48.359277] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T21:07:48.377238] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T21:07:48.386293] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-10T21:07:48.388001] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-10T21:07:49.303305] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T21:07:49.316293] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-10T21:07:49.348280] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-10T21:07:49.350689] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-10T21:07:49.354699] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-10T21:07:49.362916] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-10T21:07:50.063880] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-10T21:07:50.065333] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-10T21:07:50.077362] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-10T21:07:50.078841] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-10T21:07:50.720856] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-10T21:07:50.727531] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-10T21:07:50.810096] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-10T21:07:50.812952] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-10T21:07:51.444167] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-10T21:07:51.447137] [INFO ] [REMOTE ] QVCC: Full fetch complete (12081 records). [2025-10-10T21:07:51.449533] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T21:07:51.449719] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-10T21:07:51.461989] [FATAL] [VALIDATOR ] QVCC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:07:51.462589] [FATAL] [MAIN ] QVCC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:07:51.462464] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-10T21:07:51.462719] [WARN ] [MAIN ] QVCC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:07:51.462907] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-10T21:07:51.464056] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-10T21:07:51.464120] [INFO ] [LOCAL ] QVCC: Starting deletion of derivative data. [2025-10-10T21:07:51.464168] [DEBUG] [LOCAL ] QVCC: No derivative data file found to delete. [2025-10-10T21:07:51.464238] [INFO ] [MAIN ] Update Progress: 1761/2373 symbols completed. QVCC took 12.3s. Estimated remaining: 1h 26m 7s. Rate: 7.1 symbols/min [2025-10-10T21:07:51.653080] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:07:51.653806] [DEBUG] [LOCAL ] QVCD: No existing data file found in primary storage. [2025-10-10T21:07:51.654046] [WARN ] [MAIN ] QVCD: No existing data found, performing full refresh instead. [2025-10-10T21:07:51.654846] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-10T21:07:51.668623] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-10T21:07:51.670270] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-10T21:07:51.670485] [DEBUG] [LOCAL ] QVCD: No primary data file found to delete. [2025-10-10T21:07:51.675491] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-10T21:07:51.770559] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-10T21:07:51.833105] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T21:07:51.927500] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-10T21:07:52.117630] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:07:52.118092] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-10-10T21:07:52.912058] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-10T21:07:52.914024] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-10T21:07:53.590438] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-10T21:07:53.621855] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-10T21:07:53.622637] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T21:07:53.638609] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-10T21:07:53.849065] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-10T21:07:53.889364] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-10T21:07:54.689420] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-10T21:07:55.330467] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-10T21:07:55.489380] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-10T21:07:55.522948] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T21:07:55.661409] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T21:07:56.289417] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-10T21:07:56.341712] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-10T21:07:57.089412] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-10T21:07:57.847251] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-10T21:07:57.889348] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-10T21:07:58.127863] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T21:07:58.689398] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-10T21:07:58.903937] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-10T21:07:59.489391] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-10T21:07:59.630902] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-10T21:08:00.289420] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-10T21:08:01.089369] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-10T21:08:01.421698] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T21:08:01.433245] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T21:08:01.436733] [INFO ] [REMOTE ] QUAD: Full fetch complete (34304 records). [2025-10-10T21:08:01.437324] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-10T21:08:01.819566] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-10T21:08:01.819724] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-10T21:08:01.820746] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-10T21:08:01.820813] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-10T21:08:01.822222] [DEBUG] [LOCAL ] QUAD: Trimmed 34304 records to 23714 (keeping 200 days of data) [2025-10-10T21:08:01.912538] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-10T21:08:01.974033] [DEBUG] [LOCAL ] QUAD: Primary data saved (23714 records). [2025-10-10T21:08:01.974183] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-10T21:08:01.974261] [INFO ] [MAIN ] Update Progress: 1762/2373 symbols completed. QUAD took 22.8s. Estimated remaining: 1h 25m 59s. Rate: 7.1 symbols/min [2025-10-10T21:08:02.139686] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:08:02.139895] [DEBUG] [LOCAL ] QXO: No existing data file found in primary storage. [2025-10-10T21:08:02.139935] [WARN ] [MAIN ] QXO: No existing data found, performing full refresh instead. [2025-10-10T21:08:02.140055] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-10T21:08:02.140096] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-10T21:08:02.140137] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-10T21:08:02.140168] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-10T21:08:02.482635] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:08:02.689364] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-10T21:08:02.735429] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-10T21:08:02.941808] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-10T21:08:03.489409] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-10T21:08:03.615721] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T21:08:03.619609] [INFO ] [REMOTE ] QTWO: Full fetch complete (57348 records). [2025-10-10T21:08:03.619739] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-10T21:08:03.620296] [FATAL] [VALIDATOR ] QTWO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:08:03.620381] [FATAL] [MAIN ] QTWO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:08:03.620424] [WARN ] [MAIN ] QTWO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:08:03.620461] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-10T21:08:03.620516] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-10T21:08:03.620553] [INFO ] [LOCAL ] QTWO: Starting deletion of derivative data. [2025-10-10T21:08:03.620593] [DEBUG] [LOCAL ] QTWO: No derivative data file found to delete. [2025-10-10T21:08:03.620669] [INFO ] [MAIN ] Update Progress: 1763/2373 symbols completed. QTWO took 24.5s. Estimated remaining: 1h 25m 48s. Rate: 7.1 symbols/min [2025-10-10T21:08:03.786497] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:08:03.786728] [DEBUG] [LOCAL ] R: No existing data file found in primary storage. [2025-10-10T21:08:03.786782] [WARN ] [MAIN ] R: No existing data found, performing full refresh instead. [2025-10-10T21:08:03.786891] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-10T21:08:03.786932] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-10T21:08:03.787026] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-10T21:08:03.787062] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-10T21:08:04.125407] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:08:04.289366] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-10-10T21:08:05.089381] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-10T21:08:05.722237] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-10T21:08:05.874229] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-10T21:08:05.889343] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-10T21:08:05.908580] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-10T21:08:06.689443] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-10T21:08:07.489412] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-10T21:08:07.524753] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T21:08:07.554061] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-10T21:08:08.289416] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-10-10T21:08:09.089351] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-10T21:08:09.629034] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T21:08:09.889353] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-10T21:08:10.384856] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-10T21:08:10.694945] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-10T21:08:10.696150] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T21:08:10.818339] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T21:08:10.822888] [INFO ] [REMOTE ] QSR: Full fetch complete (75462 records). [2025-10-10T21:08:10.823017] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-10T21:08:10.823857] [FATAL] [VALIDATOR ] QSR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:08:10.823958] [FATAL] [MAIN ] QSR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:08:10.824027] [WARN ] [MAIN ] QSR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:08:10.824116] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-10T21:08:10.824194] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-10T21:08:10.824232] [INFO ] [LOCAL ] QSR: Starting deletion of derivative data. [2025-10-10T21:08:10.824272] [DEBUG] [LOCAL ] QSR: No derivative data file found to delete. [2025-10-10T21:08:10.824332] [INFO ] [MAIN ] Update Progress: 1764/2373 symbols completed. QSR took 31.7s. Estimated remaining: 1h 25m 39s. Rate: 7.1 symbols/min [2025-10-10T21:08:10.990492] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:08:10.990677] [DEBUG] [LOCAL ] RA: No existing data file found in primary storage. [2025-10-10T21:08:10.990730] [WARN ] [MAIN ] RA: No existing data found, performing full refresh instead. [2025-10-10T21:08:10.990864] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-10T21:08:10.990927] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-10T21:08:10.990976] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-10T21:08:10.991008] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-10T21:08:11.340919] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:08:11.454203] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-10T21:08:11.489335] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-10-10T21:08:12.289362] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-10T21:08:12.918487] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T21:08:13.089421] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-10T21:08:13.776659] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T21:08:13.778081] [INFO ] [REMOTE ] QVCD: Full fetch complete (6328 records). [2025-10-10T21:08:13.778149] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-10T21:08:13.897172] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-10T21:08:14.140188] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-10T21:08:14.140286] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-10T21:08:14.140585] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-10T21:08:14.140745] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-10T21:08:14.152893] [DEBUG] [LOCAL ] QVCD: Trimmed 6328 records to 4791 (keeping 200 days of data) [2025-10-10T21:08:14.161909] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T21:08:14.197743] [DEBUG] [LOCAL ] QVCD: Primary data saved (4791 records). [2025-10-10T21:08:14.197848] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-10T21:08:14.197916] [INFO ] [MAIN ] Update Progress: 1765/2373 symbols completed. QVCD took 22.7s. Estimated remaining: 1h 25m 29s. Rate: 7.1 symbols/min [2025-10-10T21:08:14.360078] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:08:14.360276] [DEBUG] [LOCAL ] RACE: No existing data file found in primary storage. [2025-10-10T21:08:14.360313] [WARN ] [MAIN ] RACE: No existing data found, performing full refresh instead. [2025-10-10T21:08:14.360422] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-10T21:08:14.360462] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-10T21:08:14.360501] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-10T21:08:14.360532] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-10T21:08:14.694895] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-10T21:08:14.705501] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:08:15.489352] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-10-10T21:08:15.915273] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T21:08:16.080192] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T21:08:16.289372] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-10T21:08:17.089347] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-10T21:08:17.375120] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T21:08:17.661604] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T21:08:17.889349] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-10T21:08:18.554619] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-10T21:08:18.689341] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-10T21:08:19.489389] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-10T21:08:19.561152] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T21:08:20.289385] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-10T21:08:20.590266] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T21:08:20.811595] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-10T21:08:21.089411] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-10T21:08:21.889408] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-10T21:08:22.205854] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T21:08:22.502508] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-10T21:08:22.689403] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-10T21:08:23.278148] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T21:08:23.489404] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-10T21:08:24.289401] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-10T21:08:24.839363] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T21:08:25.089352] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-10T21:08:25.205192] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T21:08:25.889467] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-10T21:08:26.299054] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-10T21:08:26.689380] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-10T21:08:26.929044] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-10T21:08:27.091398] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T21:08:27.489384] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-10T21:08:28.289354] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-10T21:08:28.519173] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T21:08:28.770538] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-10T21:08:29.089392] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-10T21:08:29.889391] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-10T21:08:29.945684] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-10T21:08:30.459629] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T21:08:30.689416] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-10T21:08:31.489400] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-10T21:08:31.813120] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T21:08:32.188837] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T21:08:32.289375] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-10T21:08:33.089387] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-10T21:08:33.360541] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T21:08:33.566896] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T21:08:33.889414] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-10T21:08:34.166260] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T21:08:34.689411] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-10T21:08:35.257867] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-10T21:08:35.489442] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-10T21:08:36.289401] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-10T21:08:36.428898] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-10T21:08:36.957346] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-10T21:08:36.958534] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T21:08:36.974597] [INFO ] [REMOTE ] RA: Full fetch complete (31668 records). [2025-10-10T21:08:36.974797] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-10T21:08:36.975506] [FATAL] [VALIDATOR ] RA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:08:36.975595] [FATAL] [MAIN ] RA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:08:36.975662] [WARN ] [MAIN ] RA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:08:36.975732] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-10T21:08:36.975804] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-10T21:08:36.975842] [INFO ] [LOCAL ] RA: Starting deletion of derivative data. [2025-10-10T21:08:36.975882] [DEBUG] [LOCAL ] RA: No derivative data file found to delete. [2025-10-10T21:08:36.975950] [INFO ] [MAIN ] Update Progress: 1766/2373 symbols completed. RA took 26.2s. Estimated remaining: 1h 25m 26s. Rate: 7.1 symbols/min [2025-10-10T21:08:37.094801] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-10T21:08:37.175454] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:08:37.175741] [DEBUG] [LOCAL ] RAMP: No existing data file found in primary storage. [2025-10-10T21:08:37.175791] [WARN ] [MAIN ] RAMP: No existing data found, performing full refresh instead. [2025-10-10T21:08:37.175993] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-10T21:08:37.176037] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-10T21:08:37.176078] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-10T21:08:37.176112] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-10T21:08:37.538308] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:08:37.889430] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-10T21:08:37.938765] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T21:08:37.942312] [INFO ] [REMOTE ] R: Full fetch complete (42039 records). [2025-10-10T21:08:37.942585] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-10T21:08:37.943637] [FATAL] [VALIDATOR ] R: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:08:37.943753] [FATAL] [MAIN ] R: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:08:37.943796] [WARN ] [MAIN ] R: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:08:37.943837] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-10T21:08:37.943899] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-10T21:08:37.943936] [INFO ] [LOCAL ] R: Starting deletion of derivative data. [2025-10-10T21:08:37.943975] [DEBUG] [LOCAL ] R: No derivative data file found to delete. [2025-10-10T21:08:37.944044] [INFO ] [MAIN ] Update Progress: 1767/2373 symbols completed. R took 34.3s. Estimated remaining: 1h 25m 15s. Rate: 7.1 symbols/min [2025-10-10T21:08:38.115408] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:08:38.115622] [DEBUG] [LOCAL ] RBA: No existing data file found in primary storage. [2025-10-10T21:08:38.115697] [WARN ] [MAIN ] RBA: No existing data found, performing full refresh instead. [2025-10-10T21:08:38.115817] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-10T21:08:38.115859] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-10T21:08:38.115899] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-10T21:08:38.115930] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-10T21:08:38.454228] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:08:38.689354] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-10-10T21:08:39.489434] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-10-10T21:08:39.560561] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T21:08:40.289427] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-10T21:08:40.371059] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T21:08:41.089348] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-10T21:08:41.163250] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-10T21:08:41.889461] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-10T21:08:42.605877] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-10T21:08:42.685143] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-10T21:08:42.691429] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-10T21:08:43.489410] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-10T21:08:43.509885] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T21:08:44.019159] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T21:08:44.289443] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-10T21:08:45.089437] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-10T21:08:45.859435] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-10T21:08:45.889351] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-10T21:08:45.977054] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T21:08:46.689369] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-10T21:08:46.833909] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T21:08:46.839443] [INFO ] [REMOTE ] QXO: Full fetch complete (75451 records). [2025-10-10T21:08:46.839627] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-10T21:08:46.840891] [FATAL] [VALIDATOR ] QXO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:08:46.840997] [FATAL] [MAIN ] QXO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:08:46.841050] [WARN ] [MAIN ] QXO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:08:46.841101] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-10T21:08:46.841174] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-10T21:08:46.841215] [INFO ] [LOCAL ] QXO: Starting deletion of derivative data. [2025-10-10T21:08:46.841266] [DEBUG] [LOCAL ] QXO: No derivative data file found to delete. [2025-10-10T21:08:46.841337] [INFO ] [MAIN ] Update Progress: 1768/2373 symbols completed. QXO took 44.9s. Estimated remaining: 1h 25m 7s. Rate: 7.1 symbols/min [2025-10-10T21:08:47.046319] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:08:47.046893] [DEBUG] [LOCAL ] RBC: No existing data file found in primary storage. [2025-10-10T21:08:47.047304] [WARN ] [MAIN ] RBC: No existing data found, performing full refresh instead. [2025-10-10T21:08:47.049316] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-10T21:08:47.058333] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-10T21:08:47.058890] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-10T21:08:47.059101] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-10T21:08:47.059170] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-10T21:08:47.436913] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:08:47.489345] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-10-10T21:08:48.289357] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-10T21:08:48.590447] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T21:08:48.832518] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T21:08:49.089407] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-10T21:08:49.889394] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-10T21:08:49.966760] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T21:08:50.689441] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-10T21:08:50.967206] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T21:08:51.318916] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-10T21:08:51.489410] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-10T21:08:51.955954] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-10T21:08:52.289444] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-10T21:08:53.089409] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-10T21:08:53.337176] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T21:08:53.417171] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-10T21:08:53.889388] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-10T21:08:54.346029] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T21:08:54.689457] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-10T21:08:55.195281] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-10T21:08:55.489370] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-10T21:08:56.289393] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-10T21:08:56.662477] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T21:08:56.857399] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T21:08:57.089387] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-10T21:08:57.157475] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T21:08:57.161324] [INFO ] [REMOTE ] RACE: Full fetch complete (47670 records). [2025-10-10T21:08:57.161439] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-10T21:08:57.162125] [FATAL] [VALIDATOR ] RACE: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:08:57.162215] [FATAL] [MAIN ] RACE: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:08:57.162261] [WARN ] [MAIN ] RACE: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:08:57.162335] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-10T21:08:57.162409] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-10T21:08:57.162450] [INFO ] [LOCAL ] RACE: Starting deletion of derivative data. [2025-10-10T21:08:57.162492] [DEBUG] [LOCAL ] RACE: No derivative data file found to delete. [2025-10-10T21:08:57.162583] [INFO ] [MAIN ] Update Progress: 1769/2373 symbols completed. RACE took 43.0s. Estimated remaining: 1h 24m 59s. Rate: 7.1 symbols/min [2025-10-10T21:08:57.338787] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:08:57.339031] [DEBUG] [LOCAL ] RBLX: No existing data file found in primary storage. [2025-10-10T21:08:57.339088] [WARN ] [MAIN ] RBLX: No existing data found, performing full refresh instead. [2025-10-10T21:08:57.339215] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-10T21:08:57.339261] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-10T21:08:57.339303] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-10T21:08:57.339338] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-10T21:08:57.696118] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:08:57.889422] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-10T21:08:58.164735] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-10T21:08:58.689401] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-10T21:08:59.489374] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-10-10T21:08:59.959903] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T21:09:00.289380] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-10T21:09:00.328633] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T21:09:01.089407] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-10T21:09:01.889427] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-10T21:09:02.142219] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-10T21:09:02.181514] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T21:09:02.667101] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-10T21:09:02.689407] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-10T21:09:02.757847] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-10T21:09:03.489459] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-10T21:09:04.289444] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-10T21:09:05.020541] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-10T21:09:05.089407] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-10T21:09:05.471540] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T21:09:05.547620] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T21:09:05.889392] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-10T21:09:06.689392] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-10T21:09:07.489383] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-10T21:09:07.653996] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-10T21:09:07.719420] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-10T21:09:07.758366] [INFO ] [REMOTE ] RAMP: Full fetch complete (53584 records). [2025-10-10T21:09:07.758877] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-10T21:09:07.762202] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-10T21:09:07.763228] [FATAL] [VALIDATOR ] RAMP: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:09:07.773734] [FATAL] [MAIN ] RAMP: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:09:07.774097] [WARN ] [MAIN ] RAMP: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:09:07.774337] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-10T21:09:07.774495] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-10T21:09:07.774559] [INFO ] [LOCAL ] RAMP: Starting deletion of derivative data. [2025-10-10T21:09:07.774608] [DEBUG] [LOCAL ] RAMP: No derivative data file found to delete. [2025-10-10T21:09:07.774792] [INFO ] [MAIN ] Update Progress: 1770/2373 symbols completed. RAMP took 30.8s. Estimated remaining: 1h 24m 51s. Rate: 7.1 symbols/min [2025-10-10T21:09:07.957902] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:09:07.958183] [DEBUG] [LOCAL ] RBOT: No existing data file found in primary storage. [2025-10-10T21:09:07.958229] [WARN ] [MAIN ] RBOT: No existing data found, performing full refresh instead. [2025-10-10T21:09:07.958364] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-10T21:09:07.958407] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-10T21:09:07.958449] [DEBUG] [LOCAL ] RBOT: No primary data file found to delete. [2025-10-10T21:09:07.958483] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-10T21:09:08.301741] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-10T21:09:08.339726] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:09:08.353069] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-10T21:09:09.089399] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-10T21:09:09.889392] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-10-10T21:09:10.689462] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-10T21:09:10.867265] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-10T21:09:11.050057] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-10T21:09:11.081255] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-10T21:09:11.489392] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-10T21:09:11.983165] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T21:09:12.289385] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-10T21:09:12.571901] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T21:09:13.089418] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-10T21:09:13.492780] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T21:09:13.889394] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-10T21:09:13.951460] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T21:09:13.956141] [INFO ] [REMOTE ] RBA: Full fetch complete (65528 records). [2025-10-10T21:09:13.956305] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-10T21:09:13.957177] [FATAL] [VALIDATOR ] RBA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:09:13.957274] [FATAL] [MAIN ] RBA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:09:13.957387] [WARN ] [MAIN ] RBA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:09:13.957496] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-10T21:09:13.957624] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-10T21:09:13.957709] [INFO ] [LOCAL ] RBA: Starting deletion of derivative data. [2025-10-10T21:09:13.957766] [DEBUG] [LOCAL ] RBA: No derivative data file found to delete. [2025-10-10T21:09:13.957850] [INFO ] [MAIN ] Update Progress: 1771/2373 symbols completed. RBA took 36.0s. Estimated remaining: 1h 24m 42s. Rate: 7.1 symbols/min [2025-10-10T21:09:14.140787] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:09:14.141197] [DEBUG] [LOCAL ] RBRK: No existing data file found in primary storage. [2025-10-10T21:09:14.141255] [WARN ] [MAIN ] RBRK: No existing data found, performing full refresh instead. [2025-10-10T21:09:14.141390] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-10T21:09:14.141438] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-10T21:09:14.141480] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-10T21:09:14.141513] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-10T21:09:14.511192] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:09:14.689411] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-10-10T21:09:15.489479] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-10T21:09:16.294526] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-10T21:09:16.316983] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T21:09:16.512325] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-10T21:09:16.753436] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T21:09:16.983968] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-10T21:09:17.089407] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-10T21:09:17.753722] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-10T21:09:17.755993] [INFO ] [REMOTE ] RBC: Full fetch complete (21436 records). [2025-10-10T21:09:17.756088] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-10T21:09:17.756831] [FATAL] [VALIDATOR ] RBC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:09:17.757041] [FATAL] [MAIN ] RBC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:09:17.757087] [WARN ] [MAIN ] RBC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:09:17.757133] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-10T21:09:17.757222] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-10T21:09:17.757277] [INFO ] [LOCAL ] RBC: Starting deletion of derivative data. [2025-10-10T21:09:17.757339] [DEBUG] [LOCAL ] RBC: No derivative data file found to delete. [2025-10-10T21:09:17.757490] [INFO ] [MAIN ] Update Progress: 1772/2373 symbols completed. RBC took 30.9s. Estimated remaining: 1h 24m 32s. Rate: 7.1 symbols/min [2025-10-10T21:09:17.894561] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-10T21:09:17.947622] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:09:17.947869] [DEBUG] [LOCAL ] RC: No existing data file found in primary storage. [2025-10-10T21:09:17.947933] [WARN ] [MAIN ] RC: No existing data found, performing full refresh instead. [2025-10-10T21:09:17.948374] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-10T21:09:17.948427] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-10T21:09:17.948474] [DEBUG] [LOCAL ] RC: No primary data file found to delete. [2025-10-10T21:09:17.948513] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-10T21:09:18.309751] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:09:18.689372] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-10T21:09:18.844197] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-10T21:09:19.489407] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-10-10T21:09:20.289347] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-10T21:09:20.963352] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-10T21:09:21.089429] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-10T21:09:21.694087] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-10T21:09:21.889417] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-10T21:09:22.394102] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-10T21:09:22.689389] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-10T21:09:22.734452] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-10T21:09:23.489372] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-10T21:09:23.601063] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-10T21:09:24.289344] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-10T21:09:24.710684] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T21:09:25.089423] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-10T21:09:25.243564] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-10T21:09:25.774484] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-10T21:09:25.889348] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-10T21:09:26.574947] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-10T21:09:26.689344] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-10T21:09:27.135734] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-10T21:09:27.489375] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-10T21:09:28.289396] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-10T21:09:28.949209] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-10T21:09:29.089380] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-10T21:09:29.319314] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-10T21:09:29.352066] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T21:09:29.889379] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-10T21:09:30.689347] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-10T21:09:30.891509] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-10T21:09:31.314872] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-10T21:09:31.489369] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-10T21:09:32.289407] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-10T21:09:33.089407] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-10T21:09:33.763380] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (3.07 seconds). [2025-10-10T21:09:33.852807] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-10T21:09:33.889384] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-10T21:09:34.108703] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-10T21:09:34.401775] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-10T21:09:34.689452] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-10T21:09:35.489377] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-10T21:09:36.207800] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-10T21:09:36.289376] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-10T21:09:37.089373] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-10T21:09:37.455410] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-10-10T21:09:37.598563] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T21:09:37.889356] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-10T21:09:38.143445] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T21:09:38.145387] [INFO ] [REMOTE ] RBOT: Full fetch complete (9092 records). [2025-10-10T21:09:38.145560] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-10T21:09:38.532457] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-10T21:09:38.532683] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-10T21:09:38.533866] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-10T21:09:38.533929] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-10T21:09:38.534353] [DEBUG] [LOCAL ] RBOT: Trimmed 9092 records to 6007 (keeping 200 days of data) [2025-10-10T21:09:38.573210] [DEBUG] [LOCAL ] RBOT: Primary data saved (6007 records). [2025-10-10T21:09:38.573524] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-10T21:09:38.573700] [INFO ] [MAIN ] Update Progress: 1773/2373 symbols completed. RBOT took 30.8s. Estimated remaining: 1h 24m 28s. Rate: 7.1 symbols/min [2025-10-10T21:09:38.699190] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-10T21:09:38.723263] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-10T21:09:38.811745] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:09:38.812274] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-10T21:09:38.812503] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-10T21:09:38.818456] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-10T21:09:38.818534] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-10T21:09:38.825934] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-10T21:09:38.826057] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-10T21:09:38.832505] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T21:09:38.909954] [INFO ] [REMOTE ] RBLX: Full fetch complete (77393 records). [2025-10-10T21:09:38.935362] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-10T21:09:38.956194] [FATAL] [VALIDATOR ] RBLX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:09:38.966733] [FATAL] [MAIN ] RBLX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:09:38.985895] [WARN ] [MAIN ] RBLX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:09:38.995788] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-10T21:09:39.001958] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-10T21:09:39.002048] [INFO ] [LOCAL ] RBLX: Starting deletion of derivative data. [2025-10-10T21:09:39.005088] [DEBUG] [LOCAL ] RBLX: No derivative data file found to delete. [2025-10-10T21:09:39.005219] [INFO ] [MAIN ] Update Progress: 1774/2373 symbols completed. RBLX took 41.8s. Estimated remaining: 1h 24m 16s. Rate: 7.1 symbols/min [2025-10-10T21:09:39.406923] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:09:39.411038] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:09:39.411335] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-10-10T21:09:39.411679] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-10-10T21:09:39.411810] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-10T21:09:39.411856] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-10T21:09:39.411920] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-10T21:09:39.411973] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-10T21:09:39.494611] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-10T21:09:39.858873] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:09:40.289432] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-10-10T21:09:40.492421] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T21:09:40.777133] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-10T21:09:41.089394] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-10T21:09:41.828411] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-10T21:09:41.889356] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-10T21:09:42.689380] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-10T21:09:43.046530] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T21:09:43.406716] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-10T21:09:43.489418] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-10-10T21:09:44.289432] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-10T21:09:44.448080] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-10T21:09:44.480536] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-10T21:09:45.089404] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-10T21:09:45.889422] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-10T21:09:45.973151] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T21:09:45.977940] [INFO ] [REMOTE ] RBRK: Full fetch complete (76148 records). [2025-10-10T21:09:45.978098] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-10T21:09:45.978788] [FATAL] [VALIDATOR ] RBRK: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:09:45.978890] [FATAL] [MAIN ] RBRK: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:09:45.978956] [WARN ] [MAIN ] RBRK: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:09:45.979033] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-10T21:09:45.979101] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-10T21:09:45.979140] [INFO ] [LOCAL ] RBRK: Starting deletion of derivative data. [2025-10-10T21:09:45.979183] [DEBUG] [LOCAL ] RBRK: No derivative data file found to delete. [2025-10-10T21:09:45.979241] [INFO ] [MAIN ] Update Progress: 1775/2373 symbols completed. RBRK took 32.0s. Estimated remaining: 1h 24m 7s. Rate: 7.1 symbols/min [2025-10-10T21:09:46.150554] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:09:46.150937] [DEBUG] [LOCAL ] RCI: No existing data file found in primary storage. [2025-10-10T21:09:46.151041] [WARN ] [MAIN ] RCI: No existing data found, performing full refresh instead. [2025-10-10T21:09:46.151203] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-10T21:09:46.151283] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-10T21:09:46.151427] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-10T21:09:46.151480] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-10T21:09:46.543229] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:09:46.558638] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-10T21:09:46.683682] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-10T21:09:46.689328] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-10T21:09:47.489427] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-10T21:09:47.495977] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-10T21:09:48.289397] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-10T21:09:48.444175] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-10T21:09:49.089378] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-10T21:09:49.755727] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-10T21:09:49.889359] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-10T21:09:50.355380] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-10T21:09:50.689364] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-10T21:09:50.892154] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-10T21:09:51.489374] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-10-10T21:09:52.289374] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-10T21:09:52.779894] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-10T21:09:53.089400] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-10T21:09:53.130259] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-10T21:09:53.365558] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T21:09:53.803757] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-10T21:09:53.889392] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-10T21:09:54.370333] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-10T21:09:54.689409] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-10T21:09:55.489442] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-10T21:09:56.132638] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-10T21:09:56.289345] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-10T21:09:56.496745] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-10T21:09:56.502096] [INFO ] [REMOTE ] RC: Full fetch complete (70894 records). [2025-10-10T21:09:56.502263] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-10T21:09:56.927628] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-10-10T21:09:56.927792] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-10-10T21:09:56.929510] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-10-10T21:09:56.929584] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-10-10T21:09:56.931634] [DEBUG] [LOCAL ] RC: Trimmed 70894 records to 49637 (keeping 200 days of data) [2025-10-10T21:09:57.113528] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-10T21:09:57.162316] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-10T21:09:57.263044] [DEBUG] [LOCAL ] RC: Primary data saved (49637 records). [2025-10-10T21:09:57.263196] [INFO ] [MAIN ] RC: Full history saved. [2025-10-10T21:09:57.263279] [INFO ] [MAIN ] Update Progress: 1776/2373 symbols completed. RC took 39.5s. Estimated remaining: 1h 23m 60s. Rate: 7.1 symbols/min [2025-10-10T21:09:57.462879] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:09:57.463056] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-10T21:09:57.463095] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-10T21:09:57.463207] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-10T21:09:57.463249] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-10T21:09:57.463321] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-10T21:09:57.463407] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-10T21:09:57.863027] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:09:57.889346] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-10-10T21:09:58.689437] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-10T21:09:59.089952] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T21:09:59.486208] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-10T21:09:59.489324] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-10T21:09:59.924530] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-10T21:10:00.263284] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-10T21:10:00.289392] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-10T21:10:01.089409] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-10T21:10:01.115146] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-10T21:10:01.889404] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-10T21:10:02.416523] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-10T21:10:02.689412] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-10T21:10:03.239084] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-10T21:10:03.489460] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-10T21:10:03.503470] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-10T21:10:04.289399] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-10T21:10:05.089400] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-10T21:10:05.114910] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T21:10:05.158748] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-10T21:10:05.661500] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-10T21:10:05.889395] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-10T21:10:06.283416] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-10T21:10:06.284260] [INFO ] [REMOTE ] RCB: Full fetch complete (3726 records). [2025-10-10T21:10:06.284328] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-10T21:10:06.284737] [FATAL] [VALIDATOR ] RCB: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:10:06.284820] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:10:06.284863] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:10:06.284902] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-10T21:10:06.284963] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-10T21:10:06.284998] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-10T21:10:06.285037] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-10T21:10:06.285185] [INFO ] [MAIN ] Update Progress: 1777/2373 symbols completed. RCB took 27.7s. Estimated remaining: 1h 23m 52s. Rate: 7.1 symbols/min [2025-10-10T21:10:06.465142] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:10:06.465402] [DEBUG] [LOCAL ] RCS: No existing data file found in primary storage. [2025-10-10T21:10:06.465441] [WARN ] [MAIN ] RCS: No existing data found, performing full refresh instead. [2025-10-10T21:10:06.465565] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-10T21:10:06.465607] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-10T21:10:06.465680] [DEBUG] [LOCAL ] RCS: No primary data file found to delete. [2025-10-10T21:10:06.465735] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-10T21:10:06.694589] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-10T21:10:06.841838] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:10:07.489503] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-10T21:10:08.034421] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-10T21:10:08.035295] [INFO ] [REMOTE ] RCD: Full fetch complete (6675 records). [2025-10-10T21:10:08.035367] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-10T21:10:08.035758] [FATAL] [VALIDATOR ] RCD: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:10:08.035843] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:10:08.035887] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:10:08.035930] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-10T21:10:08.036035] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-10T21:10:08.036114] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-10-10T21:10:08.036183] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-10-10T21:10:08.036242] [INFO ] [MAIN ] Update Progress: 1778/2373 symbols completed. RCD took 29.0s. Estimated remaining: 1h 23m 41s. Rate: 7.1 symbols/min [2025-10-10T21:10:08.231279] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:10:08.231455] [DEBUG] [LOCAL ] RCUS: No existing data file found in primary storage. [2025-10-10T21:10:08.231493] [WARN ] [MAIN ] RCUS: No existing data found, performing full refresh instead. [2025-10-10T21:10:08.231617] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-10T21:10:08.231691] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-10T21:10:08.231751] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-10T21:10:08.231785] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-10T21:10:08.295748] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-10T21:10:08.596090] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:10:09.082959] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-10T21:10:09.092956] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-10-10T21:10:09.889407] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-10T21:10:10.252737] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T21:10:10.689354] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-10-10T21:10:10.908461] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-10T21:10:11.489327] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-10T21:10:11.501817] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-10T21:10:12.289402] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-10T21:10:12.496254] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-10T21:10:13.089424] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-10T21:10:13.214091] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-10T21:10:13.815828] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T21:10:13.889356] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-10T21:10:14.689411] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-10T21:10:15.489383] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-10T21:10:15.687726] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-10T21:10:15.709071] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T21:10:16.073266] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-10T21:10:16.289359] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-10T21:10:16.913572] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T21:10:17.072931] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-10T21:10:17.089347] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-10T21:10:17.889415] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-10T21:10:18.122218] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-10T21:10:18.689353] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-10T21:10:19.489371] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-10T21:10:20.216519] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-10T21:10:20.217782] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-10T21:10:20.289427] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-10T21:10:20.597262] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-10T21:10:21.089434] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-10T21:10:21.889364] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-10T21:10:22.442967] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-10T21:10:22.689355] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-10T21:10:23.020286] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T21:10:23.489459] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-10T21:10:23.813556] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T21:10:24.289443] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-10T21:10:24.637721] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-10T21:10:24.849230] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-10T21:10:25.089382] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-10T21:10:25.889472] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-10T21:10:26.257327] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T21:10:26.689427] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-10T21:10:27.489388] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-10T21:10:27.531586] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-10T21:10:27.806607] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-10T21:10:28.037759] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T21:10:28.289422] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-10T21:10:28.866389] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T21:10:29.089425] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-10T21:10:29.889367] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-10T21:10:30.208625] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T21:10:30.273420] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T21:10:30.689408] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-10T21:10:30.932756] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-10T21:10:31.489454] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-10T21:10:32.289386] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-10T21:10:32.586183] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T21:10:32.621593] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-10T21:10:32.839454] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-10T21:10:32.843850] [INFO ] [REMOTE ] RCL: Full fetch complete (74952 records). [2025-10-10T21:10:32.843980] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-10T21:10:32.844877] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:10:32.844981] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:10:32.845058] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:10:32.845150] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-10T21:10:32.845232] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-10T21:10:32.845272] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-10T21:10:32.845311] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-10T21:10:32.845369] [INFO ] [MAIN ] Update Progress: 1779/2373 symbols completed. RCL took 35.6s. Estimated remaining: 1h 23m 38s. Rate: 7.1 symbols/min [2025-10-10T21:10:33.011348] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:10:33.011510] [DEBUG] [LOCAL ] RDDT: No existing data file found in primary storage. [2025-10-10T21:10:33.011546] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-10-10T21:10:33.011688] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-10T21:10:33.011752] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-10T21:10:33.011809] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-10T21:10:33.011856] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-10T21:10:33.094471] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-10T21:10:33.364518] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:10:33.889388] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-10-10T21:10:34.689384] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-10T21:10:35.045778] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-10T21:10:35.489397] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-10T21:10:35.707037] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-10T21:10:36.289427] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-10T21:10:36.766070] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-10-10T21:10:37.089423] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-10T21:10:37.150904] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-10T21:10:37.357533] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-10T21:10:37.359834] [INFO ] [REMOTE ] RCS: Full fetch complete (19140 records). [2025-10-10T21:10:37.359903] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-10T21:10:37.721106] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-10T21:10:37.721202] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-10T21:10:37.721632] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-10T21:10:37.721709] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-10T21:10:37.722219] [DEBUG] [LOCAL ] RCS: Trimmed 19140 records to 12263 (keeping 200 days of data) [2025-10-10T21:10:37.794365] [DEBUG] [LOCAL ] RCS: Primary data saved (12263 records). [2025-10-10T21:10:37.794496] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-10T21:10:37.794578] [INFO ] [MAIN ] Update Progress: 1780/2373 symbols completed. RCS took 31.5s. Estimated remaining: 1h 23m 28s. Rate: 7.1 symbols/min [2025-10-10T21:10:37.890026] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-10T21:10:37.960842] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:10:37.960991] [DEBUG] [LOCAL ] RDN: No existing data file found in primary storage. [2025-10-10T21:10:37.961028] [WARN ] [MAIN ] RDN: No existing data found, performing full refresh instead. [2025-10-10T21:10:37.961137] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-10T21:10:37.961178] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-10T21:10:37.961219] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-10T21:10:37.961251] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-10T21:10:38.087284] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T21:10:38.133287] [INFO ] [REMOTE ] RCI: Full fetch complete (70100 records). [2025-10-10T21:10:38.149088] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-10T21:10:38.221273] [FATAL] [VALIDATOR ] RCI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:10:38.242386] [FATAL] [MAIN ] RCI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:10:38.250206] [WARN ] [MAIN ] RCI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:10:38.252397] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-10T21:10:38.252467] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-10T21:10:38.252813] [INFO ] [LOCAL ] RCI: Starting deletion of derivative data. [2025-10-10T21:10:38.258204] [DEBUG] [LOCAL ] RCI: No derivative data file found to delete. [2025-10-10T21:10:38.258297] [INFO ] [MAIN ] Update Progress: 1781/2373 symbols completed. RCI took 52.3s. Estimated remaining: 1h 23m 17s. Rate: 7.1 symbols/min [2025-10-10T21:10:38.444202] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:10:38.516505] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:10:38.516755] [DEBUG] [LOCAL ] RDW: No existing data file found in primary storage. [2025-10-10T21:10:38.516804] [WARN ] [MAIN ] RDW: No existing data found, performing full refresh instead. [2025-10-10T21:10:38.516920] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-10T21:10:38.517007] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-10T21:10:38.517064] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-10T21:10:38.517099] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-10T21:10:38.698210] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-10T21:10:38.880050] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:10:39.489371] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-10-10T21:10:39.747530] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T21:10:40.289400] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-10T21:10:41.089415] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-10-10T21:10:41.131057] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T21:10:41.135528] [INFO ] [REMOTE ] RCUS: Full fetch complete (59885 records). [2025-10-10T21:10:41.135757] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-10T21:10:41.136690] [FATAL] [VALIDATOR ] RCUS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:10:41.136797] [FATAL] [MAIN ] RCUS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:10:41.136886] [WARN ] [MAIN ] RCUS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:10:41.137003] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-10T21:10:41.137109] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-10T21:10:41.137183] [INFO ] [LOCAL ] RCUS: Starting deletion of derivative data. [2025-10-10T21:10:41.137272] [DEBUG] [LOCAL ] RCUS: No derivative data file found to delete. [2025-10-10T21:10:41.137382] [INFO ] [MAIN ] Update Progress: 1782/2373 symbols completed. RCUS took 33.1s. Estimated remaining: 1h 23m 7s. Rate: 7.1 symbols/min [2025-10-10T21:10:41.319890] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:10:41.320389] [DEBUG] [LOCAL ] RDY: No existing data file found in primary storage. [2025-10-10T21:10:41.320626] [WARN ] [MAIN ] RDY: No existing data found, performing full refresh instead. [2025-10-10T21:10:41.320921] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-10T21:10:41.321406] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-10T21:10:41.321702] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-10T21:10:41.321842] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-10T21:10:41.572617] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-10-10T21:10:41.631517] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-10T21:10:41.773470] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:10:41.889383] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-10-10T21:10:42.387374] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-10T21:10:42.689381] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-10T21:10:43.489372] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-10T21:10:43.788573] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T21:10:44.289373] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-10T21:10:44.627781] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T21:10:45.089385] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-10T21:10:45.889393] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-10T21:10:46.114281] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-10T21:10:46.197409] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T21:10:46.460484] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T21:10:46.689369] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-10T21:10:47.489449] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-10T21:10:48.163213] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-10T21:10:48.289362] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-10T21:10:48.769913] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T21:10:49.089393] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-10T21:10:49.889478] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-10T21:10:50.106009] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T21:10:50.382457] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-10-10T21:10:50.689395] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-10T21:10:51.482742] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-10T21:10:51.492910] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-10T21:10:51.522334] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-10T21:10:52.065524] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-10T21:10:52.289434] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-10T21:10:53.089484] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-10T21:10:53.893861] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-10T21:10:53.903147] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-10T21:10:54.690558] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-10T21:10:54.693357] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-10T21:10:54.977480] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-10T21:10:55.489390] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-10T21:10:55.951994] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-10T21:10:56.289408] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-10T21:10:57.089394] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-10T21:10:57.278625] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-10T21:10:57.671386] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-10T21:10:57.776409] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-10T21:10:57.889346] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-10T21:10:58.689355] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-10T21:10:58.992321] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T21:10:59.489398] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-10T21:11:00.224988] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-10T21:11:00.289381] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-10T21:11:00.588257] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T21:11:01.089371] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-10T21:11:01.651528] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-10T21:11:01.889420] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-10T21:11:02.292568] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-10T21:11:02.689475] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-10T21:11:03.489378] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-10T21:11:03.715684] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-10T21:11:03.878570] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-10-10T21:11:04.289383] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-10T21:11:05.049549] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-10T21:11:05.089337] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-10T21:11:05.543313] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-10T21:11:05.889377] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-10T21:11:06.689348] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-10T21:11:06.934673] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-10T21:11:07.006541] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T21:11:07.489419] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-10T21:11:08.135676] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-10T21:11:08.289351] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-10T21:11:08.795988] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-10T21:11:09.089424] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-10T21:11:09.871392] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-10T21:11:09.889333] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-10T21:11:09.986908] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T21:11:09.990747] [INFO ] [REMOTE ] RDN: Full fetch complete (65621 records). [2025-10-10T21:11:09.990876] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-10T21:11:09.991631] [FATAL] [VALIDATOR ] RDN: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:11:09.991741] [FATAL] [MAIN ] RDN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:11:09.991784] [WARN ] [MAIN ] RDN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:11:09.991823] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-10T21:11:09.991880] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-10T21:11:09.991915] [INFO ] [LOCAL ] RDN: Starting deletion of derivative data. [2025-10-10T21:11:09.991952] [DEBUG] [LOCAL ] RDN: No derivative data file found to delete. [2025-10-10T21:11:09.992006] [INFO ] [MAIN ] Update Progress: 1783/2373 symbols completed. RDN took 32.2s. Estimated remaining: 1h 23m 5s. Rate: 7.1 symbols/min [2025-10-10T21:11:10.160734] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:11:10.160902] [DEBUG] [LOCAL ] RELX: No existing data file found in primary storage. [2025-10-10T21:11:10.160940] [WARN ] [MAIN ] RELX: No existing data found, performing full refresh instead. [2025-10-10T21:11:10.161048] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-10T21:11:10.161102] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-10T21:11:10.161144] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-10T21:11:10.161177] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-10T21:11:10.503927] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:11:10.689350] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-10T21:11:10.964530] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-10T21:11:11.489382] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-10T21:11:12.289430] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-10-10T21:11:12.431412] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T21:11:12.436517] [INFO ] [REMOTE ] RDW: Full fetch complete (74839 records). [2025-10-10T21:11:12.436671] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-10T21:11:12.437370] [FATAL] [VALIDATOR ] RDW: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:11:12.437455] [FATAL] [MAIN ] RDW: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:11:12.437499] [WARN ] [MAIN ] RDW: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:11:12.437565] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-10T21:11:12.437671] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-10T21:11:12.437728] [INFO ] [LOCAL ] RDW: Starting deletion of derivative data. [2025-10-10T21:11:12.437771] [DEBUG] [LOCAL ] RDW: No derivative data file found to delete. [2025-10-10T21:11:12.437829] [INFO ] [MAIN ] Update Progress: 1784/2373 symbols completed. RDW took 34.2s. Estimated remaining: 1h 22m 55s. Rate: 7.1 symbols/min [2025-10-10T21:11:12.651874] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:11:12.663204] [DEBUG] [LOCAL ] RERE: No existing data file found in primary storage. [2025-10-10T21:11:12.664938] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T21:11:12.663892] [WARN ] [MAIN ] RERE: No existing data found, performing full refresh instead. [2025-10-10T21:11:12.674105] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-10T21:11:12.674913] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-10T21:11:12.675002] [DEBUG] [LOCAL ] RERE: No primary data file found to delete. [2025-10-10T21:11:12.675445] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-10T21:11:13.093742] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-10T21:11:13.115920] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:11:13.151813] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (3.26 seconds). [2025-10-10T21:11:13.889351] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-10-10T21:11:14.008391] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T21:11:14.012507] [INFO ] [REMOTE ] RDY: Full fetch complete (68453 records). [2025-10-10T21:11:14.012629] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-10T21:11:14.013323] [FATAL] [VALIDATOR ] RDY: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:11:14.013420] [FATAL] [MAIN ] RDY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:11:14.013463] [WARN ] [MAIN ] RDY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:11:14.013506] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-10T21:11:14.013588] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-10T21:11:14.013682] [INFO ] [LOCAL ] RDY: Starting deletion of derivative data. [2025-10-10T21:11:14.013756] [DEBUG] [LOCAL ] RDY: No derivative data file found to delete. [2025-10-10T21:11:14.013818] [INFO ] [MAIN ] Update Progress: 1785/2373 symbols completed. RDY took 32.9s. Estimated remaining: 1h 22m 44s. Rate: 7.1 symbols/min [2025-10-10T21:11:14.273365] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T21:11:14.278211] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:11:14.287344] [DEBUG] [LOCAL ] RES: No existing data file found in primary storage. [2025-10-10T21:11:14.287425] [WARN ] [MAIN ] RES: No existing data found, performing full refresh instead. [2025-10-10T21:11:14.287559] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-10T21:11:14.287601] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-10T21:11:14.287669] [DEBUG] [LOCAL ] RES: No primary data file found to delete. [2025-10-10T21:11:14.287725] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-10T21:11:14.663664] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:11:14.689330] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-10-10T21:11:15.489381] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-10T21:11:15.525847] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-10T21:11:16.136749] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-10T21:11:16.289358] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-10T21:11:16.397852] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T21:11:16.402605] [INFO ] [REMOTE ] RDDT: Full fetch complete (77498 records). [2025-10-10T21:11:16.402817] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-10T21:11:16.403750] [FATAL] [VALIDATOR ] RDDT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:11:16.403862] [FATAL] [MAIN ] RDDT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:11:16.403906] [WARN ] [MAIN ] RDDT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:11:16.403977] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-10T21:11:16.404042] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-10T21:11:16.404078] [INFO ] [LOCAL ] RDDT: Starting deletion of derivative data. [2025-10-10T21:11:16.404122] [DEBUG] [LOCAL ] RDDT: No derivative data file found to delete. [2025-10-10T21:11:16.404182] [INFO ] [MAIN ] Update Progress: 1786/2373 symbols completed. RDDT took 43.6s. Estimated remaining: 1h 22m 34s. Rate: 7.1 symbols/min [2025-10-10T21:11:16.583030] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:11:16.583232] [DEBUG] [LOCAL ] REVG: No existing data file found in primary storage. [2025-10-10T21:11:16.583272] [WARN ] [MAIN ] REVG: No existing data found, performing full refresh instead. [2025-10-10T21:11:16.583388] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-10T21:11:16.583430] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-10T21:11:16.583472] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-10T21:11:16.583507] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-10T21:11:16.945059] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:11:17.089368] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-10-10T21:11:17.889405] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-10T21:11:18.299732] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-10T21:11:18.689459] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-10T21:11:18.902604] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T21:11:19.488636] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-10T21:11:19.495697] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-10T21:11:20.289402] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-10T21:11:20.490514] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T21:11:21.089350] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-10T21:11:21.278467] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-10T21:11:21.889376] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-10T21:11:21.912802] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T21:11:22.689345] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-10T21:11:23.039697] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T21:11:23.489391] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-10T21:11:23.552621] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-10T21:11:23.981956] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T21:11:24.289372] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-10T21:11:25.089384] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-10T21:11:25.505907] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T21:11:25.889387] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-10T21:11:26.179326] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T21:11:26.689398] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-10T21:11:26.812878] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-10T21:11:27.421377] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-10T21:11:27.489354] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-10T21:11:28.289445] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-10T21:11:28.570808] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-10T21:11:29.089397] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-10T21:11:29.473781] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-10T21:11:29.889392] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-10T21:11:29.963253] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-10T21:11:30.689382] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-10T21:11:30.951222] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T21:11:31.433225] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-10T21:11:31.489409] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-10T21:11:32.289363] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-10T21:11:32.326830] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T21:11:32.636270] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-10T21:11:33.089385] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-10T21:11:33.895026] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-10T21:11:33.899182] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-10T21:11:34.689367] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-10T21:11:35.141344] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T21:11:35.489385] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-10T21:11:35.850545] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T21:11:36.289394] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-10T21:11:36.554756] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T21:11:37.089357] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-10T21:11:37.173727] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-10T21:11:37.889390] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-10T21:11:38.065026] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T21:11:38.689343] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-10T21:11:39.139585] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-10T21:11:39.489403] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-10T21:11:39.625134] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-10T21:11:40.276011] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-10T21:11:40.289321] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-10T21:11:41.089373] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-10T21:11:41.492922] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-10T21:11:41.889342] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-10T21:11:42.235112] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T21:11:42.342222] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-10T21:11:42.689366] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-10T21:11:43.270085] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T21:11:43.489373] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-10T21:11:44.289398] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-10T21:11:44.509748] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T21:11:45.089394] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-10T21:11:45.276909] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-10T21:11:45.281145] [INFO ] [REMOTE ] RES: Full fetch complete (68602 records). [2025-10-10T21:11:45.281271] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-10T21:11:45.590442] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-10T21:11:45.623308] [INFO ] [REMOTE ] RERE: Full fetch complete (57559 records). [2025-10-10T21:11:45.656702] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-10T21:11:45.783287] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-10-10T21:11:45.788549] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-10-10T21:11:45.811288] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-10-10T21:11:45.811475] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-10-10T21:11:45.869507] [DEBUG] [LOCAL ] RES: Trimmed 68602 records to 47720 (keeping 200 days of data) [2025-10-10T21:11:45.890275] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-10T21:11:46.193708] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-10T21:11:46.194111] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-10T21:11:46.197329] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-10T21:11:46.197683] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-10T21:11:46.202733] [DEBUG] [LOCAL ] RERE: Trimmed 57559 records to 41850 (keeping 200 days of data) [2025-10-10T21:11:46.562064] [DEBUG] [LOCAL ] RERE: Primary data saved (41850 records). [2025-10-10T21:11:46.562797] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-10T21:11:46.563331] [INFO ] [MAIN ] Update Progress: 1787/2373 symbols completed. RERE took 34.1s. Estimated remaining: 1h 22m 32s. Rate: 7.1 symbols/min [2025-10-10T21:11:46.752575] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:11:46.753997] [DEBUG] [LOCAL ] REX: No existing data file found in primary storage. [2025-10-10T21:11:46.755661] [WARN ] [MAIN ] REX: No existing data found, performing full refresh instead. [2025-10-10T21:11:46.756838] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-10T21:11:46.757001] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-10T21:11:46.760812] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-10T21:11:46.760883] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-10T21:11:46.936866] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T21:11:46.986843] [DEBUG] [LOCAL ] RES: Primary data saved (47720 records). [2025-10-10T21:11:47.016735] [INFO ] [MAIN ] RES: Full history saved. [2025-10-10T21:11:47.016502] [INFO ] [REMOTE ] REVG: Full fetch complete (57708 records). [2025-10-10T21:11:47.034945] [INFO ] [MAIN ] Update Progress: 1788/2373 symbols completed. RES took 33.0s. Estimated remaining: 1h 22m 21s. Rate: 7.1 symbols/min [2025-10-10T21:11:47.050620] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-10T21:11:47.124143] [FATAL] [VALIDATOR ] REVG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:11:47.139876] [FATAL] [MAIN ] REVG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:11:47.269234] [WARN ] [MAIN ] REVG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:11:47.283864] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-10T21:11:47.310970] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-10T21:11:47.320192] [INFO ] [LOCAL ] REVG: Starting deletion of derivative data. [2025-10-10T21:11:47.320038] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:11:47.325948] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-10-10T21:11:47.320447] [DEBUG] [LOCAL ] REVG: No derivative data file found to delete. [2025-10-10T21:11:47.338447] [INFO ] [MAIN ] Update Progress: 1789/2373 symbols completed. REVG took 30.9s. Estimated remaining: 1h 22m 10s. Rate: 7.1 symbols/min [2025-10-10T21:11:47.444118] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:11:47.487595] [DEBUG] [LOCAL ] REXR: No existing data file found in primary storage. [2025-10-10T21:11:47.488039] [WARN ] [MAIN ] REXR: No existing data found, performing full refresh instead. [2025-10-10T21:11:47.490420] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-10T21:11:47.505602] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-10T21:11:47.523508] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-10T21:11:47.540080] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-10T21:11:47.540211] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-10T21:11:47.539936] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-10T21:11:47.726788] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:11:47.737219] [DEBUG] [LOCAL ] REZI: No existing data file found in primary storage. [2025-10-10T21:11:47.742374] [WARN ] [MAIN ] REZI: No existing data found, performing full refresh instead. [2025-10-10T21:11:47.759920] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-10T21:11:47.778734] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-10T21:11:47.780100] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-10T21:11:47.841520] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-10T21:11:48.238665] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:11:48.294474] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-10-10T21:11:48.400559] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:11:48.683099] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T21:11:49.089398] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-10T21:11:49.734738] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-10T21:11:49.889355] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-10-10T21:11:50.427225] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-10T21:11:50.495472] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-10T21:11:50.689392] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-10T21:11:51.210459] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T21:11:51.489364] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-10T21:11:52.289420] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-10T21:11:52.590827] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T21:11:53.089351] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-10T21:11:53.221518] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T21:11:53.889388] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-10T21:11:53.945055] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T21:11:53.969502] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-10T21:11:54.689432] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-10T21:11:55.489373] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-10T21:11:55.582242] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-10T21:11:55.587106] [INFO ] [REMOTE ] RELX: Full fetch complete (67410 records). [2025-10-10T21:11:55.587231] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-10T21:11:55.588302] [FATAL] [VALIDATOR ] RELX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:11:55.588396] [FATAL] [MAIN ] RELX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:11:55.588439] [WARN ] [MAIN ] RELX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:11:55.588509] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-10T21:11:55.588594] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-10T21:11:55.588678] [INFO ] [LOCAL ] RELX: Starting deletion of derivative data. [2025-10-10T21:11:55.588743] [DEBUG] [LOCAL ] RELX: No derivative data file found to delete. [2025-10-10T21:11:55.588813] [INFO ] [MAIN ] Update Progress: 1790/2373 symbols completed. RELX took 45.6s. Estimated remaining: 1h 22m 2s. Rate: 7.1 symbols/min [2025-10-10T21:11:55.773098] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:11:55.773332] [DEBUG] [LOCAL ] RF: No existing data file found in primary storage. [2025-10-10T21:11:55.773450] [WARN ] [MAIN ] RF: No existing data found, performing full refresh instead. [2025-10-10T21:11:55.773706] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-10T21:11:55.773890] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-10T21:11:55.774046] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-10T21:11:55.774099] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-10T21:11:56.066597] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-10T21:11:56.173729] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:11:56.289399] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-10-10T21:11:57.089383] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-10T21:11:57.345973] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T21:11:57.889384] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-10T21:11:58.347721] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-10T21:11:58.659318] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-10T21:11:58.689326] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-10T21:11:59.169148] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T21:11:59.461995] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-10T21:11:59.489455] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-10T21:12:00.289445] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-10T21:12:01.089348] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-10T21:12:01.424921] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-10T21:12:01.774195] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-10T21:12:01.889370] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-10T21:12:02.689365] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-10T21:12:02.952498] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-10T21:12:03.316012] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-10T21:12:03.489416] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-10T21:12:04.289357] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-10T21:12:04.701285] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-10T21:12:05.020238] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-10T21:12:05.089340] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-10T21:12:05.292226] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-10T21:12:05.889376] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-10T21:12:06.689390] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-10T21:12:06.981472] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T21:12:07.489357] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-10T21:12:07.777418] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-10T21:12:07.922489] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T21:12:08.289442] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-10T21:12:09.089372] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-10T21:12:09.360694] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T21:12:09.899239] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-10T21:12:09.904955] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-10T21:12:10.689368] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-10T21:12:11.159736] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T21:12:11.489449] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-10T21:12:11.858624] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T21:12:12.023612] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T21:12:12.289383] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-10T21:12:13.089347] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-10T21:12:13.755564] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-10T21:12:13.889327] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-10T21:12:13.902200] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T21:12:13.904732] [INFO ] [REMOTE ] REX: Full fetch complete (20842 records). [2025-10-10T21:12:13.904808] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-10T21:12:13.905445] [FATAL] [VALIDATOR ] REX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:12:13.905560] [FATAL] [MAIN ] REX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:12:13.905627] [WARN ] [MAIN ] REX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:12:13.905719] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-10T21:12:13.905796] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-10T21:12:13.905834] [INFO ] [LOCAL ] REX: Starting deletion of derivative data. [2025-10-10T21:12:13.905873] [DEBUG] [LOCAL ] REX: No derivative data file found to delete. [2025-10-10T21:12:13.905941] [INFO ] [MAIN ] Update Progress: 1791/2373 symbols completed. REX took 27.3s. Estimated remaining: 1h 21m 57s. Rate: 7.1 symbols/min [2025-10-10T21:12:14.075282] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:12:14.075496] [DEBUG] [LOCAL ] RFI: No existing data file found in primary storage. [2025-10-10T21:12:14.075539] [WARN ] [MAIN ] RFI: No existing data found, performing full refresh instead. [2025-10-10T21:12:14.075676] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-10T21:12:14.075731] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-10T21:12:14.075776] [DEBUG] [LOCAL ] RFI: No primary data file found to delete. [2025-10-10T21:12:14.075833] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-10T21:12:14.398399] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-10T21:12:14.492569] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:12:14.689374] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-10T21:12:15.489397] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-10T21:12:16.248833] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-10T21:12:16.289332] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-10T21:12:16.383138] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T21:12:17.089350] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-10-10T21:12:17.225042] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T21:12:17.758607] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-10T21:12:17.889385] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-10T21:12:18.013172] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T21:12:18.689395] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-10T21:12:19.489420] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-10T21:12:19.645005] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-10T21:12:20.289336] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-10T21:12:20.593215] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-10T21:12:20.975365] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-10T21:12:21.089353] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-10T21:12:21.889394] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-10T21:12:22.381522] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-10T21:12:22.689404] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-10T21:12:23.238168] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-10T21:12:23.489361] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-10T21:12:23.531989] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-10T21:12:23.722469] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-10T21:12:24.289384] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-10T21:12:24.568224] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T21:12:24.572733] [INFO ] [REMOTE ] REXR: Full fetch complete (74768 records). [2025-10-10T21:12:24.572864] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-10T21:12:24.573523] [FATAL] [VALIDATOR ] REXR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:12:24.573609] [FATAL] [MAIN ] REXR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:12:24.573685] [WARN ] [MAIN ] REXR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:12:24.573758] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-10T21:12:24.573852] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-10T21:12:24.573901] [INFO ] [LOCAL ] REXR: Starting deletion of derivative data. [2025-10-10T21:12:24.573956] [DEBUG] [LOCAL ] REXR: No derivative data file found to delete. [2025-10-10T21:12:24.574033] [INFO ] [MAIN ] Update Progress: 1792/2373 symbols completed. REXR took 37.5s. Estimated remaining: 1h 21m 49s. Rate: 7.1 symbols/min [2025-10-10T21:12:24.755106] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:12:24.755280] [DEBUG] [LOCAL ] RFL: No existing data file found in primary storage. [2025-10-10T21:12:24.755318] [WARN ] [MAIN ] RFL: No existing data found, performing full refresh instead. [2025-10-10T21:12:24.755428] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-10T21:12:24.755483] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-10T21:12:24.755564] [DEBUG] [LOCAL ] RFL: No primary data file found to delete. [2025-10-10T21:12:24.755610] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-10T21:12:25.096356] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-10T21:12:25.139043] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:12:25.205076] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T21:12:25.209769] [INFO ] [REMOTE ] RF: Full fetch complete (77237 records). [2025-10-10T21:12:25.209908] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-10T21:12:25.210562] [FATAL] [VALIDATOR ] RF: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:12:25.210684] [FATAL] [MAIN ] RF: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:12:25.210738] [WARN ] [MAIN ] RF: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:12:25.210805] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-10T21:12:25.210869] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-10T21:12:25.210905] [INFO ] [LOCAL ] RF: Starting deletion of derivative data. [2025-10-10T21:12:25.210944] [DEBUG] [LOCAL ] RF: No derivative data file found to delete. [2025-10-10T21:12:25.211013] [INFO ] [MAIN ] Update Progress: 1793/2373 symbols completed. RF took 29.6s. Estimated remaining: 1h 21m 38s. Rate: 7.1 symbols/min [2025-10-10T21:12:25.378815] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:12:25.379023] [DEBUG] [LOCAL ] RFM: No existing data file found in primary storage. [2025-10-10T21:12:25.379075] [WARN ] [MAIN ] RFM: No existing data found, performing full refresh instead. [2025-10-10T21:12:25.379191] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-10T21:12:25.379235] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-10T21:12:25.379278] [DEBUG] [LOCAL ] RFM: No primary data file found to delete. [2025-10-10T21:12:25.379310] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-10T21:12:25.737499] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:12:25.889344] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-10-10T21:12:26.249925] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T21:12:26.689420] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-10T21:12:26.753991] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-10T21:12:27.470998] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-10T21:12:27.489331] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-10T21:12:28.289378] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-10T21:12:28.512278] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-10T21:12:29.089411] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-10T21:12:29.889427] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-10-10T21:12:30.085542] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-10T21:12:30.284190] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-10T21:12:30.689480] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-10T21:12:30.705724] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-10T21:12:31.455970] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-10T21:12:31.489342] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-10T21:12:32.187489] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T21:12:32.289423] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-10T21:12:33.083417] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-10T21:12:33.089341] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-10T21:12:33.889402] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-10T21:12:33.897614] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-10T21:12:34.689390] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-10T21:12:34.957337] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-10T21:12:35.171151] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-10T21:12:35.175637] [INFO ] [REMOTE ] REZI: Full fetch complete (65623 records). [2025-10-10T21:12:35.175854] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-10T21:12:35.176909] [FATAL] [VALIDATOR ] REZI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:12:35.177051] [FATAL] [MAIN ] REZI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:12:35.177095] [WARN ] [MAIN ] REZI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:12:35.177167] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-10T21:12:35.177277] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-10T21:12:35.177365] [INFO ] [LOCAL ] REZI: Starting deletion of derivative data. [2025-10-10T21:12:35.177459] [DEBUG] [LOCAL ] REZI: No derivative data file found to delete. [2025-10-10T21:12:35.177537] [INFO ] [MAIN ] Update Progress: 1794/2373 symbols completed. REZI took 47.8s. Estimated remaining: 1h 21m 30s. Rate: 7.1 symbols/min [2025-10-10T21:12:35.350707] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:12:35.350937] [DEBUG] [LOCAL ] RFMZ: No existing data file found in primary storage. [2025-10-10T21:12:35.350975] [WARN ] [MAIN ] RFMZ: No existing data found, performing full refresh instead. [2025-10-10T21:12:35.351095] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-10T21:12:35.351136] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-10T21:12:35.351178] [DEBUG] [LOCAL ] RFMZ: No primary data file found to delete. [2025-10-10T21:12:35.351211] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-10T21:12:35.494560] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-10T21:12:35.747451] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:12:36.289437] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-10-10T21:12:36.420510] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-10T21:12:37.089404] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-10T21:12:37.279016] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-10T21:12:37.868227] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-10T21:12:37.889386] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-10T21:12:38.645818] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-10T21:12:38.689364] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-10T21:12:39.489391] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-10T21:12:39.773358] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T21:12:40.031924] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-10T21:12:40.289411] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-10T21:12:41.089375] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-10T21:12:41.135928] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-10T21:12:41.883328] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-10T21:12:41.889341] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-10T21:12:42.644104] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-10T21:12:42.689373] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-10T21:12:43.476887] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-10T21:12:43.489388] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-10T21:12:44.289395] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-10T21:12:44.352043] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-10T21:12:45.089405] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-10T21:12:45.303351] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-10T21:12:45.889410] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-10T21:12:46.180266] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-10T21:12:46.689361] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-10T21:12:46.778110] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-10T21:12:46.779709] [INFO ] [REMOTE ] RFI: Full fetch complete (15534 records). [2025-10-10T21:12:46.779781] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-10T21:12:47.149079] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-10T21:12:47.149163] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-10T21:12:47.149562] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-10T21:12:47.149603] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-10T21:12:47.150101] [DEBUG] [LOCAL ] RFI: Trimmed 15534 records to 10606 (keeping 200 days of data) [2025-10-10T21:12:47.216627] [DEBUG] [LOCAL ] RFI: Primary data saved (10606 records). [2025-10-10T21:12:47.216790] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-10T21:12:47.216871] [INFO ] [MAIN ] Update Progress: 1795/2373 symbols completed. RFI took 33.3s. Estimated remaining: 1h 21m 23s. Rate: 7.1 symbols/min [2025-10-10T21:12:47.383533] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:12:47.383720] [DEBUG] [LOCAL ] RGA: No existing data file found in primary storage. [2025-10-10T21:12:47.383769] [WARN ] [MAIN ] RGA: No existing data found, performing full refresh instead. [2025-10-10T21:12:47.383879] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-10T21:12:47.383920] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-10T21:12:47.383960] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-10T21:12:47.383992] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-10T21:12:47.494595] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-10T21:12:47.555899] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-10T21:12:47.757856] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:12:48.289385] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-10-10T21:12:48.570542] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-10T21:12:49.089385] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-10T21:12:49.889406] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-10T21:12:49.920952] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-10T21:12:49.951685] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-10T21:12:50.689391] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-10T21:12:51.240829] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-10T21:12:51.489406] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-10T21:12:52.289439] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-10T21:12:52.645322] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T21:12:52.673553] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-10T21:12:53.089346] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-10T21:12:53.296872] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-10T21:12:53.889364] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-10T21:12:54.105885] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-10T21:12:54.572769] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-10T21:12:54.573910] [INFO ] [REMOTE ] RFM: Full fetch complete (5870 records). [2025-10-10T21:12:54.573984] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-10T21:12:54.694515] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-10T21:12:54.958686] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-10T21:12:54.958790] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-10T21:12:54.959039] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-10T21:12:54.959079] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-10T21:12:54.959467] [DEBUG] [LOCAL ] RFM: Trimmed 5870 records to 4203 (keeping 200 days of data) [2025-10-10T21:12:54.986340] [DEBUG] [LOCAL ] RFM: Primary data saved (4203 records). [2025-10-10T21:12:54.986441] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-10T21:12:54.986514] [INFO ] [MAIN ] Update Progress: 1796/2373 symbols completed. RFM took 29.8s. Estimated remaining: 1h 21m 14s. Rate: 7.1 symbols/min [2025-10-10T21:12:55.161176] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:12:55.161375] [DEBUG] [LOCAL ] RGR: No existing data file found in primary storage. [2025-10-10T21:12:55.161413] [WARN ] [MAIN ] RGR: No existing data found, performing full refresh instead. [2025-10-10T21:12:55.161526] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-10T21:12:55.161567] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-10T21:12:55.161608] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-10T21:12:55.161666] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-10T21:12:55.494517] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-10T21:12:55.533340] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:12:55.838683] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-10T21:12:56.289355] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-10T21:12:56.726405] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-10T21:12:57.089396] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-10T21:12:57.889439] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-10T21:12:58.080794] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T21:12:58.120397] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-10T21:12:58.689388] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-10T21:12:58.874172] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T21:12:58.875452] [INFO ] [REMOTE ] RFL: Full fetch complete (13134 records). [2025-10-10T21:12:58.875521] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-10T21:12:59.232833] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-10T21:12:59.232915] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-10T21:12:59.233290] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-10T21:12:59.233330] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-10T21:12:59.233993] [DEBUG] [LOCAL ] RFL: Trimmed 13134 records to 11446 (keeping 200 days of data) [2025-10-10T21:12:59.298246] [DEBUG] [LOCAL ] RFL: Primary data saved (11446 records). [2025-10-10T21:12:59.298395] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-10T21:12:59.298505] [INFO ] [MAIN ] Update Progress: 1797/2373 symbols completed. RFL took 34.7s. Estimated remaining: 1h 21m 4s. Rate: 7.1 symbols/min [2025-10-10T21:12:59.489430] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-10-10T21:12:59.610403] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-10T21:13:00.289382] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-10T21:13:01.055685] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-10T21:13:01.089379] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-10T21:13:01.337347] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-10T21:13:01.889374] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-10T21:13:02.479256] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-10T21:13:02.689371] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-10T21:13:03.263514] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-10T21:13:03.489376] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-10T21:13:03.700708] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-10T21:13:04.289442] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-10T21:13:04.449560] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T21:13:05.030952] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T21:13:05.032611] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12374 records). [2025-10-10T21:13:05.032745] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-10T21:13:05.101789] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-10T21:13:05.412698] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-10T21:13:05.412812] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-10T21:13:05.413140] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-10T21:13:05.413184] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-10T21:13:05.413945] [DEBUG] [LOCAL ] RFMZ: Trimmed 12374 records to 8849 (keeping 200 days of data) [2025-10-10T21:13:05.470402] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8849 records). [2025-10-10T21:13:05.470555] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-10T21:13:05.470630] [INFO ] [MAIN ] Update Progress: 1798/2373 symbols completed. RFMZ took 30.3s. Estimated remaining: 1h 20m 55s. Rate: 7.1 symbols/min [2025-10-10T21:13:05.889361] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-10T21:13:06.762000] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T21:13:06.773342] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-10T21:13:06.785207] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-10T21:13:07.489386] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-10T21:13:08.454333] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T21:13:08.462130] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-10T21:13:08.734025] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-10T21:13:09.089381] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-10T21:13:09.904689] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-10T21:13:09.911275] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-10T21:13:10.546098] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-10T21:13:10.689405] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-10T21:13:11.569797] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T21:13:11.578207] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-10T21:13:11.593484] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T21:13:12.289430] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-10T21:13:13.264753] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T21:13:13.272867] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-10T21:13:13.631751] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-10T21:13:13.889376] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-10T21:13:14.859896] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-10T21:13:14.866882] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-10T21:13:15.276885] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-10T21:13:15.489485] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-10T21:13:15.822564] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T21:13:15.825556] [INFO ] [REMOTE ] RGA: Full fetch complete (45010 records). [2025-10-10T21:13:15.825669] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-10T21:13:15.826258] [FATAL] [VALIDATOR ] RGA: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:13:15.826342] [FATAL] [MAIN ] RGA: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:13:15.826384] [WARN ] [MAIN ] RGA: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:13:15.826422] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-10T21:13:15.826474] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-10T21:13:15.826510] [INFO ] [LOCAL ] RGA: Starting deletion of derivative data. [2025-10-10T21:13:15.826549] [DEBUG] [LOCAL ] RGA: No derivative data file found to delete. [2025-10-10T21:13:15.826628] [INFO ] [MAIN ] Update Progress: 1799/2373 symbols completed. RGA took 28.6s. Estimated remaining: 1h 20m 47s. Rate: 7.1 symbols/min [2025-10-10T21:13:17.013209] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T21:13:17.018788] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-10T21:13:17.742322] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-10T21:13:17.744404] [INFO ] [REMOTE ] RGR: Full fetch complete (28710 records). [2025-10-10T21:13:17.744475] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-10T21:13:17.745032] [FATAL] [VALIDATOR ] RGR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:13:17.745115] [FATAL] [MAIN ] RGR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:13:17.745158] [WARN ] [MAIN ] RGR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:13:17.745196] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-10T21:13:17.745249] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-10T21:13:17.745284] [INFO ] [LOCAL ] RGR: Starting deletion of derivative data. [2025-10-10T21:13:17.745324] [DEBUG] [LOCAL ] RGR: No derivative data file found to delete. [2025-10-10T21:13:17.745398] [INFO ] [MAIN ] Update Progress: 1800/2373 symbols completed. RGR took 22.8s. Estimated remaining: 1h 20m 37s. Rate: 7.1 symbols/min [2025-10-10T21:13:18.247483] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:13:18.313791] [DEBUG] [LOCAL ] RGT: No existing data file found in primary storage. [2025-10-10T21:13:18.403210] [WARN ] [MAIN ] RGT: No existing data found, performing full refresh instead. [2025-10-10T21:13:18.423168] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-10T21:13:18.361082] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:13:18.463495] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-10T21:13:18.463368] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:13:18.464384] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-10T21:13:18.480728] [DEBUG] [LOCAL ] RH: No existing data file found in primary storage. [2025-10-10T21:13:18.481702] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:13:18.480612] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-10T21:13:18.481979] [DEBUG] [LOCAL ] RGT: No primary data file found to delete. [2025-10-10T21:13:18.482147] [DEBUG] [LOCAL ] RHI: No existing data file found in primary storage. [2025-10-10T21:13:18.481855] [WARN ] [MAIN ] RH: No existing data found, performing full refresh instead. [2025-10-10T21:13:18.482288] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-10T21:13:18.482530] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-10T21:13:18.482683] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-10T21:13:18.494211] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-10T21:13:18.487946] [WARN ] [MAIN ] RHI: No existing data found, performing full refresh instead. [2025-10-10T21:13:18.519512] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-10T21:13:18.530270] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-10T21:13:18.558307] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-10T21:13:18.538935] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-10T21:13:18.514269] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-10T21:13:18.574153] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-10T21:13:18.619359] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-10T21:13:18.607270] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-10T21:13:18.649095] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-10T21:13:19.929435] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:13:20.017863] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-10-10T21:13:20.312158] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:13:20.280492] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:13:20.312475] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-10-10T21:13:20.307304] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:13:20.313759] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-10-10T21:13:20.312802] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-10-10T21:13:20.702952] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:13:20.703278] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-10-10T21:13:20.703368] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:13:20.703415] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-10T21:13:20.703472] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:13:20.703539] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-10T21:13:20.703603] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-10T21:13:20.703666] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-10T21:13:20.703734] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-10T21:13:20.703785] [INFO ] [MAIN ] Update Progress: 1801/2373 symbols completed. RHLD took 2.9s. Estimated remaining: 1h 20m 26s. Rate: 7.1 symbols/min [2025-10-10T21:13:20.872315] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:13:20.872522] [DEBUG] [LOCAL ] RHP: No existing data file found in primary storage. [2025-10-10T21:13:20.872617] [WARN ] [MAIN ] RHP: No existing data found, performing full refresh instead. [2025-10-10T21:13:20.872732] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-10T21:13:20.872776] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-10T21:13:20.872817] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-10T21:13:20.872849] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-10T21:13:21.228190] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:13:21.228492] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-10-10T21:13:21.397423] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T21:13:21.398797] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-10T21:13:22.205390] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-10T21:13:22.206919] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-10T21:13:22.482033] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T21:13:22.523371] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-10T21:13:22.689500] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-10T21:13:22.908707] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T21:13:23.229957] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T21:13:23.489407] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-10T21:13:24.289350] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-10T21:13:24.599251] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T21:13:24.717727] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-10T21:13:25.089416] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-10T21:13:25.889462] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-10T21:13:26.252945] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T21:13:26.689374] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-10T21:13:26.950051] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T21:13:27.061566] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-10T21:13:27.489395] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-10T21:13:28.253683] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-10T21:13:28.289327] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-10T21:13:28.533002] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T21:13:28.876389] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-10T21:13:29.089355] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-10T21:13:29.889395] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-10T21:13:30.689396] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-10T21:13:30.992265] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T21:13:31.358394] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-10T21:13:31.489352] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-10T21:13:31.860151] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T21:13:32.289350] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-10T21:13:33.089335] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-10T21:13:33.456307] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T21:13:33.798157] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-10T21:13:33.889398] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-10T21:13:34.370166] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T21:13:34.689424] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-10T21:13:34.726305] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-10T21:13:35.489438] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-10T21:13:36.289433] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-10T21:13:36.718677] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T21:13:37.089418] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-10T21:13:37.774455] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-10T21:13:37.889340] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-10T21:13:38.184690] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T21:13:38.689416] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-10T21:13:39.071376] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T21:13:39.489450] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-10T21:13:40.108775] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-10T21:13:40.290438] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-10T21:13:40.290564] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-10T21:13:41.089436] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-10T21:13:41.357450] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T21:13:41.889431] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-10T21:13:42.450396] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-10T21:13:42.563543] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-10T21:13:42.608506] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-10T21:13:42.689335] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-10T21:13:43.489431] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-10T21:13:44.289445] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-10T21:13:44.756746] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T21:13:45.089346] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-10T21:13:45.562338] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T21:13:45.889354] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-10T21:13:46.076060] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T21:13:46.657631] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-10T21:13:46.689341] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-10T21:13:47.489398] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-10T21:13:47.940260] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-10T21:13:48.289568] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-10T21:13:48.854308] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-10T21:13:49.089356] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-10T21:13:49.278908] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-10T21:13:49.740404] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-10T21:13:49.889338] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-10T21:13:50.235409] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T21:13:50.689421] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-10T21:13:50.712848] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T21:13:50.716479] [INFO ] [REMOTE ] RHP: Full fetch complete (57599 records). [2025-10-10T21:13:50.716620] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-10T21:13:50.717369] [FATAL] [VALIDATOR ] RHP: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:13:50.717459] [FATAL] [MAIN ] RHP: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:13:50.717502] [WARN ] [MAIN ] RHP: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:13:50.717543] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-10T21:13:50.717600] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-10T21:13:50.717635] [INFO ] [LOCAL ] RHP: Starting deletion of derivative data. [2025-10-10T21:13:50.717720] [DEBUG] [LOCAL ] RHP: No derivative data file found to delete. [2025-10-10T21:13:50.717785] [INFO ] [MAIN ] Update Progress: 1802/2373 symbols completed. RHP took 30.0s. Estimated remaining: 1h 20m 25s. Rate: 7.1 symbols/min [2025-10-10T21:13:50.889542] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:13:50.889745] [DEBUG] [LOCAL ] RIG: No existing data file found in primary storage. [2025-10-10T21:13:50.889792] [WARN ] [MAIN ] RIG: No existing data found, performing full refresh instead. [2025-10-10T21:13:50.889930] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-10T21:13:50.890003] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-10T21:13:50.890062] [DEBUG] [LOCAL ] RIG: No primary data file found to delete. [2025-10-10T21:13:50.890096] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-10T21:13:51.243956] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:13:51.489340] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-10T21:13:51.630484] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T21:13:51.634950] [INFO ] [REMOTE ] RH: Full fetch complete (65288 records). [2025-10-10T21:13:51.635079] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-10T21:13:51.635974] [FATAL] [VALIDATOR ] RH: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:13:51.636062] [FATAL] [MAIN ] RH: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:13:51.636106] [WARN ] [MAIN ] RH: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:13:51.636148] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-10T21:13:51.636213] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-10T21:13:51.636250] [INFO ] [LOCAL ] RH: Starting deletion of derivative data. [2025-10-10T21:13:51.636290] [DEBUG] [LOCAL ] RH: No derivative data file found to delete. [2025-10-10T21:13:51.636355] [INFO ] [MAIN ] Update Progress: 1803/2373 symbols completed. RH took 33.9s. Estimated remaining: 1h 20m 14s. Rate: 7.1 symbols/min [2025-10-10T21:13:51.814295] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:13:51.814690] [DEBUG] [LOCAL ] RIO: No existing data file found in primary storage. [2025-10-10T21:13:51.814751] [WARN ] [MAIN ] RIO: No existing data found, performing full refresh instead. [2025-10-10T21:13:51.814877] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-10T21:13:51.814918] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-10T21:13:51.814959] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-10T21:13:51.815020] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-10T21:13:52.099253] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-10T21:13:52.115518] [INFO ] [REMOTE ] RGT: Full fetch complete (4057 records). [2025-10-10T21:13:52.120846] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-10T21:13:52.300668] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-10T21:13:52.370743] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:13:52.596354] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-10T21:13:52.596443] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-10T21:13:52.596597] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-10T21:13:52.596635] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-10T21:13:52.597033] [DEBUG] [LOCAL ] RGT: Trimmed 4057 records to 2744 (keeping 200 days of data) [2025-10-10T21:13:52.613034] [DEBUG] [LOCAL ] RGT: Primary data saved (2744 records). [2025-10-10T21:13:52.613099] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-10T21:13:52.613164] [INFO ] [MAIN ] Update Progress: 1804/2373 symbols completed. RGT took 34.9s. Estimated remaining: 1h 20m 3s. Rate: 7.1 symbols/min [2025-10-10T21:13:52.776098] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:13:52.776248] [DEBUG] [LOCAL ] RITM: No existing data file found in primary storage. [2025-10-10T21:13:52.776286] [WARN ] [MAIN ] RITM: No existing data found, performing full refresh instead. [2025-10-10T21:13:52.776393] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-10T21:13:52.776435] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-10T21:13:52.776474] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-10T21:13:52.776507] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-10T21:13:53.089367] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-10-10T21:13:53.124850] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:13:53.230700] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T21:13:53.235092] [INFO ] [REMOTE ] RHI: Full fetch complete (69866 records). [2025-10-10T21:13:53.235203] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-10T21:13:53.235886] [FATAL] [VALIDATOR ] RHI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:13:53.235977] [FATAL] [MAIN ] RHI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:13:53.236019] [WARN ] [MAIN ] RHI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:13:53.236086] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-10T21:13:53.236152] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-10T21:13:53.236188] [INFO ] [LOCAL ] RHI: Starting deletion of derivative data. [2025-10-10T21:13:53.236226] [DEBUG] [LOCAL ] RHI: No derivative data file found to delete. [2025-10-10T21:13:53.236320] [INFO ] [MAIN ] Update Progress: 1805/2373 symbols completed. RHI took 35.5s. Estimated remaining: 1h 19m 52s. Rate: 7.1 symbols/min [2025-10-10T21:13:53.401116] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:13:53.401301] [DEBUG] [LOCAL ] RIV: No existing data file found in primary storage. [2025-10-10T21:13:53.401339] [WARN ] [MAIN ] RIV: No existing data found, performing full refresh instead. [2025-10-10T21:13:53.401452] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-10T21:13:53.401494] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-10T21:13:53.401533] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-10T21:13:53.401565] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-10T21:13:53.747169] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:13:53.889378] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-10-10T21:13:54.689374] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-10-10T21:13:55.489424] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-10-10T21:13:55.546226] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-10-10T21:13:56.289382] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-10T21:13:56.339463] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-10T21:13:56.397381] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-10T21:13:56.979267] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-10T21:13:57.089392] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-10T21:13:57.889343] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-10T21:13:58.154410] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-10T21:13:58.503825] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-10T21:13:58.689377] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-10T21:13:59.489358] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-10T21:13:59.953046] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T21:14:00.289424] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-10T21:14:00.538330] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-10T21:14:00.587940] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-10T21:14:01.089439] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-10T21:14:01.889387] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-10T21:14:02.536702] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-10T21:14:02.689349] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-10T21:14:03.437409] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-10T21:14:03.489363] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-10T21:14:04.006540] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-10T21:14:04.289369] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-10T21:14:04.373531] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T21:14:05.089403] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-10T21:14:05.889426] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-10T21:14:06.056476] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-10T21:14:06.176819] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-10T21:14:06.619826] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-10T21:14:06.689346] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-10T21:14:07.489399] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-10T21:14:07.771390] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T21:14:08.289411] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-10T21:14:08.960187] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-10T21:14:09.089390] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-10T21:14:09.645515] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-10T21:14:09.889416] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-10T21:14:10.549515] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-10T21:14:10.689359] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-10T21:14:11.296082] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-10T21:14:11.489504] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-10T21:14:12.270761] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-10T21:14:12.289327] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-10T21:14:12.980347] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-10T21:14:13.089338] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-10T21:14:13.654340] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-10T21:14:13.889406] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-10T21:14:14.697752] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-10T21:14:14.703414] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-10T21:14:14.863756] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T21:14:15.489362] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-10T21:14:15.867808] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-10T21:14:16.289470] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-10T21:14:16.493909] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-10T21:14:17.089446] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-10T21:14:17.285878] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-10T21:14:17.889399] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-10T21:14:18.060183] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-10T21:14:18.502921] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-10T21:14:18.689366] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-10T21:14:19.206843] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-10T21:14:19.489421] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-10T21:14:19.853740] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-10T21:14:20.289386] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-10T21:14:21.089397] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-10T21:14:21.374513] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-10T21:14:21.807882] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-10T21:14:21.889334] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-10T21:14:22.686204] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-10T21:14:22.691276] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-10T21:14:22.693448] [INFO ] [REMOTE ] RITM: Full fetch complete (76218 records). [2025-10-10T21:14:22.693741] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-10T21:14:22.694785] [FATAL] [VALIDATOR ] RITM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:14:22.695081] [FATAL] [MAIN ] RITM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:14:22.695153] [WARN ] [MAIN ] RITM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:14:22.695228] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-10T21:14:22.695298] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-10T21:14:22.695335] [INFO ] [LOCAL ] RITM: Starting deletion of derivative data. [2025-10-10T21:14:22.695375] [DEBUG] [LOCAL ] RITM: No derivative data file found to delete. [2025-10-10T21:14:22.695439] [INFO ] [MAIN ] Update Progress: 1806/2373 symbols completed. RITM took 30.1s. Estimated remaining: 1h 19m 51s. Rate: 7.1 symbols/min [2025-10-10T21:14:22.878858] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:14:22.879169] [DEBUG] [LOCAL ] RJF: No existing data file found in primary storage. [2025-10-10T21:14:22.879278] [WARN ] [MAIN ] RJF: No existing data found, performing full refresh instead. [2025-10-10T21:14:22.879538] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-10T21:14:22.879757] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-10T21:14:22.879853] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-10T21:14:22.879904] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-10T21:14:23.212180] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-10T21:14:23.303539] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:14:23.489420] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-10T21:14:24.132705] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-10T21:14:24.289390] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-10T21:14:25.089411] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-10-10T21:14:25.473223] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T21:14:25.889412] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-10T21:14:26.096542] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-10T21:14:26.689395] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-10T21:14:27.048110] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-10T21:14:27.489379] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-10T21:14:27.956124] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-10T21:14:27.961146] [INFO ] [REMOTE ] RIG: Full fetch complete (77706 records). [2025-10-10T21:14:27.961261] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-10T21:14:28.294493] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-10T21:14:28.378236] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-10T21:14:28.378321] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-10T21:14:28.379523] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-10T21:14:28.379587] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-10T21:14:28.381052] [DEBUG] [LOCAL ] RIG: Trimmed 77706 records to 54450 (keeping 200 days of data) [2025-10-10T21:14:28.692181] [DEBUG] [LOCAL ] RIG: Primary data saved (54450 records). [2025-10-10T21:14:28.692304] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-10T21:14:28.692379] [INFO ] [MAIN ] Update Progress: 1807/2373 symbols completed. RIG took 38.0s. Estimated remaining: 1h 19m 41s. Rate: 7.1 symbols/min [2025-10-10T21:14:28.859958] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:14:28.860203] [DEBUG] [LOCAL ] RKT: No existing data file found in primary storage. [2025-10-10T21:14:28.860371] [WARN ] [MAIN ] RKT: No existing data found, performing full refresh instead. [2025-10-10T21:14:28.860555] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-10T21:14:28.860622] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-10T21:14:28.860738] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-10T21:14:28.860784] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-10T21:14:29.132792] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T21:14:29.259548] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:14:29.260114] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-10-10T21:14:29.256613] [INFO ] [REMOTE ] RIV: Full fetch complete (17608 records). [2025-10-10T21:14:29.263128] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-10T21:14:29.263408] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-10T21:14:29.275366] [FATAL] [VALIDATOR ] RIV: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:14:29.275792] [FATAL] [MAIN ] RIV: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:14:29.276200] [WARN ] [MAIN ] RIV: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:14:29.276379] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-10T21:14:29.276480] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-10T21:14:29.276553] [INFO ] [LOCAL ] RIV: Starting deletion of derivative data. [2025-10-10T21:14:29.276731] [DEBUG] [LOCAL ] RIV: No derivative data file found to delete. [2025-10-10T21:14:29.276822] [INFO ] [MAIN ] Update Progress: 1808/2373 symbols completed. RIV took 36.0s. Estimated remaining: 1h 19m 30s. Rate: 7.1 symbols/min [2025-10-10T21:14:29.487469] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:14:29.487812] [DEBUG] [LOCAL ] RL: No existing data file found in primary storage. [2025-10-10T21:14:29.488153] [WARN ] [MAIN ] RL: No existing data found, performing full refresh instead. [2025-10-10T21:14:29.488997] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-10T21:14:29.489051] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-10T21:14:29.492000] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-10T21:14:29.491788] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-10T21:14:29.492194] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-10T21:14:29.859775] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:14:29.889352] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-10T21:14:30.689398] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-10-10T21:14:31.422883] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-10T21:14:31.489334] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-10T21:14:31.900851] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-10T21:14:32.289376] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-10T21:14:32.711373] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T21:14:33.089434] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-10T21:14:33.636242] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-10T21:14:33.889415] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-10T21:14:34.213799] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-10T21:14:34.219423] [INFO ] [REMOTE ] RIO: Full fetch complete (76971 records). [2025-10-10T21:14:34.219582] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-10T21:14:34.220620] [FATAL] [VALIDATOR ] RIO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:14:34.220727] [FATAL] [MAIN ] RIO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:14:34.220801] [WARN ] [MAIN ] RIO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:14:34.220883] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-10T21:14:34.220954] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-10T21:14:34.221022] [INFO ] [LOCAL ] RIO: Starting deletion of derivative data. [2025-10-10T21:14:34.221086] [DEBUG] [LOCAL ] RIO: No derivative data file found to delete. [2025-10-10T21:14:34.221150] [INFO ] [MAIN ] Update Progress: 1809/2373 symbols completed. RIO took 42.6s. Estimated remaining: 1h 19m 21s. Rate: 7.1 symbols/min [2025-10-10T21:14:34.426634] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:14:34.427172] [DEBUG] [LOCAL ] RLI: No existing data file found in primary storage. [2025-10-10T21:14:34.427341] [WARN ] [MAIN ] RLI: No existing data found, performing full refresh instead. [2025-10-10T21:14:34.427577] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-10T21:14:34.427863] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-10T21:14:34.428139] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-10T21:14:34.428265] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-10T21:14:34.701774] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-10T21:14:34.773201] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-10T21:14:34.894013] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:14:34.898979] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T21:14:35.489422] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-10-10T21:14:36.289438] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-10T21:14:36.782929] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T21:14:36.979783] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-10T21:14:37.089356] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-10T21:14:37.889450] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-10T21:14:38.216471] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T21:14:38.689346] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-10T21:14:39.406028] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-10T21:14:39.437778] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-10T21:14:39.489329] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-10T21:14:40.289351] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-10T21:14:40.754156] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-10T21:14:41.089351] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-10T21:14:41.204576] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T21:14:41.889530] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-10T21:14:42.698443] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-10T21:14:42.704541] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-10T21:14:43.456703] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-10T21:14:43.495757] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-10T21:14:43.512981] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-10T21:14:44.289362] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-10T21:14:44.418539] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T21:14:45.089347] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-10T21:14:45.280095] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-10T21:14:45.889417] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-10T21:14:46.688615] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-10T21:14:46.699152] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-10T21:14:46.730727] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T21:14:47.489361] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-10T21:14:47.916525] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-10T21:14:48.289462] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-10T21:14:48.556160] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-10T21:14:48.670386] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-10T21:14:49.089396] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-10T21:14:49.889426] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-10T21:14:50.142628] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T21:14:50.689375] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-10T21:14:50.943283] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-10T21:14:51.489408] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-10T21:14:51.586010] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-10T21:14:52.289371] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-10T21:14:52.787612] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-10T21:14:53.089413] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-10T21:14:53.469009] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T21:14:53.889388] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-10T21:14:54.159941] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-10T21:14:54.689497] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-10T21:14:55.489395] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-10T21:14:55.737947] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-10T21:14:55.778095] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-10T21:14:55.851429] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-10T21:14:56.289388] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-10T21:14:57.089373] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-10T21:14:57.513868] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-10T21:14:57.889388] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-10T21:14:58.302489] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-10T21:14:58.689392] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-10T21:14:58.771797] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T21:14:58.776176] [INFO ] [REMOTE ] RJF: Full fetch complete (67877 records). [2025-10-10T21:14:58.776326] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-10T21:14:58.777532] [FATAL] [VALIDATOR ] RJF: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:14:58.777614] [FATAL] [MAIN ] RJF: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:14:58.777733] [WARN ] [MAIN ] RJF: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:14:58.777852] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-10T21:14:58.777944] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-10T21:14:58.777983] [INFO ] [LOCAL ] RJF: Starting deletion of derivative data. [2025-10-10T21:14:58.778022] [DEBUG] [LOCAL ] RJF: No derivative data file found to delete. [2025-10-10T21:14:58.778105] [INFO ] [MAIN ] Update Progress: 1810/2373 symbols completed. RJF took 36.1s. Estimated remaining: 1h 19m 17s. Rate: 7.1 symbols/min [2025-10-10T21:14:58.948212] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:14:58.948529] [DEBUG] [LOCAL ] RLJ: No existing data file found in primary storage. [2025-10-10T21:14:58.948635] [WARN ] [MAIN ] RLJ: No existing data found, performing full refresh instead. [2025-10-10T21:14:58.948819] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-10T21:14:58.949024] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-10T21:14:58.949108] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-10T21:14:58.949157] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-10T21:14:59.237607] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.95 seconds). [2025-10-10T21:14:59.350335] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:14:59.489386] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-10-10T21:14:59.726241] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-10T21:14:59.730013] [INFO ] [REMOTE ] RLI: Full fetch complete (47709 records). [2025-10-10T21:14:59.730103] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-10T21:14:59.730762] [FATAL] [VALIDATOR ] RLI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:14:59.730851] [FATAL] [MAIN ] RLI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:14:59.730898] [WARN ] [MAIN ] RLI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:14:59.730939] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-10T21:14:59.730995] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-10T21:14:59.731030] [INFO ] [LOCAL ] RLI: Starting deletion of derivative data. [2025-10-10T21:14:59.731068] [DEBUG] [LOCAL ] RLI: No derivative data file found to delete. [2025-10-10T21:14:59.731121] [INFO ] [MAIN ] Update Progress: 1811/2373 symbols completed. RLI took 25.5s. Estimated remaining: 1h 19m 7s. Rate: 7.1 symbols/min [2025-10-10T21:14:59.908113] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:14:59.908236] [DEBUG] [LOCAL ] RLTY: No existing data file found in primary storage. [2025-10-10T21:14:59.908275] [WARN ] [MAIN ] RLTY: No existing data found, performing full refresh instead. [2025-10-10T21:14:59.908393] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-10T21:14:59.908440] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-10T21:14:59.908486] [DEBUG] [LOCAL ] RLTY: No primary data file found to delete. [2025-10-10T21:14:59.908521] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-10T21:15:00.276929] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:15:00.289375] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-10-10T21:15:01.089404] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-10T21:15:01.833480] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T21:15:01.888791] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-10T21:15:01.897952] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-10T21:15:02.689381] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-10T21:15:03.085409] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-10T21:15:03.241599] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-10T21:15:03.489379] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-10T21:15:04.289462] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-10T21:15:04.797443] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T21:15:04.796063] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-10T21:15:05.089386] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-10T21:15:05.889399] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-10T21:15:06.689366] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-10T21:15:06.830986] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-10T21:15:06.995764] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-10T21:15:07.489349] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-10T21:15:07.716483] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-10T21:15:07.799383] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-10T21:15:08.289387] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-10T21:15:09.089353] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-10T21:15:09.398241] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-10T21:15:09.547895] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-10T21:15:09.889331] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-10T21:15:10.133061] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-10T21:15:10.137929] [INFO ] [REMOTE ] RKT: Full fetch complete (77048 records). [2025-10-10T21:15:10.138072] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-10T21:15:10.138761] [FATAL] [VALIDATOR ] RKT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:15:10.138911] [FATAL] [MAIN ] RKT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:15:10.138975] [WARN ] [MAIN ] RKT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:15:10.139049] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-10T21:15:10.139108] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-10T21:15:10.139144] [INFO ] [LOCAL ] RKT: Starting deletion of derivative data. [2025-10-10T21:15:10.139183] [DEBUG] [LOCAL ] RKT: No derivative data file found to delete. [2025-10-10T21:15:10.139257] [INFO ] [MAIN ] Update Progress: 1812/2373 symbols completed. RKT took 41.4s. Estimated remaining: 1h 18m 59s. Rate: 7.1 symbols/min [2025-10-10T21:15:10.327628] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:15:10.327827] [DEBUG] [LOCAL ] RLX: No existing data file found in primary storage. [2025-10-10T21:15:10.327867] [WARN ] [MAIN ] RLX: No existing data found, performing full refresh instead. [2025-10-10T21:15:10.327977] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-10T21:15:10.328018] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-10T21:15:10.328065] [DEBUG] [LOCAL ] RLX: No primary data file found to delete. [2025-10-10T21:15:10.328127] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-10T21:15:10.668950] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:15:10.689328] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-10-10T21:15:11.489367] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-10T21:15:12.108837] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-10T21:15:12.228525] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-10T21:15:12.289354] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-10T21:15:13.066260] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-10T21:15:13.089362] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-10T21:15:13.279888] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-10T21:15:13.889408] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-10T21:15:14.689391] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-10T21:15:14.862015] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T21:15:15.489383] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-10T21:15:15.985139] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-10T21:15:15.985470] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-10T21:15:15.999483] [INFO ] [REMOTE ] RL: Full fetch complete (59511 records). [2025-10-10T21:15:16.000056] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-10T21:15:16.000810] [FATAL] [VALIDATOR ] RL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:15:16.000899] [FATAL] [MAIN ] RL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:15:16.000942] [WARN ] [MAIN ] RL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:15:16.001009] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-10T21:15:16.001092] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-10T21:15:16.001146] [INFO ] [LOCAL ] RL: Starting deletion of derivative data. [2025-10-10T21:15:16.001189] [DEBUG] [LOCAL ] RL: No derivative data file found to delete. [2025-10-10T21:15:16.001247] [INFO ] [MAIN ] Update Progress: 1813/2373 symbols completed. RL took 46.7s. Estimated remaining: 1h 18m 50s. Rate: 7.1 symbols/min [2025-10-10T21:15:16.171076] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:15:16.171254] [DEBUG] [LOCAL ] RM: No existing data file found in primary storage. [2025-10-10T21:15:16.171312] [WARN ] [MAIN ] RM: No existing data found, performing full refresh instead. [2025-10-10T21:15:16.171428] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-10T21:15:16.171470] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-10T21:15:16.171511] [DEBUG] [LOCAL ] RM: No primary data file found to delete. [2025-10-10T21:15:16.171543] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-10T21:15:16.294559] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-10T21:15:16.517104] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:15:17.089402] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-10-10T21:15:17.508082] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T21:15:17.583199] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T21:15:17.889341] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-10T21:15:18.263373] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-10T21:15:18.609138] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-10T21:15:18.689436] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-10T21:15:19.489341] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-10T21:15:19.704309] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-10T21:15:20.289414] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-10T21:15:20.559915] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-10T21:15:21.089349] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-10T21:15:21.799215] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-10T21:15:21.889364] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-10T21:15:22.689343] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-10T21:15:22.882443] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T21:15:22.884228] [INFO ] [REMOTE ] RLTY: Full fetch complete (17447 records). [2025-10-10T21:15:22.884385] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-10T21:15:23.289231] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-10T21:15:23.291006] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-10T21:15:23.290919] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-10T21:15:23.291511] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-10T21:15:23.301815] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-10T21:15:23.303305] [DEBUG] [LOCAL ] RLTY: Trimmed 17447 records to 11311 (keeping 200 days of data) [2025-10-10T21:15:23.392608] [DEBUG] [LOCAL ] RLTY: Primary data saved (11311 records). [2025-10-10T21:15:23.392823] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-10T21:15:23.392907] [INFO ] [MAIN ] Update Progress: 1814/2373 symbols completed. RLTY took 23.7s. Estimated remaining: 1h 18m 41s. Rate: 7.1 symbols/min [2025-10-10T21:15:23.492496] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-10T21:15:23.564702] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:15:23.564888] [DEBUG] [LOCAL ] RMAX: No existing data file found in primary storage. [2025-10-10T21:15:23.564927] [WARN ] [MAIN ] RMAX: No existing data found, performing full refresh instead. [2025-10-10T21:15:23.565041] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-10T21:15:23.565083] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-10T21:15:23.565179] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-10T21:15:23.565229] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-10T21:15:23.826442] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-10T21:15:23.939183] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:15:24.289390] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-10T21:15:25.089400] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-10-10T21:15:25.562821] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T21:15:25.670463] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-10T21:15:25.883243] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-10T21:15:25.889320] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-10T21:15:26.689368] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-10T21:15:27.136432] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T21:15:27.489384] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-10T21:15:27.737579] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-10T21:15:28.289356] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-10T21:15:28.701480] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T21:15:29.089400] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-10T21:15:29.889367] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-10T21:15:30.126398] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T21:15:30.689356] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-10T21:15:31.082221] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T21:15:31.174631] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T21:15:31.489380] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-10T21:15:32.282262] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-10T21:15:32.291762] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-10T21:15:32.835288] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T21:15:33.094631] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-10T21:15:33.102226] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-10T21:15:33.889369] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-10T21:15:34.171132] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-10T21:15:34.689386] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-10T21:15:35.489365] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-10T21:15:35.729440] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-10T21:15:35.993027] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T21:15:36.289375] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-10T21:15:36.305057] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T21:15:36.309299] [INFO ] [REMOTE ] RLJ: Full fetch complete (68843 records). [2025-10-10T21:15:36.309418] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-10T21:15:36.310073] [FATAL] [VALIDATOR ] RLJ: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:15:36.310160] [FATAL] [MAIN ] RLJ: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:15:36.310246] [WARN ] [MAIN ] RLJ: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:15:36.310320] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-10T21:15:36.310382] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-10T21:15:36.310417] [INFO ] [LOCAL ] RLJ: Starting deletion of derivative data. [2025-10-10T21:15:36.310456] [DEBUG] [LOCAL ] RLJ: No derivative data file found to delete. [2025-10-10T21:15:36.310513] [INFO ] [MAIN ] Update Progress: 1815/2373 symbols completed. RLJ took 37.5s. Estimated remaining: 1h 18m 34s. Rate: 7.1 symbols/min [2025-10-10T21:15:36.482234] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:15:36.482402] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-10-10T21:15:36.482439] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-10-10T21:15:36.482554] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-10T21:15:36.482597] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-10T21:15:36.482663] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-10T21:15:36.482722] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-10T21:15:36.846852] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:15:37.089412] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-10T21:15:37.319760] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-10T21:15:37.889405] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-10T21:15:38.689417] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-10T21:15:38.809394] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-10T21:15:39.293536] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-10T21:15:39.489340] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-10T21:15:40.006888] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-10T21:15:40.289385] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-10T21:15:41.089410] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-10T21:15:41.409161] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T21:15:41.736051] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T21:15:41.889354] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-10T21:15:42.117131] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-10T21:15:42.689401] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-10T21:15:43.489367] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-10-10T21:15:43.524935] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-10T21:15:43.839471] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-10T21:15:43.844095] [INFO ] [REMOTE ] RLX: Full fetch complete (70082 records). [2025-10-10T21:15:43.844217] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-10T21:15:44.232081] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-10T21:15:44.232160] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-10T21:15:44.233129] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-10T21:15:44.233191] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-10T21:15:44.234454] [DEBUG] [LOCAL ] RLX: Trimmed 70082 records to 48848 (keeping 200 days of data) [2025-10-10T21:15:44.291365] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-10T21:15:44.512352] [DEBUG] [LOCAL ] RLX: Primary data saved (48848 records). [2025-10-10T21:15:44.512486] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-10T21:15:44.512588] [INFO ] [MAIN ] Update Progress: 1816/2373 symbols completed. RLX took 34.4s. Estimated remaining: 1h 18m 25s. Rate: 7.1 symbols/min [2025-10-10T21:15:44.681092] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:15:44.681280] [DEBUG] [LOCAL ] RMI: No existing data file found in primary storage. [2025-10-10T21:15:44.681323] [WARN ] [MAIN ] RMI: No existing data found, performing full refresh instead. [2025-10-10T21:15:44.681431] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-10T21:15:44.681471] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-10T21:15:44.681511] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-10T21:15:44.681543] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-10T21:15:45.031665] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:15:45.089330] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-10T21:15:45.300681] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T21:15:45.651744] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-10T21:15:45.889391] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-10-10T21:15:46.139571] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-10T21:15:46.601896] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-10T21:15:46.689379] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-10T21:15:47.272117] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-10T21:15:47.274105] [INFO ] [REMOTE ] RMAX: Full fetch complete (29701 records). [2025-10-10T21:15:47.274184] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-10T21:15:47.274598] [FATAL] [VALIDATOR ] RMAX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:15:47.274700] [FATAL] [MAIN ] RMAX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:15:47.274745] [WARN ] [MAIN ] RMAX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:15:47.274783] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-10T21:15:47.274837] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-10T21:15:47.274874] [INFO ] [LOCAL ] RMAX: Starting deletion of derivative data. [2025-10-10T21:15:47.274914] [DEBUG] [LOCAL ] RMAX: No derivative data file found to delete. [2025-10-10T21:15:47.274965] [INFO ] [MAIN ] Update Progress: 1817/2373 symbols completed. RMAX took 23.9s. Estimated remaining: 1h 18m 15s. Rate: 7.1 symbols/min [2025-10-10T21:15:47.440471] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:15:47.440693] [DEBUG] [LOCAL ] RMM: No existing data file found in primary storage. [2025-10-10T21:15:47.440748] [WARN ] [MAIN ] RMM: No existing data found, performing full refresh instead. [2025-10-10T21:15:47.440868] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-10T21:15:47.440909] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-10T21:15:47.440949] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-10T21:15:47.440981] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-10T21:15:47.495097] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-10T21:15:47.793138] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:15:48.289344] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-10-10T21:15:49.089342] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-10T21:15:49.391083] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-10T21:15:49.456114] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T21:15:49.889364] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-10T21:15:50.143930] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-10T21:15:50.689382] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-10T21:15:50.908917] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-10T21:15:51.444038] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-10T21:15:51.445211] [INFO ] [REMOTE ] RM: Full fetch complete (11514 records). [2025-10-10T21:15:51.445279] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-10T21:15:51.497018] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-10T21:15:51.810926] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-10T21:15:51.811036] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-10T21:15:51.811555] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-10T21:15:51.811622] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-10T21:15:51.812307] [DEBUG] [LOCAL ] RM: Trimmed 11514 records to 7610 (keeping 200 days of data) [2025-10-10T21:15:51.863562] [DEBUG] [LOCAL ] RM: Primary data saved (7610 records). [2025-10-10T21:15:51.863794] [INFO ] [MAIN ] RM: Full history saved. [2025-10-10T21:15:51.863905] [INFO ] [MAIN ] Update Progress: 1818/2373 symbols completed. RM took 35.9s. Estimated remaining: 1h 18m 5s. Rate: 7.1 symbols/min [2025-10-10T21:15:52.044196] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:15:52.044577] [DEBUG] [LOCAL ] RMMZ: No existing data file found in primary storage. [2025-10-10T21:15:52.044694] [WARN ] [MAIN ] RMMZ: No existing data found, performing full refresh instead. [2025-10-10T21:15:52.044934] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-10T21:15:52.044979] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-10T21:15:52.045023] [DEBUG] [LOCAL ] RMMZ: No primary data file found to delete. [2025-10-10T21:15:52.045057] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-10T21:15:52.156913] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-10T21:15:52.294612] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-10T21:15:52.440776] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:15:53.089421] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-10T21:15:53.701303] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-10T21:15:53.889353] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-10-10T21:15:54.255554] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-10T21:15:54.689355] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-10T21:15:54.856588] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-10T21:15:55.489350] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-10T21:15:55.817873] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-10T21:15:56.289379] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-10T21:15:56.325275] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-10T21:15:57.089468] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-10T21:15:57.138074] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-10T21:15:57.889371] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-10T21:15:58.621520] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-10T21:15:58.689331] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-10T21:15:58.738446] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-10T21:15:59.489369] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-10T21:16:00.285338] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-10T21:16:00.289317] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-10T21:16:00.823775] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T21:16:01.051213] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-10T21:16:01.089391] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-10T21:16:01.889425] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-10T21:16:01.967586] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-10T21:16:02.689376] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-10T21:16:03.325134] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-10T21:16:03.489375] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-10T21:16:03.771309] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T21:16:04.289384] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-10T21:16:04.651787] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-10T21:16:05.089403] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-10T21:16:05.113529] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-10T21:16:05.889393] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-10T21:16:05.935925] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-10T21:16:06.689365] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-10T21:16:07.489421] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-10T21:16:07.504726] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T21:16:07.505678] [INFO ] [REMOTE ] RMI: Full fetch complete (6089 records). [2025-10-10T21:16:07.505747] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-10T21:16:07.506090] [FATAL] [VALIDATOR ] RMI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:16:07.506170] [FATAL] [MAIN ] RMI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:16:07.506213] [WARN ] [MAIN ] RMI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:16:07.506278] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-10T21:16:07.506342] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-10T21:16:07.506378] [INFO ] [LOCAL ] RMI: Starting deletion of derivative data. [2025-10-10T21:16:07.506416] [DEBUG] [LOCAL ] RMI: No derivative data file found to delete. [2025-10-10T21:16:07.506467] [INFO ] [MAIN ] Update Progress: 1819/2373 symbols completed. RMI took 23.0s. Estimated remaining: 1h 17m 59s. Rate: 7.1 symbols/min [2025-10-10T21:16:07.700898] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-10T21:16:07.711988] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:16:07.712633] [DEBUG] [LOCAL ] RMT: No existing data file found in primary storage. [2025-10-10T21:16:07.712765] [WARN ] [MAIN ] RMT: No existing data found, performing full refresh instead. [2025-10-10T21:16:07.713218] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-10T21:16:07.713262] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-10T21:16:07.713302] [DEBUG] [LOCAL ] RMT: No primary data file found to delete. [2025-10-10T21:16:07.713334] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-10T21:16:08.066708] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:16:08.289367] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-10T21:16:08.469173] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-10T21:16:09.089359] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-10-10T21:16:09.159543] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T21:16:09.889406] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-10T21:16:10.380946] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T21:16:10.645321] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-10T21:16:10.689357] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-10T21:16:11.460831] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-10T21:16:11.489390] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-10T21:16:12.289444] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-10T21:16:12.522441] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-10T21:16:13.089380] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-10T21:16:13.889370] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-10T21:16:14.281064] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T21:16:14.458402] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T21:16:14.566183] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-10T21:16:14.689405] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-10T21:16:15.438315] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-10T21:16:15.489345] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-10T21:16:16.289385] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-10T21:16:16.549393] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-10T21:16:17.089439] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-10T21:16:17.285381] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-10T21:16:17.889421] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-10T21:16:17.908214] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-10T21:16:18.682905] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-10T21:16:18.689327] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-10T21:16:19.151745] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-10T21:16:19.152749] [INFO ] [REMOTE ] RMMZ: Full fetch complete (6948 records). [2025-10-10T21:16:19.152818] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-10T21:16:19.504077] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-10T21:16:19.548567] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-10-10T21:16:19.548690] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-10-10T21:16:19.548930] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-10-10T21:16:19.548974] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-10-10T21:16:19.549355] [DEBUG] [LOCAL ] RMMZ: Trimmed 6948 records to 4879 (keeping 200 days of data) [2025-10-10T21:16:19.580487] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4879 records). [2025-10-10T21:16:19.580580] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-10-10T21:16:19.580674] [INFO ] [MAIN ] Update Progress: 1820/2373 symbols completed. RMMZ took 27.7s. Estimated remaining: 1h 17m 52s. Rate: 7.1 symbols/min [2025-10-10T21:16:19.746260] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:16:19.746452] [DEBUG] [LOCAL ] RNG: No existing data file found in primary storage. [2025-10-10T21:16:19.746501] [WARN ] [MAIN ] RNG: No existing data found, performing full refresh instead. [2025-10-10T21:16:19.746614] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-10T21:16:19.746690] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-10T21:16:19.746747] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-10T21:16:19.746781] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-10T21:16:20.091480] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:16:20.289408] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-10T21:16:21.089361] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-10T21:16:21.516364] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T21:16:21.611192] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T21:16:21.889447] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-10T21:16:22.261979] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-10T21:16:22.689355] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-10T21:16:23.177799] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-10T21:16:23.489347] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-10-10T21:16:23.794252] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-10T21:16:24.289369] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-10T21:16:25.089494] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-10T21:16:25.369386] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-10T21:16:25.409987] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T21:16:25.889462] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-10T21:16:26.386676] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T21:16:26.689359] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-10T21:16:27.218462] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-10T21:16:27.489366] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-10T21:16:27.566011] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T21:16:27.567403] [INFO ] [REMOTE ] RMM: Full fetch complete (14820 records). [2025-10-10T21:16:27.567478] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-10T21:16:27.567936] [FATAL] [VALIDATOR ] RMM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:16:27.568017] [FATAL] [MAIN ] RMM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:16:27.568059] [WARN ] [MAIN ] RMM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:16:27.568156] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-10T21:16:27.568229] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-10T21:16:27.568267] [INFO ] [LOCAL ] RMM: Starting deletion of derivative data. [2025-10-10T21:16:27.568305] [DEBUG] [LOCAL ] RMM: No derivative data file found to delete. [2025-10-10T21:16:27.568359] [INFO ] [MAIN ] Update Progress: 1821/2373 symbols completed. RMM took 40.3s. Estimated remaining: 1h 17m 43s. Rate: 7.1 symbols/min [2025-10-10T21:16:27.734291] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:16:27.734477] [DEBUG] [LOCAL ] RNGR: No existing data file found in primary storage. [2025-10-10T21:16:27.734530] [WARN ] [MAIN ] RNGR: No existing data found, performing full refresh instead. [2025-10-10T21:16:27.734662] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-10T21:16:27.734719] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-10T21:16:27.734768] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-10T21:16:27.734801] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-10T21:16:28.090536] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:16:28.289397] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-10-10T21:16:29.089444] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-10T21:16:29.436547] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T21:16:29.554621] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-10T21:16:29.801631] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-10T21:16:29.889343] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-10T21:16:30.689366] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-10T21:16:31.141115] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-10T21:16:31.472753] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T21:16:31.476700] [INFO ] [REMOTE ] RMD: Full fetch complete (60864 records). [2025-10-10T21:16:31.476815] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-10T21:16:31.477744] [FATAL] [VALIDATOR ] RMD: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:16:31.477832] [FATAL] [MAIN ] RMD: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:16:31.477875] [WARN ] [MAIN ] RMD: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:16:31.477918] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-10T21:16:31.477982] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-10T21:16:31.478018] [INFO ] [LOCAL ] RMD: Starting deletion of derivative data. [2025-10-10T21:16:31.478057] [DEBUG] [LOCAL ] RMD: No derivative data file found to delete. [2025-10-10T21:16:31.478120] [INFO ] [MAIN ] Update Progress: 1822/2373 symbols completed. RMD took 55.2s. Estimated remaining: 1h 17m 33s. Rate: 7.1 symbols/min [2025-10-10T21:16:31.499075] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-10T21:16:31.657781] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:16:31.657944] [DEBUG] [LOCAL ] RNP: No existing data file found in primary storage. [2025-10-10T21:16:31.657998] [WARN ] [MAIN ] RNP: No existing data found, performing full refresh instead. [2025-10-10T21:16:31.658114] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-10T21:16:31.658156] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-10T21:16:31.658241] [DEBUG] [LOCAL ] RNP: No primary data file found to delete. [2025-10-10T21:16:31.658292] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-10T21:16:32.001023] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:16:32.289369] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-10-10T21:16:32.910020] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T21:16:33.089372] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-10T21:16:33.610034] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T21:16:33.889347] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-10T21:16:34.404221] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T21:16:34.689350] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-10T21:16:35.089449] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T21:16:35.489415] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-10T21:16:35.786561] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-10T21:16:36.289345] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-10T21:16:36.571703] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T21:16:36.573907] [INFO ] [REMOTE ] RMT: Full fetch complete (25522 records). [2025-10-10T21:16:36.573977] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-10T21:16:36.941518] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-10T21:16:36.941616] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-10T21:16:36.942204] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-10T21:16:36.942267] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-10T21:16:36.942933] [DEBUG] [LOCAL ] RMT: Trimmed 25522 records to 17653 (keeping 200 days of data) [2025-10-10T21:16:37.047679] [DEBUG] [LOCAL ] RMT: Primary data saved (17653 records). [2025-10-10T21:16:37.047829] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-10T21:16:37.047946] [INFO ] [MAIN ] Update Progress: 1823/2373 symbols completed. RMT took 29.5s. Estimated remaining: 1h 17m 24s. Rate: 7.1 symbols/min [2025-10-10T21:16:37.094523] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-10T21:16:37.218810] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:16:37.218984] [DEBUG] [LOCAL ] RNR: No existing data file found in primary storage. [2025-10-10T21:16:37.219026] [WARN ] [MAIN ] RNR: No existing data found, performing full refresh instead. [2025-10-10T21:16:37.219137] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-10T21:16:37.219178] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-10T21:16:37.219218] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-10T21:16:37.219251] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-10T21:16:37.574513] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:16:37.749371] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T21:16:37.889378] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-10T21:16:38.582911] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-10T21:16:38.689362] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-10T21:16:39.369913] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-10T21:16:39.489383] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-10T21:16:39.550132] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-10T21:16:40.289542] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-10T21:16:41.089427] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-10-10T21:16:41.412441] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T21:16:41.657954] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-10T21:16:41.889377] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-10T21:16:42.434383] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T21:16:42.689390] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-10T21:16:43.489408] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-10T21:16:43.766776] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T21:16:44.289366] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-10T21:16:44.553398] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T21:16:44.766846] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T21:16:45.089431] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-10T21:16:45.889381] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-10T21:16:46.267181] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-10T21:16:46.633234] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-10T21:16:46.689422] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-10T21:16:47.198772] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T21:16:47.489395] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-10T21:16:47.868840] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-10T21:16:48.289417] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-10T21:16:49.089384] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-10T21:16:49.308246] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T21:16:49.808077] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T21:16:49.889408] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-10T21:16:50.362891] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-10T21:16:50.689419] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-10T21:16:51.489364] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-10T21:16:51.790790] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T21:16:51.977595] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T21:16:52.289388] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-10T21:16:53.089352] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-10T21:16:53.380563] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-10T21:16:53.598687] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T21:16:53.889361] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-10T21:16:54.375621] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-10T21:16:54.621709] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T21:16:54.623958] [INFO ] [REMOTE ] RNGR: Full fetch complete (28061 records). [2025-10-10T21:16:54.624037] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-10T21:16:54.624549] [FATAL] [VALIDATOR ] RNGR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:16:54.624762] [FATAL] [MAIN ] RNGR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:16:54.624818] [WARN ] [MAIN ] RNGR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:16:54.624895] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-10T21:16:54.625073] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-10T21:16:54.625130] [INFO ] [LOCAL ] RNGR: Starting deletion of derivative data. [2025-10-10T21:16:54.625174] [DEBUG] [LOCAL ] RNGR: No derivative data file found to delete. [2025-10-10T21:16:54.625234] [INFO ] [MAIN ] Update Progress: 1824/2373 symbols completed. RNGR took 27.1s. Estimated remaining: 1h 17m 18s. Rate: 7.1 symbols/min [2025-10-10T21:16:54.694571] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-10T21:16:54.806035] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:16:54.806271] [DEBUG] [LOCAL ] RNST: No existing data file found in primary storage. [2025-10-10T21:16:54.806310] [WARN ] [MAIN ] RNST: No existing data found, performing full refresh instead. [2025-10-10T21:16:54.806435] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-10T21:16:54.806482] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-10T21:16:54.806523] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-10T21:16:54.806558] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-10T21:16:55.194278] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:16:55.489419] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-10T21:16:56.289377] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-10T21:16:56.483134] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T21:16:57.089395] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-10T21:16:57.603961] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-10T21:16:57.674282] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-10T21:16:57.889361] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-10T21:16:58.689401] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-10T21:16:58.792227] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-10T21:16:59.489400] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-10-10T21:16:59.916588] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T21:16:59.960507] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-10T21:17:00.289389] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-10T21:17:01.089432] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-10T21:17:01.174213] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T21:17:01.178515] [INFO ] [REMOTE ] RNG: Full fetch complete (69043 records). [2025-10-10T21:17:01.178624] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-10T21:17:01.179334] [FATAL] [VALIDATOR ] RNG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:17:01.179421] [FATAL] [MAIN ] RNG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:17:01.179468] [WARN ] [MAIN ] RNG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:17:01.179509] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-10T21:17:01.179566] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-10T21:17:01.179664] [INFO ] [LOCAL ] RNG: Starting deletion of derivative data. [2025-10-10T21:17:01.179733] [DEBUG] [LOCAL ] RNG: No derivative data file found to delete. [2025-10-10T21:17:01.179801] [INFO ] [MAIN ] Update Progress: 1825/2373 symbols completed. RNG took 41.6s. Estimated remaining: 1h 17m 9s. Rate: 7.1 symbols/min [2025-10-10T21:17:01.300575] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T21:17:01.377447] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:17:01.377628] [DEBUG] [LOCAL ] ROG: No existing data file found in primary storage. [2025-10-10T21:17:01.377708] [WARN ] [MAIN ] ROG: No existing data found, performing full refresh instead. [2025-10-10T21:17:01.377828] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-10T21:17:01.377870] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-10T21:17:01.377912] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-10T21:17:01.377943] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-10T21:17:01.748344] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:17:01.889373] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-10T21:17:02.689411] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-10T21:17:02.730202] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T21:17:03.489405] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-10T21:17:03.740679] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-10T21:17:04.047169] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-10T21:17:04.289506] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-10T21:17:04.792555] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T21:17:05.089393] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-10T21:17:05.510477] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-10T21:17:05.889365] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-10T21:17:06.434463] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-10T21:17:06.689398] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-10-10T21:17:07.489441] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-10T21:17:07.871118] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T21:17:08.289373] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-10T21:17:08.657813] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T21:17:09.089350] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-10T21:17:09.209116] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-10T21:17:09.889398] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-10T21:17:10.366176] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T21:17:10.689425] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-10T21:17:10.762759] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-10T21:17:10.829637] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T21:17:10.833410] [INFO ] [REMOTE ] RNR: Full fetch complete (50684 records). [2025-10-10T21:17:10.833600] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-10T21:17:10.835094] [FATAL] [VALIDATOR ] RNR: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:17:10.835365] [FATAL] [MAIN ] RNR: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:17:10.835438] [WARN ] [MAIN ] RNR: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:17:10.835516] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-10T21:17:10.835603] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-10T21:17:10.835692] [INFO ] [LOCAL ] RNR: Starting deletion of derivative data. [2025-10-10T21:17:10.835754] [DEBUG] [LOCAL ] RNR: No derivative data file found to delete. [2025-10-10T21:17:10.835841] [INFO ] [MAIN ] Update Progress: 1826/2373 symbols completed. RNR took 33.8s. Estimated remaining: 1h 17m 1s. Rate: 7.1 symbols/min [2025-10-10T21:17:11.029768] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:17:11.030001] [DEBUG] [LOCAL ] ROK: No existing data file found in primary storage. [2025-10-10T21:17:11.030039] [WARN ] [MAIN ] ROK: No existing data found, performing full refresh instead. [2025-10-10T21:17:11.030161] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-10T21:17:11.030201] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-10T21:17:11.030242] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-10T21:17:11.030274] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-10T21:17:11.408029] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:17:11.489450] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-10T21:17:11.905597] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-10T21:17:11.908519] [INFO ] [REMOTE ] RNP: Full fetch complete (23806 records). [2025-10-10T21:17:11.908631] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-10T21:17:12.289237] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-10T21:17:12.289346] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-10T21:17:12.289373] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-10T21:17:12.290575] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-10T21:17:12.290677] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-10T21:17:12.292531] [DEBUG] [LOCAL ] RNP: Trimmed 23806 records to 16376 (keeping 200 days of data) [2025-10-10T21:17:12.399981] [DEBUG] [LOCAL ] RNP: Primary data saved (16376 records). [2025-10-10T21:17:12.400175] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-10T21:17:12.400267] [INFO ] [MAIN ] Update Progress: 1827/2373 symbols completed. RNP took 40.9s. Estimated remaining: 1h 16m 51s. Rate: 7.1 symbols/min [2025-10-10T21:17:12.571735] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:17:12.572019] [DEBUG] [LOCAL ] ROL: No existing data file found in primary storage. [2025-10-10T21:17:12.572076] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-10-10T21:17:12.572198] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-10T21:17:12.572241] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-10T21:17:12.572284] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-10T21:17:12.572318] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-10T21:17:12.943145] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:17:13.089430] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-10-10T21:17:13.356554] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-10T21:17:13.377536] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-10T21:17:13.889391] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-10T21:17:14.689417] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-10T21:17:15.276895] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-10T21:17:15.382552] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T21:17:15.489393] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-10T21:17:16.289379] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-10T21:17:16.340794] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T21:17:16.977757] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-10T21:17:17.089403] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-10T21:17:17.889382] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-10T21:17:18.273167] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T21:17:18.381003] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-10T21:17:18.689378] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-10-10T21:17:19.211298] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T21:17:19.489405] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-10T21:17:20.289406] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-10T21:17:20.671530] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T21:17:21.089380] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-10T21:17:21.160072] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-10T21:17:21.441676] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T21:17:21.889370] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-10T21:17:22.689422] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-10T21:17:23.166286] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-10T21:17:23.489408] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-10T21:17:23.603476] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T21:17:24.289413] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-10T21:17:24.773963] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-10T21:17:25.089430] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-10T21:17:25.410483] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T21:17:25.889347] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-10T21:17:26.078923] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-10T21:17:26.422467] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-10T21:17:26.689397] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-10T21:17:27.422949] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T21:17:27.426588] [INFO ] [REMOTE ] RNST: Full fetch complete (52663 records). [2025-10-10T21:17:27.426767] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-10T21:17:27.427914] [FATAL] [VALIDATOR ] RNST: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:17:27.428005] [FATAL] [MAIN ] RNST: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:17:27.428080] [WARN ] [MAIN ] RNST: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:17:27.428142] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-10T21:17:27.428260] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-10T21:17:27.428300] [INFO ] [LOCAL ] RNST: Starting deletion of derivative data. [2025-10-10T21:17:27.428341] [DEBUG] [LOCAL ] RNST: No derivative data file found to delete. [2025-10-10T21:17:27.428429] [INFO ] [MAIN ] Update Progress: 1828/2373 symbols completed. RNST took 32.8s. Estimated remaining: 1h 16m 44s. Rate: 7.1 symbols/min [2025-10-10T21:17:27.495362] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-10T21:17:27.610903] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:17:27.611162] [DEBUG] [LOCAL ] RPM: No existing data file found in primary storage. [2025-10-10T21:17:27.611205] [WARN ] [MAIN ] RPM: No existing data found, performing full refresh instead. [2025-10-10T21:17:27.611332] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-10T21:17:27.611373] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-10T21:17:27.611415] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-10T21:17:27.611447] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-10T21:17:27.996591] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:17:28.031019] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T21:17:28.289432] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-10-10T21:17:28.989394] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-10T21:17:29.089401] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-10T21:17:29.889388] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-10T21:17:30.189138] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T21:17:30.689403] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-10T21:17:31.306075] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-10T21:17:31.407370] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-10T21:17:31.489344] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-10T21:17:32.188686] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-10T21:17:32.289385] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-10T21:17:33.089374] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-10T21:17:33.585958] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T21:17:33.637595] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-10T21:17:33.889351] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-10T21:17:34.451134] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T21:17:34.519005] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-10T21:17:34.521165] [INFO ] [REMOTE ] ROG: Full fetch complete (30724 records). [2025-10-10T21:17:34.521248] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-10T21:17:34.521808] [FATAL] [VALIDATOR ] ROG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:17:34.521926] [FATAL] [MAIN ] ROG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:17:34.521970] [WARN ] [MAIN ] ROG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:17:34.522013] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-10T21:17:34.522079] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-10T21:17:34.522117] [INFO ] [LOCAL ] ROG: Starting deletion of derivative data. [2025-10-10T21:17:34.522186] [DEBUG] [LOCAL ] ROG: No derivative data file found to delete. [2025-10-10T21:17:34.522249] [INFO ] [MAIN ] Update Progress: 1829/2373 symbols completed. ROG took 33.3s. Estimated remaining: 1h 16m 35s. Rate: 7.1 symbols/min [2025-10-10T21:17:34.694624] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-10T21:17:34.697247] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:17:34.698457] [DEBUG] [LOCAL ] RPT: No existing data file found in primary storage. [2025-10-10T21:17:34.698505] [WARN ] [MAIN ] RPT: No existing data found, performing full refresh instead. [2025-10-10T21:17:34.698633] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-10T21:17:34.698716] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-10T21:17:34.698766] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-10-10T21:17:34.698799] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-10T21:17:35.061498] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:17:35.489398] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-10-10T21:17:36.289346] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-10T21:17:36.769619] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T21:17:36.856308] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T21:17:37.089378] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-10T21:17:37.593491] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T21:17:37.889383] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-10T21:17:38.689357] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-10T21:17:38.930297] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T21:17:39.167073] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T21:17:39.489423] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-10T21:17:40.145710] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T21:17:40.289333] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-10T21:17:41.089449] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-10T21:17:41.461701] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T21:17:41.889384] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-10T21:17:42.242756] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-10T21:17:42.669355] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-10T21:17:42.689341] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-10T21:17:43.489347] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-10T21:17:43.827990] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T21:17:44.289389] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-10T21:17:44.632222] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T21:17:45.089448] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-10T21:17:45.466806] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T21:17:45.889430] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-10T21:17:46.182265] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-10T21:17:46.639356] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-10T21:17:46.689349] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-10T21:17:46.948408] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-10T21:17:47.489396] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-10T21:17:47.549580] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-10T21:17:48.289374] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-10T21:17:48.442533] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T21:17:48.446473] [INFO ] [REMOTE ] ROK: Full fetch complete (62295 records). [2025-10-10T21:17:48.446587] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-10T21:17:48.447584] [FATAL] [VALIDATOR ] ROK: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:17:48.447695] [FATAL] [MAIN ] ROK: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:17:48.447745] [WARN ] [MAIN ] ROK: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:17:48.447811] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-10T21:17:48.447898] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-10T21:17:48.447953] [INFO ] [LOCAL ] ROK: Starting deletion of derivative data. [2025-10-10T21:17:48.447996] [DEBUG] [LOCAL ] ROK: No derivative data file found to delete. [2025-10-10T21:17:48.448060] [INFO ] [MAIN ] Update Progress: 1830/2373 symbols completed. ROK took 37.6s. Estimated remaining: 1h 16m 29s. Rate: 7.1 symbols/min [2025-10-10T21:17:48.621960] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:17:48.622181] [DEBUG] [LOCAL ] RQI: No existing data file found in primary storage. [2025-10-10T21:17:48.622220] [WARN ] [MAIN ] RQI: No existing data found, performing full refresh instead. [2025-10-10T21:17:48.622346] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-10T21:17:48.622388] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-10T21:17:48.622430] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-10T21:17:48.622465] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-10T21:17:48.974228] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:17:49.089348] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-10-10T21:17:49.600136] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-10T21:17:49.889399] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-10T21:17:50.688934] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T21:17:50.695890] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-10T21:17:51.489363] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-10T21:17:51.836423] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T21:17:52.289408] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-10T21:17:52.320812] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T21:17:52.817247] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-10T21:17:53.089375] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-10T21:17:53.889357] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-10T21:17:54.051334] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-10T21:17:54.362132] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-10T21:17:54.689378] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-10T21:17:55.295460] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-10T21:17:55.489380] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-10T21:17:56.289395] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-10T21:17:56.340768] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T21:17:56.347138] [INFO ] [REMOTE ] ROL: Full fetch complete (72519 records). [2025-10-10T21:17:56.347469] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-10T21:17:56.348865] [FATAL] [VALIDATOR ] ROL: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:17:56.348975] [FATAL] [MAIN ] ROL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:17:56.349022] [WARN ] [MAIN ] ROL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:17:56.349069] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-10T21:17:56.349181] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-10T21:17:56.349259] [INFO ] [LOCAL ] ROL: Starting deletion of derivative data. [2025-10-10T21:17:56.349326] [DEBUG] [LOCAL ] ROL: No derivative data file found to delete. [2025-10-10T21:17:56.349431] [INFO ] [MAIN ] Update Progress: 1831/2373 symbols completed. ROL took 43.9s. Estimated remaining: 1h 16m 20s. Rate: 7.1 symbols/min [2025-10-10T21:17:56.571634] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:17:56.571951] [DEBUG] [LOCAL ] RRC: No existing data file found in primary storage. [2025-10-10T21:17:56.572095] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-10-10T21:17:56.574475] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T21:17:56.574712] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-10T21:17:56.574857] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-10T21:17:56.583497] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-10T21:17:56.583772] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-10T21:17:56.975556] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:17:57.089448] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-10-10T21:17:57.513897] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T21:17:57.889411] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-10T21:17:58.689423] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-10T21:17:59.024264] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T21:17:59.489383] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-10T21:17:59.515271] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T21:18:00.289368] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-10T21:18:00.498106] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T21:18:00.973228] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-10T21:18:01.089434] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-10T21:18:01.878223] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T21:18:01.889319] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-10T21:18:02.392295] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T21:18:02.689368] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-10T21:18:03.489381] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-10T21:18:03.631920] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T21:18:03.636951] [INFO ] [REMOTE ] RPM: Full fetch complete (59001 records). [2025-10-10T21:18:03.637225] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-10T21:18:03.638239] [FATAL] [VALIDATOR ] RPM: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:18:03.638340] [FATAL] [MAIN ] RPM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:18:03.638385] [WARN ] [MAIN ] RPM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:18:03.638435] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-10T21:18:03.638515] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-10T21:18:03.638559] [INFO ] [LOCAL ] RPM: Starting deletion of derivative data. [2025-10-10T21:18:03.638601] [DEBUG] [LOCAL ] RPM: No derivative data file found to delete. [2025-10-10T21:18:03.638804] [INFO ] [MAIN ] Update Progress: 1832/2373 symbols completed. RPM took 36.2s. Estimated remaining: 1h 16m 11s. Rate: 7.1 symbols/min [2025-10-10T21:18:03.807435] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:18:03.807864] [DEBUG] [LOCAL ] RRX: No existing data file found in primary storage. [2025-10-10T21:18:03.807925] [WARN ] [MAIN ] RRX: No existing data found, performing full refresh instead. [2025-10-10T21:18:03.808092] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-10T21:18:03.808314] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-10T21:18:03.808384] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-10T21:18:03.808418] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-10T21:18:04.188420] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:18:04.200005] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-10T21:18:04.289365] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-10-10T21:18:04.981496] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-10T21:18:05.089381] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-10T21:18:05.889397] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-10T21:18:06.013550] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T21:18:06.689403] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-10T21:18:07.108308] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T21:18:07.249537] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-10T21:18:07.489373] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-10T21:18:08.289356] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-10T21:18:08.425266] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-10T21:18:09.008730] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-10T21:18:09.089357] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-10T21:18:09.407693] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-10T21:18:09.409751] [INFO ] [REMOTE ] RPT: Full fetch complete (28480 records). [2025-10-10T21:18:09.409919] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-10T21:18:09.786374] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-10T21:18:09.786459] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-10T21:18:09.787174] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-10T21:18:09.787298] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-10T21:18:09.788141] [DEBUG] [LOCAL ] RPT: Trimmed 28480 records to 19290 (keeping 200 days of data) [2025-10-10T21:18:09.891393] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-10T21:18:09.917398] [DEBUG] [LOCAL ] RPT: Primary data saved (19290 records). [2025-10-10T21:18:09.917603] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-10T21:18:09.917761] [INFO ] [MAIN ] Update Progress: 1833/2373 symbols completed. RPT took 35.4s. Estimated remaining: 1h 16m 2s. Rate: 7.1 symbols/min [2025-10-10T21:18:10.095443] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:18:10.095707] [DEBUG] [LOCAL ] RS: No existing data file found in primary storage. [2025-10-10T21:18:10.095776] [WARN ] [MAIN ] RS: No existing data found, performing full refresh instead. [2025-10-10T21:18:10.095932] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-10T21:18:10.095990] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-10T21:18:10.096046] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-10T21:18:10.096089] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-10T21:18:10.477895] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:18:10.689360] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-10-10T21:18:10.901139] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T21:18:11.329100] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-10T21:18:11.489350] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-10T21:18:12.289354] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-10T21:18:12.579844] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T21:18:13.067780] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-10T21:18:13.089328] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-10T21:18:13.889344] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-10T21:18:14.204514] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T21:18:14.306623] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T21:18:14.689398] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-10T21:18:15.489439] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-10T21:18:15.636346] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T21:18:16.289340] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-10T21:18:16.380738] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T21:18:17.089372] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-10T21:18:17.594846] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T21:18:17.889389] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-10T21:18:17.982341] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T21:18:18.477803] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-10T21:18:18.689416] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-10T21:18:19.469618] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T21:18:19.473454] [INFO ] [REMOTE ] RQI: Full fetch complete (42817 records). [2025-10-10T21:18:19.473589] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-10T21:18:19.474209] [FATAL] [VALIDATOR ] RQI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:18:19.474319] [FATAL] [MAIN ] RQI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:18:19.474366] [WARN ] [MAIN ] RQI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:18:19.474435] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-10T21:18:19.474500] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-10T21:18:19.474537] [INFO ] [LOCAL ] RQI: Starting deletion of derivative data. [2025-10-10T21:18:19.474576] [DEBUG] [LOCAL ] RQI: No derivative data file found to delete. [2025-10-10T21:18:19.474635] [INFO ] [MAIN ] Update Progress: 1834/2373 symbols completed. RQI took 31.0s. Estimated remaining: 1h 15m 54s. Rate: 7.1 symbols/min [2025-10-10T21:18:19.505885] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-10T21:18:19.682800] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:18:19.683001] [DEBUG] [LOCAL ] RSF: No existing data file found in primary storage. [2025-10-10T21:18:19.683075] [WARN ] [MAIN ] RSF: No existing data found, performing full refresh instead. [2025-10-10T21:18:19.683205] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-10T21:18:19.683247] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-10T21:18:19.683290] [DEBUG] [LOCAL ] RSF: No primary data file found to delete. [2025-10-10T21:18:19.683324] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-10T21:18:20.113671] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-10T21:18:20.138335] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:18:20.289400] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-10-10T21:18:20.969766] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-10T21:18:21.089372] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-10T21:18:21.680634] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-10T21:18:21.736850] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-10T21:18:21.889387] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-10T21:18:22.689433] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-10T21:18:23.489411] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-10T21:18:24.018079] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-10T21:18:24.289421] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-10T21:18:24.468740] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T21:18:24.738736] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-10T21:18:25.089393] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-10T21:18:25.199876] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T21:18:25.889397] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-10T21:18:26.689425] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-10T21:18:27.317282] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-10T21:18:27.489388] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-10T21:18:27.596036] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T21:18:28.152631] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-10T21:18:28.289383] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-10T21:18:28.640403] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-10T21:18:29.089358] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-10T21:18:29.640420] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-10T21:18:29.889354] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-10T21:18:30.002743] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-10T21:18:30.689423] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-10T21:18:31.379231] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T21:18:31.489352] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-10T21:18:32.289423] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-10T21:18:32.438760] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T21:18:33.082117] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T21:18:33.092036] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-10T21:18:33.092593] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-10T21:18:33.889356] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-10T21:18:34.689401] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-10T21:18:35.360571] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-10T21:18:35.391476] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-10T21:18:35.481805] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-10T21:18:35.489326] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-10T21:18:36.289383] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-10T21:18:36.446763] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-10T21:18:37.089350] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-10T21:18:37.158452] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T21:18:37.162990] [INFO ] [REMOTE ] RRC: Full fetch complete (76075 records). [2025-10-10T21:18:37.163106] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-10T21:18:37.163766] [FATAL] [VALIDATOR ] RRC: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:18:37.163851] [FATAL] [MAIN ] RRC: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:18:37.163894] [WARN ] [MAIN ] RRC: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:18:37.163933] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-10T21:18:37.163989] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-10T21:18:37.164024] [INFO ] [LOCAL ] RRC: Starting deletion of derivative data. [2025-10-10T21:18:37.164063] [DEBUG] [LOCAL ] RRC: No derivative data file found to delete. [2025-10-10T21:18:37.164143] [INFO ] [MAIN ] Update Progress: 1835/2373 symbols completed. RRC took 40.8s. Estimated remaining: 1h 15m 48s. Rate: 7.1 symbols/min [2025-10-10T21:18:37.332512] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:18:37.332731] [DEBUG] [LOCAL ] RSG: No existing data file found in primary storage. [2025-10-10T21:18:37.332780] [WARN ] [MAIN ] RSG: No existing data found, performing full refresh instead. [2025-10-10T21:18:37.332892] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-10T21:18:37.332935] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-10T21:18:37.332978] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-10T21:18:37.333009] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-10T21:18:37.678360] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:18:37.889369] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-10-10T21:18:37.955998] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-10T21:18:38.689384] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-10T21:18:39.489377] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-10T21:18:39.859788] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T21:18:40.176752] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T21:18:40.289357] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-10T21:18:41.089488] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-10T21:18:41.351962] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-10T21:18:41.354693] [INFO ] [REMOTE ] RS: Full fetch complete (38619 records). [2025-10-10T21:18:41.354948] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-10T21:18:41.355878] [FATAL] [VALIDATOR ] RS: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:18:41.381199] [FATAL] [MAIN ] RS: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:18:41.382119] [WARN ] [MAIN ] RS: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:18:41.383478] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-10T21:18:41.383371] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T21:18:41.383721] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-10T21:18:41.393029] [INFO ] [LOCAL ] RS: Starting deletion of derivative data. [2025-10-10T21:18:41.393096] [DEBUG] [LOCAL ] RS: No derivative data file found to delete. [2025-10-10T21:18:41.393172] [INFO ] [MAIN ] Update Progress: 1836/2373 symbols completed. RS took 31.5s. Estimated remaining: 1h 15m 39s. Rate: 7.1 symbols/min [2025-10-10T21:18:41.560815] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:18:41.561007] [DEBUG] [LOCAL ] RSI: No existing data file found in primary storage. [2025-10-10T21:18:41.561052] [WARN ] [MAIN ] RSI: No existing data found, performing full refresh instead. [2025-10-10T21:18:41.561187] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-10T21:18:41.561228] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-10T21:18:41.561268] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-10T21:18:41.561299] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-10T21:18:41.899470] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-10T21:18:41.940553] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:18:42.689371] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-10T21:18:42.776136] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-10T21:18:43.120683] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T21:18:43.489432] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-10T21:18:44.147585] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-10T21:18:44.148885] [INFO ] [REMOTE ] RSF: Full fetch complete (5680 records). [2025-10-10T21:18:44.148956] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-10T21:18:44.293767] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-10T21:18:44.548848] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-10T21:18:44.549096] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-10T21:18:44.549570] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-10T21:18:44.549683] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-10T21:18:44.550308] [DEBUG] [LOCAL ] RSF: Trimmed 5680 records to 4383 (keeping 200 days of data) [2025-10-10T21:18:44.580568] [DEBUG] [LOCAL ] RSF: Primary data saved (4383 records). [2025-10-10T21:18:44.580786] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-10T21:18:44.580913] [INFO ] [MAIN ] Update Progress: 1837/2373 symbols completed. RSF took 25.1s. Estimated remaining: 1h 15m 29s. Rate: 7.1 symbols/min [2025-10-10T21:18:44.624511] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T21:18:45.089447] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-10-10T21:18:45.889402] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-10T21:18:46.366464] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-10T21:18:46.689379] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-10T21:18:46.823275] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T21:18:46.826786] [INFO ] [REMOTE ] RRX: Full fetch complete (58130 records). [2025-10-10T21:18:46.826877] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-10T21:18:46.827515] [FATAL] [VALIDATOR ] RRX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:18:46.827601] [FATAL] [MAIN ] RRX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:18:46.827671] [WARN ] [MAIN ] RRX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:18:46.827731] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-10T21:18:46.827789] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-10T21:18:46.827825] [INFO ] [LOCAL ] RRX: Starting deletion of derivative data. [2025-10-10T21:18:46.827865] [DEBUG] [LOCAL ] RRX: No derivative data file found to delete. [2025-10-10T21:18:46.827921] [INFO ] [MAIN ] Update Progress: 1838/2373 symbols completed. RRX took 43.2s. Estimated remaining: 1h 15m 18s. Rate: 7.1 symbols/min [2025-10-10T21:18:47.124785] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-10T21:18:47.489408] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-10T21:18:48.707187] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-10T21:18:48.718430] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-10T21:18:49.013941] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-10T21:18:49.089481] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-10T21:18:50.998209] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-10T21:18:51.010571] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-10T21:18:51.040633] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T21:18:51.051377] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-10T21:18:53.090451] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-10T21:18:53.101911] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-10T21:18:53.138440] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T21:18:53.149618] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-10T21:18:55.149370] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T21:18:55.161683] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-10T21:18:55.192118] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-10T21:18:55.204423] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-10T21:18:57.085375] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T21:18:57.096302] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-10T21:18:57.287095] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-10T21:18:57.298027] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-10T21:18:58.925630] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T21:18:58.935281] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-10T21:18:59.302780] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-10T21:18:59.313417] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-10T21:19:00.472080] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-10T21:19:00.483569] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-10T21:19:00.877132] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-10T21:19:00.887527] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-10T21:19:00.964599] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-10T21:19:00.968885] [INFO ] [REMOTE ] RSG: Full fetch complete (67660 records). [2025-10-10T21:19:00.968996] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-10T21:19:00.969603] [FATAL] [VALIDATOR ] RSG: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:19:00.969711] [FATAL] [MAIN ] RSG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:19:00.969758] [WARN ] [MAIN ] RSG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:19:00.969797] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-10T21:19:00.969865] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-10T21:19:00.969932] [INFO ] [LOCAL ] RSG: Starting deletion of derivative data. [2025-10-10T21:19:00.969984] [DEBUG] [LOCAL ] RSG: No derivative data file found to delete. [2025-10-10T21:19:00.970044] [INFO ] [MAIN ] Update Progress: 1839/2373 symbols completed. RSG took 23.8s. Estimated remaining: 1h 15m 12s. Rate: 7.1 symbols/min [2025-10-10T21:19:02.872750] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T21:19:02.884300] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-10T21:19:04.835312] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T21:19:04.845789] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-10T21:19:05.779941] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T21:19:05.784295] [INFO ] [REMOTE ] RSI: Full fetch complete (69104 records). [2025-10-10T21:19:05.784416] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-10T21:19:05.785065] [FATAL] [VALIDATOR ] RSI: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:19:05.785153] [FATAL] [MAIN ] RSI: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:19:05.785198] [WARN ] [MAIN ] RSI: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:19:05.785236] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-10T21:19:05.785293] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-10T21:19:05.785329] [INFO ] [LOCAL ] RSI: Starting deletion of derivative data. [2025-10-10T21:19:05.785370] [DEBUG] [LOCAL ] RSI: No derivative data file found to delete. [2025-10-10T21:19:05.785427] [INFO ] [MAIN ] Update Progress: 1840/2373 symbols completed. RSI took 24.4s. Estimated remaining: 1h 15m 2s. Rate: 7.1 symbols/min [2025-10-10T21:19:06.401140] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:19:06.408729] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:19:06.434978] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:19:06.435505] [DEBUG] [LOCAL ] RTO: No existing data file found in primary storage. [2025-10-10T21:19:06.435306] [DEBUG] [LOCAL ] RSKD: No existing data file found in primary storage. [2025-10-10T21:19:06.435717] [WARN ] [MAIN ] RSKD: No existing data found, performing full refresh instead. [2025-10-10T21:19:06.436222] [WARN ] [MAIN ] RTO: No existing data found, performing full refresh instead. [2025-10-10T21:19:06.436093] [DEBUG] [LOCAL ] RVLV: No existing data file found in primary storage. [2025-10-10T21:19:06.452192] [WARN ] [MAIN ] RVLV: No existing data found, performing full refresh instead. [2025-10-10T21:19:06.452395] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-10T21:19:06.488343] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-10T21:19:06.446937] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-10T21:19:06.489246] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-10T21:19:06.489476] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-10T21:19:06.491903] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-10T21:19:06.508803] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:19:06.488629] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-10T21:19:06.507319] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-10T21:19:06.509275] [DEBUG] [LOCAL ] RTX: No existing data file found in primary storage. [2025-10-10T21:19:06.491795] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-10T21:19:06.514630] [WARN ] [MAIN ] RTX: No existing data found, performing full refresh instead. [2025-10-10T21:19:06.520553] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-10T21:19:06.559783] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-10T21:19:06.560009] [DEBUG] [LOCAL ] RSKD: No primary data file found to delete. [2025-10-10T21:19:06.560172] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-10T21:19:06.580127] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-10T21:19:06.611331] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-10T21:19:06.674800] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-10T21:19:07.801796] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:19:07.816072] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-10-10T21:19:07.972589] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:19:07.978181] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-10-10T21:19:08.057826] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:19:08.069393] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-10-10T21:19:08.147056] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:19:08.147530] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-10-10T21:19:09.674266] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T21:19:09.683380] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-10T21:19:09.777047] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T21:19:09.784956] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-10T21:19:09.816571] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T21:19:09.826472] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-10T21:19:10.569782] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-10T21:19:10.581371] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-10T21:19:11.414882] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T21:19:11.422195] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-10T21:19:11.585892] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T21:19:11.595151] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-10T21:19:11.714447] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-10T21:19:11.724007] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-10T21:19:12.444812] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T21:19:12.456090] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-10T21:19:13.068517] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-10T21:19:13.079055] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-10T21:19:13.142196] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T21:19:13.151588] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-10T21:19:13.180052] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T21:19:13.187982] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-10T21:19:14.284908] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-10T21:19:14.293898] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-10T21:19:14.606752] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-10T21:19:14.617401] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-10T21:19:14.647733] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-10T21:19:14.689330] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-10T21:19:15.413315] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-10T21:19:15.447184] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T21:19:15.489356] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-10T21:19:16.289471] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-10T21:19:16.560978] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T21:19:17.023470] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T21:19:17.089347] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-10T21:19:17.256037] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-10T21:19:17.889398] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-10T21:19:17.968616] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T21:19:18.598294] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-10T21:19:18.689434] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-10T21:19:19.489378] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-10T21:19:19.577291] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-10T21:19:20.289381] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-10T21:19:21.089440] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-10T21:19:21.171369] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-10T21:19:21.217836] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T21:19:21.889444] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-10T21:19:22.086947] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-10T21:19:22.689396] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-10T21:19:22.718978] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T21:19:23.489434] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-10T21:19:24.289370] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-10T21:19:24.498816] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-10T21:19:24.673860] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T21:19:25.089374] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-10T21:19:25.344979] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T21:19:25.889371] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-10T21:19:25.948354] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T21:19:26.689432] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-10T21:19:27.489406] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-10T21:19:27.597390] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-10T21:19:27.791029] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T21:19:27.821943] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-10T21:19:28.289393] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-10T21:19:28.786231] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T21:19:29.089375] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-10T21:19:29.889359] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-10T21:19:30.241598] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T21:19:30.689377] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-10T21:19:31.479293] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-10T21:19:31.489325] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-10T21:19:31.660374] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-10T21:19:32.289382] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-10T21:19:32.407665] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-10T21:19:32.792228] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-10T21:19:32.795675] [INFO ] [REMOTE ] RSKD: Full fetch complete (48325 records). [2025-10-10T21:19:32.795781] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-10T21:19:33.094570] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-10T21:19:33.206027] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-10T21:19:33.206115] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-10T21:19:33.207023] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-10T21:19:33.207087] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-10T21:19:33.208090] [DEBUG] [LOCAL ] RSKD: Trimmed 48325 records to 33861 (keeping 200 days of data) [2025-10-10T21:19:33.393605] [DEBUG] [LOCAL ] RSKD: Primary data saved (33861 records). [2025-10-10T21:19:33.393767] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-10T21:19:33.393846] [INFO ] [MAIN ] Update Progress: 1841/2373 symbols completed. RSKD took 27.6s. Estimated remaining: 1h 14m 59s. Rate: 7.1 symbols/min [2025-10-10T21:19:33.568697] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:19:33.568903] [DEBUG] [LOCAL ] RVT: No existing data file found in primary storage. [2025-10-10T21:19:33.568978] [WARN ] [MAIN ] RVT: No existing data found, performing full refresh instead. [2025-10-10T21:19:33.569145] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-10T21:19:33.569206] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-10T21:19:33.569258] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-10T21:19:33.569292] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-10T21:19:33.894517] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-10T21:19:33.936359] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:19:34.064281] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-10T21:19:34.068088] [INFO ] [REMOTE ] RTO: Full fetch complete (58251 records). [2025-10-10T21:19:34.068177] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-10T21:19:34.068836] [FATAL] [VALIDATOR ] RTO: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:19:34.068919] [FATAL] [MAIN ] RTO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:19:34.068969] [WARN ] [MAIN ] RTO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:19:34.069007] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-10T21:19:34.069063] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-10T21:19:34.069098] [INFO ] [LOCAL ] RTO: Starting deletion of derivative data. [2025-10-10T21:19:34.069136] [DEBUG] [LOCAL ] RTO: No derivative data file found to delete. [2025-10-10T21:19:34.069191] [INFO ] [MAIN ] Update Progress: 1842/2373 symbols completed. RTO took 28.3s. Estimated remaining: 1h 14m 48s. Rate: 7.1 symbols/min [2025-10-10T21:19:34.238703] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:19:34.239070] [DEBUG] [LOCAL ] RVTY: No existing data file found in primary storage. [2025-10-10T21:19:34.239124] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-10-10T21:19:34.239243] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-10T21:19:34.239285] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-10T21:19:34.239326] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-10T21:19:34.239359] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-10T21:19:34.593325] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:19:34.695030] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-10-10T21:19:34.701112] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-10T21:19:34.850024] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T21:19:34.854892] [INFO ] [REMOTE ] RVLV: Full fetch complete (68439 records). [2025-10-10T21:19:34.855013] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-10T21:19:34.855748] [FATAL] [VALIDATOR ] RVLV: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:19:34.855855] [FATAL] [MAIN ] RVLV: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:19:34.855919] [WARN ] [MAIN ] RVLV: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:19:34.855993] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-10T21:19:34.856059] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-10T21:19:34.856095] [INFO ] [LOCAL ] RVLV: Starting deletion of derivative data. [2025-10-10T21:19:34.856132] [DEBUG] [LOCAL ] RVLV: No derivative data file found to delete. [2025-10-10T21:19:34.856190] [INFO ] [MAIN ] Update Progress: 1843/2373 symbols completed. RVLV took 29.1s. Estimated remaining: 1h 14m 38s. Rate: 7.1 symbols/min [2025-10-10T21:19:35.022351] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:19:35.022492] [DEBUG] [LOCAL ] RWT: No existing data file found in primary storage. [2025-10-10T21:19:35.022529] [WARN ] [MAIN ] RWT: No existing data found, performing full refresh instead. [2025-10-10T21:19:35.022659] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-10T21:19:35.022718] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-10T21:19:35.022807] [DEBUG] [LOCAL ] RWT: No primary data file found to delete. [2025-10-10T21:19:35.022848] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-10T21:19:35.373254] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:19:35.489372] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-10T21:19:36.289355] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-10-10T21:19:36.315771] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T21:19:36.760024] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T21:19:37.089403] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-10T21:19:37.615053] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T21:19:37.889390] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-10T21:19:37.978473] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-10T21:19:37.983771] [INFO ] [REMOTE ] RTX: Full fetch complete (77342 records). [2025-10-10T21:19:37.983976] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-10T21:19:37.984828] [FATAL] [VALIDATOR ] RTX: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:19:37.984924] [FATAL] [MAIN ] RTX: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:19:37.984968] [WARN ] [MAIN ] RTX: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:19:37.985050] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-10T21:19:37.985126] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-10T21:19:37.985164] [INFO ] [LOCAL ] RTX: Starting deletion of derivative data. [2025-10-10T21:19:37.985205] [DEBUG] [LOCAL ] RTX: No derivative data file found to delete. [2025-10-10T21:19:37.985272] [INFO ] [MAIN ] Update Progress: 1844/2373 symbols completed. RTX took 32.2s. Estimated remaining: 1h 14m 28s. Rate: 7.1 symbols/min [2025-10-10T21:19:38.160804] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:19:38.161145] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-10T21:19:38.161190] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-10T21:19:38.161318] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-10T21:19:38.161360] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-10T21:19:38.161435] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-10T21:19:38.161469] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-10T21:19:38.532464] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:19:38.689391] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-10T21:19:39.390380] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-10T21:19:39.489334] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-10T21:19:40.013964] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T21:19:40.289380] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-10T21:19:40.925253] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-10T21:19:41.089386] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-10-10T21:19:41.889374] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-10-10T21:19:42.146398] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T21:19:42.606442] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-10T21:19:42.689407] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-10T21:19:43.003881] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-10T21:19:43.129005] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-10T21:19:43.489382] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-10T21:19:44.289424] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-10T21:19:45.089405] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-10T21:19:45.465094] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T21:19:45.889379] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-10T21:19:46.012047] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T21:19:46.376443] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-10T21:19:46.689380] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-10T21:19:47.489442] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-10T21:19:48.078184] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-10T21:19:48.288318] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-10T21:19:48.297345] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-10T21:19:48.314068] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-10T21:19:48.938606] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-10T21:19:49.089413] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-10T21:19:49.889391] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-10T21:19:50.492992] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-10T21:19:50.562426] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-10T21:19:50.689401] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-10T21:19:51.279441] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-10T21:19:51.489383] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-10T21:19:52.289411] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-10T21:19:52.853780] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-10T21:19:53.089407] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-10T21:19:53.889387] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-10T21:19:53.924184] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T21:19:54.370481] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-10T21:19:54.689383] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-10T21:19:54.818860] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-10T21:19:55.489409] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-10T21:19:55.938818] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T21:19:56.289398] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-10T21:19:56.916418] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-10T21:19:57.089399] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-10T21:19:57.546639] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T21:19:57.889402] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-10T21:19:58.689406] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-10T21:19:58.974437] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T21:19:59.197944] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-10T21:19:59.489398] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-10T21:19:59.765409] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T21:20:00.289466] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-10T21:20:01.089346] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-10T21:20:01.579631] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-10T21:20:01.889394] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-10T21:20:01.917554] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-10T21:20:02.214428] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T21:20:02.689387] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-10T21:20:03.489439] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-10T21:20:03.578925] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T21:20:04.289336] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-10T21:20:04.485502] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-10T21:20:05.039279] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-10T21:20:05.041703] [INFO ] [REMOTE ] RVT: Full fetch complete (38965 records). [2025-10-10T21:20:05.041783] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-10T21:20:05.042421] [FATAL] [VALIDATOR ] RVT: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:20:05.042504] [FATAL] [MAIN ] RVT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:20:05.042546] [WARN ] [MAIN ] RVT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:20:05.042585] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-10T21:20:05.042673] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-10T21:20:05.042734] [INFO ] [LOCAL ] RVT: Starting deletion of derivative data. [2025-10-10T21:20:05.042780] [DEBUG] [LOCAL ] RVT: No derivative data file found to delete. [2025-10-10T21:20:05.042834] [INFO ] [MAIN ] Update Progress: 1845/2373 symbols completed. RVT took 31.6s. Estimated remaining: 1h 14m 25s. Rate: 7.1 symbols/min [2025-10-10T21:20:05.092324] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-10T21:20:05.221813] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:20:05.221991] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-10T21:20:05.222028] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-10T21:20:05.222146] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-10T21:20:05.222203] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-10T21:20:05.222248] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-10T21:20:05.222281] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-10T21:20:05.577214] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:20:05.605942] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-10T21:20:05.738427] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-10T21:20:05.889404] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-10T21:20:06.689402] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-10T21:20:07.257251] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-10T21:20:07.258297] [INFO ] [REMOTE ] RWTN: Full fetch complete (3122 records). [2025-10-10T21:20:07.258382] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-10T21:20:07.447007] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-10T21:20:07.447281] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:20:07.447349] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:20:07.447420] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-10T21:20:07.447482] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-10T21:20:07.447518] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-10T21:20:07.447556] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-10T21:20:07.447614] [INFO ] [MAIN ] Update Progress: 1846/2373 symbols completed. RWTN took 29.5s. Estimated remaining: 1h 14m 14s. Rate: 7.1 symbols/min [2025-10-10T21:20:07.494479] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-10T21:20:07.638145] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:20:07.638568] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-10T21:20:07.638773] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-10T21:20:07.638930] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-10T21:20:07.639089] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-10T21:20:07.639200] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-10T21:20:07.639336] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-10T21:20:08.041851] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-10T21:20:08.039615] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:20:08.289358] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-10T21:20:09.089373] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-10-10T21:20:09.203258] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T21:20:09.208225] [INFO ] [REMOTE ] RVTY: Full fetch complete (66715 records). [2025-10-10T21:20:09.208400] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-10T21:20:09.209422] [FATAL] [VALIDATOR ] RVTY: Data is stale - most recent date (2025-10-09) is before last completed trading day (2025-10-10). Symbol may be delisted or halted. [2025-10-10T21:20:09.209557] [FATAL] [MAIN ] RVTY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:20:09.209628] [WARN ] [MAIN ] RVTY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:20:09.209735] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-10T21:20:09.209823] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-10T21:20:09.209874] [INFO ] [LOCAL ] RVTY: Starting deletion of derivative data. [2025-10-10T21:20:09.209929] [DEBUG] [LOCAL ] RVTY: No derivative data file found to delete. [2025-10-10T21:20:09.210015] [INFO ] [MAIN ] Update Progress: 1847/2373 symbols completed. RVTY took 35.1s. Estimated remaining: 1h 14m 4s. Rate: 7.1 symbols/min [2025-10-10T21:20:09.390365] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:20:09.390785] [DEBUG] [LOCAL ] RXO: No existing data file found in primary storage. [2025-10-10T21:20:09.390936] [WARN ] [MAIN ] RXO: No existing data found, performing full refresh instead. [2025-10-10T21:20:09.391073] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-10T21:20:09.391117] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-10T21:20:09.391189] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-10T21:20:09.391242] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-10T21:20:09.460221] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:20:09.490182] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-10-10T21:20:09.490364] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:20:09.502867] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-10-10T21:20:09.503186] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:20:09.503779] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-10T21:20:09.503898] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-10T21:20:09.509406] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-10T21:20:09.519825] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-10T21:20:09.546245] [INFO ] [MAIN ] Update Progress: 1848/2373 symbols completed. RWTP took 2.1s. Estimated remaining: 1h 13m 53s. Rate: 7.1 symbols/min [2025-10-10T21:20:09.894147] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:20:09.890559] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-10-10T21:20:09.931308] [DEBUG] [LOCAL ] RY: No existing data file found in primary storage. [2025-10-10T21:20:09.983760] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-10T21:20:09.980347] [WARN ] [MAIN ] RY: No existing data found, performing full refresh instead. [2025-10-10T21:20:10.006324] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:20:10.015051] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-10T21:20:10.016569] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-10T21:20:10.016876] [DEBUG] [LOCAL ] RY: No primary data file found to delete. [2025-10-10T21:20:10.016934] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-10T21:20:10.396596] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:20:10.573138] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-10T21:20:10.689349] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-10T21:20:11.489407] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-10T21:20:12.061743] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-10T21:20:12.100578] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T21:20:12.289337] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-10T21:20:13.089448] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-10T21:20:13.740999] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-10T21:20:13.889395] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-10T21:20:14.184710] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T21:20:14.318365] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-10T21:20:14.689415] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-10-10T21:20:15.489360] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-10T21:20:16.289437] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-10T21:20:16.582893] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T21:20:17.089398] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-10T21:20:17.268027] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T21:20:17.272014] [INFO ] [REMOTE ] RWT: Full fetch complete (58364 records). [2025-10-10T21:20:17.272161] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-10T21:20:17.350133] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-10T21:20:17.649493] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-10T21:20:17.649575] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-10T21:20:17.650460] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-10T21:20:17.650523] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-10T21:20:17.651684] [DEBUG] [LOCAL ] RWT: Trimmed 58364 records to 41423 (keeping 200 days of data) [2025-10-10T21:20:17.889433] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-10-10T21:20:17.892114] [DEBUG] [LOCAL ] RWT: Primary data saved (41423 records). [2025-10-10T21:20:17.892185] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-10T21:20:17.892292] [INFO ] [MAIN ] Update Progress: 1849/2373 symbols completed. RWT took 43.0s. Estimated remaining: 1h 13m 45s. Rate: 7.1 symbols/min [2025-10-10T21:20:18.058872] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:20:18.092234] [DEBUG] [LOCAL ] RYAM: Loaded 35363 existing records from primary storage. [2025-10-10T21:20:18.092515] [INFO ] [MAIN ] RYAM: Loaded 35363 existing records. [2025-10-10T21:20:18.296135] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:20:18.296366] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-10T21:20:18.296415] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-10T21:20:18.296692] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-10-10T21:20:18.296752] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-10T21:20:18.659896] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:20:18.689349] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-10T21:20:18.823844] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T21:20:19.350364] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-10T21:20:19.489361] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-10T21:20:19.854912] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T21:20:20.289388] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-10-10T21:20:20.864116] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T21:20:21.089384] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-10T21:20:21.900539] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-10T21:20:21.902884] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-10T21:20:22.689342] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-10T21:20:23.101521] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-10T21:20:23.254977] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-10T21:20:23.489343] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-10T21:20:23.533883] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T21:20:24.255051] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-10T21:20:24.289358] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-10T21:20:25.089382] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-10T21:20:25.104837] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-10T21:20:25.889438] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-10T21:20:26.689401] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-10T21:20:27.054738] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T21:20:27.489396] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-10T21:20:27.523015] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-10T21:20:27.903127] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-10T21:20:28.289402] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-10T21:20:28.919483] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-10T21:20:28.920692] [INFO ] [REMOTE ] RWTO: Full fetch complete (4837 records). [2025-10-10T21:20:28.920772] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-10T21:20:29.112463] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-10T21:20:29.120415] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-10T21:20:29.121507] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:20:29.121590] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:20:29.121670] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-10T21:20:29.121770] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-10T21:20:29.121814] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-10T21:20:29.121856] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-10T21:20:29.121927] [INFO ] [MAIN ] Update Progress: 1850/2373 symbols completed. RWTO took 24.1s. Estimated remaining: 1h 13m 37s. Rate: 7.1 symbols/min [2025-10-10T21:20:29.307265] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:20:29.357092] [DEBUG] [LOCAL ] RYAN: Loaded 45041 existing records from primary storage. [2025-10-10T21:20:29.357769] [INFO ] [MAIN ] RYAN: Loaded 45041 existing records. [2025-10-10T21:20:29.497562] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T21:20:29.594097] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:20:29.594457] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-10T21:20:29.594509] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-10T21:20:29.594869] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-10-10T21:20:29.594927] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-10T21:20:29.894578] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-10T21:20:30.012769] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:20:30.689391] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-10T21:20:31.135882] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-10T21:20:31.489368] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-10T21:20:31.826468] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T21:20:31.912267] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-10T21:20:32.289408] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-10-10T21:20:33.089370] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-10T21:20:33.667825] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-10T21:20:33.889420] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-10T21:20:34.169550] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T21:20:34.689404] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-10T21:20:34.830700] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-10T21:20:35.137109] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-10T21:20:35.489380] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-10T21:20:36.212674] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-10T21:20:36.289384] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-10T21:20:37.089424] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-10T21:20:37.424573] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T21:20:37.551918] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T21:20:37.889399] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-10T21:20:38.549391] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-10T21:20:38.689404] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-10T21:20:39.489426] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-10T21:20:39.832327] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T21:20:40.049279] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-10T21:20:40.289416] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-10T21:20:41.089392] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-10T21:20:41.247276] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T21:20:41.889392] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-10T21:20:42.244563] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-10T21:20:42.249821] [INFO ] [REMOTE ] RXO: Full fetch complete (68511 records). [2025-10-10T21:20:42.250029] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-10T21:20:42.307965] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T21:20:42.696133] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-10T21:20:42.748960] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-10-10T21:20:42.749045] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-10-10T21:20:42.750296] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-10-10T21:20:42.750385] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-10-10T21:20:42.751879] [DEBUG] [LOCAL ] RXO: Trimmed 68511 records to 48815 (keeping 200 days of data) [2025-10-10T21:20:43.071874] [DEBUG] [LOCAL ] RXO: Primary data saved (48815 records). [2025-10-10T21:20:43.072049] [INFO ] [MAIN ] RXO: Full history saved. [2025-10-10T21:20:43.072142] [INFO ] [MAIN ] Update Progress: 1851/2373 symbols completed. RXO took 33.9s. Estimated remaining: 1h 13m 30s. Rate: 7.1 symbols/min [2025-10-10T21:20:43.261588] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:20:43.289514] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-10T21:20:43.313605] [DEBUG] [LOCAL ] RYI: Loaded 21708 existing records from primary storage. [2025-10-10T21:20:43.313879] [INFO ] [MAIN ] RYI: Loaded 21708 existing records. [2025-10-10T21:20:43.493677] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-10T21:20:43.496838] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:20:43.497939] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-10T21:20:43.498067] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-10T21:20:43.498409] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-10T21:20:43.498545] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-10T21:20:43.858733] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:20:44.289372] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-10T21:20:44.425061] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T21:20:45.089352] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-10T21:20:45.530560] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-10T21:20:45.889409] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-10T21:20:46.068091] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-10T21:20:46.190172] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-10T21:20:46.689399] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-10-10T21:20:47.489413] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-10T21:20:47.663035] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T21:20:47.758681] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-10T21:20:48.289398] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-10T21:20:48.711364] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T21:20:49.089409] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-10T21:20:49.796750] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-10T21:20:49.889514] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-10T21:20:50.384738] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T21:20:50.689414] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-10T21:20:51.489351] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-10T21:20:51.799593] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-10T21:20:52.043608] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T21:20:52.289366] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-10T21:20:52.469062] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T21:20:53.089382] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-10T21:20:53.886428] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T21:20:53.890972] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-10T21:20:53.892698] [INFO ] [REMOTE ] RY: Full fetch complete (68971 records). [2025-10-10T21:20:53.892848] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-10T21:20:54.302195] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-10-10T21:20:54.302308] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-10-10T21:20:54.303393] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-10-10T21:20:54.303500] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-10-10T21:20:54.319041] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-10T21:20:54.324342] [DEBUG] [LOCAL ] RY: Trimmed 68971 records to 48560 (keeping 200 days of data) [2025-10-10T21:20:54.628069] [DEBUG] [LOCAL ] RY: Primary data saved (48560 records). [2025-10-10T21:20:54.628217] [INFO ] [MAIN ] RY: Full history saved. [2025-10-10T21:20:54.628295] [INFO ] [MAIN ] Update Progress: 1852/2373 symbols completed. RY took 45.1s. Estimated remaining: 1h 13m 23s. Rate: 7.1 symbols/min [2025-10-10T21:20:54.694559] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-10T21:20:54.796908] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:20:54.836746] [DEBUG] [LOCAL ] RYN: Loaded 45758 existing records from primary storage. [2025-10-10T21:20:54.840424] [INFO ] [MAIN ] RYN: Loaded 45758 existing records. [2025-10-10T21:20:55.011125] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:20:55.011296] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-10T21:20:55.011342] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-10T21:20:55.011537] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-10-10T21:20:55.011592] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-10T21:20:55.351043] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:20:55.489326] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-10-10T21:20:55.666819] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T21:20:56.289378] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-10T21:20:56.447199] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-10T21:20:57.089349] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-10T21:20:57.126016] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-10T21:20:57.164774] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T21:20:57.889434] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-10T21:20:58.689344] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-10T21:20:58.839371] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T21:20:59.058909] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T21:20:59.489375] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-10T21:21:00.289351] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-10T21:21:00.375891] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T21:21:01.060553] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T21:21:01.089362] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-10T21:21:01.516995] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T21:21:01.889387] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-10T21:21:02.476761] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-10T21:21:02.480374] [INFO ] [REMOTE ] RYAM: Full fetch complete (49087 records). [2025-10-10T21:21:02.480470] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-10T21:21:02.694502] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-10T21:21:02.862599] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-10-10T21:21:02.862702] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-10-10T21:21:02.863696] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-10-10T21:21:02.863760] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-10-10T21:21:02.864823] [DEBUG] [LOCAL ] RYAM: Trimmed 49087 records to 35637 (keeping 200 days of data) [2025-10-10T21:21:03.074424] [DEBUG] [LOCAL ] RYAM: Primary data saved (35637 records). [2025-10-10T21:21:03.074563] [INFO ] [MAIN ] RYAM: Full history saved. [2025-10-10T21:21:03.074666] [INFO ] [MAIN ] Update Progress: 1853/2373 symbols completed. RYAM took 45.2s. Estimated remaining: 1h 13m 14s. Rate: 7.1 symbols/min [2025-10-10T21:21:03.259933] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:21:03.268160] [DEBUG] [LOCAL ] RZB: Loaded 6067 existing records from primary storage. [2025-10-10T21:21:03.268403] [INFO ] [MAIN ] RZB: Loaded 6067 existing records. [2025-10-10T21:21:03.450004] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:21:03.450246] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-10T21:21:03.450293] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-10T21:21:03.450437] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-10T21:21:03.450483] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-10T21:21:03.506589] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-10T21:21:03.816673] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:21:03.870578] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T21:21:04.194734] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T21:21:04.289356] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-10T21:21:05.089361] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-10T21:21:05.344632] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T21:21:05.636768] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-10T21:21:05.889372] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-10T21:21:06.141568] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T21:21:06.146841] [INFO ] [REMOTE ] RYAN: Full fetch complete (64225 records). [2025-10-10T21:21:06.147020] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-10T21:21:06.598941] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-10-10T21:21:06.599032] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-10-10T21:21:06.600230] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-10-10T21:21:06.600297] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-10-10T21:21:06.601853] [DEBUG] [LOCAL ] RYAN: Trimmed 64225 records to 45390 (keeping 200 days of data) [2025-10-10T21:21:06.700492] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-10-10T21:21:06.895507] [DEBUG] [LOCAL ] RYAN: Primary data saved (45390 records). [2025-10-10T21:21:06.895691] [INFO ] [MAIN ] RYAN: Full history saved. [2025-10-10T21:21:06.895796] [INFO ] [MAIN ] Update Progress: 1854/2373 symbols completed. RYAN took 37.8s. Estimated remaining: 1h 13m 5s. Rate: 7.1 symbols/min [2025-10-10T21:21:07.066962] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:21:07.076515] [DEBUG] [LOCAL ] RZC: Loaded 6815 existing records from primary storage. [2025-10-10T21:21:07.076751] [INFO ] [MAIN ] RZC: Loaded 6815 existing records. [2025-10-10T21:21:07.258782] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:21:07.259228] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-10T21:21:07.259511] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-10T21:21:07.266183] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-10T21:21:07.275395] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-10T21:21:07.321504] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-10T21:21:07.495942] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-10T21:21:07.674945] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:21:07.788848] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-10T21:21:08.289383] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-10-10T21:21:09.089370] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-10T21:21:09.140365] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-10T21:21:09.441543] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T21:21:09.889383] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-10T21:21:10.173091] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T21:21:10.175392] [INFO ] [REMOTE ] RYI: Full fetch complete (31987 records). [2025-10-10T21:21:10.175467] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-10T21:21:10.558189] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-10T21:21:10.558276] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-10T21:21:10.559071] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-10T21:21:10.559135] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-10T21:21:10.560013] [DEBUG] [LOCAL ] RYI: Trimmed 31987 records to 21850 (keeping 200 days of data) [2025-10-10T21:21:10.657756] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-10T21:21:10.690723] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-10T21:21:10.711087] [DEBUG] [LOCAL ] RYI: Primary data saved (21850 records). [2025-10-10T21:21:10.711290] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-10T21:21:10.711414] [INFO ] [MAIN ] Update Progress: 1855/2373 symbols completed. RYI took 27.6s. Estimated remaining: 1h 12m 55s. Rate: 7.1 symbols/min [2025-10-10T21:21:10.875487] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:21:10.926811] [DEBUG] [LOCAL ] S: Loaded 53920 existing records from primary storage. [2025-10-10T21:21:10.927176] [INFO ] [MAIN ] S: Loaded 53920 existing records. [2025-10-10T21:21:11.096717] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:21:11.096964] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-10T21:21:11.097048] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-10T21:21:11.097366] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-10T21:21:11.097422] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-10T21:21:11.440160] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:21:11.489329] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-10-10T21:21:12.289441] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-10T21:21:12.596932] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T21:21:13.089394] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-10T21:21:13.152724] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-10T21:21:13.889457] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-10T21:21:14.210187] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-10-10T21:21:14.689396] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-10T21:21:14.815110] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-10T21:21:14.856342] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-10T21:21:15.489391] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-10T21:21:16.289369] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-10T21:21:16.890621] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-10T21:21:17.089354] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-10T21:21:17.889411] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-10T21:21:18.153010] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-10T21:21:18.272321] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-10T21:21:18.619950] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-10T21:21:18.689340] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-10T21:21:19.392437] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T21:21:19.489351] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-10T21:21:19.787465] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (4.30 seconds). [2025-10-10T21:21:20.289354] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-10T21:21:21.089375] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-10T21:21:21.417915] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T21:21:21.786029] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-10T21:21:21.889474] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-10T21:21:22.398207] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-10T21:21:22.622091] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-10T21:21:22.689396] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-10T21:21:23.489340] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-10T21:21:23.549861] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-10T21:21:24.289392] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-10T21:21:24.388014] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-10T21:21:25.089381] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-10T21:21:25.889444] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-10T21:21:25.972712] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-10T21:21:26.651843] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-10T21:21:26.689359] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-10T21:21:27.364476] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-10T21:21:27.489338] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-10T21:21:27.570394] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-10T21:21:28.289400] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-10T21:21:29.032437] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-10T21:21:29.089429] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-10T21:21:29.713325] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-10T21:21:29.889384] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-10T21:21:30.577244] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-10T21:21:30.689373] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-10T21:21:30.940872] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T21:21:31.489346] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-10T21:21:31.795214] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-10T21:21:32.289387] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-10T21:21:32.736130] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-10T21:21:32.740576] [INFO ] [REMOTE ] RYN: Full fetch complete (65082 records). [2025-10-10T21:21:32.740694] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-10T21:21:33.043529] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-10T21:21:33.094892] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-10T21:21:33.140801] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-10T21:21:33.140878] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-10T21:21:33.141862] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-10T21:21:33.141925] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-10T21:21:33.143476] [DEBUG] [LOCAL ] RYN: Trimmed 65082 records to 46093 (keeping 200 days of data) [2025-10-10T21:21:33.432480] [DEBUG] [LOCAL ] RYN: Primary data saved (46093 records). [2025-10-10T21:21:33.432830] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-10T21:21:33.432950] [INFO ] [MAIN ] Update Progress: 1856/2373 symbols completed. RYN took 38.8s. Estimated remaining: 1h 12m 50s. Rate: 7.1 symbols/min [2025-10-10T21:21:33.608833] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:21:33.650395] [DEBUG] [LOCAL ] SA: Loaded 44266 existing records from primary storage. [2025-10-10T21:21:33.650722] [INFO ] [MAIN ] SA: Loaded 44266 existing records. [2025-10-10T21:21:33.808244] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T21:21:33.821116] [INFO ] [REMOTE ] RZC: Full fetch complete (9689 records). [2025-10-10T21:21:33.836039] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-10T21:21:33.841688] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:21:33.896360] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-10T21:21:33.896617] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-10T21:21:33.913197] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-10T21:21:33.924668] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-10T21:21:33.930035] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-10T21:21:34.556536] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-10T21:21:34.569148] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-10T21:21:34.579764] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-10T21:21:34.579850] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-10T21:21:34.590042] [DEBUG] [LOCAL ] RZC: Trimmed 9689 records to 6854 (keeping 200 days of data) [2025-10-10T21:21:34.610892] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:21:34.651982] [DEBUG] [LOCAL ] RZC: Primary data saved (6854 records). [2025-10-10T21:21:34.652101] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-10T21:21:34.652187] [INFO ] [MAIN ] Update Progress: 1857/2373 symbols completed. RZC took 27.8s. Estimated remaining: 1h 12m 40s. Rate: 7.1 symbols/min [2025-10-10T21:21:34.694847] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-10-10T21:21:34.749544] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-10T21:21:34.834600] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:21:34.845778] [DEBUG] [LOCAL ] SABA: Loaded 9341 existing records from primary storage. [2025-10-10T21:21:34.846021] [INFO ] [MAIN ] SABA: Loaded 9341 existing records. [2025-10-10T21:21:35.025454] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:21:35.025777] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-10T21:21:35.025829] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-10T21:21:35.026019] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-10T21:21:35.026076] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-10T21:21:35.388503] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:21:35.489380] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-10T21:21:36.248444] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-10T21:21:36.289399] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-10T21:21:36.440016] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-10T21:21:36.821633] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-10T21:21:36.822911] [INFO ] [REMOTE ] RZB: Full fetch complete (8524 records). [2025-10-10T21:21:36.822999] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-10T21:21:37.094579] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-10-10T21:21:37.194590] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-10T21:21:37.194691] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-10T21:21:37.194930] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-10T21:21:37.194969] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-10T21:21:37.195377] [DEBUG] [LOCAL ] RZB: Trimmed 8524 records to 6096 (keeping 200 days of data) [2025-10-10T21:21:37.232210] [DEBUG] [LOCAL ] RZB: Primary data saved (6096 records). [2025-10-10T21:21:37.232349] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-10T21:21:37.232432] [INFO ] [MAIN ] Update Progress: 1858/2373 symbols completed. RZB took 34.2s. Estimated remaining: 1h 12m 30s. Rate: 7.1 symbols/min [2025-10-10T21:21:37.400784] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:21:37.432102] [DEBUG] [LOCAL ] SAFE: Loaded 30510 existing records from primary storage. [2025-10-10T21:21:37.432371] [INFO ] [MAIN ] SAFE: Loaded 30510 existing records. [2025-10-10T21:21:37.609515] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:21:37.609778] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-10T21:21:37.609831] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-10T21:21:37.610507] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-10T21:21:37.610566] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-10T21:21:37.894493] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-10T21:21:37.961234] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:21:38.099112] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T21:21:38.689376] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-10T21:21:39.489387] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-10T21:21:39.680444] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T21:21:39.859191] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T21:21:40.289403] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-10-10T21:21:41.089385] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-10T21:21:41.594280] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-10T21:21:41.894593] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-10T21:21:41.929272] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-10T21:21:42.080674] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-10T21:21:42.689369] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-10T21:21:43.490729] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-10T21:21:43.496362] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-10T21:21:44.289412] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-10T21:21:45.089436] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-10T21:21:45.286433] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T21:21:45.320138] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-10T21:21:45.598951] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T21:21:45.889402] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-10T21:21:46.013932] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-10T21:21:46.689382] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-10T21:21:47.489419] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-10T21:21:47.710268] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T21:21:47.938815] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-10T21:21:48.289378] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-10T21:21:49.089408] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-10T21:21:49.889919] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-10T21:21:49.892845] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-10T21:21:49.963395] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-10T21:21:50.438503] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T21:21:50.495567] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-10T21:21:50.689394] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-10T21:21:51.489396] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-10T21:21:51.601563] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-10T21:21:52.289457] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-10T21:21:53.089451] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-10T21:21:53.275208] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T21:21:53.376364] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-10T21:21:53.649906] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-10T21:21:53.889379] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-10T21:21:54.689394] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-10T21:21:55.489381] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-10T21:21:55.624693] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T21:21:55.658529] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-10T21:21:56.289371] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-10T21:21:56.805342] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-10T21:21:57.071707] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-10T21:21:57.089330] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-10T21:21:57.889377] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-10T21:21:58.689359] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-10T21:21:59.162057] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-10T21:21:59.278050] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-10T21:21:59.283162] [INFO ] [REMOTE ] S: Full fetch complete (77544 records). [2025-10-10T21:21:59.283290] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-10T21:21:59.499184] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-10T21:21:59.675043] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-10T21:21:59.675131] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-10T21:21:59.676297] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-10T21:21:59.676363] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-10T21:21:59.681375] [DEBUG] [LOCAL ] S: Trimmed 77544 records to 54310 (keeping 200 days of data) [2025-10-10T21:22:00.001618] [DEBUG] [LOCAL ] S: Primary data saved (54310 records). [2025-10-10T21:22:00.001787] [INFO ] [MAIN ] S: Full history saved. [2025-10-10T21:22:00.002174] [INFO ] [MAIN ] Update Progress: 1859/2373 symbols completed. S took 49.3s. Estimated remaining: 1h 12m 25s. Rate: 7.1 symbols/min [2025-10-10T21:22:00.168025] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:22:00.191222] [DEBUG] [LOCAL ] SAH: Loaded 21703 existing records from primary storage. [2025-10-10T21:22:00.191468] [INFO ] [MAIN ] SAH: Loaded 21703 existing records. [2025-10-10T21:22:00.289467] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-10T21:22:00.369734] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:22:00.369967] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-10T21:22:00.370016] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-10T21:22:00.370243] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-10T21:22:00.370301] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-10T21:22:00.723783] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-10T21:22:00.768719] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:22:01.089414] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-10-10T21:22:01.141380] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T21:22:01.405569] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T21:22:01.889388] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-10T21:22:02.177613] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-10T21:22:02.506032] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T21:22:02.507766] [INFO ] [REMOTE ] SABA: Full fetch complete (15287 records). [2025-10-10T21:22:02.507877] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-10T21:22:02.696903] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-10T21:22:02.914996] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-10T21:22:02.915081] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-10T21:22:02.915580] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-10T21:22:02.915704] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-10T21:22:02.916259] [DEBUG] [LOCAL ] SABA: Trimmed 15287 records to 9412 (keeping 200 days of data) [2025-10-10T21:22:02.978681] [DEBUG] [LOCAL ] SABA: Primary data saved (9412 records). [2025-10-10T21:22:02.978945] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-10T21:22:02.979127] [INFO ] [MAIN ] Update Progress: 1860/2373 symbols completed. SABA took 28.3s. Estimated remaining: 1h 12m 15s. Rate: 7.1 symbols/min [2025-10-10T21:22:03.159304] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:22:03.159520] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-10T21:22:03.159578] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-10T21:22:03.159727] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-10T21:22:03.159777] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-10T21:22:03.159823] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-10T21:22:03.159871] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-10T21:22:03.494520] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-10T21:22:03.524632] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:22:04.289365] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-10T21:22:04.353884] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-10T21:22:04.727368] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-10T21:22:05.089416] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-10T21:22:05.716430] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-10T21:22:05.889365] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-10-10T21:22:06.286316] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-10T21:22:06.625707] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-10T21:22:06.689391] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-10T21:22:07.489437] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-10T21:22:07.998481] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-10T21:22:08.001408] [INFO ] [REMOTE ] SAFE: Full fetch complete (44686 records). [2025-10-10T21:22:08.001534] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-10T21:22:08.290682] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-10T21:22:08.383145] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-10T21:22:08.383234] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-10T21:22:08.384226] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-10T21:22:08.384288] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-10T21:22:08.385257] [DEBUG] [LOCAL ] SAFE: Trimmed 44686 records to 30699 (keeping 200 days of data) [2025-10-10T21:22:08.570045] [DEBUG] [LOCAL ] SAFE: Primary data saved (30699 records). [2025-10-10T21:22:08.570273] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-10T21:22:08.570366] [INFO ] [MAIN ] Update Progress: 1861/2373 symbols completed. SAFE took 31.3s. Estimated remaining: 1h 12m 6s. Rate: 7.1 symbols/min [2025-10-10T21:22:08.735524] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:22:08.756964] [DEBUG] [LOCAL ] SAM: Loaded 21510 existing records from primary storage. [2025-10-10T21:22:08.757264] [INFO ] [MAIN ] SAM: Loaded 21510 existing records. [2025-10-10T21:22:08.934583] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:22:08.934813] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-10T21:22:08.934865] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-10T21:22:08.935093] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-10T21:22:08.935148] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-10T21:22:09.107029] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-10T21:22:09.306064] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:22:09.366204] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T21:22:09.438555] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-10T21:22:09.441600] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-10T21:22:09.889397] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-10T21:22:10.689383] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-10-10T21:22:11.489399] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-10T21:22:11.674756] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-10T21:22:11.679944] [INFO ] [REMOTE ] SA: Full fetch complete (62860 records). [2025-10-10T21:22:11.680079] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-10T21:22:11.820709] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T21:22:11.890105] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-10T21:22:12.108508] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-10T21:22:12.108638] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-10T21:22:12.110515] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-10T21:22:12.110588] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-10T21:22:12.112553] [DEBUG] [LOCAL ] SA: Trimmed 62860 records to 44639 (keeping 200 days of data) [2025-10-10T21:22:12.296816] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-10T21:22:12.397738] [DEBUG] [LOCAL ] SA: Primary data saved (44639 records). [2025-10-10T21:22:12.397981] [INFO ] [MAIN ] SA: Full history saved. [2025-10-10T21:22:12.398161] [INFO ] [MAIN ] Update Progress: 1862/2373 symbols completed. SA took 39.0s. Estimated remaining: 1h 11m 56s. Rate: 7.1 symbols/min [2025-10-10T21:22:12.567111] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:22:12.616076] [DEBUG] [LOCAL ] SAN: Loaded 53356 existing records from primary storage. [2025-10-10T21:22:12.616401] [INFO ] [MAIN ] SAN: Loaded 53356 existing records. [2025-10-10T21:22:12.787067] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:22:12.787293] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-10T21:22:12.787339] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-10T21:22:12.787531] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-10T21:22:12.787568] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-10T21:22:13.098323] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-10T21:22:13.138472] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:22:13.623266] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T21:22:13.889440] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-10T21:22:14.263333] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-10T21:22:14.542803] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-10T21:22:14.689389] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-10T21:22:15.489439] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-10-10T21:22:16.183757] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-10T21:22:16.289356] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-10T21:22:16.955479] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-10T21:22:17.089348] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-10T21:22:17.634735] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-10T21:22:17.889382] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-10T21:22:18.259452] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-10T21:22:18.689343] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-10T21:22:19.085879] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-10T21:22:19.129529] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T21:22:19.489395] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-10T21:22:20.289361] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-10T21:22:20.713706] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T21:22:21.089360] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-10T21:22:21.354506] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-10T21:22:21.573673] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T21:22:21.889343] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-10T21:22:22.293858] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-10T21:22:22.689382] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-10T21:22:23.085236] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-10T21:22:23.489392] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-10T21:22:24.289619] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-10T21:22:24.682139] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-10T21:22:25.089380] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-10T21:22:25.524629] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-10T21:22:25.889408] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-10T21:22:26.162936] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-10T21:22:26.163545] [INFO ] [REMOTE ] SAJ: Full fetch complete (922 records). [2025-10-10T21:22:26.163612] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-10T21:22:26.338762] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-10T21:22:26.338955] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:22:26.339029] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:22:26.339102] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-10T21:22:26.339186] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-10T21:22:26.339243] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-10T21:22:26.339291] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-10T21:22:26.339348] [INFO ] [MAIN ] Update Progress: 1863/2373 symbols completed. SAJ took 23.4s. Estimated remaining: 1h 11m 49s. Rate: 7.1 symbols/min [2025-10-10T21:22:26.504171] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-10T21:22:26.523098] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:22:26.577779] [DEBUG] [LOCAL ] SAND: Loaded 52210 existing records from primary storage. [2025-10-10T21:22:26.578086] [INFO ] [MAIN ] SAND: Loaded 52210 existing records. [2025-10-10T21:22:26.694494] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-10T21:22:26.757625] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:22:26.757868] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-10-10T21:22:26.757940] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-10-10T21:22:26.758476] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-10-10T21:22:26.758535] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-10-10T21:22:27.103076] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:22:27.489361] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-10-10T21:22:28.023826] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-10T21:22:28.289369] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-10T21:22:29.089400] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-10T21:22:29.425350] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T21:22:29.460910] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T21:22:29.889381] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-10T21:22:30.512196] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-10T21:22:30.691724] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-10-10T21:22:30.695562] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-10T21:22:31.489396] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-10T21:22:32.289358] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-10T21:22:32.529513] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T21:22:32.819614] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T21:22:33.089367] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-10T21:22:33.889496] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-10T21:22:34.314148] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T21:22:34.434301] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T21:22:34.689373] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-10-10T21:22:35.197970] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-10T21:22:35.489479] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-10T21:22:36.289516] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-10T21:22:36.589407] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T21:22:37.089362] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-10T21:22:37.186854] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-10T21:22:37.189035] [INFO ] [REMOTE ] SAH: Full fetch complete (30662 records). [2025-10-10T21:22:37.189117] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-10T21:22:37.653777] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-10T21:22:37.653984] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-10T21:22:37.654908] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-10T21:22:37.654991] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-10T21:22:37.656018] [DEBUG] [LOCAL ] SAH: Trimmed 30662 records to 21834 (keeping 200 days of data) [2025-10-10T21:22:37.776545] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-10T21:22:37.833690] [DEBUG] [LOCAL ] SAH: Primary data saved (21834 records). [2025-10-10T21:22:37.833840] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-10T21:22:37.833928] [INFO ] [MAIN ] Update Progress: 1864/2373 symbols completed. SAH took 37.8s. Estimated remaining: 1h 11m 42s. Rate: 7.1 symbols/min [2025-10-10T21:22:37.897683] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-10T21:22:38.009537] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:22:38.058479] [DEBUG] [LOCAL ] SAP: Loaded 50268 existing records from primary storage. [2025-10-10T21:22:38.058858] [INFO ] [MAIN ] SAP: Loaded 50268 existing records. [2025-10-10T21:22:38.230764] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:22:38.230978] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-10T21:22:38.231026] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-10T21:22:38.231538] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-10T21:22:38.231594] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-10T21:22:38.596490] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:22:38.607795] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T21:22:38.689411] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-10-10T21:22:39.489381] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-10-10T21:22:40.004996] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-10T21:22:40.289360] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-10T21:22:40.751170] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-10T21:22:40.947536] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-10T21:22:41.089383] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-10T21:22:41.889397] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-10-10T21:22:42.273531] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-10T21:22:42.689408] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-10T21:22:43.070387] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T21:22:43.489371] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-10T21:22:43.857623] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T21:22:44.183340] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-10T21:22:44.289335] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-10T21:22:44.779853] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T21:22:45.089384] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-10-10T21:22:45.889347] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-10T21:22:46.279074] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T21:22:46.689406] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-10T21:22:47.189831] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-10T21:22:47.268213] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T21:22:47.489405] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-10-10T21:22:47.805744] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-10T21:22:47.808786] [INFO ] [REMOTE ] SAM: Full fetch complete (31053 records). [2025-10-10T21:22:47.808880] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-10T21:22:48.181425] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-10T21:22:48.181510] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-10T21:22:48.182195] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-10T21:22:48.182257] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-10T21:22:48.183020] [DEBUG] [LOCAL ] SAM: Trimmed 31053 records to 21699 (keeping 200 days of data) [2025-10-10T21:22:48.293509] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-10T21:22:48.312500] [DEBUG] [LOCAL ] SAM: Primary data saved (21699 records). [2025-10-10T21:22:48.312639] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-10T21:22:48.312765] [INFO ] [MAIN ] Update Progress: 1865/2373 symbols completed. SAM took 39.7s. Estimated remaining: 1h 11m 34s. Rate: 7.1 symbols/min [2025-10-10T21:22:48.483263] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:22:48.500736] [DEBUG] [LOCAL ] SAR: Loaded 17116 existing records from primary storage. [2025-10-10T21:22:48.500989] [INFO ] [MAIN ] SAR: Loaded 17116 existing records. [2025-10-10T21:22:48.678816] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:22:48.679061] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-10T21:22:48.679111] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-10T21:22:48.679344] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-10T21:22:48.679402] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-10T21:22:49.044499] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:22:49.089335] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-10T21:22:49.328432] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T21:22:49.889404] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-10-10T21:22:50.450386] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-10T21:22:50.689382] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-10T21:22:50.917594] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-10T21:22:51.494621] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-10T21:22:51.514907] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T21:22:52.289391] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-10-10T21:22:52.510771] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-10T21:22:52.515853] [INFO ] [REMOTE ] SAN: Full fetch complete (76304 records). [2025-10-10T21:22:52.516020] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-10T21:22:52.896304] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-10T21:22:52.896386] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-10T21:22:52.900707] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-10T21:22:52.900797] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-10T21:22:52.902276] [DEBUG] [LOCAL ] SAN: Trimmed 76304 records to 53743 (keeping 200 days of data) [2025-10-10T21:22:53.098953] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-10-10T21:22:53.216352] [DEBUG] [LOCAL ] SAN: Primary data saved (53743 records). [2025-10-10T21:22:53.216494] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-10T21:22:53.216575] [INFO ] [MAIN ] Update Progress: 1866/2373 symbols completed. SAN took 40.8s. Estimated remaining: 1h 11m 25s. Rate: 7.1 symbols/min [2025-10-10T21:22:53.380578] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:22:53.423718] [DEBUG] [LOCAL ] SARO: Loaded 48788 existing records from primary storage. [2025-10-10T21:22:53.424032] [INFO ] [MAIN ] SARO: Loaded 48788 existing records. [2025-10-10T21:22:53.597590] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:22:53.597876] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-10T21:22:53.597931] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-10T21:22:53.598118] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-10T21:22:53.598158] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-10T21:22:53.958735] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:22:53.959119] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-10-10T21:23:06.522307] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (12.56 seconds). [2025-10-10T21:23:06.532198] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-10T21:23:06.601864] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (14.31 seconds). [2025-10-10T21:23:06.606215] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-10T21:23:07.831783] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-10T21:23:07.835034] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-10T21:23:08.074314] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (16.58 seconds). [2025-10-10T21:23:08.085307] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-10T21:23:08.565339] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (15.47 seconds). [2025-10-10T21:23:08.577005] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-10-10T21:23:08.643079] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-10T21:23:08.649618] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-10T21:23:09.848606] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (3.32 seconds). [2025-10-10T21:23:09.861725] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-10T21:23:09.862727] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-10T21:23:09.868864] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-10T21:23:10.010358] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-10T21:23:10.024022] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-10T21:23:10.124603] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-10T21:23:10.136247] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-10. [2025-10-10T21:23:10.947602] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-10T21:23:10.952313] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-10T21:23:11.440848] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T21:23:11.449561] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-10T21:23:11.853524] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T21:23:11.863902] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-10T21:23:11.955604] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-10T21:23:11.961248] [INFO ] [REMOTE ] SAND: Full fetch complete (74480 records). [2025-10-10T21:23:11.961441] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-10-10T21:23:12.276877] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T21:23:12.297597] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-10T21:23:12.381481] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-10-10T21:23:12.381579] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-10-10T21:23:12.382741] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-10-10T21:23:12.382805] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-10-10T21:23:12.384283] [DEBUG] [LOCAL ] SAND: Trimmed 74480 records to 52596 (keeping 200 days of data) [2025-10-10T21:23:12.711302] [DEBUG] [LOCAL ] SAND: Primary data saved (52596 records). [2025-10-10T21:23:12.711467] [INFO ] [MAIN ] SAND: Full history saved. [2025-10-10T21:23:12.711593] [INFO ] [MAIN ] Update Progress: 1867/2373 symbols completed. SAND took 46.4s. Estimated remaining: 1h 11m 19s. Rate: 7.1 symbols/min [2025-10-10T21:23:12.878800] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:23:12.878983] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-10T21:23:12.879021] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-10T21:23:12.879134] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-10T21:23:12.879176] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-10T21:23:12.879217] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-10T21:23:12.879250] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-10T21:23:13.229247] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:23:13.229756] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-10-10T21:23:13.435034] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T21:23:13.448186] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-10T21:23:13.522265] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T21:23:13.526073] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-10T21:23:13.763068] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-10T21:23:13.764162] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-10T21:23:14.021848] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-10T21:23:14.032807] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-10T21:23:14.079538] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-10T21:23:14.080725] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-10T21:23:14.699420] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-10T21:23:14.701918] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-10T21:23:14.702572] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-10T21:23:14.709032] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-10T21:23:14.864499] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-10T21:23:14.876346] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-10T21:23:15.210874] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-10T21:23:15.212324] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-10T21:23:15.809476] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-10T21:23:15.810875] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-10T21:23:15.824291] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-10T21:23:15.829369] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-10T21:23:16.200717] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-10T21:23:16.211538] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-10T21:23:16.244250] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-10T21:23:16.289393] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-10T21:23:16.681003] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-10T21:23:16.842891] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T21:23:17.059740] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-10T21:23:17.089409] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-10T21:23:17.889402] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-10T21:23:18.120043] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-10T21:23:18.180123] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T21:23:18.183388] [INFO ] [REMOTE ] SAR: Full fetch complete (23596 records). [2025-10-10T21:23:18.183515] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-10T21:23:18.597331] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-10T21:23:18.597470] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-10T21:23:18.598289] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-10T21:23:18.598362] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-10T21:23:18.599591] [DEBUG] [LOCAL ] SAR: Trimmed 23596 records to 17332 (keeping 200 days of data) [2025-10-10T21:23:18.690706] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-10T21:23:18.720253] [DEBUG] [LOCAL ] SAR: Primary data saved (17332 records). [2025-10-10T21:23:18.720480] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-10T21:23:18.720588] [INFO ] [MAIN ] Update Progress: 1868/2373 symbols completed. SAR took 30.4s. Estimated remaining: 1h 11m 10s. Rate: 7.1 symbols/min [2025-10-10T21:23:18.904777] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:23:18.905108] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-10T21:23:18.905163] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-10T21:23:18.905248] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-10T21:23:18.905287] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-10T21:23:18.905329] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-10T21:23:18.905365] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-10T21:23:19.158334] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-10T21:23:19.290574] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:23:19.489411] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-10-10T21:23:19.795259] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-10T21:23:19.839141] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-10T21:23:20.289391] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-10T21:23:20.594050] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-10T21:23:21.089380] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-10T21:23:21.397129] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-10T21:23:21.889379] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-10T21:23:22.689385] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-10T21:23:23.077365] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-10T21:23:23.489377] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-10T21:23:23.644233] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T21:23:23.649794] [INFO ] [REMOTE ] SAP: Full fetch complete (71878 records). [2025-10-10T21:23:23.650001] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-10T21:23:23.819813] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-10T21:23:24.071995] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-10T21:23:24.072118] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-10T21:23:24.073519] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-10T21:23:24.073595] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-10T21:23:24.075604] [DEBUG] [LOCAL ] SAP: Trimmed 71878 records to 50626 (keeping 200 days of data) [2025-10-10T21:23:24.302161] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-10T21:23:24.417493] [DEBUG] [LOCAL ] SAP: Primary data saved (50626 records). [2025-10-10T21:23:24.417730] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-10T21:23:24.418132] [INFO ] [MAIN ] Update Progress: 1869/2373 symbols completed. SAP took 46.6s. Estimated remaining: 1h 11m 1s. Rate: 7.1 symbols/min [2025-10-10T21:23:24.594466] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:23:24.594694] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-10T21:23:24.594751] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-10T21:23:24.595682] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-10T21:23:24.595741] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-10T21:23:24.595788] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-10T21:23:24.595823] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-10T21:23:24.719068] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-10T21:23:24.951889] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:23:25.089419] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-10T21:23:25.487523] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-10T21:23:25.889408] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-10-10T21:23:26.281635] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-10T21:23:26.689409] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-10T21:23:27.261503] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-10T21:23:27.489425] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-10T21:23:27.867185] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-10T21:23:28.289384] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-10T21:23:28.684364] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-10T21:23:28.685113] [INFO ] [REMOTE ] SAT: Full fetch complete (1517 records). [2025-10-10T21:23:28.685180] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-10T21:23:28.870986] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-10T21:23:28.871196] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:23:28.871243] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:23:28.871285] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-10T21:23:28.871344] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-10T21:23:28.871380] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-10T21:23:28.871419] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-10T21:23:28.871479] [INFO ] [MAIN ] Update Progress: 1870/2373 symbols completed. SAT took 16.2s. Estimated remaining: 1h 10m 51s. Rate: 7.1 symbols/min [2025-10-10T21:23:29.038292] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:23:29.069055] [DEBUG] [LOCAL ] SB: Loaded 33254 existing records from primary storage. [2025-10-10T21:23:29.069334] [INFO ] [MAIN ] SB: Loaded 33254 existing records. [2025-10-10T21:23:29.098314] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-10T21:23:29.250241] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:23:29.250502] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-10T21:23:29.250550] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-10T21:23:29.250797] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-10T21:23:29.250855] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-10T21:23:29.609320] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:23:29.613603] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-10T21:23:29.889407] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-10T21:23:30.403594] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-10T21:23:30.689356] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-10T21:23:31.221049] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-10T21:23:31.489362] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-10-10T21:23:32.289418] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-10T21:23:32.861258] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-10T21:23:33.089449] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-10T21:23:33.283413] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T21:23:33.467997] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-10T21:23:33.889406] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-10T21:23:34.689425] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-10T21:23:35.090484] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-10T21:23:35.489364] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-10T21:23:35.674854] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T21:23:36.289383] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-10T21:23:36.618457] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-10T21:23:36.683866] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-10T21:23:37.089410] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-10T21:23:37.889445] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-10T21:23:38.689421] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-10T21:23:38.726177] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T21:23:39.099029] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-10T21:23:39.489376] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-10T21:23:39.682701] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T21:23:39.891961] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-10T21:23:40.289375] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-10T21:23:40.691204] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-10T21:23:41.089429] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-10T21:23:41.889411] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-10T21:23:42.689362] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-10T21:23:42.735416] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-10T21:23:43.070113] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-10T21:23:43.489350] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-10T21:23:43.626016] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-10T21:23:43.774169] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-10T21:23:43.775039] [INFO ] [REMOTE ] SAY: Full fetch complete (1376 records). [2025-10-10T21:23:43.775116] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-10T21:23:43.960775] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-10T21:23:43.961116] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:23:43.961213] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:23:43.961288] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-10T21:23:43.961352] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-10T21:23:43.961387] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-10T21:23:43.961425] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-10T21:23:43.961481] [INFO ] [MAIN ] Update Progress: 1871/2373 symbols completed. SAY took 25.2s. Estimated remaining: 1h 10m 45s. Rate: 7.1 symbols/min [2025-10-10T21:23:44.126271] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:23:44.126452] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-10T21:23:44.126496] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-10T21:23:44.126608] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-10T21:23:44.126672] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-10T21:23:44.126735] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-10T21:23:44.126768] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-10T21:23:44.294766] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-10T21:23:44.501307] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:23:44.795672] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-10T21:23:45.089415] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-10T21:23:45.889370] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-10-10T21:23:46.127056] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:23:46.127449] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-10-10T21:23:46.127545] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:23:46.127593] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-10T21:23:46.127675] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:23:46.127749] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-10T21:23:46.127810] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-10T21:23:46.127845] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-10T21:23:46.127884] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-10T21:23:46.127951] [INFO ] [MAIN ] Update Progress: 1872/2373 symbols completed. SBDS took 2.2s. Estimated remaining: 1h 10m 34s. Rate: 7.1 symbols/min [2025-10-10T21:23:46.310678] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:23:46.354554] [DEBUG] [LOCAL ] SBH: Loaded 50164 existing records from primary storage. [2025-10-10T21:23:46.354883] [INFO ] [MAIN ] SBH: Loaded 50164 existing records. [2025-10-10T21:23:46.551192] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:23:46.551394] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-10T21:23:46.551439] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-10T21:23:46.551693] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-10T21:23:46.551750] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-10T21:23:46.693504] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-10T21:23:46.878143] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T21:23:46.946539] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:23:47.210257] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-10T21:23:47.211047] [INFO ] [REMOTE ] SAZ: Full fetch complete (1847 records). [2025-10-10T21:23:47.211115] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-10T21:23:47.417941] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T21:23:47.418223] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:23:47.418295] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:23:47.418371] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-10T21:23:47.418467] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-10T21:23:47.418524] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-10T21:23:47.418571] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-10T21:23:47.418639] [INFO ] [MAIN ] Update Progress: 1873/2373 symbols completed. SAZ took 23.0s. Estimated remaining: 1h 10m 24s. Rate: 7.1 symbols/min [2025-10-10T21:23:47.494594] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-10-10T21:23:47.597255] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:23:47.611320] [DEBUG] [LOCAL ] SBI: Loaded 7435 existing records from primary storage. [2025-10-10T21:23:47.611676] [INFO ] [MAIN ] SBI: Loaded 7435 existing records. [2025-10-10T21:23:47.795476] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:23:47.795787] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-10T21:23:47.795843] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-10T21:23:47.796070] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-10T21:23:47.796128] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-10T21:23:48.157713] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:23:48.289387] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-10T21:23:49.089553] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-10-10T21:23:49.366228] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T21:23:49.871336] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T21:23:49.875907] [INFO ] [REMOTE ] SARO: Full fetch complete (68663 records). [2025-10-10T21:23:49.876013] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-10T21:23:49.897112] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-10T21:23:49.989161] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-10T21:23:50.274968] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-10T21:23:50.275052] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-10T21:23:50.276053] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-10T21:23:50.276119] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-10T21:23:50.277522] [DEBUG] [LOCAL ] SARO: Trimmed 68663 records to 49125 (keeping 200 days of data) [2025-10-10T21:23:50.557637] [DEBUG] [LOCAL ] SARO: Primary data saved (49125 records). [2025-10-10T21:23:50.557792] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-10T21:23:50.557874] [INFO ] [MAIN ] Update Progress: 1874/2373 symbols completed. SARO took 57.3s. Estimated remaining: 1h 10m 14s. Rate: 7.1 symbols/min [2025-10-10T21:23:50.694477] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-10T21:23:50.725300] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:23:50.735688] [DEBUG] [LOCAL ] SBR: Loaded 7676 existing records from primary storage. [2025-10-10T21:23:50.736109] [INFO ] [MAIN ] SBR: Loaded 7676 existing records. [2025-10-10T21:23:50.909346] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:23:50.909594] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-10T21:23:50.909667] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-10T21:23:50.909891] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-10T21:23:50.909951] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-10T21:23:51.260862] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:23:51.467801] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-10T21:23:51.489338] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-10T21:23:51.918729] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T21:23:52.194916] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T21:23:52.289406] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-10T21:23:53.089411] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-10T21:23:53.889367] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-10-10T21:23:54.002589] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-10T21:23:54.032235] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-10T21:23:54.689389] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-10T21:23:54.826310] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-10T21:23:55.489374] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-10T21:23:55.618484] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T21:23:56.289379] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-10T21:23:56.787047] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-10T21:23:57.099126] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-10T21:23:57.116171] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T21:23:57.889366] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-10T21:23:57.948746] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-10T21:23:58.689402] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-10T21:23:59.489393] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-10T21:23:59.762250] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T21:24:00.220454] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T21:24:00.289391] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-10T21:24:00.471328] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T21:24:01.089373] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-10T21:24:01.889358] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-10T21:24:02.193581] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T21:24:02.689433] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-10T21:24:02.806949] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-10T21:24:02.806561] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T21:24:03.489444] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-10T21:24:03.551186] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-10T21:24:04.289400] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-10T21:24:05.089392] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-10T21:24:05.130297] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T21:24:05.275363] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-10T21:24:05.889415] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-10T21:24:06.017818] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-10T21:24:06.689417] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-10T21:24:07.333882] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T21:24:07.346744] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-10T21:24:07.489416] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-10T21:24:08.289696] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-10T21:24:09.075929] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-10T21:24:09.089329] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-10T21:24:09.889375] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-10T21:24:10.065770] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T21:24:10.462430] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-10T21:24:10.466192] [INFO ] [REMOTE ] SB: Full fetch complete (49839 records). [2025-10-10T21:24:10.466324] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-10T21:24:10.695796] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-10T21:24:10.852639] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-10T21:24:10.867871] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-10T21:24:10.867962] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-10T21:24:10.868844] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-10T21:24:10.868908] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-10T21:24:10.870043] [DEBUG] [LOCAL ] SB: Trimmed 49839 records to 33523 (keeping 200 days of data) [2025-10-10T21:24:11.062142] [DEBUG] [LOCAL ] SB: Primary data saved (33523 records). [2025-10-10T21:24:11.062292] [INFO ] [MAIN ] SB: Full history saved. [2025-10-10T21:24:11.062379] [INFO ] [MAIN ] Update Progress: 1875/2373 symbols completed. SB took 42.2s. Estimated remaining: 1h 10m 9s. Rate: 7.1 symbols/min [2025-10-10T21:24:11.229169] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:24:11.273569] [DEBUG] [LOCAL ] SBS: Loaded 49729 existing records from primary storage. [2025-10-10T21:24:11.273924] [INFO ] [MAIN ] SBS: Loaded 49729 existing records. [2025-10-10T21:24:11.374350] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-10T21:24:11.381402] [INFO ] [REMOTE ] SBI: Full fetch complete (10379 records). [2025-10-10T21:24:11.386627] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-10T21:24:11.492870] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-10T21:24:11.552088] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:24:11.569987] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-10T21:24:11.580525] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-10T21:24:11.615092] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-10T21:24:11.624401] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-10T21:24:12.103861] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-10T21:24:12.110030] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-10T21:24:12.115486] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-10T21:24:12.125996] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-10T21:24:12.147421] [DEBUG] [LOCAL ] SBI: Trimmed 10379 records to 7485 (keeping 200 days of data) [2025-10-10T21:24:12.244925] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:24:12.259292] [DEBUG] [LOCAL ] SBI: Primary data saved (7485 records). [2025-10-10T21:24:12.259366] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-10T21:24:12.259439] [INFO ] [MAIN ] Update Progress: 1876/2373 symbols completed. SBI took 24.8s. Estimated remaining: 1h 9m 59s. Rate: 7.1 symbols/min [2025-10-10T21:24:12.289986] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-10-10T21:24:12.433095] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:24:12.452769] [DEBUG] [LOCAL ] SBSI: Loaded 14889 existing records from primary storage. [2025-10-10T21:24:12.453153] [INFO ] [MAIN ] SBSI: Loaded 14889 existing records. [2025-10-10T21:24:12.640239] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:24:12.640459] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-10T21:24:12.640504] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-10T21:24:12.640715] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-10T21:24:12.640772] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-10T21:24:12.989739] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:24:13.089368] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-10-10T21:24:13.505400] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-10T21:24:13.889350] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-10T21:24:14.258515] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-10T21:24:14.263346] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T21:24:14.420003] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-10T21:24:14.689453] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-10T21:24:15.489388] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-10T21:24:15.604770] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-10T21:24:16.289426] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-10T21:24:17.089341] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-10T21:24:17.374141] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-10T21:24:17.476316] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-10T21:24:17.889385] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-10T21:24:18.689358] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-10T21:24:18.893074] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T21:24:19.167080] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T21:24:19.431606] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-10T21:24:19.489333] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-10T21:24:20.289396] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-10T21:24:20.409454] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-10T21:24:21.089408] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-10T21:24:21.889359] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-10T21:24:22.082277] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T21:24:22.128029] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-10T21:24:22.689421] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-10T21:24:23.072878] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-10T21:24:23.077876] [INFO ] [REMOTE ] SBH: Full fetch complete (72895 records). [2025-10-10T21:24:23.078017] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-10T21:24:23.464329] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-10T21:24:23.464488] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-10T21:24:23.465705] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-10T21:24:23.465780] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-10T21:24:23.467817] [DEBUG] [LOCAL ] SBH: Trimmed 72895 records to 50548 (keeping 200 days of data) [2025-10-10T21:24:23.514786] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-10T21:24:23.723554] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-10T21:24:23.792155] [DEBUG] [LOCAL ] SBH: Primary data saved (50548 records). [2025-10-10T21:24:23.792313] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-10T21:24:23.792423] [INFO ] [MAIN ] Update Progress: 1877/2373 symbols completed. SBH took 37.7s. Estimated remaining: 1h 9m 51s. Rate: 7.1 symbols/min [2025-10-10T21:24:24.289427] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-10T21:24:25.089353] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-10T21:24:25.106231] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T21:24:25.107980] [INFO ] [REMOTE ] SBR: Full fetch complete (11279 records). [2025-10-10T21:24:25.108053] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-10T21:24:25.482225] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-10T21:24:25.482338] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-10T21:24:25.482848] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-10T21:24:25.482928] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-10T21:24:25.483712] [DEBUG] [LOCAL ] SBR: Trimmed 11279 records to 7784 (keeping 200 days of data) [2025-10-10T21:24:25.549883] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T21:24:25.578194] [DEBUG] [LOCAL ] SBR: Primary data saved (7784 records). [2025-10-10T21:24:25.578371] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-10T21:24:25.578473] [INFO ] [MAIN ] Update Progress: 1878/2373 symbols completed. SBR took 35.0s. Estimated remaining: 1h 9m 41s. Rate: 7.1 symbols/min [2025-10-10T21:24:25.889437] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-10T21:24:26.217168] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-10T21:24:26.689386] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-10T21:24:27.932496] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T21:24:27.944305] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-10T21:24:27.995543] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T21:24:28.289419] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-10T21:24:29.279587] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-10T21:24:29.283021] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-10T21:24:29.925930] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T21:24:29.936671] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-10T21:24:30.381945] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-10T21:24:30.689388] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-10T21:24:31.683459] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-10T21:24:31.687330] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-10T21:24:31.774797] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T21:24:32.289383] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-10T21:24:32.862681] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-10T21:24:33.089390] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-10T21:24:33.977062] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-10T21:24:33.988122] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-10T21:24:34.283040] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-10T21:24:34.689409] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-10T21:24:35.870417] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-10T21:24:35.886883] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-10T21:24:35.913084] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-10T21:24:35.916061] [INFO ] [REMOTE ] SBSI: Full fetch complete (21083 records). [2025-10-10T21:24:35.916203] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-10T21:24:36.388344] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-10T21:24:36.388427] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-10T21:24:36.388999] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-10T21:24:36.389063] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-10T21:24:36.389737] [DEBUG] [LOCAL ] SBSI: Trimmed 21083 records to 15034 (keeping 200 days of data) [2025-10-10T21:24:36.491745] [DEBUG] [LOCAL ] SBSI: Primary data saved (15034 records). [2025-10-10T21:24:36.491887] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-10T21:24:36.491974] [INFO ] [MAIN ] Update Progress: 1879/2373 symbols completed. SBSI took 24.2s. Estimated remaining: 1h 9m 33s. Rate: 7.1 symbols/min [2025-10-10T21:24:37.691123] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T21:24:37.702976] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-10T21:24:39.350112] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-10T21:24:39.354601] [INFO ] [REMOTE ] SBS: Full fetch complete (70073 records). [2025-10-10T21:24:39.354739] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-10T21:24:39.743112] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-10T21:24:39.743213] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-10T21:24:39.744177] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-10T21:24:39.744239] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-10T21:24:39.745623] [DEBUG] [LOCAL ] SBS: Trimmed 70073 records to 50102 (keeping 200 days of data) [2025-10-10T21:24:40.051792] [DEBUG] [LOCAL ] SBS: Primary data saved (50102 records). [2025-10-10T21:24:40.051933] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-10T21:24:40.052045] [INFO ] [MAIN ] Update Progress: 1880/2373 symbols completed. SBS took 29.0s. Estimated remaining: 1h 9m 23s. Rate: 7.1 symbols/min [2025-10-10T21:24:40.575282] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:24:40.722960] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:24:40.734254] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-10T21:24:40.749802] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-10T21:24:40.773163] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-10T21:24:40.772888] [DEBUG] [LOCAL ] SCD: Loaded 13118 existing records from primary storage. [2025-10-10T21:24:40.775783] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:24:40.752855] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:24:40.776058] [INFO ] [MAIN ] SCD: Loaded 13118 existing records. [2025-10-10T21:24:40.775839] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-10T21:24:40.788933] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-10T21:24:40.799021] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-10T21:24:41.230167] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:24:41.251097] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-10T21:24:41.252618] [DEBUG] [LOCAL ] SCCO: Loaded 49979 existing records from primary storage. [2025-10-10T21:24:41.303549] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-10T21:24:41.315140] [INFO ] [MAIN ] SCCO: Loaded 49979 existing records. [2025-10-10T21:24:41.326339] [DEBUG] [LOCAL ] SBSW: Loaded 53469 existing records from primary storage. [2025-10-10T21:24:41.320351] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-10T21:24:41.329818] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-10T21:24:41.330132] [INFO ] [MAIN ] SBSW: Loaded 53469 existing records. [2025-10-10T21:24:41.650044] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:24:41.725843] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-10-10T21:24:41.958229] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:24:42.006845] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-10T21:24:42.006947] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-10T21:24:41.980126] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:24:42.038933] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-10T21:24:42.038888] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-10T21:24:42.039070] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-10T21:24:42.050540] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-10T21:24:42.107615] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-10T21:24:42.119680] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-10T21:24:42.201593] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-10T21:24:42.248012] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-10T21:24:42.367545] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:24:42.425020] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-10-10T21:24:42.672444] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-10T21:24:42.699161] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-10T21:24:42.911672] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:24:42.935171] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-10-10T21:24:42.939379] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:24:42.939822] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-10-10T21:24:43.373356] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-10T21:24:43.374897] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-10T21:24:43.374059] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-10T21:24:43.377120] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-10T21:24:43.633954] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-10T21:24:43.635109] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-10T21:24:43.882664] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-10T21:24:44.271443] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T21:24:44.289345] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-10T21:24:44.918374] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T21:24:45.089499] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-10T21:24:45.450077] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-10T21:24:45.484401] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-10T21:24:45.520097] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-10T21:24:45.889402] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-10T21:24:46.689436] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-10T21:24:46.828935] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-10T21:24:47.489409] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-10T21:24:48.179120] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-10T21:24:48.289410] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-10T21:24:48.805965] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-10T21:24:49.089371] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-10T21:24:49.797368] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T21:24:49.805043] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-10T21:24:49.889410] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-10T21:24:50.689370] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-10T21:24:50.771318] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-10T21:24:51.489461] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-10T21:24:52.062915] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-10T21:24:52.289368] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-10T21:24:52.752757] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-10T21:24:53.089432] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-10T21:24:53.148798] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-10T21:24:53.466271] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-10T21:24:53.889429] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-10T21:24:54.689394] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-10T21:24:54.980853] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T21:24:55.489428] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-10T21:24:55.762506] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-10T21:24:55.763425] [INFO ] [REMOTE ] SBXD: Full fetch complete (3112 records). [2025-10-10T21:24:55.763538] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-10T21:24:55.947246] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-10-10T21:24:55.947503] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:24:55.947572] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:24:55.947668] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-10T21:24:55.947755] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-10T21:24:55.947796] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-10T21:24:55.947836] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-10T21:24:55.947901] [INFO ] [MAIN ] Update Progress: 1881/2373 symbols completed. SBXD took 15.9s. Estimated remaining: 1h 9m 17s. Rate: 7.1 symbols/min [2025-10-10T21:24:56.130965] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:24:56.182184] [DEBUG] [LOCAL ] SCHW: Loaded 54075 existing records from primary storage. [2025-10-10T21:24:56.182602] [INFO ] [MAIN ] SCHW: Loaded 54075 existing records. [2025-10-10T21:24:56.294518] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-10T21:24:56.370333] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:24:56.370789] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-10T21:24:56.370845] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-10T21:24:56.371117] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-10T21:24:56.371173] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-10T21:24:56.748523] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:24:56.754622] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-10T21:24:57.080405] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-10T21:24:57.089329] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-10T21:24:57.889425] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-10T21:24:58.245935] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-10T21:24:58.689388] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-10T21:24:59.364255] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-10T21:24:59.489426] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-10-10T21:24:59.694138] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-10T21:25:00.289419] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-10T21:25:01.089438] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-10T21:25:01.244783] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T21:25:01.247224] [INFO ] [REMOTE ] SCD: Full fetch complete (16579 records). [2025-10-10T21:25:01.247344] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-10T21:25:01.654924] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-10T21:25:01.655052] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-10T21:25:01.655703] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-10T21:25:01.655907] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-10T21:25:01.656850] [DEBUG] [LOCAL ] SCD: Trimmed 16579 records to 13228 (keeping 200 days of data) [2025-10-10T21:25:01.761395] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-10T21:25:01.793180] [DEBUG] [LOCAL ] SCD: Primary data saved (13228 records). [2025-10-10T21:25:01.793400] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-10T21:25:01.793517] [INFO ] [MAIN ] Update Progress: 1882/2373 symbols completed. SCD took 21.7s. Estimated remaining: 1h 9m 8s. Rate: 7.1 symbols/min [2025-10-10T21:25:01.898755] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-10T21:25:01.977807] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:25:02.024966] [DEBUG] [LOCAL ] SCI: Loaded 46874 existing records from primary storage. [2025-10-10T21:25:02.025408] [INFO ] [MAIN ] SCI: Loaded 46874 existing records. [2025-10-10T21:25:02.205823] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:25:02.206112] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-10T21:25:02.206164] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-10T21:25:02.206398] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-10T21:25:02.206438] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-10T21:25:02.591105] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:25:02.689388] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-10-10T21:25:02.789602] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-10T21:25:03.489402] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-10T21:25:04.092051] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-10T21:25:04.289486] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-10T21:25:04.706223] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T21:25:05.089514] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-10T21:25:05.175499] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T21:25:05.889389] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-10T21:25:06.403406] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-10T21:25:06.689466] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-10T21:25:07.341687] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-10T21:25:07.420562] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-10T21:25:07.489371] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-10T21:25:08.289373] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-10T21:25:08.483254] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T21:25:09.089364] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-10T21:25:09.525962] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T21:25:09.889339] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-10T21:25:10.519470] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-10T21:25:10.689354] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-10T21:25:11.193710] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T21:25:11.489346] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-10T21:25:11.533750] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-10T21:25:12.289346] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-10T21:25:13.010001] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-10T21:25:13.089369] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-10T21:25:13.590717] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T21:25:13.635478] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T21:25:13.889391] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-10T21:25:14.689433] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-10T21:25:14.924747] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T21:25:15.489421] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-10T21:25:15.831834] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T21:25:16.288435] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-10T21:25:16.298878] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-10T21:25:17.089395] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-10T21:25:17.695070] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-10T21:25:17.889451] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-10T21:25:18.396375] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-10T21:25:18.689411] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-10T21:25:19.235447] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-10T21:25:19.489415] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-10T21:25:19.790800] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T21:25:20.289357] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-10T21:25:20.729517] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-10T21:25:20.734584] [INFO ] [REMOTE ] SBSW: Full fetch complete (76545 records). [2025-10-10T21:25:20.734728] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-10T21:25:21.107764] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-10T21:25:21.133411] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-10T21:25:21.133529] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-10T21:25:21.134885] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-10T21:25:21.134968] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-10T21:25:21.136792] [DEBUG] [LOCAL ] SBSW: Trimmed 76545 records to 53859 (keeping 200 days of data) [2025-10-10T21:25:21.253151] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T21:25:21.506169] [DEBUG] [LOCAL ] SBSW: Primary data saved (53859 records). [2025-10-10T21:25:21.506307] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-10T21:25:21.506391] [INFO ] [MAIN ] Update Progress: 1883/2373 symbols completed. SBSW took 41.5s. Estimated remaining: 1h 9m 2s. Rate: 7.1 symbols/min [2025-10-10T21:25:21.671255] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:25:21.687167] [DEBUG] [LOCAL ] SCL: Loaded 14919 existing records from primary storage. [2025-10-10T21:25:21.687414] [INFO ] [MAIN ] SCL: Loaded 14919 existing records. [2025-10-10T21:25:21.864205] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:25:21.864451] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-10T21:25:21.864504] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-10T21:25:21.864722] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-10T21:25:21.864779] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-10T21:25:21.895308] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-10T21:25:22.215557] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:25:22.278715] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T21:25:22.689355] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-10-10T21:25:23.043828] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-10T21:25:23.049006] [INFO ] [REMOTE ] SCCO: Full fetch complete (71354 records). [2025-10-10T21:25:23.049128] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-10T21:25:23.443842] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-10T21:25:23.443931] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-10T21:25:23.445006] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-10T21:25:23.445070] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-10T21:25:23.446417] [DEBUG] [LOCAL ] SCCO: Trimmed 71354 records to 50367 (keeping 200 days of data) [2025-10-10T21:25:23.500525] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-10T21:25:23.683807] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-10T21:25:23.779226] [DEBUG] [LOCAL ] SCCO: Primary data saved (50367 records). [2025-10-10T21:25:23.779362] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-10T21:25:23.779443] [INFO ] [MAIN ] Update Progress: 1884/2373 symbols completed. SCCO took 43.7s. Estimated remaining: 1h 8m 52s. Rate: 7.1 symbols/min [2025-10-10T21:25:23.948693] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:25:23.970140] [DEBUG] [LOCAL ] SCM: Loaded 20128 existing records from primary storage. [2025-10-10T21:25:23.970429] [INFO ] [MAIN ] SCM: Loaded 20128 existing records. [2025-10-10T21:25:24.152777] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:25:24.153042] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-10T21:25:24.153123] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-10T21:25:24.153407] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-10T21:25:24.153501] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-10T21:25:24.292615] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-10T21:25:24.549110] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-10T21:25:24.580626] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:25:25.089397] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-10-10T21:25:25.384330] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T21:25:25.580232] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-10T21:25:25.889375] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-10T21:25:26.418354] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T21:25:26.689396] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-10T21:25:27.489427] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-10T21:25:27.654707] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T21:25:28.289488] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-10T21:25:28.490383] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-10T21:25:28.935396] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-10T21:25:29.089348] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-10T21:25:29.458325] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T21:25:29.889370] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-10T21:25:30.689385] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-10T21:25:31.043368] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T21:25:31.296013] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-10T21:25:31.489391] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-10T21:25:31.784682] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-10T21:25:32.289341] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-10T21:25:32.340926] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-10T21:25:33.089406] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-10T21:25:33.814213] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T21:25:33.889340] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-10T21:25:34.290929] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T21:25:34.689348] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-10T21:25:35.489385] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-10T21:25:35.764511] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-10T21:25:35.836074] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-10T21:25:36.289342] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-10T21:25:36.824367] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-10T21:25:37.089364] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-10T21:25:37.889390] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-10T21:25:38.177769] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-10T21:25:38.184164] [INFO ] [REMOTE ] SCHW: Full fetch complete (77704 records). [2025-10-10T21:25:38.184382] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-10T21:25:38.593092] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-10T21:25:38.593252] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-10T21:25:38.594465] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-10T21:25:38.594529] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-10T21:25:38.596140] [DEBUG] [LOCAL ] SCHW: Trimmed 77704 records to 54465 (keeping 200 days of data) [2025-10-10T21:25:38.691005] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-10T21:25:38.924253] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-10T21:25:38.980847] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-10T21:25:39.002395] [DEBUG] [LOCAL ] SCHW: Primary data saved (54465 records). [2025-10-10T21:25:39.002562] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-10T21:25:39.002692] [INFO ] [MAIN ] Update Progress: 1885/2373 symbols completed. SCHW took 43.1s. Estimated remaining: 1h 8m 45s. Rate: 7.1 symbols/min [2025-10-10T21:25:39.169188] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:25:39.209701] [DEBUG] [LOCAL ] SCS: Loaded 43817 existing records from primary storage. [2025-10-10T21:25:39.210020] [INFO ] [MAIN ] SCS: Loaded 43817 existing records. [2025-10-10T21:25:39.384385] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:25:39.384728] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-10T21:25:39.384784] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-10T21:25:39.384964] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-10T21:25:39.385003] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-10T21:25:39.494538] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-10T21:25:39.740377] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:25:40.045224] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T21:25:40.289363] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-10T21:25:40.854421] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-10T21:25:41.089368] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-10T21:25:41.877842] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-10T21:25:41.882256] [INFO ] [REMOTE ] SCI: Full fetch complete (67403 records). [2025-10-10T21:25:41.882363] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-10T21:25:41.894594] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-10-10T21:25:42.293534] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-10T21:25:42.293712] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-10T21:25:42.295697] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-10T21:25:42.295771] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-10T21:25:42.294537] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-10T21:25:42.301617] [DEBUG] [LOCAL ] SCI: Trimmed 67403 records to 47192 (keeping 200 days of data) [2025-10-10T21:25:42.588858] [DEBUG] [LOCAL ] SCI: Primary data saved (47192 records). [2025-10-10T21:25:42.589011] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-10T21:25:42.589094] [INFO ] [MAIN ] Update Progress: 1886/2373 symbols completed. SCI took 40.8s. Estimated remaining: 1h 8m 36s. Rate: 7.1 symbols/min [2025-10-10T21:25:42.690533] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-10T21:25:42.761372] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:25:42.791129] [DEBUG] [LOCAL ] SD: Loaded 28932 existing records from primary storage. [2025-10-10T21:25:42.791420] [INFO ] [MAIN ] SD: Loaded 28932 existing records. [2025-10-10T21:25:42.974357] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:25:42.974580] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-10T21:25:42.974627] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-10T21:25:42.974897] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-10T21:25:42.974957] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-10T21:25:43.344264] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:25:43.489403] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-10-10T21:25:43.660060] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T21:25:43.929265] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-10T21:25:44.289439] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-10T21:25:44.758633] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-10T21:25:45.089350] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-10T21:25:45.258558] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-10T21:25:45.260390] [INFO ] [REMOTE ] SCL: Full fetch complete (21355 records). [2025-10-10T21:25:45.260462] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-10T21:25:45.659726] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-10T21:25:45.659869] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-10T21:25:45.661161] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-10T21:25:45.661218] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-10T21:25:45.661868] [DEBUG] [LOCAL ] SCL: Trimmed 21355 records to 14996 (keeping 200 days of data) [2025-10-10T21:25:45.752844] [DEBUG] [LOCAL ] SCL: Primary data saved (14996 records). [2025-10-10T21:25:45.752996] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-10T21:25:45.753097] [INFO ] [MAIN ] Update Progress: 1887/2373 symbols completed. SCL took 24.2s. Estimated remaining: 1h 8m 26s. Rate: 7.1 symbols/min [2025-10-10T21:25:45.899072] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-10T21:25:45.924859] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:25:45.937265] [DEBUG] [LOCAL ] SDHC: Loaded 10432 existing records from primary storage. [2025-10-10T21:25:45.937483] [INFO ] [MAIN ] SDHC: Loaded 10432 existing records. [2025-10-10T21:25:46.110116] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:25:46.110340] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-10T21:25:46.110387] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-10T21:25:46.110573] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-10T21:25:46.110636] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-10T21:25:46.463951] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:25:46.689358] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-10T21:25:46.796107] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T21:25:46.887955] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-10T21:25:47.315554] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-10T21:25:47.489393] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-10T21:25:48.289351] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-10T21:25:48.773514] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T21:25:49.089362] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-10T21:25:49.518626] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-10T21:25:49.889395] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-10-10T21:25:50.689400] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-10T21:25:50.723390] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T21:25:51.004184] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-10T21:25:51.489352] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-10T21:25:51.991616] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T21:25:52.289378] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-10T21:25:53.089357] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-10T21:25:53.114820] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T21:25:53.889394] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-10T21:25:53.952431] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T21:25:54.247534] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-10T21:25:54.689383] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-10T21:25:55.489344] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-10T21:25:55.649246] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T21:25:55.667935] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T21:25:56.289378] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-10T21:25:57.046455] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-10T21:25:57.089336] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-10T21:25:57.381679] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-10T21:25:57.889356] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-10T21:25:58.324739] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T21:25:58.689385] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-10T21:25:59.355880] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-10T21:25:59.489362] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-10T21:25:59.932896] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-10T21:26:00.024108] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-10T21:26:00.289399] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-10T21:26:01.089347] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-10T21:26:01.480425] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-10T21:26:01.483278] [INFO ] [REMOTE ] SCM: Full fetch complete (28812 records). [2025-10-10T21:26:01.483351] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-10T21:26:01.839746] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-10T21:26:01.839810] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-10T21:26:01.840424] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-10T21:26:01.840465] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-10T21:26:01.841126] [DEBUG] [LOCAL ] SCM: Trimmed 28812 records to 20313 (keeping 200 days of data) [2025-10-10T21:26:01.891608] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-10T21:26:01.964468] [DEBUG] [LOCAL ] SCM: Primary data saved (20313 records). [2025-10-10T21:26:01.964578] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-10T21:26:01.964694] [INFO ] [MAIN ] Update Progress: 1888/2373 symbols completed. SCM took 38.2s. Estimated remaining: 1h 8m 19s. Rate: 7.1 symbols/min [2025-10-10T21:26:02.128125] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:26:02.140520] [DEBUG] [LOCAL ] SDHY: Loaded 11007 existing records from primary storage. [2025-10-10T21:26:02.140761] [INFO ] [MAIN ] SDHY: Loaded 11007 existing records. [2025-10-10T21:26:02.313949] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:26:02.314112] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-10T21:26:02.314157] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-10T21:26:02.314375] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-10T21:26:02.314436] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-10T21:26:02.629807] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-10T21:26:02.694494] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-10T21:26:02.698706] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:26:02.814554] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-10T21:26:03.489334] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-10T21:26:04.289419] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-10-10T21:26:04.336493] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T21:26:04.372668] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-10T21:26:05.057136] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-10T21:26:05.089334] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-10T21:26:05.584713] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-10T21:26:05.889395] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-10T21:26:06.689425] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-10T21:26:07.489415] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-10T21:26:07.563477] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T21:26:07.635474] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-10T21:26:08.289405] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-10T21:26:08.655972] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T21:26:09.089397] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-10T21:26:09.507986] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T21:26:09.889365] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-10T21:26:10.079633] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-10T21:26:10.689352] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-10T21:26:11.241634] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T21:26:11.341855] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-10T21:26:11.489386] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-10T21:26:12.289379] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-10T21:26:13.089429] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-10T21:26:13.131060] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T21:26:13.132801] [INFO ] [REMOTE ] SDHC: Full fetch complete (17084 records). [2025-10-10T21:26:13.132874] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-10T21:26:13.532025] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-10T21:26:13.532136] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-10T21:26:13.532846] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-10T21:26:13.532930] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-10T21:26:13.533754] [DEBUG] [LOCAL ] SDHC: Trimmed 17084 records to 10511 (keeping 200 days of data) [2025-10-10T21:26:13.624638] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-10T21:26:13.651266] [DEBUG] [LOCAL ] SDHC: Primary data saved (10511 records). [2025-10-10T21:26:13.651415] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-10T21:26:13.651507] [INFO ] [MAIN ] Update Progress: 1889/2373 symbols completed. SDHC took 27.9s. Estimated remaining: 1h 8m 12s. Rate: 7.1 symbols/min [2025-10-10T21:26:13.813557] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:26:13.855212] [DEBUG] [LOCAL ] SDRL: Loaded 41781 existing records from primary storage. [2025-10-10T21:26:13.855551] [INFO ] [MAIN ] SDRL: Loaded 41781 existing records. [2025-10-10T21:26:13.897108] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-10T21:26:14.031101] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:26:14.031352] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-10T21:26:14.031402] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-10T21:26:14.031613] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-10T21:26:14.031705] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-10T21:26:14.370768] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T21:26:14.396974] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:26:14.397929] [INFO ] [REMOTE ] SD: Full fetch complete (41056 records). [2025-10-10T21:26:14.398063] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-10T21:26:14.694631] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-10T21:26:14.784575] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-10T21:26:14.784748] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-10T21:26:14.786838] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-10T21:26:14.786915] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-10T21:26:14.788554] [DEBUG] [LOCAL ] SD: Trimmed 41056 records to 29127 (keeping 200 days of data) [2025-10-10T21:26:14.986944] [DEBUG] [LOCAL ] SD: Primary data saved (29127 records). [2025-10-10T21:26:14.987182] [INFO ] [MAIN ] SD: Full history saved. [2025-10-10T21:26:14.987297] [INFO ] [MAIN ] Update Progress: 1890/2373 symbols completed. SD took 32.4s. Estimated remaining: 1h 8m 1s. Rate: 7.1 symbols/min [2025-10-10T21:26:15.128267] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-10T21:26:15.185419] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:26:15.243779] [DEBUG] [LOCAL ] SE: Loaded 53720 existing records from primary storage. [2025-10-10T21:26:15.244239] [INFO ] [MAIN ] SE: Loaded 53720 existing records. [2025-10-10T21:26:15.430164] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:26:15.430507] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-10T21:26:15.430564] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-10T21:26:15.430870] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-10-10T21:26:15.430930] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-10T21:26:15.499352] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-10-10T21:26:15.806603] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:26:16.196331] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-10T21:26:16.289346] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-10T21:26:17.089407] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-10T21:26:17.326954] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T21:26:17.481447] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-10T21:26:17.487884] [INFO ] [REMOTE ] SCS: Full fetch complete (60847 records). [2025-10-10T21:26:17.488052] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-10T21:26:17.624983] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-10T21:26:17.885808] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-10T21:26:17.885948] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-10T21:26:17.886900] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-10T21:26:17.886961] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-10T21:26:17.888125] [DEBUG] [LOCAL ] SCS: Trimmed 60847 records to 44139 (keeping 200 days of data) [2025-10-10T21:26:17.889436] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-10-10T21:26:18.149738] [DEBUG] [LOCAL ] SCS: Primary data saved (44139 records). [2025-10-10T21:26:18.149871] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-10T21:26:18.149947] [INFO ] [MAIN ] Update Progress: 1891/2373 symbols completed. SCS took 39.1s. Estimated remaining: 1h 7m 52s. Rate: 7.1 symbols/min [2025-10-10T21:26:18.314164] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:26:18.355475] [DEBUG] [LOCAL ] SEE: Loaded 48548 existing records from primary storage. [2025-10-10T21:26:18.355821] [INFO ] [MAIN ] SEE: Loaded 48548 existing records. [2025-10-10T21:26:18.536078] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:26:18.536294] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-10T21:26:18.536368] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-10T21:26:18.536592] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-10T21:26:18.536677] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-10T21:26:18.704599] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-10T21:26:18.883983] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:26:19.489337] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-10T21:26:20.054853] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T21:26:20.221428] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-10T21:26:20.289414] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-10T21:26:21.089364] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-10T21:26:21.226802] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-10T21:26:21.435114] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-10T21:26:21.889378] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-10T21:26:22.689415] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-10T21:26:22.851352] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-10T21:26:23.489368] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-10-10T21:26:23.596314] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-10T21:26:23.649780] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T21:26:24.289402] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-10T21:26:25.089417] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-10T21:26:25.373507] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T21:26:25.889426] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-10T21:26:26.025070] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-10T21:26:26.113837] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T21:26:26.689399] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-10T21:26:27.489428] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-10T21:26:27.718043] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-10T21:26:27.951735] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-10T21:26:28.105134] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T21:26:28.289402] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-10T21:26:29.089446] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-10T21:26:29.239842] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-10T21:26:29.889434] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-10T21:26:30.689412] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-10T21:26:31.494892] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-10T21:26:31.509130] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-10T21:26:31.699202] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T21:26:32.289378] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-10T21:26:32.366881] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T21:26:32.368628] [INFO ] [REMOTE ] SDHY: Full fetch complete (15685 records). [2025-10-10T21:26:32.368730] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-10T21:26:32.771522] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-10T21:26:32.772370] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-10T21:26:32.774710] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-10T21:26:32.774790] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-10T21:26:32.774133] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-10T21:26:32.785579] [DEBUG] [LOCAL ] SDHY: Trimmed 15685 records to 11075 (keeping 200 days of data) [2025-10-10T21:26:32.854482] [DEBUG] [LOCAL ] SDHY: Primary data saved (11075 records). [2025-10-10T21:26:32.854632] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-10T21:26:32.854777] [INFO ] [MAIN ] Update Progress: 1892/2373 symbols completed. SDHY took 30.9s. Estimated remaining: 1h 7m 45s. Rate: 7.1 symbols/min [2025-10-10T21:26:33.024779] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:26:33.040306] [DEBUG] [LOCAL ] SEG: Loaded 13269 existing records from primary storage. [2025-10-10T21:26:33.040560] [INFO ] [MAIN ] SEG: Loaded 13269 existing records. [2025-10-10T21:26:33.094571] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-10T21:26:33.226870] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:26:33.227201] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-10T21:26:33.227253] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-10T21:26:33.227474] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-10T21:26:33.227562] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-10T21:26:33.584540] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:26:33.889386] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-10T21:26:34.150010] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T21:26:34.689352] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-10T21:26:34.814908] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T21:26:35.489367] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-10-10T21:26:35.865313] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T21:26:36.289356] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-10T21:26:36.506875] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T21:26:36.707039] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T21:26:37.089393] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-10T21:26:37.889381] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-10T21:26:38.041058] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-10T21:26:38.689393] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-10T21:26:38.731494] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-10T21:26:39.423727] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-10T21:26:39.489346] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-10T21:26:40.289411] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-10T21:26:40.350845] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T21:26:41.089354] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-10T21:26:41.308798] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-10T21:26:41.889381] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-10T21:26:41.943141] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-10T21:26:42.240963] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-10T21:26:42.689373] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-10T21:26:43.489395] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-10T21:26:44.086233] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-10T21:26:44.289380] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-10T21:26:44.799914] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T21:26:44.873747] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-10T21:26:45.089376] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-10T21:26:45.889391] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-10T21:26:46.202432] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-10T21:26:46.599229] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-10T21:26:46.689406] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-10T21:26:47.489381] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-10T21:26:47.630387] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T21:26:47.654564] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-10T21:26:48.289426] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-10T21:26:49.089371] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-10T21:26:49.357491] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-10T21:26:49.889369] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-10T21:26:49.943968] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-10T21:26:50.504831] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-10T21:26:50.689389] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-10T21:26:50.914094] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-10T21:26:51.489424] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-10T21:26:52.283012] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-10T21:26:52.289321] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-10T21:26:52.662432] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T21:26:53.089425] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-10T21:26:53.190330] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-10T21:26:53.889449] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-10T21:26:54.689351] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-10T21:26:54.987129] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T21:26:55.094465] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T21:26:55.096247] [INFO ] [REMOTE ] SEG: Full fetch complete (19731 records). [2025-10-10T21:26:55.096325] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-10T21:26:55.476840] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-10T21:26:55.476941] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-10T21:26:55.477620] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-10T21:26:55.477708] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-10T21:26:55.478448] [DEBUG] [LOCAL ] SEG: Trimmed 19731 records to 13415 (keeping 200 days of data) [2025-10-10T21:26:55.511769] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-10T21:26:55.565577] [DEBUG] [LOCAL ] SEG: Primary data saved (13415 records). [2025-10-10T21:26:55.565819] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-10T21:26:55.565948] [INFO ] [MAIN ] Update Progress: 1893/2373 symbols completed. SEG took 22.7s. Estimated remaining: 1h 7m 40s. Rate: 7.1 symbols/min [2025-10-10T21:26:55.743739] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:26:55.796068] [DEBUG] [LOCAL ] SEI: Loaded 50147 existing records from primary storage. [2025-10-10T21:26:55.796534] [INFO ] [MAIN ] SEI: Loaded 50147 existing records. [2025-10-10T21:26:55.984747] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:26:55.985765] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-10T21:26:55.985830] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-10T21:26:55.986546] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-10T21:26:55.986608] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-10T21:26:56.294478] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-10T21:26:56.371378] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:26:56.563469] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T21:26:57.089386] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-10T21:26:57.131043] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-10T21:26:57.135322] [INFO ] [REMOTE ] SDRL: Full fetch complete (61602 records). [2025-10-10T21:26:57.135430] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-10T21:26:57.511180] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-10T21:26:57.511275] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-10T21:26:57.512234] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-10T21:26:57.512302] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-10T21:26:57.513576] [DEBUG] [LOCAL ] SDRL: Trimmed 61602 records to 42101 (keeping 200 days of data) [2025-10-10T21:26:57.758240] [DEBUG] [LOCAL ] SDRL: Primary data saved (42101 records). [2025-10-10T21:26:57.758430] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-10T21:26:57.758539] [INFO ] [MAIN ] Update Progress: 1894/2373 symbols completed. SDRL took 44.1s. Estimated remaining: 1h 7m 30s. Rate: 7.1 symbols/min [2025-10-10T21:26:57.889554] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-10-10T21:26:57.941611] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:26:57.958347] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-10T21:26:57.964464] [INFO ] [REMOTE ] SE: Full fetch complete (77095 records). [2025-10-10T21:26:57.964747] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-10T21:26:58.337249] [DEBUG] [LOCAL ] SEM: Loaded 43265 existing records from primary storage. [2025-10-10T21:26:58.355455] [INFO ] [MAIN ] SEM: Loaded 43265 existing records. [2025-10-10T21:26:58.628592] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-10T21:26:58.636216] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-10T21:26:58.641188] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-10T21:26:58.697301] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-10T21:26:58.703153] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:26:58.703564] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-10T21:26:58.703669] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-10T21:26:58.709161] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-10T21:26:58.718453] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-10T21:26:58.719165] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T21:26:58.734134] [DEBUG] [LOCAL ] SE: Trimmed 77095 records to 54109 (keeping 200 days of data) [2025-10-10T21:26:58.781435] [INFO ] [REMOTE ] SEE: Full fetch complete (69816 records). [2025-10-10T21:26:58.889548] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-10T21:26:59.757268] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:26:59.848435] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-10-10T21:26:59.862901] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-10T21:26:59.883368] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-10T21:26:59.887116] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-10T21:26:59.887540] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-10T21:26:59.915549] [DEBUG] [LOCAL ] SE: Primary data saved (54109 records). [2025-10-10T21:26:59.916594] [INFO ] [MAIN ] SE: Full history saved. [2025-10-10T21:26:59.917381] [INFO ] [MAIN ] Update Progress: 1895/2373 symbols completed. SE took 44.9s. Estimated remaining: 1h 7m 20s. Rate: 7.1 symbols/min [2025-10-10T21:26:59.995922] [DEBUG] [LOCAL ] SEE: Trimmed 69816 records to 48909 (keeping 200 days of data) [2025-10-10T21:27:00.219163] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-10T21:27:00.263787] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-10T21:27:00.290066] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:27:00.508600] [DEBUG] [LOCAL ] SEE: Primary data saved (48909 records). [2025-10-10T21:27:00.508845] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-10T21:27:00.508950] [INFO ] [MAIN ] Update Progress: 1896/2373 symbols completed. SEE took 42.4s. Estimated remaining: 1h 7m 9s. Rate: 7.1 symbols/min [2025-10-10T21:27:00.640277] [DEBUG] [LOCAL ] SEMR: Loaded 42098 existing records from primary storage. [2025-10-10T21:27:00.656675] [INFO ] [MAIN ] SEMR: Loaded 42098 existing records. [2025-10-10T21:27:00.811560] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:27:00.919275] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:27:00.919696] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-10T21:27:00.919762] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-10T21:27:00.920046] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-10T21:27:00.920106] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-10T21:27:01.202528] [DEBUG] [LOCAL ] SES: Loaded 51959 existing records from primary storage. [2025-10-10T21:27:01.231825] [INFO ] [MAIN ] SES: Loaded 51959 existing records. [2025-10-10T21:27:01.531857] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:27:01.538918] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-10-10T21:27:01.538332] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:27:01.540139] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-10T21:27:01.540198] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-10T21:27:01.540422] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-10T21:27:01.540480] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-10T21:27:01.951318] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:27:01.951771] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-10-10T21:27:02.272540] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-10T21:27:02.282067] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-10T21:27:03.383256] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (3.12 seconds). [2025-10-10T21:27:03.392588] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-10T21:27:03.623150] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-10T21:27:03.634062] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-10T21:27:03.671634] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-10T21:27:04.289474] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-10T21:27:04.406099] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-10T21:27:04.869574] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-10T21:27:05.055237] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-10T21:27:05.089351] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-10T21:27:05.889383] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-10T21:27:06.694573] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-10T21:27:06.710319] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T21:27:07.196124] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (2.91 seconds). [2025-10-10T21:27:07.489397] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-10T21:27:08.289378] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-10T21:27:08.722910] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T21:27:08.770427] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.88 seconds). [2025-10-10T21:27:09.089347] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-10T21:27:09.719328] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-10T21:27:09.760737] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-10T21:27:09.889403] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-10T21:27:10.689405] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-10T21:27:11.489350] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-10T21:27:11.572711] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-10T21:27:11.623053] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T21:27:12.289509] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-10T21:27:12.590223] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T21:27:13.089449] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-10T21:27:13.889374] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-10T21:27:14.129161] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-10T21:27:14.250107] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T21:27:14.689370] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-10T21:27:14.802309] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T21:27:15.489376] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-10T21:27:16.289356] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-10T21:27:16.537054] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T21:27:16.790591] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-10-10T21:27:16.896270] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T21:27:17.089383] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-10T21:27:17.889380] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-10T21:27:18.390524] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-10T21:27:18.689379] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-10T21:27:18.844138] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-10T21:27:19.489401] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-10T21:27:20.289420] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-10T21:27:20.548621] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-10T21:27:20.673541] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-10T21:27:21.089343] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-10T21:27:21.318689] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T21:27:21.889384] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-10T21:27:22.139240] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T21:27:22.689398] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-10T21:27:23.203766] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T21:27:23.256839] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T21:27:23.489373] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-10T21:27:24.289370] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-10T21:27:24.458491] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T21:27:25.089423] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-10T21:27:25.151382] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T21:27:25.889377] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-10T21:27:26.615852] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-10T21:27:26.620415] [INFO ] [REMOTE ] SEMR: Full fetch complete (59702 records). [2025-10-10T21:27:26.620499] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-10T21:27:26.694669] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-10T21:27:27.008135] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-10T21:27:27.008324] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-10T21:27:27.009577] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-10T21:27:27.009698] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-10T21:27:27.011768] [DEBUG] [LOCAL ] SEMR: Trimmed 59702 records to 42445 (keeping 200 days of data) [2025-10-10T21:27:27.141487] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-10-10T21:27:27.294373] [DEBUG] [LOCAL ] SEMR: Primary data saved (42445 records). [2025-10-10T21:27:27.294513] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-10T21:27:27.294599] [INFO ] [MAIN ] Update Progress: 1897/2373 symbols completed. SEMR took 27.4s. Estimated remaining: 1h 7m 6s. Rate: 7.1 symbols/min [2025-10-10T21:27:27.463863] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:27:27.476730] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-10T21:27:27.481493] [INFO ] [REMOTE ] SEM: Full fetch complete (61572 records). [2025-10-10T21:27:27.481639] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-10T21:27:27.503869] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-10T21:27:27.792803] [DEBUG] [LOCAL ] SF: Loaded 41925 existing records from primary storage. [2025-10-10T21:27:27.814402] [INFO ] [MAIN ] SF: Loaded 41925 existing records. [2025-10-10T21:27:28.114563] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-10T21:27:28.120760] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:27:28.121015] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-10T21:27:28.120887] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-10T21:27:28.122164] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-10T21:27:28.122245] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-10T21:27:28.121092] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-10T21:27:28.122617] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-10T21:27:28.122878] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-10T21:27:28.194729] [DEBUG] [LOCAL ] SEM: Trimmed 61572 records to 43588 (keeping 200 days of data) [2025-10-10T21:27:28.667900] [DEBUG] [LOCAL ] SEM: Primary data saved (43588 records). [2025-10-10T21:27:28.689603] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-10T21:27:28.690228] [INFO ] [MAIN ] Update Progress: 1898/2373 symbols completed. SEM took 30.9s. Estimated remaining: 1h 6m 55s. Rate: 7.1 symbols/min [2025-10-10T21:27:28.852126] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:27:28.870700] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-10-10T21:27:28.944154] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:27:28.980782] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-10T21:27:28.984257] [DEBUG] [LOCAL ] SFB: Loaded 4217 existing records from primary storage. [2025-10-10T21:27:28.994976] [INFO ] [MAIN ] SFB: Loaded 4217 existing records. [2025-10-10T21:27:29.094916] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-10T21:27:29.174992] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:27:29.175243] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-10T21:27:29.175299] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-10T21:27:29.175474] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-10T21:27:29.175541] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-10T21:27:29.525927] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:27:29.601675] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-10T21:27:29.889380] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-10T21:27:30.689075] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-10T21:27:30.697049] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-10T21:27:31.159885] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-10T21:27:31.489431] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-10T21:27:31.884512] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-10T21:27:31.968937] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-10T21:27:32.289416] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-10T21:27:33.089394] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-10-10T21:27:33.366823] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-10T21:27:33.372469] [INFO ] [REMOTE ] SEI: Full fetch complete (70439 records). [2025-10-10T21:27:33.372681] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-10T21:27:33.796604] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-10T21:27:33.798858] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-10T21:27:33.801817] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-10T21:27:33.801579] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-10T21:27:33.803864] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-10T21:27:33.805771] [DEBUG] [LOCAL ] SEI: Trimmed 70439 records to 50532 (keeping 200 days of data) [2025-10-10T21:27:33.902114] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-10T21:27:34.144009] [DEBUG] [LOCAL ] SEI: Primary data saved (50532 records). [2025-10-10T21:27:34.144205] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-10T21:27:34.144543] [INFO ] [MAIN ] Update Progress: 1899/2373 symbols completed. SEI took 38.6s. Estimated remaining: 1h 6m 46s. Rate: 7.1 symbols/min [2025-10-10T21:27:34.326633] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:27:34.353276] [DEBUG] [LOCAL ] SFBS: Loaded 21214 existing records from primary storage. [2025-10-10T21:27:34.353605] [INFO ] [MAIN ] SFBS: Loaded 21214 existing records. [2025-10-10T21:27:34.538525] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:27:34.538941] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-10T21:27:34.539076] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-10T21:27:34.539255] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-10T21:27:34.539295] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-10T21:27:34.696623] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-10T21:27:34.828481] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-10T21:27:34.944690] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:27:35.432243] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-10T21:27:35.489385] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-10T21:27:35.581133] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-10T21:27:36.039319] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-10T21:27:36.289405] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-10T21:27:37.089389] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-10-10T21:27:37.102557] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-10T21:27:37.889454] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-10T21:27:38.359293] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-10T21:27:38.689373] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-10T21:27:39.457200] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-10T21:27:39.489364] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-10T21:27:39.749866] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T21:27:39.845368] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-10T21:27:40.289417] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-10T21:27:41.089386] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-10T21:27:41.889386] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-10T21:27:42.430813] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T21:27:42.690014] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-10T21:27:42.690183] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-10T21:27:43.271377] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-10T21:27:43.396331] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-10T21:27:43.489348] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-10T21:27:44.199906] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-10T21:27:44.289397] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-10T21:27:45.089382] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-10T21:27:45.631698] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-10T21:27:45.889385] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-10T21:27:46.463492] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-10T21:27:46.469176] [INFO ] [REMOTE ] SES: Full fetch complete (75608 records). [2025-10-10T21:27:46.469351] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-10T21:27:46.685023] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-10T21:27:46.694485] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-10T21:27:46.898755] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-10T21:27:46.898880] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-10T21:27:46.900105] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-10T21:27:46.900174] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-10T21:27:46.901731] [DEBUG] [LOCAL ] SES: Trimmed 75608 records to 52349 (keeping 200 days of data) [2025-10-10T21:27:47.206629] [DEBUG] [LOCAL ] SES: Primary data saved (52349 records). [2025-10-10T21:27:47.206794] [INFO ] [MAIN ] SES: Full history saved. [2025-10-10T21:27:47.206893] [INFO ] [MAIN ] Update Progress: 1900/2373 symbols completed. SES took 46.7s. Estimated remaining: 1h 6m 39s. Rate: 7.1 symbols/min [2025-10-10T21:27:47.370193] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:27:47.409519] [DEBUG] [LOCAL ] SFL: Loaded 45526 existing records from primary storage. [2025-10-10T21:27:47.409845] [INFO ] [MAIN ] SFL: Loaded 45526 existing records. [2025-10-10T21:27:47.496419] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-10T21:27:47.595224] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:27:47.595497] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-10T21:27:47.595573] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-10T21:27:47.595870] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-10T21:27:47.595934] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-10T21:27:47.955887] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:27:48.035381] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T21:27:48.289362] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-10T21:27:49.089404] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-10-10T21:27:49.322573] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T21:27:49.539426] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-10T21:27:49.889371] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-10T21:27:50.497899] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T21:27:50.689360] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-10T21:27:51.292516] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-10T21:27:51.489387] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-10T21:27:52.064116] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-10T21:27:52.065101] [INFO ] [REMOTE ] SFB: Full fetch complete (5835 records). [2025-10-10T21:27:52.065167] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-10T21:27:52.306582] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-10T21:27:52.426207] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-10T21:27:52.426318] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-10T21:27:52.426515] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-10T21:27:52.426590] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-10T21:27:52.427293] [DEBUG] [LOCAL ] SFB: Trimmed 5835 records to 4239 (keeping 200 days of data) [2025-10-10T21:27:52.462013] [DEBUG] [LOCAL ] SFB: Primary data saved (4239 records). [2025-10-10T21:27:52.475027] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-10T21:27:52.475722] [INFO ] [MAIN ] Update Progress: 1901/2373 symbols completed. SFB took 23.8s. Estimated remaining: 1h 6m 30s. Rate: 7.1 symbols/min [2025-10-10T21:27:52.476486] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T21:27:52.649797] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:27:52.700301] [DEBUG] [LOCAL ] SG: Loaded 53857 existing records from primary storage. [2025-10-10T21:27:52.700683] [INFO ] [MAIN ] SG: Loaded 53857 existing records. [2025-10-10T21:27:52.871272] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:27:52.871468] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-10T21:27:52.871515] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-10T21:27:52.871774] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-10T21:27:52.871829] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-10T21:27:53.101270] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-10T21:27:53.227412] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:27:53.561639] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T21:27:53.889380] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-10T21:27:54.689346] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-10T21:27:55.044530] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-10T21:27:55.073386] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T21:27:55.489423] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-10T21:27:56.289454] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-10T21:27:56.442926] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T21:27:57.089426] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-10-10T21:27:57.440907] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T21:27:57.542551] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-10T21:27:57.889401] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-10T21:27:58.689393] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-10T21:27:59.187908] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T21:27:59.247537] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-10T21:27:59.489395] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-10T21:27:59.990689] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T21:28:00.289439] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-10T21:28:00.753892] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T21:28:01.089412] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-10T21:28:01.769238] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-10T21:28:01.889470] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-10T21:28:02.145071] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-10T21:28:02.147739] [INFO ] [REMOTE ] SFBS: Full fetch complete (30174 records). [2025-10-10T21:28:02.147819] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-10T21:28:02.518887] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-10T21:28:02.518987] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-10T21:28:02.519916] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-10T21:28:02.519993] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-10T21:28:02.520995] [DEBUG] [LOCAL ] SFBS: Trimmed 30174 records to 21351 (keeping 200 days of data) [2025-10-10T21:28:02.663197] [DEBUG] [LOCAL ] SFBS: Primary data saved (21351 records). [2025-10-10T21:28:02.663367] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-10T21:28:02.663467] [INFO ] [MAIN ] Update Progress: 1902/2373 symbols completed. SFBS took 28.5s. Estimated remaining: 1h 6m 22s. Rate: 7.1 symbols/min [2025-10-10T21:28:02.694499] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-10T21:28:02.842146] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:28:02.891892] [DEBUG] [LOCAL ] SGHC: Loaded 46912 existing records from primary storage. [2025-10-10T21:28:02.892344] [INFO ] [MAIN ] SGHC: Loaded 46912 existing records. [2025-10-10T21:28:03.079881] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:28:03.080333] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-10T21:28:03.080388] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-10T21:28:03.080634] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-10T21:28:03.080776] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-10T21:28:03.485077] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:28:03.489355] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-10-10T21:28:03.667588] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T21:28:04.289409] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-10T21:28:04.680088] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T21:28:04.713507] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T21:28:05.089371] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-10T21:28:05.889377] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-10T21:28:06.293931] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-10T21:28:06.694463] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-10T21:28:06.708257] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T21:28:07.469790] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T21:28:07.474261] [INFO ] [REMOTE ] SF: Full fetch complete (60044 records). [2025-10-10T21:28:07.474389] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-10T21:28:07.497033] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-10T21:28:07.900121] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-10T21:28:07.900206] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-10T21:28:07.901147] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-10T21:28:07.901211] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-10T21:28:07.902498] [DEBUG] [LOCAL ] SF: Trimmed 60044 records to 42272 (keeping 200 days of data) [2025-10-10T21:28:08.167578] [DEBUG] [LOCAL ] SF: Primary data saved (42272 records). [2025-10-10T21:28:08.167746] [INFO ] [MAIN ] SF: Full history saved. [2025-10-10T21:28:08.167838] [INFO ] [MAIN ] Update Progress: 1903/2373 symbols completed. SF took 40.9s. Estimated remaining: 1h 6m 12s. Rate: 7.1 symbols/min [2025-10-10T21:28:08.294603] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-10T21:28:08.339447] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:28:08.339818] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-10T21:28:08.339871] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-10T21:28:08.339994] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-10T21:28:08.340051] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-10T21:28:08.340095] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-10T21:28:08.340128] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-10T21:28:08.696965] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:28:08.817960] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-10T21:28:09.089469] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-10T21:28:09.370164] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-10T21:28:09.889469] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-10T21:28:10.060384] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T21:28:10.689355] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-10T21:28:11.264025] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-10T21:28:11.489379] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-10-10T21:28:11.614939] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T21:28:11.746795] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:28:11.747136] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-10-10T21:28:11.747258] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:28:11.747345] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-10T21:28:11.747430] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:28:11.747523] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-10T21:28:11.747604] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-10T21:28:11.747670] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-10T21:28:11.747750] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-10T21:28:11.747806] [INFO ] [MAIN ] Update Progress: 1904/2373 symbols completed. SGI took 3.6s. Estimated remaining: 1h 6m 3s. Rate: 7.1 symbols/min [2025-10-10T21:28:11.920109] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:28:11.948327] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T21:28:11.960482] [DEBUG] [LOCAL ] SGU: Loaded 6613 existing records from primary storage. [2025-10-10T21:28:11.960691] [INFO ] [MAIN ] SGU: Loaded 6613 existing records. [2025-10-10T21:28:12.135008] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:28:12.135259] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-10T21:28:12.135307] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-10T21:28:12.135466] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-10T21:28:12.135523] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-10T21:28:12.293422] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-10T21:28:12.495374] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:28:13.089374] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-10-10T21:28:13.671278] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-10T21:28:13.889346] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-10T21:28:14.183819] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-10T21:28:14.689350] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-10T21:28:14.702118] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-10T21:28:15.489438] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-10T21:28:16.241430] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-10T21:28:16.289359] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-10T21:28:16.506604] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T21:28:17.089406] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-10T21:28:17.889384] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-10T21:28:18.497411] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-10T21:28:18.689425] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-10T21:28:18.925639] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T21:28:19.489381] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-10T21:28:19.788154] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T21:28:20.289416] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-10T21:28:21.089403] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-10T21:28:21.221220] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T21:28:21.354107] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-10T21:28:21.709370] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-10T21:28:21.889381] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-10T21:28:22.257578] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T21:28:22.689419] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-10T21:28:23.489406] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-10T21:28:23.772131] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T21:28:24.269082] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T21:28:24.273708] [INFO ] [REMOTE ] SFL: Full fetch complete (65689 records). [2025-10-10T21:28:24.273836] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-10T21:28:24.295204] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-10T21:28:24.678895] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-10T21:28:24.678989] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-10T21:28:24.680108] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-10T21:28:24.680177] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-10T21:28:24.681728] [DEBUG] [LOCAL ] SFL: Trimmed 65689 records to 45894 (keeping 200 days of data) [2025-10-10T21:28:24.963135] [DEBUG] [LOCAL ] SFL: Primary data saved (45894 records). [2025-10-10T21:28:24.963277] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-10T21:28:24.963362] [INFO ] [MAIN ] Update Progress: 1905/2373 symbols completed. SFL took 37.8s. Estimated remaining: 1h 5m 56s. Rate: 7.1 symbols/min [2025-10-10T21:28:25.092884] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-10T21:28:25.143970] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:28:25.190533] [DEBUG] [LOCAL ] SHAK: Loaded 49174 existing records from primary storage. [2025-10-10T21:28:25.190945] [INFO ] [MAIN ] SHAK: Loaded 49174 existing records. [2025-10-10T21:28:25.371721] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:28:25.372238] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-10T21:28:25.372297] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-10T21:28:25.372487] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-10T21:28:25.385017] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-10T21:28:25.512570] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T21:28:25.782070] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:28:25.889410] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-10-10T21:28:25.937009] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-10T21:28:26.268462] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T21:28:26.689425] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-10T21:28:27.489375] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-10T21:28:27.500246] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-10T21:28:27.585158] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T21:28:28.289409] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-10T21:28:29.031927] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-10T21:28:29.089403] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-10T21:28:29.786196] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-10T21:28:29.889373] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-10T21:28:30.021134] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-10T21:28:30.689415] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-10T21:28:31.489420] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-10T21:28:31.678460] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T21:28:31.736595] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-10T21:28:32.289394] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-10T21:28:33.089367] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-10T21:28:33.203217] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-10T21:28:33.465804] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-10T21:28:33.889378] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-10T21:28:34.508727] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T21:28:34.509725] [INFO ] [REMOTE ] SGU: Full fetch complete (9015 records). [2025-10-10T21:28:34.509792] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-10T21:28:34.695455] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-10T21:28:34.864563] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-10T21:28:34.864673] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-10T21:28:34.864929] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-10T21:28:34.865016] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-10T21:28:34.865456] [DEBUG] [LOCAL ] SGU: Trimmed 9015 records to 6661 (keeping 200 days of data) [2025-10-10T21:28:34.907368] [DEBUG] [LOCAL ] SGU: Primary data saved (6661 records). [2025-10-10T21:28:34.907515] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-10T21:28:34.907617] [INFO ] [MAIN ] Update Progress: 1906/2373 symbols completed. SGU took 23.2s. Estimated remaining: 1h 5m 47s. Rate: 7.1 symbols/min [2025-10-10T21:28:35.079345] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:28:35.104613] [DEBUG] [LOCAL ] SHCO: Loaded 25606 existing records from primary storage. [2025-10-10T21:28:35.104899] [INFO ] [MAIN ] SHCO: Loaded 25606 existing records. [2025-10-10T21:28:35.280705] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:28:35.281012] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-10T21:28:35.281139] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-10T21:28:35.281584] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-10T21:28:35.281738] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-10T21:28:35.497316] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-10T21:28:35.658096] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-10T21:28:35.682460] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:28:36.289367] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-10T21:28:36.472584] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T21:28:36.477518] [INFO ] [REMOTE ] SGHC: Full fetch complete (64379 records). [2025-10-10T21:28:36.477631] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-10T21:28:36.852423] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-10T21:28:36.852509] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-10T21:28:36.853499] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-10T21:28:36.853562] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-10T21:28:36.854866] [DEBUG] [LOCAL ] SGHC: Trimmed 64379 records to 47289 (keeping 200 days of data) [2025-10-10T21:28:37.089420] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-10-10T21:28:37.151550] [DEBUG] [LOCAL ] SGHC: Primary data saved (47289 records). [2025-10-10T21:28:37.151742] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-10T21:28:37.151857] [INFO ] [MAIN ] Update Progress: 1907/2373 symbols completed. SGHC took 34.5s. Estimated remaining: 1h 5m 37s. Rate: 7.1 symbols/min [2025-10-10T21:28:37.325695] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:28:37.374413] [DEBUG] [LOCAL ] SHEL: Loaded 54062 existing records from primary storage. [2025-10-10T21:28:37.374762] [INFO ] [MAIN ] SHEL: Loaded 54062 existing records. [2025-10-10T21:28:37.553856] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:28:37.554171] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-10T21:28:37.554341] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-10T21:28:37.554676] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-10T21:28:37.554743] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-10T21:28:37.703737] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-10T21:28:37.897838] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-10T21:28:37.937622] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:28:38.385903] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-10T21:28:38.531901] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-10T21:28:38.689380] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-10-10T21:28:39.430422] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-10T21:28:39.489331] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-10T21:28:40.289340] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-10T21:28:40.959837] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-10T21:28:41.089342] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-10T21:28:41.488984] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T21:28:41.610081] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T21:28:41.889359] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-10T21:28:42.689356] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-10T21:28:43.023367] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-10T21:28:43.028404] [INFO ] [REMOTE ] SG: Full fetch complete (77311 records). [2025-10-10T21:28:43.028523] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-10T21:28:43.429196] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-10T21:28:43.429316] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-10T21:28:43.430451] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-10T21:28:43.430512] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-10T21:28:43.433244] [DEBUG] [LOCAL ] SG: Trimmed 77311 records to 54245 (keeping 200 days of data) [2025-10-10T21:28:43.490625] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-10T21:28:43.751789] [DEBUG] [LOCAL ] SG: Primary data saved (54245 records). [2025-10-10T21:28:43.752154] [INFO ] [MAIN ] SG: Full history saved. [2025-10-10T21:28:43.752299] [INFO ] [MAIN ] Update Progress: 1908/2373 symbols completed. SG took 51.3s. Estimated remaining: 1h 5m 29s. Rate: 7.1 symbols/min [2025-10-10T21:28:43.924191] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:28:43.959901] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T21:28:43.992443] [DEBUG] [LOCAL ] SHG: Loaded 26539 existing records from primary storage. [2025-10-10T21:28:43.992758] [INFO ] [MAIN ] SHG: Loaded 26539 existing records. [2025-10-10T21:28:44.168119] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:28:44.168382] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-10T21:28:44.168431] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-10T21:28:44.168862] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-10T21:28:44.168920] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-10T21:28:44.294551] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-10T21:28:44.525246] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:28:44.816212] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T21:28:44.880003] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-10T21:28:45.089377] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-10-10T21:28:45.839906] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T21:28:45.889350] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-10T21:28:46.636987] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T21:28:46.689351] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-10T21:28:47.489349] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-10T21:28:47.911741] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T21:28:48.011020] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T21:28:48.289434] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-10T21:28:49.089398] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-10T21:28:49.557087] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-10T21:28:49.785030] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T21:28:49.889362] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-10T21:28:50.049382] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T21:28:50.689417] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-10T21:28:50.785542] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-10T21:28:51.489375] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-10T21:28:52.289346] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-10T21:28:52.353347] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T21:28:52.693553] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T21:28:53.089384] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-10T21:28:53.889360] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-10T21:28:54.301797] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-10T21:28:54.664289] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-10T21:28:54.689348] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-10T21:28:55.489408] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-10T21:28:55.548682] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-10T21:28:56.289420] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-10T21:28:56.791604] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T21:28:56.999739] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-10T21:28:57.089328] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-10T21:28:57.415291] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-10T21:28:57.889382] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-10T21:28:58.689399] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-10T21:28:59.373680] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-10T21:28:59.444475] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-10T21:28:59.489346] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-10T21:28:59.575357] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-10T21:29:00.289394] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-10T21:29:01.089382] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-10T21:29:01.280146] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T21:29:01.890061] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-10T21:29:01.894026] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-10T21:29:02.689389] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-10T21:29:03.019532] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T21:29:03.489402] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-10T21:29:03.878983] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-10T21:29:03.881510] [INFO ] [REMOTE ] SHCO: Full fetch complete (37592 records). [2025-10-10T21:29:03.881606] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-10T21:29:04.278222] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-10T21:29:04.278411] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-10T21:29:04.279297] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-10T21:29:04.279382] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-10T21:29:04.280533] [DEBUG] [LOCAL ] SHCO: Trimmed 37592 records to 25780 (keeping 200 days of data) [2025-10-10T21:29:04.341123] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-10T21:29:04.417162] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-10T21:29:04.490983] [DEBUG] [LOCAL ] SHCO: Primary data saved (25780 records). [2025-10-10T21:29:04.491150] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-10T21:29:04.491253] [INFO ] [MAIN ] Update Progress: 1909/2373 symbols completed. SHCO took 29.6s. Estimated remaining: 1h 5m 23s. Rate: 7.1 symbols/min [2025-10-10T21:29:04.671256] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T21:29:04.695455] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:29:04.739956] [DEBUG] [LOCAL ] SHO: Loaded 49918 existing records from primary storage. [2025-10-10T21:29:04.740340] [INFO ] [MAIN ] SHO: Loaded 49918 existing records. [2025-10-10T21:29:04.918416] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:29:04.918710] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-10T21:29:04.918785] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-10T21:29:04.919150] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-10T21:29:04.919210] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-10T21:29:05.095992] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-10T21:29:05.294096] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:29:05.889392] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-10T21:29:06.061850] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-10T21:29:06.066516] [INFO ] [REMOTE ] SHAK: Full fetch complete (70728 records). [2025-10-10T21:29:06.066703] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-10T21:29:06.452106] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-10T21:29:06.452198] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-10T21:29:06.453680] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-10T21:29:06.453741] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-10T21:29:06.455128] [DEBUG] [LOCAL ] SHAK: Trimmed 70728 records to 49551 (keeping 200 days of data) [2025-10-10T21:29:06.689388] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-10-10T21:29:06.755030] [DEBUG] [LOCAL ] SHAK: Primary data saved (49551 records). [2025-10-10T21:29:06.755181] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-10T21:29:06.755286] [INFO ] [MAIN ] Update Progress: 1910/2373 symbols completed. SHAK took 41.8s. Estimated remaining: 1h 5m 13s. Rate: 7.1 symbols/min [2025-10-10T21:29:06.923735] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:29:06.929473] [DEBUG] [LOCAL ] SHOC: Loaded 3377 existing records from primary storage. [2025-10-10T21:29:06.929631] [INFO ] [MAIN ] SHOC: Loaded 3377 existing records. [2025-10-10T21:29:07.104215] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:29:07.104461] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-10T21:29:07.104508] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-10T21:29:07.104692] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-10T21:29:07.104749] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-10T21:29:07.468001] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:29:07.489847] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-10T21:29:07.489974] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-10-10T21:29:07.571223] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-10T21:29:08.073388] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T21:29:08.289357] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-10T21:29:08.397238] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-10T21:29:09.089462] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-10T21:29:09.889382] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-10T21:29:10.689929] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-10T21:29:10.696841] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-10T21:29:10.737016] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T21:29:11.126373] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-10T21:29:11.280746] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-10T21:29:11.489367] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-10T21:29:12.289371] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-10T21:29:13.089466] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-10T21:29:13.278144] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T21:29:13.586335] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T21:29:13.889446] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-10T21:29:14.689400] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-10T21:29:14.815937] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-10T21:29:14.821746] [INFO ] [REMOTE ] SHEL: Full fetch complete (77694 records). [2025-10-10T21:29:14.821973] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-10T21:29:15.258788] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-10T21:29:15.258904] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-10T21:29:15.260483] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-10T21:29:15.260555] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-10T21:29:15.262638] [DEBUG] [LOCAL ] SHEL: Trimmed 77694 records to 54452 (keeping 200 days of data) [2025-10-10T21:29:15.502510] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-10T21:29:15.643722] [DEBUG] [LOCAL ] SHEL: Primary data saved (54452 records). [2025-10-10T21:29:15.643919] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-10T21:29:15.644545] [INFO ] [MAIN ] Update Progress: 1911/2373 symbols completed. SHEL took 38.5s. Estimated remaining: 1h 5m 5s. Rate: 7.1 symbols/min [2025-10-10T21:29:15.819837] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:29:15.864197] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T21:29:15.865951] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-10T21:29:15.881808] [INFO ] [REMOTE ] SHG: Full fetch complete (40927 records). [2025-10-10T21:29:15.881983] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-10T21:29:16.025995] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-10T21:29:16.159790] [DEBUG] [LOCAL ] SHW: Loaded 50691 existing records from primary storage. [2025-10-10T21:29:16.200164] [INFO ] [MAIN ] SHW: Loaded 50691 existing records. [2025-10-10T21:29:16.298407] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-10T21:29:16.497920] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-10T21:29:16.502696] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-10T21:29:16.507021] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-10T21:29:16.530837] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-10T21:29:16.530701] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:29:16.531394] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-10T21:29:16.531459] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-10T21:29:16.531886] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-10T21:29:16.532009] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-10T21:29:16.625578] [DEBUG] [LOCAL ] SHG: Trimmed 40927 records to 26806 (keeping 200 days of data) [2025-10-10T21:29:17.015344] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:29:17.089271] [DEBUG] [LOCAL ] SHG: Primary data saved (26806 records). [2025-10-10T21:29:17.089545] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-10-10T21:29:17.089422] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-10T21:29:17.090036] [INFO ] [MAIN ] Update Progress: 1912/2373 symbols completed. SHG took 33.3s. Estimated remaining: 1h 4m 55s. Rate: 7.1 symbols/min [2025-10-10T21:29:17.259435] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:29:17.259626] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-10T21:29:17.259697] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-10T21:29:17.259816] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-10T21:29:17.259858] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-10T21:29:17.259900] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-10T21:29:17.259933] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-10T21:29:17.610235] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:29:17.889404] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-10-10T21:29:18.114636] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:29:18.115164] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-10-10T21:29:18.115270] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:29:18.115324] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-10T21:29:18.115386] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:29:18.115461] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-10T21:29:18.115532] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-10T21:29:18.115570] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-10T21:29:18.115609] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-10T21:29:18.115688] [INFO ] [MAIN ] Update Progress: 1913/2373 symbols completed. SI took 1.0s. Estimated remaining: 1h 4m 44s. Rate: 7.1 symbols/min [2025-10-10T21:29:18.295858] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:29:18.328672] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T21:29:18.377151] [DEBUG] [LOCAL ] SID: Loaded 42901 existing records from primary storage. [2025-10-10T21:29:18.377524] [INFO ] [MAIN ] SID: Loaded 42901 existing records. [2025-10-10T21:29:18.554378] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:29:18.554698] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-10T21:29:18.554761] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-10T21:29:18.554987] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-10T21:29:18.555049] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-10T21:29:18.701848] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-10T21:29:18.921334] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:29:19.118098] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-10T21:29:19.489363] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-10T21:29:20.289424] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-10T21:29:20.642788] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-10T21:29:21.089332] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-10T21:29:21.202603] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-10T21:29:21.472994] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T21:29:21.889418] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-10-10T21:29:22.689333] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-10T21:29:22.820917] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T21:29:23.489367] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-10T21:29:23.678910] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T21:29:24.289371] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-10T21:29:24.728937] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-10T21:29:24.970737] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-10T21:29:25.049100] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-10T21:29:25.089422] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-10T21:29:25.889380] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-10T21:29:26.689423] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-10T21:29:27.149855] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-10T21:29:27.489406] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-10T21:29:27.750039] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T21:29:28.289348] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-10T21:29:28.577209] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-10T21:29:29.089351] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-10T21:29:29.428570] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T21:29:29.889398] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-10T21:29:30.218030] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T21:29:30.452133] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-10T21:29:30.655472] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T21:29:30.689341] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-10T21:29:31.489386] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-10T21:29:32.289354] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-10T21:29:32.477552] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T21:29:33.089373] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-10T21:29:33.109982] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-10T21:29:33.114404] [INFO ] [REMOTE ] SHO: Full fetch complete (70951 records). [2025-10-10T21:29:33.114526] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-10T21:29:33.500155] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-10T21:29:33.500245] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-10T21:29:33.501383] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-10T21:29:33.501451] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-10T21:29:33.502972] [DEBUG] [LOCAL ] SHO: Trimmed 70951 records to 50269 (keeping 200 days of data) [2025-10-10T21:29:33.806935] [DEBUG] [LOCAL ] SHO: Primary data saved (50269 records). [2025-10-10T21:29:33.807114] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-10T21:29:33.807222] [INFO ] [MAIN ] Update Progress: 1914/2373 symbols completed. SHO took 29.3s. Estimated remaining: 1h 4m 38s. Rate: 7.1 symbols/min [2025-10-10T21:29:33.898448] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-10T21:29:33.982788] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:29:34.023715] [DEBUG] [LOCAL ] SIG: Loaded 46129 existing records from primary storage. [2025-10-10T21:29:34.024017] [INFO ] [MAIN ] SIG: Loaded 46129 existing records. [2025-10-10T21:29:34.226345] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:29:34.226720] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-10T21:29:34.226831] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-10T21:29:34.227086] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-10T21:29:34.227143] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-10T21:29:34.564367] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-10T21:29:34.593726] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-10T21:29:34.621264] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:29:34.689327] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-10-10T21:29:34.825834] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T21:29:35.489367] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-10T21:29:36.236436] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-10T21:29:36.289367] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-10T21:29:36.606714] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T21:29:37.089401] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-10T21:29:37.646578] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T21:29:37.725602] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-10T21:29:37.889391] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-10T21:29:38.512339] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-10T21:29:38.689377] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-10T21:29:39.489350] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-10T21:29:40.067890] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-10T21:29:40.068911] [INFO ] [REMOTE ] SHOC: Full fetch complete (7074 records). [2025-10-10T21:29:40.068994] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-10T21:29:40.294512] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-10T21:29:40.440579] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-10T21:29:40.440781] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-10T21:29:40.441063] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-10T21:29:40.441142] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-10T21:29:40.441738] [DEBUG] [LOCAL ] SHOC: Trimmed 7074 records to 3425 (keeping 200 days of data) [2025-10-10T21:29:40.462243] [DEBUG] [LOCAL ] SHOC: Primary data saved (3425 records). [2025-10-10T21:29:40.462303] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-10T21:29:40.462375] [INFO ] [MAIN ] Update Progress: 1915/2373 symbols completed. SHOC took 33.7s. Estimated remaining: 1h 4m 29s. Rate: 7.1 symbols/min [2025-10-10T21:29:40.630139] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:29:40.653438] [DEBUG] [LOCAL ] SII: Loaded 23968 existing records from primary storage. [2025-10-10T21:29:40.653726] [INFO ] [MAIN ] SII: Loaded 23968 existing records. [2025-10-10T21:29:40.829944] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:29:40.847733] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-10T21:29:40.847816] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-10T21:29:40.862128] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-10T21:29:40.862206] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-10T21:29:40.960610] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-10T21:29:41.094609] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-10T21:29:41.236076] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:29:41.889364] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-10-10T21:29:42.045626] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T21:29:42.689405] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-10T21:29:42.983346] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-10T21:29:43.198819] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-10T21:29:43.489389] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-10T21:29:44.289366] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-10T21:29:44.532889] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-10T21:29:45.089390] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-10T21:29:45.447373] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T21:29:45.838875] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T21:29:45.889368] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-10T21:29:46.125081] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-10T21:29:46.689422] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-10T21:29:47.489401] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-10T21:29:48.022527] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-10T21:29:48.289414] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-10T21:29:48.791716] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T21:29:49.089410] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-10T21:29:49.228264] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T21:29:49.408338] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-10T21:29:49.889380] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-10T21:29:50.689364] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-10T21:29:50.865267] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T21:29:51.110981] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T21:29:51.489387] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-10T21:29:52.289425] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-10T21:29:52.437832] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T21:29:53.089374] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-10T21:29:53.489079] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-10T21:29:53.889425] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-10T21:29:54.009785] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-10T21:29:54.248957] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T21:29:54.689374] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-10T21:29:55.492850] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-10T21:29:55.494212] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T21:29:55.501211] [INFO ] [REMOTE ] SID: Full fetch complete (60827 records). [2025-10-10T21:29:55.501378] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-10T21:29:55.812558] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-10T21:29:55.977366] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-10T21:29:55.977475] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-10T21:29:55.978771] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-10T21:29:55.978837] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-10T21:29:55.980479] [DEBUG] [LOCAL ] SID: Trimmed 60827 records to 43228 (keeping 200 days of data) [2025-10-10T21:29:56.242309] [DEBUG] [LOCAL ] SID: Primary data saved (43228 records). [2025-10-10T21:29:56.242455] [INFO ] [MAIN ] SID: Full history saved. [2025-10-10T21:29:56.242538] [INFO ] [MAIN ] Update Progress: 1916/2373 symbols completed. SID took 38.1s. Estimated remaining: 1h 4m 22s. Rate: 7.1 symbols/min [2025-10-10T21:29:56.294607] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-10T21:29:56.440927] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:29:56.473437] [DEBUG] [LOCAL ] SILA: Loaded 30772 existing records from primary storage. [2025-10-10T21:29:56.473778] [INFO ] [MAIN ] SILA: Loaded 30772 existing records. [2025-10-10T21:29:56.680672] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:29:56.681935] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-10T21:29:56.682028] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-10T21:29:56.682412] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-10T21:29:56.682519] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-10T21:29:57.033159] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:29:57.089345] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-10-10T21:29:57.370818] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T21:29:57.889396] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-10T21:29:58.104007] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-10T21:29:58.110454] [INFO ] [REMOTE ] SHW: Full fetch complete (73049 records). [2025-10-10T21:29:58.110710] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-10T21:29:58.510489] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-10T21:29:58.510616] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-10T21:29:58.512430] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-10T21:29:58.512609] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-10T21:29:58.514585] [DEBUG] [LOCAL ] SHW: Trimmed 73049 records to 51079 (keeping 200 days of data) [2025-10-10T21:29:58.710117] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-10T21:29:58.770725] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T21:29:58.891539] [DEBUG] [LOCAL ] SHW: Primary data saved (51079 records). [2025-10-10T21:29:58.891770] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-10T21:29:58.892456] [INFO ] [MAIN ] Update Progress: 1917/2373 symbols completed. SHW took 43.2s. Estimated remaining: 1h 4m 12s. Rate: 7.1 symbols/min [2025-10-10T21:29:59.200429] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-10T21:29:59.489396] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-10T21:30:00.061874] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-10T21:30:00.289399] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-10T21:30:01.000904] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T21:30:01.089397] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-10T21:30:01.611253] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T21:30:01.889395] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-10T21:30:02.689409] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-10T21:30:03.167406] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T21:30:03.489495] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-10T21:30:03.536591] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-10T21:30:04.289378] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-10T21:30:04.336854] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T21:30:05.007246] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T21:30:05.089425] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-10T21:30:05.492403] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T21:30:05.496876] [INFO ] [REMOTE ] SIG: Full fetch complete (67817 records). [2025-10-10T21:30:05.497064] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-10T21:30:05.904898] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-10T21:30:06.113676] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-10T21:30:06.113872] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-10T21:30:06.117362] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-10T21:30:06.117480] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-10T21:30:06.119844] [DEBUG] [LOCAL ] SIG: Trimmed 67817 records to 46469 (keeping 200 days of data) [2025-10-10T21:30:06.268699] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-10T21:30:06.282743] [INFO ] [REMOTE ] SII: Full fetch complete (30715 records). [2025-10-10T21:30:06.284477] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-10T21:30:06.819077] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-10T21:30:06.819802] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-10T21:30:06.823626] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-10T21:30:06.824047] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-10T21:30:06.827745] [DEBUG] [LOCAL ] SII: Trimmed 30715 records to 24196 (keeping 200 days of data) [2025-10-10T21:30:07.024498] [DEBUG] [LOCAL ] SII: Primary data saved (24196 records). [2025-10-10T21:30:07.026199] [INFO ] [MAIN ] SII: Full history saved. [2025-10-10T21:30:07.026599] [INFO ] [MAIN ] Update Progress: 1918/2373 symbols completed. SII took 26.6s. Estimated remaining: 1h 4m 4s. Rate: 7.1 symbols/min [2025-10-10T21:30:07.028168] [DEBUG] [LOCAL ] SIG: Primary data saved (46469 records). [2025-10-10T21:30:07.028271] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-10T21:30:07.028379] [INFO ] [MAIN ] Update Progress: 1919/2373 symbols completed. SIG took 33.2s. Estimated remaining: 1h 3m 53s. Rate: 7.1 symbols/min [2025-10-10T21:30:07.378019] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-10T21:30:07.384750] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-10T21:30:08.960980] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-10T21:30:08.968458] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-10T21:30:10.548322] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T21:30:10.555302] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-10T21:30:12.064998] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-10T21:30:12.072337] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-10T21:30:13.820662] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T21:30:13.829160] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-10T21:30:15.587569] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-10T21:30:15.595244] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-10T21:30:17.101358] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T21:30:17.108133] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-10T21:30:18.383764] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T21:30:18.389849] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-10T21:30:19.481157] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T21:30:19.484346] [INFO ] [REMOTE ] SILA: Full fetch complete (44516 records). [2025-10-10T21:30:19.484441] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-10T21:30:19.863824] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-10T21:30:19.863911] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-10T21:30:19.864740] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-10T21:30:19.864802] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-10T21:30:19.865723] [DEBUG] [LOCAL ] SILA: Trimmed 44516 records to 31008 (keeping 200 days of data) [2025-10-10T21:30:20.052422] [DEBUG] [LOCAL ] SILA: Primary data saved (31008 records). [2025-10-10T21:30:20.052570] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-10T21:30:20.052675] [INFO ] [MAIN ] Update Progress: 1920/2373 symbols completed. SILA took 23.8s. Estimated remaining: 1h 3m 46s. Rate: 7.1 symbols/min [2025-10-10T21:30:20.774018] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:30:20.902511] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:30:20.874850] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:30:20.915537] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:30:20.936615] [DEBUG] [LOCAL ] SJT: Loaded 22638 existing records from primary storage. [2025-10-10T21:30:20.947164] [INFO ] [MAIN ] SJT: Loaded 22638 existing records. [2025-10-10T21:30:21.067706] [DEBUG] [LOCAL ] SITE: Loaded 35558 existing records from primary storage. [2025-10-10T21:30:21.093499] [INFO ] [MAIN ] SITE: Loaded 35558 existing records. [2025-10-10T21:30:21.239073] [DEBUG] [LOCAL ] SITC: Loaded 41812 existing records from primary storage. [2025-10-10T21:30:21.282534] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:30:21.283025] [INFO ] [MAIN ] SITC: Loaded 41812 existing records. [2025-10-10T21:30:21.289521] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-10T21:30:21.289166] [DEBUG] [LOCAL ] SJM: Loaded 50431 existing records from primary storage. [2025-10-10T21:30:21.294843] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-10T21:30:21.326127] [INFO ] [MAIN ] SJM: Loaded 50431 existing records. [2025-10-10T21:30:21.391678] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-10T21:30:21.425493] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-10T21:30:21.657312] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:30:21.695105] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-10T21:30:21.742880] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-10T21:30:21.807086] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-10T21:30:21.807324] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-10T21:30:21.903257] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:30:21.958404] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-10T21:30:21.983168] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-10T21:30:22.062756] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-10T21:30:22.093523] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-10T21:30:22.156544] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:30:22.262032] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-10T21:30:22.308250] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-10T21:30:22.358723] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-10T21:30:22.358924] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-10T21:30:23.017681] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:30:23.087298] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:30:23.116269] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-10-10T21:30:23.122026] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-10-10T21:30:23.323424] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:30:23.334229] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-10-10T21:30:23.398072] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:30:23.398440] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-10-10T21:30:24.563250] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-10T21:30:24.569300] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-10T21:30:24.598860] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T21:30:24.605201] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-10T21:30:24.724813] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T21:30:24.734901] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-10T21:30:25.286228] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T21:30:25.296021] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-10T21:30:25.361294] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-10T21:30:25.365933] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-10T21:30:26.179349] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-10T21:30:26.185713] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-10T21:30:26.454845] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-10T21:30:26.464098] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-10T21:30:26.550494] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-10T21:30:26.556114] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-10T21:30:26.685193] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-10T21:30:26.694979] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-10T21:30:27.753459] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-10T21:30:27.758766] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-10T21:30:28.184570] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T21:30:28.193696] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-10T21:30:28.231792] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-10T21:30:28.239803] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-10T21:30:28.547856] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T21:30:28.559513] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-10T21:30:28.785156] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-10T21:30:28.791562] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-10T21:30:29.949831] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T21:30:29.959106] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-10T21:30:29.991036] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-10T21:30:30.000734] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-10T21:30:30.098952] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-10T21:30:30.109402] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-10T21:30:30.210537] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-10T21:30:30.221491] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-10T21:30:30.949288] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-10T21:30:30.954510] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-10T21:30:31.755746] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T21:30:31.764587] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-10T21:30:31.811378] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T21:30:31.903551] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-10T21:30:32.185931] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T21:30:32.289364] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-10T21:30:33.089377] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-10T21:30:33.329366] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-10T21:30:33.889347] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-10T21:30:34.221976] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-10T21:30:34.689364] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-10T21:30:34.754518] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-10T21:30:34.865737] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T21:30:35.489425] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-10T21:30:36.289358] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-10T21:30:36.811333] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-10T21:30:36.945833] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-10T21:30:37.089337] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-10T21:30:37.650955] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-10T21:30:37.889385] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-10T21:30:38.331485] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T21:30:38.689425] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-10T21:30:39.489471] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-10T21:30:39.583165] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T21:30:39.798479] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-10T21:30:39.801110] [INFO ] [REMOTE ] SJT: Full fetch complete (31907 records). [2025-10-10T21:30:39.801201] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-10T21:30:40.192904] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-10T21:30:40.193008] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-10T21:30:40.194034] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-10T21:30:40.194130] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-10T21:30:40.195244] [DEBUG] [LOCAL ] SJT: Trimmed 31907 records to 22810 (keeping 200 days of data) [2025-10-10T21:30:40.290345] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-10T21:30:40.336507] [DEBUG] [LOCAL ] SJT: Primary data saved (22810 records). [2025-10-10T21:30:40.336716] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-10T21:30:40.336852] [INFO ] [MAIN ] Update Progress: 1921/2373 symbols completed. SJT took 20.3s. Estimated remaining: 1h 3m 40s. Rate: 7.1 symbols/min [2025-10-10T21:30:40.507643] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:30:40.543141] [DEBUG] [LOCAL ] SKE: Loaded 36667 existing records from primary storage. [2025-10-10T21:30:40.543468] [INFO ] [MAIN ] SKE: Loaded 36667 existing records. [2025-10-10T21:30:40.713799] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:30:40.714135] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-10T21:30:40.714183] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-10T21:30:40.714406] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-10T21:30:40.714483] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-10T21:30:41.089731] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-10T21:30:41.129983] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:30:41.686042] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-10T21:30:41.889346] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-10-10T21:30:41.917149] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T21:30:42.689412] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-10T21:30:42.886307] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-10T21:30:43.489335] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-10T21:30:43.595276] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T21:30:44.289402] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-10T21:30:44.661204] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T21:30:45.089434] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-10T21:30:45.278180] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T21:30:45.335821] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-10T21:30:45.889407] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-10T21:30:46.615175] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-10T21:30:46.619887] [INFO ] [REMOTE ] SITE: Full fetch complete (50019 records). [2025-10-10T21:30:46.620052] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-10T21:30:46.698585] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-10T21:30:47.029150] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-10T21:30:47.029260] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-10T21:30:47.030683] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-10T21:30:47.030751] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-10T21:30:47.032355] [DEBUG] [LOCAL ] SITE: Trimmed 50019 records to 35824 (keeping 200 days of data) [2025-10-10T21:30:47.226803] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T21:30:47.317631] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-10T21:30:47.340451] [DEBUG] [LOCAL ] SITE: Primary data saved (35824 records). [2025-10-10T21:30:47.340669] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-10T21:30:47.340795] [INFO ] [MAIN ] Update Progress: 1922/2373 symbols completed. SITE took 27.3s. Estimated remaining: 1h 3m 32s. Rate: 7.1 symbols/min [2025-10-10T21:30:47.500375] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-10T21:30:47.520665] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:30:47.533640] [DEBUG] [LOCAL ] SKIL: Loaded 6584 existing records from primary storage. [2025-10-10T21:30:47.533952] [INFO ] [MAIN ] SKIL: Loaded 6584 existing records. [2025-10-10T21:30:47.722355] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:30:47.722774] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-10T21:30:47.722839] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-10T21:30:47.723555] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-10T21:30:47.723624] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-10T21:30:48.094027] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:30:48.289380] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-10T21:30:49.089451] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-10T21:30:49.254526] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T21:30:49.259920] [INFO ] [REMOTE ] SJM: Full fetch complete (71996 records). [2025-10-10T21:30:49.260072] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-10T21:30:49.662863] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-10T21:30:49.662960] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-10T21:30:49.664080] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-10T21:30:49.664148] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-10T21:30:49.665549] [DEBUG] [LOCAL ] SJM: Trimmed 71996 records to 50766 (keeping 200 days of data) [2025-10-10T21:30:49.896588] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-10-10T21:30:49.915230] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T21:30:50.014665] [DEBUG] [LOCAL ] SJM: Primary data saved (50766 records). [2025-10-10T21:30:50.014839] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-10T21:30:50.014942] [INFO ] [MAIN ] Update Progress: 1923/2373 symbols completed. SJM took 30.0s. Estimated remaining: 1h 3m 22s. Rate: 7.1 symbols/min [2025-10-10T21:30:50.182344] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:30:50.194739] [DEBUG] [LOCAL ] SKLZ: Loaded 11644 existing records from primary storage. [2025-10-10T21:30:50.194975] [INFO ] [MAIN ] SKLZ: Loaded 11644 existing records. [2025-10-10T21:30:50.370494] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:30:50.370720] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-10T21:30:50.370774] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-10T21:30:50.370964] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-10T21:30:50.371020] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-10T21:30:50.711155] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-10T21:30:50.717310] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:30:50.882182] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-10T21:30:50.910047] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T21:30:51.489451] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-10-10T21:30:52.193961] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-10T21:30:52.228516] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-10T21:30:52.289407] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-10T21:30:53.089413] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-10T21:30:53.524246] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-10T21:30:53.889414] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-10T21:30:54.689384] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-10T21:30:54.747453] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-10T21:30:54.866866] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-10T21:30:55.489428] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-10T21:30:56.289431] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-10T21:30:56.432042] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-10T21:30:56.581635] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T21:30:56.801310] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-10T21:30:57.089407] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-10T21:30:57.889469] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-10T21:30:58.021941] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-10T21:30:58.689483] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-10T21:30:59.491997] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-10T21:30:59.496995] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-10T21:30:59.772892] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T21:30:59.778075] [INFO ] [REMOTE ] SITC: Full fetch complete (60481 records). [2025-10-10T21:30:59.778258] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-10T21:31:00.202070] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-10T21:31:00.202260] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-10T21:31:00.203722] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-10T21:31:00.203789] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-10T21:31:00.205494] [DEBUG] [LOCAL ] SITC: Trimmed 60481 records to 42127 (keeping 200 days of data) [2025-10-10T21:31:00.298112] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-10T21:31:00.302700] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-10T21:31:00.489920] [DEBUG] [LOCAL ] SITC: Primary data saved (42127 records). [2025-10-10T21:31:00.490083] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-10T21:31:00.490192] [INFO ] [MAIN ] Update Progress: 1924/2373 symbols completed. SITC took 40.4s. Estimated remaining: 1h 3m 14s. Rate: 7.1 symbols/min [2025-10-10T21:31:00.671790] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:31:00.712109] [DEBUG] [LOCAL ] SKM: Loaded 35216 existing records from primary storage. [2025-10-10T21:31:00.712458] [INFO ] [MAIN ] SKM: Loaded 35216 existing records. [2025-10-10T21:31:00.904282] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:31:00.904552] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-10T21:31:00.904609] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-10T21:31:00.904856] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-10T21:31:00.904912] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-10T21:31:01.089839] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-10T21:31:01.315225] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:31:01.489673] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-10T21:31:01.872814] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-10T21:31:01.889404] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-10T21:31:02.689411] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-10T21:31:02.872628] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-10T21:31:03.489498] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-10T21:31:04.289397] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-10-10T21:31:04.384630] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T21:31:04.412598] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T21:31:05.089430] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-10T21:31:05.696521] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T21:31:05.889421] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-10T21:31:05.965008] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-10T21:31:06.689405] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-10T21:31:07.001497] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-10T21:31:07.079858] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-10T21:31:07.489401] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-10T21:31:08.289402] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-10T21:31:08.442452] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-10T21:31:09.089413] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-10T21:31:09.743072] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-10T21:31:09.803912] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-10T21:31:09.889401] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-10T21:31:10.689425] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-10T21:31:11.489432] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-10T21:31:11.602954] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-10T21:31:11.727156] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T21:31:12.289420] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-10T21:31:12.655304] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T21:31:13.081596] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-10T21:31:13.083200] [INFO ] [REMOTE ] SKIL: Full fetch complete (10160 records). [2025-10-10T21:31:13.083276] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-10T21:31:13.094502] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-10T21:31:13.440104] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-10T21:31:13.440193] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-10T21:31:13.440497] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-10T21:31:13.440538] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-10T21:31:13.441016] [DEBUG] [LOCAL ] SKIL: Trimmed 10160 records to 6671 (keeping 200 days of data) [2025-10-10T21:31:13.480404] [DEBUG] [LOCAL ] SKIL: Primary data saved (6671 records). [2025-10-10T21:31:13.480545] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-10T21:31:13.480631] [INFO ] [MAIN ] Update Progress: 1925/2373 symbols completed. SKIL took 26.1s. Estimated remaining: 1h 3m 6s. Rate: 7.1 symbols/min [2025-10-10T21:31:13.648771] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:31:13.686105] [DEBUG] [LOCAL ] SKT: Loaded 42715 existing records from primary storage. [2025-10-10T21:31:13.686409] [INFO ] [MAIN ] SKT: Loaded 42715 existing records. [2025-10-10T21:31:13.856952] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:31:13.857232] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-10T21:31:13.857282] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-10T21:31:13.857497] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-10T21:31:13.857571] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-10T21:31:13.898461] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-10T21:31:14.208833] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:31:14.689393] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-10T21:31:14.922782] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T21:31:15.120822] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T21:31:15.489391] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-10T21:31:16.289347] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-10T21:31:16.609801] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T21:31:16.705195] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T21:31:17.089393] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-10T21:31:17.602267] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-10T21:31:17.889353] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-10T21:31:18.066471] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T21:31:18.689403] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-10-10T21:31:19.489380] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-10T21:31:19.580905] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T21:31:19.731144] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-10T21:31:20.289360] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-10T21:31:20.374124] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T21:31:20.375538] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18463 records). [2025-10-10T21:31:20.375606] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-10T21:31:20.738355] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-10T21:31:20.738440] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-10T21:31:20.738857] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-10T21:31:20.738930] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-10T21:31:20.739468] [DEBUG] [LOCAL ] SKLZ: Trimmed 18463 records to 11724 (keeping 200 days of data) [2025-10-10T21:31:20.807430] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11724 records). [2025-10-10T21:31:20.807610] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-10T21:31:20.807731] [INFO ] [MAIN ] Update Progress: 1926/2373 symbols completed. SKLZ took 30.8s. Estimated remaining: 1h 2m 58s. Rate: 7.1 symbols/min [2025-10-10T21:31:20.973576] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:31:21.011106] [DEBUG] [LOCAL ] SKY: Loaded 38321 existing records from primary storage. [2025-10-10T21:31:21.011445] [INFO ] [MAIN ] SKY: Loaded 38321 existing records. [2025-10-10T21:31:21.094467] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-10T21:31:21.196143] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:31:21.196388] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-10T21:31:21.196437] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-10T21:31:21.196682] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-10T21:31:21.196740] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-10T21:31:21.555581] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:31:21.783156] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-10T21:31:21.889370] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-10T21:31:22.689420] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-10T21:31:22.803144] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-10T21:31:23.489399] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-10T21:31:23.652545] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T21:31:23.741032] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T21:31:23.745677] [INFO ] [REMOTE ] SKE: Full fetch complete (51274 records). [2025-10-10T21:31:23.745807] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-10T21:31:24.122176] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-10T21:31:24.122272] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-10T21:31:24.123247] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-10T21:31:24.123313] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-10T21:31:24.124530] [DEBUG] [LOCAL ] SKE: Trimmed 51274 records to 37016 (keeping 200 days of data) [2025-10-10T21:31:24.298890] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-10-10T21:31:24.364570] [DEBUG] [LOCAL ] SKE: Primary data saved (37016 records). [2025-10-10T21:31:24.364762] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-10T21:31:24.364863] [INFO ] [MAIN ] Update Progress: 1927/2373 symbols completed. SKE took 44.0s. Estimated remaining: 1h 2m 48s. Rate: 7.1 symbols/min [2025-10-10T21:31:24.569480] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:31:24.588577] [DEBUG] [LOCAL ] SKYH: Loaded 16701 existing records from primary storage. [2025-10-10T21:31:24.588877] [INFO ] [MAIN ] SKYH: Loaded 16701 existing records. [2025-10-10T21:31:24.789746] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:31:24.790106] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-10T21:31:24.790171] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-10T21:31:24.790403] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-10T21:31:24.790460] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-10T21:31:25.094476] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-10T21:31:25.162500] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-10T21:31:25.237270] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:31:25.889374] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-10-10T21:31:26.155020] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T21:31:26.689375] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-10T21:31:26.946563] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T21:31:27.110172] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T21:31:27.489444] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-10T21:31:28.224988] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-10T21:31:28.289334] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-10T21:31:29.089447] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-10T21:31:29.381204] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-10T21:31:29.889352] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-10T21:31:30.019783] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T21:31:30.459257] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-10T21:31:30.462730] [INFO ] [REMOTE ] SKM: Full fetch complete (48478 records). [2025-10-10T21:31:30.462824] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-10T21:31:30.694478] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-10T21:31:30.850503] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-10T21:31:30.850604] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-10T21:31:30.851790] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-10T21:31:30.851852] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-10T21:31:30.852839] [DEBUG] [LOCAL ] SKM: Trimmed 48478 records to 35508 (keeping 200 days of data) [2025-10-10T21:31:31.073581] [DEBUG] [LOCAL ] SKM: Primary data saved (35508 records). [2025-10-10T21:31:31.073768] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-10T21:31:31.073860] [INFO ] [MAIN ] Update Progress: 1928/2373 symbols completed. SKM took 30.6s. Estimated remaining: 1h 2m 39s. Rate: 7.1 symbols/min [2025-10-10T21:31:31.241191] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:31:31.289858] [DEBUG] [LOCAL ] SLB: Loaded 54087 existing records from primary storage. [2025-10-10T21:31:31.290216] [INFO ] [MAIN ] SLB: Loaded 54087 existing records. [2025-10-10T21:31:31.470206] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:31:31.470436] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-10T21:31:31.470481] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-10T21:31:31.470722] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-10-10T21:31:31.470779] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-10T21:31:31.501195] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-10T21:31:31.833364] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:31:31.866063] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T21:31:31.871233] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T21:31:32.289393] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-10T21:31:33.089341] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-10T21:31:33.531801] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-10T21:31:33.621345] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-10T21:31:33.889378] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-10T21:31:34.029337] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T21:31:34.689367] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-10T21:31:35.131922] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-10T21:31:35.489447] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-10T21:31:36.289374] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-10T21:31:36.530693] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-10T21:31:37.089352] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-10-10T21:31:37.214711] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T21:31:37.591270] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-10T21:31:37.889393] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-10T21:31:38.689400] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-10T21:31:39.088335] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T21:31:39.217484] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-10T21:31:39.489380] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-10T21:31:40.154239] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-10T21:31:40.289397] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-10T21:31:40.666857] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T21:31:41.089381] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-10T21:31:41.889339] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-10T21:31:42.070236] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T21:31:42.689353] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-10T21:31:43.292287] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-10T21:31:43.489408] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-10T21:31:43.607407] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-10T21:31:43.723088] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-10T21:31:44.289370] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-10T21:31:44.576514] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-10T21:31:45.089393] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-10T21:31:45.224815] [DEBUG] [REMOTE ] SLB: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-10T21:31:45.225055] [WARN ] [REMOTE ] SLB: No data returned for month 2025-02 [2025-10-10T21:31:45.225142] [FATAL] [REMOTE ] SLB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:31:45.225219] [FATAL] [MAIN ] SLB: Failed to fetch primary data. [2025-10-10T21:31:45.225255] [WARN ] [MAIN ] SLB: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:31:45.225316] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-10T21:31:45.225375] [DEBUG] [LOCAL ] SLB: No primary data file found to delete. [2025-10-10T21:31:45.225418] [INFO ] [LOCAL ] SLB: Starting deletion of derivative data. [2025-10-10T21:31:45.225626] [DEBUG] [LOCAL ] SLB: Deleted derivative data file. [2025-10-10T21:31:45.225919] [INFO ] [MAIN ] Update Progress: 1929/2373 symbols completed. SLB took 14.2s. Estimated remaining: 1h 2m 32s. Rate: 7.1 symbols/min [2025-10-10T21:31:45.389491] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:31:45.425366] [DEBUG] [LOCAL ] SLF: Loaded 39021 existing records from primary storage. [2025-10-10T21:31:45.425686] [INFO ] [MAIN ] SLF: Loaded 39021 existing records. [2025-10-10T21:31:45.605059] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:31:45.605296] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-10T21:31:45.605396] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-10T21:31:45.605617] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-10T21:31:45.605891] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-10T21:31:45.892994] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-10T21:31:45.960522] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:31:46.000777] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-10T21:31:46.689363] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-10T21:31:47.059222] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T21:31:47.489398] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-10-10T21:31:48.199372] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-10T21:31:48.203365] [INFO ] [REMOTE ] SKT: Full fetch complete (60326 records). [2025-10-10T21:31:48.203474] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-10T21:31:48.295812] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-10T21:31:48.603936] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-10T21:31:48.604071] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-10T21:31:48.605090] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-10T21:31:48.605154] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-10T21:31:48.606465] [DEBUG] [LOCAL ] SKT: Trimmed 60326 records to 43020 (keeping 200 days of data) [2025-10-10T21:31:48.868788] [DEBUG] [LOCAL ] SKT: Primary data saved (43020 records). [2025-10-10T21:31:48.868925] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-10T21:31:48.869002] [INFO ] [MAIN ] Update Progress: 1930/2373 symbols completed. SKT took 35.4s. Estimated remaining: 1h 2m 23s. Rate: 7.1 symbols/min [2025-10-10T21:31:49.045118] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:31:49.088905] [DEBUG] [LOCAL ] SLG: Loaded 45493 existing records from primary storage. [2025-10-10T21:31:49.089248] [INFO ] [MAIN ] SLG: Loaded 45493 existing records. [2025-10-10T21:31:49.111139] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-10T21:31:49.223737] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T21:31:49.303731] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:31:49.303918] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-10T21:31:49.303964] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-10T21:31:49.304175] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-10T21:31:49.304231] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-10T21:31:49.658296] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:31:49.889356] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-10T21:31:49.963036] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T21:31:50.189316] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-10T21:31:50.689413] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-10T21:31:51.494529] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-10T21:31:51.507258] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T21:31:52.289408] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-10T21:31:52.509300] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-10T21:31:52.512593] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T21:31:52.524519] [INFO ] [REMOTE ] SKYH: Full fetch complete (22354 records). [2025-10-10T21:31:52.524793] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-10T21:31:52.898279] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-10T21:31:52.898370] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-10T21:31:52.898954] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-10T21:31:52.899045] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-10T21:31:52.899740] [DEBUG] [LOCAL ] SKYH: Trimmed 22354 records to 16809 (keeping 200 days of data) [2025-10-10T21:31:52.993262] [DEBUG] [LOCAL ] SKYH: Primary data saved (16809 records). [2025-10-10T21:31:52.993408] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-10T21:31:52.993491] [INFO ] [MAIN ] Update Progress: 1931/2373 symbols completed. SKYH took 28.6s. Estimated remaining: 1h 2m 13s. Rate: 7.1 symbols/min [2025-10-10T21:31:53.090733] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-10T21:31:53.162563] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:31:53.205043] [DEBUG] [LOCAL ] SLGN: Loaded 40946 existing records from primary storage. [2025-10-10T21:31:53.205457] [INFO ] [MAIN ] SLGN: Loaded 40946 existing records. [2025-10-10T21:31:53.392258] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:31:53.392502] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-10T21:31:53.392551] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-10T21:31:53.392766] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-10T21:31:53.392823] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-10T21:31:53.759961] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:31:53.889377] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-10-10T21:31:54.055950] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T21:31:54.689379] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-10-10T21:31:54.863517] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T21:31:55.005603] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-10T21:31:55.489451] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-10T21:31:55.980044] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T21:31:56.289382] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-10T21:31:56.943127] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T21:31:56.947855] [INFO ] [REMOTE ] SKY: Full fetch complete (54208 records). [2025-10-10T21:31:56.948016] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-10T21:31:57.094508] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-10T21:31:57.401908] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-10T21:31:57.402053] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-10T21:31:57.403401] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-10T21:31:57.403475] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-10T21:31:57.404976] [DEBUG] [LOCAL ] SKY: Trimmed 54208 records to 38636 (keeping 200 days of data) [2025-10-10T21:31:57.668324] [DEBUG] [LOCAL ] SKY: Primary data saved (38636 records). [2025-10-10T21:31:57.668482] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-10T21:31:57.668568] [INFO ] [MAIN ] Update Progress: 1932/2373 symbols completed. SKY took 36.9s. Estimated remaining: 1h 2m 4s. Rate: 7.1 symbols/min [2025-10-10T21:31:57.880705] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:31:57.880937] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-10T21:31:57.881007] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-10T21:31:57.881201] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-10T21:31:57.881270] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-10T21:31:57.881314] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-10T21:31:57.881346] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-10T21:31:57.912294] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-10T21:31:58.214502] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-10T21:31:58.283397] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:31:58.689365] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-10T21:31:58.894632] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T21:31:59.489349] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-10T21:31:59.626054] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T21:32:00.289368] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-10-10T21:32:00.343617] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T21:32:00.716322] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-10T21:32:01.089436] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-10T21:32:01.297905] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T21:32:01.491669] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-10T21:32:01.889401] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-10T21:32:02.689411] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-10T21:32:03.489462] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-10T21:32:03.588401] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T21:32:03.702224] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-10T21:32:04.289358] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-10T21:32:05.089406] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-10T21:32:05.274442] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T21:32:05.889438] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-10T21:32:06.105460] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T21:32:06.672945] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T21:32:06.689321] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-10T21:32:07.489369] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-10T21:32:07.703350] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T21:32:08.296898] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-10T21:32:08.303412] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-10T21:32:08.582332] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-10T21:32:08.796595] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T21:32:09.089421] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-10T21:32:09.889379] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-10T21:32:10.689346] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-10T21:32:10.916775] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T21:32:11.448565] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T21:32:11.489403] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-10T21:32:11.884497] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-10T21:32:11.948331] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T21:32:12.289433] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-10T21:32:13.089394] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-10T21:32:13.800516] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-10T21:32:13.889425] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-10T21:32:14.689392] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-10T21:32:14.738950] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T21:32:15.006557] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-10T21:32:15.489394] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-10T21:32:15.702920] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T21:32:16.289424] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-10T21:32:16.790849] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T21:32:17.089386] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-10T21:32:17.490153] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-10T21:32:17.874994] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-10T21:32:17.889349] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-10T21:32:18.689399] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-10T21:32:19.336190] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T21:32:19.340167] [INFO ] [REMOTE ] SLF: Full fetch complete (56354 records). [2025-10-10T21:32:19.340274] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-10T21:32:19.490672] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-10T21:32:19.740063] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-10T21:32:19.740155] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-10T21:32:19.741126] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-10T21:32:19.741217] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-10T21:32:19.742535] [DEBUG] [LOCAL ] SLF: Trimmed 56354 records to 39332 (keeping 200 days of data) [2025-10-10T21:32:19.941933] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-10T21:32:20.006954] [DEBUG] [LOCAL ] SLF: Primary data saved (39332 records). [2025-10-10T21:32:20.007157] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-10T21:32:20.007247] [INFO ] [MAIN ] Update Progress: 1933/2373 symbols completed. SLF took 34.8s. Estimated remaining: 1h 1m 58s. Rate: 7.1 symbols/min [2025-10-10T21:32:20.188010] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:32:20.227997] [DEBUG] [LOCAL ] SLQT: Loaded 43804 existing records from primary storage. [2025-10-10T21:32:20.228311] [INFO ] [MAIN ] SLQT: Loaded 43804 existing records. [2025-10-10T21:32:20.291317] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-10T21:32:20.418279] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:32:20.418541] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-10T21:32:20.418619] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-10T21:32:20.418950] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-10T21:32:20.419018] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-10T21:32:20.570240] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-10T21:32:20.755143] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-10T21:32:20.831902] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:32:21.089385] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-10-10T21:32:21.889387] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-10T21:32:22.436375] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T21:32:22.689405] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-10T21:32:23.489336] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-10T21:32:23.745456] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T21:32:23.889410] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-10T21:32:24.289360] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-10T21:32:24.543026] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T21:32:25.089397] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-10T21:32:25.834190] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-10T21:32:25.889357] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-10T21:32:26.689376] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-10T21:32:26.964531] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-10T21:32:26.969624] [INFO ] [REMOTE ] SLGN: Full fetch complete (58844 records). [2025-10-10T21:32:26.969830] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-10T21:32:27.360990] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-10T21:32:27.361080] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-10T21:32:27.362154] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-10T21:32:27.362217] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-10T21:32:27.363504] [DEBUG] [LOCAL ] SLGN: Trimmed 58844 records to 41331 (keeping 200 days of data) [2025-10-10T21:32:27.491933] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-10T21:32:27.615926] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T21:32:27.659164] [DEBUG] [LOCAL ] SLGN: Primary data saved (41331 records). [2025-10-10T21:32:27.659309] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-10T21:32:27.659390] [INFO ] [MAIN ] Update Progress: 1934/2373 symbols completed. SLGN took 34.7s. Estimated remaining: 1h 1m 50s. Rate: 7.1 symbols/min [2025-10-10T21:32:27.825926] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:32:27.854338] [DEBUG] [LOCAL ] SLVM: Loaded 28054 existing records from primary storage. [2025-10-10T21:32:27.854632] [INFO ] [MAIN ] SLVM: Loaded 28054 existing records. [2025-10-10T21:32:27.956858] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-10T21:32:28.035543] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:32:28.035864] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-10T21:32:28.035919] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-10T21:32:28.036138] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-10T21:32:28.036196] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-10T21:32:28.291325] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-10T21:32:28.331765] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-10T21:32:28.398412] [INFO ] [REMOTE ] SLG: Full fetch complete (64897 records). [2025-10-10T21:32:28.418918] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-10T21:32:28.418609] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:32:28.814731] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-10T21:32:28.814823] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-10T21:32:28.816347] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-10T21:32:28.816460] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-10T21:32:28.817888] [DEBUG] [LOCAL ] SLG: Trimmed 64897 records to 45846 (keeping 200 days of data) [2025-10-10T21:32:29.095406] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-10T21:32:29.107938] [DEBUG] [LOCAL ] SLG: Primary data saved (45846 records). [2025-10-10T21:32:29.108095] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-10T21:32:29.108197] [INFO ] [MAIN ] Update Progress: 1935/2373 symbols completed. SLG took 40.2s. Estimated remaining: 1h 1m 40s. Rate: 7.1 symbols/min [2025-10-10T21:32:29.285072] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:32:29.332432] [DEBUG] [LOCAL ] SM: Loaded 52703 existing records from primary storage. [2025-10-10T21:32:29.332826] [INFO ] [MAIN ] SM: Loaded 52703 existing records. [2025-10-10T21:32:29.434489] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-10T21:32:29.435390] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1041 records). [2025-10-10T21:32:29.435830] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-10T21:32:29.630583] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:32:29.664797] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-10T21:32:29.675602] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-10T21:32:29.689838] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-10T21:32:29.691832] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-10T21:32:29.700962] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-10T21:32:29.728526] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:32:29.760708] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:32:29.772494] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-10T21:32:29.777993] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-10T21:32:29.797231] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-10T21:32:29.800149] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-10T21:32:29.800408] [INFO ] [MAIN ] Update Progress: 1936/2373 symbols completed. SLNZ took 32.1s. Estimated remaining: 1h 1m 30s. Rate: 7.1 symbols/min [2025-10-10T21:32:29.895922] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-10-10T21:32:30.183688] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:32:30.187862] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-10T21:32:30.188461] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-10T21:32:30.194129] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-10T21:32:30.199547] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-10T21:32:30.210271] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-10T21:32:30.215598] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-10T21:32:30.270472] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:32:30.379964] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-10T21:32:30.685616] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:32:30.689330] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-10-10T21:32:30.920332] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:32:30.920758] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-10-10T21:32:30.920926] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:32:30.921014] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-10T21:32:30.921091] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:32:30.921185] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-10T21:32:30.921268] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-10T21:32:30.921305] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-10T21:32:30.921344] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-10T21:32:30.921434] [INFO ] [MAIN ] Update Progress: 1937/2373 symbols completed. SMA took 1.1s. Estimated remaining: 1h 1m 20s. Rate: 7.1 symbols/min [2025-10-10T21:32:31.089024] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:32:31.100157] [DEBUG] [LOCAL ] SMBK: Loaded 8215 existing records from primary storage. [2025-10-10T21:32:31.100402] [INFO ] [MAIN ] SMBK: Loaded 8215 existing records. [2025-10-10T21:32:31.278115] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:32:31.278372] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-10T21:32:31.278428] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-10T21:32:31.278636] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-10T21:32:31.278732] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-10T21:32:31.496623] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-10T21:32:31.498060] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T21:32:31.671296] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:32:32.289383] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-10T21:32:33.089404] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-10-10T21:32:33.361189] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T21:32:33.532338] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T21:32:33.889382] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-10T21:32:34.689363] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-10-10T21:32:34.797598] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T21:32:35.319745] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-10T21:32:35.489383] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-10T21:32:35.586287] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-10T21:32:36.289383] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-10T21:32:37.030269] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-10T21:32:37.089343] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-10T21:32:37.889336] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-10T21:32:38.024612] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T21:32:38.478143] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T21:32:38.689371] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-10T21:32:39.489408] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-10T21:32:39.658852] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T21:32:39.754159] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T21:32:40.289433] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-10T21:32:41.044329] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-10T21:32:41.089328] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-10T21:32:41.115225] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T21:32:41.889430] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-10T21:32:42.044412] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-10T21:32:42.689394] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-10T21:32:43.489409] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-10T21:32:43.654186] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-10T21:32:43.849100] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-10T21:32:44.289397] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-10T21:32:44.761486] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-10T21:32:45.089375] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-10T21:32:45.170341] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-10T21:32:45.889382] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-10T21:32:46.689390] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-10T21:32:46.758024] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T21:32:47.489355] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-10T21:32:47.642955] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-10T21:32:47.807773] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T21:32:48.289426] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-10T21:32:49.020566] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-10T21:32:49.089351] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-10T21:32:49.889369] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-10T21:32:50.452403] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-10T21:32:50.689416] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-10T21:32:50.739188] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-10T21:32:51.150854] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T21:32:51.489374] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-10T21:32:52.289369] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-10T21:32:52.441756] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T21:32:52.465793] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T21:32:52.469933] [INFO ] [REMOTE ] SLQT: Full fetch complete (63780 records). [2025-10-10T21:32:52.470075] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-10T21:32:52.844961] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-10T21:32:52.845068] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-10T21:32:52.846077] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-10T21:32:52.846140] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-10T21:32:52.847470] [DEBUG] [LOCAL ] SLQT: Trimmed 63780 records to 44094 (keeping 200 days of data) [2025-10-10T21:32:53.096375] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-10T21:32:53.109453] [DEBUG] [LOCAL ] SLQT: Primary data saved (44094 records). [2025-10-10T21:32:53.109607] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-10T21:32:53.110179] [INFO ] [MAIN ] Update Progress: 1938/2373 symbols completed. SLQT took 33.1s. Estimated remaining: 1h 1m 14s. Rate: 7.1 symbols/min [2025-10-10T21:32:53.300039] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:32:53.316329] [DEBUG] [LOCAL ] SMC: Loaded 11351 existing records from primary storage. [2025-10-10T21:32:53.316629] [INFO ] [MAIN ] SMC: Loaded 11351 existing records. [2025-10-10T21:32:53.538372] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:32:53.538698] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-10T21:32:53.538761] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-10T21:32:53.539060] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-10T21:32:53.539118] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-10T21:32:53.903169] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-10T21:32:53.910849] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T21:32:53.956958] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:32:54.689444] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-10-10T21:32:54.864082] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-10T21:32:54.989412] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T21:32:55.347127] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-10T21:32:55.489381] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-10T21:32:56.289389] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-10T21:32:57.089363] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-10T21:32:57.355757] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-10T21:32:57.449885] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-10T21:32:57.889365] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-10T21:32:58.115594] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-10T21:32:58.690057] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-10T21:32:59.331779] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-10T21:32:59.489356] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-10T21:32:59.590793] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-10T21:33:00.289440] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-10T21:33:00.494592] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-10T21:33:00.497812] [INFO ] [REMOTE ] SLVM: Full fetch complete (40043 records). [2025-10-10T21:33:00.497890] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-10T21:33:00.877049] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-10T21:33:00.877145] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-10T21:33:00.877961] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-10T21:33:00.878030] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-10T21:33:00.878967] [DEBUG] [LOCAL ] SLVM: Trimmed 40043 records to 28268 (keeping 200 days of data) [2025-10-10T21:33:01.052600] [DEBUG] [LOCAL ] SLVM: Primary data saved (28268 records). [2025-10-10T21:33:01.052770] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-10T21:33:01.052873] [INFO ] [MAIN ] Update Progress: 1939/2373 symbols completed. SLVM took 33.4s. Estimated remaining: 1h 1m 6s. Rate: 7.1 symbols/min [2025-10-10T21:33:01.094623] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-10T21:33:01.199548] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T21:33:01.231933] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:33:01.276955] [DEBUG] [LOCAL ] SMFG: Loaded 48531 existing records from primary storage. [2025-10-10T21:33:01.277334] [INFO ] [MAIN ] SMFG: Loaded 48531 existing records. [2025-10-10T21:33:01.447149] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:33:01.447335] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-10T21:33:01.447381] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-10T21:33:01.447684] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-10T21:33:01.447742] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-10T21:33:01.796471] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:33:01.889364] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-10-10T21:33:02.689412] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-10T21:33:03.011776] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T21:33:03.489375] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-10T21:33:03.605400] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-10T21:33:03.715185] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T21:33:04.289421] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-10T21:33:05.089417] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-10T21:33:05.434525] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T21:33:05.473595] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-10T21:33:05.475825] [INFO ] [REMOTE ] SMBK: Full fetch complete (11750 records). [2025-10-10T21:33:05.475898] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-10T21:33:05.856856] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-10T21:33:05.856946] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-10T21:33:05.857253] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-10T21:33:05.857316] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-10T21:33:05.857868] [DEBUG] [LOCAL ] SMBK: Trimmed 11750 records to 8292 (keeping 200 days of data) [2025-10-10T21:33:05.896078] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-10T21:33:05.914141] [DEBUG] [LOCAL ] SMBK: Primary data saved (8292 records). [2025-10-10T21:33:05.914308] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-10T21:33:05.914417] [INFO ] [MAIN ] Update Progress: 1940/2373 symbols completed. SMBK took 35.0s. Estimated remaining: 1h 0m 56s. Rate: 7.1 symbols/min [2025-10-10T21:33:06.084561] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:33:06.098857] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-10T21:33:06.133333] [DEBUG] [LOCAL ] SMG: Loaded 43897 existing records from primary storage. [2025-10-10T21:33:06.133715] [INFO ] [MAIN ] SMG: Loaded 43897 existing records. [2025-10-10T21:33:06.310903] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:33:06.311131] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-10T21:33:06.311182] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-10T21:33:06.311365] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-10T21:33:06.311403] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-10T21:33:06.660572] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:33:06.689336] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-10-10T21:33:07.489360] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-10T21:33:07.799297] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T21:33:07.804477] [INFO ] [REMOTE ] SM: Full fetch complete (75540 records). [2025-10-10T21:33:07.804595] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-10T21:33:08.195050] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-10T21:33:08.195135] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-10T21:33:08.196118] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-10T21:33:08.196183] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-10T21:33:08.197587] [DEBUG] [LOCAL ] SM: Trimmed 75540 records to 53093 (keeping 200 days of data) [2025-10-10T21:33:08.293927] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-10T21:33:08.546028] [DEBUG] [LOCAL ] SM: Primary data saved (53093 records). [2025-10-10T21:33:08.546235] [INFO ] [MAIN ] SM: Full history saved. [2025-10-10T21:33:08.546610] [INFO ] [MAIN ] Update Progress: 1941/2373 symbols completed. SM took 39.4s. Estimated remaining: 1h 0m 47s. Rate: 7.1 symbols/min [2025-10-10T21:33:08.559777] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T21:33:08.752959] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:33:08.763121] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-10T21:33:08.777794] [DEBUG] [LOCAL ] SMHI: Loaded 13175 existing records from primary storage. [2025-10-10T21:33:08.778025] [INFO ] [MAIN ] SMHI: Loaded 13175 existing records. [2025-10-10T21:33:08.949799] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:33:08.949978] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-10T21:33:08.950024] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-10T21:33:08.950218] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-10T21:33:08.950275] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-10T21:33:09.095607] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-10T21:33:09.301876] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:33:09.889377] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-10-10T21:33:10.098733] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T21:33:10.689370] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-10T21:33:10.881350] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T21:33:11.026780] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-10T21:33:11.489370] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-10T21:33:12.170173] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-10T21:33:12.289379] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-10T21:33:13.089345] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-10T21:33:13.224185] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T21:33:13.889349] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-10T21:33:14.192681] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-10T21:33:14.247097] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T21:33:14.689336] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-10T21:33:15.085623] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-10T21:33:15.489395] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-10T21:33:15.566333] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-10T21:33:16.289359] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-10T21:33:16.670597] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-10T21:33:17.089377] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-10T21:33:17.889432] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-10T21:33:18.144696] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T21:33:18.689429] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-10T21:33:19.052494] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-10T21:33:19.084745] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T21:33:19.489407] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-10T21:33:20.289358] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-10T21:33:20.491188] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-10T21:33:20.678921] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-10T21:33:21.089370] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-10T21:33:21.889352] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-10T21:33:22.169151] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T21:33:22.383147] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-10T21:33:22.413001] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T21:33:22.689423] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-10T21:33:23.489362] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-10T21:33:24.289423] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-10T21:33:24.499928] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T21:33:24.672572] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T21:33:24.886823] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-10T21:33:25.089418] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-10T21:33:25.889366] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-10T21:33:26.104674] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-10T21:33:26.689398] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-10T21:33:27.489393] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-10T21:33:27.706685] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-10T21:33:28.289350] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-10T21:33:28.427993] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T21:33:28.510776] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-10T21:33:29.089377] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-10T21:33:29.889372] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-10T21:33:30.037192] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-10T21:33:30.207417] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T21:33:30.689383] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-10T21:33:30.899139] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-10T21:33:31.489437] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-10T21:33:32.289388] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-10T21:33:32.321421] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T21:33:32.405505] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-10T21:33:33.089424] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-10T21:33:33.889429] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-10T21:33:34.018325] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T21:33:34.689374] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-10T21:33:34.807161] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-10T21:33:35.062951] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T21:33:35.489429] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-10T21:33:36.190764] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T21:33:36.195512] [INFO ] [REMOTE ] SMFG: Full fetch complete (69077 records). [2025-10-10T21:33:36.195628] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-10T21:33:36.294562] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-10T21:33:36.577506] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-10T21:33:36.577590] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-10T21:33:36.578633] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-10T21:33:36.578715] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-10T21:33:36.580472] [DEBUG] [LOCAL ] SMFG: Trimmed 69077 records to 48900 (keeping 200 days of data) [2025-10-10T21:33:36.868571] [DEBUG] [LOCAL ] SMFG: Primary data saved (48900 records). [2025-10-10T21:33:36.868721] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-10T21:33:36.868807] [INFO ] [MAIN ] Update Progress: 1942/2373 symbols completed. SMFG took 35.8s. Estimated remaining: 1h 0m 43s. Rate: 7.1 symbols/min [2025-10-10T21:33:37.039857] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:33:37.059571] [DEBUG] [LOCAL ] SMP: Loaded 19095 existing records from primary storage. [2025-10-10T21:33:37.059856] [INFO ] [MAIN ] SMP: Loaded 19095 existing records. [2025-10-10T21:33:37.096190] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-10T21:33:37.131076] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T21:33:37.149701] [INFO ] [REMOTE ] SMHI: Full fetch complete (22087 records). [2025-10-10T21:33:37.157348] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-10T21:33:37.336278] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:33:37.365674] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-10T21:33:37.383684] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-10T21:33:37.406538] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-10T21:33:37.441510] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-10T21:33:37.463490] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T21:33:37.835354] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-10T21:33:37.866739] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-10T21:33:37.888011] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-10T21:33:37.893735] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-10T21:33:37.893809] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-10T21:33:37.926924] [DEBUG] [LOCAL ] SMHI: Trimmed 22087 records to 13253 (keeping 200 days of data) [2025-10-10T21:33:38.035676] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T21:33:38.038701] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:33:38.046745] [INFO ] [REMOTE ] SMC: Full fetch complete (16526 records). [2025-10-10T21:33:38.065093] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-10T21:33:38.457183] [DEBUG] [LOCAL ] SMHI: Primary data saved (13253 records). [2025-10-10T21:33:38.467263] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-10T21:33:38.467347] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-10T21:33:38.467422] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-10T21:33:38.468001] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-10T21:33:38.468079] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-10T21:33:38.467512] [INFO ] [MAIN ] Update Progress: 1943/2373 symbols completed. SMHI took 29.9s. Estimated remaining: 1h 0m 33s. Rate: 7.1 symbols/min [2025-10-10T21:33:38.468852] [DEBUG] [LOCAL ] SMC: Trimmed 16526 records to 11462 (keeping 200 days of data) [2025-10-10T21:33:38.698675] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:33:38.695441] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-10-10T21:33:38.719891] [DEBUG] [LOCAL ] SMC: Primary data saved (11462 records). [2025-10-10T21:33:38.733911] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-10T21:33:38.734089] [INFO ] [MAIN ] Update Progress: 1944/2373 symbols completed. SMC took 45.6s. Estimated remaining: 1h 0m 22s. Rate: 7.1 symbols/min [2025-10-10T21:33:38.925395] [DEBUG] [LOCAL ] SMR: Loaded 54188 existing records from primary storage. [2025-10-10T21:33:38.928224] [INFO ] [MAIN ] SMR: Loaded 54188 existing records. [2025-10-10T21:33:38.934735] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:33:39.128731] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:33:39.139766] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-10T21:33:39.140045] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-10T21:33:39.140433] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-10-10T21:33:39.140495] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-10T21:33:39.262423] [DEBUG] [LOCAL ] SMRT: Loaded 44367 existing records from primary storage. [2025-10-10T21:33:39.263034] [INFO ] [MAIN ] SMRT: Loaded 44367 existing records. [2025-10-10T21:33:39.522698] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T21:33:39.642694] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:33:39.662119] [INFO ] [REMOTE ] SMG: Full fetch complete (62769 records). [2025-10-10T21:33:39.675244] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-10T21:33:39.675424] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-10T21:33:39.675520] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-10T21:33:39.681697] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-10T21:33:39.718240] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-10T21:33:39.909959] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:33:39.984677] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-10-10T21:33:39.985758] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T21:33:40.309178] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-10T21:33:40.469944] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:33:40.600527] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-10T21:33:40.600628] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-10T21:33:40.601771] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-10T21:33:40.601837] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-10T21:33:40.603206] [DEBUG] [LOCAL ] SMG: Trimmed 62769 records to 44210 (keeping 200 days of data) [2025-10-10T21:33:40.872727] [DEBUG] [LOCAL ] SMG: Primary data saved (44210 records). [2025-10-10T21:33:40.872888] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-10T21:33:40.872971] [INFO ] [MAIN ] Update Progress: 1945/2373 symbols completed. SMG took 35.0s. Estimated remaining: 1h 0m 13s. Rate: 7.1 symbols/min [2025-10-10T21:33:41.051591] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:33:41.082426] [DEBUG] [LOCAL ] SMWB: Loaded 32522 existing records from primary storage. [2025-10-10T21:33:41.082758] [INFO ] [MAIN ] SMWB: Loaded 32522 existing records. [2025-10-10T21:33:41.105473] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-10-10T21:33:41.276335] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:33:41.276709] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-10T21:33:41.276767] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-10T21:33:41.276948] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-10T21:33:41.276988] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-10T21:33:41.543590] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-10T21:33:41.658042] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:33:41.889421] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-10T21:33:42.518074] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-10T21:33:42.689366] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-10T21:33:42.892816] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-10-10T21:33:43.077623] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-10T21:33:43.489406] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-10T21:33:44.289440] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-10T21:33:44.352346] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-10T21:33:44.785870] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T21:33:45.089407] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-10T21:33:45.889359] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-10-10T21:33:46.398171] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T21:33:46.689375] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-10T21:33:46.968009] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-10T21:33:47.489364] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-10T21:33:47.535770] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-10T21:33:47.610864] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T21:33:48.289382] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-10T21:33:49.060300] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T21:33:49.089321] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-10T21:33:49.299407] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-10T21:33:49.889381] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-10T21:33:50.689368] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-10T21:33:50.814914] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T21:33:51.489360] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-10T21:33:51.604106] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T21:33:52.289472] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-10T21:33:53.089356] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-10T21:33:53.280441] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T21:33:53.407179] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-10-10T21:33:53.408821] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-10T21:33:53.830870] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-10T21:33:53.889355] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-10T21:33:54.689382] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-10T21:33:55.413871] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-10T21:33:55.489337] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-10T21:33:56.289426] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-10T21:33:56.594492] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T21:33:57.008676] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-10T21:33:57.089381] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-10T21:33:57.545310] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-10T21:33:57.889400] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-10T21:33:58.689424] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-10T21:33:59.165465] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T21:33:59.418363] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-10T21:33:59.489347] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-10T21:34:00.289376] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-10T21:34:00.348078] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-10T21:34:01.089456] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-10T21:34:01.287526] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T21:34:01.289499] [INFO ] [REMOTE ] SMP: Full fetch complete (26234 records). [2025-10-10T21:34:01.289569] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-10T21:34:01.665099] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-10T21:34:01.665212] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-10T21:34:01.665905] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-10T21:34:01.666014] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-10T21:34:01.666948] [DEBUG] [LOCAL ] SMP: Trimmed 26234 records to 19271 (keeping 200 days of data) [2025-10-10T21:34:01.791393] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-10T21:34:01.831168] [DEBUG] [LOCAL ] SMP: Primary data saved (19271 records). [2025-10-10T21:34:01.831319] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-10T21:34:01.831407] [INFO ] [MAIN ] Update Progress: 1946/2373 symbols completed. SMP took 25.0s. Estimated remaining: 1h 0m 7s. Rate: 7.1 symbols/min [2025-10-10T21:34:01.896186] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-10T21:34:02.016705] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:34:02.063783] [DEBUG] [LOCAL ] SN: Loaded 50297 existing records from primary storage. [2025-10-10T21:34:02.064202] [INFO ] [MAIN ] SN: Loaded 50297 existing records. [2025-10-10T21:34:02.245111] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:34:02.245383] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-10T21:34:02.245443] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-10T21:34:02.245628] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-10T21:34:02.245712] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-10T21:34:02.611183] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:34:02.629671] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-10T21:34:02.689393] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-10T21:34:03.489387] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-10T21:34:04.255704] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T21:34:04.289363] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-10T21:34:04.762761] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-10-10T21:34:04.815477] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-10T21:34:05.089383] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-10T21:34:05.889401] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-10T21:34:05.965354] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-10T21:34:06.363261] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-10T21:34:06.689385] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-10T21:34:07.489413] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-10-10T21:34:08.142315] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-10T21:34:08.289364] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-10T21:34:08.431611] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-10T21:34:09.089428] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-10T21:34:09.194313] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T21:34:09.889432] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-10T21:34:09.941102] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-10T21:34:10.689427] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-10T21:34:11.489427] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-10T21:34:11.739891] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-10T21:34:11.828724] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T21:34:11.838687] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-10T21:34:11.842907] [INFO ] [REMOTE ] SMWB: Full fetch complete (49178 records). [2025-10-10T21:34:11.843006] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-10T21:34:12.212459] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-10T21:34:12.212540] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-10T21:34:12.213340] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-10T21:34:12.213401] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-10T21:34:12.214381] [DEBUG] [LOCAL ] SMWB: Trimmed 49178 records to 32747 (keeping 200 days of data) [2025-10-10T21:34:12.293281] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-10T21:34:12.397961] [DEBUG] [LOCAL ] SMWB: Primary data saved (32747 records). [2025-10-10T21:34:12.398130] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-10T21:34:12.398214] [INFO ] [MAIN ] Update Progress: 1947/2373 symbols completed. SMWB took 31.5s. Estimated remaining: 59m 59s. Rate: 7.1 symbols/min [2025-10-10T21:34:12.566971] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:34:12.593560] [DEBUG] [LOCAL ] SNA: Loaded 25838 existing records from primary storage. [2025-10-10T21:34:12.593874] [INFO ] [MAIN ] SNA: Loaded 25838 existing records. [2025-10-10T21:34:12.769337] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:34:12.769549] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-10T21:34:12.769595] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-10T21:34:12.769821] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-10T21:34:12.769878] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-10T21:34:13.110432] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-10T21:34:13.148331] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T21:34:13.153982] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:34:13.889391] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-10-10T21:34:14.183105] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T21:34:14.689424] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-10T21:34:15.412680] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T21:34:15.489377] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-10T21:34:16.081894] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.97 seconds). [2025-10-10T21:34:16.289444] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-10T21:34:16.623705] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-10T21:34:16.995248] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-10T21:34:17.089354] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-10T21:34:17.889358] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-10T21:34:18.689381] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-10T21:34:18.731777] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T21:34:19.178128] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.89 seconds). [2025-10-10T21:34:19.489347] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-10T21:34:19.582613] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-10T21:34:19.586972] [INFO ] [REMOTE ] SMRT: Full fetch complete (62171 records). [2025-10-10T21:34:19.587120] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-10T21:34:20.036893] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-10T21:34:20.039274] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-10T21:34:20.040430] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-10T21:34:20.040522] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-10T21:34:20.039120] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-10T21:34:20.053022] [DEBUG] [LOCAL ] SMRT: Trimmed 62171 records to 44671 (keeping 200 days of data) [2025-10-10T21:34:20.295452] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-10T21:34:20.304385] [DEBUG] [LOCAL ] SMRT: Primary data saved (44671 records). [2025-10-10T21:34:20.304540] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-10T21:34:20.304625] [INFO ] [MAIN ] Update Progress: 1948/2373 symbols completed. SMRT took 41.6s. Estimated remaining: 59m 50s. Rate: 7.1 symbols/min [2025-10-10T21:34:20.475370] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:34:20.538773] [DEBUG] [LOCAL ] SNAP: Loaded 54186 existing records from primary storage. [2025-10-10T21:34:20.539180] [INFO ] [MAIN ] SNAP: Loaded 54186 existing records. [2025-10-10T21:34:20.736830] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:34:20.737090] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-10T21:34:20.737147] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-10T21:34:20.737385] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-10T21:34:20.737443] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-10T21:34:21.095618] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-10T21:34:21.104321] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:34:21.878246] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-10T21:34:21.889327] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-10T21:34:22.157148] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.67 seconds). [2025-10-10T21:34:22.162396] [INFO ] [REMOTE ] SMR: Full fetch complete (77974 records). [2025-10-10T21:34:22.162620] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-10T21:34:22.547432] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-10T21:34:22.547527] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-10T21:34:22.548662] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-10T21:34:22.548725] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-10T21:34:22.550144] [DEBUG] [LOCAL ] SMR: Trimmed 77974 records to 54578 (keeping 200 days of data) [2025-10-10T21:34:22.716710] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-10-10T21:34:22.875377] [DEBUG] [LOCAL ] SMR: Primary data saved (54578 records). [2025-10-10T21:34:22.875521] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-10T21:34:22.875602] [INFO ] [MAIN ] Update Progress: 1949/2373 symbols completed. SMR took 44.4s. Estimated remaining: 59m 41s. Rate: 7.1 symbols/min [2025-10-10T21:34:23.043254] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:34:23.077742] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T21:34:23.076498] [DEBUG] [LOCAL ] SNDA: Loaded 4468 existing records from primary storage. [2025-10-10T21:34:23.088066] [INFO ] [MAIN ] SNDA: Loaded 4468 existing records. [2025-10-10T21:34:23.262460] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:34:23.262806] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-10T21:34:23.262860] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-10T21:34:23.263503] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-10T21:34:23.263559] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-10T21:34:23.496792] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-10T21:34:23.614387] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:34:23.720084] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T21:34:24.289427] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-10-10T21:34:24.634818] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T21:34:24.920710] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-10T21:34:25.089344] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-10T21:34:25.222587] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-10T21:34:25.889422] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-10T21:34:26.689393] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-10T21:34:27.489379] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-10T21:34:27.579151] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-10T21:34:27.797910] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T21:34:27.836246] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-10T21:34:28.289341] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-10T21:34:28.378521] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T21:34:29.089398] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-10T21:34:29.889360] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-10T21:34:30.094440] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-10T21:34:30.639214] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-10T21:34:30.689348] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-10T21:34:31.076292] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-10T21:34:31.446336] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-10T21:34:31.489353] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-10T21:34:32.289430] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-10T21:34:32.304376] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-10T21:34:33.089559] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-10T21:34:33.885285] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-10T21:34:33.889319] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-10T21:34:34.591930] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-10T21:34:34.689367] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-10T21:34:34.775607] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-10T21:34:35.489404] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-10T21:34:36.057896] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-10T21:34:36.289392] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-10T21:34:37.089443] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-10T21:34:37.794482] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-10T21:34:37.889362] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-10T21:34:38.044505] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-10T21:34:38.605046] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-10T21:34:38.689426] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-10T21:34:38.974951] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T21:34:39.483723] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-10T21:34:39.489337] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-10T21:34:40.289392] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-10T21:34:41.045959] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-10T21:34:41.089377] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-10T21:34:41.223312] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-10T21:34:41.229138] [INFO ] [REMOTE ] SN: Full fetch complete (71231 records). [2025-10-10T21:34:41.229331] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-10T21:34:41.631304] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-10T21:34:41.631418] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-10T21:34:41.633245] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-10T21:34:41.633316] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-10T21:34:41.637181] [DEBUG] [LOCAL ] SN: Trimmed 71231 records to 50672 (keeping 200 days of data) [2025-10-10T21:34:41.741455] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-10T21:34:41.743729] [INFO ] [REMOTE ] SNDA: Full fetch complete (7697 records). [2025-10-10T21:34:41.744173] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-10T21:34:41.902907] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-10T21:34:42.164942] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-10T21:34:42.166999] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-10T21:34:42.167957] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-10T21:34:42.168040] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-10T21:34:42.173347] [DEBUG] [LOCAL ] SNDA: Trimmed 7697 records to 4512 (keeping 200 days of data) [2025-10-10T21:34:42.295581] [DEBUG] [LOCAL ] SNDA: Primary data saved (4512 records). [2025-10-10T21:34:42.297241] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-10T21:34:42.298029] [INFO ] [MAIN ] Update Progress: 1950/2373 symbols completed. SNDA took 19.4s. Estimated remaining: 59m 35s. Rate: 7.1 symbols/min [2025-10-10T21:34:42.478480] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:34:42.574698] [DEBUG] [LOCAL ] SNDR: Loaded 41466 existing records from primary storage. [2025-10-10T21:34:42.576576] [INFO ] [MAIN ] SNDR: Loaded 41466 existing records. [2025-10-10T21:34:42.694274] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-10T21:34:42.784068] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:34:42.785385] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-10T21:34:42.785482] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-10T21:34:42.786205] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-10T21:34:42.786279] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-10T21:34:43.015419] [DEBUG] [LOCAL ] SN: Primary data saved (50672 records). [2025-10-10T21:34:43.047378] [INFO ] [MAIN ] SN: Full history saved. [2025-10-10T21:34:43.058431] [INFO ] [MAIN ] Update Progress: 1951/2373 symbols completed. SN took 41.2s. Estimated remaining: 59m 24s. Rate: 7.1 symbols/min [2025-10-10T21:34:43.257975] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:34:43.350840] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:34:43.353797] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-10T21:34:43.401947] [DEBUG] [LOCAL ] SNN: Loaded 44528 existing records from primary storage. [2025-10-10T21:34:43.402287] [INFO ] [MAIN ] SNN: Loaded 44528 existing records. [2025-10-10T21:34:43.496140] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-10-10T21:34:43.575188] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:34:43.575370] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-10T21:34:43.575419] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-10T21:34:43.575639] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-10T21:34:43.575729] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-10T21:34:43.920168] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:34:44.289409] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-10-10T21:34:45.089362] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-10T21:34:45.287358] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-10T21:34:45.320738] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-10T21:34:45.513476] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T21:34:45.838573] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-10T21:34:45.889403] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-10T21:34:46.689382] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-10T21:34:46.966830] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T21:34:46.969826] [INFO ] [REMOTE ] SNA: Full fetch complete (38645 records). [2025-10-10T21:34:46.969915] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-10T21:34:47.380241] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-10T21:34:47.380336] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-10T21:34:47.381678] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-10T21:34:47.381743] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-10T21:34:47.382896] [DEBUG] [LOCAL ] SNA: Trimmed 38645 records to 25978 (keeping 200 days of data) [2025-10-10T21:34:47.489426] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-10T21:34:47.564379] [DEBUG] [LOCAL ] SNA: Primary data saved (25978 records). [2025-10-10T21:34:47.564693] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-10T21:34:47.564849] [INFO ] [MAIN ] Update Progress: 1952/2373 symbols completed. SNA took 35.2s. Estimated remaining: 59m 15s. Rate: 7.1 symbols/min [2025-10-10T21:34:47.740726] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:34:47.798433] [DEBUG] [LOCAL ] SNOW: Loaded 53983 existing records from primary storage. [2025-10-10T21:34:47.798886] [INFO ] [MAIN ] SNOW: Loaded 53983 existing records. [2025-10-10T21:34:47.982051] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:34:47.982330] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-10T21:34:47.982383] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-10T21:34:47.982611] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-10-10T21:34:47.982694] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-10T21:34:48.294734] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-10T21:34:48.357204] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:34:49.089471] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-10-10T21:34:49.132873] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-10T21:34:49.167925] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-10T21:34:49.395819] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-10T21:34:49.889425] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-10T21:34:50.689422] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-10T21:34:51.436750] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-10T21:34:51.489358] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-10T21:34:51.712500] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-10T21:34:52.289400] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-10T21:34:53.089434] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-10T21:34:53.248280] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T21:34:53.387631] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-10T21:34:53.889375] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-10T21:34:54.376251] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T21:34:54.624874] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-10T21:34:54.689358] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-10T21:34:55.489385] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-10T21:34:56.289370] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-10T21:34:56.602984] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-10T21:34:57.023239] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-10T21:34:57.090682] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-10T21:34:57.093436] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T21:34:57.470311] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-10T21:34:57.889398] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-10T21:34:58.689390] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-10T21:34:59.483739] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-10T21:34:59.495590] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-10T21:35:00.289345] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-10T21:35:00.507135] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-10T21:35:00.710737] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-10-10T21:35:01.089362] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-10T21:35:01.187181] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-10T21:35:01.889442] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-10T21:35:02.661978] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-10T21:35:02.689452] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-10T21:35:03.489377] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-10T21:35:03.543000] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T21:35:03.711887] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-10T21:35:03.719906] [INFO ] [REMOTE ] SNAP: Full fetch complete (77934 records). [2025-10-10T21:35:03.720131] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-10T21:35:04.111710] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-10T21:35:04.111813] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-10T21:35:04.113491] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-10T21:35:04.113587] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-10T21:35:04.115275] [DEBUG] [LOCAL ] SNAP: Trimmed 77934 records to 54576 (keeping 200 days of data) [2025-10-10T21:35:04.293899] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-10T21:35:04.444113] [DEBUG] [LOCAL ] SNAP: Primary data saved (54576 records). [2025-10-10T21:35:04.444288] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-10T21:35:04.444895] [INFO ] [MAIN ] Update Progress: 1953/2373 symbols completed. SNAP took 44.1s. Estimated remaining: 59m 8s. Rate: 7.1 symbols/min [2025-10-10T21:35:04.619038] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:35:04.664526] [DEBUG] [LOCAL ] SNV: Loaded 49251 existing records from primary storage. [2025-10-10T21:35:04.664924] [INFO ] [MAIN ] SNV: Loaded 49251 existing records. [2025-10-10T21:35:04.838116] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:35:04.838410] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-10T21:35:04.838458] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-10T21:35:04.838706] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-10T21:35:04.838762] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-10T21:35:05.230898] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:35:05.231905] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-10-10T21:35:05.323906] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T21:35:05.433501] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-10-10T21:35:05.889370] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-10T21:35:05.978157] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T21:35:06.689350] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-10T21:35:07.122967] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T21:35:07.222943] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-10T21:35:07.489382] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-10T21:35:08.289409] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-10T21:35:08.471806] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T21:35:09.089510] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-10T21:35:09.389541] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T21:35:09.889390] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-10T21:35:10.689426] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-10T21:35:10.751690] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-10T21:35:10.913702] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-10T21:35:11.489342] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-10T21:35:11.712792] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T21:35:11.966350] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T21:35:12.289367] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-10T21:35:12.921999] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-10T21:35:13.089388] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-10T21:35:13.889403] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-10T21:35:14.409288] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-10T21:35:14.616670] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-10T21:35:14.621463] [INFO ] [REMOTE ] SNDR: Full fetch complete (59658 records). [2025-10-10T21:35:14.621589] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-10T21:35:14.697315] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-10T21:35:15.020110] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-10T21:35:15.020211] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-10T21:35:15.021297] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-10T21:35:15.021370] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-10T21:35:15.023096] [DEBUG] [LOCAL ] SNDR: Trimmed 59658 records to 41828 (keeping 200 days of data) [2025-10-10T21:35:15.274527] [DEBUG] [LOCAL ] SNDR: Primary data saved (41828 records). [2025-10-10T21:35:15.274688] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-10T21:35:15.274782] [INFO ] [MAIN ] Update Progress: 1954/2373 symbols completed. SNDR took 33.0s. Estimated remaining: 59m 1s. Rate: 7.1 symbols/min [2025-10-10T21:35:15.445274] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:35:15.490194] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-10T21:35:15.490132] [DEBUG] [LOCAL ] SNX: Loaded 40296 existing records from primary storage. [2025-10-10T21:35:15.491295] [INFO ] [MAIN ] SNX: Loaded 40296 existing records. [2025-10-10T21:35:15.679485] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:35:15.679999] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-10T21:35:15.680076] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-10T21:35:15.680384] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-10T21:35:15.702857] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-10T21:35:15.767501] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T21:35:16.061119] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:35:16.289371] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-10-10T21:35:17.089482] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-10T21:35:17.091823] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-10T21:35:17.518106] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T21:35:17.609227] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T21:35:17.889366] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-10T21:35:18.149380] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-10T21:35:18.153632] [INFO ] [REMOTE ] SNN: Full fetch complete (63021 records). [2025-10-10T21:35:18.153801] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-10T21:35:18.536326] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-10T21:35:18.536393] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-10T21:35:18.537363] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-10T21:35:18.537433] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-10T21:35:18.538797] [DEBUG] [LOCAL ] SNN: Trimmed 63021 records to 44855 (keeping 200 days of data) [2025-10-10T21:35:18.709954] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-10T21:35:18.808900] [DEBUG] [LOCAL ] SNN: Primary data saved (44855 records). [2025-10-10T21:35:18.809038] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-10T21:35:18.809119] [INFO ] [MAIN ] Update Progress: 1955/2373 symbols completed. SNN took 35.7s. Estimated remaining: 58m 51s. Rate: 7.1 symbols/min [2025-10-10T21:35:18.977154] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:35:19.026982] [DEBUG] [LOCAL ] SO: Loaded 53999 existing records from primary storage. [2025-10-10T21:35:19.027322] [INFO ] [MAIN ] SO: Loaded 53999 existing records. [2025-10-10T21:35:19.200056] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:35:19.200330] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-10T21:35:19.200392] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-10T21:35:19.200782] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-10T21:35:19.200847] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-10T21:35:19.494539] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-10T21:35:19.545030] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:35:20.223857] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-10T21:35:20.289346] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-10T21:35:20.688457] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T21:35:21.089340] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-10-10T21:35:21.337862] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T21:35:21.889375] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-10T21:35:22.679168] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-10T21:35:22.684220] [INFO ] [REMOTE ] SNOW: Full fetch complete (77652 records). [2025-10-10T21:35:22.684344] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-10T21:35:22.716502] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-10T21:35:23.084758] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-10T21:35:23.085146] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-10T21:35:23.086727] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-10T21:35:23.086809] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-10T21:35:23.091804] [DEBUG] [LOCAL ] SNOW: Trimmed 77652 records to 54373 (keeping 200 days of data) [2025-10-10T21:35:23.120557] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-10T21:35:23.403286] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-10T21:35:23.489396] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-10T21:35:23.513912] [DEBUG] [LOCAL ] SNOW: Primary data saved (54373 records). [2025-10-10T21:35:23.514078] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-10T21:35:23.514166] [INFO ] [MAIN ] Update Progress: 1956/2373 symbols completed. SNOW took 35.9s. Estimated remaining: 58m 42s. Rate: 7.1 symbols/min [2025-10-10T21:35:23.679863] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:35:23.717734] [DEBUG] [LOCAL ] SOBO: Loaded 39595 existing records from primary storage. [2025-10-10T21:35:23.718085] [INFO ] [MAIN ] SOBO: Loaded 39595 existing records. [2025-10-10T21:35:23.892179] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:35:23.892386] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-10T21:35:23.892432] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-10T21:35:23.892713] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-10T21:35:23.892779] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-10T21:35:24.254489] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:35:24.289332] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-10-10T21:35:24.414259] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-10T21:35:25.089398] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-10T21:35:25.474672] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-10T21:35:25.889347] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-10T21:35:26.120602] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T21:35:26.689469] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-10T21:35:26.905166] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T21:35:27.489402] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-10T21:35:27.630773] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T21:35:28.166007] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-10T21:35:28.289392] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-10T21:35:29.089390] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-10T21:35:29.418773] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-10T21:35:29.529115] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T21:35:29.889390] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-10T21:35:30.689391] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-10T21:35:31.184448] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-10T21:35:31.489424] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-10T21:35:31.539028] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-10T21:35:32.289386] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-10T21:35:32.470465] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-10T21:35:33.047212] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T21:35:33.089339] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-10T21:35:33.889360] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-10T21:35:34.256510] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-10T21:35:34.689357] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-10T21:35:35.131502] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-10T21:35:35.489386] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-10T21:35:35.739199] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T21:35:36.137922] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-10T21:35:36.289371] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-10T21:35:37.089412] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-10T21:35:37.694725] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-10T21:35:37.889413] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-10T21:35:38.001806] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T21:35:38.689426] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-10T21:35:38.775162] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T21:35:39.481255] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T21:35:39.492373] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-10T21:35:40.013954] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T21:35:40.289467] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-10T21:35:41.089354] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-10T21:35:41.222893] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T21:35:41.368217] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T21:35:41.373247] [INFO ] [REMOTE ] SNV: Full fetch complete (71295 records). [2025-10-10T21:35:41.373413] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-10T21:35:41.810809] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-10T21:35:41.810905] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-10T21:35:41.812268] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-10T21:35:41.812333] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-10T21:35:41.813838] [DEBUG] [LOCAL ] SNV: Trimmed 71295 records to 49619 (keeping 200 days of data) [2025-10-10T21:35:41.912084] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-10T21:35:42.151585] [DEBUG] [LOCAL ] SNV: Primary data saved (49619 records). [2025-10-10T21:35:42.151767] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-10T21:35:42.151860] [INFO ] [MAIN ] Update Progress: 1957/2373 symbols completed. SNV took 37.7s. Estimated remaining: 58m 36s. Rate: 7.1 symbols/min [2025-10-10T21:35:42.689475] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-10T21:35:43.076923] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T21:35:43.489374] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-10T21:35:43.562480] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T21:35:44.289402] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-10T21:35:44.398024] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-10T21:35:44.942953] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-10T21:35:45.089366] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-10T21:35:45.292233] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-10T21:35:45.889370] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-10T21:35:46.172202] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T21:35:46.689408] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-10T21:35:47.446350] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T21:35:47.451812] [INFO ] [REMOTE ] SO: Full fetch complete (77597 records). [2025-10-10T21:35:47.451942] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-10T21:35:47.494765] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-10T21:35:47.656907] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T21:35:47.882950] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-10T21:35:47.883048] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-10T21:35:47.884160] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-10T21:35:47.884229] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-10T21:35:47.888176] [DEBUG] [LOCAL ] SO: Trimmed 77597 records to 54389 (keeping 200 days of data) [2025-10-10T21:35:48.216011] [DEBUG] [LOCAL ] SO: Primary data saved (54389 records). [2025-10-10T21:35:48.216148] [INFO ] [MAIN ] SO: Full history saved. [2025-10-10T21:35:48.216228] [INFO ] [MAIN ] Update Progress: 1958/2373 symbols completed. SO took 29.4s. Estimated remaining: 58m 27s. Rate: 7.1 symbols/min [2025-10-10T21:35:48.289372] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-10T21:35:49.328837] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-10T21:35:49.338019] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-10T21:35:49.945330] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T21:35:49.954154] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-10T21:35:50.372628] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-10T21:35:50.376495] [INFO ] [REMOTE ] SNX: Full fetch complete (57091 records). [2025-10-10T21:35:50.376622] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-10T21:35:50.752714] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-10T21:35:50.752804] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-10T21:35:50.753848] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-10T21:35:50.753910] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-10T21:35:50.755031] [DEBUG] [LOCAL ] SNX: Trimmed 57091 records to 40527 (keeping 200 days of data) [2025-10-10T21:35:51.005773] [DEBUG] [LOCAL ] SNX: Primary data saved (40527 records). [2025-10-10T21:35:51.005913] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-10T21:35:51.006008] [INFO ] [MAIN ] Update Progress: 1959/2373 symbols completed. SNX took 35.7s. Estimated remaining: 58m 17s. Rate: 7.1 symbols/min [2025-10-10T21:35:51.409418] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-10T21:35:51.413513] [INFO ] [REMOTE ] SOBO: Full fetch complete (58214 records). [2025-10-10T21:35:51.413616] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-10T21:35:51.815267] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-10T21:35:51.815366] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-10T21:35:51.816350] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-10T21:35:51.816417] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-10T21:35:51.818218] [DEBUG] [LOCAL ] SOBO: Trimmed 58214 records to 39909 (keeping 200 days of data) [2025-10-10T21:35:52.150159] [DEBUG] [LOCAL ] SOBO: Primary data saved (39909 records). [2025-10-10T21:35:52.150331] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-10T21:35:52.150460] [INFO ] [MAIN ] Update Progress: 1960/2373 symbols completed. SOBO took 28.6s. Estimated remaining: 58m 7s. Rate: 7.1 symbols/min [2025-10-10T21:35:52.907323] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:35:52.938527] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:35:53.047729] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:35:53.076743] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:35:53.075617] [DEBUG] [LOCAL ] SOJC: Loaded 5009 existing records from primary storage. [2025-10-10T21:35:53.077424] [INFO ] [MAIN ] SOJC: Loaded 5009 existing records. [2025-10-10T21:35:53.121740] [DEBUG] [LOCAL ] SOJE: Loaded 9109 existing records from primary storage. [2025-10-10T21:35:53.162805] [INFO ] [MAIN ] SOJE: Loaded 9109 existing records. [2025-10-10T21:35:53.294170] [DEBUG] [LOCAL ] SOJD: Loaded 13098 existing records from primary storage. [2025-10-10T21:35:53.341046] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:35:53.349919] [INFO ] [MAIN ] SOJD: Loaded 13098 existing records. [2025-10-10T21:35:53.395789] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-10T21:35:53.411696] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-10T21:35:53.411983] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-10T21:35:53.412064] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-10T21:35:53.553161] [DEBUG] [LOCAL ] SOC: Loaded 51018 existing records from primary storage. [2025-10-10T21:35:53.601698] [INFO ] [MAIN ] SOC: Loaded 51018 existing records. [2025-10-10T21:35:53.845765] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:35:53.970203] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-10T21:35:53.976790] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:35:53.988984] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-10T21:35:54.052139] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-10T21:35:54.057427] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-10T21:35:54.020480] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-10T21:35:54.102251] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-10T21:35:54.132221] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:35:54.234688] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-10T21:35:54.234883] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-10T21:35:54.240145] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-10T21:35:54.240623] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-10T21:35:54.245898] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-10T21:35:54.287307] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-10T21:35:54.424272] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:35:54.581800] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-10-10T21:35:55.254326] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:35:55.273452] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-10-10T21:35:55.295614] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:35:55.295978] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-10-10T21:35:55.377219] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:35:55.377573] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-10-10T21:35:55.700834] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-10T21:35:55.703454] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-10T21:35:56.006257] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-10T21:35:56.010358] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-10T21:35:56.444867] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-10T21:35:56.446750] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-10T21:35:56.550802] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-10T21:35:56.555803] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-10T21:35:56.575201] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-10T21:35:56.800486] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T21:35:57.089397] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-10T21:35:57.124078] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-10T21:35:57.662823] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-10T21:35:57.889432] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-10T21:35:58.689363] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-10T21:35:58.800377] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-10T21:35:58.916943] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-10T21:35:59.222570] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-10T21:35:59.489389] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-10T21:36:00.289444] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-10T21:36:00.427040] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-10T21:36:01.089399] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-10T21:36:01.350665] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-10T21:36:01.889351] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-10T21:36:01.959612] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T21:36:02.689375] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-10T21:36:03.498319] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-10T21:36:03.517749] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T21:36:03.620519] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-10T21:36:04.227458] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-10T21:36:04.289337] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-10T21:36:05.009875] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-10T21:36:05.089388] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-10T21:36:05.889359] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-10T21:36:06.018325] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-10T21:36:06.593873] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-10T21:36:06.689401] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-10T21:36:07.489354] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-10T21:36:07.664984] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T21:36:08.289421] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-10T21:36:09.089362] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-10T21:36:09.192165] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-10T21:36:09.232876] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-10T21:36:09.654229] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-10T21:36:09.889346] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-10T21:36:10.570149] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-10T21:36:10.689414] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-10T21:36:11.206374] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-10T21:36:11.207553] [INFO ] [REMOTE ] SOJC: Full fetch complete (7548 records). [2025-10-10T21:36:11.207628] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-10T21:36:11.497615] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-10T21:36:11.588633] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-10T21:36:11.588750] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-10T21:36:11.588984] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-10T21:36:11.589024] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-10T21:36:11.589403] [DEBUG] [LOCAL ] SOJC: Trimmed 7548 records to 5037 (keeping 200 days of data) [2025-10-10T21:36:11.620613] [DEBUG] [LOCAL ] SOJC: Primary data saved (5037 records). [2025-10-10T21:36:11.620775] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-10T21:36:11.620869] [INFO ] [MAIN ] Update Progress: 1961/2373 symbols completed. SOJC took 19.5s. Estimated remaining: 58m 1s. Rate: 7.1 symbols/min [2025-10-10T21:36:11.814962] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:36:11.815205] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-10T21:36:11.815276] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-10T21:36:11.815419] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-10T21:36:11.815472] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-10T21:36:11.815532] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-10T21:36:11.815578] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-10T21:36:12.161544] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:36:12.289394] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-10T21:36:12.636989] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-10T21:36:13.089365] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-10T21:36:13.824253] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T21:36:13.889366] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-10T21:36:14.257846] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T21:36:14.689385] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-10T21:36:15.489343] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-10-10T21:36:15.627571] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T21:36:15.631997] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-10T21:36:15.749158] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:36:15.749444] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-10-10T21:36:15.749536] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:36:15.749583] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-10-10T21:36:15.749663] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:36:15.749745] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-10T21:36:15.749809] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-10T21:36:15.749847] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-10T21:36:15.749886] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-10T21:36:15.749931] [INFO ] [MAIN ] Update Progress: 1962/2373 symbols completed. SOJF took 4.1s. Estimated remaining: 57m 51s. Rate: 7.1 symbols/min [2025-10-10T21:36:15.921093] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:36:15.937045] [DEBUG] [LOCAL ] SOL: Loaded 13107 existing records from primary storage. [2025-10-10T21:36:15.937293] [INFO ] [MAIN ] SOL: Loaded 13107 existing records. [2025-10-10T21:36:16.117259] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:36:16.117468] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-10T21:36:16.117529] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-10T21:36:16.117722] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-10T21:36:16.117777] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-10T21:36:16.294564] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-10T21:36:16.471187] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:36:17.089368] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-10-10T21:36:17.241985] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-10T21:36:17.889484] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-10T21:36:18.426096] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T21:36:18.689399] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-10T21:36:18.806140] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-10T21:36:19.489431] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-10T21:36:19.907267] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T21:36:20.113158] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T21:36:20.114377] [INFO ] [REMOTE ] SOJE: Full fetch complete (13836 records). [2025-10-10T21:36:20.114445] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-10T21:36:20.294694] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-10T21:36:20.479136] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-10T21:36:20.479224] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-10T21:36:20.479679] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-10T21:36:20.479742] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-10T21:36:20.480361] [DEBUG] [LOCAL ] SOJE: Trimmed 13836 records to 9165 (keeping 200 days of data) [2025-10-10T21:36:20.539334] [DEBUG] [LOCAL ] SOJE: Primary data saved (9165 records). [2025-10-10T21:36:20.539487] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-10T21:36:20.539576] [INFO ] [MAIN ] Update Progress: 1963/2373 symbols completed. SOJE took 28.4s. Estimated remaining: 57m 42s. Rate: 7.1 symbols/min [2025-10-10T21:36:20.708753] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:36:20.747531] [DEBUG] [LOCAL ] SOLV: Loaded 44207 existing records from primary storage. [2025-10-10T21:36:20.747864] [INFO ] [MAIN ] SOLV: Loaded 44207 existing records. [2025-10-10T21:36:20.930037] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:36:20.930698] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-10T21:36:20.930758] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-10T21:36:20.931088] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-10-10T21:36:20.931151] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-10T21:36:21.099199] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-10T21:36:21.286115] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:36:21.889369] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-10T21:36:22.206929] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-10T21:36:22.344561] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-10T21:36:22.689362] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-10T21:36:22.786456] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-10T21:36:23.489411] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-10-10T21:36:23.616794] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T21:36:24.289389] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-10T21:36:24.969931] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T21:36:25.089392] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-10T21:36:25.218614] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-10T21:36:25.889446] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-10T21:36:26.186862] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-10T21:36:26.691024] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-10T21:36:26.694821] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T21:36:26.696874] [INFO ] [REMOTE ] SOJD: Full fetch complete (19407 records). [2025-10-10T21:36:26.696948] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-10T21:36:27.121362] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-10T21:36:27.121481] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-10T21:36:27.122031] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-10T21:36:27.122095] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-10T21:36:27.122825] [DEBUG] [LOCAL ] SOJD: Trimmed 19407 records to 13182 (keeping 200 days of data) [2025-10-10T21:36:27.210748] [DEBUG] [LOCAL ] SOJD: Primary data saved (13182 records). [2025-10-10T21:36:27.210899] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-10T21:36:27.210984] [INFO ] [MAIN ] Update Progress: 1964/2373 symbols completed. SOJD took 35.1s. Estimated remaining: 57m 33s. Rate: 7.1 symbols/min [2025-10-10T21:36:27.400026] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:36:27.438249] [DEBUG] [LOCAL ] SON: Loaded 43399 existing records from primary storage. [2025-10-10T21:36:27.438544] [INFO ] [MAIN ] SON: Loaded 43399 existing records. [2025-10-10T21:36:27.499132] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-10T21:36:27.613781] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:36:27.614013] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-10T21:36:27.614062] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-10T21:36:27.614277] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-10T21:36:27.614332] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-10T21:36:27.959537] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:36:28.289348] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-10-10T21:36:28.568213] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T21:36:29.089404] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-10T21:36:29.302229] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T21:36:29.566530] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T21:36:29.889351] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-10T21:36:30.305504] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T21:36:30.689386] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-10T21:36:31.489518] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-10T21:36:31.558723] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-10T21:36:32.046001] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-10T21:36:32.289426] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-10T21:36:32.552341] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T21:36:33.089372] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-10T21:36:33.375620] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-10T21:36:33.889393] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-10T21:36:34.689448] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-10T21:36:35.095770] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T21:36:35.489374] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-10T21:36:35.680584] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-10T21:36:36.289375] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-10T21:36:36.375033] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T21:36:37.089357] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-10T21:36:37.327371] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-10T21:36:37.332879] [INFO ] [REMOTE ] SOC: Full fetch complete (71742 records). [2025-10-10T21:36:37.333043] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-10T21:36:37.743258] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-10T21:36:37.743475] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-10T21:36:37.745201] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-10T21:36:37.745308] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-10T21:36:37.746933] [DEBUG] [LOCAL ] SOC: Trimmed 71742 records to 51406 (keeping 200 days of data) [2025-10-10T21:36:37.931041] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-10T21:36:38.031162] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-10T21:36:38.110365] [DEBUG] [LOCAL ] SOC: Primary data saved (51406 records). [2025-10-10T21:36:38.110530] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-10T21:36:38.111001] [INFO ] [MAIN ] Update Progress: 1965/2373 symbols completed. SOC took 46.0s. Estimated remaining: 57m 25s. Rate: 7.1 symbols/min [2025-10-10T21:36:38.274019] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:36:38.325125] [DEBUG] [LOCAL ] SONY: Loaded 53756 existing records from primary storage. [2025-10-10T21:36:38.325480] [INFO ] [MAIN ] SONY: Loaded 53756 existing records. [2025-10-10T21:36:38.497224] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:36:38.497461] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-10T21:36:38.497509] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-10T21:36:38.497745] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-10T21:36:38.497803] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-10T21:36:38.689351] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-10T21:36:38.855088] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:36:38.888068] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T21:36:39.259991] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-10T21:36:39.489407] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-10-10T21:36:40.289376] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-10T21:36:40.530020] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T21:36:41.089347] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-10T21:36:41.649871] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T21:36:41.789926] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-10T21:36:41.802872] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-10T21:36:41.889337] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-10T21:36:42.689350] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-10T21:36:42.841332] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-10T21:36:43.489363] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-10T21:36:44.289454] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-10T21:36:44.528048] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-10T21:36:44.547102] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T21:36:45.089418] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-10T21:36:45.889369] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-10T21:36:45.985540] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-10T21:36:46.288215] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T21:36:46.689356] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-10T21:36:46.970823] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T21:36:46.972911] [INFO ] [REMOTE ] SOL: Full fetch complete (21414 records). [2025-10-10T21:36:46.973026] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-10T21:36:47.327527] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-10T21:36:47.327600] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-10T21:36:47.328075] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-10T21:36:47.328135] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-10T21:36:47.328739] [DEBUG] [LOCAL ] SOL: Trimmed 21414 records to 13271 (keeping 200 days of data) [2025-10-10T21:36:47.408172] [DEBUG] [LOCAL ] SOL: Primary data saved (13271 records). [2025-10-10T21:36:47.408365] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-10T21:36:47.408480] [INFO ] [MAIN ] Update Progress: 1966/2373 symbols completed. SOL took 31.7s. Estimated remaining: 57m 17s. Rate: 7.1 symbols/min [2025-10-10T21:36:47.498397] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-10T21:36:47.577635] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:36:47.582714] [DEBUG] [LOCAL ] SOR: Loaded 2909 existing records from primary storage. [2025-10-10T21:36:47.582863] [INFO ] [MAIN ] SOR: Loaded 2909 existing records. [2025-10-10T21:36:47.755789] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:36:47.755985] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-10T21:36:47.756031] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-10T21:36:47.756156] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-10T21:36:47.756193] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-10T21:36:48.111243] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:36:48.223111] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T21:36:48.289332] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-10T21:36:49.089363] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-10-10T21:36:49.618788] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-10T21:36:49.661218] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-10T21:36:49.742813] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T21:36:49.889359] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-10T21:36:50.624934] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-10T21:36:50.689410] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-10T21:36:51.489397] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-10T21:36:52.289405] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-10T21:36:52.443073] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-10T21:36:53.089438] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-10T21:36:53.249998] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T21:36:53.277087] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T21:36:53.889389] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-10T21:36:54.689397] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-10T21:36:55.189701] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-10T21:36:55.489493] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-10T21:36:55.663123] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T21:36:56.289393] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-10T21:36:56.548357] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T21:36:57.089359] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-10T21:36:57.728772] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-10T21:36:57.881427] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-10T21:36:57.885859] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-10T21:36:57.889700] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-10T21:36:57.893869] [INFO ] [REMOTE ] SON: Full fetch complete (62458 records). [2025-10-10T21:36:57.893952] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-10T21:36:58.277231] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-10T21:36:58.277342] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-10T21:36:58.278364] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-10T21:36:58.278448] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-10T21:36:58.279725] [DEBUG] [LOCAL ] SON: Trimmed 62458 records to 43771 (keeping 200 days of data) [2025-10-10T21:36:58.567807] [DEBUG] [LOCAL ] SON: Primary data saved (43771 records). [2025-10-10T21:36:58.568003] [INFO ] [MAIN ] SON: Full history saved. [2025-10-10T21:36:58.568107] [INFO ] [MAIN ] Update Progress: 1967/2373 symbols completed. SON took 31.4s. Estimated remaining: 57m 9s. Rate: 7.1 symbols/min [2025-10-10T21:36:58.694553] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-10T21:36:58.738181] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:36:58.750585] [DEBUG] [LOCAL ] SOS: Loaded 9215 existing records from primary storage. [2025-10-10T21:36:58.750894] [INFO ] [MAIN ] SOS: Loaded 9215 existing records. [2025-10-10T21:36:58.924513] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:36:58.924817] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-10T21:36:58.924868] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-10T21:36:58.925107] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-10T21:36:58.925164] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-10T21:36:59.279133] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:36:59.489394] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-10-10T21:36:59.761903] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-10T21:37:00.187473] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-10T21:37:00.289402] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-10T21:37:00.861636] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T21:37:01.089413] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-10T21:37:01.890270] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-10T21:37:02.053810] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T21:37:02.429639] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-10T21:37:02.532063] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T21:37:02.536412] [INFO ] [REMOTE ] SOLV: Full fetch complete (63339 records). [2025-10-10T21:37:02.536572] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-10T21:37:02.692767] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-10T21:37:02.975389] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-10T21:37:02.975526] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-10T21:37:02.976540] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-10T21:37:02.976604] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-10T21:37:02.978039] [DEBUG] [LOCAL ] SOLV: Trimmed 63339 records to 44502 (keeping 200 days of data) [2025-10-10T21:37:03.242361] [DEBUG] [LOCAL ] SOLV: Primary data saved (44502 records). [2025-10-10T21:37:03.242506] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-10T21:37:03.242589] [INFO ] [MAIN ] Update Progress: 1968/2373 symbols completed. SOLV took 42.7s. Estimated remaining: 57m 0s. Rate: 7.1 symbols/min [2025-10-10T21:37:03.411189] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:37:03.444094] [DEBUG] [LOCAL ] SPB: Loaded 34429 existing records from primary storage. [2025-10-10T21:37:03.444409] [INFO ] [MAIN ] SPB: Loaded 34429 existing records. [2025-10-10T21:37:03.499577] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-10T21:37:03.629288] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:37:03.629582] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-10T21:37:03.629629] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-10T21:37:03.629885] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-10T21:37:03.629945] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-10T21:37:03.986721] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:37:04.240961] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-10T21:37:04.289370] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-10-10T21:37:04.979076] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-10T21:37:05.089399] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-10T21:37:05.742837] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-10T21:37:05.775271] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-10T21:37:05.889400] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-10T21:37:06.689390] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-10T21:37:07.349900] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T21:37:07.489379] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-10T21:37:08.289407] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-10T21:37:08.888442] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-10T21:37:08.934105] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-10T21:37:09.089424] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-10T21:37:09.274160] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T21:37:09.719576] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-10T21:37:09.889385] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-10T21:37:10.689409] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-10T21:37:11.325801] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-10T21:37:11.385914] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T21:37:11.489380] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-10T21:37:12.289385] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-10T21:37:13.089420] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-10T21:37:13.176204] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T21:37:13.503319] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-10T21:37:13.889445] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-10T21:37:14.491275] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-10T21:37:14.570744] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-10T21:37:14.689422] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-10T21:37:15.266919] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-10T21:37:15.489442] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-10T21:37:16.062225] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-10T21:37:16.289404] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-10T21:37:17.089455] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-10T21:37:17.655537] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-10T21:37:17.889428] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-10T21:37:17.987046] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T21:37:18.345549] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-10T21:37:18.346619] [INFO ] [REMOTE ] SOR: Full fetch complete (4417 records). [2025-10-10T21:37:18.346737] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-10T21:37:18.692330] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-10T21:37:18.722822] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-10T21:37:18.723165] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-10T21:37:18.723407] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-10T21:37:18.723452] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-10T21:37:18.723872] [DEBUG] [LOCAL ] SOR: Trimmed 4417 records to 2933 (keeping 200 days of data) [2025-10-10T21:37:18.743484] [DEBUG] [LOCAL ] SOR: Primary data saved (2933 records). [2025-10-10T21:37:18.743595] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-10T21:37:18.743718] [INFO ] [MAIN ] Update Progress: 1969/2373 symbols completed. SOR took 31.3s. Estimated remaining: 56m 53s. Rate: 7.1 symbols/min [2025-10-10T21:37:18.915477] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:37:18.967364] [DEBUG] [LOCAL ] SPCE: Loaded 50318 existing records from primary storage. [2025-10-10T21:37:18.967801] [INFO ] [MAIN ] SPCE: Loaded 50318 existing records. [2025-10-10T21:37:19.160358] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:37:19.160624] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-10T21:37:19.160707] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-10T21:37:19.161107] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-10T21:37:19.161203] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-10T21:37:19.501677] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-10T21:37:19.544012] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:37:20.289422] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-10T21:37:20.387325] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T21:37:20.851800] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-10T21:37:21.089384] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-10-10T21:37:21.670413] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-10T21:37:21.889368] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-10T21:37:22.689485] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-10T21:37:23.367310] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-10T21:37:23.489440] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-10T21:37:23.673612] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-10T21:37:23.679446] [INFO ] [REMOTE ] SONY: Full fetch complete (77240 records). [2025-10-10T21:37:23.679637] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-10T21:37:24.010619] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-10T21:37:24.117423] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-10T21:37:24.117557] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-10T21:37:24.119300] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-10T21:37:24.119373] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-10T21:37:24.121465] [DEBUG] [LOCAL ] SONY: Trimmed 77240 records to 54146 (keeping 200 days of data) [2025-10-10T21:37:24.309195] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-10T21:37:24.487443] [DEBUG] [LOCAL ] SONY: Primary data saved (54146 records). [2025-10-10T21:37:24.487715] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-10T21:37:24.488376] [INFO ] [MAIN ] Update Progress: 1970/2373 symbols completed. SONY took 46.4s. Estimated remaining: 56m 44s. Rate: 7.1 symbols/min [2025-10-10T21:37:24.716681] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:37:24.728262] [DEBUG] [LOCAL ] SPE: Loaded 6317 existing records from primary storage. [2025-10-10T21:37:24.728562] [INFO ] [MAIN ] SPE: Loaded 6317 existing records. [2025-10-10T21:37:24.918564] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:37:24.919074] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-10T21:37:24.919188] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-10T21:37:24.919560] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-10T21:37:24.919621] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-10T21:37:25.096714] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-10T21:37:25.319084] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:37:25.322826] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T21:37:25.510967] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T21:37:25.889405] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-10-10T21:37:26.689371] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-10T21:37:26.772339] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-10T21:37:27.268321] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-10T21:37:27.489390] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-10T21:37:28.092932] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-10T21:37:28.289406] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-10T21:37:29.089360] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-10T21:37:29.499908] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-10T21:37:29.622982] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-10T21:37:29.889400] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-10T21:37:29.988058] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-10T21:37:30.689387] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-10T21:37:31.489341] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-10T21:37:31.603774] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-10T21:37:32.073978] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-10T21:37:32.289406] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-10T21:37:33.017271] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-10T21:37:33.051165] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-10T21:37:33.089369] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-10T21:37:33.889393] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-10T21:37:34.024943] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-10T21:37:34.689374] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-10T21:37:35.489357] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-10T21:37:35.693670] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T21:37:35.696615] [INFO ] [REMOTE ] SOS: Full fetch complete (11206 records). [2025-10-10T21:37:35.696855] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-10T21:37:36.076743] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-10T21:37:36.084122] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-10T21:37:36.087308] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-10T21:37:36.087435] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-10T21:37:36.089751] [DEBUG] [LOCAL ] SOS: Trimmed 11206 records to 9331 (keeping 200 days of data) [2025-10-10T21:37:36.089617] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-10T21:37:36.153451] [DEBUG] [LOCAL ] SOS: Primary data saved (9331 records). [2025-10-10T21:37:36.153588] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-10T21:37:36.153689] [INFO ] [MAIN ] Update Progress: 1971/2373 symbols completed. SOS took 37.6s. Estimated remaining: 56m 36s. Rate: 7.1 symbols/min [2025-10-10T21:37:36.267787] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-10T21:37:36.291226] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-10T21:37:36.342185] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:37:36.394113] [DEBUG] [LOCAL ] SPG: Loaded 50593 existing records from primary storage. [2025-10-10T21:37:36.394440] [INFO ] [MAIN ] SPG: Loaded 50593 existing records. [2025-10-10T21:37:36.625068] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:37:36.625350] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-10T21:37:36.625418] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-10T21:37:36.625717] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-10T21:37:36.625789] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-10T21:37:37.102386] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-10T21:37:37.166888] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:37:37.889397] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-10-10T21:37:37.941794] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-10T21:37:38.646966] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-10T21:37:38.689437] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-10T21:37:39.348435] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-10T21:37:39.484145] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-10T21:37:39.489319] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-10T21:37:40.226745] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-10T21:37:40.289360] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-10T21:37:41.089439] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-10T21:37:41.889389] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-10T21:37:41.987173] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-10T21:37:42.127148] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T21:37:42.689380] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-10T21:37:43.338828] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-10T21:37:43.339947] [INFO ] [REMOTE ] SPE: Full fetch complete (9870 records). [2025-10-10T21:37:43.340017] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-10T21:37:43.493802] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-10T21:37:43.725468] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-10T21:37:43.725575] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-10T21:37:43.725993] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-10T21:37:43.726060] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-10T21:37:43.726603] [DEBUG] [LOCAL ] SPE: Trimmed 9870 records to 6369 (keeping 200 days of data) [2025-10-10T21:37:43.769068] [DEBUG] [LOCAL ] SPE: Primary data saved (6369 records). [2025-10-10T21:37:43.769244] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-10T21:37:43.769358] [INFO ] [MAIN ] Update Progress: 1972/2373 symbols completed. SPE took 19.3s. Estimated remaining: 56m 28s. Rate: 7.1 symbols/min [2025-10-10T21:37:43.953305] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:37:44.005353] [DEBUG] [LOCAL ] SPGI: Loaded 46139 existing records from primary storage. [2025-10-10T21:37:44.005994] [INFO ] [MAIN ] SPGI: Loaded 46139 existing records. [2025-10-10T21:37:44.226741] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:37:44.243122] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-10T21:37:44.243344] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-10T21:37:44.245399] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-10T21:37:44.245319] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-10T21:37:44.245672] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-10T21:37:44.292309] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-10T21:37:44.626842] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:37:45.089355] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-10T21:37:45.428484] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T21:37:45.575091] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T21:37:45.579023] [INFO ] [REMOTE ] SPB: Full fetch complete (47594 records). [2025-10-10T21:37:45.579192] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-10T21:37:45.895087] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-10-10T21:37:45.987056] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-10T21:37:45.987170] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-10T21:37:45.988400] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-10T21:37:45.988465] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-10T21:37:45.989519] [DEBUG] [LOCAL ] SPB: Trimmed 47594 records to 34631 (keeping 200 days of data) [2025-10-10T21:37:46.197757] [DEBUG] [LOCAL ] SPB: Primary data saved (34631 records). [2025-10-10T21:37:46.197903] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-10T21:37:46.197988] [INFO ] [MAIN ] Update Progress: 1973/2373 symbols completed. SPB took 43.0s. Estimated remaining: 56m 18s. Rate: 7.1 symbols/min [2025-10-10T21:37:46.362958] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:37:46.380958] [DEBUG] [LOCAL ] SPH: Loaded 16976 existing records from primary storage. [2025-10-10T21:37:46.381202] [INFO ] [MAIN ] SPH: Loaded 16976 existing records. [2025-10-10T21:37:46.555746] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:37:46.556000] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-10T21:37:46.556048] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-10T21:37:46.556240] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-10T21:37:46.556295] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-10T21:37:46.696160] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-10T21:37:46.910741] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:37:47.453597] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-10T21:37:47.489332] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-10T21:37:47.815186] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-10T21:37:48.289438] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-10T21:37:48.922611] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-10T21:37:49.089466] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-10T21:37:49.258995] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T21:37:49.889440] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-10-10T21:37:50.315038] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T21:37:50.689371] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-10T21:37:50.814684] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T21:37:50.841025] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-10T21:37:51.489425] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-10T21:37:52.289423] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-10T21:37:52.699735] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-10T21:37:52.831291] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T21:37:53.089396] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-10T21:37:53.889459] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-10T21:37:54.370199] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-10T21:37:54.689380] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-10T21:37:55.105163] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-10T21:37:55.163935] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-10T21:37:55.489407] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-10T21:37:56.289439] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-10T21:37:56.566585] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T21:37:57.089344] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-10T21:37:57.317368] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T21:37:57.889363] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-10T21:37:58.144293] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-10T21:37:58.149252] [INFO ] [REMOTE ] SPCE: Full fetch complete (72432 records). [2025-10-10T21:37:58.149374] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-10T21:37:58.530077] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-10T21:37:58.530173] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-10T21:37:58.531286] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-10T21:37:58.531351] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-10T21:37:58.533537] [DEBUG] [LOCAL ] SPCE: Trimmed 72432 records to 50706 (keeping 200 days of data) [2025-10-10T21:37:58.693185] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-10T21:37:58.825597] [DEBUG] [LOCAL ] SPCE: Primary data saved (50706 records). [2025-10-10T21:37:58.825767] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-10T21:37:58.825857] [INFO ] [MAIN ] Update Progress: 1974/2373 symbols completed. SPCE took 40.1s. Estimated remaining: 56m 10s. Rate: 7.1 symbols/min [2025-10-10T21:37:58.994702] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:37:59.032794] [DEBUG] [LOCAL ] SPHR: Loaded 40671 existing records from primary storage. [2025-10-10T21:37:59.033129] [INFO ] [MAIN ] SPHR: Loaded 40671 existing records. [2025-10-10T21:37:59.211219] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:37:59.211526] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-10T21:37:59.211601] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-10T21:37:59.212056] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-10T21:37:59.212138] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-10T21:37:59.514470] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-10T21:37:59.561568] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-10T21:37:59.635382] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:37:59.968887] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-10T21:38:00.027506] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-10T21:38:00.289398] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-10-10T21:38:01.089399] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-10T21:38:01.183197] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-10T21:38:01.276730] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-10T21:38:01.889391] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-10T21:38:02.643495] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T21:38:02.689369] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-10T21:38:03.109470] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-10T21:38:03.489378] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-10T21:38:04.134415] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-10T21:38:04.289365] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-10T21:38:04.589629] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T21:38:05.089346] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-10T21:38:05.519093] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T21:38:05.889379] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-10T21:38:06.689358] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-10T21:38:06.856203] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T21:38:07.224570] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-10T21:38:07.489343] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-10T21:38:07.923586] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-10T21:38:08.289408] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-10T21:38:08.978074] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T21:38:09.089414] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-10T21:38:09.605633] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-10T21:38:09.889410] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-10T21:38:10.575981] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-10T21:38:10.625048] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T21:38:10.630382] [INFO ] [REMOTE ] SPG: Full fetch complete (71937 records). [2025-10-10T21:38:10.630534] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-10T21:38:10.694452] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-10T21:38:11.038142] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-10T21:38:11.038253] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-10T21:38:11.039710] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-10T21:38:11.039782] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-10T21:38:11.041812] [DEBUG] [LOCAL ] SPG: Trimmed 71937 records to 50962 (keeping 200 days of data) [2025-10-10T21:38:11.409332] [DEBUG] [LOCAL ] SPG: Primary data saved (50962 records). [2025-10-10T21:38:11.409535] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-10T21:38:11.409673] [INFO ] [MAIN ] Update Progress: 1975/2373 symbols completed. SPG took 35.3s. Estimated remaining: 56m 3s. Rate: 7.1 symbols/min [2025-10-10T21:38:11.494571] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-10T21:38:11.591196] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:38:11.631583] [DEBUG] [LOCAL ] SPIR: Loaded 37664 existing records from primary storage. [2025-10-10T21:38:11.631988] [INFO ] [MAIN ] SPIR: Loaded 37664 existing records. [2025-10-10T21:38:11.826105] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:38:11.831840] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-10T21:38:11.836328] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-10T21:38:11.837677] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-10T21:38:11.837575] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-10T21:38:11.837827] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-10T21:38:12.223984] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:38:12.289460] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-10-10T21:38:13.089358] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-10T21:38:13.335195] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-10T21:38:13.395569] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-10T21:38:13.889374] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-10T21:38:14.689448] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-10T21:38:15.071949] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T21:38:15.489408] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-10T21:38:15.545228] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T21:38:15.547465] [INFO ] [REMOTE ] SPH: Full fetch complete (27991 records). [2025-10-10T21:38:15.547571] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-10T21:38:15.794674] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T21:38:16.004238] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-10T21:38:16.004343] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-10T21:38:16.005527] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-10T21:38:16.005597] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-10T21:38:16.006635] [DEBUG] [LOCAL ] SPH: Trimmed 27991 records to 17100 (keeping 200 days of data) [2025-10-10T21:38:16.126932] [DEBUG] [LOCAL ] SPH: Primary data saved (17100 records). [2025-10-10T21:38:16.127230] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-10T21:38:16.127376] [INFO ] [MAIN ] Update Progress: 1976/2373 symbols completed. SPH took 29.9s. Estimated remaining: 55m 54s. Rate: 7.1 symbols/min [2025-10-10T21:38:16.302493] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-10T21:38:16.305879] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:38:16.315515] [DEBUG] [LOCAL ] SPMC: Loaded 5366 existing records from primary storage. [2025-10-10T21:38:16.315812] [INFO ] [MAIN ] SPMC: Loaded 5366 existing records. [2025-10-10T21:38:16.490340] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:38:16.490623] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-10T21:38:16.490707] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-10T21:38:16.490894] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-10T21:38:16.490952] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-10T21:38:16.863744] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:38:17.089571] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-10T21:38:17.089500] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T21:38:17.889400] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-10-10T21:38:17.962481] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-10T21:38:18.556514] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-10T21:38:18.572460] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-10T21:38:18.689429] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-10T21:38:19.489406] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-10T21:38:20.015283] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-10T21:38:20.251924] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-10T21:38:20.289413] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-10T21:38:21.089418] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-10T21:38:21.230883] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-10T21:38:21.889422] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-10T21:38:22.689431] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-10T21:38:22.795924] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-10T21:38:22.876521] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T21:38:23.489438] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-10T21:38:23.874172] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-10T21:38:24.289393] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-10T21:38:24.354589] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T21:38:25.089398] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-10T21:38:25.889361] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-10T21:38:26.348948] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-10T21:38:26.581054] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-10T21:38:26.689385] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-10T21:38:27.272704] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T21:38:27.432627] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T21:38:27.438137] [INFO ] [REMOTE ] SPGI: Full fetch complete (67200 records). [2025-10-10T21:38:27.438313] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-10T21:38:27.494743] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-10T21:38:27.839972] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-10T21:38:27.840059] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-10T21:38:27.841083] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-10T21:38:27.841145] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-10T21:38:27.842411] [DEBUG] [LOCAL ] SPGI: Trimmed 67200 records to 46517 (keeping 200 days of data) [2025-10-10T21:38:28.138780] [DEBUG] [LOCAL ] SPGI: Primary data saved (46517 records). [2025-10-10T21:38:28.138963] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-10T21:38:28.139795] [INFO ] [MAIN ] Update Progress: 1977/2373 symbols completed. SPGI took 44.4s. Estimated remaining: 55m 46s. Rate: 7.1 symbols/min [2025-10-10T21:38:28.294524] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-10T21:38:28.368776] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:38:28.374253] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-10T21:38:28.374129] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-10T21:38:28.374413] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-10T21:38:28.376600] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-10T21:38:28.376669] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-10T21:38:28.376740] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-10T21:38:28.376776] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-10T21:38:28.792037] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:38:29.089471] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-10T21:38:29.889490] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-10-10T21:38:30.086930] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T21:38:30.117794] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:38:30.118240] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-10-10T21:38:30.118339] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:38:30.118387] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-10T21:38:30.118448] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:38:30.118523] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-10T21:38:30.118595] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-10T21:38:30.118631] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-10T21:38:30.118728] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-10T21:38:30.118790] [INFO ] [MAIN ] Update Progress: 1978/2373 symbols completed. SPME took 2.0s. Estimated remaining: 55m 36s. Rate: 7.1 symbols/min [2025-10-10T21:38:30.304319] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:38:30.342027] [DEBUG] [LOCAL ] SPNT: Loaded 34903 existing records from primary storage. [2025-10-10T21:38:30.354057] [INFO ] [MAIN ] SPNT: Loaded 34903 existing records. [2025-10-10T21:38:30.419455] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T21:38:30.451502] [INFO ] [REMOTE ] SPHR: Full fetch complete (58164 records). [2025-10-10T21:38:30.461992] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-10T21:38:30.649477] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:38:30.664875] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-10T21:38:30.665036] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-10T21:38:30.665593] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-10T21:38:30.676304] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-10T21:38:30.697011] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-10T21:38:31.249255] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-10T21:38:31.260361] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-10T21:38:31.266600] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-10T21:38:31.276947] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-10T21:38:31.314069] [DEBUG] [LOCAL ] SPHR: Trimmed 58164 records to 41016 (keeping 200 days of data) [2025-10-10T21:38:31.416231] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:38:31.532622] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-10T21:38:31.609584] [DEBUG] [LOCAL ] SPHR: Primary data saved (41016 records). [2025-10-10T21:38:31.609761] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-10T21:38:31.609856] [INFO ] [MAIN ] Update Progress: 1979/2373 symbols completed. SPHR took 32.8s. Estimated remaining: 55m 26s. Rate: 7.1 symbols/min [2025-10-10T21:38:31.781626] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:38:31.789813] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T21:38:31.839051] [DEBUG] [LOCAL ] SPOT: Loaded 50814 existing records from primary storage. [2025-10-10T21:38:31.839394] [INFO ] [MAIN ] SPOT: Loaded 50814 existing records. [2025-10-10T21:38:32.039095] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:38:32.039329] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-10T21:38:32.039378] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-10T21:38:32.039622] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-10-10T21:38:32.039711] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-10T21:38:32.298152] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-10T21:38:32.420677] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:38:33.036259] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-10T21:38:33.089340] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-10-10T21:38:33.235769] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T21:38:33.889386] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-10T21:38:34.627455] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-10T21:38:34.689332] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-10T21:38:35.066017] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-10T21:38:35.094802] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T21:38:35.489382] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-10T21:38:36.058413] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-10T21:38:36.059548] [INFO ] [REMOTE ] SPMC: Full fetch complete (8098 records). [2025-10-10T21:38:36.059637] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-10T21:38:36.294464] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-10-10T21:38:36.470592] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-10T21:38:36.470722] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-10T21:38:36.470983] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-10T21:38:36.471024] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-10T21:38:36.471496] [DEBUG] [LOCAL ] SPMC: Trimmed 8098 records to 5393 (keeping 200 days of data) [2025-10-10T21:38:36.506546] [DEBUG] [LOCAL ] SPMC: Primary data saved (5393 records). [2025-10-10T21:38:36.506698] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-10T21:38:36.506793] [INFO ] [MAIN ] Update Progress: 1980/2373 symbols completed. SPMC took 20.4s. Estimated remaining: 55m 17s. Rate: 7.1 symbols/min [2025-10-10T21:38:36.696926] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:38:36.737635] [DEBUG] [LOCAL ] SPR: Loaded 41394 existing records from primary storage. [2025-10-10T21:38:36.738036] [INFO ] [MAIN ] SPR: Loaded 41394 existing records. [2025-10-10T21:38:36.950518] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:38:36.950784] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-10T21:38:36.950847] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-10T21:38:36.951077] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-10T21:38:36.951134] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-10T21:38:37.094449] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-10T21:38:37.336877] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:38:37.858515] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-10T21:38:37.889376] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-10-10T21:38:38.689373] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-10T21:38:39.172612] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-10T21:38:39.489466] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-10T21:38:39.653046] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T21:38:40.132325] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T21:38:40.289382] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-10T21:38:41.089386] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-10T21:38:41.733514] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-10T21:38:41.864389] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T21:38:41.889384] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-10T21:38:42.689404] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-10T21:38:42.775448] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T21:38:43.489486] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-10T21:38:43.825407] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-10T21:38:44.288585] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T21:38:44.296054] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-10T21:38:45.089345] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-10T21:38:45.154328] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-10T21:38:45.889398] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-10T21:38:45.925789] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T21:38:46.689430] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-10T21:38:47.489376] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-10T21:38:47.605874] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-10T21:38:47.640229] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T21:38:48.289413] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-10T21:38:48.465399] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T21:38:49.089393] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-10T21:38:49.357779] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T21:38:49.475730] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-10T21:38:49.889388] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-10T21:38:50.689369] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-10T21:38:51.489427] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-10T21:38:51.717342] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T21:38:51.773664] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-10T21:38:51.862047] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-10T21:38:52.289379] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-10T21:38:53.013622] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T21:38:53.089380] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-10T21:38:53.889375] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-10T21:38:54.689413] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-10T21:38:54.731292] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-10T21:38:54.768126] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T21:38:54.991669] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-10T21:38:54.996073] [INFO ] [REMOTE ] SPIR: Full fetch complete (53493 records). [2025-10-10T21:38:54.996174] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-10T21:38:55.404249] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-10T21:38:55.404358] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-10T21:38:55.405364] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-10T21:38:55.405450] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-10T21:38:55.406585] [DEBUG] [LOCAL ] SPIR: Trimmed 53493 records to 37959 (keeping 200 days of data) [2025-10-10T21:38:55.489856] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-10T21:38:55.626032] [DEBUG] [LOCAL ] SPIR: Primary data saved (37959 records). [2025-10-10T21:38:55.626177] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-10T21:38:55.626269] [INFO ] [MAIN ] Update Progress: 1981/2373 symbols completed. SPIR took 44.2s. Estimated remaining: 55m 11s. Rate: 7.1 symbols/min [2025-10-10T21:38:55.791716] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:38:55.803476] [DEBUG] [LOCAL ] SPRU: Loaded 9627 existing records from primary storage. [2025-10-10T21:38:55.803773] [INFO ] [MAIN ] SPRU: Loaded 9627 existing records. [2025-10-10T21:38:55.989949] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:38:55.990269] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-10T21:38:55.990326] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-10T21:38:55.990569] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-10T21:38:55.990626] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-10T21:38:56.292740] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-10T21:38:56.348752] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:38:56.541842] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T21:38:56.648721] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-10T21:38:57.089406] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-10T21:38:57.889397] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-10-10T21:38:58.611584] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-10T21:38:58.698119] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-10T21:38:58.716023] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T21:38:58.767185] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-10T21:38:59.489422] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-10T21:39:00.289405] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-10T21:39:00.336179] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-10T21:39:01.089433] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-10T21:39:01.406363] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-10T21:39:01.683448] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-10T21:39:01.889392] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-10T21:39:01.930184] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T21:39:02.689374] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-10T21:39:03.489367] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-10T21:39:03.820633] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T21:39:03.913085] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T21:39:04.253083] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-10T21:39:04.289348] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-10T21:39:05.089349] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-10T21:39:05.158877] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T21:39:05.889377] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-10T21:39:06.304475] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T21:39:06.689393] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-10T21:39:07.489439] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-10T21:39:07.709260] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T21:39:07.858433] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-10T21:39:08.289368] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-10T21:39:08.786964] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-10T21:39:08.790163] [INFO ] [REMOTE ] SPNT: Full fetch complete (48717 records). [2025-10-10T21:39:08.790242] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-10T21:39:09.094578] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-10T21:39:09.162976] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-10T21:39:09.163078] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-10T21:39:09.163974] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-10T21:39:09.164038] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-10T21:39:09.165046] [DEBUG] [LOCAL ] SPNT: Trimmed 48717 records to 35122 (keeping 200 days of data) [2025-10-10T21:39:09.371423] [DEBUG] [LOCAL ] SPNT: Primary data saved (35122 records). [2025-10-10T21:39:09.371567] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-10T21:39:09.371692] [INFO ] [MAIN ] Update Progress: 1982/2373 symbols completed. SPNT took 39.3s. Estimated remaining: 55m 3s. Rate: 7.1 symbols/min [2025-10-10T21:39:09.549357] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:39:09.575198] [DEBUG] [LOCAL ] SPXC: Loaded 23389 existing records from primary storage. [2025-10-10T21:39:09.575451] [INFO ] [MAIN ] SPXC: Loaded 23389 existing records. [2025-10-10T21:39:09.758230] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:39:09.758590] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-10T21:39:09.758671] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-10T21:39:09.759418] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-10T21:39:09.759475] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-10T21:39:09.880914] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-10T21:39:09.890125] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-10T21:39:09.914739] [INFO ] [REMOTE ] SPR: Full fetch complete (60070 records). [2025-10-10T21:39:09.942751] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-10T21:39:10.164992] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-10T21:39:10.348527] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:39:10.571832] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-10T21:39:10.571914] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-10T21:39:10.572910] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-10T21:39:10.572978] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-10T21:39:10.574231] [DEBUG] [LOCAL ] SPR: Trimmed 60070 records to 41702 (keeping 200 days of data) [2025-10-10T21:39:10.691749] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-10T21:39:10.816763] [DEBUG] [LOCAL ] SPR: Primary data saved (41702 records). [2025-10-10T21:39:10.816894] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-10T21:39:10.816974] [INFO ] [MAIN ] Update Progress: 1983/2373 symbols completed. SPR took 34.3s. Estimated remaining: 54m 54s. Rate: 7.1 symbols/min [2025-10-10T21:39:10.989706] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:39:11.001403] [DEBUG] [LOCAL ] SPXX: Loaded 9562 existing records from primary storage. [2025-10-10T21:39:11.001632] [INFO ] [MAIN ] SPXX: Loaded 9562 existing records. [2025-10-10T21:39:11.185769] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:39:11.186000] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-10T21:39:11.186049] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-10T21:39:11.186252] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-10T21:39:11.186309] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-10T21:39:11.501701] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-10-10T21:39:11.541501] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:39:11.575268] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-10T21:39:12.085776] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-10T21:39:12.090577] [INFO ] [REMOTE ] SPOT: Full fetch complete (73661 records). [2025-10-10T21:39:12.090722] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-10T21:39:12.295506] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-10-10T21:39:12.479506] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-10T21:39:12.479582] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-10T21:39:12.480676] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-10T21:39:12.480739] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-10T21:39:12.482350] [DEBUG] [LOCAL ] SPOT: Trimmed 73661 records to 51195 (keeping 200 days of data) [2025-10-10T21:39:12.795427] [DEBUG] [LOCAL ] SPOT: Primary data saved (51195 records). [2025-10-10T21:39:12.795546] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-10T21:39:12.795639] [INFO ] [MAIN ] Update Progress: 1984/2373 symbols completed. SPOT took 41.2s. Estimated remaining: 54m 44s. Rate: 7.1 symbols/min [2025-10-10T21:39:13.006773] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-10T21:39:13.009865] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:39:13.058294] [DEBUG] [LOCAL ] SQM: Loaded 49015 existing records from primary storage. [2025-10-10T21:39:13.058622] [INFO ] [MAIN ] SQM: Loaded 49015 existing records. [2025-10-10T21:39:13.094547] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-10T21:39:13.181310] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-10T21:39:13.242002] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:39:13.242183] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-10T21:39:13.242228] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-10T21:39:13.242438] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-10T21:39:13.242494] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-10T21:39:13.592488] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:39:13.889418] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-10T21:39:14.021121] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-10T21:39:14.647461] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-10T21:39:14.689394] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-10T21:39:15.489431] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-10T21:39:15.606622] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-10T21:39:16.289352] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-10T21:39:16.823689] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T21:39:17.089397] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-10T21:39:17.529210] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-10T21:39:17.889409] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-10T21:39:18.444997] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-10T21:39:18.689395] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-10-10T21:39:18.848157] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-10T21:39:19.489379] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-10T21:39:20.289407] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-10T21:39:20.402398] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T21:39:20.403212] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T21:39:20.415734] [INFO ] [REMOTE ] SPRU: Full fetch complete (11981 records). [2025-10-10T21:39:20.415874] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-10T21:39:20.788610] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-10T21:39:20.788714] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-10T21:39:20.788987] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-10T21:39:20.789027] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-10T21:39:20.789493] [DEBUG] [LOCAL ] SPRU: Trimmed 11981 records to 9717 (keeping 200 days of data) [2025-10-10T21:39:20.843351] [DEBUG] [LOCAL ] SPRU: Primary data saved (9717 records). [2025-10-10T21:39:20.843480] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-10T21:39:20.843575] [INFO ] [MAIN ] Update Progress: 1985/2373 symbols completed. SPRU took 25.2s. Estimated remaining: 54m 35s. Rate: 7.1 symbols/min [2025-10-10T21:39:21.014690] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:39:21.042166] [DEBUG] [LOCAL ] SQNS: Loaded 27209 existing records from primary storage. [2025-10-10T21:39:21.042434] [INFO ] [MAIN ] SQNS: Loaded 27209 existing records. [2025-10-10T21:39:21.097237] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-10T21:39:21.222461] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:39:21.222735] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-10T21:39:21.222792] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-10T21:39:21.223018] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-10T21:39:21.223075] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-10T21:39:21.577086] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:39:21.610683] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T21:39:21.889415] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-10T21:39:22.113940] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-10T21:39:22.689399] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-10-10T21:39:23.489484] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-10T21:39:23.589504] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-10T21:39:23.943300] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-10T21:39:24.289376] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-10T21:39:24.508716] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-10T21:39:25.030755] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-10T21:39:25.089420] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-10T21:39:25.889355] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-10T21:39:26.005924] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-10T21:39:26.689394] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-10T21:39:27.489404] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-10T21:39:27.610842] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T21:39:27.611147] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-10T21:39:28.289402] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-10T21:39:29.030757] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-10T21:39:29.089388] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-10T21:39:29.191009] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T21:39:29.889368] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-10T21:39:30.329039] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-10T21:39:30.689423] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-10T21:39:30.771918] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-10T21:39:31.255914] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-10T21:39:31.489466] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-10T21:39:32.289395] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-10T21:39:32.438921] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-10T21:39:33.089477] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-10T21:39:33.151713] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-10T21:39:33.889388] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-10T21:39:34.029028] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-10T21:39:34.689353] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-10T21:39:35.117433] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-10T21:39:35.489371] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-10T21:39:35.668700] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T21:39:35.670578] [INFO ] [REMOTE ] SPXX: Full fetch complete (13401 records). [2025-10-10T21:39:35.670669] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-10T21:39:36.035008] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-10T21:39:36.035087] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-10T21:39:36.035390] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-10T21:39:36.035431] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-10T21:39:36.035962] [DEBUG] [LOCAL ] SPXX: Trimmed 13401 records to 9640 (keeping 200 days of data) [2025-10-10T21:39:36.095205] [DEBUG] [LOCAL ] SPXX: Primary data saved (9640 records). [2025-10-10T21:39:36.095352] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-10T21:39:36.095435] [INFO ] [MAIN ] Update Progress: 1986/2373 symbols completed. SPXX took 25.3s. Estimated remaining: 54m 28s. Rate: 7.1 symbols/min [2025-10-10T21:39:36.263778] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:39:36.294551] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-10T21:39:36.296925] [DEBUG] [LOCAL ] SR: Loaded 32794 existing records from primary storage. [2025-10-10T21:39:36.297271] [INFO ] [MAIN ] SR: Loaded 32794 existing records. [2025-10-10T21:39:36.470809] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:39:36.471044] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-10T21:39:36.471093] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-10T21:39:36.471273] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-10T21:39:36.471312] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-10T21:39:36.870453] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:39:37.089412] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-10-10T21:39:37.385424] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T21:39:37.402795] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-10T21:39:37.889423] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-10T21:39:38.572869] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T21:39:38.689402] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-10T21:39:39.489348] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-10T21:39:39.860951] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T21:39:40.020492] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-10T21:39:40.289395] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-10T21:39:40.473753] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-10T21:39:41.089399] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-10T21:39:41.889372] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-10T21:39:42.088705] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-10T21:39:42.691075] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-10T21:39:42.694209] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T21:39:42.712863] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-10T21:39:43.489406] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-10T21:39:44.152420] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T21:39:44.289399] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-10T21:39:45.089419] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-10T21:39:45.704418] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-10T21:39:45.889380] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-10T21:39:45.936028] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-10T21:39:46.440036] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T21:39:46.689433] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-10T21:39:47.489406] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-10T21:39:47.677138] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T21:39:48.289420] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-10T21:39:48.430575] [DEBUG] [REMOTE ] SPXC: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-10T21:39:48.438553] [WARN ] [REMOTE ] SPXC: No data returned for month 2025-10 [2025-10-10T21:39:48.438920] [FATAL] [REMOTE ] SPXC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:39:48.439613] [FATAL] [MAIN ] SPXC: Failed to fetch primary data. [2025-10-10T21:39:48.441411] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T21:39:48.441562] [WARN ] [MAIN ] SPXC: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:39:48.449559] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-10T21:39:48.449850] [DEBUG] [LOCAL ] SPXC: No primary data file found to delete. [2025-10-10T21:39:48.450389] [INFO ] [LOCAL ] SPXC: Starting deletion of derivative data. [2025-10-10T21:39:48.450984] [DEBUG] [LOCAL ] SPXC: Deleted derivative data file. [2025-10-10T21:39:48.451093] [INFO ] [MAIN ] Update Progress: 1987/2373 symbols completed. SPXC took 39.1s. Estimated remaining: 54m 21s. Rate: 7.1 symbols/min [2025-10-10T21:39:48.625863] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:39:48.686208] [DEBUG] [LOCAL ] SRE: Loaded 53804 existing records from primary storage. [2025-10-10T21:39:48.686629] [INFO ] [MAIN ] SRE: Loaded 53804 existing records. [2025-10-10T21:39:48.873106] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:39:48.873460] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-10T21:39:48.873516] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-10T21:39:48.873806] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-10T21:39:48.873864] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-10T21:39:49.094586] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-10T21:39:49.252739] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:39:49.313876] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T21:39:49.889416] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-10T21:39:50.689444] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-10-10T21:39:51.066997] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T21:39:51.413574] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-10T21:39:51.489373] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-10T21:39:52.289364] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-10T21:39:52.732948] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-10T21:39:52.811450] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T21:39:52.814820] [INFO ] [REMOTE ] SQNS: Full fetch complete (32868 records). [2025-10-10T21:39:52.814949] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-10T21:39:53.098942] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-10T21:39:53.203685] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-10T21:39:53.203812] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-10T21:39:53.205099] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-10T21:39:53.205363] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-10T21:39:53.206772] [DEBUG] [LOCAL ] SQNS: Trimmed 32868 records to 27421 (keeping 200 days of data) [2025-10-10T21:39:53.331740] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-10T21:39:53.405586] [DEBUG] [LOCAL ] SQNS: Primary data saved (27421 records). [2025-10-10T21:39:53.405808] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-10T21:39:53.405918] [INFO ] [MAIN ] Update Progress: 1988/2373 symbols completed. SQNS took 32.6s. Estimated remaining: 54m 11s. Rate: 7.1 symbols/min [2025-10-10T21:39:53.590089] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:39:53.605115] [DEBUG] [LOCAL ] SREA: Loaded 10293 existing records from primary storage. [2025-10-10T21:39:53.605424] [INFO ] [MAIN ] SREA: Loaded 10293 existing records. [2025-10-10T21:39:53.791792] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:39:53.792081] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-10T21:39:53.792130] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-10T21:39:53.792353] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-10T21:39:53.792410] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-10T21:39:53.892797] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-10T21:39:54.178579] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:39:54.689386] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-10T21:39:54.768995] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T21:39:55.489405] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-10T21:39:55.931887] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T21:39:56.289394] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-10T21:39:56.362469] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T21:39:57.089394] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-10T21:39:57.179449] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T21:39:57.889407] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-10T21:39:58.139500] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T21:39:58.660717] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-10T21:39:58.689351] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-10T21:39:59.233827] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-10T21:39:59.489411] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-10T21:40:00.251611] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-10T21:40:00.289348] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-10T21:40:01.089363] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-10T21:40:01.321336] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-10T21:40:01.327538] [INFO ] [REMOTE ] SQM: Full fetch complete (69222 records). [2025-10-10T21:40:01.327801] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-10T21:40:01.697472] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-10T21:40:01.732627] [INFO ] [REMOTE ] SR: Full fetch complete (46067 records). [2025-10-10T21:40:01.780098] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-10T21:40:01.828613] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-10T21:40:01.888080] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-10T21:40:01.897618] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-10-10T21:40:01.918792] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-10T21:40:01.932108] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-10T21:40:02.022071] [DEBUG] [LOCAL ] SQM: Trimmed 69222 records to 49402 (keeping 200 days of data) [2025-10-10T21:40:02.388834] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-10T21:40:02.392267] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-10T21:40:02.397513] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-10T21:40:02.397678] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-10T21:40:02.448125] [DEBUG] [LOCAL ] SR: Trimmed 46067 records to 33009 (keeping 200 days of data) [2025-10-10T21:40:02.710700] [DEBUG] [LOCAL ] SQM: Primary data saved (49402 records). [2025-10-10T21:40:02.711606] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-10T21:40:02.712032] [INFO ] [MAIN ] Update Progress: 1989/2373 symbols completed. SQM took 49.9s. Estimated remaining: 54m 3s. Rate: 7.1 symbols/min [2025-10-10T21:40:02.915222] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:40:03.030119] [DEBUG] [LOCAL ] SRFM: Loaded 38214 existing records from primary storage. [2025-10-10T21:40:03.032405] [INFO ] [MAIN ] SRFM: Loaded 38214 existing records. [2025-10-10T21:40:03.079597] [DEBUG] [LOCAL ] SR: Primary data saved (33009 records). [2025-10-10T21:40:03.096337] [INFO ] [MAIN ] SR: Full history saved. [2025-10-10T21:40:03.111169] [INFO ] [MAIN ] Update Progress: 1990/2373 symbols completed. SR took 27.0s. Estimated remaining: 53m 53s. Rate: 7.1 symbols/min [2025-10-10T21:40:03.201024] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-10T21:40:03.278404] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-10T21:40:03.369568] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:40:03.390522] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-10T21:40:03.403290] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-10T21:40:03.409568] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-10T21:40:03.433343] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-10T21:40:03.542115] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:40:03.575064] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-10T21:40:03.654013] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-10T21:40:03.828416] [DEBUG] [LOCAL ] SRG: Loaded 15439 existing records from primary storage. [2025-10-10T21:40:03.852808] [INFO ] [MAIN ] SRG: Loaded 15439 existing records. [2025-10-10T21:40:04.041321] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:40:04.126810] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:40:04.127107] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-10T21:40:04.127177] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-10T21:40:04.127354] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-10T21:40:04.127394] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-10T21:40:04.301692] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-10-10T21:40:04.399080] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-10T21:40:04.503334] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:40:05.089418] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-10-10T21:40:05.812173] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-10T21:40:05.889350] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-10T21:40:05.933137] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-10T21:40:06.260531] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-10T21:40:06.689441] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-10T21:40:07.489379] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-10T21:40:08.064486] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-10T21:40:08.207895] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-10T21:40:08.289366] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-10T21:40:08.665004] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-10T21:40:09.089406] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-10T21:40:09.536373] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T21:40:09.889434] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-10T21:40:10.689383] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-10T21:40:11.136958] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-10T21:40:11.335053] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-10T21:40:11.431781] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-10T21:40:11.489376] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-10T21:40:12.289349] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-10T21:40:12.697468] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T21:40:13.039469] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-10T21:40:13.089348] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-10T21:40:13.889370] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-10T21:40:14.389730] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T21:40:14.689328] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-10T21:40:14.800761] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-10T21:40:15.489377] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-10T21:40:16.289397] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-10T21:40:16.486608] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-10T21:40:16.883755] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-10T21:40:17.089393] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-10T21:40:17.778213] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-10T21:40:17.889367] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-10T21:40:18.689393] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-10T21:40:19.489488] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-10T21:40:19.582777] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-10T21:40:19.801348] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-10T21:40:20.016665] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-10T21:40:20.289376] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-10T21:40:20.396674] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-10T21:40:21.089377] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-10T21:40:21.889418] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-10T21:40:22.189910] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T21:40:22.689361] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-10T21:40:22.798554] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-10T21:40:23.145751] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-10T21:40:23.489436] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-10T21:40:23.667001] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T21:40:24.074186] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-10T21:40:24.289374] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-10T21:40:25.089402] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-10T21:40:25.889376] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-10T21:40:26.177003] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-10T21:40:26.544147] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-10T21:40:26.689368] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-10T21:40:27.011972] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-10T21:40:27.489399] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-10T21:40:28.289350] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-10T21:40:28.377500] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-10T21:40:28.830674] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-10T21:40:28.835731] [INFO ] [REMOTE ] SRFM: Full fetch complete (50354 records). [2025-10-10T21:40:28.835818] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-10T21:40:29.095670] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-10T21:40:29.209848] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T21:40:29.231413] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-10T21:40:29.231561] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-10T21:40:29.232844] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-10T21:40:29.233036] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-10T21:40:29.233498] [INFO ] [REMOTE ] SRE: Full fetch complete (77296 records). [2025-10-10T21:40:29.233820] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-10T21:40:29.240316] [DEBUG] [LOCAL ] SRFM: Trimmed 50354 records to 38604 (keeping 200 days of data) [2025-10-10T21:40:29.944316] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-10T21:40:30.080325] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-10T21:40:30.087761] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-10T21:40:30.089525] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-10T21:40:30.090200] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-10T21:40:30.110111] [DEBUG] [LOCAL ] SRE: Trimmed 77296 records to 54194 (keeping 200 days of data) [2025-10-10T21:40:30.126356] [DEBUG] [LOCAL ] SRFM: Primary data saved (38604 records). [2025-10-10T21:40:30.126758] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-10T21:40:30.127163] [INFO ] [MAIN ] Update Progress: 1991/2373 symbols completed. SRFM took 27.4s. Estimated remaining: 53m 48s. Rate: 7.1 symbols/min [2025-10-10T21:40:30.337919] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T21:40:30.501472] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:40:30.553493] [DEBUG] [LOCAL ] SRI: Loaded 26857 existing records from primary storage. [2025-10-10T21:40:30.553949] [INFO ] [MAIN ] SRI: Loaded 26857 existing records. [2025-10-10T21:40:30.701803] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-10T21:40:30.858730] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:40:30.860783] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-10T21:40:30.861833] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-10T21:40:30.863223] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-10T21:40:30.863573] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-10T21:40:30.979182] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-10T21:40:31.312996] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:40:31.330728] [DEBUG] [LOCAL ] SRE: Primary data saved (54194 records). [2025-10-10T21:40:31.330835] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-10T21:40:31.331360] [INFO ] [MAIN ] Update Progress: 1992/2373 symbols completed. SRE took 42.9s. Estimated remaining: 53m 38s. Rate: 7.1 symbols/min [2025-10-10T21:40:31.489891] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-10-10T21:40:31.507881] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:40:31.508704] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-10T21:40:31.508764] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-10T21:40:31.508898] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-10T21:40:31.508952] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-10T21:40:31.509013] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-10T21:40:31.509057] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-10T21:40:31.625808] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T21:40:31.648786] [INFO ] [REMOTE ] SRG: Full fetch complete (23720 records). [2025-10-10T21:40:31.667236] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-10T21:40:32.216952] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:40:32.297495] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-10T21:40:32.299133] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-10T21:40:32.299208] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-10T21:40:32.300494] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-10T21:40:32.300554] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-10T21:40:32.301197] [DEBUG] [LOCAL ] SRG: Trimmed 23720 records to 15543 (keeping 200 days of data) [2025-10-10T21:40:32.387526] [DEBUG] [LOCAL ] SRG: Primary data saved (15543 records). [2025-10-10T21:40:32.387684] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-10T21:40:32.387781] [INFO ] [MAIN ] Update Progress: 1993/2373 symbols completed. SRG took 29.2s. Estimated remaining: 53m 29s. Rate: 7.1 symbols/min [2025-10-10T21:40:32.559131] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:40:32.569294] [DEBUG] [LOCAL ] SRV: Loaded 7411 existing records from primary storage. [2025-10-10T21:40:32.569527] [INFO ] [MAIN ] SRV: Loaded 7411 existing records. [2025-10-10T21:40:32.751799] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:40:32.752099] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-10T21:40:32.752180] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-10T21:40:32.752376] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-10T21:40:32.752433] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-10T21:40:33.091211] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-10-10T21:40:33.151045] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:40:33.153632] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-10T21:40:33.255259] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-10T21:40:33.884744] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-10T21:40:33.889336] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-10T21:40:34.689428] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-10T21:40:34.746460] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-10T21:40:35.255987] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-10T21:40:35.489407] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-10T21:40:36.143710] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-10T21:40:36.144968] [INFO ] [REMOTE ] SREA: Full fetch complete (15308 records). [2025-10-10T21:40:36.145039] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-10T21:40:36.296516] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-10T21:40:36.522317] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-10T21:40:36.522402] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-10T21:40:36.522824] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-10T21:40:36.522887] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-10T21:40:36.523487] [DEBUG] [LOCAL ] SREA: Trimmed 15308 records to 10327 (keeping 200 days of data) [2025-10-10T21:40:36.587986] [DEBUG] [LOCAL ] SREA: Primary data saved (10327 records). [2025-10-10T21:40:36.588134] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-10T21:40:36.588220] [INFO ] [MAIN ] Update Progress: 1994/2373 symbols completed. SREA took 43.2s. Estimated remaining: 53m 19s. Rate: 7.1 symbols/min [2025-10-10T21:40:36.757897] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:40:36.797467] [DEBUG] [LOCAL ] SSB: Loaded 42877 existing records from primary storage. [2025-10-10T21:40:36.797787] [INFO ] [MAIN ] SSB: Loaded 42877 existing records. [2025-10-10T21:40:36.882046] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-10T21:40:36.986257] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:40:36.986546] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-10T21:40:36.986606] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-10T21:40:36.986876] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-10T21:40:36.986943] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-10T21:40:37.094012] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-10-10T21:40:37.387072] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:40:37.889372] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-10T21:40:38.091540] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T21:40:38.294378] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-10T21:40:38.689351] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-10T21:40:39.489370] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-10T21:40:40.074027] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-10T21:40:40.289359] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-10T21:40:40.383852] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T21:40:40.700872] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-10T21:40:41.089369] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-10T21:40:41.889385] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-10T21:40:41.954506] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-10T21:40:42.479458] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-10T21:40:42.689403] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-10T21:40:43.100784] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-10T21:40:43.489437] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-10T21:40:43.899494] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-10T21:40:44.289395] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-10T21:40:45.089395] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-10-10T21:40:45.283934] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-10T21:40:45.889375] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-10T21:40:46.689382] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-10T21:40:46.788427] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T21:40:46.795697] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-10T21:40:47.180593] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-10T21:40:47.489383] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-10T21:40:48.289412] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-10T21:40:48.334137] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-10T21:40:49.089406] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-10T21:40:49.498598] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-10T21:40:49.712293] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-10T21:40:49.889373] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-10T21:40:50.303273] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-10T21:40:50.304041] [INFO ] [REMOTE ] SRL: Full fetch complete (1958 records). [2025-10-10T21:40:50.304107] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-10T21:40:50.487702] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-10T21:40:50.487890] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:40:50.487936] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:40:50.487975] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-10T21:40:50.488085] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-10T21:40:50.488142] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-10T21:40:50.488185] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-10T21:40:50.488243] [INFO ] [MAIN ] Update Progress: 1995/2373 symbols completed. SRL took 19.2s. Estimated remaining: 53m 12s. Rate: 7.1 symbols/min [2025-10-10T21:40:50.662155] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:40:50.685637] [DEBUG] [LOCAL ] SSD: Loaded 22618 existing records from primary storage. [2025-10-10T21:40:50.685912] [INFO ] [MAIN ] SSD: Loaded 22618 existing records. [2025-10-10T21:40:50.696916] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-10T21:40:50.870724] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:40:50.870911] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-10T21:40:50.870958] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-10T21:40:50.871149] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-10T21:40:50.871206] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-10T21:40:51.239809] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:40:51.489392] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-10T21:40:52.294554] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-10-10T21:40:52.313842] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T21:40:52.454708] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-10T21:40:53.089371] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-10T21:40:53.202884] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-10T21:40:53.889391] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-10T21:40:53.966793] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-10T21:40:54.689416] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-10T21:40:55.206802] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T21:40:55.489383] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-10T21:40:55.572254] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-10T21:40:56.289379] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-10T21:40:56.798889] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T21:40:57.089347] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-10T21:40:57.166349] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-10T21:40:57.889352] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-10T21:40:58.376982] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T21:40:58.689415] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-10T21:40:59.343768] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-10T21:40:59.489363] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-10T21:41:00.157566] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-10T21:41:00.289340] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-10T21:41:01.035470] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T21:41:01.046811] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-10T21:41:01.089330] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-10T21:41:01.697217] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-10T21:41:01.698878] [INFO ] [REMOTE ] SRV: Full fetch complete (11393 records). [2025-10-10T21:41:01.698971] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-10T21:41:01.899104] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-10T21:41:02.114960] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-10T21:41:02.115059] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-10T21:41:02.115378] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-10T21:41:02.115472] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-10T21:41:02.116142] [DEBUG] [LOCAL ] SRV: Trimmed 11393 records to 7459 (keeping 200 days of data) [2025-10-10T21:41:02.164509] [DEBUG] [LOCAL ] SRV: Primary data saved (7459 records). [2025-10-10T21:41:02.164678] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-10T21:41:02.164782] [INFO ] [MAIN ] Update Progress: 1996/2373 symbols completed. SRV took 29.8s. Estimated remaining: 53m 4s. Rate: 7.1 symbols/min [2025-10-10T21:41:02.334319] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:41:02.372151] [DEBUG] [LOCAL ] SSL: Loaded 41671 existing records from primary storage. [2025-10-10T21:41:02.372450] [INFO ] [MAIN ] SSL: Loaded 41671 existing records. [2025-10-10T21:41:02.545745] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:41:02.545988] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-10T21:41:02.546036] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-10T21:41:02.546295] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-10T21:41:02.546355] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-10T21:41:02.703047] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-10T21:41:02.922070] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:41:03.489420] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-10T21:41:03.866511] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T21:41:04.289366] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-10T21:41:04.365356] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T21:41:04.825764] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T21:41:05.089381] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-10T21:41:05.889387] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-10T21:41:05.914996] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T21:41:06.005000] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-10T21:41:06.689394] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-10T21:41:07.164568] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-10T21:41:07.489346] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-10T21:41:08.041128] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T21:41:08.206276] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-10T21:41:08.289337] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-10T21:41:09.089383] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-10T21:41:09.399446] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-10T21:41:09.402089] [INFO ] [REMOTE ] SRI: Full fetch complete (40567 records). [2025-10-10T21:41:09.402398] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-10T21:41:09.796885] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-10T21:41:09.797111] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-10T21:41:09.798618] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-10T21:41:09.798712] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-10T21:41:09.800139] [DEBUG] [LOCAL ] SRI: Trimmed 40567 records to 26976 (keeping 200 days of data) [2025-10-10T21:41:09.889564] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-10T21:41:09.974241] [DEBUG] [LOCAL ] SRI: Primary data saved (26976 records). [2025-10-10T21:41:09.974436] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-10T21:41:09.974555] [INFO ] [MAIN ] Update Progress: 1997/2373 symbols completed. SRI took 39.8s. Estimated remaining: 52m 56s. Rate: 7.1 symbols/min [2025-10-10T21:41:10.689360] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-10-10T21:41:10.849553] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T21:41:11.192462] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T21:41:11.489400] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-10T21:41:12.289433] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-10T21:41:12.447703] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T21:41:12.797171] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T21:41:13.089366] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-10T21:41:13.889383] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-10T21:41:14.091530] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T21:41:14.159928] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-10T21:41:14.162880] [INFO ] [REMOTE ] SSD: Full fetch complete (32243 records). [2025-10-10T21:41:14.162985] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-10T21:41:14.579720] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-10T21:41:14.579839] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-10T21:41:14.581284] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-10T21:41:14.581376] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-10T21:41:14.582867] [DEBUG] [LOCAL ] SSD: Trimmed 32243 records to 22766 (keeping 200 days of data) [2025-10-10T21:41:14.689733] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-10T21:41:14.743431] [DEBUG] [LOCAL ] SSD: Primary data saved (22766 records). [2025-10-10T21:41:14.743624] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-10T21:41:14.743795] [INFO ] [MAIN ] Update Progress: 1998/2373 symbols completed. SSD took 24.3s. Estimated remaining: 52m 46s. Rate: 7.1 symbols/min [2025-10-10T21:41:15.731004] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T21:41:15.741461] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-10T21:41:16.593780] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T21:41:16.603279] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-10T21:41:17.448425] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T21:41:17.456551] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-10T21:41:17.781717] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T21:41:17.889376] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-10T21:41:19.153618] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-10T21:41:19.162216] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-10T21:41:19.698296] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T21:41:19.708517] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-10T21:41:20.594422] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-10T21:41:20.604118] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-10T21:41:21.526500] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T21:41:21.538539] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-10T21:41:22.371171] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-10T21:41:22.384602] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-10T21:41:23.237240] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-10T21:41:23.247906] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-10T21:41:24.139430] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T21:41:24.148812] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-10T21:41:24.217622] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-10T21:41:24.222019] [INFO ] [REMOTE ] SSB: Full fetch complete (61325 records). [2025-10-10T21:41:24.222160] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-10T21:41:24.630472] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-10T21:41:24.630682] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-10T21:41:24.632169] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-10T21:41:24.632238] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-10T21:41:24.634023] [DEBUG] [LOCAL ] SSB: Trimmed 61325 records to 43219 (keeping 200 days of data) [2025-10-10T21:41:24.924259] [DEBUG] [LOCAL ] SSB: Primary data saved (43219 records). [2025-10-10T21:41:24.924498] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-10T21:41:24.924670] [INFO ] [MAIN ] Update Progress: 1999/2373 symbols completed. SSB took 48.3s. Estimated remaining: 52m 38s. Rate: 7.1 symbols/min [2025-10-10T21:41:25.422431] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-10T21:41:25.433311] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-10T21:41:27.228920] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T21:41:27.239131] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-10T21:41:28.987399] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T21:41:28.997129] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-10T21:41:30.578488] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T21:41:30.583520] [INFO ] [REMOTE ] SSL: Full fetch complete (59980 records). [2025-10-10T21:41:30.583667] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-10T21:41:30.967946] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-10T21:41:30.968066] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-10T21:41:30.969092] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-10T21:41:30.969157] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-10T21:41:30.970377] [DEBUG] [LOCAL ] SSL: Trimmed 59980 records to 41966 (keeping 200 days of data) [2025-10-10T21:41:31.210074] [DEBUG] [LOCAL ] SSL: Primary data saved (41966 records). [2025-10-10T21:41:31.210208] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-10T21:41:31.210289] [INFO ] [MAIN ] Update Progress: 2000/2373 symbols completed. SSL took 29.0s. Estimated remaining: 52m 29s. Rate: 7.1 symbols/min [2025-10-10T21:41:31.860003] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:41:31.874820] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:41:31.965232] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:41:31.993472] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:41:32.006228] [DEBUG] [LOCAL ] SST: Loaded 11781 existing records from primary storage. [2025-10-10T21:41:32.006639] [INFO ] [MAIN ] SST: Loaded 11781 existing records. [2025-10-10T21:41:32.223611] [DEBUG] [LOCAL ] SSTK: Loaded 25722 existing records from primary storage. [2025-10-10T21:41:32.256625] [INFO ] [MAIN ] SSTK: Loaded 25722 existing records. [2025-10-10T21:41:32.289954] [DEBUG] [LOCAL ] STAG: Loaded 50435 existing records from primary storage. [2025-10-10T21:41:32.288876] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:41:32.290857] [DEBUG] [LOCAL ] ST: Loaded 50184 existing records from primary storage. [2025-10-10T21:41:32.302537] [INFO ] [MAIN ] STAG: Loaded 50435 existing records. [2025-10-10T21:41:32.291224] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-10T21:41:32.325770] [INFO ] [MAIN ] ST: Loaded 50184 existing records. [2025-10-10T21:41:32.325938] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-10T21:41:32.421733] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-10T21:41:32.538376] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-10T21:41:32.816292] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:41:32.861351] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-10T21:41:32.893171] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-10T21:41:32.909806] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-10T21:41:32.904362] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:41:32.944079] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-10T21:41:32.938761] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-10T21:41:33.136762] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-10T21:41:33.174813] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:41:33.227613] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-10T21:41:33.242241] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-10T21:41:33.264460] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-10T21:41:33.329782] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-10T21:41:33.350813] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-10T21:41:33.350931] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-10T21:41:33.621845] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:41:33.708577] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-10-10T21:41:34.227102] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:41:34.251358] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-10-10T21:41:34.397872] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:41:34.421357] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-10-10T21:41:34.463519] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:41:34.464220] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-10-10T21:41:34.812170] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-10T21:41:34.815293] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-10T21:41:35.789978] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T21:41:35.796795] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-10T21:41:35.927153] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-10T21:41:35.938200] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-10T21:41:36.024317] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T21:41:36.034281] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-10T21:41:36.067331] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T21:41:36.071944] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-10T21:41:37.055255] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T21:41:37.058510] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-10T21:41:37.395545] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T21:41:37.405718] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-10T21:41:37.433780] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T21:41:37.443057] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-10T21:41:37.660980] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-10T21:41:37.664767] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-10T21:41:37.704724] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-10T21:41:37.714567] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-10T21:41:38.630821] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-10T21:41:38.638449] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-10T21:41:38.647134] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-10T21:41:38.689403] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-10T21:41:39.345277] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-10T21:41:39.489387] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-10T21:41:39.552322] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-10T21:41:39.664286] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T21:41:39.731908] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-10T21:41:40.289382] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-10T21:41:41.089426] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-10T21:41:41.482189] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T21:41:41.581749] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-10T21:41:41.889368] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-10T21:41:42.689374] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-10T21:41:42.907874] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-10T21:41:43.099534] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-10T21:41:43.489371] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-10T21:41:44.223526] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T21:41:44.289351] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-10T21:41:44.451777] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-10T21:41:45.089391] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-10T21:41:45.889362] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-10T21:41:46.304431] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T21:41:46.654867] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-10T21:41:46.689353] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-10T21:41:46.827873] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T21:41:47.489423] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-10T21:41:48.289391] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-10T21:41:48.717403] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-10T21:41:48.810796] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-10T21:41:48.812173] [INFO ] [REMOTE ] SST: Full fetch complete (18554 records). [2025-10-10T21:41:48.812296] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-10T21:41:48.872577] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-10T21:41:49.094549] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-10T21:41:49.209256] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-10T21:41:49.209333] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-10T21:41:49.209880] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-10T21:41:49.209941] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-10T21:41:49.210508] [DEBUG] [LOCAL ] SST: Trimmed 18554 records to 11805 (keeping 200 days of data) [2025-10-10T21:41:49.279991] [DEBUG] [LOCAL ] SST: Primary data saved (11805 records). [2025-10-10T21:41:49.280143] [INFO ] [MAIN ] SST: Full history saved. [2025-10-10T21:41:49.280254] [INFO ] [MAIN ] Update Progress: 2001/2373 symbols completed. SST took 18.1s. Estimated remaining: 52m 23s. Rate: 7.1 symbols/min [2025-10-10T21:41:49.445558] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:41:49.463152] [DEBUG] [LOCAL ] STC: Loaded 17464 existing records from primary storage. [2025-10-10T21:41:49.463385] [INFO ] [MAIN ] STC: Loaded 17464 existing records. [2025-10-10T21:41:49.637522] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:41:49.637815] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-10T21:41:49.637875] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-10T21:41:49.638050] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-10T21:41:49.638107] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-10T21:41:49.897923] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-10T21:41:49.995744] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:41:50.689405] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-10-10T21:41:51.111754] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T21:41:51.300526] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-10T21:41:51.489363] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-10T21:41:51.927590] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-10T21:41:52.289382] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-10T21:41:53.089418] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-10T21:41:53.236247] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T21:41:53.585508] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-10T21:41:53.889368] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-10T21:41:54.689382] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-10T21:41:55.082448] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T21:41:55.259506] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-10T21:41:55.489382] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-10T21:41:56.289382] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-10T21:41:56.340668] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T21:41:56.367441] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-10T21:41:57.089413] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-10T21:41:57.493566] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-10T21:41:57.889399] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-10T21:41:58.279480] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T21:41:58.689391] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-10T21:41:59.489361] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-10T21:41:59.821704] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T21:41:59.967761] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T21:42:00.121221] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-10T21:42:00.289350] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-10T21:42:01.089372] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-10T21:42:01.525082] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-10T21:42:01.889404] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-10T21:42:02.689428] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-10T21:42:03.023937] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T21:42:03.241505] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T21:42:03.292314] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-10T21:42:03.294898] [INFO ] [REMOTE ] SSTK: Full fetch complete (41562 records). [2025-10-10T21:42:03.294990] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-10T21:42:03.497058] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-10T21:42:03.662132] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-10T21:42:03.662256] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-10T21:42:03.663131] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-10T21:42:03.663194] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-10T21:42:03.664073] [DEBUG] [LOCAL ] SSTK: Trimmed 41562 records to 25879 (keeping 200 days of data) [2025-10-10T21:42:03.823915] [DEBUG] [LOCAL ] SSTK: Primary data saved (25879 records). [2025-10-10T21:42:03.824059] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-10T21:42:03.824155] [INFO ] [MAIN ] Update Progress: 2002/2373 symbols completed. SSTK took 32.6s. Estimated remaining: 52m 15s. Rate: 7.1 symbols/min [2025-10-10T21:42:03.987080] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:42:04.021783] [DEBUG] [LOCAL ] STE: Loaded 35659 existing records from primary storage. [2025-10-10T21:42:04.022058] [INFO ] [MAIN ] STE: Loaded 35659 existing records. [2025-10-10T21:42:04.192383] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:42:04.192548] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-10T21:42:04.192594] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-10T21:42:04.192824] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-10-10T21:42:04.192880] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-10T21:42:04.289453] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-10T21:42:04.542588] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:42:05.089429] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-10T21:42:05.410491] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-10T21:42:05.484970] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T21:42:05.489958] [INFO ] [REMOTE ] ST: Full fetch complete (71954 records). [2025-10-10T21:42:05.490108] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-10T21:42:05.878055] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-10T21:42:05.878155] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-10T21:42:05.879528] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-10T21:42:05.879596] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-10T21:42:05.881177] [DEBUG] [LOCAL ] ST: Trimmed 71954 records to 50558 (keeping 200 days of data) [2025-10-10T21:42:05.933320] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-10T21:42:06.189219] [DEBUG] [LOCAL ] ST: Primary data saved (50558 records). [2025-10-10T21:42:06.189352] [INFO ] [MAIN ] ST: Full history saved. [2025-10-10T21:42:06.189431] [INFO ] [MAIN ] Update Progress: 2003/2373 symbols completed. ST took 34.9s. Estimated remaining: 52m 6s. Rate: 7.1 symbols/min [2025-10-10T21:42:06.322297] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-10T21:42:06.382195] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:42:06.404602] [DEBUG] [LOCAL ] STEL: Loaded 22955 existing records from primary storage. [2025-10-10T21:42:06.404874] [INFO ] [MAIN ] STEL: Loaded 22955 existing records. [2025-10-10T21:42:06.575678] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:42:06.575870] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-10T21:42:06.575916] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-10T21:42:06.576104] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-10T21:42:06.576159] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-10T21:42:06.694588] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-10T21:42:06.921830] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:42:07.385866] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T21:42:07.390832] [INFO ] [REMOTE ] STAG: Full fetch complete (72210 records). [2025-10-10T21:42:07.390955] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-10T21:42:07.490787] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-10-10T21:42:07.790998] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-10T21:42:07.791095] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-10T21:42:07.792501] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-10T21:42:07.792568] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-10T21:42:07.793997] [DEBUG] [LOCAL ] STAG: Trimmed 72210 records to 50819 (keeping 200 days of data) [2025-10-10T21:42:08.017985] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-10T21:42:08.123187] [DEBUG] [LOCAL ] STAG: Primary data saved (50819 records). [2025-10-10T21:42:08.123331] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-10T21:42:08.123417] [INFO ] [MAIN ] Update Progress: 2004/2373 symbols completed. STAG took 36.9s. Estimated remaining: 51m 56s. Rate: 7.1 symbols/min [2025-10-10T21:42:08.289754] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:42:08.289827] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-10-10T21:42:08.326986] [DEBUG] [LOCAL ] STEM: Loaded 39229 existing records from primary storage. [2025-10-10T21:42:08.327293] [INFO ] [MAIN ] STEM: Loaded 39229 existing records. [2025-10-10T21:42:08.506634] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:42:08.506936] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-10T21:42:08.506994] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-10T21:42:08.507240] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-10T21:42:08.507295] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-10T21:42:08.867177] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:42:09.089370] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-10T21:42:09.153114] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-10T21:42:09.429912] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-10T21:42:09.889387] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-10-10T21:42:09.928120] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-10T21:42:10.689373] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-10T21:42:11.489399] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-10T21:42:11.832874] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-10T21:42:12.128764] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-10T21:42:12.141263] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-10T21:42:12.289369] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-10T21:42:13.089375] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-10T21:42:13.889418] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-10T21:42:14.246416] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-10T21:42:14.636550] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-10T21:42:14.689470] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-10T21:42:15.389817] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-10T21:42:15.489396] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-10T21:42:15.666354] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T21:42:15.668332] [INFO ] [REMOTE ] STC: Full fetch complete (25616 records). [2025-10-10T21:42:15.668418] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-10T21:42:16.056381] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-10T21:42:16.056488] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-10T21:42:16.057666] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-10T21:42:16.057735] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-10T21:42:16.058736] [DEBUG] [LOCAL ] STC: Trimmed 25616 records to 17551 (keeping 200 days of data) [2025-10-10T21:42:16.178777] [DEBUG] [LOCAL ] STC: Primary data saved (17551 records). [2025-10-10T21:42:16.179028] [INFO ] [MAIN ] STC: Full history saved. [2025-10-10T21:42:16.179146] [INFO ] [MAIN ] Update Progress: 2005/2373 symbols completed. STC took 26.9s. Estimated remaining: 51m 48s. Rate: 7.1 symbols/min [2025-10-10T21:42:16.294615] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-10T21:42:16.358943] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:42:16.379319] [DEBUG] [LOCAL ] STEW: Loaded 16229 existing records from primary storage. [2025-10-10T21:42:16.379639] [INFO ] [MAIN ] STEW: Loaded 16229 existing records. [2025-10-10T21:42:16.569953] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:42:16.570277] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-10T21:42:16.570331] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-10T21:42:16.570539] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-10T21:42:16.570581] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-10T21:42:16.939430] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:42:17.089440] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-10-10T21:42:17.223314] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T21:42:17.889361] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-10T21:42:18.221522] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T21:42:18.385790] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-10T21:42:18.689367] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-10T21:42:19.102636] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-10T21:42:19.489352] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-10T21:42:19.928343] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T21:42:20.289375] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-10T21:42:21.089400] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-10T21:42:21.540058] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T21:42:21.889357] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-10T21:42:22.035224] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T21:42:22.511137] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-10T21:42:22.689416] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-10T21:42:23.489352] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-10T21:42:23.701163] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-10T21:42:23.743464] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-10T21:42:24.289371] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-10T21:42:25.015527] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-10T21:42:25.089366] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-10T21:42:25.793498] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-10T21:42:25.889387] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-10T21:42:26.689430] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-10T21:42:26.719116] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-10T21:42:27.165897] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-10T21:42:27.489375] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-10T21:42:28.289394] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-10T21:42:28.791276] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-10T21:42:29.089357] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-10T21:42:29.156761] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T21:42:29.177204] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-10T21:42:29.889346] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-10T21:42:29.982138] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-10T21:42:30.689409] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-10T21:42:31.489357] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-10T21:42:31.531722] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-10T21:42:32.289394] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-10T21:42:32.673309] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-10T21:42:32.768260] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-10T21:42:33.089383] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-10T21:42:33.885956] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-10T21:42:33.892975] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-10T21:42:34.434598] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T21:42:34.689380] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-10T21:42:35.057889] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-10T21:42:35.489365] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-10T21:42:35.921514] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-10T21:42:36.289386] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-10T21:42:36.713316] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-10T21:42:37.089374] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-10T21:42:37.491450] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T21:42:37.889377] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-10T21:42:38.605172] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T21:42:38.689374] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-10T21:42:38.860172] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-10T21:42:39.489380] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-10T21:42:40.283066] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-10T21:42:40.289482] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-10T21:42:40.616715] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-10T21:42:40.619026] [INFO ] [REMOTE ] STEL: Full fetch complete (31935 records). [2025-10-10T21:42:40.619098] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-10T21:42:40.982244] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-10T21:42:40.982328] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-10T21:42:40.983054] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-10T21:42:40.983118] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-10T21:42:40.983994] [DEBUG] [LOCAL ] STEL: Trimmed 31935 records to 23115 (keeping 200 days of data) [2025-10-10T21:42:41.089672] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-10T21:42:41.129757] [DEBUG] [LOCAL ] STEL: Primary data saved (23115 records). [2025-10-10T21:42:41.129890] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-10T21:42:41.129977] [INFO ] [MAIN ] Update Progress: 2006/2373 symbols completed. STEL took 34.9s. Estimated remaining: 51m 42s. Rate: 7.1 symbols/min [2025-10-10T21:42:41.299935] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:42:41.300127] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-10T21:42:41.300164] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-10T21:42:41.300283] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-10T21:42:41.300324] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-10T21:42:41.300395] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-10T21:42:41.300433] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-10T21:42:41.486862] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-10T21:42:41.676866] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:42:41.889382] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-10-10T21:42:42.293548] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-10T21:42:42.689376] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-10T21:42:42.701758] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-10T21:42:42.705759] [INFO ] [REMOTE ] STEM: Full fetch complete (61480 records). [2025-10-10T21:42:42.705924] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-10T21:42:43.093068] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-10T21:42:43.093145] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-10T21:42:43.094452] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-10T21:42:43.094535] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-10T21:42:43.096163] [DEBUG] [LOCAL ] STEM: Trimmed 61480 records to 39568 (keeping 200 days of data) [2025-10-10T21:42:43.301480] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-10T21:42:43.326483] [DEBUG] [LOCAL ] STEM: Primary data saved (39568 records). [2025-10-10T21:42:43.326631] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-10T21:42:43.326754] [INFO ] [MAIN ] Update Progress: 2007/2373 symbols completed. STEM took 35.2s. Estimated remaining: 51m 33s. Rate: 7.1 symbols/min [2025-10-10T21:42:43.489512] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:42:43.489711] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-10T21:42:43.500950] [DEBUG] [LOCAL ] STK: Loaded 9650 existing records from primary storage. [2025-10-10T21:42:43.501148] [INFO ] [MAIN ] STK: Loaded 9650 existing records. [2025-10-10T21:42:43.672667] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:42:43.672866] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-10T21:42:43.672913] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-10T21:42:43.673098] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-10T21:42:43.673153] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-10T21:42:44.048016] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:42:44.289351] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-10T21:42:44.660157] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-10T21:42:44.673078] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-10T21:42:45.089445] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-10T21:42:45.889386] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-10T21:42:46.021019] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T21:42:46.689418] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-10T21:42:47.073838] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-10T21:42:47.077430] [INFO ] [REMOTE ] STE: Full fetch complete (50556 records). [2025-10-10T21:42:47.077527] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-10T21:42:47.452465] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-10T21:42:47.452586] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-10T21:42:47.453562] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-10T21:42:47.453626] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-10T21:42:47.454780] [DEBUG] [LOCAL ] STE: Trimmed 50556 records to 35898 (keeping 200 days of data) [2025-10-10T21:42:47.509023] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-10T21:42:47.663723] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-10T21:42:47.699420] [DEBUG] [LOCAL ] STE: Primary data saved (35898 records). [2025-10-10T21:42:47.699571] [INFO ] [MAIN ] STE: Full history saved. [2025-10-10T21:42:47.699675] [INFO ] [MAIN ] Update Progress: 2008/2373 symbols completed. STE took 43.9s. Estimated remaining: 51m 24s. Rate: 7.1 symbols/min [2025-10-10T21:42:47.867867] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:42:47.870414] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-10T21:42:47.920111] [DEBUG] [LOCAL ] STLA: Loaded 53941 existing records from primary storage. [2025-10-10T21:42:47.920416] [INFO ] [MAIN ] STLA: Loaded 53941 existing records. [2025-10-10T21:42:48.102229] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:42:48.102489] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-10T21:42:48.102553] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-10T21:42:48.102796] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-10T21:42:48.102852] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-10T21:42:48.294539] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-10-10T21:42:48.450315] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:42:49.089355] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-10-10T21:42:49.298341] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T21:42:49.889465] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-10T21:42:50.689387] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-10T21:42:50.754607] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-10T21:42:50.756467] [INFO ] [REMOTE ] STEW: Full fetch complete (21745 records). [2025-10-10T21:42:50.756546] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-10T21:42:51.142361] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-10T21:42:51.157732] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-10T21:42:51.157952] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-10T21:42:51.159148] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-10T21:42:51.159220] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-10T21:42:51.160168] [DEBUG] [LOCAL ] STEW: Trimmed 21745 records to 16339 (keeping 200 days of data) [2025-10-10T21:42:51.270422] [DEBUG] [LOCAL ] STEW: Primary data saved (16339 records). [2025-10-10T21:42:51.270671] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-10T21:42:51.270845] [INFO ] [MAIN ] Update Progress: 2009/2373 symbols completed. STEW took 35.1s. Estimated remaining: 51m 14s. Rate: 7.1 symbols/min [2025-10-10T21:42:51.459312] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:42:51.491593] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-10T21:42:51.496179] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-10T21:42:51.559769] [DEBUG] [LOCAL ] STM: Loaded 53960 existing records from primary storage. [2025-10-10T21:42:51.560138] [INFO ] [MAIN ] STM: Loaded 53960 existing records. [2025-10-10T21:42:51.733425] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:42:51.733672] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-10T21:42:51.733735] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-10T21:42:51.733947] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-10T21:42:51.734003] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-10T21:42:51.986254] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-10T21:42:52.101169] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:42:52.289383] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-10T21:42:52.722967] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-10T21:42:53.089419] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-10T21:42:53.889446] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-10-10T21:42:54.048955] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-10T21:42:54.689403] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-10T21:42:55.489396] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-10T21:42:56.036116] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-10T21:42:56.110816] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-10T21:42:56.289375] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-10T21:42:56.731396] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T21:42:57.089436] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-10T21:42:57.889383] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-10T21:42:58.466597] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-10T21:42:58.689378] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-10T21:42:58.786176] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-10T21:42:58.848473] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-10T21:42:59.232878] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-10T21:42:59.489399] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-10T21:43:00.289448] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-10T21:43:00.822300] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-10T21:43:00.823065] [INFO ] [REMOTE ] STG: Full fetch complete (2519 records). [2025-10-10T21:43:00.823133] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-10T21:43:01.006900] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-10T21:43:01.007285] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:43:01.007368] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:43:01.007442] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-10T21:43:01.007508] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-10T21:43:01.007543] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-10T21:43:01.007581] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-10T21:43:01.007663] [INFO ] [MAIN ] Update Progress: 2010/2373 symbols completed. STG took 19.9s. Estimated remaining: 51m 6s. Rate: 7.1 symbols/min [2025-10-10T21:43:01.094563] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-10T21:43:01.180748] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:43:01.204081] [DEBUG] [LOCAL ] STN: Loaded 23000 existing records from primary storage. [2025-10-10T21:43:01.204337] [INFO ] [MAIN ] STN: Loaded 23000 existing records. [2025-10-10T21:43:01.381631] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:43:01.381966] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-10T21:43:01.382056] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-10T21:43:01.382623] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-10T21:43:01.382717] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-10T21:43:01.519103] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-10T21:43:01.785802] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:43:01.889355] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-10-10T21:43:02.103306] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-10T21:43:02.689380] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-10T21:43:03.174764] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T21:43:03.489343] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-10T21:43:03.664634] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-10T21:43:04.289370] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-10T21:43:04.697741] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-10T21:43:05.089384] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-10T21:43:05.889398] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-10T21:43:06.135758] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-10T21:43:06.689399] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-10T21:43:06.782844] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-10T21:43:07.489338] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-10T21:43:07.600255] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-10T21:43:07.983968] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T21:43:08.289378] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-10T21:43:09.089403] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-10T21:43:09.159004] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-10T21:43:09.889371] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-10T21:43:10.174310] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-10T21:43:10.689360] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-10T21:43:10.793782] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-10T21:43:11.472068] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-10T21:43:11.489332] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-10T21:43:12.289399] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-10T21:43:12.949182] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-10T21:43:13.089443] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-10T21:43:13.210397] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-10T21:43:13.668534] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-10T21:43:13.889384] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-10T21:43:14.689421] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-10T21:43:15.353045] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-10T21:43:15.489355] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-10T21:43:15.609910] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-10T21:43:16.184281] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-10T21:43:16.289429] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-10T21:43:17.084633] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-10T21:43:17.086309] [INFO ] [REMOTE ] STK: Full fetch complete (14109 records). [2025-10-10T21:43:17.086421] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-10T21:43:17.098379] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-10T21:43:17.476975] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-10T21:43:17.477156] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-10T21:43:17.477800] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-10T21:43:17.477910] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-10T21:43:17.478871] [DEBUG] [LOCAL ] STK: Trimmed 14109 records to 9737 (keeping 200 days of data) [2025-10-10T21:43:17.541918] [DEBUG] [LOCAL ] STK: Primary data saved (9737 records). [2025-10-10T21:43:17.542096] [INFO ] [MAIN ] STK: Full history saved. [2025-10-10T21:43:17.542197] [INFO ] [MAIN ] Update Progress: 2011/2373 symbols completed. STK took 34.2s. Estimated remaining: 50m 59s. Rate: 7.1 symbols/min [2025-10-10T21:43:17.727407] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:43:17.761635] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-10T21:43:17.817636] [DEBUG] [LOCAL ] STNG: Loaded 44007 existing records from primary storage. [2025-10-10T21:43:17.818094] [INFO ] [MAIN ] STNG: Loaded 44007 existing records. [2025-10-10T21:43:17.895850] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-10T21:43:18.016273] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:43:18.016587] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-10T21:43:18.016668] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-10T21:43:18.017123] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-10T21:43:18.017186] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-10T21:43:18.399440] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:43:18.689382] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-10T21:43:19.254840] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-10T21:43:19.489345] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-10T21:43:19.577092] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-10T21:43:20.289367] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-10T21:43:21.014683] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-10T21:43:21.040752] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T21:43:21.089347] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-10T21:43:21.889347] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-10-10T21:43:22.539296] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-10T21:43:22.565782] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-10T21:43:22.689354] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-10T21:43:23.205032] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T21:43:23.489438] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-10T21:43:24.130160] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-10T21:43:24.289435] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-10T21:43:25.089373] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-10T21:43:25.168040] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T21:43:25.889401] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-10T21:43:26.624091] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-10T21:43:26.653917] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-10T21:43:26.689382] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-10T21:43:26.850691] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-10T21:43:27.489405] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-10T21:43:28.289422] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-10T21:43:28.736703] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-10T21:43:28.930272] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-10T21:43:28.936380] [INFO ] [REMOTE ] STLA: Full fetch complete (77541 records). [2025-10-10T21:43:28.936630] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-10T21:43:29.096689] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-10T21:43:29.355225] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-10T21:43:29.355332] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-10T21:43:29.356930] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-10T21:43:29.357003] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-10T21:43:29.359019] [DEBUG] [LOCAL ] STLA: Trimmed 77541 records to 54331 (keeping 200 days of data) [2025-10-10T21:43:29.723481] [DEBUG] [LOCAL ] STLA: Primary data saved (54331 records). [2025-10-10T21:43:29.723710] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-10T21:43:29.724330] [INFO ] [MAIN ] Update Progress: 2012/2373 symbols completed. STLA took 42.0s. Estimated remaining: 50m 51s. Rate: 7.1 symbols/min [2025-10-10T21:43:29.898500] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-10T21:43:29.902467] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:43:29.921689] [DEBUG] [LOCAL ] STRV: Loaded 11368 existing records from primary storage. [2025-10-10T21:43:29.922112] [INFO ] [MAIN ] STRV: Loaded 11368 existing records. [2025-10-10T21:43:30.130343] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:43:30.140951] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-10T21:43:30.141053] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-10T21:43:30.141371] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-10T21:43:30.142953] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T21:43:30.141852] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-10T21:43:30.509260] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:43:30.526877] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-10T21:43:30.689376] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-10-10T21:43:31.489411] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-10T21:43:31.872756] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-10T21:43:31.904093] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-10T21:43:31.909814] [INFO ] [REMOTE ] STM: Full fetch complete (77522 records). [2025-10-10T21:43:31.909968] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-10T21:43:32.298305] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-10T21:43:32.297522] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-10T21:43:32.299166] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-10T21:43:32.300388] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-10T21:43:32.300551] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-10T21:43:32.303457] [DEBUG] [LOCAL ] STM: Trimmed 77522 records to 54350 (keeping 200 days of data) [2025-10-10T21:43:32.637200] [DEBUG] [LOCAL ] STM: Primary data saved (54350 records). [2025-10-10T21:43:32.637343] [INFO ] [MAIN ] STM: Full history saved. [2025-10-10T21:43:32.637425] [INFO ] [MAIN ] Update Progress: 2013/2373 symbols completed. STM took 41.4s. Estimated remaining: 50m 42s. Rate: 7.1 symbols/min [2025-10-10T21:43:32.805335] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:43:32.855047] [DEBUG] [LOCAL ] STT: Loaded 51314 existing records from primary storage. [2025-10-10T21:43:32.855396] [INFO ] [MAIN ] STT: Loaded 51314 existing records. [2025-10-10T21:43:33.033172] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:43:33.033774] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-10T21:43:33.033857] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-10T21:43:33.034211] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-10-10T21:43:33.034279] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-10T21:43:33.106981] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-10T21:43:33.431080] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:43:33.442324] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T21:43:33.577911] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T21:43:33.889395] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-10T21:43:34.288782] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-10T21:43:34.689497] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-10T21:43:35.489413] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-10-10T21:43:35.620300] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-10T21:43:35.788959] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T21:43:36.289416] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-10T21:43:37.089478] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-10T21:43:37.482356] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-10T21:43:37.889391] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-10T21:43:38.030344] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T21:43:38.196360] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-10T21:43:38.198566] [INFO ] [REMOTE ] STN: Full fetch complete (32299 records). [2025-10-10T21:43:38.198639] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-10T21:43:38.563674] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-10T21:43:38.563765] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-10T21:43:38.564479] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-10T21:43:38.564542] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-10T21:43:38.565489] [DEBUG] [LOCAL ] STN: Trimmed 32299 records to 23156 (keeping 200 days of data) [2025-10-10T21:43:38.690225] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-10T21:43:38.710014] [DEBUG] [LOCAL ] STN: Primary data saved (23156 records). [2025-10-10T21:43:38.710093] [INFO ] [MAIN ] STN: Full history saved. [2025-10-10T21:43:38.710165] [INFO ] [MAIN ] Update Progress: 2014/2373 symbols completed. STN took 37.7s. Estimated remaining: 50m 33s. Rate: 7.1 symbols/min [2025-10-10T21:43:38.879612] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:43:38.879798] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-10T21:43:38.879842] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-10T21:43:38.879952] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-10T21:43:38.879997] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-10T21:43:38.880039] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-10T21:43:38.880072] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-10T21:43:39.231782] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:43:39.489355] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-10-10T21:43:39.736244] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:43:39.736575] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-10-10T21:43:39.736698] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:43:39.736760] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-10T21:43:39.736823] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:43:39.736894] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-10T21:43:39.736957] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-10T21:43:39.736996] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-10T21:43:39.737082] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-10T21:43:39.737145] [INFO ] [MAIN ] Update Progress: 2015/2373 symbols completed. STUB took 1.0s. Estimated remaining: 50m 23s. Rate: 7.1 symbols/min [2025-10-10T21:43:39.912282] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:43:39.944275] [DEBUG] [LOCAL ] STVN: Loaded 26765 existing records from primary storage. [2025-10-10T21:43:39.944826] [INFO ] [MAIN ] STVN: Loaded 26765 existing records. [2025-10-10T21:43:40.088016] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-10T21:43:40.164861] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:43:40.165845] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-10T21:43:40.166138] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-10T21:43:40.166507] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-10T21:43:40.166569] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-10T21:43:40.292122] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-10T21:43:40.562247] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T21:43:40.567535] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:43:41.089446] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-10-10T21:43:41.889355] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-10T21:43:42.221402] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T21:43:42.611537] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T21:43:42.689389] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-10T21:43:43.489420] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-10T21:43:43.774173] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T21:43:44.174808] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-10T21:43:44.289356] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-10T21:43:45.089355] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-10T21:43:45.330093] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-10T21:43:45.617798] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T21:43:45.889381] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-10T21:43:46.689363] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-10T21:43:46.876033] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T21:43:46.961382] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-10T21:43:47.489406] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-10T21:43:47.835215] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T21:43:48.289369] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-10T21:43:48.798576] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T21:43:49.089370] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-10T21:43:49.889402] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-10T21:43:50.322415] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T21:43:50.352404] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T21:43:50.689409] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-10T21:43:51.079820] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-10T21:43:51.489382] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-10T21:43:52.289390] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-10T21:43:52.579548] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-10T21:43:53.089388] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-10T21:43:53.241210] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-10T21:43:53.341679] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T21:43:53.889402] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-10T21:43:54.052454] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-10T21:43:54.689441] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-10T21:43:55.439917] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-10T21:43:55.444026] [INFO ] [REMOTE ] STNG: Full fetch complete (64437 records). [2025-10-10T21:43:55.444123] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-10T21:43:55.498759] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-10T21:43:55.753292] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-10T21:43:55.849715] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-10T21:43:55.849807] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-10T21:43:55.850984] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-10T21:43:55.851053] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-10T21:43:55.852327] [DEBUG] [LOCAL ] STNG: Trimmed 64437 records to 44349 (keeping 200 days of data) [2025-10-10T21:43:56.117130] [DEBUG] [LOCAL ] STNG: Primary data saved (44349 records). [2025-10-10T21:43:56.117265] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-10T21:43:56.117382] [INFO ] [MAIN ] Update Progress: 2016/2373 symbols completed. STNG took 38.6s. Estimated remaining: 50m 16s. Rate: 7.1 symbols/min [2025-10-10T21:43:56.305187] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-10T21:43:56.307773] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:43:56.358415] [DEBUG] [LOCAL ] STWD: Loaded 52326 existing records from primary storage. [2025-10-10T21:43:56.358796] [INFO ] [MAIN ] STWD: Loaded 52326 existing records. [2025-10-10T21:43:56.531686] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:43:56.531913] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-10T21:43:56.531958] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-10T21:43:56.532166] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-10T21:43:56.532221] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-10T21:43:56.883914] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:43:57.089347] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-10-10T21:43:57.426968] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T21:43:57.484933] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-10T21:43:57.889434] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-10T21:43:58.689361] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-10T21:43:58.776314] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-10T21:43:59.023927] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T21:43:59.489355] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-10T21:43:59.965842] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-10T21:44:00.289430] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-10T21:44:00.411205] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-10T21:44:01.089374] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-10T21:44:01.889363] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-10T21:44:01.930265] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T21:44:01.931979] [INFO ] [REMOTE ] STRV: Full fetch complete (17767 records). [2025-10-10T21:44:01.932052] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-10T21:44:02.331081] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-10T21:44:02.331286] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-10T21:44:02.332319] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-10T21:44:02.332560] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-10T21:44:02.333610] [DEBUG] [LOCAL ] STRV: Trimmed 17767 records to 11460 (keeping 200 days of data) [2025-10-10T21:44:02.429311] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-10T21:44:02.458926] [DEBUG] [LOCAL ] STRV: Primary data saved (11460 records). [2025-10-10T21:44:02.459126] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-10T21:44:02.459293] [INFO ] [MAIN ] Update Progress: 2017/2373 symbols completed. STRV took 32.7s. Estimated remaining: 50m 7s. Rate: 7.1 symbols/min [2025-10-10T21:44:02.628730] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:44:02.632540] [DEBUG] [LOCAL ] STXD: Loaded 1244 existing records from primary storage. [2025-10-10T21:44:02.632720] [INFO ] [MAIN ] STXD: Loaded 1244 existing records. [2025-10-10T21:44:02.695465] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-10T21:44:02.823675] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:44:02.824018] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-10T21:44:02.824074] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-10T21:44:02.824231] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-10T21:44:02.824290] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-10T21:44:03.194484] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:44:03.489393] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-10T21:44:03.861315] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T21:44:04.231084] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-10T21:44:04.289347] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-10T21:44:05.089370] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-10T21:44:05.536000] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-10T21:44:05.859910] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T21:44:05.889351] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-10T21:44:06.689393] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-10T21:44:06.851445] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T21:44:07.132126] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-10T21:44:07.135341] [INFO ] [REMOTE ] STVN: Full fetch complete (39169 records). [2025-10-10T21:44:07.135438] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-10T21:44:07.494543] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-10-10T21:44:07.539431] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-10T21:44:07.539538] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-10T21:44:07.540719] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-10T21:44:07.540785] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-10T21:44:07.541807] [DEBUG] [LOCAL ] STVN: Trimmed 39169 records to 26967 (keeping 200 days of data) [2025-10-10T21:44:07.715751] [DEBUG] [LOCAL ] STVN: Primary data saved (26967 records). [2025-10-10T21:44:07.715912] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-10T21:44:07.716013] [INFO ] [MAIN ] Update Progress: 2018/2373 symbols completed. STVN took 28.0s. Estimated remaining: 49m 58s. Rate: 7.1 symbols/min [2025-10-10T21:44:07.910915] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:44:07.915934] [DEBUG] [LOCAL ] STXE: Loaded 2107 existing records from primary storage. [2025-10-10T21:44:07.916126] [INFO ] [MAIN ] STXE: Loaded 2107 existing records. [2025-10-10T21:44:08.092453] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:44:08.092736] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-10T21:44:08.092792] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-10T21:44:08.092978] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-10T21:44:08.093109] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-10T21:44:08.171633] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-10T21:44:08.314211] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-10T21:44:08.494284] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:44:08.499160] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T21:44:09.089443] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-10-10T21:44:09.789637] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-10T21:44:09.889418] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-10T21:44:10.292474] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T21:44:10.640639] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-10T21:44:10.645948] [INFO ] [REMOTE ] STT: Full fetch complete (74248 records). [2025-10-10T21:44:10.646108] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-10T21:44:10.699169] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-10T21:44:11.043981] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-10T21:44:11.044089] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-10T21:44:11.045610] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-10T21:44:11.045721] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-10T21:44:11.049257] [DEBUG] [LOCAL ] STT: Trimmed 74248 records to 51696 (keeping 200 days of data) [2025-10-10T21:44:11.297547] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-10T21:44:11.424486] [DEBUG] [LOCAL ] STT: Primary data saved (51696 records). [2025-10-10T21:44:11.424692] [INFO ] [MAIN ] STT: Full history saved. [2025-10-10T21:44:11.424830] [INFO ] [MAIN ] Update Progress: 2019/2373 symbols completed. STT took 38.8s. Estimated remaining: 49m 49s. Rate: 7.1 symbols/min [2025-10-10T21:44:11.494595] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-10T21:44:11.605032] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:44:11.609762] [DEBUG] [LOCAL ] STXG: Loaded 2480 existing records from primary storage. [2025-10-10T21:44:11.609916] [INFO ] [MAIN ] STXG: Loaded 2480 existing records. [2025-10-10T21:44:11.800138] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:44:11.800391] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-10T21:44:11.800440] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-10T21:44:11.800616] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-10T21:44:11.800713] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-10T21:44:12.089631] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-10T21:44:12.167879] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:44:12.289400] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-10T21:44:12.881954] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-10T21:44:13.089448] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-10T21:44:13.889402] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-10T21:44:14.435810] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-10T21:44:14.689360] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-10T21:44:15.220204] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T21:44:15.272694] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-10T21:44:15.489350] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-10T21:44:16.077394] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-10T21:44:16.289457] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-10T21:44:16.822477] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-10T21:44:17.089425] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-10T21:44:17.889395] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-10T21:44:18.629757] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-10T21:44:18.689356] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-10T21:44:19.168856] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-10T21:44:19.220799] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-10T21:44:19.489391] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-10T21:44:19.897876] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-10T21:44:20.289374] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-10T21:44:20.694430] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-10T21:44:21.089413] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-10T21:44:21.610378] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-10T21:44:21.889379] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-10T21:44:22.689421] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-10T21:44:23.092827] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-10T21:44:23.489383] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-10-10T21:44:23.844032] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T21:44:23.945199] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-10T21:44:24.289379] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-10T21:44:24.603779] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-10T21:44:25.089378] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-10T21:44:25.463863] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-10T21:44:25.464540] [INFO ] [REMOTE ] STXD: Full fetch complete (2019 records). [2025-10-10T21:44:25.464606] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-10T21:44:25.811987] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-10T21:44:25.812065] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-10T21:44:25.812153] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-10T21:44:25.812191] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-10T21:44:25.812529] [DEBUG] [LOCAL ] STXD: Trimmed 2019 records to 1250 (keeping 200 days of data) [2025-10-10T21:44:25.820661] [DEBUG] [LOCAL ] STXD: Primary data saved (1250 records). [2025-10-10T21:44:25.820730] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-10T21:44:25.820796] [INFO ] [MAIN ] Update Progress: 2020/2373 symbols completed. STXD took 23.4s. Estimated remaining: 49m 42s. Rate: 7.1 symbols/min [2025-10-10T21:44:25.894486] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-10T21:44:25.991579] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:44:25.995440] [DEBUG] [LOCAL ] STXK: Loaded 1534 existing records from primary storage. [2025-10-10T21:44:25.995600] [INFO ] [MAIN ] STXK: Loaded 1534 existing records. [2025-10-10T21:44:26.173582] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:44:26.173950] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-10T21:44:26.174009] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-10T21:44:26.174190] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-10T21:44:26.174245] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-10T21:44:26.515317] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:44:26.520032] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-10T21:44:26.689347] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-10-10T21:44:27.224156] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-10T21:44:27.489401] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-10T21:44:28.019572] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-10T21:44:28.289380] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-10T21:44:28.792679] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-10T21:44:29.089348] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-10T21:44:29.635703] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-10T21:44:29.889382] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-10T21:44:30.197759] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-10T21:44:30.689421] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-10T21:44:31.220356] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-10T21:44:31.489414] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-10T21:44:32.145858] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-10T21:44:32.289352] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-10T21:44:32.973799] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-10T21:44:33.089378] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-10T21:44:33.792931] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-10T21:44:33.889351] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-10T21:44:34.431205] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-10T21:44:34.689369] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-10T21:44:35.119055] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-10T21:44:35.489379] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-10T21:44:36.289398] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-10T21:44:36.886614] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-10T21:44:37.089410] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-10T21:44:37.510430] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-10T21:44:37.512253] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T21:44:37.889389] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-10T21:44:38.422748] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-10T21:44:38.689377] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-10T21:44:39.278148] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-10T21:44:39.489347] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-10T21:44:39.886576] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-10T21:44:40.289381] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-10T21:44:40.863896] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-10T21:44:41.089429] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-10T21:44:41.600786] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-10T21:44:41.889416] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-10T21:44:42.296535] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-10T21:44:42.297547] [INFO ] [REMOTE ] STXK: Full fetch complete (2415 records). [2025-10-10T21:44:42.297621] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-10T21:44:42.662794] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-10T21:44:42.662919] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-10T21:44:42.663059] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-10T21:44:42.663207] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-10T21:44:42.663587] [DEBUG] [LOCAL ] STXK: Trimmed 2415 records to 1545 (keeping 200 days of data) [2025-10-10T21:44:42.674505] [DEBUG] [LOCAL ] STXK: Primary data saved (1545 records). [2025-10-10T21:44:42.674569] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-10T21:44:42.674670] [INFO ] [MAIN ] Update Progress: 2021/2373 symbols completed. STXK took 16.9s. Estimated remaining: 49m 35s. Rate: 7.1 symbols/min [2025-10-10T21:44:42.694568] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-10T21:44:42.875708] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:44:42.876007] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-10T21:44:42.876063] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-10T21:44:42.876185] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-10T21:44:42.876227] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-10T21:44:42.876268] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-10T21:44:42.876301] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-10T21:44:43.241772] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:44:43.309401] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-10T21:44:43.489399] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-10T21:44:44.289391] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-10T21:44:44.840564] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-10T21:44:45.089372] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-10T21:44:45.471952] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T21:44:45.651033] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-10T21:44:45.889396] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-10T21:44:46.424723] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-10T21:44:46.425702] [INFO ] [REMOTE ] STXE: Full fetch complete (3504 records). [2025-10-10T21:44:46.425774] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-10T21:44:46.694564] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-10T21:44:46.825308] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-10T21:44:46.825391] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-10T21:44:46.825549] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-10T21:44:46.825588] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-10T21:44:46.825942] [DEBUG] [LOCAL ] STXE: Trimmed 3504 records to 2120 (keeping 200 days of data) [2025-10-10T21:44:46.838924] [DEBUG] [LOCAL ] STXE: Primary data saved (2120 records). [2025-10-10T21:44:46.838993] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-10T21:44:46.839071] [INFO ] [MAIN ] Update Progress: 2022/2373 symbols completed. STXE took 39.1s. Estimated remaining: 49m 25s. Rate: 7.1 symbols/min [2025-10-10T21:44:47.004713] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:44:47.010157] [DEBUG] [LOCAL ] STXT: Loaded 2515 existing records from primary storage. [2025-10-10T21:44:47.010315] [INFO ] [MAIN ] STXT: Loaded 2515 existing records. [2025-10-10T21:44:47.180992] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:44:47.181332] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-10T21:44:47.181390] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-10T21:44:47.181631] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-10T21:44:47.181733] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-10T21:44:47.494541] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-10T21:44:47.531216] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:44:48.053237] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-10T21:44:48.289419] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-10T21:44:48.723173] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-10T21:44:48.724144] [INFO ] [REMOTE ] STXG: Full fetch complete (4091 records). [2025-10-10T21:44:48.724213] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-10T21:44:48.886095] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-10T21:44:49.094521] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-10T21:44:49.154703] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-10T21:44:49.154806] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-10T21:44:49.154993] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-10T21:44:49.155036] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-10T21:44:49.155418] [DEBUG] [LOCAL ] STXG: Trimmed 4091 records to 2487 (keeping 200 days of data) [2025-10-10T21:44:49.172320] [DEBUG] [LOCAL ] STXG: Primary data saved (2487 records). [2025-10-10T21:44:49.172421] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-10T21:44:49.172566] [INFO ] [MAIN ] Update Progress: 2023/2373 symbols completed. STXG took 37.7s. Estimated remaining: 49m 16s. Rate: 7.1 symbols/min [2025-10-10T21:44:49.346764] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:44:49.351033] [DEBUG] [LOCAL ] STXV: Loaded 1550 existing records from primary storage. [2025-10-10T21:44:49.351196] [INFO ] [MAIN ] STXV: Loaded 1550 existing records. [2025-10-10T21:44:49.550333] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:44:49.550613] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-10T21:44:49.550693] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-10T21:44:49.550880] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-10T21:44:49.550938] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-10T21:44:49.894489] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-10-10T21:44:49.925835] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:44:50.615484] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-10T21:44:50.666189] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-10T21:44:50.671881] [INFO ] [REMOTE ] STWD: Full fetch complete (75197 records). [2025-10-10T21:44:50.672115] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-10T21:44:50.695798] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-10-10T21:44:51.096737] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-10T21:44:51.096876] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-10T21:44:51.098781] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-10T21:44:51.098886] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-10T21:44:51.101747] [DEBUG] [LOCAL ] STWD: Trimmed 75197 records to 52712 (keeping 200 days of data) [2025-10-10T21:44:51.209968] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-10T21:44:51.447678] [DEBUG] [LOCAL ] STWD: Primary data saved (52712 records). [2025-10-10T21:44:51.447868] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-10T21:44:51.447972] [INFO ] [MAIN ] Update Progress: 2024/2373 symbols completed. STWD took 55.3s. Estimated remaining: 49m 6s. Rate: 7.1 symbols/min [2025-10-10T21:44:51.494562] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-10T21:44:51.627251] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:44:51.682973] [DEBUG] [LOCAL ] STZ: Loaded 52717 existing records from primary storage. [2025-10-10T21:44:51.683399] [INFO ] [MAIN ] STZ: Loaded 52717 existing records. [2025-10-10T21:44:51.878452] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:44:51.879681] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-10T21:44:51.879746] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-10T21:44:51.880718] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-10-10T21:44:51.880781] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-10T21:44:52.071743] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-10T21:44:52.254887] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:44:52.289349] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-10-10T21:44:53.089391] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-10-10T21:44:53.651505] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-10T21:44:53.889369] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-10T21:44:54.173877] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T21:44:54.534244] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-10T21:44:54.689385] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-10T21:44:55.229533] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-10T21:44:55.489416] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-10T21:44:55.955076] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-10T21:44:56.289384] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-10T21:44:56.795330] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-10T21:44:57.089379] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-10T21:44:57.692243] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-10T21:44:57.889408] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-10T21:44:58.539735] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-10T21:44:58.689378] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-10T21:44:59.259520] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-10T21:44:59.489394] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-10T21:45:00.289399] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-10T21:45:01.002701] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-10T21:45:01.089415] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-10T21:45:01.529316] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-10T21:45:01.889366] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-10T21:45:01.992488] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-10T21:45:02.283599] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-10T21:45:02.689417] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-10T21:45:03.121826] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-10T21:45:03.489435] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-10T21:45:03.899679] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-10T21:45:04.289429] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-10T21:45:04.843003] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-10T21:45:05.089443] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-10T21:45:05.652576] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-10T21:45:05.889401] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-10T21:45:06.573249] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-10T21:45:06.689424] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-10T21:45:07.096819] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-10T21:45:07.489409] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-10T21:45:08.026806] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-10T21:45:08.289475] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-10T21:45:09.089486] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-10T21:45:09.390050] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-10T21:45:09.391262] [INFO ] [REMOTE ] STXM: Full fetch complete (1409 records). [2025-10-10T21:45:09.391357] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-10T21:45:09.636682] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-10T21:45:09.636888] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:45:09.636958] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:45:09.637062] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-10T21:45:09.637141] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-10T21:45:09.637180] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-10T21:45:09.637219] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-10T21:45:09.637363] [INFO ] [MAIN ] Update Progress: 2025/2373 symbols completed. STXM took 27.0s. Estimated remaining: 48m 60s. Rate: 7.1 symbols/min [2025-10-10T21:45:09.828938] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:45:09.877972] [DEBUG] [LOCAL ] SU: Loaded 53823 existing records from primary storage. [2025-10-10T21:45:09.878294] [INFO ] [MAIN ] SU: Loaded 53823 existing records. [2025-10-10T21:45:09.898567] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-10T21:45:10.063170] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:45:10.063450] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-10T21:45:10.063500] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-10T21:45:10.063767] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-10T21:45:10.063833] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-10T21:45:10.419568] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:45:10.449174] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-10T21:45:10.505089] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-10T21:45:10.689368] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-10-10T21:45:11.489394] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-10T21:45:12.289481] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-10T21:45:12.831487] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-10T21:45:12.833317] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-10T21:45:13.089353] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-10T21:45:13.796611] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-10T21:45:13.889348] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-10T21:45:14.689404] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-10T21:45:15.104344] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-10T21:45:15.202916] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-10T21:45:15.489384] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-10T21:45:15.794564] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T21:45:16.090279] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-10T21:45:16.289410] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-10T21:45:16.942561] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-10T21:45:17.089416] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-10T21:45:17.889368] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-10T21:45:18.420981] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-10T21:45:18.536267] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-10T21:45:18.689395] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-10T21:45:19.489380] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-10T21:45:20.015482] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-10T21:45:20.289390] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-10T21:45:20.732753] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-10T21:45:20.993026] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-10T21:45:21.089388] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-10T21:45:21.889387] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-10T21:45:22.689402] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-10T21:45:23.233692] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-10T21:45:23.405748] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-10T21:45:23.489478] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-10T21:45:23.897917] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-10T21:45:23.922896] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-10T21:45:23.923690] [INFO ] [REMOTE ] STXT: Full fetch complete (3903 records). [2025-10-10T21:45:23.923760] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-10T21:45:24.275915] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-10T21:45:24.276017] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-10T21:45:24.276159] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-10T21:45:24.276196] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-10T21:45:24.276532] [DEBUG] [LOCAL ] STXT: Trimmed 3903 records to 2534 (keeping 200 days of data) [2025-10-10T21:45:24.289543] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-10T21:45:24.293949] [DEBUG] [LOCAL ] STXT: Primary data saved (2534 records). [2025-10-10T21:45:24.294159] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-10T21:45:24.294250] [INFO ] [MAIN ] Update Progress: 2026/2373 symbols completed. STXT took 37.5s. Estimated remaining: 48m 52s. Rate: 7.1 symbols/min [2025-10-10T21:45:24.459468] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:45:24.504051] [DEBUG] [LOCAL ] SUI: Loaded 42042 existing records from primary storage. [2025-10-10T21:45:24.504352] [INFO ] [MAIN ] SUI: Loaded 42042 existing records. [2025-10-10T21:45:24.683282] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:45:24.683486] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-10T21:45:24.683533] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-10T21:45:24.683765] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-10T21:45:24.683820] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-10T21:45:24.784855] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-10T21:45:24.791631] [INFO ] [REMOTE ] STXV: Full fetch complete (2546 records). [2025-10-10T21:45:24.791752] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-10T21:45:25.093710] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-10T21:45:25.242281] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:45:25.411154] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-10T21:45:25.411235] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-10T21:45:25.411354] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-10T21:45:25.411391] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-10T21:45:25.411742] [DEBUG] [LOCAL ] STXV: Trimmed 2546 records to 1561 (keeping 200 days of data) [2025-10-10T21:45:25.421879] [DEBUG] [LOCAL ] STXV: Primary data saved (1561 records). [2025-10-10T21:45:25.421958] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-10T21:45:25.422033] [INFO ] [MAIN ] Update Progress: 2027/2373 symbols completed. STXV took 36.2s. Estimated remaining: 48m 43s. Rate: 7.1 symbols/min [2025-10-10T21:45:25.590280] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:45:25.630693] [DEBUG] [LOCAL ] SUN: Loaded 38241 existing records from primary storage. [2025-10-10T21:45:25.631006] [INFO ] [MAIN ] SUN: Loaded 38241 existing records. [2025-10-10T21:45:25.805727] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:45:25.805936] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-10T21:45:25.805984] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-10T21:45:25.806266] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-10T21:45:25.806305] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-10T21:45:25.896985] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-10T21:45:26.182503] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:45:26.689337] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-10-10T21:45:27.164853] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-10T21:45:27.489385] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-10-10T21:45:27.712984] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-10T21:45:28.289356] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-10T21:45:28.519700] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T21:45:28.610889] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-10T21:45:29.089379] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-10T21:45:29.889417] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-10T21:45:30.611548] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-10T21:45:30.650458] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-10T21:45:30.689336] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-10T21:45:31.489404] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-10T21:45:31.650504] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-10T21:45:32.289465] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-10T21:45:32.431134] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-10T21:45:33.089339] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-10T21:45:33.537515] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T21:45:33.889341] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-10T21:45:33.943935] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-10T21:45:34.066244] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T21:45:34.689367] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-10T21:45:35.489345] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-10T21:45:35.717818] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T21:45:36.289403] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-10T21:45:36.329786] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-10T21:45:37.089374] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-10T21:45:37.705481] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-10T21:45:37.710777] [INFO ] [REMOTE ] STZ: Full fetch complete (75920 records). [2025-10-10T21:45:37.710902] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-10T21:45:37.892413] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-10T21:45:38.146458] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-10T21:45:38.149888] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-10T21:45:38.149785] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T21:45:38.159523] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-10T21:45:38.160143] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-10T21:45:38.162246] [DEBUG] [LOCAL ] STZ: Trimmed 75920 records to 53107 (keeping 200 days of data) [2025-10-10T21:45:38.509485] [DEBUG] [LOCAL ] STZ: Primary data saved (53107 records). [2025-10-10T21:45:38.509714] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-10T21:45:38.509818] [INFO ] [MAIN ] Update Progress: 2028/2373 symbols completed. STZ took 47.1s. Estimated remaining: 48m 35s. Rate: 7.1 symbols/min [2025-10-10T21:45:38.694720] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:45:38.694871] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-10T21:45:38.741027] [DEBUG] [LOCAL ] SUPV: Loaded 47846 existing records from primary storage. [2025-10-10T21:45:38.759048] [INFO ] [MAIN ] SUPV: Loaded 47846 existing records. [2025-10-10T21:45:38.791367] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-10T21:45:38.948824] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:45:38.949080] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-10T21:45:38.949134] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-10T21:45:38.949383] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-10T21:45:38.949440] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-10T21:45:39.312206] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:45:39.489348] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-10T21:45:40.037495] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T21:45:40.289386] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-10T21:45:40.430947] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T21:45:41.089347] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-10T21:45:41.240136] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T21:45:41.889375] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-10T21:45:42.306916] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-10T21:45:42.689361] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-10T21:45:42.900359] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T21:45:43.104438] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-10T21:45:43.489377] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-10T21:45:44.289352] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-10-10T21:45:44.728283] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-10T21:45:45.089351] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-10T21:45:45.195721] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-10T21:45:45.834908] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T21:45:45.889375] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-10T21:45:46.689385] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-10T21:45:46.769787] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-10T21:45:46.774807] [INFO ] [REMOTE ] SU: Full fetch complete (77384 records). [2025-10-10T21:45:46.774951] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-10T21:45:47.168054] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-10T21:45:47.168194] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-10T21:45:47.169398] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-10T21:45:47.169511] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-10T21:45:47.171244] [DEBUG] [LOCAL ] SU: Trimmed 77384 records to 54213 (keeping 200 days of data) [2025-10-10T21:45:47.432596] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-10T21:45:47.499495] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-10T21:45:47.553353] [DEBUG] [LOCAL ] SU: Primary data saved (54213 records). [2025-10-10T21:45:47.553507] [INFO ] [MAIN ] SU: Full history saved. [2025-10-10T21:45:47.554051] [INFO ] [MAIN ] Update Progress: 2029/2373 symbols completed. SU took 37.9s. Estimated remaining: 48m 27s. Rate: 7.1 symbols/min [2025-10-10T21:45:47.720206] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:45:47.762338] [DEBUG] [LOCAL ] SUZ: Loaded 45890 existing records from primary storage. [2025-10-10T21:45:47.762684] [INFO ] [MAIN ] SUZ: Loaded 45890 existing records. [2025-10-10T21:45:47.909554] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T21:45:48.002992] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:45:48.003227] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-10T21:45:48.003276] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-10T21:45:48.003468] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-10T21:45:48.003506] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-10T21:45:48.293610] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-10T21:45:48.371571] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:45:49.089386] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-10T21:45:49.277706] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T21:45:49.889354] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-10T21:45:50.292689] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-10T21:45:50.689391] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-10-10T21:45:50.914421] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-10T21:45:51.489374] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-10T21:45:51.651036] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T21:45:52.289384] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-10T21:45:52.475056] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-10T21:45:53.089347] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-10T21:45:53.116311] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T21:45:53.889410] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-10T21:45:54.128607] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-10T21:45:54.689454] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-10T21:45:54.853957] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-10T21:45:55.411890] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-10T21:45:55.416434] [INFO ] [REMOTE ] SUN: Full fetch complete (55138 records). [2025-10-10T21:45:55.416541] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-10T21:45:55.495055] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-10T21:45:55.816700] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-10T21:45:55.816789] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-10T21:45:55.817866] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-10T21:45:55.817930] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-10T21:45:55.819113] [DEBUG] [LOCAL ] SUN: Trimmed 55138 records to 38533 (keeping 200 days of data) [2025-10-10T21:45:56.056105] [DEBUG] [LOCAL ] SUN: Primary data saved (38533 records). [2025-10-10T21:45:56.056419] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-10T21:45:56.056568] [INFO ] [MAIN ] Update Progress: 2030/2373 symbols completed. SUN took 30.6s. Estimated remaining: 48m 18s. Rate: 7.1 symbols/min [2025-10-10T21:45:56.253439] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:45:56.259288] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-10T21:45:56.290292] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-10T21:45:56.308148] [DEBUG] [LOCAL ] SVV: Loaded 40238 existing records from primary storage. [2025-10-10T21:45:56.308473] [INFO ] [MAIN ] SVV: Loaded 40238 existing records. [2025-10-10T21:45:56.482828] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:45:56.483042] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-10T21:45:56.483089] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-10T21:45:56.483274] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-10T21:45:56.483312] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-10T21:45:56.834256] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:45:57.089380] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-10-10T21:45:57.358918] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T21:45:57.889432] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-10T21:45:58.157397] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-10T21:45:58.678405] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T21:45:58.689322] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-10T21:45:59.376560] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-10T21:45:59.380985] [INFO ] [REMOTE ] SUI: Full fetch complete (60863 records). [2025-10-10T21:45:59.381122] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-10T21:45:59.494539] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-10T21:45:59.773244] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-10T21:45:59.773330] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-10T21:45:59.774430] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-10T21:45:59.774495] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-10T21:45:59.775795] [DEBUG] [LOCAL ] SUI: Trimmed 60863 records to 42380 (keeping 200 days of data) [2025-10-10T21:46:00.044480] [DEBUG] [LOCAL ] SUI: Primary data saved (42380 records). [2025-10-10T21:46:00.044803] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-10T21:46:00.044938] [INFO ] [MAIN ] Update Progress: 2031/2373 symbols completed. SUI took 35.8s. Estimated remaining: 48m 9s. Rate: 7.1 symbols/min [2025-10-10T21:46:00.212050] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:46:00.263046] [DEBUG] [LOCAL ] SW: Loaded 53574 existing records from primary storage. [2025-10-10T21:46:00.270887] [INFO ] [MAIN ] SW: Loaded 53574 existing records. [2025-10-10T21:46:00.295982] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-10T21:46:00.333196] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T21:46:00.482748] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:46:00.482980] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-10T21:46:00.483029] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-10T21:46:00.483261] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-10T21:46:00.483334] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-10T21:46:00.884403] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:46:01.089462] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-10-10T21:46:01.672852] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-10T21:46:01.889432] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-10T21:46:02.689380] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-10T21:46:02.719540] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-10T21:46:03.210858] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-10T21:46:03.489458] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-10T21:46:03.765844] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T21:46:04.243083] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-10T21:46:04.289362] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-10T21:46:04.998821] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-10T21:46:05.089457] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-10T21:46:05.467258] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-10T21:46:05.889407] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-10T21:46:06.689452] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-10T21:46:06.929703] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T21:46:07.489476] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-10T21:46:07.687497] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T21:46:08.289482] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-10T21:46:08.672386] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T21:46:09.089455] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-10T21:46:09.433692] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T21:46:09.889524] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-10T21:46:10.046459] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T21:46:10.689359] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-10T21:46:10.920421] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T21:46:11.489394] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-10T21:46:11.553199] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-10T21:46:11.558716] [INFO ] [REMOTE ] SUPV: Full fetch complete (68502 records). [2025-10-10T21:46:11.558846] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-10T21:46:11.946783] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-10T21:46:11.946909] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-10T21:46:11.948244] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-10T21:46:11.948332] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-10T21:46:11.949979] [DEBUG] [LOCAL ] SUPV: Trimmed 68502 records to 48230 (keeping 200 days of data) [2025-10-10T21:46:12.259813] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T21:46:12.262558] [DEBUG] [LOCAL ] SUPV: Primary data saved (48230 records). [2025-10-10T21:46:12.272597] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-10T21:46:12.272801] [INFO ] [MAIN ] Update Progress: 2032/2373 symbols completed. SUPV took 33.8s. Estimated remaining: 48m 1s. Rate: 7.1 symbols/min [2025-10-10T21:46:12.294481] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-10T21:46:12.442176] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:46:12.493229] [DEBUG] [LOCAL ] SWK: Loaded 52815 existing records from primary storage. [2025-10-10T21:46:12.493601] [INFO ] [MAIN ] SWK: Loaded 52815 existing records. [2025-10-10T21:46:12.674006] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:46:12.674227] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-10T21:46:12.674272] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-10T21:46:12.674477] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-10T21:46:12.674529] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-10T21:46:13.029276] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:46:13.089411] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-10-10T21:46:13.278885] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T21:46:13.889426] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-10T21:46:14.082000] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T21:46:14.689389] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-10T21:46:14.845280] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-10T21:46:15.343969] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-10T21:46:15.489449] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-10T21:46:16.289428] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-10T21:46:16.682316] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T21:46:17.089382] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-10T21:46:17.482334] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-10T21:46:17.889460] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-10T21:46:17.948202] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T21:46:18.175617] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-10T21:46:18.689395] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-10T21:46:19.489335] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-10T21:46:19.938778] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T21:46:20.289424] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-10T21:46:20.421621] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-10T21:46:20.839773] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T21:46:21.089385] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-10T21:46:21.889383] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-10T21:46:22.560260] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-10T21:46:22.689366] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-10T21:46:22.956560] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T21:46:23.489363] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-10T21:46:23.805261] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T21:46:24.150787] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-10T21:46:24.289392] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-10T21:46:25.089405] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-10T21:46:25.217952] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T21:46:25.889400] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-10T21:46:26.396946] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T21:46:26.689416] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-10T21:46:26.971264] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T21:46:27.489623] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-10T21:46:27.546763] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-10T21:46:27.551071] [INFO ] [REMOTE ] SVV: Full fetch complete (56730 records). [2025-10-10T21:46:27.551187] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-10T21:46:27.923220] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-10T21:46:27.923307] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-10T21:46:27.924291] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-10T21:46:27.924354] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-10T21:46:27.925575] [DEBUG] [LOCAL ] SVV: Trimmed 56730 records to 40570 (keeping 200 days of data) [2025-10-10T21:46:28.159805] [DEBUG] [LOCAL ] SVV: Primary data saved (40570 records). [2025-10-10T21:46:28.159935] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-10T21:46:28.160015] [INFO ] [MAIN ] Update Progress: 2033/2373 symbols completed. SVV took 32.1s. Estimated remaining: 47m 54s. Rate: 7.1 symbols/min [2025-10-10T21:46:28.373208] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:46:28.300815] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-10T21:46:28.394699] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T21:46:28.433431] [DEBUG] [LOCAL ] SWX: Loaded 31366 existing records from primary storage. [2025-10-10T21:46:28.433741] [INFO ] [MAIN ] SWX: Loaded 31366 existing records. [2025-10-10T21:46:28.604206] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:46:28.604414] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-10T21:46:28.604463] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-10T21:46:28.604734] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-10T21:46:28.604792] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-10T21:46:28.946251] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:46:29.089332] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-10-10T21:46:29.640969] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T21:46:29.889381] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-10T21:46:29.998919] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-10T21:46:30.003877] [INFO ] [REMOTE ] SUZ: Full fetch complete (66605 records). [2025-10-10T21:46:30.004087] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-10T21:46:30.428989] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-10T21:46:30.429221] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-10T21:46:30.430966] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-10T21:46:30.431058] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-10T21:46:30.448803] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T21:46:30.455428] [DEBUG] [LOCAL ] SUZ: Trimmed 66605 records to 46265 (keeping 200 days of data) [2025-10-10T21:46:30.690014] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-10T21:46:30.748445] [DEBUG] [LOCAL ] SUZ: Primary data saved (46265 records). [2025-10-10T21:46:30.748737] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-10T21:46:30.749271] [INFO ] [MAIN ] Update Progress: 2034/2373 symbols completed. SUZ took 43.2s. Estimated remaining: 47m 44s. Rate: 7.1 symbols/min [2025-10-10T21:46:30.924133] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:46:30.934861] [DEBUG] [LOCAL ] SWZ: Loaded 6129 existing records from primary storage. [2025-10-10T21:46:30.935165] [INFO ] [MAIN ] SWZ: Loaded 6129 existing records. [2025-10-10T21:46:31.125486] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:46:31.125811] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-10T21:46:31.125934] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-10T21:46:31.126150] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-10T21:46:31.126207] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-10T21:46:31.489891] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:46:31.490011] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-10T21:46:31.915421] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T21:46:32.289414] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-10-10T21:46:32.763406] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-10T21:46:33.068628] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-10T21:46:33.089345] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-10T21:46:33.148378] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-10T21:46:33.889392] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-10T21:46:34.666529] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-10T21:46:34.689369] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-10T21:46:35.249689] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-10T21:46:35.415238] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-10T21:46:35.489370] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-10T21:46:36.289371] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-10T21:46:37.089359] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-10T21:46:37.565479] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T21:46:37.889409] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-10T21:46:38.209587] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T21:46:38.414225] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-10T21:46:38.689354] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-10T21:46:38.943140] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-10T21:46:39.440303] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-10T21:46:39.445346] [INFO ] [REMOTE ] SW: Full fetch complete (76826 records). [2025-10-10T21:46:39.445451] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-10T21:46:39.498321] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-10T21:46:39.830069] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-10T21:46:39.830148] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-10T21:46:39.831326] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-10T21:46:39.831390] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-10T21:46:39.832802] [DEBUG] [LOCAL ] SW: Trimmed 76826 records to 53963 (keeping 200 days of data) [2025-10-10T21:46:40.154556] [DEBUG] [LOCAL ] SW: Primary data saved (53963 records). [2025-10-10T21:46:40.154735] [INFO ] [MAIN ] SW: Full history saved. [2025-10-10T21:46:40.154826] [INFO ] [MAIN ] Update Progress: 2035/2373 symbols completed. SW took 40.1s. Estimated remaining: 47m 36s. Rate: 7.1 symbols/min [2025-10-10T21:46:40.293462] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-10T21:46:40.323345] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:46:40.359879] [DEBUG] [LOCAL ] SXC: Loaded 41724 existing records from primary storage. [2025-10-10T21:46:40.360165] [INFO ] [MAIN ] SXC: Loaded 41724 existing records. [2025-10-10T21:46:40.532119] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:46:40.532375] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-10T21:46:40.532422] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-10T21:46:40.532723] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-10T21:46:40.532783] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-10T21:46:40.882178] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:46:41.076292] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-10T21:46:41.089319] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-10T21:46:41.302842] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-10T21:46:41.307762] [INFO ] [REMOTE ] SWK: Full fetch complete (75310 records). [2025-10-10T21:46:41.307868] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-10T21:46:41.698813] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-10T21:46:41.698885] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-10T21:46:41.699990] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-10T21:46:41.700054] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-10T21:46:41.701548] [DEBUG] [LOCAL ] SWK: Trimmed 75310 records to 53204 (keeping 200 days of data) [2025-10-10T21:46:41.892093] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-10T21:46:42.034494] [DEBUG] [LOCAL ] SWK: Primary data saved (53204 records). [2025-10-10T21:46:42.034626] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-10T21:46:42.034743] [INFO ] [MAIN ] Update Progress: 2036/2373 symbols completed. SWK took 29.8s. Estimated remaining: 47m 27s. Rate: 7.1 symbols/min [2025-10-10T21:46:42.168973] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-10T21:46:42.213390] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:46:42.226997] [DEBUG] [LOCAL ] SXI: Loaded 11775 existing records from primary storage. [2025-10-10T21:46:42.227232] [INFO ] [MAIN ] SXI: Loaded 11775 existing records. [2025-10-10T21:46:42.402140] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:46:42.402414] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-10T21:46:42.402469] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-10T21:46:42.402983] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-10T21:46:42.403040] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-10T21:46:42.694578] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-10T21:46:42.758418] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:46:43.435250] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-10T21:46:43.466966] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-10T21:46:43.489338] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-10T21:46:43.980718] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-10T21:46:44.289376] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-10-10T21:46:45.089406] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-10-10T21:46:45.889377] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-10T21:46:46.064502] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-10T21:46:46.078202] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-10T21:46:46.654095] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-10T21:46:46.689334] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-10T21:46:47.489393] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-10T21:46:48.289403] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-10T21:46:48.446274] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-10T21:46:48.487982] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T21:46:49.089390] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-10T21:46:49.869316] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T21:46:49.889327] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-10T21:46:50.024557] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-10T21:46:50.689405] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-10T21:46:51.489348] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-10T21:46:51.596779] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T21:46:51.612849] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-10T21:46:52.289335] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-10T21:46:52.502695] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-10T21:46:53.089429] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-10T21:46:53.807931] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T21:46:53.823288] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-10T21:46:53.889368] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-10T21:46:54.689366] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-10T21:46:55.475006] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T21:46:55.489324] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-10T21:46:56.289476] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-10T21:46:56.290550] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-10T21:46:56.956030] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-10T21:46:57.089337] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-10T21:46:57.249879] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T21:46:57.889416] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-10T21:46:58.678783] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-10T21:46:58.689318] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-10T21:46:58.894353] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T21:46:59.282783] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-10T21:46:59.283859] [INFO ] [REMOTE ] SWZ: Full fetch complete (8187 records). [2025-10-10T21:46:59.283929] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-10T21:46:59.495629] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-10T21:46:59.635356] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-10T21:46:59.635430] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-10T21:46:59.635675] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-10T21:46:59.635737] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-10T21:46:59.636134] [DEBUG] [LOCAL ] SWZ: Trimmed 8187 records to 6168 (keeping 200 days of data) [2025-10-10T21:46:59.672920] [DEBUG] [LOCAL ] SWZ: Primary data saved (6168 records). [2025-10-10T21:46:59.673045] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-10T21:46:59.673146] [INFO ] [MAIN ] Update Progress: 2037/2373 symbols completed. SWZ took 28.9s. Estimated remaining: 47m 20s. Rate: 7.1 symbols/min [2025-10-10T21:47:00.289397] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-10T21:47:01.089367] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-10T21:47:01.919118] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-10T21:47:01.928899] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-10T21:47:01.980967] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T21:47:01.995405] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-10T21:47:02.689426] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-10T21:47:03.489360] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-10T21:47:03.590815] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-10T21:47:03.922570] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-10T21:47:03.925844] [INFO ] [REMOTE ] SWX: Full fetch complete (43927 records). [2025-10-10T21:47:03.925949] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-10T21:47:04.298005] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-10T21:47:04.300370] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-10T21:47:04.300446] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-10T21:47:04.301483] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-10T21:47:04.301563] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-10T21:47:04.303016] [DEBUG] [LOCAL ] SWX: Trimmed 43927 records to 31622 (keeping 200 days of data) [2025-10-10T21:47:04.497748] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-10T21:47:04.507204] [DEBUG] [LOCAL ] SWX: Primary data saved (31622 records). [2025-10-10T21:47:04.507292] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-10T21:47:04.507361] [INFO ] [MAIN ] Update Progress: 2038/2373 symbols completed. SWX took 36.3s. Estimated remaining: 47m 11s. Rate: 7.1 symbols/min [2025-10-10T21:47:05.089466] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-10T21:47:06.096867] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-10T21:47:06.106545] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-10T21:47:06.262100] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-10T21:47:06.689390] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-10T21:47:07.695753] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-10T21:47:07.695218] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T21:47:07.708817] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-10T21:47:08.289351] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-10T21:47:08.557391] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T21:47:08.559719] [INFO ] [REMOTE ] SXI: Full fetch complete (15204 records). [2025-10-10T21:47:08.559818] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-10T21:47:09.108099] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-10T21:47:09.108243] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-10T21:47:09.109115] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-10T21:47:09.109207] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-10T21:47:09.110281] [DEBUG] [LOCAL ] SXI: Trimmed 15204 records to 11909 (keeping 200 days of data) [2025-10-10T21:47:09.221606] [DEBUG] [LOCAL ] SXI: Primary data saved (11909 records). [2025-10-10T21:47:09.221790] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-10T21:47:09.221899] [INFO ] [MAIN ] Update Progress: 2039/2373 symbols completed. SXI took 27.2s. Estimated remaining: 47m 2s. Rate: 7.1 symbols/min [2025-10-10T21:47:09.995775] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T21:47:10.006092] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-10T21:47:11.708520] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-10T21:47:11.717183] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-10T21:47:13.189060] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-10T21:47:13.193870] [INFO ] [REMOTE ] SXC: Full fetch complete (60867 records). [2025-10-10T21:47:13.194034] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-10T21:47:13.594501] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-10T21:47:13.594604] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-10T21:47:13.596233] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-10T21:47:13.596301] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-10T21:47:13.598019] [DEBUG] [LOCAL ] SXC: Trimmed 60867 records to 42061 (keeping 200 days of data) [2025-10-10T21:47:13.858860] [DEBUG] [LOCAL ] SXC: Primary data saved (42061 records). [2025-10-10T21:47:13.859030] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-10T21:47:13.859126] [INFO ] [MAIN ] Update Progress: 2040/2373 symbols completed. SXC took 33.7s. Estimated remaining: 46m 53s. Rate: 7.1 symbols/min [2025-10-10T21:47:14.420431] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:47:14.448887] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:47:14.600189] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:47:14.603580] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:47:14.678213] [DEBUG] [LOCAL ] SYY: Loaded 53622 existing records from primary storage. [2025-10-10T21:47:14.696884] [INFO ] [MAIN ] SYY: Loaded 53622 existing records. [2025-10-10T21:47:14.733706] [DEBUG] [LOCAL ] SYF: Loaded 53836 existing records from primary storage. [2025-10-10T21:47:14.786475] [INFO ] [MAIN ] SYF: Loaded 53836 existing records. [2025-10-10T21:47:14.846230] [DEBUG] [LOCAL ] SXT: Loaded 30046 existing records from primary storage. [2025-10-10T21:47:14.901388] [INFO ] [MAIN ] SXT: Loaded 30046 existing records. [2025-10-10T21:47:14.985546] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:47:15.060853] [DEBUG] [LOCAL ] SYK: Loaded 47241 existing records from primary storage. [2025-10-10T21:47:15.095816] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-10T21:47:15.121985] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-10T21:47:15.122232] [INFO ] [MAIN ] SYK: Loaded 47241 existing records. [2025-10-10T21:47:15.161146] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-10T21:47:15.161325] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-10T21:47:15.456327] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:47:15.438771] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:47:15.491206] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-10T21:47:15.505866] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-10T21:47:15.516426] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-10T21:47:15.511210] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-10T21:47:15.548704] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-10T21:47:15.580098] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-10T21:47:15.590690] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-10T21:47:15.602059] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-10T21:47:15.659896] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:47:15.695253] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-10T21:47:15.776720] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-10T21:47:15.879080] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-10T21:47:15.884395] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-10T21:47:16.468492] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:47:16.500726] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-10-10T21:47:16.834480] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:47:16.856499] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-10-10T21:47:16.932712] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:47:16.948851] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-10-10T21:47:17.006443] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:47:17.006832] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-10-10T21:47:18.283192] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T21:47:18.287494] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-10T21:47:18.636535] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-10T21:47:18.647456] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-10T21:47:18.960106] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T21:47:18.971279] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-10T21:47:18.983169] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-10T21:47:18.987613] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-10T21:47:19.097106] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-10T21:47:19.107509] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-10T21:47:20.353510] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T21:47:20.358092] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-10T21:47:20.444394] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-10T21:47:20.455311] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-10T21:47:20.707199] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T21:47:20.717779] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-10T21:47:21.138733] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T21:47:21.149087] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-10T21:47:21.247097] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-10T21:47:21.253108] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-10T21:47:22.046153] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T21:47:22.056316] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-10T21:47:22.665501] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T21:47:22.689332] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-10T21:47:22.790550] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-10T21:47:22.881147] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T21:47:23.489435] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-10T21:47:24.183001] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-10T21:47:24.287741] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T21:47:24.298307] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-10T21:47:24.844562] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T21:47:25.089391] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-10T21:47:25.889379] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-10T21:47:26.366702] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-10T21:47:26.689375] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-10T21:47:27.188997] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-10T21:47:27.217721] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T21:47:27.489403] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-10T21:47:28.289389] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-10T21:47:28.818221] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T21:47:29.089414] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-10T21:47:29.626724] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-10T21:47:29.860848] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T21:47:29.889342] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-10T21:47:30.689381] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-10T21:47:31.172903] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-10T21:47:31.395572] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T21:47:31.489376] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-10T21:47:32.289409] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-10T21:47:32.834524] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-10T21:47:33.089391] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-10T21:47:33.554081] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-10T21:47:33.763134] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-10T21:47:33.889395] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-10T21:47:34.588812] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-10T21:47:34.689353] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-10T21:47:35.234013] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T21:47:35.237766] [INFO ] [REMOTE ] SXT: Full fetch complete (39147 records). [2025-10-10T21:47:35.237877] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-10T21:47:35.496879] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-10T21:47:35.639682] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-10T21:47:35.639815] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-10T21:47:35.641440] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-10T21:47:35.641509] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-10T21:47:35.642983] [DEBUG] [LOCAL ] SXT: Trimmed 39147 records to 30290 (keeping 200 days of data) [2025-10-10T21:47:35.843367] [DEBUG] [LOCAL ] SXT: Primary data saved (30290 records). [2025-10-10T21:47:35.843559] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-10T21:47:35.843686] [INFO ] [MAIN ] Update Progress: 2041/2373 symbols completed. SXT took 22.0s. Estimated remaining: 46m 46s. Rate: 7.1 symbols/min [2025-10-10T21:47:36.025262] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:47:36.085278] [DEBUG] [LOCAL ] T: Loaded 54188 existing records from primary storage. [2025-10-10T21:47:36.085716] [INFO ] [MAIN ] T: Loaded 54188 existing records. [2025-10-10T21:47:36.266746] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:47:36.267205] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-10T21:47:36.267271] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-10T21:47:36.267593] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-10T21:47:36.267800] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-10T21:47:36.300593] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-10T21:47:36.622409] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:47:36.844933] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-10T21:47:37.089366] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-10T21:47:37.548915] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T21:47:37.889378] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-10T21:47:37.941521] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T21:47:38.689363] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-10T21:47:39.153933] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-10T21:47:39.244632] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-10T21:47:39.489392] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-10T21:47:40.289398] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-10T21:47:40.750917] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-10T21:47:41.089362] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-10T21:47:41.344811] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T21:47:41.889406] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-10T21:47:42.366629] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T21:47:42.689439] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-10T21:47:43.225560] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T21:47:43.250839] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-10T21:47:43.255963] [INFO ] [REMOTE ] SYY: Full fetch complete (76986 records). [2025-10-10T21:47:43.256095] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-10T21:47:43.494517] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-10T21:47:43.648736] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-10T21:47:43.648949] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-10T21:47:43.650379] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-10T21:47:43.650445] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-10T21:47:43.652039] [DEBUG] [LOCAL ] SYY: Trimmed 76986 records to 54009 (keeping 200 days of data) [2025-10-10T21:47:43.901758] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T21:47:44.033109] [DEBUG] [LOCAL ] SYY: Primary data saved (54009 records). [2025-10-10T21:47:44.033262] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-10T21:47:44.033347] [INFO ] [MAIN ] Update Progress: 2042/2373 symbols completed. SYY took 30.2s. Estimated remaining: 46m 38s. Rate: 7.1 symbols/min [2025-10-10T21:47:44.201331] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:47:44.241578] [DEBUG] [LOCAL ] TAC: Loaded 43025 existing records from primary storage. [2025-10-10T21:47:44.241920] [INFO ] [MAIN ] TAC: Loaded 43025 existing records. [2025-10-10T21:47:44.302064] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-10-10T21:47:44.431976] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:47:44.433571] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-10T21:47:44.433410] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T21:47:44.433760] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-10T21:47:44.438789] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-10T21:47:44.438852] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-10T21:47:44.480608] [INFO ] [REMOTE ] SYF: Full fetch complete (77337 records). [2025-10-10T21:47:44.506339] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-10T21:47:45.105885] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:47:45.097541] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-10T21:47:45.210000] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-10T21:47:45.210089] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-10T21:47:45.211346] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-10T21:47:45.211410] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-10T21:47:45.213859] [DEBUG] [LOCAL ] SYF: Trimmed 77337 records to 54226 (keeping 200 days of data) [2025-10-10T21:47:45.542508] [DEBUG] [LOCAL ] SYF: Primary data saved (54226 records). [2025-10-10T21:47:45.542672] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-10T21:47:45.542780] [INFO ] [MAIN ] Update Progress: 2043/2373 symbols completed. SYF took 31.6s. Estimated remaining: 46m 28s. Rate: 7.1 symbols/min [2025-10-10T21:47:45.706842] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:47:45.753493] [DEBUG] [LOCAL ] TAK: Loaded 50348 existing records from primary storage. [2025-10-10T21:47:45.753838] [INFO ] [MAIN ] TAK: Loaded 50348 existing records. [2025-10-10T21:47:45.893339] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-10-10T21:47:45.929254] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:47:45.929550] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-10T21:47:45.929597] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-10T21:47:45.930272] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-10T21:47:45.930329] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-10T21:47:46.280958] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:47:46.689398] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-10-10T21:47:46.951470] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-10T21:47:47.016452] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T21:47:47.271371] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T21:47:47.489437] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-10T21:47:48.291325] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-10T21:47:48.579711] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T21:47:49.089391] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-10T21:47:49.748731] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T21:47:49.889337] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-10T21:47:50.118445] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-10T21:47:50.566512] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-10T21:47:50.689354] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-10T21:47:51.258919] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T21:47:51.489367] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-10T21:47:52.289420] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-10T21:47:52.471558] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T21:47:53.089405] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-10T21:47:53.316910] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-10T21:47:53.889395] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-10T21:47:54.699200] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-10T21:47:54.709599] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-10T21:47:54.806452] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-10T21:47:55.457783] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T21:47:55.463892] [INFO ] [REMOTE ] SYK: Full fetch complete (68898 records). [2025-10-10T21:47:55.464045] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-10T21:47:55.495388] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-10T21:47:55.891733] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T21:47:55.900972] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-10T21:47:55.901522] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-10T21:47:55.902906] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-10T21:47:55.902989] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-10T21:47:55.904469] [DEBUG] [LOCAL ] SYK: Trimmed 68898 records to 47599 (keeping 200 days of data) [2025-10-10T21:47:56.209503] [DEBUG] [LOCAL ] SYK: Primary data saved (47599 records). [2025-10-10T21:47:56.209660] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-10T21:47:56.209773] [INFO ] [MAIN ] Update Progress: 2044/2373 symbols completed. SYK took 42.3s. Estimated remaining: 46m 20s. Rate: 7.1 symbols/min [2025-10-10T21:47:56.298417] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-10T21:47:56.386899] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:47:56.446328] [DEBUG] [LOCAL ] TAL: Loaded 52193 existing records from primary storage. [2025-10-10T21:47:56.446942] [INFO ] [MAIN ] TAL: Loaded 52193 existing records. [2025-10-10T21:47:56.654371] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:47:56.654674] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-10T21:47:56.654739] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-10T21:47:56.654957] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-10T21:47:56.654999] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-10T21:47:57.014626] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:47:57.089437] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-10-10T21:47:57.889394] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-10T21:47:58.034689] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T21:47:58.260475] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-10-10T21:47:58.689384] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-10T21:47:59.075998] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-10T21:47:59.489366] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-10T21:47:59.928431] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T21:48:00.289367] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-10T21:48:00.450600] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T21:48:01.089423] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-10T21:48:01.870702] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-10T21:48:01.889370] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-10T21:48:02.285827] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-10-10T21:48:02.689413] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-10T21:48:02.737144] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T21:48:03.489333] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-10T21:48:03.745374] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-10T21:48:04.289411] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-10T21:48:05.089426] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-10T21:48:05.505788] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-10-10T21:48:05.552671] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-10T21:48:05.594312] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T21:48:05.889411] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-10T21:48:06.689428] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-10T21:48:07.176239] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-10T21:48:07.489396] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-10T21:48:07.910381] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-10T21:48:08.289350] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-10T21:48:08.383291] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T21:48:09.089362] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-10T21:48:09.764305] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-10T21:48:09.889403] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-10T21:48:10.122778] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T21:48:10.689381] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-10T21:48:11.489370] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-10T21:48:11.629143] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-10T21:48:11.752122] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T21:48:12.289397] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-10T21:48:12.755283] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T21:48:12.961258] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-10T21:48:13.089388] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-10T21:48:13.889372] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-10T21:48:14.689404] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-10T21:48:14.689948] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T21:48:14.696870] [INFO ] [REMOTE ] TAK: Full fetch complete (71743 records). [2025-10-10T21:48:14.697099] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-10T21:48:15.105202] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-10T21:48:15.105379] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-10T21:48:15.107434] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-10T21:48:15.107775] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-10T21:48:15.149161] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-10T21:48:15.149375] [DEBUG] [LOCAL ] TAK: Trimmed 71743 records to 50719 (keeping 200 days of data) [2025-10-10T21:48:15.471296] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T21:48:15.477924] [INFO ] [REMOTE ] TAC: Full fetch complete (63926 records). [2025-10-10T21:48:15.478745] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-10T21:48:15.496309] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-10T21:48:15.672605] [DEBUG] [LOCAL ] TAK: Primary data saved (50719 records). [2025-10-10T21:48:15.689298] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-10T21:48:15.711330] [INFO ] [MAIN ] Update Progress: 2045/2373 symbols completed. TAK took 30.2s. Estimated remaining: 46m 13s. Rate: 7.1 symbols/min [2025-10-10T21:48:16.075686] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:48:16.116361] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-10T21:48:16.116680] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-10T21:48:16.118862] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-10T21:48:16.119285] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-10T21:48:16.121573] [DEBUG] [LOCAL ] TAC: Trimmed 63926 records to 43404 (keeping 200 days of data) [2025-10-10T21:48:16.293038] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-10T21:48:16.423176] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-10T21:48:16.484861] [DEBUG] [LOCAL ] TALO: Loaded 51225 existing records from primary storage. [2025-10-10T21:48:16.490313] [DEBUG] [LOCAL ] TAC: Primary data saved (43404 records). [2025-10-10T21:48:16.490758] [INFO ] [MAIN ] TALO: Loaded 51225 existing records. [2025-10-10T21:48:16.490884] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-10T21:48:16.524319] [INFO ] [MAIN ] Update Progress: 2046/2373 symbols completed. TAC took 32.5s. Estimated remaining: 46m 4s. Rate: 7.1 symbols/min [2025-10-10T21:48:16.839384] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:48:16.868188] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-10T21:48:16.870218] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-10T21:48:16.888537] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-10T21:48:16.890420] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-10T21:48:16.890190] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:48:17.286587] [DEBUG] [LOCAL ] TAP: Loaded 53307 existing records from primary storage. [2025-10-10T21:48:17.321388] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:48:17.321980] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-10-10T21:48:17.322875] [INFO ] [MAIN ] TAP: Loaded 53307 existing records. [2025-10-10T21:48:17.538987] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:48:17.539554] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-10T21:48:17.539613] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-10T21:48:17.539858] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-10T21:48:17.539909] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-10T21:48:17.947168] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:48:17.947708] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-10-10T21:48:18.211403] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-10T21:48:18.406452] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T21:48:18.689387] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-10T21:48:19.175538] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T21:48:19.493997] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-10T21:48:19.500898] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T21:48:20.289384] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-10T21:48:21.089484] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-10T21:48:21.348981] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-10T21:48:21.399155] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T21:48:21.889478] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-10T21:48:22.124367] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-10T21:48:22.640407] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-10T21:48:22.646550] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-10-10T21:48:22.646816] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-10T21:48:22.694625] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-10T21:48:23.066064] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-10T21:48:23.066336] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-10T21:48:23.067621] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-10T21:48:23.067714] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-10T21:48:23.096460] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 54578 (keeping 200 days of data) [2025-10-10T21:48:23.098898] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-10T21:48:23.450596] [DEBUG] [LOCAL ] T: Primary data saved (54578 records). [2025-10-10T21:48:23.450768] [INFO ] [MAIN ] T: Full history saved. [2025-10-10T21:48:23.451363] [INFO ] [MAIN ] Update Progress: 2047/2373 symbols completed. T took 47.6s. Estimated remaining: 45m 55s. Rate: 7.1 symbols/min [2025-10-10T21:48:23.494590] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-10T21:48:23.621619] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:48:23.640382] [DEBUG] [LOCAL ] TBB: Loaded 11747 existing records from primary storage. [2025-10-10T21:48:23.640668] [INFO ] [MAIN ] TBB: Loaded 11747 existing records. [2025-10-10T21:48:23.813498] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:48:23.813808] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-10T21:48:23.813855] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-10T21:48:23.814157] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-10T21:48:23.814230] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-10T21:48:24.161785] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:48:24.289374] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-10T21:48:24.763608] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-10T21:48:24.868886] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T21:48:25.089413] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-10T21:48:25.889364] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-10T21:48:26.147381] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T21:48:26.689363] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-10T21:48:27.125548] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T21:48:27.220718] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-10T21:48:27.489371] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-10-10T21:48:28.289358] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-10T21:48:28.334137] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-10T21:48:28.424413] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T21:48:28.429271] [INFO ] [REMOTE ] TAL: Full fetch complete (75490 records). [2025-10-10T21:48:28.429400] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-10T21:48:28.812195] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-10T21:48:28.812294] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-10T21:48:28.813470] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-10T21:48:28.813533] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-10T21:48:28.815314] [DEBUG] [LOCAL ] TAL: Trimmed 75490 records to 52579 (keeping 200 days of data) [2025-10-10T21:48:29.105425] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-10T21:48:29.157003] [DEBUG] [LOCAL ] TAL: Primary data saved (52579 records). [2025-10-10T21:48:29.157164] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-10T21:48:29.157258] [INFO ] [MAIN ] Update Progress: 2048/2373 symbols completed. TAL took 32.9s. Estimated remaining: 45m 46s. Rate: 7.1 symbols/min [2025-10-10T21:48:29.322680] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:48:29.361752] [DEBUG] [LOCAL ] TBBB: Loaded 35892 existing records from primary storage. [2025-10-10T21:48:29.362059] [INFO ] [MAIN ] TBBB: Loaded 35892 existing records. [2025-10-10T21:48:29.548804] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:48:29.549052] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-10T21:48:29.549110] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-10T21:48:29.549331] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-10T21:48:29.549389] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-10T21:48:29.900909] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-10T21:48:29.934614] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:48:29.938608] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T21:48:30.689418] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-10-10T21:48:31.157319] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-10T21:48:31.341140] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-10T21:48:31.489384] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-10T21:48:32.295085] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-10T21:48:32.307970] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T21:48:32.389895] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T21:48:33.089379] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-10T21:48:33.889380] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-10T21:48:34.081023] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-10T21:48:34.114375] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T21:48:34.689410] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-10T21:48:35.046697] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-10T21:48:35.489377] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-10T21:48:35.636306] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-10T21:48:36.289401] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-10T21:48:37.089426] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-10T21:48:37.160401] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-10T21:48:37.234039] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T21:48:37.889382] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-10T21:48:38.689378] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-10T21:48:39.038301] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T21:48:39.490026] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-10T21:48:39.495547] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-10T21:48:40.185618] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-10T21:48:40.289346] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-10T21:48:41.089386] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-10T21:48:41.384058] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-10T21:48:41.889398] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-10T21:48:42.081672] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-10T21:48:42.392556] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-10T21:48:42.689362] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-10T21:48:43.489527] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-10T21:48:43.786219] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T21:48:44.289367] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-10T21:48:44.407163] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-10T21:48:44.754272] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-10T21:48:45.089394] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-10T21:48:45.889414] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-10T21:48:46.101079] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T21:48:46.689358] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-10T21:48:47.075107] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T21:48:47.489353] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-10T21:48:47.514907] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T21:48:48.272918] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T21:48:48.277824] [INFO ] [REMOTE ] TALO: Full fetch complete (73247 records). [2025-10-10T21:48:48.277958] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-10T21:48:48.299470] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-10T21:48:48.599522] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-10T21:48:48.685556] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-10T21:48:48.685688] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-10T21:48:48.687002] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-10T21:48:48.687106] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-10T21:48:48.688872] [DEBUG] [LOCAL ] TALO: Trimmed 73247 records to 51598 (keeping 200 days of data) [2025-10-10T21:48:49.017205] [DEBUG] [LOCAL ] TALO: Primary data saved (51598 records). [2025-10-10T21:48:49.017400] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-10T21:48:49.017503] [INFO ] [MAIN ] Update Progress: 2049/2373 symbols completed. TALO took 33.3s. Estimated remaining: 45m 40s. Rate: 7.1 symbols/min [2025-10-10T21:48:49.095979] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-10T21:48:49.203949] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:48:49.228878] [DEBUG] [LOCAL ] TBI: Loaded 22583 existing records from primary storage. [2025-10-10T21:48:49.229233] [INFO ] [MAIN ] TBI: Loaded 22583 existing records. [2025-10-10T21:48:49.426738] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:48:49.427327] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-10T21:48:49.427384] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-10T21:48:49.427746] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-10T21:48:49.427807] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-10T21:48:49.794448] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:48:49.889383] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-10-10T21:48:49.930408] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T21:48:50.109687] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-10T21:48:50.689429] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-10T21:48:51.205521] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T21:48:51.489369] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-10T21:48:51.597449] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-10T21:48:52.289387] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-10T21:48:52.734252] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T21:48:53.089439] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-10T21:48:53.126513] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T21:48:53.127965] [INFO ] [REMOTE ] TBB: Full fetch complete (16942 records). [2025-10-10T21:48:53.128036] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-10T21:48:53.521908] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-10T21:48:53.522004] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-10T21:48:53.522531] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-10T21:48:53.522588] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-10T21:48:53.523482] [DEBUG] [LOCAL ] TBB: Trimmed 16942 records to 11799 (keeping 200 days of data) [2025-10-10T21:48:53.632932] [DEBUG] [LOCAL ] TBB: Primary data saved (11799 records). [2025-10-10T21:48:53.633141] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-10T21:48:53.633272] [INFO ] [MAIN ] Update Progress: 2050/2373 symbols completed. TBB took 30.2s. Estimated remaining: 45m 30s. Rate: 7.1 symbols/min [2025-10-10T21:48:53.889400] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-10T21:48:53.916178] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:48:53.918135] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-10T21:48:53.918215] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-10T21:48:53.918366] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-10T21:48:53.918415] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-10T21:48:53.918462] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-10T21:48:53.918500] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-10T21:48:54.432640] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:48:54.621617] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T21:48:54.689355] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-10T21:48:55.489400] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-10T21:48:55.708370] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-10T21:48:55.714258] [INFO ] [REMOTE ] TAP: Full fetch complete (76214 records). [2025-10-10T21:48:55.714459] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-10T21:48:56.141896] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-10T21:48:56.142086] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-10T21:48:56.144267] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-10T21:48:56.145246] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-10T21:48:56.148198] [DEBUG] [LOCAL ] TAP: Trimmed 76214 records to 53692 (keeping 200 days of data) [2025-10-10T21:48:56.338390] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-10-10T21:48:56.512358] [DEBUG] [LOCAL ] TAP: Primary data saved (53692 records). [2025-10-10T21:48:56.512546] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-10T21:48:56.512707] [INFO ] [MAIN ] Update Progress: 2051/2373 symbols completed. TAP took 40.0s. Estimated remaining: 45m 21s. Rate: 7.1 symbols/min [2025-10-10T21:48:56.703019] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-10T21:48:56.742625] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:48:56.757848] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-10T21:48:56.768257] [DEBUG] [LOCAL ] TBN: Loaded 3895 existing records from primary storage. [2025-10-10T21:48:56.768559] [INFO ] [MAIN ] TBN: Loaded 3895 existing records. [2025-10-10T21:48:56.845506] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-10T21:48:56.967360] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:48:56.967673] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-10T21:48:56.967740] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-10T21:48:56.967959] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-10T21:48:56.968023] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-10T21:48:57.094528] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-10T21:48:57.353495] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:48:57.889415] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-10T21:48:58.332181] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-10T21:48:58.689355] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-10T21:48:58.803511] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T21:48:59.078208] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-10T21:48:59.489407] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-10-10T21:49:00.045636] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-10T21:49:00.289439] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-10T21:49:01.089398] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-10T21:49:01.174952] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T21:49:01.672809] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-10T21:49:01.889395] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-10T21:49:02.689394] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-10T21:49:03.184909] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T21:49:03.489373] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-10T21:49:04.246719] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-10T21:49:04.289342] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-10T21:49:04.351156] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-10T21:49:05.089454] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-10T21:49:05.473758] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-10T21:49:05.642832] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T21:49:05.646870] [INFO ] [REMOTE ] TBBB: Full fetch complete (51532 records). [2025-10-10T21:49:05.647009] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-10T21:49:05.894704] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-10T21:49:06.061993] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-10T21:49:06.062094] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-10T21:49:06.063444] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-10T21:49:06.063524] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-10T21:49:06.065218] [DEBUG] [LOCAL ] TBBB: Trimmed 51532 records to 36241 (keeping 200 days of data) [2025-10-10T21:49:06.296875] [DEBUG] [LOCAL ] TBBB: Primary data saved (36241 records). [2025-10-10T21:49:06.297140] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-10T21:49:06.297265] [INFO ] [MAIN ] Update Progress: 2052/2373 symbols completed. TBBB took 37.1s. Estimated remaining: 45m 13s. Rate: 7.1 symbols/min [2025-10-10T21:49:06.468209] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:49:06.468430] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-10T21:49:06.468468] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-10T21:49:06.468680] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-10T21:49:06.468735] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-10T21:49:06.468780] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-10T21:49:06.468815] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-10T21:49:06.698844] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-10T21:49:06.774254] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-10T21:49:06.850518] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:49:07.489430] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-10T21:49:08.148961] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-10T21:49:08.171670] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-10T21:49:08.289395] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-10-10T21:49:08.530067] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:49:08.530510] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-10-10T21:49:08.530608] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:49:08.530684] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-10T21:49:08.530751] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:49:08.530825] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-10T21:49:08.530894] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-10T21:49:08.530930] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-10T21:49:08.530969] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-10T21:49:08.531021] [INFO ] [MAIN ] Update Progress: 2053/2373 symbols completed. TCAI took 2.2s. Estimated remaining: 45m 3s. Rate: 7.1 symbols/min [2025-10-10T21:49:08.703603] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:49:08.719038] [DEBUG] [LOCAL ] TCBX: Loaded 10220 existing records from primary storage. [2025-10-10T21:49:08.719432] [INFO ] [MAIN ] TCBX: Loaded 10220 existing records. [2025-10-10T21:49:08.898684] [WARN ] [MAIN ] TCBX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:49:08.898989] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-10T21:49:08.899068] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-10T21:49:08.899327] [DEBUG] [LOCAL ] TCBX: Deleted primary data file. [2025-10-10T21:49:08.899383] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-10T21:49:09.094568] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-10T21:49:09.291321] [INFO ] [REMOTE ] TCBX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:49:09.889358] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-10T21:49:10.302698] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-10T21:49:10.479670] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T21:49:10.689421] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-10T21:49:11.489390] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-10T21:49:11.941271] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-10T21:49:11.962575] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-10T21:49:12.289375] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-10T21:49:12.699729] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-10T21:49:13.089435] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-10T21:49:13.889393] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-10T21:49:14.400540] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-10T21:49:14.689379] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-10T21:49:14.703552] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-10T21:49:15.078237] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-10T21:49:15.489386] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-10T21:49:16.024437] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-10T21:49:16.289399] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-10T21:49:16.841848] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-10T21:49:17.089409] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-10T21:49:17.889362] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-10T21:49:18.384054] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T21:49:18.529587] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-10T21:49:18.689400] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2024-12. [2025-10-10T21:49:19.489376] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-10T21:49:19.685830] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T21:49:20.289367] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-10T21:49:20.618107] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-10T21:49:20.625341] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T21:49:20.627959] [INFO ] [REMOTE ] TBI: Full fetch complete (31645 records). [2025-10-10T21:49:20.628038] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-10T21:49:21.022995] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-10T21:49:21.023146] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-10T21:49:21.024490] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-10T21:49:21.024556] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-10T21:49:21.025510] [DEBUG] [LOCAL ] TBI: Trimmed 31645 records to 22719 (keeping 200 days of data) [2025-10-10T21:49:21.109703] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-10T21:49:21.168254] [DEBUG] [LOCAL ] TBI: Primary data saved (22719 records). [2025-10-10T21:49:21.168450] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-10T21:49:21.168592] [INFO ] [MAIN ] Update Progress: 2054/2373 symbols completed. TBI took 32.2s. Estimated remaining: 44m 56s. Rate: 7.1 symbols/min [2025-10-10T21:49:21.348916] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:49:21.409089] [DEBUG] [LOCAL ] TD: Loaded 52741 existing records from primary storage. [2025-10-10T21:49:21.409551] [INFO ] [MAIN ] TD: Loaded 52741 existing records. [2025-10-10T21:49:21.536011] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-10T21:49:21.555892] [INFO ] [REMOTE ] TBLU: Full fetch complete (1189 records). [2025-10-10T21:49:21.577625] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-10T21:49:21.661796] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:49:21.680359] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-10T21:49:21.680519] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-10T21:49:21.703350] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-10T21:49:21.711548] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-10T21:49:21.894678] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-10T21:49:21.957213] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-10T21:49:21.979217] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-10T21:49:22.019349] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-10T21:49:22.070342] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-10T21:49:22.103775] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-10T21:49:22.130615] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-10T21:49:22.131053] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-10T21:49:22.131572] [INFO ] [MAIN ] Update Progress: 2055/2373 symbols completed. TBLU took 28.5s. Estimated remaining: 44m 46s. Rate: 7.1 symbols/min [2025-10-10T21:49:22.327337] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:49:22.398403] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:49:22.449203] [DEBUG] [LOCAL ] TDC: Loaded 46902 existing records from primary storage. [2025-10-10T21:49:22.449674] [INFO ] [MAIN ] TDC: Loaded 46902 existing records. [2025-10-10T21:49:22.630751] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:49:22.630996] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-10T21:49:22.631047] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-10T21:49:22.631324] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-10T21:49:22.631382] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-10T21:49:22.694526] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-10-10T21:49:22.700125] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-10T21:49:22.995295] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:49:23.489384] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-10-10T21:49:24.289404] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-01. [2025-10-10T21:49:24.765583] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-10T21:49:25.089414] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-10T21:49:25.323129] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T21:49:25.438014] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-10T21:49:25.889403] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-02. [2025-10-10T21:49:25.957153] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-10T21:49:26.689424] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-10T21:49:26.855825] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T21:49:27.489380] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-10T21:49:27.520904] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T21:49:27.522741] [INFO ] [REMOTE ] TBN: Full fetch complete (5762 records). [2025-10-10T21:49:27.522820] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-10T21:49:27.896258] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-10T21:49:27.896395] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-10T21:49:27.896876] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-10T21:49:27.896944] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-10T21:49:27.897387] [DEBUG] [LOCAL ] TBN: Trimmed 5762 records to 3943 (keeping 200 days of data) [2025-10-10T21:49:27.922420] [DEBUG] [LOCAL ] TBN: Primary data saved (3943 records). [2025-10-10T21:49:27.922569] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-10T21:49:27.922697] [INFO ] [MAIN ] Update Progress: 2056/2373 symbols completed. TBN took 31.4s. Estimated remaining: 44m 37s. Rate: 7.1 symbols/min [2025-10-10T21:49:28.096258] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:49:28.106394] [DEBUG] [LOCAL ] TDF: Loaded 6286 existing records from primary storage. [2025-10-10T21:49:28.106707] [INFO ] [MAIN ] TDF: Loaded 6286 existing records. [2025-10-10T21:49:28.284546] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:49:28.284879] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-10T21:49:28.284934] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-10T21:49:28.285088] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-10T21:49:28.285126] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-10T21:49:28.296407] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-03. [2025-10-10T21:49:28.642407] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:49:29.089409] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-10-10T21:49:29.319729] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-10T21:49:29.421219] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T21:49:29.889420] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-10T21:49:30.069395] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-10T21:49:30.689417] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-04. [2025-10-10T21:49:31.489399] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-10T21:49:31.895631] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T21:49:32.013659] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-10T21:49:32.289394] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-05. [2025-10-10T21:49:32.656094] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T21:49:33.089368] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-10T21:49:33.169214] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-10T21:49:33.889399] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-06. [2025-10-10T21:49:34.689420] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-10T21:49:34.747141] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-10T21:49:34.974120] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T21:49:35.489425] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-10T21:49:35.650176] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-10T21:49:36.289400] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-10T21:49:37.089398] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-07. [2025-10-10T21:49:37.186819] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T21:49:37.471581] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T21:49:37.889403] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-10T21:49:38.015008] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-10T21:49:38.689435] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-10T21:49:39.489366] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-08. [2025-10-10T21:49:39.591278] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-10T21:49:39.852853] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T21:49:40.000368] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-10T21:49:40.289385] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-10T21:49:41.089370] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-09. [2025-10-10T21:49:41.175083] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-10T21:49:41.889346] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-10T21:49:41.980160] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-10T21:49:42.689356] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-10T21:49:42.852755] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T21:49:43.489443] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-10T21:49:44.289388] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-10. [2025-10-10T21:49:44.569020] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T21:49:44.757679] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-10T21:49:44.759285] [INFO ] [REMOTE ] TCBX: Full fetch complete (15830 records). [2025-10-10T21:49:44.759355] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-10T21:49:45.094537] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-10T21:49:45.140609] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-10T21:49:45.140838] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-10T21:49:45.141728] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-10T21:49:45.141908] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-10T21:49:45.142557] [DEBUG] [LOCAL ] TCBX: Trimmed 15830 records to 10298 (keeping 200 days of data) [2025-10-10T21:49:45.208022] [DEBUG] [LOCAL ] TCBX: Primary data saved (10298 records). [2025-10-10T21:49:45.208240] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-10T21:49:45.208366] [INFO ] [MAIN ] Update Progress: 2057/2373 symbols completed. TCBX took 36.7s. Estimated remaining: 44m 30s. Rate: 7.1 symbols/min [2025-10-10T21:49:45.400919] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:49:45.471677] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T21:49:45.521748] [DEBUG] [LOCAL ] TDG: Loaded 22182 existing records from primary storage. [2025-10-10T21:49:45.522264] [INFO ] [MAIN ] TDG: Loaded 22182 existing records. [2025-10-10T21:49:45.818399] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:49:45.818849] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-10T21:49:45.818930] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-10T21:49:45.819251] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-10T21:49:45.819328] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-10T21:49:45.895037] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-10T21:49:45.925831] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-10T21:49:46.361725] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:49:46.689379] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-10T21:49:47.418445] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-10T21:49:47.489350] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-10T21:49:47.837579] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-10T21:49:48.217672] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-10T21:49:48.289408] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-10T21:49:49.090856] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-10T21:49:49.889382] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-10-10T21:49:50.056167] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-10T21:49:50.256048] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T21:49:50.689405] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-10T21:49:51.373021] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T21:49:51.489482] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-10T21:49:52.289408] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-10T21:49:52.614302] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-10T21:49:53.089388] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-10T21:49:53.265220] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T21:49:53.571618] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-10T21:49:53.573012] [INFO ] [REMOTE ] TDF: Full fetch complete (10348 records). [2025-10-10T21:49:53.573093] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-10T21:49:53.720751] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-10T21:49:53.896319] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-10T21:49:53.989622] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-10T21:49:53.989790] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-10T21:49:53.990282] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-10T21:49:53.990348] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-10T21:49:53.990956] [DEBUG] [LOCAL ] TDF: Trimmed 10348 records to 6355 (keeping 200 days of data) [2025-10-10T21:49:54.032529] [DEBUG] [LOCAL ] TDF: Primary data saved (6355 records). [2025-10-10T21:49:54.032736] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-10T21:49:54.032875] [INFO ] [MAIN ] Update Progress: 2058/2373 symbols completed. TDF took 26.1s. Estimated remaining: 44m 22s. Rate: 7.1 symbols/min [2025-10-10T21:49:54.206337] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:49:54.261194] [DEBUG] [LOCAL ] TDOC: Loaded 53739 existing records from primary storage. [2025-10-10T21:49:54.261515] [INFO ] [MAIN ] TDOC: Loaded 53739 existing records. [2025-10-10T21:49:54.450957] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:49:54.451175] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-10T21:49:54.451222] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-10T21:49:54.451487] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-10T21:49:54.451544] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-10T21:49:54.689467] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-10T21:49:54.798403] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:49:55.240312] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T21:49:55.489390] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-10T21:49:56.289377] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-10-10T21:49:56.811913] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T21:49:56.835784] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T21:49:57.089392] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-10T21:49:57.889348] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-10T21:49:58.158066] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T21:49:58.689366] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-10T21:49:59.147371] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-10T21:49:59.489361] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-10T21:49:59.695854] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T21:50:00.194229] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-10T21:50:00.289332] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-10T21:50:01.089399] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-10T21:50:01.797108] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-10T21:50:01.863310] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-10T21:50:01.889417] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-10T21:50:02.689377] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-10T21:50:03.076537] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T21:50:03.489430] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-10T21:50:03.978409] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-10T21:50:04.289409] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-10T21:50:04.674882] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-10-10T21:50:05.089355] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-10T21:50:05.263093] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T21:50:05.541390] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-10T21:50:05.889373] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-10T21:50:06.689424] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-10T21:50:07.303497] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-10T21:50:07.489362] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-10T21:50:07.953057] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-10T21:50:08.289356] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-10T21:50:08.378468] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-10T21:50:08.383149] [INFO ] [REMOTE ] TDC: Full fetch complete (67257 records). [2025-10-10T21:50:08.383248] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-10T21:50:08.759765] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-10T21:50:08.759842] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-10T21:50:08.760907] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-10T21:50:08.760966] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-10T21:50:08.762170] [DEBUG] [LOCAL ] TDC: Trimmed 67257 records to 47272 (keeping 200 days of data) [2025-10-10T21:50:09.032563] [DEBUG] [LOCAL ] TDC: Primary data saved (47272 records). [2025-10-10T21:50:09.032719] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-10T21:50:09.032809] [INFO ] [MAIN ] Update Progress: 2059/2373 symbols completed. TDC took 46.9s. Estimated remaining: 44m 14s. Rate: 7.1 symbols/min [2025-10-10T21:50:09.094720] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-10T21:50:09.206414] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:50:09.245166] [DEBUG] [LOCAL ] TDS: Loaded 42883 existing records from primary storage. [2025-10-10T21:50:09.245443] [INFO ] [MAIN ] TDS: Loaded 42883 existing records. [2025-10-10T21:50:09.418493] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:50:09.418713] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-10T21:50:09.418768] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-10T21:50:09.418948] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-10T21:50:09.418985] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-10T21:50:09.777834] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:50:09.807126] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-10T21:50:09.889333] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-10-10T21:50:10.111691] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-10T21:50:10.116598] [INFO ] [REMOTE ] TD: Full fetch complete (75781 records). [2025-10-10T21:50:10.116747] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-10T21:50:10.545248] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-10T21:50:10.545373] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-10T21:50:10.546972] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-10T21:50:10.547070] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-10T21:50:10.549180] [DEBUG] [LOCAL ] TD: Trimmed 75781 records to 53114 (keeping 200 days of data) [2025-10-10T21:50:10.740766] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-10T21:50:10.799429] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-10T21:50:10.934506] [DEBUG] [LOCAL ] TD: Primary data saved (53114 records). [2025-10-10T21:50:10.934728] [INFO ] [MAIN ] TD: Full history saved. [2025-10-10T21:50:10.934847] [INFO ] [MAIN ] Update Progress: 2060/2373 symbols completed. TD took 49.8s. Estimated remaining: 44m 5s. Rate: 7.1 symbols/min [2025-10-10T21:50:11.112341] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:50:11.164090] [DEBUG] [LOCAL ] TDW: Loaded 45430 existing records from primary storage. [2025-10-10T21:50:11.164514] [INFO ] [MAIN ] TDW: Loaded 45430 existing records. [2025-10-10T21:50:11.362006] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:50:11.362500] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-10T21:50:11.362590] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-10T21:50:11.363024] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-10T21:50:11.363107] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-10T21:50:11.474438] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-10T21:50:11.509610] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-10T21:50:11.801505] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:50:12.289404] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-10T21:50:12.971030] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T21:50:13.023731] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-10T21:50:13.089393] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-10T21:50:13.889450] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-10-10T21:50:14.009385] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-10T21:50:14.689381] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-10T21:50:15.279006] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-10T21:50:15.425444] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T21:50:15.489417] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-10T21:50:16.289400] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-10T21:50:16.481094] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T21:50:16.906009] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T21:50:16.909007] [INFO ] [REMOTE ] TDG: Full fetch complete (31778 records). [2025-10-10T21:50:16.909107] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-10T21:50:17.091176] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-10T21:50:17.325639] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-10T21:50:17.325821] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-10T21:50:17.327109] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-10T21:50:17.327231] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-10T21:50:17.329197] [DEBUG] [LOCAL ] TDG: Trimmed 31778 records to 22311 (keeping 200 days of data) [2025-10-10T21:50:17.514712] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T21:50:17.548705] [DEBUG] [LOCAL ] TDG: Primary data saved (22311 records). [2025-10-10T21:50:17.548905] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-10T21:50:17.549042] [INFO ] [MAIN ] Update Progress: 2061/2373 symbols completed. TDG took 32.3s. Estimated remaining: 43m 56s. Rate: 7.1 symbols/min [2025-10-10T21:50:17.736111] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:50:17.765685] [DEBUG] [LOCAL ] TDY: Loaded 22540 existing records from primary storage. [2025-10-10T21:50:17.766044] [INFO ] [MAIN ] TDY: Loaded 22540 existing records. [2025-10-10T21:50:17.894525] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-10T21:50:17.955235] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:50:17.955520] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-10T21:50:17.955579] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-10T21:50:17.955897] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-10T21:50:17.955958] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-10T21:50:18.319509] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:50:18.689410] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-10T21:50:19.489393] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-10-10T21:50:19.609353] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T21:50:19.700401] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-10T21:50:20.289393] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-10T21:50:20.513700] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T21:50:20.865303] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T21:50:21.089402] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-10T21:50:21.889396] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-10T21:50:22.371306] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T21:50:22.689388] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-10T21:50:23.026795] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T21:50:23.489391] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-10T21:50:23.728544] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-10T21:50:24.162775] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-10T21:50:24.289379] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-10T21:50:25.089396] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-10T21:50:25.369332] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T21:50:25.452316] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T21:50:25.889390] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-10T21:50:26.382740] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T21:50:26.689407] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-10T21:50:27.489404] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-10T21:50:27.678287] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T21:50:28.300690] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-10T21:50:28.307571] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-10T21:50:29.065266] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T21:50:29.089386] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-10T21:50:29.737433] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-10T21:50:29.889419] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-10T21:50:30.689408] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-10T21:50:30.918374] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T21:50:31.317995] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-10T21:50:31.489373] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-10T21:50:32.289363] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-10T21:50:32.429731] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T21:50:32.892467] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-10T21:50:33.089440] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-10T21:50:33.889355] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-10T21:50:34.357930] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-10T21:50:34.364343] [INFO ] [REMOTE ] TDOC: Full fetch complete (77304 records). [2025-10-10T21:50:34.364551] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-10T21:50:34.697540] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-10T21:50:34.771203] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-10T21:50:34.771603] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-10T21:50:34.773107] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-10T21:50:34.773202] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-10T21:50:34.790853] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T21:50:34.796273] [DEBUG] [LOCAL ] TDOC: Trimmed 77304 records to 54129 (keeping 200 days of data) [2025-10-10T21:50:35.048773] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T21:50:35.182198] [DEBUG] [LOCAL ] TDOC: Primary data saved (54129 records). [2025-10-10T21:50:35.182410] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-10T21:50:35.182539] [INFO ] [MAIN ] Update Progress: 2062/2373 symbols completed. TDOC took 41.1s. Estimated remaining: 43m 49s. Rate: 7.1 symbols/min [2025-10-10T21:50:35.363850] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:50:35.364091] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-10T21:50:35.364131] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-10T21:50:35.364324] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-10T21:50:35.364397] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-10T21:50:35.364446] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-10T21:50:35.364481] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-10T21:50:35.494465] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-10T21:50:35.736386] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:50:36.289384] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-10T21:50:36.635619] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-10T21:50:37.089401] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-10T21:50:37.285699] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-10T21:50:37.857103] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-10T21:50:37.889337] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-10T21:50:38.689363] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-10T21:50:38.905632] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T21:50:39.140853] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-10T21:50:39.489419] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-10T21:50:40.289345] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-10T21:50:40.315809] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T21:50:40.319733] [INFO ] [REMOTE ] TDS: Full fetch complete (61540 records). [2025-10-10T21:50:40.319818] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-10T21:50:40.697743] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-10T21:50:40.698067] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-10T21:50:40.699166] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-10T21:50:40.699242] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-10T21:50:40.700516] [DEBUG] [LOCAL ] TDS: Trimmed 61540 records to 43218 (keeping 200 days of data) [2025-10-10T21:50:40.964946] [DEBUG] [LOCAL ] TDS: Primary data saved (43218 records). [2025-10-10T21:50:40.965091] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-10T21:50:40.965797] [INFO ] [MAIN ] Update Progress: 2063/2373 symbols completed. TDS took 31.9s. Estimated remaining: 43m 40s. Rate: 7.1 symbols/min [2025-10-10T21:50:41.090756] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-10-10T21:50:41.134449] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:50:41.146101] [DEBUG] [LOCAL ] TEAF: Loaded 7566 existing records from primary storage. [2025-10-10T21:50:41.146314] [INFO ] [MAIN ] TEAF: Loaded 7566 existing records. [2025-10-10T21:50:41.348017] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:50:41.348260] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-10T21:50:41.348311] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-10T21:50:41.348910] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-10T21:50:41.350051] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T21:50:41.348971] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-10T21:50:41.420320] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:50:41.437004] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-10-10T21:50:41.464884] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:50:41.465071] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-10T21:50:41.465662] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:50:41.476211] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-10T21:50:41.481505] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-10T21:50:41.486717] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-10T21:50:41.515388] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-10T21:50:41.539874] [INFO ] [MAIN ] Update Progress: 2064/2373 symbols completed. TE took 6.4s. Estimated remaining: 43m 31s. Rate: 7.1 symbols/min [2025-10-10T21:50:41.666225] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T21:50:41.923821] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:50:41.900735] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-10T21:50:41.937791] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:50:41.990788] [DEBUG] [LOCAL ] TECK: Loaded 53829 existing records from primary storage. [2025-10-10T21:50:41.991093] [INFO ] [MAIN ] TECK: Loaded 53829 existing records. [2025-10-10T21:50:42.173951] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:50:42.174196] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-10T21:50:42.174247] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-10T21:50:42.174464] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-10T21:50:42.174522] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-10T21:50:42.539678] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:50:42.544749] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-10T21:50:42.547082] [INFO ] [REMOTE ] TDY: Full fetch complete (31934 records). [2025-10-10T21:50:42.547161] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-10T21:50:42.694482] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-10-10T21:50:42.930938] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-10T21:50:42.931016] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-10T21:50:42.931842] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-10T21:50:42.931905] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-10T21:50:42.932606] [DEBUG] [LOCAL ] TDY: Trimmed 31934 records to 22699 (keeping 200 days of data) [2025-10-10T21:50:43.079409] [DEBUG] [LOCAL ] TDY: Primary data saved (22699 records). [2025-10-10T21:50:43.079545] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-10T21:50:43.079631] [INFO ] [MAIN ] Update Progress: 2065/2373 symbols completed. TDY took 25.5s. Estimated remaining: 43m 21s. Rate: 7.1 symbols/min [2025-10-10T21:50:43.255889] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:50:43.294126] [DEBUG] [LOCAL ] TEF: Loaded 37317 existing records from primary storage. [2025-10-10T21:50:43.294461] [INFO ] [MAIN ] TEF: Loaded 37317 existing records. [2025-10-10T21:50:43.466838] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:50:43.467070] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-10T21:50:43.467134] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-10T21:50:43.467360] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-10T21:50:43.467416] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-10T21:50:43.497144] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-10T21:50:43.813439] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:50:44.289401] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-10-10T21:50:44.722984] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-10T21:50:45.089379] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-10-10T21:50:45.186826] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-10T21:50:45.191572] [INFO ] [REMOTE ] TDW: Full fetch complete (66901 records). [2025-10-10T21:50:45.191746] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-10T21:50:45.310450] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T21:50:45.603594] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-10T21:50:45.603725] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-10T21:50:45.605317] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-10T21:50:45.605384] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-10T21:50:45.607438] [DEBUG] [LOCAL ] TDW: Trimmed 66901 records to 45772 (keeping 200 days of data) [2025-10-10T21:50:45.878062] [DEBUG] [LOCAL ] TDW: Primary data saved (45772 records). [2025-10-10T21:50:45.878208] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-10T21:50:45.878296] [INFO ] [MAIN ] Update Progress: 2066/2373 symbols completed. TDW took 34.9s. Estimated remaining: 43m 12s. Rate: 7.1 symbols/min [2025-10-10T21:50:45.898798] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-10T21:50:46.058103] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:50:46.083697] [DEBUG] [LOCAL ] TEI: Loaded 21591 existing records from primary storage. [2025-10-10T21:50:46.084072] [INFO ] [MAIN ] TEI: Loaded 21591 existing records. [2025-10-10T21:50:46.270456] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:50:46.270804] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-10T21:50:46.270888] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-10T21:50:46.271200] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-10T21:50:46.271260] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-10T21:50:46.647056] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:50:46.689363] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-10T21:50:46.729706] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-10T21:50:46.743001] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-10T21:50:47.489423] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-10T21:50:48.289406] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-10-10T21:50:48.614390] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T21:50:49.089334] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-10T21:50:49.224095] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T21:50:49.312827] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T21:50:49.889366] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-10T21:50:50.468139] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T21:50:50.594917] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-10T21:50:50.689329] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-10T21:50:51.489418] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-10T21:50:51.971336] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T21:50:52.289365] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-10T21:50:53.089347] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-10T21:50:53.185996] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-10T21:50:53.554732] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-10T21:50:53.761146] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-10T21:50:53.889430] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-10T21:50:54.689438] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-10T21:50:55.489368] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-10T21:50:56.024861] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T21:50:56.289373] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-10T21:50:56.492951] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-10T21:50:56.816823] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-10T21:50:57.089405] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-10T21:50:57.157264] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-10T21:50:57.889403] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-10T21:50:58.689368] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-10T21:50:58.793993] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-10T21:50:58.825287] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T21:50:59.489400] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-10T21:50:59.948920] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T21:51:00.289420] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-10T21:51:01.089379] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-10T21:51:01.787048] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-10T21:51:01.889344] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-10T21:51:02.081614] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T21:51:02.102926] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-10T21:51:02.689421] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-10T21:51:03.489381] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-10T21:51:03.852929] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T21:51:03.975278] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T21:51:04.193057] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-10T21:51:04.289373] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-10T21:51:05.089378] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-10T21:51:05.675423] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-10T21:51:05.889356] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-10T21:51:05.987297] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-10T21:51:06.689370] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-10T21:51:07.269316] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T21:51:07.270536] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-10T21:51:07.489425] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-10T21:51:08.289395] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-10T21:51:09.055085] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-10T21:51:09.089351] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-10T21:51:09.505536] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T21:51:09.889347] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-10T21:51:09.973834] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-10T21:51:10.689384] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-10T21:51:11.489380] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-10T21:51:12.116063] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-10T21:51:12.145405] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-10T21:51:12.289383] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-10T21:51:13.089351] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-10T21:51:13.115743] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T21:51:13.474597] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-10T21:51:13.478964] [INFO ] [REMOTE ] TEI: Full fetch complete (30978 records). [2025-10-10T21:51:13.479088] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-10T21:51:13.846538] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T21:51:13.861156] [INFO ] [REMOTE ] TEAF: Full fetch complete (9963 records). [2025-10-10T21:51:13.861059] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-10T21:51:13.861265] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-10T21:51:13.861470] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-10T21:51:13.894499] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-10T21:51:13.900816] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-10T21:51:13.948588] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-10T21:51:13.987434] [DEBUG] [LOCAL ] TEI: Trimmed 30978 records to 21784 (keeping 200 days of data) [2025-10-10T21:51:14.322012] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-10T21:51:14.322816] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-10T21:51:14.323528] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-10T21:51:14.323616] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-10T21:51:14.325225] [DEBUG] [LOCAL ] TEAF: Trimmed 9963 records to 7606 (keeping 200 days of data) [2025-10-10T21:51:14.382441] [DEBUG] [LOCAL ] TEAF: Primary data saved (7606 records). [2025-10-10T21:51:14.384004] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-10T21:51:14.385416] [INFO ] [MAIN ] Update Progress: 2067/2373 symbols completed. TEAF took 33.4s. Estimated remaining: 43m 6s. Rate: 7.1 symbols/min [2025-10-10T21:51:14.577461] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:51:14.604123] [DEBUG] [LOCAL ] TEI: Primary data saved (21784 records). [2025-10-10T21:51:14.604320] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-10T21:51:14.604429] [INFO ] [MAIN ] Update Progress: 2068/2373 symbols completed. TEI took 28.7s. Estimated remaining: 42m 57s. Rate: 7.1 symbols/min [2025-10-10T21:51:14.690614] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-10T21:51:14.808969] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:51:14.826250] [DEBUG] [LOCAL ] TEL: Loaded 51443 existing records from primary storage. [2025-10-10T21:51:14.826818] [INFO ] [MAIN ] TEL: Loaded 51443 existing records. [2025-10-10T21:51:15.056135] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:51:15.067561] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-10T21:51:15.067732] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-10T21:51:15.068284] [DEBUG] [LOCAL ] TEN: Loaded 30606 existing records from primary storage. [2025-10-10T21:51:15.068636] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-10T21:51:15.068875] [INFO ] [MAIN ] TEN: Loaded 30606 existing records. [2025-10-10T21:51:15.068972] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-10T21:51:15.415001] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:51:15.449429] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-10T21:51:15.494687] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-10T21:51:15.526241] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-10T21:51:15.541798] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-10T21:51:15.709804] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:51:15.738790] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-10-10T21:51:15.809897] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T21:51:16.047345] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:51:16.289378] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-10T21:51:16.753765] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-10T21:51:17.089391] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-10T21:51:17.789326] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-10T21:51:17.889354] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-10T21:51:17.979800] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-10T21:51:18.689393] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-10-10T21:51:19.283799] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-10T21:51:19.446509] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-10T21:51:19.450301] [INFO ] [REMOTE ] TEF: Full fetch complete (54752 records). [2025-10-10T21:51:19.450399] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-10T21:51:19.494610] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-10T21:51:19.853119] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-10T21:51:19.853350] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-10T21:51:19.854598] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-10T21:51:19.854743] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-10T21:51:19.856107] [DEBUG] [LOCAL ] TEF: Trimmed 54752 records to 37625 (keeping 200 days of data) [2025-10-10T21:51:19.961561] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-10T21:51:20.112955] [DEBUG] [LOCAL ] TEF: Primary data saved (37625 records). [2025-10-10T21:51:20.113188] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-10T21:51:20.113345] [INFO ] [MAIN ] Update Progress: 2069/2373 symbols completed. TEF took 37.0s. Estimated remaining: 42m 48s. Rate: 7.1 symbols/min [2025-10-10T21:51:20.289101] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:51:20.289402] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-10T21:51:20.315234] [DEBUG] [LOCAL ] TEO: Loaded 22593 existing records from primary storage. [2025-10-10T21:51:20.315547] [INFO ] [MAIN ] TEO: Loaded 22593 existing records. [2025-10-10T21:51:20.526774] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:51:20.527050] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-10T21:51:20.527120] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-10T21:51:20.527371] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-10T21:51:20.527449] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-10T21:51:20.920261] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:51:21.089340] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-10-10T21:51:21.395101] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T21:51:21.400276] [INFO ] [REMOTE ] TECK: Full fetch complete (77317 records). [2025-10-10T21:51:21.400421] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-10T21:51:21.790735] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-10T21:51:21.790891] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-10T21:51:21.792205] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-10T21:51:21.792269] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-10T21:51:21.815519] [DEBUG] [LOCAL ] TECK: Trimmed 77317 records to 54219 (keeping 200 days of data) [2025-10-10T21:51:21.816946] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-10T21:51:21.912177] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-10T21:51:22.063414] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-10T21:51:22.180828] [DEBUG] [LOCAL ] TECK: Primary data saved (54219 records). [2025-10-10T21:51:22.180998] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-10T21:51:22.181086] [INFO ] [MAIN ] Update Progress: 2070/2373 symbols completed. TECK took 40.6s. Estimated remaining: 42m 38s. Rate: 7.1 symbols/min [2025-10-10T21:51:22.345613] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:51:22.397229] [DEBUG] [LOCAL ] TEVA: Loaded 54020 existing records from primary storage. [2025-10-10T21:51:22.397545] [INFO ] [MAIN ] TEVA: Loaded 54020 existing records. [2025-10-10T21:51:22.571227] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:51:22.571474] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-10T21:51:22.571522] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-10T21:51:22.571768] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-10T21:51:22.571824] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-10T21:51:22.694601] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-10T21:51:22.936893] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:51:23.489358] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-10-10T21:51:23.850399] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T21:51:23.937492] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-10T21:51:24.289363] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-10T21:51:25.089372] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-10T21:51:25.224989] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-10T21:51:25.419345] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-10T21:51:25.889363] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-10T21:51:26.694712] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-10T21:51:26.706465] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T21:51:27.121411] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-10T21:51:27.489450] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-10T21:51:28.289379] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-10T21:51:28.898351] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-10T21:51:28.964469] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-10T21:51:29.089396] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-10T21:51:29.834528] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T21:51:29.889386] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-10T21:51:30.294751] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T21:51:30.689379] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-10T21:51:31.489347] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-10T21:51:31.616491] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T21:51:32.289370] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-10T21:51:32.323081] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T21:51:32.428393] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-10T21:51:33.089387] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-10T21:51:33.889376] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-10T21:51:34.614510] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-10T21:51:34.689361] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-10T21:51:34.774194] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-10T21:51:35.069826] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T21:51:35.489444] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-10T21:51:36.289443] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-10T21:51:36.467713] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-10T21:51:36.757219] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-10T21:51:37.089397] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-10T21:51:37.889358] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-10T21:51:38.441346] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-10T21:51:38.525042] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-10T21:51:38.692841] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-10T21:51:38.696873] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-10T21:51:39.489369] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-10T21:51:40.175314] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T21:51:40.289334] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-10T21:51:41.089335] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-10T21:51:41.518958] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-10T21:51:41.521669] [INFO ] [REMOTE ] TEO: Full fetch complete (32606 records). [2025-10-10T21:51:41.521745] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-10T21:51:41.844464] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-10T21:51:41.893404] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-10T21:51:41.943682] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-10T21:51:41.943783] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-10T21:51:41.944525] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-10T21:51:41.944567] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-10T21:51:41.945496] [DEBUG] [LOCAL ] TEO: Trimmed 32606 records to 22786 (keeping 200 days of data) [2025-10-10T21:51:42.072188] [DEBUG] [LOCAL ] TEO: Primary data saved (22786 records). [2025-10-10T21:51:42.072324] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-10T21:51:42.072405] [INFO ] [MAIN ] Update Progress: 2071/2373 symbols completed. TEO took 22.0s. Estimated remaining: 42m 32s. Rate: 7.1 symbols/min [2025-10-10T21:51:42.238386] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:51:42.277877] [DEBUG] [LOCAL ] TEX: Loaded 44337 existing records from primary storage. [2025-10-10T21:51:42.278187] [INFO ] [MAIN ] TEX: Loaded 44337 existing records. [2025-10-10T21:51:42.459707] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:51:42.460005] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-10T21:51:42.460062] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-10T21:51:42.460414] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-10T21:51:42.460498] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-10T21:51:42.697927] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-10T21:51:42.822939] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:51:42.853903] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T21:51:43.489355] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-10T21:51:43.645305] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T21:51:44.289418] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-10T21:51:45.089399] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-10-10T21:51:45.138812] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-10T21:51:45.508506] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T21:51:45.889359] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-10T21:51:45.977696] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-10T21:51:46.689495] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-10T21:51:46.904442] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-10T21:51:47.489427] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-10T21:51:47.828917] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T21:51:48.295432] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-10T21:51:48.310771] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-10T21:51:49.089431] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-10T21:51:49.230897] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-10T21:51:49.889452] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-10T21:51:50.089023] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-10T21:51:50.212934] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T21:51:50.689481] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-10T21:51:51.489434] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-10T21:51:51.689201] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T21:51:52.233071] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-10T21:51:52.289334] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-10T21:51:53.089370] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-10T21:51:53.422851] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T21:51:53.543258] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-10T21:51:53.546009] [INFO ] [REMOTE ] TEN: Full fetch complete (43868 records). [2025-10-10T21:51:53.546188] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-10T21:51:53.895205] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-10T21:51:53.909105] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-10T21:51:53.909192] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-10T21:51:53.910031] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-10T21:51:53.910188] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-10T21:51:53.911113] [DEBUG] [LOCAL ] TEN: Trimmed 43868 records to 30810 (keeping 200 days of data) [2025-10-10T21:51:54.093333] [DEBUG] [LOCAL ] TEN: Primary data saved (30810 records). [2025-10-10T21:51:54.093472] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-10T21:51:54.093555] [INFO ] [MAIN ] Update Progress: 2072/2373 symbols completed. TEN took 39.5s. Estimated remaining: 42m 24s. Rate: 7.1 symbols/min [2025-10-10T21:51:54.258110] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:51:54.317824] [DEBUG] [LOCAL ] TFC: Loaded 54057 existing records from primary storage. [2025-10-10T21:51:54.318133] [INFO ] [MAIN ] TFC: Loaded 54057 existing records. [2025-10-10T21:51:54.489005] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:51:54.489221] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-10T21:51:54.489268] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-10T21:51:54.489482] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-10T21:51:54.489537] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-10T21:51:54.695029] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-10T21:51:54.841294] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:51:55.104440] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-10T21:51:55.190794] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-10T21:51:55.195486] [INFO ] [REMOTE ] TEL: Full fetch complete (73387 records). [2025-10-10T21:51:55.195609] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-10T21:51:55.509901] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-10-10T21:51:55.602405] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-10T21:51:55.602491] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-10T21:51:55.603671] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-10T21:51:55.603735] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-10T21:51:55.605162] [DEBUG] [LOCAL ] TEL: Trimmed 73387 records to 51770 (keeping 200 days of data) [2025-10-10T21:51:55.935950] [DEBUG] [LOCAL ] TEL: Primary data saved (51770 records). [2025-10-10T21:51:55.936095] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-10T21:51:55.936524] [INFO ] [MAIN ] Update Progress: 2073/2373 symbols completed. TEL took 41.6s. Estimated remaining: 42m 14s. Rate: 7.1 symbols/min [2025-10-10T21:51:56.106737] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:51:56.141560] [DEBUG] [LOCAL ] TFII: Loaded 33623 existing records from primary storage. [2025-10-10T21:51:56.141866] [INFO ] [MAIN ] TFII: Loaded 33623 existing records. [2025-10-10T21:51:56.290215] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-10T21:51:56.321333] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:51:56.323023] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-10T21:51:56.323233] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-10T21:51:56.339752] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-10T21:51:56.350145] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-10T21:51:56.437133] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-10T21:51:56.720662] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:51:57.089405] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-10T21:51:57.709757] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-10T21:51:57.889389] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-10-10T21:51:58.229914] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T21:51:58.689442] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-10T21:51:58.808036] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-10T21:51:59.400718] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-10T21:51:59.489380] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-10T21:52:00.289368] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-10T21:52:00.531128] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T21:52:01.010369] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-10T21:52:01.089467] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-10T21:52:01.815019] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-10T21:52:01.889414] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-10T21:52:02.689344] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-10T21:52:03.106495] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-10T21:52:03.111561] [INFO ] [REMOTE ] TEVA: Full fetch complete (77704 records). [2025-10-10T21:52:03.111707] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-10T21:52:03.506183] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-10T21:52:03.506703] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-10T21:52:03.507050] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-10T21:52:03.508788] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-10T21:52:03.510122] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-10T21:52:03.541907] [DEBUG] [LOCAL ] TEVA: Trimmed 77704 records to 54410 (keeping 200 days of data) [2025-10-10T21:52:03.546528] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-10T21:52:03.881062] [DEBUG] [LOCAL ] TEVA: Primary data saved (54410 records). [2025-10-10T21:52:03.881199] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-10T21:52:03.881282] [INFO ] [MAIN ] Update Progress: 2074/2373 symbols completed. TEVA took 41.7s. Estimated remaining: 42m 6s. Rate: 7.1 symbols/min [2025-10-10T21:52:04.018716] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-10T21:52:04.079332] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:52:04.101912] [DEBUG] [LOCAL ] TFIN: Loaded 23689 existing records from primary storage. [2025-10-10T21:52:04.102169] [INFO ] [MAIN ] TFIN: Loaded 23689 existing records. [2025-10-10T21:52:04.273249] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:52:04.273468] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-10T21:52:04.273515] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-10T21:52:04.273719] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-10T21:52:04.273775] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-10T21:52:04.294630] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-10T21:52:04.623546] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:52:05.089376] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-10T21:52:05.180472] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-10T21:52:05.889427] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-10T21:52:06.003731] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T21:52:06.689416] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-10T21:52:06.996115] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T21:52:07.489367] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-10T21:52:07.756168] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T21:52:08.289366] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-10-10T21:52:08.879732] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-10T21:52:08.921671] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-10T21:52:09.089400] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-10T21:52:09.270924] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-10T21:52:09.889433] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-10T21:52:10.689393] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-10T21:52:11.242287] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-10T21:52:11.489416] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-10T21:52:11.602336] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T21:52:11.828327] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-10T21:52:12.289425] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-10T21:52:13.033082] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-10T21:52:13.089362] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-10T21:52:13.483983] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-10T21:52:13.889386] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-10T21:52:14.638929] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-10T21:52:14.643111] [INFO ] [REMOTE ] TEX: Full fetch complete (64519 records). [2025-10-10T21:52:14.643217] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-10T21:52:14.698015] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-10T21:52:15.043128] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-10T21:52:15.043219] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-10T21:52:15.044478] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-10T21:52:15.044553] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-10T21:52:15.045965] [DEBUG] [LOCAL ] TEX: Trimmed 64519 records to 44641 (keeping 200 days of data) [2025-10-10T21:52:15.327677] [DEBUG] [LOCAL ] TEX: Primary data saved (44641 records). [2025-10-10T21:52:15.327851] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-10T21:52:15.327967] [INFO ] [MAIN ] Update Progress: 2075/2373 symbols completed. TEX took 33.3s. Estimated remaining: 41m 58s. Rate: 7.1 symbols/min [2025-10-10T21:52:15.498281] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-10T21:52:15.501607] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:52:15.536919] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T21:52:15.577754] [DEBUG] [LOCAL ] TFPM: Loaded 38919 existing records from primary storage. [2025-10-10T21:52:15.578039] [INFO ] [MAIN ] TFPM: Loaded 38919 existing records. [2025-10-10T21:52:15.750086] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:52:15.750275] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-10T21:52:15.750322] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-10T21:52:15.750532] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-10T21:52:15.750587] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-10T21:52:16.099257] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:52:16.113122] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-10T21:52:16.289330] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-10T21:52:17.087195] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-10T21:52:17.089885] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-10-10T21:52:17.899474] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-10T21:52:17.902884] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-10T21:52:18.611785] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T21:52:18.689356] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-10T21:52:19.356232] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T21:52:19.489361] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-10T21:52:19.983933] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-10T21:52:20.289409] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-10T21:52:21.093526] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-10T21:52:21.096237] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-10T21:52:21.613392] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T21:52:21.889373] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-10T21:52:22.689355] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-10T21:52:23.131752] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T21:52:23.316943] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-10T21:52:23.489390] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-10T21:52:24.220945] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-10T21:52:24.289333] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-10T21:52:24.932933] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-10T21:52:25.089415] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-10T21:52:25.706327] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-10T21:52:25.889419] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-10T21:52:26.318706] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-10T21:52:26.689395] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-10T21:52:27.346167] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T21:52:27.489437] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-10T21:52:28.289359] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-10T21:52:28.806598] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-10T21:52:28.834888] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T21:52:29.089391] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-10T21:52:29.464718] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-10T21:52:29.889410] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-10T21:52:30.261967] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-10T21:52:30.265387] [INFO ] [REMOTE ] TFII: Full fetch complete (47929 records). [2025-10-10T21:52:30.265475] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-10T21:52:30.703270] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-10T21:52:30.724758] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-10T21:52:30.724871] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-10T21:52:30.726142] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-10T21:52:30.726232] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-10T21:52:30.727429] [DEBUG] [LOCAL ] TFII: Trimmed 47929 records to 33845 (keeping 200 days of data) [2025-10-10T21:52:30.968867] [DEBUG] [LOCAL ] TFII: Primary data saved (33845 records). [2025-10-10T21:52:30.969211] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-10T21:52:30.969340] [INFO ] [MAIN ] Update Progress: 2076/2373 symbols completed. TFII took 35.0s. Estimated remaining: 41m 50s. Rate: 7.1 symbols/min [2025-10-10T21:52:31.145703] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:52:31.194219] [DEBUG] [LOCAL ] TFX: Loaded 37007 existing records from primary storage. [2025-10-10T21:52:31.194636] [INFO ] [MAIN ] TFX: Loaded 37007 existing records. [2025-10-10T21:52:31.385691] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:52:31.386151] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-10T21:52:31.386213] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-10T21:52:31.386702] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-10T21:52:31.386762] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-10T21:52:31.490342] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-10T21:52:31.781621] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-10T21:52:31.853860] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:52:31.911717] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-10T21:52:31.914618] [INFO ] [REMOTE ] TFIN: Full fetch complete (31722 records). [2025-10-10T21:52:31.914730] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-10T21:52:32.274234] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-10T21:52:32.274324] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-10T21:52:32.275322] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-10T21:52:32.275385] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-10T21:52:32.276233] [DEBUG] [LOCAL ] TFIN: Trimmed 31722 records to 23854 (keeping 200 days of data) [2025-10-10T21:52:32.323912] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-10T21:52:32.420210] [DEBUG] [LOCAL ] TFIN: Primary data saved (23854 records). [2025-10-10T21:52:32.420375] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-10T21:52:32.420469] [INFO ] [MAIN ] Update Progress: 2077/2373 symbols completed. TFIN took 28.5s. Estimated remaining: 41m 41s. Rate: 7.1 symbols/min [2025-10-10T21:52:33.089364] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-10-10T21:52:33.567092] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T21:52:33.889405] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-10T21:52:34.118587] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T21:52:34.647497] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T21:52:34.653053] [INFO ] [REMOTE ] TFC: Full fetch complete (77671 records). [2025-10-10T21:52:34.653238] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-10T21:52:34.698559] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-10T21:52:35.071549] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T21:52:35.104712] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-10T21:52:35.104863] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-10T21:52:35.106738] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-10T21:52:35.106812] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-10T21:52:35.110210] [DEBUG] [LOCAL ] TFC: Trimmed 77671 records to 54447 (keeping 200 days of data) [2025-10-10T21:52:35.467687] [DEBUG] [LOCAL ] TFC: Primary data saved (54447 records). [2025-10-10T21:52:35.468065] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-10T21:52:35.468198] [INFO ] [MAIN ] Update Progress: 2078/2373 symbols completed. TFC took 41.4s. Estimated remaining: 41m 32s. Rate: 7.1 symbols/min [2025-10-10T21:52:35.489368] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-10T21:52:36.395222] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-10T21:52:36.404078] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-10T21:52:37.264486] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-10T21:52:37.272469] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-10T21:52:38.054522] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T21:52:38.063848] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-10T21:52:39.094248] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T21:52:39.106341] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-10T21:52:39.249420] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T21:52:39.489414] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-10T21:52:41.066266] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T21:52:41.077241] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-10T21:52:41.311934] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T21:52:41.321945] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-10T21:52:42.858866] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T21:52:42.869020] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-10T21:52:42.949239] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T21:52:42.953965] [INFO ] [REMOTE ] TFPM: Full fetch complete (51940 records). [2025-10-10T21:52:42.954072] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-10T21:52:43.338988] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-10T21:52:43.339119] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-10T21:52:43.340345] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-10T21:52:43.340409] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-10T21:52:43.341853] [DEBUG] [LOCAL ] TFPM: Trimmed 51940 records to 39256 (keeping 200 days of data) [2025-10-10T21:52:43.599777] [DEBUG] [LOCAL ] TFPM: Primary data saved (39256 records). [2025-10-10T21:52:43.600252] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-10T21:52:43.600382] [INFO ] [MAIN ] Update Progress: 2079/2373 symbols completed. TFPM took 28.3s. Estimated remaining: 41m 23s. Rate: 7.1 symbols/min [2025-10-10T21:52:44.130415] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T21:52:44.138758] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-10T21:52:45.798231] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T21:52:45.806101] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-10T21:52:47.485722] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T21:52:47.497866] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-10T21:52:49.188349] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-10T21:52:49.196837] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-10T21:52:50.949317] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T21:52:50.960376] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-10T21:52:52.425843] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-10T21:52:52.430058] [INFO ] [REMOTE ] TFX: Full fetch complete (54588 records). [2025-10-10T21:52:52.430213] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-10T21:52:52.833982] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-10T21:52:52.834070] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-10T21:52:52.835575] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-10T21:52:52.835666] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-10T21:52:52.837350] [DEBUG] [LOCAL ] TFX: Trimmed 54588 records to 37279 (keeping 200 days of data) [2025-10-10T21:52:53.082865] [DEBUG] [LOCAL ] TFX: Primary data saved (37279 records). [2025-10-10T21:52:53.083052] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-10T21:52:53.083193] [INFO ] [MAIN ] Update Progress: 2080/2373 symbols completed. TFX took 22.1s. Estimated remaining: 41m 15s. Rate: 7.1 symbols/min [2025-10-10T21:52:53.754481] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:52:53.775170] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:52:53.844008] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:52:53.850273] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-10T21:52:53.850174] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:52:53.851517] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-10T21:52:53.852234] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-10T21:52:53.852356] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-10T21:52:53.852410] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-10T21:52:53.852447] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-10T21:52:53.925427] [DEBUG] [LOCAL ] TG: Loaded 10436 existing records from primary storage. [2025-10-10T21:52:53.954101] [INFO ] [MAIN ] TG: Loaded 10436 existing records. [2025-10-10T21:52:54.165849] [DEBUG] [LOCAL ] TGLS: Loaded 27715 existing records from primary storage. [2025-10-10T21:52:54.243311] [INFO ] [MAIN ] TGLS: Loaded 27715 existing records. [2025-10-10T21:52:54.581599] [DEBUG] [LOCAL ] TGNA: Loaded 48984 existing records from primary storage. [2025-10-10T21:52:54.619356] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:52:54.651009] [INFO ] [MAIN ] TGNA: Loaded 48984 existing records. [2025-10-10T21:52:54.690479] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-10T21:52:54.716968] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-10T21:52:54.745483] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:52:54.778459] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-10T21:52:54.826039] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-10T21:52:54.825849] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-10T21:52:54.854102] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:52:54.836568] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-10T21:52:54.865590] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-10T21:52:54.875205] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-10T21:52:54.869583] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-10-10T21:52:55.142600] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:52:55.170185] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-10T21:52:55.185934] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-10T21:52:55.231715] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-10T21:52:55.273720] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-10T21:52:55.297791] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:52:55.412498] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-10-10T21:52:55.454041] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:52:55.481548] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-10T21:52:55.507916] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:52:55.576944] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-10T21:52:55.664727] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-10T21:52:55.767565] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-10T21:52:55.770546] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:52:55.823613] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-10-10T21:52:55.797788] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-10T21:52:55.833196] [INFO ] [MAIN ] Update Progress: 2081/2373 symbols completed. TGE took 2.7s. Estimated remaining: 41m 6s. Rate: 7.1 symbols/min [2025-10-10T21:52:56.123591] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:52:56.150072] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-10-10T21:52:56.288217] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:52:56.346044] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:52:56.346479] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-10-10T21:52:56.378130] [DEBUG] [LOCAL ] TGS: Loaded 33223 existing records from primary storage. [2025-10-10T21:52:56.378496] [INFO ] [MAIN ] TGS: Loaded 33223 existing records. [2025-10-10T21:52:56.557326] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:52:56.557585] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-10T21:52:56.557635] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-10T21:52:56.558000] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-10T21:52:56.558057] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-10T21:52:56.962334] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:52:56.962683] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-10-10T21:52:57.093701] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-10T21:52:57.097592] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-10T21:52:57.214012] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-10T21:52:57.220034] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-10T21:52:58.151710] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-10T21:52:58.153849] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T21:52:58.157170] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-10T21:52:58.167058] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-10T21:52:58.252340] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-10T21:52:58.258912] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-10T21:52:58.477202] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-10T21:52:58.483893] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-10T21:52:58.682807] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-10T21:52:58.685107] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-10T21:52:59.583935] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T21:52:59.589907] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-10T21:52:59.719939] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-10T21:52:59.722920] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-10T21:52:59.794338] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T21:52:59.801998] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-10T21:52:59.890485] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-10T21:52:59.900346] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-10T21:53:00.369217] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-10T21:53:00.372423] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-10T21:53:01.261005] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-10T21:53:01.264026] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-10T21:53:01.558577] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T21:53:01.566804] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-10T21:53:01.684455] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T21:53:01.889415] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-10T21:53:02.050624] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-10T21:53:02.083847] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-10T21:53:02.694453] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-10T21:53:02.713210] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T21:53:03.489364] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-10T21:53:03.524518] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-10T21:53:03.660711] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-10T21:53:04.289393] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-10T21:53:05.089360] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-10T21:53:05.293179] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-10T21:53:05.516566] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-10T21:53:05.889418] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-10T21:53:06.689349] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-10T21:53:06.744098] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-10T21:53:06.840735] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-10T21:53:07.489463] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-10T21:53:08.252974] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-10T21:53:08.289327] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-10T21:53:09.036191] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-10T21:53:09.089338] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-10T21:53:09.595058] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T21:53:09.889369] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-10T21:53:10.451116] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-10T21:53:10.689384] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-10T21:53:11.489348] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-10T21:53:11.582511] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-10T21:53:11.584100] [INFO ] [REMOTE ] TG: Full fetch complete (14969 records). [2025-10-10T21:53:11.584169] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-10T21:53:11.994723] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-10T21:53:11.997558] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-10T21:53:11.998530] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-10T21:53:11.998699] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-10T21:53:12.000346] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T21:53:12.010753] [DEBUG] [LOCAL ] TG: Trimmed 14969 records to 10536 (keeping 200 days of data) [2025-10-10T21:53:12.070236] [DEBUG] [LOCAL ] TG: Primary data saved (10536 records). [2025-10-10T21:53:12.070378] [INFO ] [MAIN ] TG: Full history saved. [2025-10-10T21:53:12.070464] [INFO ] [MAIN ] Update Progress: 2082/2373 symbols completed. TG took 19.0s. Estimated remaining: 40m 58s. Rate: 7.1 symbols/min [2025-10-10T21:53:12.233690] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:53:12.292691] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-10T21:53:12.296634] [DEBUG] [LOCAL ] TGT: Loaded 54168 existing records from primary storage. [2025-10-10T21:53:12.297225] [INFO ] [MAIN ] TGT: Loaded 54168 existing records. [2025-10-10T21:53:12.471734] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:53:12.472091] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-10T21:53:12.472183] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-10T21:53:12.472438] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-10T21:53:12.472484] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-10T21:53:12.844457] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-10T21:53:12.855528] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:53:13.089384] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-10-10T21:53:13.889373] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-10T21:53:14.238432] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T21:53:14.689391] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-10T21:53:15.040625] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T21:53:15.409497] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-10T21:53:15.489354] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-10T21:53:16.289377] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-10T21:53:16.597687] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-10T21:53:17.051674] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T21:53:17.089352] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-10T21:53:17.878217] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-10T21:53:17.889323] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-10T21:53:18.465996] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T21:53:18.689385] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-10T21:53:19.308573] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-10T21:53:19.489388] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-10T21:53:20.211606] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-10T21:53:20.215696] [INFO ] [REMOTE ] TGS: Full fetch complete (48039 records). [2025-10-10T21:53:20.215821] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-10T21:53:20.294525] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-10T21:53:20.598310] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-10T21:53:20.598419] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-10T21:53:20.600280] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-10T21:53:20.600349] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-10T21:53:20.601723] [DEBUG] [LOCAL ] TGS: Trimmed 48039 records to 33559 (keeping 200 days of data) [2025-10-10T21:53:20.812285] [DEBUG] [LOCAL ] TGS: Primary data saved (33559 records). [2025-10-10T21:53:20.812560] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-10T21:53:20.812740] [INFO ] [MAIN ] Update Progress: 2083/2373 symbols completed. TGS took 25.0s. Estimated remaining: 40m 50s. Rate: 7.1 symbols/min [2025-10-10T21:53:20.980835] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:53:21.029017] [DEBUG] [LOCAL ] THC: Loaded 47679 existing records from primary storage. [2025-10-10T21:53:21.029391] [INFO ] [MAIN ] THC: Loaded 47679 existing records. [2025-10-10T21:53:21.099738] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-10T21:53:21.212478] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:53:21.212802] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-10T21:53:21.212857] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-10T21:53:21.213142] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-10T21:53:21.213198] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-10T21:53:21.591114] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:53:21.746492] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-10T21:53:21.889352] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-10T21:53:22.218805] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T21:53:22.271764] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-10T21:53:22.274884] [INFO ] [REMOTE ] TGLS: Full fetch complete (40512 records). [2025-10-10T21:53:22.275079] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-10T21:53:22.698953] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-10-10T21:53:22.717321] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-10T21:53:22.717415] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-10T21:53:22.719183] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-10T21:53:22.719363] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-10T21:53:22.720495] [DEBUG] [LOCAL ] TGLS: Trimmed 40512 records to 27913 (keeping 200 days of data) [2025-10-10T21:53:22.913075] [DEBUG] [LOCAL ] TGLS: Primary data saved (27913 records). [2025-10-10T21:53:22.913218] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-10T21:53:22.913307] [INFO ] [MAIN ] Update Progress: 2084/2373 symbols completed. TGLS took 29.8s. Estimated remaining: 40m 41s. Rate: 7.1 symbols/min [2025-10-10T21:53:23.112762] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:53:23.138069] [DEBUG] [LOCAL ] THG: Loaded 21678 existing records from primary storage. [2025-10-10T21:53:23.138327] [INFO ] [MAIN ] THG: Loaded 21678 existing records. [2025-10-10T21:53:23.339308] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:53:23.339528] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-10T21:53:23.339576] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-10T21:53:23.339811] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-10T21:53:23.339870] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-10T21:53:23.502548] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-10T21:53:23.750961] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:53:23.868269] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-10T21:53:24.032799] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T21:53:24.289355] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-10T21:53:25.089358] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-10T21:53:25.399921] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T21:53:25.889414] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-10T21:53:26.689351] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-10-10T21:53:26.736931] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-10T21:53:26.932104] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T21:53:27.489373] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-10T21:53:27.747546] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T21:53:27.835683] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-10T21:53:28.289383] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-10T21:53:29.089386] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-10T21:53:29.889358] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-10T21:53:29.924102] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T21:53:29.928988] [INFO ] [REMOTE ] TGNA: Full fetch complete (69914 records). [2025-10-10T21:53:29.929140] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-10T21:53:30.380013] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-10T21:53:30.380243] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-10T21:53:30.381860] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-10T21:53:30.382106] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-10T21:53:30.399858] [DEBUG] [LOCAL ] TGNA: Trimmed 69914 records to 49361 (keeping 200 days of data) [2025-10-10T21:53:30.416435] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-10-10T21:53:30.668829] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-10T21:53:30.689813] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-10T21:53:30.774541] [DEBUG] [LOCAL ] TGNA: Primary data saved (49361 records). [2025-10-10T21:53:30.774790] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-10T21:53:30.774923] [INFO ] [MAIN ] Update Progress: 2085/2373 symbols completed. TGNA took 37.7s. Estimated remaining: 40m 32s. Rate: 7.1 symbols/min [2025-10-10T21:53:30.956026] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:53:30.961555] [DEBUG] [LOCAL ] THIR: Loaded 2297 existing records from primary storage. [2025-10-10T21:53:30.961758] [INFO ] [MAIN ] THIR: Loaded 2297 existing records. [2025-10-10T21:53:31.151843] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:53:31.152135] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-10T21:53:31.152193] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-10T21:53:31.152408] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-10T21:53:31.152454] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-10T21:53:31.494559] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-10T21:53:31.592134] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:53:31.808258] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T21:53:31.893185] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-10T21:53:32.289383] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-10T21:53:33.089396] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-10T21:53:33.909222] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-10-10T21:53:33.911040] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-10T21:53:34.025196] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-10T21:53:34.329763] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-10T21:53:34.430017] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-10T21:53:34.689398] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-10T21:53:35.489450] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-10T21:53:35.889690] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-10T21:53:36.289436] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-10T21:53:36.598974] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T21:53:37.089371] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-10T21:53:37.480745] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-10T21:53:37.889384] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-10T21:53:38.697285] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-10T21:53:38.705547] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-10T21:53:39.103072] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-10T21:53:39.489391] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-10T21:53:39.766596] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T21:53:40.289466] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-10T21:53:40.584639] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-10T21:53:41.089399] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-10T21:53:41.889413] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-10T21:53:42.133245] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T21:53:42.689405] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-10T21:53:43.131102] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-10T21:53:43.147574] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T21:53:43.489362] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-10T21:53:43.632247] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-10T21:53:44.289426] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-10T21:53:45.089427] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-10T21:53:45.334499] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-10T21:53:45.889378] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-10T21:53:46.381757] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-10T21:53:46.396428] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T21:53:46.689402] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-10T21:53:47.489382] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-10T21:53:47.705976] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T21:53:48.019624] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-10T21:53:48.289377] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-10T21:53:49.089388] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-10T21:53:49.787708] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-10T21:53:49.813723] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T21:53:49.889336] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-10T21:53:50.124462] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-10T21:53:50.689407] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-10T21:53:51.475736] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-10T21:53:51.489389] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-10T21:53:51.494164] [INFO ] [REMOTE ] TGT: Full fetch complete (77861 records). [2025-10-10T21:53:51.496208] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-10T21:53:51.496020] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-10T21:53:51.552839] [INFO ] [REMOTE ] THC: Full fetch complete (68836 records). [2025-10-10T21:53:51.581851] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-10T21:53:52.236769] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-10T21:53:52.237469] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-10T21:53:52.244475] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-10T21:53:52.254887] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-10T21:53:52.315310] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-10T21:53:52.336968] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-10T21:53:52.336784] [DEBUG] [LOCAL ] TGT: Trimmed 77861 records to 54558 (keeping 200 days of data) [2025-10-10T21:53:52.337440] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-10T21:53:52.338161] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-10T21:53:52.338239] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-10T21:53:52.406404] [DEBUG] [LOCAL ] THC: Trimmed 68836 records to 47996 (keeping 200 days of data) [2025-10-10T21:53:52.829270] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T21:53:52.939171] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-10T21:53:53.000784] [DEBUG] [LOCAL ] THC: Primary data saved (47996 records). [2025-10-10T21:53:53.006099] [INFO ] [MAIN ] THC: Full history saved. [2025-10-10T21:53:53.006908] [INFO ] [MAIN ] Update Progress: 2086/2373 symbols completed. THC took 32.2s. Estimated remaining: 40m 25s. Rate: 7.1 symbols/min [2025-10-10T21:53:53.093247] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-10T21:53:53.137291] [DEBUG] [LOCAL ] TGT: Primary data saved (54558 records). [2025-10-10T21:53:53.148386] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-10T21:53:53.153726] [INFO ] [MAIN ] Update Progress: 2087/2373 symbols completed. TGT took 41.1s. Estimated remaining: 40m 16s. Rate: 7.1 symbols/min [2025-10-10T21:53:53.323389] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:53:53.380719] [DEBUG] [LOCAL ] THLV: Loaded 1551 existing records from primary storage. [2025-10-10T21:53:53.396285] [INFO ] [MAIN ] THLV: Loaded 1551 existing records. [2025-10-10T21:53:53.401096] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:53:53.582033] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:53:53.582415] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-10T21:53:53.582495] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-10T21:53:53.582771] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-10T21:53:53.582830] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-10T21:53:53.765842] [DEBUG] [LOCAL ] THO: Loaded 41932 existing records from primary storage. [2025-10-10T21:53:53.827595] [INFO ] [MAIN ] THO: Loaded 41932 existing records. [2025-10-10T21:53:53.903513] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-10T21:53:54.171467] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:53:54.199963] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:53:54.200759] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-10T21:53:54.201096] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-10T21:53:54.201623] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-10T21:53:54.201732] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-10T21:53:54.357921] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T21:53:54.542084] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-10T21:53:54.595702] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:53:54.689326] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-10-10T21:53:55.489387] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-10-10T21:53:56.075997] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-10T21:53:56.289384] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-10T21:53:56.414777] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T21:53:57.033625] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-10T21:53:57.089352] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-10T21:53:57.627130] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-10T21:53:57.889386] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-10T21:53:58.431476] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-10T21:53:58.689455] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-10T21:53:59.489366] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-10T21:53:59.734361] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-10T21:53:59.737408] [INFO ] [REMOTE ] THG: Full fetch complete (30962 records). [2025-10-10T21:53:59.737519] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-10T21:54:00.137348] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-10T21:54:00.137477] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-10T21:54:00.138821] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-10T21:54:00.138888] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-10T21:54:00.139737] [DEBUG] [LOCAL ] THG: Trimmed 30962 records to 21827 (keeping 200 days of data) [2025-10-10T21:54:00.242821] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-10T21:54:00.290855] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-10T21:54:00.304214] [DEBUG] [LOCAL ] THG: Primary data saved (21827 records). [2025-10-10T21:54:00.304391] [INFO ] [MAIN ] THG: Full history saved. [2025-10-10T21:54:00.304513] [INFO ] [MAIN ] Update Progress: 2088/2373 symbols completed. THG took 37.4s. Estimated remaining: 40m 7s. Rate: 7.1 symbols/min [2025-10-10T21:54:00.482781] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:54:00.512846] [DEBUG] [LOCAL ] THQ: Loaded 25352 existing records from primary storage. [2025-10-10T21:54:00.513290] [INFO ] [MAIN ] THQ: Loaded 25352 existing records. [2025-10-10T21:54:00.696771] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:54:00.697371] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-10T21:54:00.697540] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-10T21:54:00.697830] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-10T21:54:00.697894] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-10T21:54:01.090375] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-10T21:54:01.090241] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:54:01.118014] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-10T21:54:01.683355] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-10T21:54:01.684252] [INFO ] [REMOTE ] THIR: Full fetch complete (2827 records). [2025-10-10T21:54:01.684321] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-10T21:54:01.899379] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-10T21:54:02.058172] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-10T21:54:02.058254] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-10T21:54:02.058376] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-10T21:54:02.058415] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-10T21:54:02.058811] [DEBUG] [LOCAL ] THIR: Trimmed 2827 records to 2341 (keeping 200 days of data) [2025-10-10T21:54:02.073014] [DEBUG] [LOCAL ] THIR: Primary data saved (2341 records). [2025-10-10T21:54:02.073119] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-10T21:54:02.073201] [INFO ] [MAIN ] Update Progress: 2089/2373 symbols completed. THIR took 31.3s. Estimated remaining: 39m 58s. Rate: 7.1 symbols/min [2025-10-10T21:54:02.247451] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:54:02.267623] [DEBUG] [LOCAL ] THR: Loaded 19941 existing records from primary storage. [2025-10-10T21:54:02.267940] [INFO ] [MAIN ] THR: Loaded 19941 existing records. [2025-10-10T21:54:02.450861] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:54:02.451084] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-10T21:54:02.451133] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-10T21:54:02.451332] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-10T21:54:02.451388] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-10T21:54:02.563029] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-10T21:54:02.699440] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-10T21:54:02.825621] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:54:03.295048] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-10T21:54:03.489378] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-10-10T21:54:04.289346] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-10T21:54:04.783034] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T21:54:05.089429] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-10T21:54:05.510537] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-10T21:54:05.889408] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-10T21:54:06.054373] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T21:54:06.293698] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-10T21:54:06.689384] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-10T21:54:07.489376] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-10-10T21:54:08.289367] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-10T21:54:08.445107] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T21:54:08.536077] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-10T21:54:08.811936] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-10T21:54:09.089366] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-10T21:54:09.889397] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-10T21:54:10.529485] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T21:54:10.689370] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-10T21:54:11.489385] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-10T21:54:11.715534] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-10T21:54:11.821760] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-10T21:54:12.270769] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-10T21:54:12.289335] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-10T21:54:13.089410] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-10T21:54:13.681691] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-10T21:54:13.786711] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-10T21:54:13.889389] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-10T21:54:14.689406] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-10T21:54:15.234578] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-10T21:54:15.489346] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-10T21:54:15.971752] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T21:54:16.289392] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-10T21:54:17.089389] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-10T21:54:17.419021] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-10T21:54:17.487627] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-10T21:54:17.889394] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-10T21:54:18.355844] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-10T21:54:18.605826] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-10T21:54:18.689352] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-10T21:54:19.489432] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-10T21:54:19.881910] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-10T21:54:20.289365] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-10T21:54:20.606720] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-10T21:54:21.089377] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-10T21:54:21.465797] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-10T21:54:21.889378] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-10T21:54:22.689382] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-10T21:54:22.717299] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T21:54:23.151155] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-10T21:54:23.489379] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-10T21:54:23.634390] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-10T21:54:24.289432] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-10T21:54:25.089389] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-10T21:54:25.111574] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-10T21:54:25.514265] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-10T21:54:25.515360] [INFO ] [REMOTE ] THLV: Full fetch complete (2572 records). [2025-10-10T21:54:25.515445] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-10T21:54:25.891280] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-10T21:54:25.891717] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-10T21:54:25.891880] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-10T21:54:25.892111] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-10T21:54:25.892210] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-10T21:54:25.893954] [DEBUG] [LOCAL ] THLV: Trimmed 2572 records to 1560 (keeping 200 days of data) [2025-10-10T21:54:25.904033] [DEBUG] [LOCAL ] THLV: Primary data saved (1560 records). [2025-10-10T21:54:25.904098] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-10T21:54:25.904198] [INFO ] [MAIN ] Update Progress: 2090/2373 symbols completed. THLV took 32.9s. Estimated remaining: 39m 52s. Rate: 7.1 symbols/min [2025-10-10T21:54:26.075515] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:54:26.104885] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T21:54:26.145414] [DEBUG] [LOCAL ] THS: Loaded 38695 existing records from primary storage. [2025-10-10T21:54:26.145736] [INFO ] [MAIN ] THS: Loaded 38695 existing records. [2025-10-10T21:54:26.319731] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:54:26.319984] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-10T21:54:26.320045] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-10T21:54:26.320218] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-10T21:54:26.320255] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-10T21:54:26.668079] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:54:26.689346] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-10-10T21:54:26.778068] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-10T21:54:27.489397] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-10T21:54:28.232939] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T21:54:28.289384] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-10T21:54:28.701378] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-10T21:54:29.089389] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-10T21:54:29.767758] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-10T21:54:29.889376] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-10T21:54:30.542920] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-10T21:54:30.689365] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-10T21:54:31.474466] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T21:54:31.489328] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-10T21:54:31.840777] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-10T21:54:31.843523] [INFO ] [REMOTE ] THQ: Full fetch complete (34993 records). [2025-10-10T21:54:31.843618] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-10T21:54:32.210988] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-10T21:54:32.211081] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-10T21:54:32.211923] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-10T21:54:32.211986] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-10T21:54:32.213045] [DEBUG] [LOCAL ] THQ: Trimmed 34993 records to 25525 (keeping 200 days of data) [2025-10-10T21:54:32.303335] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-10T21:54:32.416375] [DEBUG] [LOCAL ] THQ: Primary data saved (25525 records). [2025-10-10T21:54:32.416527] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-10T21:54:32.416631] [INFO ] [MAIN ] Update Progress: 2091/2373 symbols completed. THQ took 32.1s. Estimated remaining: 39m 43s. Rate: 7.1 symbols/min [2025-10-10T21:54:32.582011] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:54:32.615742] [DEBUG] [LOCAL ] THW: Loaded 19800 existing records from primary storage. [2025-10-10T21:54:32.616400] [INFO ] [MAIN ] THW: Loaded 19800 existing records. [2025-10-10T21:54:32.798763] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:54:32.799087] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-10T21:54:32.799149] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-10T21:54:32.799402] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-10T21:54:32.799468] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-10T21:54:33.098464] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-10T21:54:33.191232] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-10T21:54:33.220356] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:54:33.386694] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T21:54:33.388819] [INFO ] [REMOTE ] THR: Full fetch complete (28647 records). [2025-10-10T21:54:33.388891] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-10T21:54:33.777421] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-10T21:54:33.777536] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-10T21:54:33.778299] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-10T21:54:33.778360] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-10T21:54:33.779080] [DEBUG] [LOCAL ] THR: Trimmed 28647 records to 20063 (keeping 200 days of data) [2025-10-10T21:54:33.889392] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-10T21:54:33.923854] [DEBUG] [LOCAL ] THR: Primary data saved (20063 records). [2025-10-10T21:54:33.923993] [INFO ] [MAIN ] THR: Full history saved. [2025-10-10T21:54:33.924093] [INFO ] [MAIN ] Update Progress: 2092/2373 symbols completed. THR took 31.9s. Estimated remaining: 39m 33s. Rate: 7.1 symbols/min [2025-10-10T21:54:34.095073] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:54:34.095289] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-10T21:54:34.095327] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-10T21:54:34.095450] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-10T21:54:34.095491] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-10T21:54:34.095531] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-10T21:54:34.095562] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-10T21:54:34.442452] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:54:34.689342] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-10-10T21:54:34.963405] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:54:34.964151] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-10-10T21:54:34.965753] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-10T21:54:34.965849] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:54:34.974777] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-10T21:54:34.975248] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:54:34.975332] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-10T21:54:34.975862] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-10T21:54:34.975929] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-10T21:54:34.975976] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-10T21:54:34.976068] [INFO ] [MAIN ] Update Progress: 2093/2373 symbols completed. TIC took 1.1s. Estimated remaining: 39m 24s. Rate: 7.1 symbols/min [2025-10-10T21:54:35.168275] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:54:35.235464] [DEBUG] [LOCAL ] TIMB: Loaded 35792 existing records from primary storage. [2025-10-10T21:54:35.235905] [INFO ] [MAIN ] TIMB: Loaded 35792 existing records. [2025-10-10T21:54:35.424348] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:54:35.424818] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-10T21:54:35.424879] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-10T21:54:35.427511] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-10T21:54:35.427700] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-10T21:54:35.494619] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-10-10T21:54:35.604075] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T21:54:35.837721] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:54:36.289454] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-10T21:54:36.923121] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T21:54:37.089387] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-10T21:54:37.889361] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-10T21:54:38.084519] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T21:54:38.391986] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-10T21:54:38.689397] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-10T21:54:39.491701] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-10T21:54:39.498909] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-10T21:54:39.961946] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-10T21:54:40.289456] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-10T21:54:41.089374] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-10-10T21:54:41.252488] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T21:54:41.790891] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-10T21:54:41.889433] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-10T21:54:42.689364] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-10T21:54:42.795820] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-10T21:54:43.360373] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-10T21:54:43.364470] [INFO ] [REMOTE ] THO: Full fetch complete (60160 records). [2025-10-10T21:54:43.364627] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-10T21:54:43.494534] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-10T21:54:43.755942] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-10T21:54:43.756026] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-10T21:54:43.757198] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-10T21:54:43.757260] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-10T21:54:43.758466] [DEBUG] [LOCAL ] THO: Trimmed 60160 records to 42217 (keeping 200 days of data) [2025-10-10T21:54:44.015019] [DEBUG] [LOCAL ] THO: Primary data saved (42217 records). [2025-10-10T21:54:44.015181] [INFO ] [MAIN ] THO: Full history saved. [2025-10-10T21:54:44.015276] [INFO ] [MAIN ] Update Progress: 2094/2373 symbols completed. THO took 50.9s. Estimated remaining: 39m 16s. Rate: 7.1 symbols/min [2025-10-10T21:54:44.191826] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:54:44.199691] [DEBUG] [LOCAL ] TISI: Loaded 3481 existing records from primary storage. [2025-10-10T21:54:44.199963] [INFO ] [MAIN ] TISI: Loaded 3481 existing records. [2025-10-10T21:54:44.294568] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-10T21:54:44.401430] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:54:44.410108] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-10T21:54:44.410268] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-10T21:54:44.424833] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-10T21:54:44.425302] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-10T21:54:44.426075] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-10T21:54:44.799274] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:54:44.811623] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T21:54:45.089427] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-10-10T21:54:45.889356] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-10T21:54:45.969347] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-10T21:54:45.996455] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-10T21:54:46.689433] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-10T21:54:47.113117] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-10T21:54:47.250162] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-10T21:54:47.489351] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-10T21:54:48.289375] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-10T21:54:48.832049] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T21:54:49.089402] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-10T21:54:49.889365] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-10T21:54:50.134260] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T21:54:50.217040] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-10T21:54:50.414372] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-10T21:54:50.689448] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-10T21:54:51.489424] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-10T21:54:52.108871] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-10T21:54:52.260745] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-10T21:54:52.289335] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-10T21:54:53.089375] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-10T21:54:53.163596] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T21:54:53.889372] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-10T21:54:54.689349] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-10T21:54:54.813426] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T21:54:55.092930] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T21:54:55.392162] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-10T21:54:55.489389] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-10T21:54:56.289454] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-10T21:54:57.089412] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-10T21:54:57.192234] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-10T21:54:57.472783] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-10T21:54:57.889384] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-10T21:54:58.009891] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-10T21:54:58.429278] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-10T21:54:58.689383] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-10T21:54:59.236303] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-10T21:54:59.489373] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-10T21:55:00.289366] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-10T21:55:00.752814] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T21:55:01.089391] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-10T21:55:01.711885] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-10T21:55:01.889392] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-10T21:55:02.325364] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T21:55:02.689383] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-10T21:55:02.870276] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T21:55:02.874344] [INFO ] [REMOTE ] THS: Full fetch complete (54308 records). [2025-10-10T21:55:02.874435] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-10T21:55:03.177219] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-10T21:55:03.198772] [INFO ] [REMOTE ] TISI: Full fetch complete (4917 records). [2025-10-10T21:55:03.222058] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-10T21:55:03.337532] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-10T21:55:03.348687] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-10T21:55:03.369076] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-10T21:55:03.371807] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-10T21:55:03.431473] [DEBUG] [LOCAL ] THS: Trimmed 54308 records to 38977 (keeping 200 days of data) [2025-10-10T21:55:03.495536] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-10T21:55:03.736954] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-10T21:55:03.737604] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-10T21:55:03.737911] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-10T21:55:03.738343] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-10T21:55:03.740215] [DEBUG] [LOCAL ] TISI: Trimmed 4917 records to 3496 (keeping 200 days of data) [2025-10-10T21:55:03.770823] [DEBUG] [LOCAL ] TISI: Primary data saved (3496 records). [2025-10-10T21:55:03.772114] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-10T21:55:03.772558] [INFO ] [MAIN ] Update Progress: 2095/2373 symbols completed. TISI took 19.8s. Estimated remaining: 39m 9s. Rate: 7.1 symbols/min [2025-10-10T21:55:04.077444] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:55:04.118153] [DEBUG] [LOCAL ] TIXT: Loaded 32214 existing records from primary storage. [2025-10-10T21:55:04.125769] [DEBUG] [LOCAL ] THS: Primary data saved (38977 records). [2025-10-10T21:55:04.126168] [INFO ] [MAIN ] TIXT: Loaded 32214 existing records. [2025-10-10T21:55:04.126316] [INFO ] [MAIN ] THS: Full history saved. [2025-10-10T21:55:04.158200] [INFO ] [MAIN ] Update Progress: 2096/2373 symbols completed. THS took 38.3s. Estimated remaining: 38m 59s. Rate: 7.1 symbols/min [2025-10-10T21:55:04.303685] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-10T21:55:04.456977] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:55:04.481899] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-10T21:55:04.488343] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-10T21:55:04.506717] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-10T21:55:04.508104] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-10T21:55:04.508024] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:55:04.924494] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:55:04.926191] [DEBUG] [LOCAL ] TJX: Loaded 54058 existing records from primary storage. [2025-10-10T21:55:04.927205] [INFO ] [MAIN ] TJX: Loaded 54058 existing records. [2025-10-10T21:55:05.089747] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-10-10T21:55:05.112439] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:55:05.113721] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-10T21:55:05.113780] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-10T21:55:05.113988] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-10T21:55:05.114026] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-10T21:55:05.439872] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-10T21:55:05.518078] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:55:05.520419] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-10T21:55:05.522766] [INFO ] [REMOTE ] THW: Full fetch complete (29107 records). [2025-10-10T21:55:05.522835] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-10T21:55:05.894517] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-10T21:55:05.895438] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-10T21:55:05.896545] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-10T21:55:05.897631] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-10T21:55:05.897851] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-10T21:55:05.898896] [DEBUG] [LOCAL ] THW: Trimmed 29107 records to 19931 (keeping 200 days of data) [2025-10-10T21:55:06.030336] [DEBUG] [LOCAL ] THW: Primary data saved (19931 records). [2025-10-10T21:55:06.030542] [INFO ] [MAIN ] THW: Full history saved. [2025-10-10T21:55:06.030673] [INFO ] [MAIN ] Update Progress: 2097/2373 symbols completed. THW took 33.6s. Estimated remaining: 38m 50s. Rate: 7.1 symbols/min [2025-10-10T21:55:06.205408] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:55:06.247281] [DEBUG] [LOCAL ] TK: Loaded 39475 existing records from primary storage. [2025-10-10T21:55:06.248013] [INFO ] [MAIN ] TK: Loaded 39475 existing records. [2025-10-10T21:55:06.438954] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:55:06.439361] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-10T21:55:06.439426] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-10T21:55:06.439731] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-10T21:55:06.439809] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-10T21:55:06.715891] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T21:55:06.700445] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-10-10T21:55:06.853309] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:55:07.489376] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-10T21:55:07.577344] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-10T21:55:08.289365] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-10T21:55:08.987910] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-10T21:55:09.089268] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-10T21:55:09.089422] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-10T21:55:09.889359] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-10T21:55:10.101415] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T21:55:10.690585] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-10T21:55:10.699961] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-10T21:55:10.769638] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-10T21:55:11.489379] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-10-10T21:55:11.946295] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-10T21:55:12.289381] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-10T21:55:13.089346] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-10T21:55:13.270983] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-10T21:55:13.365613] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-10T21:55:13.889347] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-10T21:55:14.385037] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-10T21:55:14.689383] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-10T21:55:14.734293] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T21:55:14.737377] [INFO ] [REMOTE ] TIMB: Full fetch complete (53531 records). [2025-10-10T21:55:14.737481] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-10T21:55:15.122177] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-10T21:55:15.122272] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-10T21:55:15.123380] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-10T21:55:15.123442] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-10T21:55:15.124478] [DEBUG] [LOCAL ] TIMB: Trimmed 53531 records to 36068 (keeping 200 days of data) [2025-10-10T21:55:15.349519] [DEBUG] [LOCAL ] TIMB: Primary data saved (36068 records). [2025-10-10T21:55:15.349711] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-10T21:55:15.349807] [INFO ] [MAIN ] Update Progress: 2098/2373 symbols completed. TIMB took 40.4s. Estimated remaining: 38m 42s. Rate: 7.1 symbols/min [2025-10-10T21:55:15.494686] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-10T21:55:15.549446] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:55:15.588514] [DEBUG] [LOCAL ] TKC: Loaded 39447 existing records from primary storage. [2025-10-10T21:55:15.588881] [INFO ] [MAIN ] TKC: Loaded 39447 existing records. [2025-10-10T21:55:15.766395] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:55:15.766634] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-10T21:55:15.766719] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-10T21:55:15.766967] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-10T21:55:15.767047] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-10T21:55:16.126129] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:55:16.141385] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-10T21:55:16.289352] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-10T21:55:17.089350] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-10T21:55:17.259786] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T21:55:17.598324] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-10T21:55:17.889392] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-10T21:55:18.689389] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-10T21:55:18.760874] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-10T21:55:18.799408] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-10T21:55:19.489436] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-10T21:55:20.289458] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-10T21:55:20.343423] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T21:55:21.089422] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-10-10T21:55:21.755836] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-10T21:55:21.896793] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-10T21:55:21.900683] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-10T21:55:21.992845] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-10T21:55:22.689424] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-10T21:55:23.489345] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-10T21:55:24.090422] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-10T21:55:24.222121] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-10T21:55:24.289373] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-10T21:55:25.089356] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-10T21:55:25.253251] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T21:55:25.844052] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-10T21:55:25.889336] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-10T21:55:26.689355] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-10T21:55:27.330279] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-10T21:55:27.374929] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T21:55:27.489353] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-10T21:55:28.173395] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-10T21:55:28.289364] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-10T21:55:29.089356] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-10T21:55:29.687356] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-10T21:55:29.889422] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-10T21:55:30.001316] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T21:55:30.475056] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-10T21:55:30.479621] [INFO ] [REMOTE ] TIXT: Full fetch complete (46208 records). [2025-10-10T21:55:30.479900] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-10T21:55:30.695267] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-10T21:55:30.898817] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-10T21:55:30.898920] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-10T21:55:30.899958] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-10T21:55:30.900028] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-10T21:55:30.901196] [DEBUG] [LOCAL ] TIXT: Trimmed 46208 records to 32473 (keeping 200 days of data) [2025-10-10T21:55:31.082443] [DEBUG] [LOCAL ] TIXT: Primary data saved (32473 records). [2025-10-10T21:55:31.082558] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-10T21:55:31.082661] [INFO ] [MAIN ] Update Progress: 2099/2373 symbols completed. TIXT took 27.3s. Estimated remaining: 38m 34s. Rate: 7.1 symbols/min [2025-10-10T21:55:31.259983] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:55:31.270167] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T21:55:31.317766] [DEBUG] [LOCAL ] TKO: Loaded 44214 existing records from primary storage. [2025-10-10T21:55:31.318071] [INFO ] [MAIN ] TKO: Loaded 44214 existing records. [2025-10-10T21:55:31.489334] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:55:31.489395] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-10T21:55:31.489616] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-10T21:55:31.489843] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-10T21:55:31.490717] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-10T21:55:31.490777] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-10T21:55:31.867730] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:55:32.289466] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-10-10T21:55:32.513602] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T21:55:33.089535] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-10T21:55:33.647633] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T21:55:33.897874] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-10T21:55:33.931130] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-10T21:55:34.331766] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T21:55:34.689399] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-10T21:55:35.090300] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-10T21:55:35.489427] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-10T21:55:36.287421] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T21:55:36.294995] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-10T21:55:37.089359] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-10T21:55:37.778337] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-10T21:55:37.889342] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-10T21:55:37.985085] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T21:55:38.689389] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-10T21:55:39.073432] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T21:55:39.464393] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-10T21:55:39.489346] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-10T21:55:39.763326] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-10T21:55:40.247832] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T21:55:40.253228] [INFO ] [REMOTE ] TJX: Full fetch complete (77681 records). [2025-10-10T21:55:40.253389] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-10T21:55:40.294491] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-10T21:55:40.681671] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-10T21:55:40.681777] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-10T21:55:40.683008] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-10T21:55:40.683076] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-10T21:55:40.685927] [DEBUG] [LOCAL ] TJX: Trimmed 77681 records to 54447 (keeping 200 days of data) [2025-10-10T21:55:41.049057] [DEBUG] [LOCAL ] TJX: Primary data saved (54447 records). [2025-10-10T21:55:41.049225] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-10T21:55:41.049328] [INFO ] [MAIN ] Update Progress: 2100/2373 symbols completed. TJX took 36.8s. Estimated remaining: 38m 26s. Rate: 7.1 symbols/min [2025-10-10T21:55:41.095735] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-10T21:55:41.220934] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:55:41.260732] [DEBUG] [LOCAL ] TKR: Loaded 40194 existing records from primary storage. [2025-10-10T21:55:41.261036] [INFO ] [MAIN ] TKR: Loaded 40194 existing records. [2025-10-10T21:55:41.433105] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:55:41.433337] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-10T21:55:41.433386] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-10T21:55:41.433586] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-10T21:55:41.433684] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-10T21:55:41.782033] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:55:41.889347] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-10-10T21:55:42.222391] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T21:55:42.311013] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-10T21:55:42.689403] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-10T21:55:43.465846] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-10T21:55:43.489334] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-10T21:55:44.289355] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-10T21:55:44.826430] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T21:55:45.089381] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-10T21:55:45.307686] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-10T21:55:45.889376] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-10T21:55:45.934793] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T21:55:46.689371] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-10T21:55:47.062047] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T21:55:47.262701] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-10T21:55:47.266314] [INFO ] [REMOTE ] TK: Full fetch complete (56251 records). [2025-10-10T21:55:47.266404] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-10T21:55:47.494928] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-10T21:55:47.669196] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-10T21:55:47.669280] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-10T21:55:47.670312] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-10T21:55:47.670384] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-10T21:55:47.671565] [DEBUG] [LOCAL ] TK: Trimmed 56251 records to 39728 (keeping 200 days of data) [2025-10-10T21:55:47.906241] [DEBUG] [LOCAL ] TK: Primary data saved (39728 records). [2025-10-10T21:55:47.906404] [INFO ] [MAIN ] TK: Full history saved. [2025-10-10T21:55:47.906497] [INFO ] [MAIN ] Update Progress: 2101/2373 symbols completed. TK took 41.9s. Estimated remaining: 38m 17s. Rate: 7.1 symbols/min [2025-10-10T21:55:48.111913] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:55:48.151222] [DEBUG] [LOCAL ] TLK: Loaded 39054 existing records from primary storage. [2025-10-10T21:55:48.151840] [INFO ] [MAIN ] TLK: Loaded 39054 existing records. [2025-10-10T21:55:48.299304] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-10T21:55:48.356229] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:55:48.369906] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-10T21:55:48.370005] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-10T21:55:48.370752] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-10T21:55:48.370820] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-10T21:55:48.371613] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T21:55:48.732728] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:55:49.089414] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-10-10T21:55:49.219850] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T21:55:49.889382] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-10T21:55:50.264216] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T21:55:50.519084] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T21:55:50.689360] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-10T21:55:51.489356] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-10T21:55:51.713133] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T21:55:52.289421] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-10T21:55:52.373793] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-10T21:55:53.089360] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-10T21:55:53.215320] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T21:55:53.852190] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T21:55:53.889388] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-10T21:55:54.689438] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-10T21:55:54.846007] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T21:55:55.489442] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-10T21:55:55.767556] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T21:55:56.289458] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-10T21:55:56.454996] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T21:55:57.089422] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-10T21:55:57.341959] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T21:55:57.889344] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-10T21:55:58.100485] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-10T21:55:58.689371] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-10T21:55:58.750872] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-10T21:55:58.755232] [INFO ] [REMOTE ] TKC: Full fetch complete (53075 records). [2025-10-10T21:55:58.755313] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-10T21:55:59.170381] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-10T21:55:59.170590] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-10T21:55:59.172186] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-10T21:55:59.172302] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-10T21:55:59.198082] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T21:55:59.206793] [DEBUG] [LOCAL ] TKC: Trimmed 53075 records to 39807 (keeping 200 days of data) [2025-10-10T21:55:59.453168] [DEBUG] [LOCAL ] TKC: Primary data saved (39807 records). [2025-10-10T21:55:59.453363] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-10T21:55:59.453897] [INFO ] [MAIN ] Update Progress: 2102/2373 symbols completed. TKC took 44.1s. Estimated remaining: 38m 9s. Rate: 7.1 symbols/min [2025-10-10T21:55:59.494535] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-10T21:55:59.640338] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:55:59.661173] [DEBUG] [LOCAL ] TLYS: Loaded 16546 existing records from primary storage. [2025-10-10T21:55:59.661474] [INFO ] [MAIN ] TLYS: Loaded 16546 existing records. [2025-10-10T21:55:59.843516] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:55:59.843877] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-10T21:55:59.843937] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-10T21:55:59.844149] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-10T21:55:59.844208] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-10T21:56:00.211410] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:56:00.243963] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-10T21:56:00.289392] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-10T21:56:00.480315] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-10T21:56:01.089420] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-10T21:56:01.889418] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-10T21:56:02.032399] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-10T21:56:02.036915] [INFO ] [REMOTE ] TKO: Full fetch complete (64897 records). [2025-10-10T21:56:02.037055] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-10T21:56:02.424007] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-10T21:56:02.484734] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-10T21:56:02.484863] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-10T21:56:02.486563] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-10T21:56:02.486660] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-10T21:56:02.488764] [DEBUG] [LOCAL ] TKO: Trimmed 64897 records to 44571 (keeping 200 days of data) [2025-10-10T21:56:02.700782] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-10T21:56:02.811039] [DEBUG] [LOCAL ] TKO: Primary data saved (44571 records). [2025-10-10T21:56:02.811280] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-10T21:56:02.811430] [INFO ] [MAIN ] Update Progress: 2103/2373 symbols completed. TKO took 31.7s. Estimated remaining: 38m 0s. Rate: 7.1 symbols/min [2025-10-10T21:56:03.014753] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:56:03.057720] [DEBUG] [LOCAL ] TM: Loaded 36635 existing records from primary storage. [2025-10-10T21:56:03.058109] [INFO ] [MAIN ] TM: Loaded 36635 existing records. [2025-10-10T21:56:03.277118] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-10T21:56:03.276162] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:56:03.285978] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-10T21:56:03.286402] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-10T21:56:03.286734] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-10T21:56:03.286797] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-10T21:56:03.494752] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-10T21:56:03.674168] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:56:04.275776] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T21:56:04.289349] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-10T21:56:05.089433] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-10-10T21:56:05.394373] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T21:56:05.889367] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-10-10T21:56:05.961603] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T21:56:06.689391] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-10T21:56:06.968408] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-10T21:56:07.034552] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T21:56:07.489367] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-10T21:56:08.289380] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-10T21:56:08.381600] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-10T21:56:09.089418] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-10T21:56:09.141835] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-10T21:56:09.633016] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T21:56:09.889393] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-10T21:56:10.689375] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-10T21:56:10.837396] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T21:56:11.489439] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-10T21:56:11.758092] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T21:56:12.029711] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T21:56:12.289436] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-10T21:56:13.089382] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-10T21:56:13.180983] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T21:56:13.768231] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-10T21:56:13.772151] [INFO ] [REMOTE ] TKR: Full fetch complete (57741 records). [2025-10-10T21:56:13.772271] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-10T21:56:13.894463] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-10T21:56:14.093286] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-10T21:56:14.184577] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-10T21:56:14.184677] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-10T21:56:14.185673] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-10T21:56:14.185735] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-10T21:56:14.186881] [DEBUG] [LOCAL ] TKR: Trimmed 57741 records to 40474 (keeping 200 days of data) [2025-10-10T21:56:14.473500] [DEBUG] [LOCAL ] TKR: Primary data saved (40474 records). [2025-10-10T21:56:14.473630] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-10T21:56:14.473745] [INFO ] [MAIN ] Update Progress: 2104/2373 symbols completed. TKR took 33.4s. Estimated remaining: 37m 52s. Rate: 7.1 symbols/min [2025-10-10T21:56:14.638255] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:56:14.690021] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-10T21:56:14.691890] [DEBUG] [LOCAL ] TME: Loaded 53567 existing records from primary storage. [2025-10-10T21:56:14.692244] [INFO ] [MAIN ] TME: Loaded 53567 existing records. [2025-10-10T21:56:14.875917] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:56:14.876124] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-10T21:56:14.876176] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-10T21:56:14.876376] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-10T21:56:14.876429] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-10T21:56:15.234818] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:56:15.489345] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-10T21:56:15.673407] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T21:56:15.756172] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T21:56:16.289432] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-10T21:56:16.601356] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-10T21:56:16.605252] [INFO ] [REMOTE ] TLK: Full fetch complete (57291 records). [2025-10-10T21:56:16.605351] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-10T21:56:16.984773] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-10T21:56:16.984859] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-10T21:56:16.986210] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-10T21:56:16.986293] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-10T21:56:16.987607] [DEBUG] [LOCAL ] TLK: Trimmed 57291 records to 39321 (keeping 200 days of data) [2025-10-10T21:56:17.090252] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-10T21:56:17.248697] [DEBUG] [LOCAL ] TLK: Primary data saved (39321 records). [2025-10-10T21:56:17.248941] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-10T21:56:17.249090] [INFO ] [MAIN ] Update Progress: 2105/2373 symbols completed. TLK took 29.3s. Estimated remaining: 37m 43s. Rate: 7.1 symbols/min [2025-10-10T21:56:17.422913] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:56:17.465268] [DEBUG] [LOCAL ] TMHC: Loaded 45681 existing records from primary storage. [2025-10-10T21:56:17.465681] [INFO ] [MAIN ] TMHC: Loaded 45681 existing records. [2025-10-10T21:56:17.647744] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:56:17.647962] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-10T21:56:17.648010] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-10T21:56:17.648213] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-10T21:56:17.648250] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-10T21:56:17.892574] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-10-10T21:56:18.041288] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:56:18.049965] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-10T21:56:18.313925] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T21:56:18.689403] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-10T21:56:19.489445] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-10T21:56:19.960529] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-10T21:56:20.289355] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-10T21:56:20.457514] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-10T21:56:20.474428] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-10T21:56:21.089397] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-10T21:56:21.889380] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-10T21:56:22.352177] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T21:56:22.689357] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-10T21:56:23.045062] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-10T21:56:23.148132] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T21:56:23.489376] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-10T21:56:24.289384] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-10T21:56:24.865521] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-10T21:56:24.907578] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-10T21:56:25.089414] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-10T21:56:25.889427] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-10T21:56:26.331384] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-10T21:56:26.664747] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-10T21:56:26.689333] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-10T21:56:27.168218] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-10T21:56:27.489461] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-10T21:56:28.289397] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-10-10T21:56:28.482020] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-10T21:56:28.733494] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T21:56:29.089447] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-10T21:56:29.889401] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-10T21:56:30.090172] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T21:56:30.246684] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-10T21:56:30.689412] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-10T21:56:31.489387] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-10T21:56:32.063053] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-10T21:56:32.278799] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-10T21:56:32.280367] [INFO ] [REMOTE ] TLYS: Full fetch complete (21721 records). [2025-10-10T21:56:32.280455] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-10T21:56:32.294558] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-10T21:56:32.649784] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T21:56:32.742629] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-10T21:56:32.742739] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-10T21:56:32.743294] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-10T21:56:32.743335] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-10T21:56:32.743992] [DEBUG] [LOCAL ] TLYS: Trimmed 21721 records to 16650 (keeping 200 days of data) [2025-10-10T21:56:32.838691] [DEBUG] [LOCAL ] TLYS: Primary data saved (16650 records). [2025-10-10T21:56:32.838852] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-10T21:56:32.838941] [INFO ] [MAIN ] Update Progress: 2106/2373 symbols completed. TLYS took 33.4s. Estimated remaining: 37m 35s. Rate: 7.1 symbols/min [2025-10-10T21:56:33.008339] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:56:33.058081] [DEBUG] [LOCAL ] TMO: Loaded 52801 existing records from primary storage. [2025-10-10T21:56:33.058417] [INFO ] [MAIN ] TMO: Loaded 52801 existing records. [2025-10-10T21:56:33.094597] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-10T21:56:33.241533] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:56:33.241958] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-10T21:56:33.242012] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-10T21:56:33.242295] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-10T21:56:33.242352] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-10T21:56:33.589510] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:56:33.889353] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-10T21:56:34.489093] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-10T21:56:34.689358] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-10-10T21:56:34.964068] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-10T21:56:35.489388] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-10T21:56:35.616037] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T21:56:36.215230] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-10T21:56:36.289369] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-10T21:56:36.525241] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-10T21:56:37.089440] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-10T21:56:37.889390] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-10T21:56:38.403019] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-10T21:56:38.689435] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-10T21:56:39.304792] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-10T21:56:39.375841] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-10T21:56:39.379282] [INFO ] [REMOTE ] TM: Full fetch complete (52687 records). [2025-10-10T21:56:39.379376] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-10T21:56:39.494923] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-10T21:56:39.760770] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-10T21:56:39.760866] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-10T21:56:39.761899] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-10T21:56:39.761967] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-10T21:56:39.763282] [DEBUG] [LOCAL ] TM: Trimmed 52687 records to 36916 (keeping 200 days of data) [2025-10-10T21:56:39.983292] [DEBUG] [LOCAL ] TM: Primary data saved (36916 records). [2025-10-10T21:56:39.983435] [INFO ] [MAIN ] TM: Full history saved. [2025-10-10T21:56:39.983518] [INFO ] [MAIN ] Update Progress: 2107/2373 symbols completed. TM took 37.2s. Estimated remaining: 37m 27s. Rate: 7.1 symbols/min [2025-10-10T21:56:40.150406] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:56:40.170900] [DEBUG] [LOCAL ] TNC: Loaded 14670 existing records from primary storage. [2025-10-10T21:56:40.171239] [INFO ] [MAIN ] TNC: Loaded 14670 existing records. [2025-10-10T21:56:40.301297] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-10T21:56:40.352635] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:56:40.352906] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-10T21:56:40.352954] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-10T21:56:40.353213] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-10T21:56:40.353288] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-10T21:56:40.710128] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:56:40.736238] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-10T21:56:41.089344] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-10-10T21:56:41.457402] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T21:56:41.856814] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-10T21:56:41.889334] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-10T21:56:42.642713] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-10T21:56:42.689353] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-10T21:56:43.116424] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-10T21:56:43.489436] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-10T21:56:44.289369] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-10T21:56:44.727606] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-10T21:56:45.089396] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-10T21:56:45.474808] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-10T21:56:45.611296] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-10T21:56:45.889460] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-10T21:56:46.689352] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-10T21:56:46.990563] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T21:56:46.995702] [INFO ] [REMOTE ] TME: Full fetch complete (76920 records). [2025-10-10T21:56:46.995871] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-10T21:56:47.429404] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-10T21:56:47.429482] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-10T21:56:47.430630] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-10T21:56:47.430713] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-10T21:56:47.432289] [DEBUG] [LOCAL ] TME: Trimmed 76920 records to 53957 (keeping 200 days of data) [2025-10-10T21:56:47.490680] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-10T21:56:47.810573] [DEBUG] [LOCAL ] TME: Primary data saved (53957 records). [2025-10-10T21:56:47.810744] [INFO ] [MAIN ] TME: Full history saved. [2025-10-10T21:56:47.810836] [INFO ] [MAIN ] Update Progress: 2108/2373 symbols completed. TME took 33.3s. Estimated remaining: 37m 18s. Rate: 7.1 symbols/min [2025-10-10T21:56:48.001877] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:56:48.034417] [DEBUG] [LOCAL ] TNET: Loaded 28458 existing records from primary storage. [2025-10-10T21:56:48.034833] [INFO ] [MAIN ] TNET: Loaded 28458 existing records. [2025-10-10T21:56:48.226303] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:56:48.227083] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-10T21:56:48.227282] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-10T21:56:48.239375] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-10T21:56:48.239479] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-10T21:56:48.371912] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-10T21:56:48.433972] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-10T21:56:48.664307] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:56:48.703151] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T21:56:48.752549] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T21:56:49.089384] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-10-10T21:56:49.889411] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-10T21:56:50.516186] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-10T21:56:50.693204] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-10T21:56:50.701123] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-10T21:56:51.108810] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-10T21:56:51.489406] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-10T21:56:52.289350] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-10T21:56:52.421506] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T21:56:53.089362] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-10T21:56:53.430414] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-10T21:56:53.618948] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-10T21:56:53.889425] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-10T21:56:54.689404] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-10T21:56:54.833807] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T21:56:55.489359] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-10T21:56:55.816953] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-10T21:56:56.164896] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-10T21:56:56.289340] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-10T21:56:56.807588] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-10T21:56:57.089367] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-10T21:56:57.889356] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-10T21:56:57.890782] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T21:56:58.689407] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-10T21:56:59.081314] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T21:56:59.476015] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T21:56:59.489325] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-10T21:57:00.289386] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-10T21:57:00.738341] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T21:57:01.089512] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-10T21:57:01.445968] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T21:57:01.528303] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T21:57:01.861770] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T21:57:01.866722] [INFO ] [REMOTE ] TMO: Full fetch complete (75482 records). [2025-10-10T21:57:01.866870] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-10T21:57:01.896197] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-10T21:57:02.280599] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-10T21:57:02.280724] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-10T21:57:02.281978] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-10T21:57:02.282042] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-10T21:57:02.283424] [DEBUG] [LOCAL ] TMO: Trimmed 75482 records to 53169 (keeping 200 days of data) [2025-10-10T21:57:02.654897] [DEBUG] [LOCAL ] TMO: Primary data saved (53169 records). [2025-10-10T21:57:02.655036] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-10T21:57:02.655744] [INFO ] [MAIN ] Update Progress: 2109/2373 symbols completed. TMO took 29.8s. Estimated remaining: 37m 10s. Rate: 7.1 symbols/min [2025-10-10T21:57:02.698504] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-10T21:57:02.825557] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:57:02.825782] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-10T21:57:02.825827] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-10T21:57:02.825938] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-10T21:57:02.825978] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-10T21:57:02.826019] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-10T21:57:02.826051] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-10T21:57:03.174902] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:57:03.489371] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-10T21:57:03.665420] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T21:57:03.753531] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-10T21:57:04.289427] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-10-10T21:57:04.543164] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T21:57:04.543487] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-10-10T21:57:04.543578] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T21:57:04.543624] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-10T21:57:04.543704] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T21:57:04.543753] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-10T21:57:04.543808] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-10T21:57:04.543843] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-10T21:57:04.543881] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-10T21:57:04.543928] [INFO ] [MAIN ] Update Progress: 2110/2373 symbols completed. TNGY took 1.9s. Estimated remaining: 37m 1s. Rate: 7.1 symbols/min [2025-10-10T21:57:04.720696] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:57:04.756513] [DEBUG] [LOCAL ] TNK: Loaded 35458 existing records from primary storage. [2025-10-10T21:57:04.756883] [INFO ] [MAIN ] TNK: Loaded 35458 existing records. [2025-10-10T21:57:04.934766] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:57:04.935003] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-10T21:57:04.935049] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-10T21:57:04.935258] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-10T21:57:04.935314] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-10T21:57:05.090497] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-10T21:57:05.299196] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:57:05.337148] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T21:57:05.889420] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-10T21:57:06.332114] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T21:57:06.689452] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-10T21:57:07.361099] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T21:57:07.362769] [INFO ] [REMOTE ] TNC: Full fetch complete (22468 records). [2025-10-10T21:57:07.362864] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-10T21:57:07.493202] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-10-10T21:57:07.684671] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T21:57:07.791289] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-10T21:57:07.791374] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-10T21:57:07.791986] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-10T21:57:07.792049] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-10T21:57:07.792639] [DEBUG] [LOCAL ] TNC: Trimmed 22468 records to 14744 (keeping 200 days of data) [2025-10-10T21:57:07.885887] [DEBUG] [LOCAL ] TNC: Primary data saved (14744 records). [2025-10-10T21:57:07.886028] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-10T21:57:07.886117] [INFO ] [MAIN ] Update Progress: 2111/2373 symbols completed. TNC took 27.9s. Estimated remaining: 36m 52s. Rate: 7.1 symbols/min [2025-10-10T21:57:08.050746] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:57:08.090590] [DEBUG] [LOCAL ] TNL: Loaded 42062 existing records from primary storage. [2025-10-10T21:57:08.090922] [INFO ] [MAIN ] TNL: Loaded 42062 existing records. [2025-10-10T21:57:08.270697] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:57:08.270937] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-10T21:57:08.270984] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-10T21:57:08.271226] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-10T21:57:08.271293] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-10T21:57:08.301428] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-10T21:57:08.634083] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:57:09.089361] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-10T21:57:09.191366] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-10T21:57:09.889407] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-10T21:57:10.036569] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T21:57:10.041165] [INFO ] [REMOTE ] TMHC: Full fetch complete (65996 records). [2025-10-10T21:57:10.041270] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-10T21:57:10.431581] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-10T21:57:10.431874] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-10T21:57:10.433125] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-10T21:57:10.433207] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-10T21:57:10.452814] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T21:57:10.461407] [DEBUG] [LOCAL ] TMHC: Trimmed 65996 records to 45999 (keeping 200 days of data) [2025-10-10T21:57:10.689626] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-10T21:57:10.753990] [DEBUG] [LOCAL ] TMHC: Primary data saved (45999 records). [2025-10-10T21:57:10.754144] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-10T21:57:10.754232] [INFO ] [MAIN ] Update Progress: 2112/2373 symbols completed. TMHC took 53.5s. Estimated remaining: 36m 43s. Rate: 7.1 symbols/min [2025-10-10T21:57:10.930141] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:57:10.984514] [DEBUG] [LOCAL ] TOL: Loaded 51135 existing records from primary storage. [2025-10-10T21:57:10.984876] [INFO ] [MAIN ] TOL: Loaded 51135 existing records. [2025-10-10T21:57:11.170905] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:57:11.171263] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-10T21:57:11.171330] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-10T21:57:11.171556] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-10T21:57:11.171613] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-10T21:57:11.494295] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-10-10T21:57:11.534618] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:57:11.578138] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T21:57:12.003519] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T21:57:12.289377] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-10T21:57:12.632995] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-10T21:57:13.089385] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-10T21:57:13.889684] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-10-10T21:57:13.894448] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T21:57:14.689408] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-10T21:57:14.718338] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T21:57:15.500152] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-10T21:57:15.502828] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-10T21:57:16.247889] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-10T21:57:16.289356] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-10T21:57:17.089384] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-10T21:57:17.190477] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T21:57:17.729178] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T21:57:17.889400] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-10T21:57:18.638614] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-10T21:57:18.689367] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-10T21:57:19.294423] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T21:57:19.489402] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-10T21:57:20.289356] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-10T21:57:20.634311] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-10T21:57:20.653729] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-10T21:57:20.657025] [INFO ] [REMOTE ] TNET: Full fetch complete (41571 records). [2025-10-10T21:57:20.657203] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-10T21:57:21.068169] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-10T21:57:21.068271] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-10T21:57:21.069188] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-10T21:57:21.069253] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-10T21:57:21.070298] [DEBUG] [LOCAL ] TNET: Trimmed 41571 records to 28679 (keeping 200 days of data) [2025-10-10T21:57:21.126726] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-10T21:57:21.258142] [DEBUG] [LOCAL ] TNET: Primary data saved (28679 records). [2025-10-10T21:57:21.258331] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-10T21:57:21.258423] [INFO ] [MAIN ] Update Progress: 2113/2373 symbols completed. TNET took 33.4s. Estimated remaining: 36m 35s. Rate: 7.1 symbols/min [2025-10-10T21:57:21.434434] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:57:21.496331] [DEBUG] [LOCAL ] TOST: Loaded 54073 existing records from primary storage. [2025-10-10T21:57:21.496691] [INFO ] [MAIN ] TOST: Loaded 54073 existing records. [2025-10-10T21:57:21.685315] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:57:21.685682] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-10T21:57:21.685762] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-10T21:57:21.686038] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-10T21:57:21.686128] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-10T21:57:21.894742] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-10T21:57:22.023348] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T21:57:22.101520] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:57:22.689409] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-10T21:57:22.786281] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-10T21:57:23.489392] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-10-10T21:57:24.045019] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T21:57:24.171451] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-10T21:57:24.289450] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-10T21:57:25.089384] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-10T21:57:25.137338] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-10T21:57:25.889361] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-10T21:57:26.310078] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T21:57:26.689413] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-10T21:57:26.868628] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-10T21:57:27.489359] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-10T21:57:27.615754] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T21:57:27.980727] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-10T21:57:28.289380] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-10T21:57:28.633126] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T21:57:29.089411] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-10T21:57:29.889418] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-10T21:57:30.494737] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-10T21:57:30.632770] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-10T21:57:30.689420] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-10T21:57:31.489415] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-10T21:57:31.588725] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T21:57:32.289394] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-10T21:57:32.865807] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-10T21:57:33.089467] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-10T21:57:33.128323] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-10T21:57:33.874171] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T21:57:33.889332] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-10T21:57:34.689459] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-10T21:57:34.912487] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-10T21:57:35.481530] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T21:57:35.489324] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-10T21:57:36.289414] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-10T21:57:36.943544] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-10T21:57:36.978849] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-10T21:57:37.089383] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-10T21:57:37.889402] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-10T21:57:38.340098] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-10T21:57:38.689372] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-10T21:57:39.035717] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-10T21:57:39.209710] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-10T21:57:39.489423] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-10T21:57:40.268884] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-10T21:57:40.289366] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-10T21:57:41.089386] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-10T21:57:41.284456] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T21:57:41.889358] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-10T21:57:41.939238] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-10T21:57:42.472111] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T21:57:42.475634] [INFO ] [REMOTE ] TNK: Full fetch complete (51863 records). [2025-10-10T21:57:42.475764] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-10T21:57:42.695815] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-10T21:57:42.900309] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-10T21:57:42.900386] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-10T21:57:42.901323] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-10T21:57:42.901385] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-10T21:57:42.902419] [DEBUG] [LOCAL ] TNK: Trimmed 51863 records to 35697 (keeping 200 days of data) [2025-10-10T21:57:43.116324] [DEBUG] [LOCAL ] TNK: Primary data saved (35697 records). [2025-10-10T21:57:43.116472] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-10T21:57:43.116555] [INFO ] [MAIN ] Update Progress: 2114/2373 symbols completed. TNK took 38.6s. Estimated remaining: 36m 28s. Rate: 7.1 symbols/min [2025-10-10T21:57:43.282030] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:57:43.312995] [DEBUG] [LOCAL ] TPB: Loaded 25800 existing records from primary storage. [2025-10-10T21:57:43.313312] [INFO ] [MAIN ] TPB: Loaded 25800 existing records. [2025-10-10T21:57:43.498046] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:57:43.498581] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-10T21:57:43.498247] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-10T21:57:43.499565] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-10T21:57:43.500046] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-10T21:57:43.500185] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-10T21:57:43.715541] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-10T21:57:43.897369] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:57:44.289373] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-10T21:57:44.321363] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T21:57:44.326304] [INFO ] [REMOTE ] TOL: Full fetch complete (73689 records). [2025-10-10T21:57:44.326438] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-10T21:57:44.729562] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-10T21:57:44.729738] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-10T21:57:44.731047] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-10T21:57:44.731142] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-10T21:57:44.732623] [DEBUG] [LOCAL ] TOL: Trimmed 73689 records to 51509 (keeping 200 days of data) [2025-10-10T21:57:45.008563] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-10T21:57:45.100483] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-10T21:57:45.126211] [DEBUG] [LOCAL ] TOL: Primary data saved (51509 records). [2025-10-10T21:57:45.126361] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-10T21:57:45.126488] [INFO ] [MAIN ] Update Progress: 2115/2373 symbols completed. TOL took 34.4s. Estimated remaining: 36m 19s. Rate: 7.1 symbols/min [2025-10-10T21:57:45.324346] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:57:45.363502] [DEBUG] [LOCAL ] TPC: Loaded 39226 existing records from primary storage. [2025-10-10T21:57:45.363855] [INFO ] [MAIN ] TPC: Loaded 39226 existing records. [2025-10-10T21:57:45.546116] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:57:45.546356] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-10T21:57:45.546403] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-10T21:57:45.546712] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-10T21:57:45.546771] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-10T21:57:45.846932] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-10T21:57:45.863612] [INFO ] [REMOTE ] TNL: Full fetch complete (59171 records). [2025-10-10T21:57:45.874173] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-10T21:57:45.894405] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-10-10T21:57:46.007095] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:57:46.343867] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-10T21:57:46.343991] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-10T21:57:46.345770] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-10T21:57:46.345856] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-10T21:57:46.347566] [DEBUG] [LOCAL ] TNL: Trimmed 59171 records to 42370 (keeping 200 days of data) [2025-10-10T21:57:46.631402] [DEBUG] [LOCAL ] TNL: Primary data saved (42370 records). [2025-10-10T21:57:46.631578] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-10T21:57:46.631702] [INFO ] [MAIN ] Update Progress: 2116/2373 symbols completed. TNL took 38.7s. Estimated remaining: 36m 10s. Rate: 7.1 symbols/min [2025-10-10T21:57:46.696746] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-10-10T21:57:46.809866] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:57:46.854725] [DEBUG] [LOCAL ] TPH: Loaded 45227 existing records from primary storage. [2025-10-10T21:57:46.855116] [INFO ] [MAIN ] TPH: Loaded 45227 existing records. [2025-10-10T21:57:47.039690] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:57:47.039953] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-10T21:57:47.040007] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-10T21:57:47.040253] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-10T21:57:47.040311] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-10T21:57:47.436815] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T21:57:47.435891] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:57:47.489333] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-10-10T21:57:47.541252] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-10T21:57:47.794513] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-10T21:57:48.289393] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-10T21:57:48.758245] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-10T21:57:49.089378] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-10T21:57:49.889395] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-10T21:57:49.923602] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T21:57:50.695121] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-10T21:57:50.706729] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T21:57:51.135045] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-10T21:57:51.489434] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-10T21:57:52.289363] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-10T21:57:53.016127] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-10T21:57:53.089375] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-10T21:57:53.134948] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-10T21:57:53.452912] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T21:57:53.889378] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-10T21:57:54.611288] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-10T21:57:54.689380] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-10T21:57:55.489395] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-10T21:57:55.761700] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T21:57:56.200823] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-10T21:57:56.289389] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-10T21:57:57.089427] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-10T21:57:57.708854] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-10T21:57:57.740066] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-10T21:57:57.889382] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-10T21:57:58.689371] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-10T21:57:58.726217] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-10T21:57:59.113711] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-10T21:57:59.489380] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-10T21:58:00.289360] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-10T21:58:00.494990] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T21:58:01.089385] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-10T21:58:01.119147] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-10T21:58:01.174394] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-10T21:58:01.889443] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-10T21:58:02.438958] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-10T21:58:02.689418] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-10T21:58:03.330296] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T21:58:03.336169] [INFO ] [REMOTE ] TOST: Full fetch complete (77700 records). [2025-10-10T21:58:03.336358] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-10T21:58:03.494601] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-10T21:58:03.779267] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-10T21:58:03.779372] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-10T21:58:03.780851] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-10T21:58:03.780924] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-10T21:58:03.785013] [DEBUG] [LOCAL ] TOST: Trimmed 77700 records to 54463 (keeping 200 days of data) [2025-10-10T21:58:04.183921] [DEBUG] [LOCAL ] TOST: Primary data saved (54463 records). [2025-10-10T21:58:04.184122] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-10T21:58:04.184226] [INFO ] [MAIN ] Update Progress: 2117/2373 symbols completed. TOST took 42.9s. Estimated remaining: 36m 2s. Rate: 7.1 symbols/min [2025-10-10T21:58:04.285991] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-10T21:58:04.295448] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-10T21:58:04.751191] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T21:58:05.089398] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-10T21:58:05.659904] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-10T21:58:05.889471] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-10T21:58:06.689465] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-10T21:58:06.808029] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T21:58:07.397500] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-10T21:58:07.489383] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-10T21:58:08.126675] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-10T21:58:08.289407] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-10T21:58:08.397638] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T21:58:09.089459] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-10T21:58:09.889391] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-10T21:58:10.059162] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T21:58:10.494972] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T21:58:10.689428] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-10T21:58:11.406288] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-10T21:58:11.489376] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-10T21:58:12.289427] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-10T21:58:12.498736] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T21:58:12.839310] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-10T21:58:12.842917] [INFO ] [REMOTE ] TPB: Full fetch complete (35690 records). [2025-10-10T21:58:12.843023] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-10T21:58:13.097625] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-10T21:58:13.218154] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-10T21:58:13.218238] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-10T21:58:13.219106] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-10T21:58:13.219169] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-10T21:58:13.219975] [DEBUG] [LOCAL ] TPB: Trimmed 35690 records to 26064 (keeping 200 days of data) [2025-10-10T21:58:13.404287] [DEBUG] [LOCAL ] TPB: Primary data saved (26064 records). [2025-10-10T21:58:13.404427] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-10T21:58:13.404514] [INFO ] [MAIN ] Update Progress: 2118/2373 symbols completed. TPB took 30.3s. Estimated remaining: 35m 54s. Rate: 7.1 symbols/min [2025-10-10T21:58:14.095049] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T21:58:14.103333] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-10T21:58:14.742408] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-10T21:58:14.746730] [INFO ] [REMOTE ] TPH: Full fetch complete (64843 records). [2025-10-10T21:58:14.746836] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-10T21:58:15.139395] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-10T21:58:15.139497] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-10T21:58:15.140776] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-10T21:58:15.140852] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-10T21:58:15.142396] [DEBUG] [LOCAL ] TPH: Trimmed 64843 records to 45574 (keeping 200 days of data) [2025-10-10T21:58:15.429834] [DEBUG] [LOCAL ] TPH: Primary data saved (45574 records). [2025-10-10T21:58:15.430011] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-10T21:58:15.430158] [INFO ] [MAIN ] Update Progress: 2119/2373 symbols completed. TPH took 28.8s. Estimated remaining: 35m 45s. Rate: 7.1 symbols/min [2025-10-10T21:58:15.624045] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-10T21:58:15.627892] [INFO ] [REMOTE ] TPC: Full fetch complete (55222 records). [2025-10-10T21:58:15.627996] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-10T21:58:15.996205] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-10T21:58:15.996307] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-10T21:58:15.997249] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-10T21:58:15.997333] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-10T21:58:15.998537] [DEBUG] [LOCAL ] TPC: Trimmed 55222 records to 39503 (keeping 200 days of data) [2025-10-10T21:58:16.231378] [DEBUG] [LOCAL ] TPC: Primary data saved (39503 records). [2025-10-10T21:58:16.231520] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-10T21:58:16.231604] [INFO ] [MAIN ] Update Progress: 2120/2373 symbols completed. TPC took 31.1s. Estimated remaining: 35m 35s. Rate: 7.1 symbols/min [2025-10-10T21:58:16.962097] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:58:16.934404] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:58:16.997069] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:58:17.068118] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:58:17.076747] [DEBUG] [LOCAL ] TPYP: Loaded 7959 existing records from primary storage. [2025-10-10T21:58:17.077143] [INFO ] [MAIN ] TPYP: Loaded 7959 existing records. [2025-10-10T21:58:17.082553] [DEBUG] [LOCAL ] TPL: Loaded 12371 existing records from primary storage. [2025-10-10T21:58:17.088914] [INFO ] [MAIN ] TPL: Loaded 12371 existing records. [2025-10-10T21:58:17.327041] [DEBUG] [LOCAL ] TPVG: Loaded 27262 existing records from primary storage. [2025-10-10T21:58:17.354966] [INFO ] [MAIN ] TPVG: Loaded 27262 existing records. [2025-10-10T21:58:17.477531] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:58:17.561892] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-10T21:58:17.553814] [DEBUG] [LOCAL ] TPR: Loaded 53825 existing records from primary storage. [2025-10-10T21:58:17.594431] [INFO ] [MAIN ] TPR: Loaded 53825 existing records. [2025-10-10T21:58:17.588864] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-10T21:58:17.672745] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-10T21:58:17.706797] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-10T21:58:17.720494] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:58:17.751243] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-10T21:58:17.761825] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-10T21:58:17.857984] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-10T21:58:17.924563] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:58:17.939507] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-10T21:58:17.975778] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-10T21:58:17.928724] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-10T21:58:18.081007] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:58:18.053794] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-10T21:58:18.102805] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-10T21:58:18.102720] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-10T21:58:18.217412] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-10T21:58:18.304855] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-10T21:58:18.365545] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-10T21:58:19.155444] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:58:19.207543] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-10-10T21:58:19.269521] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:58:19.319028] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-10-10T21:58:19.508149] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:58:19.547326] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-10-10T21:58:19.551311] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:58:19.552961] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-10-10T21:58:20.147830] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-10T21:58:20.150036] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-10T21:58:20.693454] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T21:58:20.698338] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-10T21:58:20.793692] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-10T21:58:20.796963] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-10T21:58:21.188763] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-10T21:58:21.196392] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-10T21:58:21.602401] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T21:58:21.614194] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-10T21:58:21.783324] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-10T21:58:21.798669] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-10T21:58:21.889387] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-10T21:58:22.161615] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T21:58:22.689420] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-10T21:58:22.839603] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-10T21:58:23.489412] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-10T21:58:23.658692] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T21:58:23.899285] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T21:58:24.289361] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-10T21:58:24.400054] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-10T21:58:25.089379] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-10T21:58:25.317791] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-10T21:58:25.889458] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-10T21:58:26.689396] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-10T21:58:26.783496] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-10T21:58:27.130502] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-10T21:58:27.489408] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-10T21:58:27.735313] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-10T21:58:28.289372] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-10T21:58:28.326681] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-10T21:58:29.089444] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-10T21:58:29.779086] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-10T21:58:29.889409] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-10T21:58:30.689409] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-10T21:58:31.278536] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-10T21:58:31.424206] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T21:58:31.489409] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-10T21:58:31.903022] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T21:58:32.006099] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-10T21:58:32.289417] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-10T21:58:33.089369] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-10T21:58:33.246210] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-10T21:58:33.889368] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-10T21:58:34.126173] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-10T21:58:34.689364] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-10T21:58:34.743374] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-10T21:58:35.489412] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-10T21:58:36.157009] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T21:58:36.158325] [INFO ] [REMOTE ] TPYP: Full fetch complete (12465 records). [2025-10-10T21:58:36.158395] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-10T21:58:36.300721] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-10T21:58:36.536813] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-10T21:58:36.536899] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-10T21:58:36.537292] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-10T21:58:36.537355] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-10T21:58:36.537984] [DEBUG] [LOCAL ] TPYP: Trimmed 12465 records to 8020 (keeping 200 days of data) [2025-10-10T21:58:36.602620] [DEBUG] [LOCAL ] TPYP: Primary data saved (8020 records). [2025-10-10T21:58:36.602793] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-10T21:58:36.602897] [INFO ] [MAIN ] Update Progress: 2121/2373 symbols completed. TPYP took 20.4s. Estimated remaining: 35m 28s. Rate: 7.1 symbols/min [2025-10-10T21:58:36.777346] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:58:36.786176] [DEBUG] [LOCAL ] TPZ: Loaded 4867 existing records from primary storage. [2025-10-10T21:58:36.786439] [INFO ] [MAIN ] TPZ: Loaded 4867 existing records. [2025-10-10T21:58:36.995112] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:58:37.014745] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-10T21:58:37.014854] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-10T21:58:37.030347] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-10T21:58:37.030432] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-10T21:58:37.037953] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-10T21:58:37.094556] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-10T21:58:37.460481] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:58:37.691419] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-10T21:58:37.889359] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-10T21:58:38.366213] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-10T21:58:38.689375] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-10T21:58:39.489397] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-10-10T21:58:39.870132] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T21:58:40.023093] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-10T21:58:40.036766] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-10T21:58:40.289402] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-10T21:58:41.089391] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-10T21:58:41.792750] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-10T21:58:41.889390] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-10T21:58:42.610285] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T21:58:42.689428] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-10T21:58:43.192725] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-10T21:58:43.489388] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-10T21:58:44.289396] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-10T21:58:44.423246] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-10T21:58:44.898835] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-10T21:58:44.921141] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-10T21:58:45.089388] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-10T21:58:45.889343] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-10T21:58:45.991115] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T21:58:46.689399] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-10T21:58:47.262770] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T21:58:47.489394] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-10T21:58:48.289408] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-10T21:58:48.532397] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T21:58:49.043411] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-10T21:58:49.089325] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-10T21:58:49.195512] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-10T21:58:49.889398] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-10T21:58:50.425871] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T21:58:50.429342] [INFO ] [REMOTE ] TPVG: Full fetch complete (39665 records). [2025-10-10T21:58:50.429439] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-10T21:58:50.694502] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-10T21:58:50.800998] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-10T21:58:50.817372] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-10T21:58:50.817462] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-10T21:58:50.818427] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-10T21:58:50.818527] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-10T21:58:50.819485] [DEBUG] [LOCAL ] TPVG: Trimmed 39665 records to 27522 (keeping 200 days of data) [2025-10-10T21:58:51.026291] [DEBUG] [LOCAL ] TPVG: Primary data saved (27522 records). [2025-10-10T21:58:51.026503] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-10T21:58:51.026621] [INFO ] [MAIN ] Update Progress: 2122/2373 symbols completed. TPVG took 34.8s. Estimated remaining: 35m 20s. Rate: 7.1 symbols/min [2025-10-10T21:58:51.213040] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:58:51.235683] [DEBUG] [LOCAL ] TR: Loaded 18876 existing records from primary storage. [2025-10-10T21:58:51.236007] [INFO ] [MAIN ] TR: Loaded 18876 existing records. [2025-10-10T21:58:51.418698] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:58:51.419003] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-10T21:58:51.419054] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-10T21:58:51.419282] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-10T21:58:51.419340] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-10T21:58:51.497404] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-10T21:58:51.795284] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:58:52.126228] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-10T21:58:52.289431] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-10T21:58:52.795514] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-10T21:58:52.797203] [INFO ] [REMOTE ] TPL: Full fetch complete (17629 records). [2025-10-10T21:58:52.797276] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-10T21:58:53.098316] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-10T21:58:53.222958] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-10T21:58:53.244446] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-10T21:58:53.245010] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-10T21:58:53.245922] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-10T21:58:53.246012] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-10T21:58:53.247518] [DEBUG] [LOCAL ] TPL: Trimmed 17629 records to 12460 (keeping 200 days of data) [2025-10-10T21:58:53.350539] [DEBUG] [LOCAL ] TPL: Primary data saved (12460 records). [2025-10-10T21:58:53.350772] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-10T21:58:53.350886] [INFO ] [MAIN ] Update Progress: 2123/2373 symbols completed. TPL took 37.1s. Estimated remaining: 35m 11s. Rate: 7.1 symbols/min [2025-10-10T21:58:53.518309] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:58:53.532135] [DEBUG] [LOCAL ] TRAK: Loaded 9675 existing records from primary storage. [2025-10-10T21:58:53.532461] [INFO ] [MAIN ] TRAK: Loaded 9675 existing records. [2025-10-10T21:58:53.725344] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:58:53.725707] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-10T21:58:53.725784] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-10T21:58:53.726023] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-10T21:58:53.726082] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-10T21:58:53.902767] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-10T21:58:53.980982] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-10T21:58:54.109103] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:58:54.689394] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-10-10T21:58:55.489409] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-10T21:58:55.707207] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-10T21:58:55.715142] [INFO ] [REMOTE ] TPR: Full fetch complete (77392 records). [2025-10-10T21:58:55.715384] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-10T21:58:55.878791] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T21:58:56.152734] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-10T21:58:56.152847] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-10T21:58:56.154324] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-10T21:58:56.154394] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-10T21:58:56.156516] [DEBUG] [LOCAL ] TPR: Trimmed 77392 records to 54214 (keeping 200 days of data) [2025-10-10T21:58:56.174174] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-10T21:58:56.289588] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-10T21:58:56.575847] [DEBUG] [LOCAL ] TPR: Primary data saved (54214 records). [2025-10-10T21:58:56.576053] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-10T21:58:56.577111] [INFO ] [MAIN ] Update Progress: 2124/2373 symbols completed. TPR took 40.3s. Estimated remaining: 35m 2s. Rate: 7.1 symbols/min [2025-10-10T21:58:56.752235] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:58:56.773532] [DEBUG] [LOCAL ] TRC: Loaded 15744 existing records from primary storage. [2025-10-10T21:58:56.773966] [INFO ] [MAIN ] TRC: Loaded 15744 existing records. [2025-10-10T21:58:56.955373] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:58:56.955700] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-10T21:58:56.955763] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-10T21:58:56.956020] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-10T21:58:56.956078] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-10T21:58:57.094570] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-10T21:58:57.356818] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:58:57.424616] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-10T21:58:57.604188] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-10T21:58:57.889403] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-10T21:58:58.689398] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-10-10T21:58:58.922678] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-10T21:58:59.377773] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-10T21:58:59.489409] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-10-10T21:59:00.289378] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-10T21:59:00.392153] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-10T21:59:00.969158] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-10T21:59:01.089420] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-10T21:59:01.749367] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-10T21:59:01.889390] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-10T21:59:02.565050] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-10T21:59:02.566952] [INFO ] [REMOTE ] TPZ: Full fetch complete (9109 records). [2025-10-10T21:59:02.567138] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-10T21:59:02.689944] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-10T21:59:02.958634] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-10T21:59:02.958764] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-10T21:59:02.959179] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-10T21:59:02.959221] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-10T21:59:02.959845] [DEBUG] [LOCAL ] TPZ: Trimmed 9109 records to 4896 (keeping 200 days of data) [2025-10-10T21:59:02.995960] [DEBUG] [LOCAL ] TPZ: Primary data saved (4896 records). [2025-10-10T21:59:02.996107] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-10T21:59:02.996205] [INFO ] [MAIN ] Update Progress: 2125/2373 symbols completed. TPZ took 26.4s. Estimated remaining: 34m 54s. Rate: 7.1 symbols/min [2025-10-10T21:59:03.163380] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:59:03.216155] [DEBUG] [LOCAL ] TREX: Loaded 50263 existing records from primary storage. [2025-10-10T21:59:03.216581] [INFO ] [MAIN ] TREX: Loaded 50263 existing records. [2025-10-10T21:59:03.401883] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:59:03.402505] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-10T21:59:03.402569] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-10T21:59:03.402817] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-10T21:59:03.402876] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-10T21:59:03.494537] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-10T21:59:03.685393] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-10T21:59:03.785318] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:59:04.289409] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-10-10T21:59:04.529686] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-10T21:59:05.089406] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-10T21:59:05.889393] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-10T21:59:06.087682] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T21:59:06.340846] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T21:59:06.428781] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-10T21:59:06.689394] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-10T21:59:07.489364] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-10T21:59:07.771605] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T21:59:08.289415] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-10T21:59:08.674902] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-10T21:59:09.089392] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-10T21:59:09.751031] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T21:59:09.889393] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-10T21:59:10.055564] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T21:59:10.689399] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-10T21:59:11.489366] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-10T21:59:11.708891] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T21:59:11.820908] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-10T21:59:12.289398] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-10T21:59:12.732879] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T21:59:13.089410] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-10T21:59:13.611935] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T21:59:13.889385] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-10T21:59:14.010409] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-10T21:59:14.689395] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-10T21:59:15.489378] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-10T21:59:16.000427] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-10T21:59:16.030920] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-10T21:59:16.203348] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-10T21:59:16.289382] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-10T21:59:17.089392] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-10T21:59:17.475442] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T21:59:17.889442] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-10T21:59:18.280056] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-10T21:59:18.689472] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-10T21:59:19.489462] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-10T21:59:19.874309] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T21:59:19.950019] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-10T21:59:20.289372] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-10T21:59:20.680466] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T21:59:20.802795] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-10T21:59:21.089377] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-10T21:59:21.889374] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-10T21:59:22.146341] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-10T21:59:22.149043] [INFO ] [REMOTE ] TR: Full fetch complete (25324 records). [2025-10-10T21:59:22.149140] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-10T21:59:22.524209] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-10T21:59:22.524312] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-10T21:59:22.525147] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-10T21:59:22.525212] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-10T21:59:22.526006] [DEBUG] [LOCAL ] TR: Trimmed 25324 records to 19014 (keeping 200 days of data) [2025-10-10T21:59:22.653225] [DEBUG] [LOCAL ] TR: Primary data saved (19014 records). [2025-10-10T21:59:22.653419] [INFO ] [MAIN ] TR: Full history saved. [2025-10-10T21:59:22.653541] [INFO ] [MAIN ] Update Progress: 2126/2373 symbols completed. TR took 31.6s. Estimated remaining: 34m 46s. Rate: 7.1 symbols/min [2025-10-10T21:59:22.697772] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-10T21:59:22.829771] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:59:22.895076] [DEBUG] [LOCAL ] TRGP: Loaded 51169 existing records from primary storage. [2025-10-10T21:59:22.895526] [INFO ] [MAIN ] TRGP: Loaded 51169 existing records. [2025-10-10T21:59:23.072803] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:59:23.073075] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-10T21:59:23.073126] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-10T21:59:23.073355] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-10T21:59:23.073412] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-10T21:59:23.483565] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:59:23.489331] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-10T21:59:23.689014] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-10T21:59:23.848357] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-10T21:59:23.958287] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-10T21:59:24.289449] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-10T21:59:25.089413] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-10T21:59:25.438858] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-10T21:59:25.889458] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-10T21:59:26.593046] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-10T21:59:26.689420] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-10-10T21:59:26.752889] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T21:59:26.754582] [INFO ] [REMOTE ] TRC: Full fetch complete (21846 records). [2025-10-10T21:59:26.754674] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-10T21:59:27.137346] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-10T21:59:27.137422] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-10T21:59:27.138050] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-10T21:59:27.138113] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-10T21:59:27.138683] [DEBUG] [LOCAL ] TRC: Trimmed 21846 records to 15818 (keeping 200 days of data) [2025-10-10T21:59:27.228577] [DEBUG] [LOCAL ] TRC: Primary data saved (15818 records). [2025-10-10T21:59:27.228741] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-10T21:59:27.228834] [INFO ] [MAIN ] Update Progress: 2127/2373 symbols completed. TRC took 30.7s. Estimated remaining: 34m 38s. Rate: 7.1 symbols/min [2025-10-10T21:59:27.391760] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:59:27.426751] [DEBUG] [LOCAL ] TRN: Loaded 37031 existing records from primary storage. [2025-10-10T21:59:27.427059] [INFO ] [MAIN ] TRN: Loaded 37031 existing records. [2025-10-10T21:59:27.499415] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-10T21:59:27.610434] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:59:27.610730] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-10T21:59:27.610799] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-10T21:59:27.612144] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-10T21:59:27.612216] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-10T21:59:27.979744] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:59:28.289411] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-10T21:59:28.703905] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T21:59:28.759935] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-10T21:59:29.089401] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-10T21:59:29.889359] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-10-10T21:59:29.994888] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-10T21:59:30.219068] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T21:59:30.689401] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-10T21:59:30.971545] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-10T21:59:31.489398] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-10T21:59:32.289430] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-10T21:59:32.682111] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-10T21:59:33.089379] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-10T21:59:33.112890] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T21:59:33.889373] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-10T21:59:34.331224] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-10T21:59:34.466668] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T21:59:34.689397] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-10T21:59:35.440279] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-10T21:59:35.489375] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-10T21:59:36.289413] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-10T21:59:36.672777] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T21:59:36.984428] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-10T21:59:37.089430] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-10T21:59:37.118555] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T21:59:37.889413] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-10T21:59:38.689378] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-10T21:59:39.046482] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T21:59:39.489485] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-10T21:59:39.689526] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T21:59:40.052944] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-10T21:59:40.289419] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-10T21:59:41.089378] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-10T21:59:41.522999] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-10T21:59:41.889399] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-10T21:59:41.928194] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T21:59:42.375940] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-10T21:59:42.381253] [INFO ] [REMOTE ] TREX: Full fetch complete (71148 records). [2025-10-10T21:59:42.381420] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-10T21:59:42.694471] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-10T21:59:42.790371] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-10T21:59:42.790480] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-10T21:59:42.792044] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-10T21:59:42.792112] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-10T21:59:42.794065] [DEBUG] [LOCAL ] TREX: Trimmed 71148 records to 50610 (keeping 200 days of data) [2025-10-10T21:59:42.892335] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-10T21:59:43.154849] [DEBUG] [LOCAL ] TREX: Primary data saved (50610 records). [2025-10-10T21:59:43.155041] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-10T21:59:43.155142] [INFO ] [MAIN ] Update Progress: 2128/2373 symbols completed. TREX took 40.2s. Estimated remaining: 34m 30s. Rate: 7.1 symbols/min [2025-10-10T21:59:43.329512] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:59:43.373741] [DEBUG] [LOCAL ] TRNO: Loaded 44218 existing records from primary storage. [2025-10-10T21:59:43.374136] [INFO ] [MAIN ] TRNO: Loaded 44218 existing records. [2025-10-10T21:59:43.494527] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-10T21:59:43.562789] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:59:43.563071] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-10T21:59:43.563162] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-10T21:59:43.563503] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-10T21:59:43.563575] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-10T21:59:43.923190] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:59:44.289393] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-10T21:59:44.807489] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-10T21:59:44.808454] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-10T21:59:44.821727] [INFO ] [REMOTE ] TRAK: Full fetch complete (13618 records). [2025-10-10T21:59:44.822031] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-10T21:59:45.097980] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-10T21:59:45.202871] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-10T21:59:45.202990] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-10T21:59:45.203498] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-10T21:59:45.203569] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-10T21:59:45.204530] [DEBUG] [LOCAL ] TRAK: Trimmed 13618 records to 9733 (keeping 200 days of data) [2025-10-10T21:59:45.281118] [DEBUG] [LOCAL ] TRAK: Primary data saved (9733 records). [2025-10-10T21:59:45.281332] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-10T21:59:45.281435] [INFO ] [MAIN ] Update Progress: 2129/2373 symbols completed. TRAK took 51.9s. Estimated remaining: 34m 21s. Rate: 7.1 symbols/min [2025-10-10T21:59:45.452124] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:59:45.505321] [DEBUG] [LOCAL ] TROX: Loaded 52360 existing records from primary storage. [2025-10-10T21:59:45.505742] [INFO ] [MAIN ] TROX: Loaded 52360 existing records. [2025-10-10T21:59:45.708134] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:59:45.708448] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-10T21:59:45.708522] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-10T21:59:45.708776] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-10T21:59:45.708835] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-10T21:59:45.891485] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-10-10T21:59:46.053091] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T21:59:46.133997] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:59:46.689400] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-10-10T21:59:47.131957] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-10T21:59:47.489388] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-10T21:59:47.827379] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T21:59:47.945691] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T21:59:48.289367] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-10T21:59:49.089397] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-10T21:59:49.317873] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-10T21:59:49.889435] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-10T21:59:49.954116] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-10T21:59:50.689394] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-10T21:59:51.022785] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T21:59:51.489370] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-10T21:59:51.837888] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T21:59:52.289429] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-10T21:59:52.466117] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T21:59:53.089383] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-10T21:59:53.192199] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-10T21:59:53.873110] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T21:59:53.878856] [INFO ] [REMOTE ] TRGP: Full fetch complete (73518 records). [2025-10-10T21:59:53.879056] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-10T21:59:53.895196] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-10T21:59:54.212010] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T21:59:54.349928] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-10T21:59:54.350100] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-10T21:59:54.351713] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-10T21:59:54.351785] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-10T21:59:54.354115] [DEBUG] [LOCAL ] TRGP: Trimmed 73518 records to 51543 (keeping 200 days of data) [2025-10-10T21:59:54.689512] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-10T21:59:54.703583] [DEBUG] [LOCAL ] TRGP: Primary data saved (51543 records). [2025-10-10T21:59:54.703826] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-10T21:59:54.703954] [INFO ] [MAIN ] Update Progress: 2130/2373 symbols completed. TRGP took 32.1s. Estimated remaining: 34m 12s. Rate: 7.1 symbols/min [2025-10-10T21:59:54.884964] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T21:59:54.939265] [DEBUG] [LOCAL ] TRP: Loaded 52533 existing records from primary storage. [2025-10-10T21:59:54.939787] [INFO ] [MAIN ] TRP: Loaded 52533 existing records. [2025-10-10T21:59:55.140937] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T21:59:55.141148] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-10T21:59:55.141198] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-10T21:59:55.141404] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-10T21:59:55.141461] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-10T21:59:55.507560] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-10T21:59:55.511170] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T21:59:55.676947] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T21:59:56.289395] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-10T21:59:56.760720] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-10T21:59:56.801230] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T21:59:57.089403] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-10T21:59:57.326271] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-10T21:59:57.889407] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-10T21:59:58.618772] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T21:59:58.689417] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-10-10T21:59:59.489381] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-10T21:59:59.775331] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-10T22:00:00.188384] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-10T22:00:00.289371] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-10T22:00:01.089416] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-10T22:00:01.555433] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-10T22:00:01.677331] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-10T22:00:01.889374] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-10T22:00:02.689405] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-10T22:00:03.132392] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-10T22:00:03.489377] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-10T22:00:03.733980] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T22:00:04.005538] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-10T22:00:04.009273] [INFO ] [REMOTE ] TRN: Full fetch complete (52595 records). [2025-10-10T22:00:04.009404] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-10T22:00:04.295860] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-10T22:00:04.399993] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-10T22:00:04.400113] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-10T22:00:04.401391] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-10T22:00:04.401462] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-10T22:00:04.403134] [DEBUG] [LOCAL ] TRN: Trimmed 52595 records to 37274 (keeping 200 days of data) [2025-10-10T22:00:04.645633] [DEBUG] [LOCAL ] TRN: Primary data saved (37274 records). [2025-10-10T22:00:04.645813] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-10T22:00:04.645903] [INFO ] [MAIN ] Update Progress: 2131/2373 symbols completed. TRN took 37.4s. Estimated remaining: 34m 4s. Rate: 7.1 symbols/min [2025-10-10T22:00:04.821546] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:00:04.857256] [DEBUG] [LOCAL ] TRTX: Loaded 37713 existing records from primary storage. [2025-10-10T22:00:04.858197] [INFO ] [MAIN ] TRTX: Loaded 37713 existing records. [2025-10-10T22:00:05.039823] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:00:05.040071] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-10T22:00:05.040120] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-10T22:00:05.040340] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-10T22:00:05.040400] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-10T22:00:05.095425] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-10T22:00:05.439990] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:00:05.552618] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-10T22:00:05.889410] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-10T22:00:06.159171] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T22:00:06.665269] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T22:00:06.689367] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-10T22:00:07.489400] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-10-10T22:00:07.944139] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-10T22:00:08.289424] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-10T22:00:08.747672] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-10T22:00:09.089382] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-10T22:00:09.292936] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T22:00:09.889414] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-10T22:00:10.491190] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-10T22:00:10.689378] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-10T22:00:10.968043] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T22:00:11.089027] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T22:00:11.489387] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-10T22:00:12.289375] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-10T22:00:12.382786] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T22:00:13.089404] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-10T22:00:13.364165] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-10T22:00:13.889354] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-10T22:00:13.938329] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-10T22:00:14.689370] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-10T22:00:14.881116] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-10T22:00:14.886170] [INFO ] [REMOTE ] TROX: Full fetch complete (73387 records). [2025-10-10T22:00:14.886299] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-10T22:00:15.285535] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-10T22:00:15.285618] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-10T22:00:15.286775] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-10T22:00:15.286862] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-10T22:00:15.289417] [DEBUG] [LOCAL ] TROX: Trimmed 73387 records to 52739 (keeping 200 days of data) [2025-10-10T22:00:15.496603] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-10T22:00:15.609307] [DEBUG] [LOCAL ] TROX: Primary data saved (52739 records). [2025-10-10T22:00:15.609468] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-10T22:00:15.609560] [INFO ] [MAIN ] Update Progress: 2132/2373 symbols completed. TROX took 30.3s. Estimated remaining: 33m 56s. Rate: 7.1 symbols/min [2025-10-10T22:00:15.826212] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:00:15.828588] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T22:00:15.885667] [DEBUG] [LOCAL ] TRU: Loaded 51727 existing records from primary storage. [2025-10-10T22:00:15.886018] [INFO ] [MAIN ] TRU: Loaded 51727 existing records. [2025-10-10T22:00:16.060094] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:00:16.060314] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-10T22:00:16.060360] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-10T22:00:16.060676] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-10T22:00:16.060735] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-10T22:00:16.298174] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-10T22:00:16.416487] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:00:16.598875] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-10T22:00:17.018055] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-10T22:00:17.089394] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-10T22:00:17.419536] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-10T22:00:17.423432] [INFO ] [REMOTE ] TRNO: Full fetch complete (63157 records). [2025-10-10T22:00:17.423534] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-10T22:00:17.799422] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-10T22:00:17.799499] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-10T22:00:17.800546] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-10T22:00:17.800609] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-10T22:00:17.801871] [DEBUG] [LOCAL ] TRNO: Trimmed 63157 records to 44485 (keeping 200 days of data) [2025-10-10T22:00:17.891874] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-10-10T22:00:18.079929] [DEBUG] [LOCAL ] TRNO: Primary data saved (44485 records). [2025-10-10T22:00:18.080065] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-10T22:00:18.080165] [INFO ] [MAIN ] Update Progress: 2133/2373 symbols completed. TRNO took 34.9s. Estimated remaining: 33m 47s. Rate: 7.1 symbols/min [2025-10-10T22:00:18.251773] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:00:18.296130] [DEBUG] [LOCAL ] TRV: Loaded 47850 existing records from primary storage. [2025-10-10T22:00:18.296445] [INFO ] [MAIN ] TRV: Loaded 47850 existing records. [2025-10-10T22:00:18.469670] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:00:18.469886] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-10T22:00:18.469933] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-10T22:00:18.470120] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-10T22:00:18.470175] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-10T22:00:18.707523] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-10T22:00:18.854319] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:00:18.877716] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-10T22:00:19.489347] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-10T22:00:19.855266] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-10T22:00:20.289394] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-10T22:00:20.850091] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-10T22:00:21.089425] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-10-10T22:00:21.272371] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T22:00:21.889384] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-10T22:00:22.205700] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-10T22:00:22.689407] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-10T22:00:23.134033] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-10T22:00:23.464572] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-10T22:00:23.489342] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-10T22:00:24.289422] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-10T22:00:24.511748] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T22:00:25.047761] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-10T22:00:25.089380] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-10T22:00:25.889352] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-10T22:00:26.188978] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T22:00:26.689352] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-10T22:00:26.786531] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-10T22:00:27.489350] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-10T22:00:27.860878] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T22:00:28.217587] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-10T22:00:28.289426] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-10T22:00:29.046393] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T22:00:29.089365] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-10T22:00:29.889414] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-10T22:00:30.418863] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T22:00:30.689403] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-10T22:00:30.899890] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T22:00:31.364141] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-10T22:00:31.489346] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-10T22:00:32.289395] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-10T22:00:32.391497] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-10T22:00:33.089392] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-10T22:00:33.719346] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T22:00:33.723863] [INFO ] [REMOTE ] TRTX: Full fetch complete (53138 records). [2025-10-10T22:00:33.724093] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-10T22:00:33.892767] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-10T22:00:33.900718] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-10T22:00:34.186672] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-10T22:00:34.186773] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-10T22:00:34.187992] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-10T22:00:34.188082] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-10T22:00:34.189278] [DEBUG] [LOCAL ] TRTX: Trimmed 53138 records to 37988 (keeping 200 days of data) [2025-10-10T22:00:34.428968] [DEBUG] [LOCAL ] TRTX: Primary data saved (37988 records). [2025-10-10T22:00:34.429120] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-10T22:00:34.429228] [INFO ] [MAIN ] Update Progress: 2134/2373 symbols completed. TRTX took 29.8s. Estimated remaining: 33m 39s. Rate: 7.1 symbols/min [2025-10-10T22:00:34.605270] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:00:34.654803] [DEBUG] [LOCAL ] TS: Loaded 52055 existing records from primary storage. [2025-10-10T22:00:34.655161] [INFO ] [MAIN ] TS: Loaded 52055 existing records. [2025-10-10T22:00:34.696956] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-10T22:00:34.835579] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:00:34.835893] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-10T22:00:34.835941] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-10T22:00:34.836200] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-10T22:00:34.836267] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-10T22:00:34.991136] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-10T22:00:35.034475] [INFO ] [REMOTE ] TRP: Full fetch complete (75522 records). [2025-10-10T22:00:35.083934] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-10T22:00:35.350553] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:00:35.494447] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-10-10T22:00:35.615169] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-10T22:00:35.615329] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-10T22:00:35.616782] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-10T22:00:35.616862] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-10T22:00:35.618509] [DEBUG] [LOCAL ] TRP: Trimmed 75522 records to 52912 (keeping 200 days of data) [2025-10-10T22:00:35.946004] [DEBUG] [LOCAL ] TRP: Primary data saved (52912 records). [2025-10-10T22:00:35.946205] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-10T22:00:35.946375] [INFO ] [MAIN ] Update Progress: 2135/2373 symbols completed. TRP took 41.2s. Estimated remaining: 33m 30s. Rate: 7.1 symbols/min [2025-10-10T22:00:36.155150] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-10T22:00:36.158763] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:00:36.205310] [DEBUG] [LOCAL ] TSE: Loaded 28066 existing records from primary storage. [2025-10-10T22:00:36.205715] [INFO ] [MAIN ] TSE: Loaded 28066 existing records. [2025-10-10T22:00:36.292324] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-10T22:00:36.397445] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:00:36.397982] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-10T22:00:36.398049] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-10T22:00:36.398329] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-10T22:00:36.398449] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-10T22:00:36.793441] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-10T22:00:36.797582] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:00:37.089379] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-10-10T22:00:37.593405] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-10T22:00:37.889394] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-10T22:00:38.177862] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T22:00:38.278456] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T22:00:38.689401] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-10T22:00:39.489389] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-10T22:00:39.725127] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T22:00:40.143718] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-10T22:00:40.289390] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-10T22:00:41.089433] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-10T22:00:41.629682] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-10T22:00:41.889403] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-10T22:00:42.116961] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T22:00:42.550271] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T22:00:42.689377] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-10T22:00:43.489371] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-10T22:00:43.707079] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T22:00:44.289385] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-10T22:00:44.517331] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-10T22:00:45.089403] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-10T22:00:45.436468] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T22:00:45.792107] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T22:00:45.889414] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-10T22:00:46.487383] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-10T22:00:46.689447] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-10T22:00:47.489360] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-10T22:00:47.622785] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T22:00:48.289377] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-10T22:00:48.615672] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-10T22:00:48.833349] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T22:00:49.089383] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-10T22:00:49.889429] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-10T22:00:50.037319] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T22:00:50.045126] [INFO ] [REMOTE ] TRU: Full fetch complete (73677 records). [2025-10-10T22:00:50.045352] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-10T22:00:50.443975] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-10T22:00:50.444092] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-10T22:00:50.445523] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-10T22:00:50.445592] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-10T22:00:50.448396] [DEBUG] [LOCAL ] TRU: Trimmed 73677 records to 52113 (keeping 200 days of data) [2025-10-10T22:00:50.690860] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-10T22:00:50.789263] [DEBUG] [LOCAL ] TRU: Primary data saved (52113 records). [2025-10-10T22:00:50.789444] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-10T22:00:50.789541] [INFO ] [MAIN ] Update Progress: 2136/2373 symbols completed. TRU took 35.2s. Estimated remaining: 33m 22s. Rate: 7.1 symbols/min [2025-10-10T22:00:50.969287] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:00:50.980270] [DEBUG] [LOCAL ] TSI: Loaded 7608 existing records from primary storage. [2025-10-10T22:00:50.980583] [INFO ] [MAIN ] TSI: Loaded 7608 existing records. [2025-10-10T22:00:51.175909] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:00:51.177314] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-10T22:00:51.177563] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-10T22:00:51.188973] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-10T22:00:51.199503] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-10T22:00:51.294902] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-10T22:00:51.499308] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-10T22:00:51.625907] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:00:51.880459] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T22:00:52.294731] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-10T22:00:52.306077] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T22:00:52.327986] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T22:00:52.340710] [INFO ] [REMOTE ] TRV: Full fetch complete (69558 records). [2025-10-10T22:00:52.340933] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-10T22:00:52.743558] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-10T22:00:52.743706] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-10T22:00:52.745321] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-10T22:00:52.745410] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-10T22:00:52.747356] [DEBUG] [LOCAL ] TRV: Trimmed 69558 records to 48195 (keeping 200 days of data) [2025-10-10T22:00:53.089860] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-10-10T22:00:53.160423] [DEBUG] [LOCAL ] TRV: Primary data saved (48195 records). [2025-10-10T22:00:53.160628] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-10T22:00:53.160834] [INFO ] [MAIN ] Update Progress: 2137/2373 symbols completed. TRV took 35.1s. Estimated remaining: 33m 13s. Rate: 7.1 symbols/min [2025-10-10T22:00:53.341195] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:00:53.399471] [DEBUG] [LOCAL ] TSLX: Loaded 35737 existing records from primary storage. [2025-10-10T22:00:53.399857] [INFO ] [MAIN ] TSLX: Loaded 35737 existing records. [2025-10-10T22:00:53.627443] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:00:53.627853] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-10T22:00:53.627914] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-10T22:00:53.628147] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-10T22:00:53.628212] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-10T22:00:53.896738] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-10T22:00:54.015374] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:00:54.024975] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-10T22:00:54.160086] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T22:00:54.689446] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-10T22:00:55.480991] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T22:00:55.489323] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-10T22:00:56.289386] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-10-10T22:00:56.654374] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T22:00:57.064811] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-10T22:00:57.089404] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-10T22:00:57.216422] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-10T22:00:57.889445] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-10T22:00:58.023389] [DEBUG] [REMOTE ] TSI: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-10T22:00:58.023884] [WARN ] [REMOTE ] TSI: No data returned for month 2025-01 [2025-10-10T22:00:58.023986] [FATAL] [REMOTE ] TSI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T22:00:58.024081] [FATAL] [MAIN ] TSI: Failed to fetch primary data. [2025-10-10T22:00:58.024144] [WARN ] [MAIN ] TSI: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T22:00:58.024222] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-10T22:00:58.024298] [DEBUG] [LOCAL ] TSI: No primary data file found to delete. [2025-10-10T22:00:58.024336] [INFO ] [LOCAL ] TSI: Starting deletion of derivative data. [2025-10-10T22:00:58.026440] [DEBUG] [LOCAL ] TSI: Deleted derivative data file. [2025-10-10T22:00:58.026754] [INFO ] [MAIN ] Update Progress: 2138/2373 symbols completed. TSI took 7.2s. Estimated remaining: 33m 4s. Rate: 7.1 symbols/min [2025-10-10T22:00:58.204215] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:00:58.291341] [DEBUG] [LOCAL ] TSM: Loaded 54209 existing records from primary storage. [2025-10-10T22:00:58.291738] [INFO ] [MAIN ] TSM: Loaded 54209 existing records. [2025-10-10T22:00:58.467372] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:00:58.467887] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-10T22:00:58.467973] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-10T22:00:58.468855] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-10T22:00:58.468911] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-10T22:00:58.694538] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-10T22:00:58.826334] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:00:58.933629] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T22:00:59.489396] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-10-10T22:01:00.080081] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-10T22:01:00.289400] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-10T22:01:01.089425] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-10T22:01:01.889812] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-10T22:01:02.082689] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T22:01:02.525534] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (3.04 seconds). [2025-10-10T22:01:02.689450] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-10T22:01:02.915430] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-10T22:01:02.985010] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-10T22:01:03.489413] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-10T22:01:04.119819] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-10T22:01:04.289386] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-10T22:01:05.089457] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-10T22:01:05.730361] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-10T22:01:05.889389] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-10T22:01:06.294184] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.80 seconds). [2025-10-10T22:01:06.370801] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T22:01:06.377233] [INFO ] [REMOTE ] TS: Full fetch complete (74526 records). [2025-10-10T22:01:06.377446] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-10T22:01:06.694607] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-10T22:01:06.819135] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-10T22:01:06.819259] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-10T22:01:06.820995] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-10T22:01:06.821067] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-10T22:01:06.823152] [DEBUG] [LOCAL ] TS: Trimmed 74526 records to 52435 (keeping 200 days of data) [2025-10-10T22:01:07.180180] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T22:01:07.198525] [DEBUG] [LOCAL ] TS: Primary data saved (52435 records). [2025-10-10T22:01:07.198779] [INFO ] [MAIN ] TS: Full history saved. [2025-10-10T22:01:07.199163] [INFO ] [MAIN ] Update Progress: 2139/2373 symbols completed. TS took 32.8s. Estimated remaining: 32m 56s. Rate: 7.1 symbols/min [2025-10-10T22:01:07.379437] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:01:07.434872] [DEBUG] [LOCAL ] TSN: Loaded 53344 existing records from primary storage. [2025-10-10T22:01:07.435318] [INFO ] [MAIN ] TSN: Loaded 53344 existing records. [2025-10-10T22:01:07.502042] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-10T22:01:07.622144] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:01:07.622392] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-10T22:01:07.622484] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-10T22:01:07.622848] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-10T22:01:07.622907] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-10T22:01:08.000406] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:01:08.289428] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-10T22:01:09.089367] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-10-10T22:01:09.211162] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T22:01:09.419089] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-10T22:01:09.422958] [INFO ] [REMOTE ] TSE: Full fetch complete (40703 records). [2025-10-10T22:01:09.423255] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-10T22:01:09.865811] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (3.17 seconds). [2025-10-10T22:01:09.895418] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-10T22:01:09.896007] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-10T22:01:09.896312] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-10T22:01:09.898882] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-10T22:01:09.899074] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-10T22:01:09.900513] [DEBUG] [LOCAL ] TSE: Trimmed 40703 records to 28282 (keeping 200 days of data) [2025-10-10T22:01:10.089464] [DEBUG] [LOCAL ] TSE: Primary data saved (28282 records). [2025-10-10T22:01:10.089674] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-10T22:01:10.089906] [INFO ] [MAIN ] Update Progress: 2140/2373 symbols completed. TSE took 34.1s. Estimated remaining: 32m 47s. Rate: 7.1 symbols/min [2025-10-10T22:01:10.266475] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:01:10.280509] [DEBUG] [LOCAL ] TSQ: Loaded 11789 existing records from primary storage. [2025-10-10T22:01:10.280848] [INFO ] [MAIN ] TSQ: Loaded 11789 existing records. [2025-10-10T22:01:10.479051] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:01:10.479348] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-10T22:01:10.479400] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-10T22:01:10.479775] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-10T22:01:10.479897] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-10T22:01:10.702721] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-10T22:01:10.858066] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:01:11.218473] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-10T22:01:11.489401] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-10T22:01:11.645906] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-10T22:01:12.289482] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-10T22:01:13.089364] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-10-10T22:01:13.435393] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T22:01:13.588547] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-10-10T22:01:13.889449] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-10T22:01:13.927333] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T22:01:14.013516] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-10T22:01:14.689401] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-10T22:01:15.489360] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-10T22:01:15.636437] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-10T22:01:15.636884] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-10T22:01:16.289397] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-10T22:01:17.089413] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-10T22:01:17.163727] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T22:01:17.889439] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-10T22:01:18.689362] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-10T22:01:18.840033] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-10T22:01:19.132121] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T22:01:19.329411] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (3.04 seconds). [2025-10-10T22:01:19.489406] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-10T22:01:20.289384] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-10T22:01:20.383150] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-10T22:01:21.089394] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-10T22:01:21.530378] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T22:01:21.889396] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-10T22:01:22.689477] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-10T22:01:22.736720] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-10T22:01:22.886472] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-10T22:01:22.888883] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-10T22:01:23.489391] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-10T22:01:24.289360] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-10T22:01:24.843703] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-10T22:01:25.027586] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-10T22:01:25.089408] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-10T22:01:25.889445] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-10T22:01:26.689386] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-10T22:01:26.903326] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-10T22:01:26.901410] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-10T22:01:27.144421] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-10T22:01:27.489370] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-10T22:01:27.790586] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-10T22:01:27.794839] [INFO ] [REMOTE ] TSLX: Full fetch complete (49817 records). [2025-10-10T22:01:27.794980] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-10T22:01:28.162692] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-10T22:01:28.162776] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-10T22:01:28.163515] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-10T22:01:28.163556] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-10T22:01:28.164530] [DEBUG] [LOCAL ] TSLX: Trimmed 49817 records to 36037 (keeping 200 days of data) [2025-10-10T22:01:28.290887] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-10T22:01:28.389270] [DEBUG] [LOCAL ] TSLX: Primary data saved (36037 records). [2025-10-10T22:01:28.389424] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-10T22:01:28.389518] [INFO ] [MAIN ] Update Progress: 2141/2373 symbols completed. TSLX took 35.2s. Estimated remaining: 32m 40s. Rate: 7.1 symbols/min [2025-10-10T22:01:28.554718] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:01:28.603198] [DEBUG] [LOCAL ] TT: Loaded 47820 existing records from primary storage. [2025-10-10T22:01:28.603512] [INFO ] [MAIN ] TT: Loaded 47820 existing records. [2025-10-10T22:01:28.801745] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:01:28.802035] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-10T22:01:28.802096] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-10T22:01:28.802325] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-10T22:01:28.802392] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-10T22:01:29.090756] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-10T22:01:29.164044] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:01:29.460857] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-10T22:01:29.663597] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T22:01:29.889408] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-10-10T22:01:30.689459] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-10T22:01:31.489412] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-10T22:01:31.749372] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T22:01:31.828634] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T22:01:32.118249] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (3.03 seconds). [2025-10-10T22:01:32.289333] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-10T22:01:33.089385] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-10T22:01:33.689266] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-10T22:01:33.889414] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-10T22:01:34.689426] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-10T22:01:34.866826] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T22:01:35.006203] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-10T22:01:35.121185] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-10T22:01:35.256691] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-10T22:01:35.489357] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-10T22:01:36.289476] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-10T22:01:36.533472] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-10T22:01:37.089355] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-10T22:01:37.857916] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T22:01:37.862982] [INFO ] [REMOTE ] TSN: Full fetch complete (76394 records). [2025-10-10T22:01:37.863105] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-10T22:01:37.897005] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-10T22:01:38.249390] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-10T22:01:38.249470] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-10T22:01:38.250679] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-10T22:01:38.250754] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-10T22:01:38.252258] [DEBUG] [LOCAL ] TSN: Trimmed 76394 records to 53734 (keeping 200 days of data) [2025-10-10T22:01:38.582547] [DEBUG] [LOCAL ] TSN: Primary data saved (53734 records). [2025-10-10T22:01:38.582719] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-10T22:01:38.582992] [INFO ] [MAIN ] Update Progress: 2142/2373 symbols completed. TSN took 31.4s. Estimated remaining: 32m 31s. Rate: 7.1 symbols/min [2025-10-10T22:01:38.694485] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-10T22:01:38.760271] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:01:38.760444] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-10T22:01:38.760481] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-10T22:01:38.760590] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-10T22:01:38.760631] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-10T22:01:38.760719] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-10T22:01:38.760762] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-10T22:01:38.873459] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T22:01:39.125483] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:01:39.346804] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-10-10T22:01:39.489372] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-10T22:01:40.289392] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-10-10T22:01:40.526109] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T22:01:40.526670] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-10-10T22:01:40.526775] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T22:01:40.526825] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-10T22:01:40.526863] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T22:01:40.526935] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-10T22:01:40.527051] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-10T22:01:40.527130] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-10T22:01:40.527206] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-10T22:01:40.527276] [INFO ] [MAIN ] Update Progress: 2143/2373 symbols completed. TTAM took 1.9s. Estimated remaining: 32m 22s. Rate: 7.1 symbols/min [2025-10-10T22:01:40.718004] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:01:40.748789] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-10T22:01:40.794044] [DEBUG] [LOCAL ] TTC: Loaded 42360 existing records from primary storage. [2025-10-10T22:01:40.794414] [INFO ] [MAIN ] TTC: Loaded 42360 existing records. [2025-10-10T22:01:40.970765] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:01:40.971193] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-10T22:01:40.971254] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-10T22:01:40.971529] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-10T22:01:40.971586] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-10T22:01:41.094501] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-10T22:01:41.320980] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:01:41.707497] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-10T22:01:41.712747] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-10-10T22:01:41.712880] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-10T22:01:41.901694] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-10-10T22:01:42.101736] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-10T22:01:42.101853] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-10T22:01:42.103074] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-10T22:01:42.103137] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-10T22:01:42.105880] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 54599 (keeping 200 days of data) [2025-10-10T22:01:42.452544] [DEBUG] [LOCAL ] TSM: Primary data saved (54599 records). [2025-10-10T22:01:42.452705] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-10T22:01:42.452801] [INFO ] [MAIN ] Update Progress: 2144/2373 symbols completed. TSM took 44.4s. Estimated remaining: 32m 13s. Rate: 7.1 symbols/min [2025-10-10T22:01:42.619781] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:01:42.667385] [DEBUG] [LOCAL ] TTE: Loaded 51981 existing records from primary storage. [2025-10-10T22:01:42.667837] [INFO ] [MAIN ] TTE: Loaded 51981 existing records. [2025-10-10T22:01:42.698193] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-10T22:01:42.848428] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:01:42.848612] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-10T22:01:42.848688] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-10T22:01:42.849058] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-10T22:01:42.849096] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-10T22:01:43.209546] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:01:43.276545] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-10T22:01:43.489329] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-10T22:01:43.495775] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-10T22:01:43.497108] [INFO ] [REMOTE ] TSQ: Full fetch complete (16401 records). [2025-10-10T22:01:43.497228] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-10T22:01:43.862167] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-10T22:01:43.862260] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-10T22:01:43.862807] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-10T22:01:43.862885] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-10T22:01:43.885283] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T22:01:43.884364] [DEBUG] [LOCAL ] TSQ: Trimmed 16401 records to 11863 (keeping 200 days of data) [2025-10-10T22:01:43.963938] [DEBUG] [LOCAL ] TSQ: Primary data saved (11863 records). [2025-10-10T22:01:43.964071] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-10T22:01:43.964152] [INFO ] [MAIN ] Update Progress: 2145/2373 symbols completed. TSQ took 33.9s. Estimated remaining: 32m 4s. Rate: 7.1 symbols/min [2025-10-10T22:01:44.131999] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:01:44.177576] [DEBUG] [LOCAL ] TTI: Loaded 46300 existing records from primary storage. [2025-10-10T22:01:44.177924] [INFO ] [MAIN ] TTI: Loaded 46300 existing records. [2025-10-10T22:01:44.294516] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-10T22:01:44.355280] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:01:44.355443] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-10T22:01:44.355490] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-10T22:01:44.355731] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-10T22:01:44.355793] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-10T22:01:44.702747] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:01:45.089352] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-10-10T22:01:45.619745] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-10T22:01:45.709349] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-10T22:01:45.889366] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-10T22:01:46.217513] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T22:01:46.689400] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-10-10T22:01:47.489410] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-10T22:01:47.897271] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T22:01:48.289409] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-10T22:01:48.726725] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-10T22:01:49.089458] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-10T22:01:49.298533] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T22:01:49.727931] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-10T22:01:49.889365] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-10T22:01:50.689416] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-10T22:01:51.145924] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-10T22:01:51.489389] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-10T22:01:51.805879] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T22:01:52.289360] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-10T22:01:52.522907] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T22:01:53.089403] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-10T22:01:53.348686] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-10T22:01:53.889425] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-10T22:01:54.172002] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-10T22:01:54.689405] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-10T22:01:54.772749] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-10T22:01:55.489808] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-10T22:01:55.865196] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T22:01:56.289409] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-10T22:01:56.425299] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-10T22:01:57.089396] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-10T22:01:57.224918] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-10T22:01:57.889420] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-10T22:01:57.979837] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T22:01:58.689346] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-10T22:01:59.210163] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-10T22:01:59.314482] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-10T22:01:59.489371] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-10T22:02:00.289354] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-10T22:02:00.521985] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T22:02:00.611285] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-10T22:02:00.616383] [INFO ] [REMOTE ] TT: Full fetch complete (69728 records). [2025-10-10T22:02:00.616498] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-10T22:02:01.080227] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-10T22:02:01.080405] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-10T22:02:01.081754] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-10T22:02:01.081947] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-10T22:02:01.083500] [DEBUG] [LOCAL ] TT: Trimmed 69728 records to 48155 (keeping 200 days of data) [2025-10-10T22:02:01.089343] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-10T22:02:01.375157] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-10T22:02:01.461526] [DEBUG] [LOCAL ] TT: Primary data saved (48155 records). [2025-10-10T22:02:01.461712] [INFO ] [MAIN ] TT: Full history saved. [2025-10-10T22:02:01.461832] [INFO ] [MAIN ] Update Progress: 2146/2373 symbols completed. TT took 33.1s. Estimated remaining: 31m 56s. Rate: 7.1 symbols/min [2025-10-10T22:02:01.630708] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:02:01.681763] [DEBUG] [LOCAL ] TU: Loaded 50202 existing records from primary storage. [2025-10-10T22:02:01.682113] [INFO ] [MAIN ] TU: Loaded 50202 existing records. [2025-10-10T22:02:01.860098] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:02:01.860355] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-10T22:02:01.860414] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-10T22:02:01.860628] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-10T22:02:01.860733] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-10T22:02:01.894582] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-10T22:02:02.220894] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:02:02.553049] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T22:02:02.689340] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-10T22:02:03.489420] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-10-10T22:02:04.075786] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-10T22:02:04.289384] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-10T22:02:04.427738] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-10T22:02:05.089344] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-10T22:02:05.463307] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-10T22:02:05.889353] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-10T22:02:06.249007] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T22:02:06.689362] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-10T22:02:06.794897] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T22:02:07.227378] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T22:02:07.489374] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-10T22:02:08.289387] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-10T22:02:08.749776] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-10T22:02:09.089390] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-10T22:02:09.317564] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T22:02:09.541510] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T22:02:09.889529] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-10T22:02:10.689394] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-10T22:02:10.898871] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T22:02:11.489416] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-10T22:02:11.937472] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-10T22:02:12.289431] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-10T22:02:12.879102] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-10T22:02:13.019052] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-10T22:02:13.089455] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-10T22:02:13.889411] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-10T22:02:13.937908] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-10T22:02:14.689442] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-10T22:02:14.986264] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T22:02:15.489377] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-10T22:02:15.560306] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-10T22:02:15.565077] [INFO ] [REMOTE ] TTC: Full fetch complete (62095 records). [2025-10-10T22:02:15.565188] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-10T22:02:15.957458] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-10T22:02:15.957544] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-10T22:02:15.958573] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-10T22:02:15.958676] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-10T22:02:15.960024] [DEBUG] [LOCAL ] TTC: Trimmed 62095 records to 42672 (keeping 200 days of data) [2025-10-10T22:02:16.279035] [DEBUG] [LOCAL ] TTC: Primary data saved (42672 records). [2025-10-10T22:02:16.279168] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-10T22:02:16.279426] [INFO ] [MAIN ] Update Progress: 2147/2373 symbols completed. TTC took 35.8s. Estimated remaining: 31m 49s. Rate: 7.1 symbols/min [2025-10-10T22:02:16.299753] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-10T22:02:16.454487] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:02:16.510709] [DEBUG] [LOCAL ] TUYA: Loaded 46266 existing records from primary storage. [2025-10-10T22:02:16.511003] [INFO ] [MAIN ] TUYA: Loaded 46266 existing records. [2025-10-10T22:02:16.696731] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:02:16.697262] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-10T22:02:16.707873] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-10T22:02:16.725618] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-10T22:02:16.725785] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-10T22:02:16.804566] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-10T22:02:17.094220] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:02:17.094333] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-10T22:02:17.611969] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-10T22:02:17.728252] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-10T22:02:17.889394] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-10T22:02:18.689417] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-10T22:02:18.926720] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-10T22:02:18.931729] [INFO ] [REMOTE ] TTE: Full fetch complete (74960 records). [2025-10-10T22:02:18.931864] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-10T22:02:19.325126] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-10T22:02:19.325355] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-10T22:02:19.327353] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-10T22:02:19.327478] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-10T22:02:19.339674] [DEBUG] [LOCAL ] TTE: Trimmed 74960 records to 52365 (keeping 200 days of data) [2025-10-10T22:02:19.362267] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-10T22:02:19.489352] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-10T22:02:19.705847] [DEBUG] [LOCAL ] TTE: Primary data saved (52365 records). [2025-10-10T22:02:19.706001] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-10T22:02:19.706089] [INFO ] [MAIN ] Update Progress: 2148/2373 symbols completed. TTE took 37.3s. Estimated remaining: 31m 40s. Rate: 7.1 symbols/min [2025-10-10T22:02:19.872278] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:02:19.913837] [DEBUG] [LOCAL ] TV: Loaded 42296 existing records from primary storage. [2025-10-10T22:02:19.914285] [INFO ] [MAIN ] TV: Loaded 42296 existing records. [2025-10-10T22:02:20.117954] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:02:20.118182] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-10T22:02:20.118230] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-10T22:02:20.118422] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-10T22:02:20.118477] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-10T22:02:20.294377] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-10-10T22:02:20.489355] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:02:20.521407] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-10T22:02:21.089382] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-10-10T22:02:21.502269] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-10T22:02:21.629915] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T22:02:21.889420] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-10T22:02:22.689367] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-10T22:02:22.935044] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T22:02:23.268804] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-10T22:02:23.489363] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-10T22:02:24.289405] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-10T22:02:24.341625] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T22:02:25.089418] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-10T22:02:25.358025] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T22:02:25.437719] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-10T22:02:25.442310] [INFO ] [REMOTE ] TTI: Full fetch complete (65623 records). [2025-10-10T22:02:25.442413] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-10T22:02:25.813108] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-10T22:02:25.813187] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-10T22:02:25.814352] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-10T22:02:25.814415] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-10T22:02:25.815690] [DEBUG] [LOCAL ] TTI: Trimmed 65623 records to 46673 (keeping 200 days of data) [2025-10-10T22:02:25.895725] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-10T22:02:26.081296] [DEBUG] [LOCAL ] TTI: Primary data saved (46673 records). [2025-10-10T22:02:26.081732] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-10T22:02:26.081844] [INFO ] [MAIN ] Update Progress: 2149/2373 symbols completed. TTI took 42.1s. Estimated remaining: 31m 31s. Rate: 7.1 symbols/min [2025-10-10T22:02:26.245537] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:02:26.251690] [DEBUG] [LOCAL ] TVC: Loaded 3335 existing records from primary storage. [2025-10-10T22:02:26.251865] [INFO ] [MAIN ] TVC: Loaded 3335 existing records. [2025-10-10T22:02:26.422868] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:02:26.423114] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-10T22:02:26.423160] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-10T22:02:26.423888] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-10T22:02:26.423959] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-10T22:02:26.691471] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-10T22:02:26.775056] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:02:27.257545] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-10T22:02:27.489406] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-10T22:02:27.528732] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-10T22:02:27.533679] [INFO ] [REMOTE ] TU: Full fetch complete (72746 records). [2025-10-10T22:02:27.533846] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-10T22:02:27.918752] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-10T22:02:27.918849] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-10T22:02:27.920159] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-10T22:02:27.920243] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-10T22:02:27.921933] [DEBUG] [LOCAL ] TU: Trimmed 72746 records to 50567 (keeping 200 days of data) [2025-10-10T22:02:28.036475] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T22:02:28.285068] [DEBUG] [LOCAL ] TU: Primary data saved (50567 records). [2025-10-10T22:02:28.285203] [INFO ] [MAIN ] TU: Full history saved. [2025-10-10T22:02:28.285287] [INFO ] [MAIN ] Update Progress: 2150/2373 symbols completed. TU took 26.8s. Estimated remaining: 31m 22s. Rate: 7.1 symbols/min [2025-10-10T22:02:28.296529] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-10-10T22:02:28.469098] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:02:28.474203] [DEBUG] [LOCAL ] TVE: Loaded 2784 existing records from primary storage. [2025-10-10T22:02:28.474361] [INFO ] [MAIN ] TVE: Loaded 2784 existing records. [2025-10-10T22:02:28.645549] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:02:28.645771] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-10T22:02:28.645820] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-10T22:02:28.646030] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-10T22:02:28.646085] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-10T22:02:29.000108] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:02:29.089347] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-10-10T22:02:29.355463] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-10T22:02:29.386174] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T22:02:29.772297] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-10T22:02:29.889415] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-10T22:02:30.689454] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-10T22:02:31.489394] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-10T22:02:31.833112] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T22:02:31.901500] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-10T22:02:32.289371] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-10T22:02:32.377164] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T22:02:32.993161] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T22:02:33.089378] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-10T22:02:33.824774] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-10T22:02:33.889416] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-10T22:02:34.567570] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-10T22:02:34.689408] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-10T22:02:35.435827] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-10T22:02:35.489431] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-10T22:02:36.289498] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-10T22:02:37.027890] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-10T22:02:37.089331] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-10T22:02:37.452300] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T22:02:37.694949] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-10T22:02:37.889375] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-10T22:02:38.689417] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-10T22:02:39.274474] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-10T22:02:39.489381] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-10T22:02:39.697399] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-10T22:02:40.106529] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-10T22:02:40.289373] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-10T22:02:40.745194] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-10T22:02:40.746226] [INFO ] [REMOTE ] TVC: Full fetch complete (5357 records). [2025-10-10T22:02:40.746301] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-10T22:02:41.100385] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-10T22:02:41.127606] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-10T22:02:41.127714] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-10T22:02:41.127959] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-10T22:02:41.128021] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-10T22:02:41.128533] [DEBUG] [LOCAL ] TVC: Trimmed 5357 records to 3358 (keeping 200 days of data) [2025-10-10T22:02:41.149444] [DEBUG] [LOCAL ] TVC: Primary data saved (3358 records). [2025-10-10T22:02:41.149551] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-10T22:02:41.149635] [INFO ] [MAIN ] Update Progress: 2151/2373 symbols completed. TVC took 15.1s. Estimated remaining: 31m 14s. Rate: 7.1 symbols/min [2025-10-10T22:02:41.321352] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:02:41.357936] [DEBUG] [LOCAL ] TWI: Loaded 34326 existing records from primary storage. [2025-10-10T22:02:41.358297] [INFO ] [MAIN ] TWI: Loaded 34326 existing records. [2025-10-10T22:02:41.537282] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:02:41.537497] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-10T22:02:41.537545] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-10T22:02:41.537881] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-10T22:02:41.537938] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-10T22:02:41.879715] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:02:41.889338] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-10-10T22:02:42.689443] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-10T22:02:42.904975] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-10T22:02:43.060822] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-10T22:02:43.351416] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-10T22:02:43.489368] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-10T22:02:44.289394] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-10T22:02:45.094521] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-10T22:02:45.114220] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-10T22:02:45.889368] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-10T22:02:45.921050] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-10T22:02:46.120067] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-10T22:02:46.689380] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-10T22:02:47.435006] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-10T22:02:47.489395] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-10T22:02:47.702970] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T22:02:47.917319] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-10T22:02:48.289377] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-10T22:02:48.839851] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-10T22:02:49.089402] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-10T22:02:49.889383] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-10T22:02:50.689338] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-10T22:02:51.047516] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T22:02:51.466552] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-10T22:02:51.467868] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T22:02:51.489323] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-10T22:02:52.289385] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-10T22:02:52.848181] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-10T22:02:53.089347] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-10T22:02:53.306639] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T22:02:53.431117] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-10T22:02:53.889372] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-10T22:02:54.579228] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-10T22:02:54.689367] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-10T22:02:55.118515] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-10T22:02:55.119417] [INFO ] [REMOTE ] TVE: Full fetch complete (4331 records). [2025-10-10T22:02:55.119489] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-10T22:02:55.486625] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-10T22:02:55.486738] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-10T22:02:55.486934] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-10T22:02:55.487000] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-10T22:02:55.487461] [DEBUG] [LOCAL ] TVE: Trimmed 4331 records to 2793 (keeping 200 days of data) [2025-10-10T22:02:55.494963] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-10T22:02:55.506596] [DEBUG] [LOCAL ] TVE: Primary data saved (2793 records). [2025-10-10T22:02:55.506713] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-10T22:02:55.506805] [INFO ] [MAIN ] Update Progress: 2152/2373 symbols completed. TVE took 27.2s. Estimated remaining: 31m 6s. Rate: 7.1 symbols/min [2025-10-10T22:02:55.681147] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:02:55.737110] [DEBUG] [LOCAL ] TWLO: Loaded 53147 existing records from primary storage. [2025-10-10T22:02:55.737502] [INFO ] [MAIN ] TWLO: Loaded 53147 existing records. [2025-10-10T22:02:55.919873] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:02:55.920214] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-10T22:02:55.920280] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-10T22:02:55.920547] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-10T22:02:55.920605] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-10T22:02:56.291899] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-10T22:02:56.291829] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:02:57.089409] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-10-10T22:02:57.235865] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T22:02:57.889340] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-10T22:02:58.143330] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T22:02:58.689378] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-10T22:02:59.232159] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-10T22:02:59.489400] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-10T22:02:59.599080] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-10T22:03:00.289421] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-10T22:03:00.338085] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T22:03:01.089412] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-10T22:03:01.407114] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T22:03:01.889377] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-10T22:03:01.976300] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T22:03:02.681628] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-10T22:03:02.689425] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-10T22:03:03.132695] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-10T22:03:03.489384] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-10T22:03:04.275423] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-10T22:03:04.279823] [INFO ] [REMOTE ] TUYA: Full fetch complete (65970 records). [2025-10-10T22:03:04.279935] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-10T22:03:04.294522] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-10T22:03:04.773058] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-10T22:03:04.773408] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-10T22:03:04.774717] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-10T22:03:04.774788] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-10T22:03:04.776610] [DEBUG] [LOCAL ] TUYA: Trimmed 65970 records to 46611 (keeping 200 days of data) [2025-10-10T22:03:05.099495] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-10T22:03:05.143539] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-10T22:03:05.163057] [DEBUG] [LOCAL ] TUYA: Primary data saved (46611 records). [2025-10-10T22:03:05.163238] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-10T22:03:05.163332] [INFO ] [MAIN ] Update Progress: 2153/2373 symbols completed. TUYA took 48.9s. Estimated remaining: 30m 58s. Rate: 7.1 symbols/min [2025-10-10T22:03:05.399568] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:03:05.406820] [DEBUG] [LOCAL ] TWN: Loaded 3208 existing records from primary storage. [2025-10-10T22:03:05.407116] [INFO ] [MAIN ] TWN: Loaded 3208 existing records. [2025-10-10T22:03:05.629017] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:03:05.629283] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-10T22:03:05.629360] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-10T22:03:05.629565] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-10T22:03:05.629673] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-10T22:03:05.896353] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-10T22:03:06.015679] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:03:06.553302] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-10T22:03:06.689353] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-10T22:03:06.780002] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-10T22:03:06.824009] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T22:03:07.489438] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-10T22:03:08.289420] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-10-10T22:03:08.979407] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-10T22:03:09.089384] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-10T22:03:09.109033] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-10T22:03:09.210486] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-10T22:03:09.889385] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-10T22:03:10.689348] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-10T22:03:10.995400] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T22:03:11.220894] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T22:03:11.225133] [INFO ] [REMOTE ] TV: Full fetch complete (61490 records). [2025-10-10T22:03:11.225326] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-10T22:03:11.494503] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-10T22:03:11.608894] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-10T22:03:11.608988] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-10T22:03:11.610177] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-10T22:03:11.610266] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-10T22:03:11.612009] [DEBUG] [LOCAL ] TV: Trimmed 61490 records to 42533 (keeping 200 days of data) [2025-10-10T22:03:11.881264] [DEBUG] [LOCAL ] TV: Primary data saved (42533 records). [2025-10-10T22:03:11.881394] [INFO ] [MAIN ] TV: Full history saved. [2025-10-10T22:03:11.881477] [INFO ] [MAIN ] Update Progress: 2154/2373 symbols completed. TV took 52.2s. Estimated remaining: 30m 49s. Rate: 7.1 symbols/min [2025-10-10T22:03:12.050004] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:03:12.098004] [DEBUG] [LOCAL ] TWO: Loaded 48896 existing records from primary storage. [2025-10-10T22:03:12.098319] [INFO ] [MAIN ] TWO: Loaded 48896 existing records. [2025-10-10T22:03:12.220845] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-10T22:03:12.304568] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-10T22:03:12.311263] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:03:12.312229] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-10T22:03:12.312280] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-10T22:03:12.312507] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-10T22:03:12.312564] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-10T22:03:12.308193] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-10T22:03:12.665456] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:03:13.089420] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-10-10T22:03:13.567168] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T22:03:13.571807] [INFO ] [REMOTE ] TWI: Full fetch complete (52308 records). [2025-10-10T22:03:13.572004] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-10T22:03:13.894605] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-10T22:03:13.978207] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-10T22:03:13.978319] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-10T22:03:13.979912] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-10T22:03:13.979977] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-10T22:03:13.981383] [DEBUG] [LOCAL ] TWI: Trimmed 52308 records to 34575 (keeping 200 days of data) [2025-10-10T22:03:14.187575] [DEBUG] [LOCAL ] TWI: Primary data saved (34575 records). [2025-10-10T22:03:14.187782] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-10T22:03:14.187893] [INFO ] [MAIN ] Update Progress: 2155/2373 symbols completed. TWI took 33.0s. Estimated remaining: 30m 40s. Rate: 7.1 symbols/min [2025-10-10T22:03:14.371523] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:03:14.371765] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-10T22:03:14.371812] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-10T22:03:14.371934] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-10T22:03:14.371976] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-10T22:03:14.372017] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-10T22:03:14.372051] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-10T22:03:14.694496] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-10T22:03:14.753591] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:03:14.984130] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T22:03:15.489425] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-10T22:03:15.528237] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-10T22:03:15.738520] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T22:03:16.289402] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-10-10T22:03:16.527898] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T22:03:16.528351] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-10-10T22:03:16.528480] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T22:03:16.528582] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-10T22:03:16.528671] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T22:03:16.528744] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-10T22:03:16.528817] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-10T22:03:16.528858] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-10T22:03:16.528899] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-10T22:03:16.528952] [INFO ] [MAIN ] Update Progress: 2156/2373 symbols completed. TWOD took 2.3s. Estimated remaining: 30m 31s. Rate: 7.1 symbols/min [2025-10-10T22:03:16.708499] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:03:16.736325] [DEBUG] [LOCAL ] TX: Loaded 23510 existing records from primary storage. [2025-10-10T22:03:16.736625] [INFO ] [MAIN ] TX: Loaded 23510 existing records. [2025-10-10T22:03:16.919324] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:03:16.919628] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-10T22:03:16.919712] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-10T22:03:16.919952] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-10T22:03:16.920009] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-10T22:03:17.090775] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-10T22:03:17.307230] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:03:17.336567] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-10T22:03:17.889388] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-10T22:03:18.689412] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-10-10T22:03:19.151096] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-10T22:03:19.489400] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-10T22:03:19.619935] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T22:03:19.981582] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-10T22:03:20.289487] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-10T22:03:21.089458] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-10T22:03:21.496349] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-10T22:03:21.646217] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-10T22:03:21.825831] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-10T22:03:21.889349] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-10T22:03:22.689399] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-10T22:03:23.489427] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-10T22:03:24.219735] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-10T22:03:24.264696] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-10T22:03:24.293214] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-10T22:03:24.299789] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T22:03:25.089400] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-10T22:03:25.889383] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-10T22:03:26.163035] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-10T22:03:26.689393] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-10T22:03:27.272095] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-10T22:03:27.348206] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-10T22:03:27.408433] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-10T22:03:27.489394] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-10T22:03:28.289413] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-10T22:03:29.089393] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-10T22:03:29.421535] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-10T22:03:29.427297] [INFO ] [REMOTE ] TWLO: Full fetch complete (76458 records). [2025-10-10T22:03:29.427474] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-10T22:03:29.835672] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-10T22:03:29.835859] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-10T22:03:29.837904] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-10T22:03:29.838020] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-10T22:03:29.840181] [DEBUG] [LOCAL ] TWLO: Trimmed 76458 records to 53536 (keeping 200 days of data) [2025-10-10T22:03:29.895487] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-10T22:03:30.100435] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-10T22:03:30.273856] [DEBUG] [LOCAL ] TWLO: Primary data saved (53536 records). [2025-10-10T22:03:30.274050] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-10T22:03:30.274153] [INFO ] [MAIN ] Update Progress: 2157/2373 symbols completed. TWLO took 34.8s. Estimated remaining: 30m 23s. Rate: 7.1 symbols/min [2025-10-10T22:03:30.308908] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T22:03:30.504515] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-10T22:03:30.689393] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-10T22:03:31.370043] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-10T22:03:31.489411] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-10T22:03:32.289373] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-10T22:03:32.741611] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-10T22:03:32.831763] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-10T22:03:33.089428] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-10T22:03:33.775289] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-10T22:03:33.889360] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-10T22:03:34.476135] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-10T22:03:34.477369] [INFO ] [REMOTE ] TWN: Full fetch complete (5328 records). [2025-10-10T22:03:34.477441] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-10T22:03:34.694590] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-10T22:03:34.842718] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-10T22:03:34.842802] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-10T22:03:34.843048] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-10T22:03:34.843090] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-10T22:03:34.843619] [DEBUG] [LOCAL ] TWN: Trimmed 5328 records to 3242 (keeping 200 days of data) [2025-10-10T22:03:34.864330] [DEBUG] [LOCAL ] TWN: Primary data saved (3242 records). [2025-10-10T22:03:34.864428] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-10T22:03:34.864522] [INFO ] [MAIN ] Update Progress: 2158/2373 symbols completed. TWN took 29.7s. Estimated remaining: 30m 14s. Rate: 7.1 symbols/min [2025-10-10T22:03:35.489407] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-10T22:03:36.078596] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-10T22:03:36.289415] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-10T22:03:37.444595] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T22:03:37.455142] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-10T22:03:37.598124] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-10T22:03:37.889385] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-10T22:03:39.245131] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-10T22:03:39.251782] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-10T22:03:39.480336] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T22:03:39.490617] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-10T22:03:40.545492] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T22:03:40.550839] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-10T22:03:41.508204] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T22:03:41.521724] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-10T22:03:41.660591] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-10T22:03:41.663684] [INFO ] [REMOTE ] TX: Full fetch complete (35718 records). [2025-10-10T22:03:41.663769] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-10T22:03:42.045495] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-10T22:03:42.045594] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-10T22:03:42.046611] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-10T22:03:42.046697] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-10T22:03:42.047889] [DEBUG] [LOCAL ] TX: Trimmed 35718 records to 23640 (keeping 200 days of data) [2025-10-10T22:03:42.196238] [DEBUG] [LOCAL ] TX: Primary data saved (23640 records). [2025-10-10T22:03:42.196415] [INFO ] [MAIN ] TX: Full history saved. [2025-10-10T22:03:42.196517] [INFO ] [MAIN ] Update Progress: 2159/2373 symbols completed. TX took 25.7s. Estimated remaining: 30m 6s. Rate: 7.1 symbols/min [2025-10-10T22:03:43.416582] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T22:03:43.427893] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-10T22:03:45.350196] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T22:03:45.361129] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-10T22:03:47.130696] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-10T22:03:47.135775] [INFO ] [REMOTE ] TWO: Full fetch complete (69115 records). [2025-10-10T22:03:47.135932] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-10T22:03:47.528138] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-10T22:03:47.528229] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-10T22:03:47.530107] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-10T22:03:47.530214] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-10T22:03:47.533245] [DEBUG] [LOCAL ] TWO: Trimmed 69115 records to 49240 (keeping 200 days of data) [2025-10-10T22:03:47.839126] [DEBUG] [LOCAL ] TWO: Primary data saved (49240 records). [2025-10-10T22:03:47.839309] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-10T22:03:47.839417] [INFO ] [MAIN ] Update Progress: 2160/2373 symbols completed. TWO took 36.0s. Estimated remaining: 29m 57s. Rate: 7.1 symbols/min [2025-10-10T22:03:48.456715] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:03:48.539743] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:03:48.536221] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:03:48.562077] [DEBUG] [LOCAL ] TXNM: No existing data file found in primary storage. [2025-10-10T22:03:48.562543] [WARN ] [MAIN ] TXNM: No existing data found, performing full refresh instead. [2025-10-10T22:03:48.563956] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:03:48.564952] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-10T22:03:48.565393] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-10T22:03:48.565475] [DEBUG] [LOCAL ] TXNM: No primary data file found to delete. [2025-10-10T22:03:48.565517] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-10T22:03:48.691449] [DEBUG] [LOCAL ] TY: Loaded 7663 existing records from primary storage. [2025-10-10T22:03:48.691919] [INFO ] [MAIN ] TY: Loaded 7663 existing records. [2025-10-10T22:03:48.752344] [DEBUG] [LOCAL ] TXO: Loaded 19452 existing records from primary storage. [2025-10-10T22:03:48.856199] [INFO ] [MAIN ] TXO: Loaded 19452 existing records. [2025-10-10T22:03:49.233045] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:03:49.244380] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-10T22:03:49.260172] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-10T22:03:49.228697] [DEBUG] [LOCAL ] TXT: Loaded 50058 existing records from primary storage. [2025-10-10T22:03:49.293799] [INFO ] [MAIN ] TXT: Loaded 50058 existing records. [2025-10-10T22:03:49.307945] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-10T22:03:49.418078] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-10T22:03:49.391764] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:03:49.567864] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-10T22:03:49.559183] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:03:49.594143] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-10T22:03:49.625381] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-10-10T22:03:49.648895] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-10T22:03:49.659778] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-10T22:03:49.830163] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:03:49.890832] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-10T22:03:49.908516] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-10T22:03:49.941177] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-10T22:03:49.941404] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-10T22:03:50.650185] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:03:50.695878] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-10-10T22:03:50.752522] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:03:50.768358] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-10-10T22:03:50.831065] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:03:50.831777] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-10-10T22:03:51.385764] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T22:03:51.394447] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-10T22:03:51.449519] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-10T22:03:51.453125] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-10T22:03:51.626124] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-10T22:03:51.628800] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-10T22:03:52.558854] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-10T22:03:52.563153] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-10T22:03:52.616793] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-10T22:03:52.619481] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-10T22:03:52.815860] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T22:03:52.825991] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-10T22:03:52.935340] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-10T22:03:52.946836] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-10T22:03:53.519301] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T22:03:53.521965] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-10T22:03:53.729901] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-10T22:03:53.734776] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-10T22:03:54.142664] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-10T22:03:54.145088] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-10T22:03:54.412175] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-10T22:03:54.625889] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-10T22:03:54.689405] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-10T22:03:54.848458] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-10T22:03:54.954603] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-10T22:03:55.489421] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-10T22:03:56.289418] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-10T22:03:56.442975] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T22:03:56.947407] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-10T22:03:57.089399] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-10T22:03:57.367971] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T22:03:57.889391] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-10T22:03:58.689370] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-10T22:03:58.891752] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-10T22:03:59.202564] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-10T22:03:59.489376] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-10T22:03:59.624266] [DEBUG] [REMOTE ] TY: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-10T22:03:59.624592] [WARN ] [REMOTE ] TY: No data returned for month 2025-06 [2025-10-10T22:03:59.624710] [FATAL] [REMOTE ] TY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T22:03:59.624796] [FATAL] [MAIN ] TY: Failed to fetch primary data. [2025-10-10T22:03:59.624881] [WARN ] [MAIN ] TY: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T22:03:59.624918] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-10T22:03:59.625155] [DEBUG] [LOCAL ] TY: No primary data file found to delete. [2025-10-10T22:03:59.625471] [INFO ] [LOCAL ] TY: Starting deletion of derivative data. [2025-10-10T22:03:59.626364] [DEBUG] [LOCAL ] TY: Deleted derivative data file. [2025-10-10T22:03:59.626535] [INFO ] [MAIN ] Update Progress: 2161/2373 symbols completed. TY took 11.8s. Estimated remaining: 29m 49s. Rate: 7.1 symbols/min [2025-10-10T22:03:59.828285] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:03:59.844484] [DEBUG] [LOCAL ] TYG: Loaded 13993 existing records from primary storage. [2025-10-10T22:03:59.844944] [INFO ] [MAIN ] TYG: Loaded 13993 existing records. [2025-10-10T22:04:00.024073] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:04:00.024576] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-10T22:04:00.024676] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-10T22:04:00.038222] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-10T22:04:00.058053] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-10T22:04:00.146463] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-10T22:04:00.294572] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-10T22:04:00.426222] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:04:01.089406] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-10T22:04:01.889457] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-10T22:04:02.453189] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T22:04:02.694944] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-10T22:04:02.700679] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-10T22:04:03.489407] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-10T22:04:03.733059] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T22:04:04.127564] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-10T22:04:04.289417] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-10T22:04:05.023881] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-10T22:04:05.089344] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-10T22:04:05.442320] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T22:04:05.889412] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-10T22:04:06.347341] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-10T22:04:06.689450] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-10-10T22:04:07.489383] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-10T22:04:07.680609] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T22:04:07.726707] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-10T22:04:08.289393] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-10T22:04:09.089424] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-10T22:04:09.235023] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T22:04:09.761071] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-10T22:04:09.889417] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-10T22:04:10.007470] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T22:04:10.689400] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-10T22:04:10.973424] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T22:04:10.976770] [INFO ] [REMOTE ] TXO: Full fetch complete (26669 records). [2025-10-10T22:04:10.976910] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-10T22:04:11.370587] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-10T22:04:11.370710] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-10T22:04:11.371527] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-10T22:04:11.371634] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-10T22:04:11.372883] [DEBUG] [LOCAL ] TXO: Trimmed 26669 records to 19726 (keeping 200 days of data) [2025-10-10T22:04:11.489487] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-10T22:04:11.509542] [DEBUG] [LOCAL ] TXO: Primary data saved (19726 records). [2025-10-10T22:04:11.509760] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-10T22:04:11.509866] [INFO ] [MAIN ] Update Progress: 2162/2373 symbols completed. TXO took 23.7s. Estimated remaining: 29m 41s. Rate: 7.1 symbols/min [2025-10-10T22:04:11.689629] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:04:11.714096] [DEBUG] [LOCAL ] TYL: Loaded 22514 existing records from primary storage. [2025-10-10T22:04:11.714423] [INFO ] [MAIN ] TYL: Loaded 22514 existing records. [2025-10-10T22:04:11.897233] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:04:11.897529] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-10T22:04:11.897607] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-10T22:04:11.897906] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-10T22:04:11.897968] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-10T22:04:12.258633] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:04:12.289369] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-10T22:04:12.516606] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-10T22:04:12.963400] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-10T22:04:13.089361] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-10T22:04:13.649595] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T22:04:13.889419] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-10T22:04:14.328795] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T22:04:14.689414] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-10T22:04:15.489365] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-10T22:04:15.870031] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T22:04:16.186036] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-10T22:04:16.190898] [INFO ] [REMOTE ] TXNM: Full fetch complete (62832 records). [2025-10-10T22:04:16.191239] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-10T22:04:16.294578] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-10T22:04:16.611685] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-10T22:04:16.611817] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-10T22:04:16.613197] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-10T22:04:16.613267] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-10T22:04:16.615368] [DEBUG] [LOCAL ] TXNM: Trimmed 62832 records to 44121 (keeping 200 days of data) [2025-10-10T22:04:16.717789] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-10T22:04:16.918312] [DEBUG] [LOCAL ] TXNM: Primary data saved (44121 records). [2025-10-10T22:04:16.918600] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-10T22:04:16.918818] [INFO ] [MAIN ] Update Progress: 2163/2373 symbols completed. TXNM took 29.1s. Estimated remaining: 29m 32s. Rate: 7.1 symbols/min [2025-10-10T22:04:17.093348] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-10-10T22:04:17.116993] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:04:17.192512] [DEBUG] [LOCAL ] U: Loaded 54189 existing records from primary storage. [2025-10-10T22:04:17.192974] [INFO ] [MAIN ] U: Loaded 54189 existing records. [2025-10-10T22:04:17.448913] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:04:17.453179] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-10T22:04:17.450254] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-10T22:04:17.453503] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-10T22:04:17.464221] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-10T22:04:17.464313] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-10T22:04:17.838938] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:04:17.889381] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-10T22:04:18.434154] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T22:04:18.689352] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-10T22:04:18.703047] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T22:04:18.708404] [INFO ] [REMOTE ] TXT: Full fetch complete (72243 records). [2025-10-10T22:04:18.708570] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-10T22:04:19.127272] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-10T22:04:19.127402] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-10T22:04:19.128954] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-10T22:04:19.129023] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-10T22:04:19.131035] [DEBUG] [LOCAL ] TXT: Trimmed 72243 records to 50440 (keeping 200 days of data) [2025-10-10T22:04:19.472301] [DEBUG] [LOCAL ] TXT: Primary data saved (50440 records). [2025-10-10T22:04:19.472494] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-10T22:04:19.472613] [INFO ] [MAIN ] Update Progress: 2164/2373 symbols completed. TXT took 31.6s. Estimated remaining: 29m 23s. Rate: 7.1 symbols/min [2025-10-10T22:04:19.494617] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-10T22:04:19.654690] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:04:19.707831] [DEBUG] [LOCAL ] UA: Loaded 50807 existing records from primary storage. [2025-10-10T22:04:19.708271] [INFO ] [MAIN ] UA: Loaded 50807 existing records. [2025-10-10T22:04:19.902874] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:04:19.903571] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-10T22:04:19.903670] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-10T22:04:19.904171] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-10T22:04:19.904247] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-10T22:04:20.225847] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-10T22:04:20.312876] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-10T22:04:20.319693] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:04:20.772116] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T22:04:21.089454] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-10-10T22:04:21.616114] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T22:04:21.889445] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-10T22:04:22.689406] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-10-10T22:04:23.054484] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-10T22:04:23.489379] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-10T22:04:23.854941] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-10-10T22:04:24.071714] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-10T22:04:24.289390] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-10T22:04:24.563363] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T22:04:25.089379] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-10T22:04:25.235573] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-10T22:04:25.889388] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-10T22:04:26.448634] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-10T22:04:26.689438] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-10T22:04:27.489393] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-10T22:04:27.983848] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T22:04:28.289392] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-10T22:04:28.444123] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-10T22:04:29.089373] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-10T22:04:29.334184] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T22:04:29.784718] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-10T22:04:29.889385] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-10T22:04:30.689371] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-10T22:04:31.088604] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-10T22:04:31.402842] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-10T22:04:31.489432] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-10T22:04:32.289353] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-10T22:04:32.522270] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T22:04:32.605495] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-10T22:04:33.089431] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-10T22:04:33.889363] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-10T22:04:34.044891] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-10T22:04:34.650549] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-10T22:04:34.689325] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-10T22:04:34.971555] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-10T22:04:35.489419] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-10T22:04:36.289370] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-10T22:04:36.577887] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-10T22:04:36.944530] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-10T22:04:37.063430] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-10T22:04:37.089344] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-10T22:04:37.889404] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-10T22:04:38.360127] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T22:04:38.689450] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-10T22:04:39.489389] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-10T22:04:40.094527] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-10T22:04:40.289363] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-10T22:04:40.533705] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-10T22:04:40.537468] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-10T22:04:40.553771] [INFO ] [REMOTE ] TYG: Full fetch complete (22391 records). [2025-10-10T22:04:40.554718] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-10T22:04:40.936225] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-10T22:04:40.936105] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-10T22:04:40.936477] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-10T22:04:40.939960] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-10T22:04:40.940058] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-10T22:04:40.940175] [INFO ] [REMOTE ] TYL: Full fetch complete (31441 records). [2025-10-10T22:04:40.940297] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-10T22:04:40.991780] [DEBUG] [LOCAL ] TYG: Trimmed 22391 records to 14076 (keeping 200 days of data) [2025-10-10T22:04:41.095838] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-10T22:04:41.405378] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-10T22:04:41.406685] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-10T22:04:41.409312] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-10T22:04:41.410456] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-10T22:04:41.414299] [DEBUG] [LOCAL ] TYL: Trimmed 31441 records to 22651 (keeping 200 days of data) [2025-10-10T22:04:41.514881] [DEBUG] [LOCAL ] TYG: Primary data saved (14076 records). [2025-10-10T22:04:41.516071] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-10T22:04:41.516429] [INFO ] [MAIN ] Update Progress: 2165/2373 symbols completed. TYG took 41.9s. Estimated remaining: 29m 16s. Rate: 7.1 symbols/min [2025-10-10T22:04:41.706913] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:04:41.733842] [DEBUG] [LOCAL ] TYL: Primary data saved (22651 records). [2025-10-10T22:04:41.733989] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-10T22:04:41.734077] [INFO ] [MAIN ] Update Progress: 2166/2373 symbols completed. TYL took 30.2s. Estimated remaining: 29m 7s. Rate: 7.1 symbols/min [2025-10-10T22:04:41.896832] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-10T22:04:41.932000] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:04:41.949152] [DEBUG] [LOCAL ] UAA: Loaded 53898 existing records from primary storage. [2025-10-10T22:04:41.949566] [INFO ] [MAIN ] UAA: Loaded 53898 existing records. [2025-10-10T22:04:42.056997] [DEBUG] [LOCAL ] UAN: Loaded 5459 existing records from primary storage. [2025-10-10T22:04:42.057729] [INFO ] [MAIN ] UAN: Loaded 5459 existing records. [2025-10-10T22:04:42.242953] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:04:42.269708] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-10T22:04:42.292347] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-10T22:04:42.316719] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-10T22:04:42.325003] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-10T22:04:42.324760] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:04:42.330450] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-10T22:04:42.343466] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-10T22:04:42.369153] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-10T22:04:42.402616] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-10T22:04:43.041291] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:04:43.051912] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-10-10T22:04:43.115421] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:04:43.489458] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-10-10T22:04:43.612790] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-10T22:04:43.729941] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T22:04:44.085855] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-10T22:04:44.289402] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-10T22:04:45.056912] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T22:04:45.089325] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-10T22:04:45.889381] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-10T22:04:46.590163] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-10T22:04:46.689368] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-10T22:04:47.074276] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T22:04:47.489383] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-10T22:04:47.795700] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T22:04:48.289380] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-10T22:04:49.089429] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-10T22:04:49.312981] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-10T22:04:49.494848] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-10T22:04:49.889405] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-10T22:04:49.998157] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-10T22:04:50.052311] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T22:04:50.689410] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-10T22:04:51.424933] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-10T22:04:51.489431] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-10T22:04:52.078407] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-10T22:04:52.166306] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-10T22:04:52.289403] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-10T22:04:53.089390] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-10T22:04:53.228282] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-10T22:04:53.889392] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-10T22:04:54.689361] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-10T22:04:54.778324] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-10T22:04:55.181660] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-10T22:04:55.489378] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-10T22:04:56.074164] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-10T22:04:56.289416] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-10T22:04:57.089416] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-10T22:04:57.721624] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-10T22:04:57.889347] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-10T22:04:58.243232] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-10T22:04:58.248264] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-10-10T22:04:58.248392] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-10T22:04:58.639265] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-10T22:04:58.639445] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-10T22:04:58.640639] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-10T22:04:58.640727] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-10T22:04:58.642160] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 54579 (keeping 200 days of data) [2025-10-10T22:04:58.701547] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-10T22:04:58.972548] [DEBUG] [LOCAL ] U: Primary data saved (54579 records). [2025-10-10T22:04:58.972765] [INFO ] [MAIN ] U: Full history saved. [2025-10-10T22:04:58.972855] [INFO ] [MAIN ] Update Progress: 2167/2373 symbols completed. U took 42.1s. Estimated remaining: 28m 59s. Rate: 7.1 symbols/min [2025-10-10T22:04:59.141788] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:04:59.179094] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-10T22:04:59.181432] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-10T22:04:59.237585] [DEBUG] [LOCAL ] UBER: Loaded 54196 existing records from primary storage. [2025-10-10T22:04:59.237921] [INFO ] [MAIN ] UBER: Loaded 54196 existing records. [2025-10-10T22:04:59.420414] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:04:59.420793] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-10T22:04:59.420919] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-10T22:04:59.421511] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-10T22:04:59.421674] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-10T22:04:59.494448] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-10T22:04:59.739789] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T22:04:59.831535] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:05:00.289431] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-10T22:05:01.089442] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-10T22:05:01.629332] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-10T22:05:01.818388] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-10T22:05:01.889369] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-10T22:05:02.420051] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-10T22:05:02.689370] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-10-10T22:05:02.735676] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-10T22:05:03.489402] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-10T22:05:04.289396] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-10T22:05:05.089354] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-10T22:05:05.128517] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-10T22:05:05.277498] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-10T22:05:05.282394] [INFO ] [REMOTE ] UA: Full fetch complete (72966 records). [2025-10-10T22:05:05.282515] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-10T22:05:05.683476] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-10T22:05:05.683714] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-10T22:05:05.685024] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-10T22:05:05.685104] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-10T22:05:05.722961] [DEBUG] [LOCAL ] UA: Trimmed 72966 records to 51194 (keeping 200 days of data) [2025-10-10T22:05:05.725360] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (3.04 seconds). [2025-10-10T22:05:05.899991] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-10T22:05:06.036851] [DEBUG] [LOCAL ] UA: Primary data saved (51194 records). [2025-10-10T22:05:06.037023] [INFO ] [MAIN ] UA: Full history saved. [2025-10-10T22:05:06.037122] [INFO ] [MAIN ] Update Progress: 2168/2373 symbols completed. UA took 46.6s. Estimated remaining: 28m 51s. Rate: 7.1 symbols/min [2025-10-10T22:05:06.203369] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:05:06.251369] [DEBUG] [LOCAL ] UBS: Loaded 52720 existing records from primary storage. [2025-10-10T22:05:06.251731] [INFO ] [MAIN ] UBS: Loaded 52720 existing records. [2025-10-10T22:05:06.428064] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:05:06.429061] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-10T22:05:06.429109] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-10T22:05:06.429310] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-10T22:05:06.429365] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-10T22:05:06.612072] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-10T22:05:06.657315] [INFO ] [REMOTE ] UAN: Full fetch complete (8041 records). [2025-10-10T22:05:06.674165] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-10T22:05:06.692087] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-10T22:05:06.981435] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:05:07.220677] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-10T22:05:07.220786] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-10T22:05:07.221079] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-10T22:05:07.221278] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-10T22:05:07.238156] [DEBUG] [LOCAL ] UAN: Trimmed 8041 records to 5484 (keeping 200 days of data) [2025-10-10T22:05:07.267692] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-10T22:05:07.298354] [DEBUG] [LOCAL ] UAN: Primary data saved (5484 records). [2025-10-10T22:05:07.298470] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-10T22:05:07.298553] [INFO ] [MAIN ] Update Progress: 2169/2373 symbols completed. UAN took 25.6s. Estimated remaining: 28m 41s. Rate: 7.1 symbols/min [2025-10-10T22:05:07.462813] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:05:07.496737] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-10-10T22:05:07.502588] [DEBUG] [LOCAL ] UCB: Loaded 38026 existing records from primary storage. [2025-10-10T22:05:07.502866] [INFO ] [MAIN ] UCB: Loaded 38026 existing records. [2025-10-10T22:05:07.677324] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:05:07.677590] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-10T22:05:07.677665] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-10T22:05:07.677905] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-10T22:05:07.677960] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-10T22:05:08.023762] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:05:08.289393] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-10-10T22:05:09.089402] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-10T22:05:09.168902] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-10T22:05:09.499054] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T22:05:09.889387] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-10T22:05:10.091705] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T22:05:10.633743] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-10T22:05:10.689352] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-10T22:05:11.489348] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-10T22:05:11.843732] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-10T22:05:12.289402] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-10T22:05:12.405222] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-10T22:05:13.089452] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-10T22:05:13.394825] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-10T22:05:13.433217] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-10T22:05:13.889388] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-10T22:05:14.660000] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-10T22:05:14.665297] [INFO ] [REMOTE ] UAA: Full fetch complete (77484 records). [2025-10-10T22:05:14.665439] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-10T22:05:14.697118] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-10T22:05:15.077053] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-10T22:05:15.077170] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-10T22:05:15.078504] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-10T22:05:15.078607] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-10T22:05:15.084059] [DEBUG] [LOCAL ] UAA: Trimmed 77484 records to 54287 (keeping 200 days of data) [2025-10-10T22:05:15.426664] [DEBUG] [LOCAL ] UAA: Primary data saved (54287 records). [2025-10-10T22:05:15.426821] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-10T22:05:15.426907] [INFO ] [MAIN ] Update Progress: 2170/2373 symbols completed. UAA took 33.9s. Estimated remaining: 28m 33s. Rate: 7.1 symbols/min [2025-10-10T22:05:15.496495] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-10T22:05:15.597353] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-10T22:05:15.631369] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:05:15.680910] [DEBUG] [LOCAL ] UDR: Loaded 52279 existing records from primary storage. [2025-10-10T22:05:15.681244] [INFO ] [MAIN ] UDR: Loaded 52279 existing records. [2025-10-10T22:05:15.859538] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:05:15.859831] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-10T22:05:15.859935] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-10T22:05:15.860166] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-10T22:05:15.860223] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-10T22:05:16.238548] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:05:16.268132] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T22:05:16.289337] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-10T22:05:17.089432] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-10-10T22:05:17.889358] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-10T22:05:18.230106] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-10T22:05:18.490944] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-10T22:05:18.689385] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-10T22:05:18.969879] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T22:05:19.111594] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T22:05:19.489394] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-10T22:05:20.289392] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-10T22:05:21.080920] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-10T22:05:21.091459] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-10T22:05:21.453218] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-10T22:05:21.708590] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-10T22:05:21.889365] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-10T22:05:22.128808] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-10T22:05:22.689378] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-10T22:05:23.489390] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-10T22:05:23.978606] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-10T22:05:24.289377] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-10T22:05:24.546268] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-10T22:05:25.089358] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-10T22:05:25.284404] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-10T22:05:25.678172] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-10T22:05:25.889405] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-10T22:05:26.700833] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-10T22:05:26.703597] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-10T22:05:27.489404] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-10T22:05:27.821608] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T22:05:28.289448] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-10T22:05:28.693438] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T22:05:28.780433] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-10T22:05:29.089387] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-10T22:05:29.889420] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-10T22:05:30.464081] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-10T22:05:30.689342] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-10T22:05:31.128405] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T22:05:31.489383] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-10T22:05:32.289352] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-10T22:05:32.504230] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-10T22:05:32.680479] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T22:05:32.986279] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-10T22:05:33.089378] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-10-10T22:05:33.889405] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-10T22:05:34.093220] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-10T22:05:34.208095] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T22:05:34.689343] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-10. [2025-10-10T22:05:35.489404] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-10T22:05:36.066272] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-10T22:05:36.101379] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-10T22:05:36.107164] [INFO ] [REMOTE ] UCB: Full fetch complete (54667 records). [2025-10-10T22:05:36.107285] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-10T22:05:36.298363] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-10T22:05:36.488327] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-10T22:05:36.488413] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-10T22:05:36.489442] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-10T22:05:36.489505] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-10T22:05:36.490682] [DEBUG] [LOCAL ] UCB: Trimmed 54667 records to 38322 (keeping 200 days of data) [2025-10-10T22:05:36.729595] [DEBUG] [LOCAL ] UCB: Primary data saved (38322 records). [2025-10-10T22:05:36.729782] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-10T22:05:36.729918] [INFO ] [MAIN ] Update Progress: 2171/2373 symbols completed. UCB took 29.4s. Estimated remaining: 28m 26s. Rate: 7.1 symbols/min [2025-10-10T22:05:36.899130] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:05:36.936071] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-10T22:05:36.980527] [DEBUG] [LOCAL ] UE: Loaded 42867 existing records from primary storage. [2025-10-10T22:05:36.980886] [INFO ] [MAIN ] UE: Loaded 42867 existing records. [2025-10-10T22:05:37.094447] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-10T22:05:37.158066] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:05:37.158267] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-10T22:05:37.158316] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-10T22:05:37.158528] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-10T22:05:37.158584] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-10T22:05:37.509228] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:05:37.889401] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-10-10T22:05:38.108566] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-10T22:05:38.114302] [INFO ] [REMOTE ] UBS: Full fetch complete (75731 records). [2025-10-10T22:05:38.114518] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-10T22:05:38.525842] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-10T22:05:38.525925] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-10T22:05:38.527230] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-10T22:05:38.527293] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-10T22:05:38.528726] [DEBUG] [LOCAL ] UBS: Trimmed 75731 records to 53101 (keeping 200 days of data) [2025-10-10T22:05:38.704307] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-10T22:05:38.854388] [DEBUG] [LOCAL ] UBS: Primary data saved (53101 records). [2025-10-10T22:05:38.854537] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-10T22:05:38.854624] [INFO ] [MAIN ] Update Progress: 2172/2373 symbols completed. UBS took 32.8s. Estimated remaining: 28m 17s. Rate: 7.1 symbols/min [2025-10-10T22:05:39.026943] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:05:39.037566] [DEBUG] [LOCAL ] UFI: Loaded 8205 existing records from primary storage. [2025-10-10T22:05:39.037810] [INFO ] [MAIN ] UFI: Loaded 8205 existing records. [2025-10-10T22:05:39.217219] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:05:39.217751] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-10T22:05:39.217813] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-10T22:05:39.217967] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-10T22:05:39.253486] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-10T22:05:39.379056] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-10T22:05:39.498472] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-10T22:05:39.650702] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:05:39.871766] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T22:05:40.289377] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-10T22:05:41.089450] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-10-10T22:05:41.226029] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-10T22:05:41.344633] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-10T22:05:41.889589] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-10T22:05:41.891355] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-10T22:05:41.968985] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-10T22:05:42.689366] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-10T22:05:43.489398] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-10T22:05:44.010371] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-10T22:05:44.299316] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-10T22:05:44.304166] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T22:05:44.446562] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-10T22:05:45.089378] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-10T22:05:45.650247] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-10T22:05:45.889358] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-10T22:05:46.689408] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-10T22:05:46.795865] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-10T22:05:46.823072] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-10T22:05:47.489417] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-10T22:05:48.256128] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T22:05:48.261737] [INFO ] [REMOTE ] UDR: Full fetch complete (74709 records). [2025-10-10T22:05:48.261862] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-10T22:05:48.295104] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-10T22:05:48.572984] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T22:05:48.715963] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-10T22:05:48.716059] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-10T22:05:48.717345] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-10T22:05:48.717410] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-10T22:05:48.719770] [DEBUG] [LOCAL ] UDR: Trimmed 74709 records to 52669 (keeping 200 days of data) [2025-10-10T22:05:49.054711] [DEBUG] [LOCAL ] UDR: Primary data saved (52669 records). [2025-10-10T22:05:49.054874] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-10T22:05:49.054967] [INFO ] [MAIN ] Update Progress: 2173/2373 symbols completed. UDR took 33.6s. Estimated remaining: 28m 8s. Rate: 7.1 symbols/min [2025-10-10T22:05:49.097224] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-10T22:05:49.227078] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:05:49.250187] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-10T22:05:49.289626] [DEBUG] [LOCAL ] UGI: Loaded 50938 existing records from primary storage. [2025-10-10T22:05:49.290019] [INFO ] [MAIN ] UGI: Loaded 50938 existing records. [2025-10-10T22:05:49.468237] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:05:49.468581] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-10T22:05:49.468754] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-10T22:05:49.469080] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-10T22:05:49.469138] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-10T22:05:49.642156] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-10T22:05:49.738233] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-10-10T22:05:49.771590] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-10T22:05:49.894540] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-10T22:05:49.960459] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:05:50.245598] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-10T22:05:50.245716] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-10T22:05:50.246974] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-10T22:05:50.247038] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-10T22:05:50.248517] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 54586 (keeping 200 days of data) [2025-10-10T22:05:50.580713] [DEBUG] [LOCAL ] UBER: Primary data saved (54586 records). [2025-10-10T22:05:50.580863] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-10T22:05:50.580953] [INFO ] [MAIN ] Update Progress: 2174/2373 symbols completed. UBER took 51.6s. Estimated remaining: 27m 59s. Rate: 7.1 symbols/min [2025-10-10T22:05:50.694577] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-10T22:05:50.749931] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:05:50.790028] [DEBUG] [LOCAL ] UGP: Loaded 43221 existing records from primary storage. [2025-10-10T22:05:50.790359] [INFO ] [MAIN ] UGP: Loaded 43221 existing records. [2025-10-10T22:05:50.974494] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:05:50.984551] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-10T22:05:50.984703] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-10T22:05:50.985934] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-10T22:05:50.985869] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-10T22:05:50.986134] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-10T22:05:51.332607] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:05:51.489384] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-10-10T22:05:52.289349] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-10-10T22:05:52.573218] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T22:05:52.695462] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-10T22:05:53.089394] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-10T22:05:53.889360] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-10T22:05:54.129863] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T22:05:54.172600] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-10T22:05:54.689379] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-10T22:05:55.489392] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-10T22:05:55.587594] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T22:05:56.060081] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-10T22:05:56.289438] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-10T22:05:57.089394] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-10T22:05:57.300982] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-10T22:05:57.612114] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-10T22:05:57.630109] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-10T22:05:57.889465] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-10T22:05:58.689409] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-10T22:05:59.470075] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-10T22:05:59.489338] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-10T22:05:59.862421] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T22:06:00.289416] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-10T22:06:00.324892] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-10T22:06:01.089398] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-10T22:06:01.235762] [DEBUG] [REMOTE ] UFI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-10T22:06:01.236149] [WARN ] [REMOTE ] UFI: No data returned for month 2025-09 [2025-10-10T22:06:01.236265] [FATAL] [REMOTE ] UFI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T22:06:01.236389] [FATAL] [MAIN ] UFI: Failed to fetch primary data. [2025-10-10T22:06:01.236472] [WARN ] [MAIN ] UFI: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T22:06:01.236560] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-10T22:06:01.236692] [DEBUG] [LOCAL ] UFI: No primary data file found to delete. [2025-10-10T22:06:01.236760] [INFO ] [LOCAL ] UFI: Starting deletion of derivative data. [2025-10-10T22:06:01.237408] [DEBUG] [LOCAL ] UFI: Deleted derivative data file. [2025-10-10T22:06:01.237515] [INFO ] [MAIN ] Update Progress: 2175/2373 symbols completed. UFI took 22.4s. Estimated remaining: 27m 51s. Rate: 7.1 symbols/min [2025-10-10T22:06:01.422953] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:06:01.441981] [DEBUG] [LOCAL ] UHAL: Loaded 16874 existing records from primary storage. [2025-10-10T22:06:01.442255] [INFO ] [MAIN ] UHAL: Loaded 16874 existing records. [2025-10-10T22:06:01.636830] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:06:01.637059] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-10T22:06:01.637110] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-10T22:06:01.637341] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-10T22:06:01.637397] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-10T22:06:01.895858] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-10T22:06:02.027526] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:06:02.106906] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T22:06:02.689369] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-10T22:06:03.489435] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-10T22:06:03.814103] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T22:06:04.289425] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-10T22:06:04.462374] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T22:06:05.089409] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-10-10T22:06:05.288789] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T22:06:05.889418] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-10T22:06:06.266803] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T22:06:06.346141] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-10T22:06:06.689379] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-10T22:06:07.489372] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-10T22:06:07.878688] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T22:06:08.289447] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-10T22:06:08.440187] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T22:06:08.659088] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T22:06:09.089362] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-10T22:06:09.889350] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-10T22:06:10.177695] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T22:06:10.253208] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T22:06:10.689429] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-10T22:06:11.489453] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-10T22:06:11.546632] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T22:06:12.289364] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-10T22:06:12.715569] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-10T22:06:12.755518] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-10T22:06:13.089436] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-10T22:06:13.771182] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-10T22:06:13.775140] [INFO ] [REMOTE ] UE: Full fetch complete (61087 records). [2025-10-10T22:06:13.775238] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-10T22:06:13.894541] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-10T22:06:14.162409] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-10T22:06:14.162487] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-10T22:06:14.163545] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-10T22:06:14.163607] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-10T22:06:14.164826] [DEBUG] [LOCAL ] UE: Trimmed 61087 records to 43173 (keeping 200 days of data) [2025-10-10T22:06:14.433455] [DEBUG] [LOCAL ] UE: Primary data saved (43173 records). [2025-10-10T22:06:14.433593] [INFO ] [MAIN ] UE: Full history saved. [2025-10-10T22:06:14.433972] [INFO ] [MAIN ] Update Progress: 2176/2373 symbols completed. UE took 37.7s. Estimated remaining: 27m 43s. Rate: 7.1 symbols/min [2025-10-10T22:06:14.613249] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:06:14.650417] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-10T22:06:14.692610] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-10T22:06:14.696843] [DEBUG] [LOCAL ] UHS: Loaded 40845 existing records from primary storage. [2025-10-10T22:06:14.697125] [INFO ] [MAIN ] UHS: Loaded 40845 existing records. [2025-10-10T22:06:14.871313] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:06:14.871525] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-10T22:06:14.871572] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-10T22:06:14.871805] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-10T22:06:14.871862] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-10T22:06:15.177999] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T22:06:15.248793] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:06:15.489361] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-10T22:06:16.289350] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-10-10T22:06:16.639331] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T22:06:16.787225] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-10T22:06:17.089362] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-10T22:06:17.889411] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-10T22:06:18.034767] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-10T22:06:18.249055] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-10T22:06:18.689380] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-10T22:06:19.489438] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-10T22:06:19.706095] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T22:06:20.289384] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-10T22:06:20.337018] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T22:06:20.704243] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-10T22:06:21.089421] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-10T22:06:21.889397] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-10T22:06:22.033019] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T22:06:22.041272] [INFO ] [REMOTE ] UGI: Full fetch complete (73277 records). [2025-10-10T22:06:22.041515] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-10T22:06:22.455144] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-10T22:06:22.455254] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-10T22:06:22.456506] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-10T22:06:22.456575] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-10T22:06:22.463634] [DEBUG] [LOCAL ] UGI: Trimmed 73277 records to 51300 (keeping 200 days of data) [2025-10-10T22:06:22.689589] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-10T22:06:22.791152] [DEBUG] [LOCAL ] UGI: Primary data saved (51300 records). [2025-10-10T22:06:22.791307] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-10T22:06:22.791397] [INFO ] [MAIN ] Update Progress: 2177/2373 symbols completed. UGI took 33.7s. Estimated remaining: 27m 35s. Rate: 7.1 symbols/min [2025-10-10T22:06:22.989040] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:06:22.992068] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T22:06:23.012311] [DEBUG] [LOCAL ] UHT: Loaded 10086 existing records from primary storage. [2025-10-10T22:06:23.012557] [INFO ] [MAIN ] UHT: Loaded 10086 existing records. [2025-10-10T22:06:23.150473] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-10T22:06:23.220219] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:06:23.220539] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-10T22:06:23.220699] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-10T22:06:23.220957] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-10T22:06:23.221015] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-10T22:06:23.494701] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-10T22:06:23.594735] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:06:24.289341] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-10T22:06:24.320282] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T22:06:25.089414] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-10-10T22:06:25.363440] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-10T22:06:25.487500] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T22:06:25.889354] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-10T22:06:25.933969] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-10T22:06:26.689338] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-10T22:06:27.141316] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T22:06:27.255568] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-10T22:06:27.489402] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-10T22:06:28.289451] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-10T22:06:29.089391] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-10T22:06:29.431394] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T22:06:29.491554] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T22:06:29.493725] [INFO ] [REMOTE ] UHAL: Full fetch complete (23182 records). [2025-10-10T22:06:29.493800] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-10T22:06:29.848960] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-10T22:06:29.849035] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-10T22:06:29.849517] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-10T22:06:29.849557] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-10T22:06:29.850222] [DEBUG] [LOCAL ] UHAL: Trimmed 23182 records to 17006 (keeping 200 days of data) [2025-10-10T22:06:29.890172] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-10T22:06:29.951452] [DEBUG] [LOCAL ] UHAL: Primary data saved (17006 records). [2025-10-10T22:06:29.951586] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-10T22:06:29.951690] [INFO ] [MAIN ] Update Progress: 2178/2373 symbols completed. UHAL took 28.7s. Estimated remaining: 27m 26s. Rate: 7.1 symbols/min [2025-10-10T22:06:30.124032] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:06:30.155412] [DEBUG] [LOCAL ] UI: Loaded 13490 existing records from primary storage. [2025-10-10T22:06:30.155673] [INFO ] [MAIN ] UI: Loaded 13490 existing records. [2025-10-10T22:06:30.330570] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:06:30.330779] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-10T22:06:30.330829] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-10T22:06:30.330995] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-10T22:06:30.331050] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-10T22:06:30.684137] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:06:30.689328] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-10-10T22:06:30.876311] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T22:06:31.489380] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-10T22:06:31.665991] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-10T22:06:31.863941] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T22:06:32.289393] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-10T22:06:33.089357] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-10T22:06:33.273513] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-10T22:06:33.364925] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T22:06:33.889411] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-10T22:06:34.054471] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T22:06:34.689411] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-10T22:06:35.489381] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-10T22:06:35.546471] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-10T22:06:35.550817] [INFO ] [REMOTE ] UGP: Full fetch complete (62180 records). [2025-10-10T22:06:35.550910] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-10T22:06:35.845305] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-10T22:06:35.936832] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-10T22:06:35.936905] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-10T22:06:35.938039] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-10T22:06:35.938102] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-10T22:06:35.939276] [DEBUG] [LOCAL ] UGP: Trimmed 62180 records to 43561 (keeping 200 days of data) [2025-10-10T22:06:36.190683] [DEBUG] [LOCAL ] UGP: Primary data saved (43561 records). [2025-10-10T22:06:36.190815] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-10T22:06:36.190908] [INFO ] [MAIN ] Update Progress: 2179/2373 symbols completed. UGP took 45.6s. Estimated remaining: 27m 17s. Rate: 7.1 symbols/min [2025-10-10T22:06:36.289914] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-10T22:06:36.364034] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:06:36.398567] [DEBUG] [LOCAL ] UIS: Loaded 37228 existing records from primary storage. [2025-10-10T22:06:36.398871] [INFO ] [MAIN ] UIS: Loaded 37228 existing records. [2025-10-10T22:06:36.606095] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:06:36.606390] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-10T22:06:36.606448] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-10T22:06:36.606764] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-10T22:06:36.606823] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-10T22:06:36.757152] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-10T22:06:36.978141] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:06:37.089387] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-10-10T22:06:37.150057] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-10T22:06:37.889380] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-10T22:06:38.636189] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T22:06:38.689340] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-10T22:06:39.135769] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-10T22:06:39.489378] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-10T22:06:40.205390] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-10T22:06:40.289332] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-10T22:06:40.539803] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-10T22:06:41.089395] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-10T22:06:41.537228] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T22:06:41.889385] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-10T22:06:42.128732] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-10T22:06:42.689395] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-10T22:06:43.489393] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-10T22:06:43.591532] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-10T22:06:43.729470] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-10T22:06:44.289383] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-10T22:06:44.852356] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-10T22:06:45.089413] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-10T22:06:45.392349] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T22:06:45.889385] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-10T22:06:46.075272] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-10T22:06:46.689419] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-10T22:06:46.895485] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-10T22:06:47.489421] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-10T22:06:47.668727] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-10T22:06:48.289396] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-10T22:06:49.089366] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-10T22:06:49.220629] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-10T22:06:49.270136] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T22:06:49.889420] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-10T22:06:50.042416] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-10T22:06:50.689445] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-10T22:06:50.704309] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T22:06:50.707718] [INFO ] [REMOTE ] UHT: Full fetch complete (14964 records). [2025-10-10T22:06:50.707943] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-10T22:06:51.212052] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-10T22:06:51.212154] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-10T22:06:51.212700] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-10T22:06:51.212765] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-10T22:06:51.213322] [DEBUG] [LOCAL ] UHT: Trimmed 14964 records to 10186 (keeping 200 days of data) [2025-10-10T22:06:51.292460] [DEBUG] [LOCAL ] UHT: Primary data saved (10186 records). [2025-10-10T22:06:51.292690] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-10T22:06:51.292820] [INFO ] [MAIN ] Update Progress: 2180/2373 symbols completed. UHT took 28.5s. Estimated remaining: 27m 10s. Rate: 7.1 symbols/min [2025-10-10T22:06:51.491938] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-10T22:06:51.491808] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:06:51.492450] [DEBUG] [LOCAL ] UL: No existing data file found in primary storage. [2025-10-10T22:06:51.492848] [WARN ] [MAIN ] UL: No existing data found, performing full refresh instead. [2025-10-10T22:06:51.493989] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-10T22:06:51.494068] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-10T22:06:51.494119] [DEBUG] [LOCAL ] UL: No primary data file found to delete. [2025-10-10T22:06:51.494155] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-10T22:06:51.875476] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:06:51.881455] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T22:06:52.289395] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-10T22:06:52.890922] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-10T22:06:53.089394] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-10T22:06:53.617894] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T22:06:53.889400] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-10-10T22:06:54.329855] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-10T22:06:54.689411] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-10T22:06:55.489375] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-10T22:06:56.036114] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-10T22:06:56.074371] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-10T22:06:56.289387] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-10T22:06:56.704326] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-10T22:06:57.089389] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-10T22:06:57.889395] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-10T22:06:58.230012] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-10T22:06:58.232440] [INFO ] [REMOTE ] UI: Full fetch complete (18861 records). [2025-10-10T22:06:58.232524] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-10T22:06:58.525027] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-10T22:06:58.685372] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-10T22:06:58.685513] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-10T22:06:58.686419] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-10T22:06:58.700704] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-10T22:06:58.700894] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-10T22:06:58.712985] [DEBUG] [LOCAL ] UI: Trimmed 18861 records to 13680 (keeping 200 days of data) [2025-10-10T22:06:58.715845] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-10T22:06:58.819899] [DEBUG] [LOCAL ] UI: Primary data saved (13680 records). [2025-10-10T22:06:58.820097] [INFO ] [MAIN ] UI: Full history saved. [2025-10-10T22:06:58.820198] [INFO ] [MAIN ] Update Progress: 2181/2373 symbols completed. UI took 28.9s. Estimated remaining: 27m 1s. Rate: 7.1 symbols/min [2025-10-10T22:06:59.006886] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:06:59.048239] [DEBUG] [LOCAL ] ULS: Loaded 39657 existing records from primary storage. [2025-10-10T22:06:59.048697] [INFO ] [MAIN ] ULS: Loaded 39657 existing records. [2025-10-10T22:06:59.237162] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:06:59.237437] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-10T22:06:59.237488] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-10T22:06:59.237931] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-10T22:06:59.237994] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-10T22:06:59.494684] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-10T22:06:59.613163] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:07:00.292727] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-10-10T22:07:00.296603] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-10T22:07:00.301231] [INFO ] [REMOTE ] UHS: Full fetch complete (58196 records). [2025-10-10T22:07:00.301470] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-10T22:07:00.522331] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T22:07:00.773454] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-10T22:07:00.773565] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-10T22:07:00.774968] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-10T22:07:00.775035] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-10T22:07:00.776704] [DEBUG] [LOCAL ] UHS: Trimmed 58196 records to 41138 (keeping 200 days of data) [2025-10-10T22:07:01.089551] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-10T22:07:01.107196] [DEBUG] [LOCAL ] UHS: Primary data saved (41138 records). [2025-10-10T22:07:01.107351] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-10T22:07:01.107909] [INFO ] [MAIN ] Update Progress: 2182/2373 symbols completed. UHS took 46.7s. Estimated remaining: 26m 52s. Rate: 7.1 symbols/min [2025-10-10T22:07:01.275543] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:07:01.325693] [DEBUG] [LOCAL ] UMC: Loaded 53076 existing records from primary storage. [2025-10-10T22:07:01.326031] [INFO ] [MAIN ] UMC: Loaded 53076 existing records. [2025-10-10T22:07:01.504828] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:07:01.505048] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-10T22:07:01.505095] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-10T22:07:01.505318] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-10T22:07:01.505374] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-10T22:07:01.882872] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:07:01.889341] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-10-10T22:07:02.198868] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-10T22:07:02.689375] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-10T22:07:02.834087] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-10T22:07:03.489388] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-10T22:07:03.645797] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-10T22:07:03.687138] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T22:07:04.289391] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-10T22:07:05.094491] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-10T22:07:05.112873] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T22:07:05.747046] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T22:07:05.889416] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-10T22:07:06.689376] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-10T22:07:06.807681] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-10T22:07:07.489405] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-10T22:07:08.142910] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-10T22:07:08.289384] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-10T22:07:08.392433] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-10T22:07:08.628637] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-10T22:07:09.089396] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-10T22:07:09.889403] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-10T22:07:10.236795] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T22:07:10.689431] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-10T22:07:10.960349] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T22:07:11.489374] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-10T22:07:11.978059] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-10T22:07:12.078551] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-10T22:07:12.289400] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-10T22:07:13.089426] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-10T22:07:13.263259] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-10T22:07:13.755067] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-10T22:07:13.889406] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-10T22:07:14.426434] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T22:07:14.430419] [INFO ] [REMOTE ] UIS: Full fetch complete (51926 records). [2025-10-10T22:07:14.430532] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-10T22:07:14.694628] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-10T22:07:14.821083] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-10T22:07:14.821172] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-10T22:07:14.822201] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-10T22:07:14.822309] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-10T22:07:14.823483] [DEBUG] [LOCAL ] UIS: Trimmed 51926 records to 37519 (keeping 200 days of data) [2025-10-10T22:07:15.042426] [DEBUG] [LOCAL ] UIS: Primary data saved (37519 records). [2025-10-10T22:07:15.042567] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-10T22:07:15.042672] [INFO ] [MAIN ] Update Progress: 2183/2373 symbols completed. UIS took 38.9s. Estimated remaining: 26m 44s. Rate: 7.1 symbols/min [2025-10-10T22:07:15.205956] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:07:15.239437] [DEBUG] [LOCAL ] UMH: Loaded 34107 existing records from primary storage. [2025-10-10T22:07:15.239748] [INFO ] [MAIN ] UMH: Loaded 34107 existing records. [2025-10-10T22:07:15.424172] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:07:15.424426] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-10T22:07:15.424477] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-10T22:07:15.424851] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-10T22:07:15.424911] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-10T22:07:15.497009] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-10T22:07:15.775722] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:07:15.981301] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-10T22:07:16.088058] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T22:07:16.289428] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-10T22:07:17.089394] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-10-10T22:07:17.154485] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T22:07:17.889368] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-10T22:07:18.264896] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T22:07:18.507092] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T22:07:18.689379] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-10T22:07:19.489406] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-10T22:07:19.907493] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T22:07:19.998772] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T22:07:20.289396] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-10T22:07:21.089367] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-10T22:07:21.390627] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T22:07:21.483684] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-10T22:07:21.889404] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-10T22:07:22.689432] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-10T22:07:23.089349] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-10T22:07:23.489381] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-10T22:07:23.877551] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T22:07:24.289413] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-10T22:07:24.433086] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T22:07:25.089400] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-10T22:07:25.544569] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-10T22:07:25.589470] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-10T22:07:25.889408] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-10T22:07:26.245030] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-10T22:07:26.689423] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-10T22:07:27.479019] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-10T22:07:27.489330] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-10T22:07:27.941850] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-10T22:07:27.945522] [INFO ] [REMOTE ] ULS: Full fetch complete (53973 records). [2025-10-10T22:07:27.945688] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-10T22:07:28.299571] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-10T22:07:28.337905] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-10T22:07:28.338013] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-10T22:07:28.339283] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-10T22:07:28.339349] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-10T22:07:28.340904] [DEBUG] [LOCAL ] ULS: Trimmed 53973 records to 39884 (keeping 200 days of data) [2025-10-10T22:07:28.590036] [DEBUG] [LOCAL ] ULS: Primary data saved (39884 records). [2025-10-10T22:07:28.590181] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-10T22:07:28.590265] [INFO ] [MAIN ] Update Progress: 2184/2373 symbols completed. ULS took 29.8s. Estimated remaining: 26m 36s. Rate: 7.1 symbols/min [2025-10-10T22:07:28.762477] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:07:28.777428] [DEBUG] [LOCAL ] UNF: Loaded 12201 existing records from primary storage. [2025-10-10T22:07:28.777811] [INFO ] [MAIN ] UNF: Loaded 12201 existing records. [2025-10-10T22:07:28.952836] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:07:28.953141] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-10T22:07:28.953218] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-10T22:07:28.953447] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-10T22:07:28.953609] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-10T22:07:29.091707] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-10T22:07:29.122195] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-10T22:07:29.341139] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:07:29.826154] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-10T22:07:29.832034] [INFO ] [REMOTE ] UL: Full fetch complete (76893 records). [2025-10-10T22:07:29.832313] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-10T22:07:29.895362] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-10T22:07:30.221349] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-10T22:07:30.221454] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-10T22:07:30.223189] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-10T22:07:30.223268] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-10T22:07:30.226232] [DEBUG] [LOCAL ] UL: Trimmed 76893 records to 53848 (keeping 200 days of data) [2025-10-10T22:07:30.583395] [DEBUG] [LOCAL ] UL: Primary data saved (53848 records). [2025-10-10T22:07:30.583584] [INFO ] [MAIN ] UL: Full history saved. [2025-10-10T22:07:30.583716] [INFO ] [MAIN ] Update Progress: 2185/2373 symbols completed. UL took 39.3s. Estimated remaining: 26m 27s. Rate: 7.1 symbols/min [2025-10-10T22:07:30.694564] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-10-10T22:07:30.761378] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:07:30.807441] [DEBUG] [LOCAL ] UNFI: Loaded 42684 existing records from primary storage. [2025-10-10T22:07:30.807957] [INFO ] [MAIN ] UNFI: Loaded 42684 existing records. [2025-10-10T22:07:31.005838] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:07:31.006983] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-10T22:07:31.007294] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-10T22:07:31.007628] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-10T22:07:31.007732] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-10T22:07:31.449276] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:07:31.452357] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-10T22:07:31.489345] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-10T22:07:31.571812] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T22:07:31.699371] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-10T22:07:32.289396] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-10T22:07:33.089445] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-10-10T22:07:33.477004] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-10T22:07:33.494422] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-10T22:07:33.889426] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-10T22:07:34.689417] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-10T22:07:34.836174] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-10T22:07:35.489479] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-10T22:07:36.028943] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-10T22:07:36.094998] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-10T22:07:36.289403] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-10T22:07:37.089418] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-10T22:07:37.144222] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T22:07:37.567886] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-10T22:07:37.889497] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-10T22:07:38.689385] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-10T22:07:38.806351] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-10T22:07:38.812030] [INFO ] [REMOTE ] UMC: Full fetch complete (76531 records). [2025-10-10T22:07:38.812211] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-10T22:07:39.209132] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-10T22:07:39.209238] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-10T22:07:39.210892] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-10T22:07:39.210962] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-10T22:07:39.212872] [DEBUG] [LOCAL ] UMC: Trimmed 76531 records to 53453 (keeping 200 days of data) [2025-10-10T22:07:39.472538] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-10T22:07:39.492491] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-10T22:07:39.491540] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-10T22:07:39.584500] [DEBUG] [LOCAL ] UMC: Primary data saved (53453 records). [2025-10-10T22:07:39.584686] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-10T22:07:39.584963] [INFO ] [MAIN ] Update Progress: 2186/2373 symbols completed. UMC took 38.5s. Estimated remaining: 26m 19s. Rate: 7.1 symbols/min [2025-10-10T22:07:39.751874] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:07:39.803702] [DEBUG] [LOCAL ] UNH: Loaded 54193 existing records from primary storage. [2025-10-10T22:07:39.804048] [INFO ] [MAIN ] UNH: Loaded 54193 existing records. [2025-10-10T22:07:39.987631] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:07:39.987890] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-10T22:07:39.987940] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-10T22:07:39.988178] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-10T22:07:39.988272] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-10T22:07:40.294597] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-10T22:07:40.351259] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:07:41.089352] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-10T22:07:41.220219] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T22:07:41.865867] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-10T22:07:41.889373] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-10T22:07:42.126793] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-10T22:07:42.689472] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-10-10T22:07:43.489401] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-10T22:07:43.712353] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T22:07:44.289433] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-10T22:07:44.922357] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T22:07:44.926180] [INFO ] [REMOTE ] UMH: Full fetch complete (46736 records). [2025-10-10T22:07:44.926284] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-10T22:07:45.106837] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-10T22:07:45.316974] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-10T22:07:45.317119] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-10T22:07:45.318172] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-10T22:07:45.318246] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-10T22:07:45.330878] [DEBUG] [LOCAL ] UMH: Trimmed 46736 records to 34385 (keeping 200 days of data) [2025-10-10T22:07:45.351660] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-10T22:07:45.594630] [DEBUG] [LOCAL ] UMH: Primary data saved (34385 records). [2025-10-10T22:07:45.594780] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-10T22:07:45.594910] [INFO ] [MAIN ] Update Progress: 2187/2373 symbols completed. UMH took 30.6s. Estimated remaining: 26m 10s. Rate: 7.1 symbols/min [2025-10-10T22:07:45.779013] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:07:45.827848] [DEBUG] [LOCAL ] UNM: Loaded 48566 existing records from primary storage. [2025-10-10T22:07:45.828271] [INFO ] [MAIN ] UNM: Loaded 48566 existing records. [2025-10-10T22:07:45.897989] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-10T22:07:46.015124] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:07:46.015366] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-10T22:07:46.015416] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-10T22:07:46.015740] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-10T22:07:46.015844] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-10T22:07:46.196621] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-10T22:07:46.424631] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:07:46.466068] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-10T22:07:46.689396] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-10T22:07:47.489468] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-10T22:07:47.693366] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-10T22:07:48.289365] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-10T22:07:48.392841] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-10T22:07:48.502637] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-10T22:07:48.875438] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-10T22:07:49.089374] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-10-10T22:07:49.889388] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-10T22:07:50.512194] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-10T22:07:50.689389] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-10T22:07:51.489391] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-10T22:07:52.223478] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-10T22:07:52.289373] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-10T22:07:52.460829] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T22:07:52.535367] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-10T22:07:53.089403] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-10T22:07:53.889398] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-10T22:07:54.439853] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-10T22:07:54.689367] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-10T22:07:55.061791] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-10T22:07:55.489437] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-10T22:07:55.760045] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T22:07:56.289410] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-10T22:07:56.984929] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-10T22:07:57.089388] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-10T22:07:57.600095] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-10-10T22:07:57.889382] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-10T22:07:58.220587] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T22:07:58.689468] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-10T22:07:59.084604] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-10T22:07:59.489366] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-10T22:07:59.732161] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-10T22:08:00.289413] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-10T22:08:00.915814] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-10-10T22:08:01.028879] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-10T22:08:01.089352] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-10T22:08:01.889404] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-10T22:08:02.108839] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T22:08:02.479368] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-10T22:08:02.689372] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-10T22:08:02.912226] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T22:08:03.489397] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-10T22:08:03.711482] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T22:08:03.716296] [INFO ] [REMOTE ] UNFI: Full fetch complete (59461 records). [2025-10-10T22:08:03.716408] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-10T22:08:04.103355] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-10T22:08:04.103439] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-10T22:08:04.104478] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-10T22:08:04.104546] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-10T22:08:04.106218] [DEBUG] [LOCAL ] UNFI: Trimmed 59461 records to 42999 (keeping 200 days of data) [2025-10-10T22:08:04.313118] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-10T22:08:04.365977] [DEBUG] [LOCAL ] UNFI: Primary data saved (42999 records). [2025-10-10T22:08:04.366107] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-10T22:08:04.366204] [INFO ] [MAIN ] Update Progress: 2188/2373 symbols completed. UNFI took 33.8s. Estimated remaining: 26m 3s. Rate: 7.1 symbols/min [2025-10-10T22:08:04.532285] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:08:04.538536] [DEBUG] [LOCAL ] UNMA: Loaded 3567 existing records from primary storage. [2025-10-10T22:08:04.538744] [INFO ] [MAIN ] UNMA: Loaded 3567 existing records. [2025-10-10T22:08:04.734376] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:08:04.734592] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-10T22:08:04.734688] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-10T22:08:04.734853] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-10T22:08:04.734910] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-10T22:08:05.100276] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-10T22:08:05.100176] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:08:05.634848] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T22:08:05.719301] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-10T22:08:05.889385] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-10T22:08:06.689469] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-10-10T22:08:06.719500] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T22:08:06.721210] [INFO ] [REMOTE ] UNF: Full fetch complete (17306 records). [2025-10-10T22:08:06.721356] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-10T22:08:07.095698] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-10T22:08:07.095848] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-10T22:08:07.096455] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-10T22:08:07.096542] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-10T22:08:07.097577] [DEBUG] [LOCAL ] UNF: Trimmed 17306 records to 12272 (keeping 200 days of data) [2025-10-10T22:08:07.184418] [DEBUG] [LOCAL ] UNF: Primary data saved (12272 records). [2025-10-10T22:08:07.184700] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-10T22:08:07.185007] [INFO ] [MAIN ] Update Progress: 2189/2373 symbols completed. UNF took 38.6s. Estimated remaining: 25m 54s. Rate: 7.1 symbols/min [2025-10-10T22:08:07.301017] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-10T22:08:07.391764] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (3.08 seconds). [2025-10-10T22:08:07.422197] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:08:07.483462] [DEBUG] [LOCAL ] UNP: Loaded 53694 existing records from primary storage. [2025-10-10T22:08:07.483901] [INFO ] [MAIN ] UNP: Loaded 53694 existing records. [2025-10-10T22:08:07.495036] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-10T22:08:07.678086] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:08:07.678367] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-10T22:08:07.678432] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-10T22:08:07.678630] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-10T22:08:07.678730] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-10T22:08:08.024622] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:08:08.289415] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-10T22:08:08.860834] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T22:08:09.024162] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-10T22:08:09.089357] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-10-10T22:08:09.889375] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-10T22:08:10.689377] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-10T22:08:11.025582] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T22:08:11.489447] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-10T22:08:12.289366] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-10T22:08:12.415720] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-10T22:08:12.460135] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T22:08:12.807285] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-10T22:08:13.089363] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-10T22:08:13.889353] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-10T22:08:14.375344] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-10T22:08:14.623851] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-10T22:08:14.628633] [INFO ] [REMOTE ] UNM: Full fetch complete (69788 records). [2025-10-10T22:08:14.628782] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-10T22:08:14.701488] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-10T22:08:15.061857] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-10T22:08:15.061946] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-10T22:08:15.063113] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-10T22:08:15.063178] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-10T22:08:15.064484] [DEBUG] [LOCAL ] UNM: Trimmed 69788 records to 48932 (keeping 200 days of data) [2025-10-10T22:08:15.367979] [DEBUG] [LOCAL ] UNM: Primary data saved (48932 records). [2025-10-10T22:08:15.368221] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-10T22:08:15.368352] [INFO ] [MAIN ] Update Progress: 2190/2373 symbols completed. UNM took 29.8s. Estimated remaining: 25m 45s. Rate: 7.1 symbols/min [2025-10-10T22:08:15.492534] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-10T22:08:15.541262] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-10T22:08:15.547035] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:08:15.596223] [DEBUG] [LOCAL ] UP: Loaded 44091 existing records from primary storage. [2025-10-10T22:08:15.596537] [INFO ] [MAIN ] UP: Loaded 44091 existing records. [2025-10-10T22:08:15.767014] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:08:15.767239] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-10T22:08:15.767287] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-10T22:08:15.767504] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-10T22:08:15.767560] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-10T22:08:16.114799] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:08:16.289445] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-10T22:08:16.788586] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-10-10T22:08:16.886829] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-10T22:08:16.917108] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-10T22:08:17.089372] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-10T22:08:17.889399] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-10-10T22:08:18.689437] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-10T22:08:19.367294] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-10T22:08:19.402761] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-10T22:08:19.489353] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-10T22:08:19.615166] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T22:08:20.289367] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-10T22:08:21.089367] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-10T22:08:21.758136] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-10T22:08:21.889355] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-10T22:08:21.984247] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T22:08:22.535249] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (3.05 seconds). [2025-10-10T22:08:22.689419] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-10T22:08:23.489387] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-10T22:08:23.755785] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-10T22:08:24.209284] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-10T22:08:24.289445] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-10T22:08:24.364430] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-10T22:08:24.602263] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-10T22:08:25.089382] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-10T22:08:25.889395] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-10T22:08:26.593747] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-10T22:08:26.689367] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-10T22:08:27.340112] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-10T22:08:27.453772] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T22:08:27.459115] [INFO ] [REMOTE ] UNH: Full fetch complete (77867 records). [2025-10-10T22:08:27.459239] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-10T22:08:27.494566] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-10T22:08:27.878788] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-10T22:08:27.878906] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-10T22:08:27.880476] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-10T22:08:27.880569] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-10T22:08:27.882393] [DEBUG] [LOCAL ] UNH: Trimmed 77867 records to 54583 (keeping 200 days of data) [2025-10-10T22:08:28.133211] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-10T22:08:28.136333] [INFO ] [REMOTE ] UNMA: Full fetch complete (5695 records). [2025-10-10T22:08:28.137576] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-10T22:08:28.289370] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-10T22:08:28.563508] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-10T22:08:28.563974] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-10T22:08:28.564273] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-10T22:08:28.564359] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-10T22:08:28.565381] [DEBUG] [LOCAL ] UNMA: Trimmed 5695 records to 3599 (keeping 200 days of data) [2025-10-10T22:08:28.598893] [DEBUG] [LOCAL ] UNMA: Primary data saved (3599 records). [2025-10-10T22:08:28.599565] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-10T22:08:28.599736] [INFO ] [MAIN ] Update Progress: 2191/2373 symbols completed. UNMA took 24.2s. Estimated remaining: 25m 37s. Rate: 7.1 symbols/min [2025-10-10T22:08:28.848737] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:08:28.924535] [DEBUG] [LOCAL ] UNH: Primary data saved (54583 records). [2025-10-10T22:08:28.924959] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-10T22:08:28.925488] [INFO ] [MAIN ] Update Progress: 2192/2373 symbols completed. UNH took 49.3s. Estimated remaining: 25m 28s. Rate: 7.1 symbols/min [2025-10-10T22:08:29.100239] [DEBUG] [LOCAL ] UPS: Loaded 54107 existing records from primary storage. [2025-10-10T22:08:29.093597] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-10T22:08:29.148274] [INFO ] [MAIN ] UPS: Loaded 54107 existing records. [2025-10-10T22:08:29.176493] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:08:29.341587] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:08:29.341944] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-10T22:08:29.342000] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-10T22:08:29.342270] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-10T22:08:29.342332] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-10T22:08:29.473040] [DEBUG] [LOCAL ] URI: Loaded 35396 existing records from primary storage. [2025-10-10T22:08:29.488689] [INFO ] [MAIN ] URI: Loaded 35396 existing records. [2025-10-10T22:08:29.838177] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:08:29.862633] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-10T22:08:29.862975] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-10T22:08:29.896947] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:08:29.892257] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-10T22:08:29.897233] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-10-10T22:08:29.897322] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-10T22:08:30.260395] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:08:30.297848] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-10T22:08:30.689462] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-10-10T22:08:30.991059] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T22:08:31.489370] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-10T22:08:32.289419] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-10T22:08:32.406005] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-10T22:08:32.514817] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-10T22:08:32.729603] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-10T22:08:33.089382] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-10T22:08:33.889359] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-10T22:08:34.274287] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T22:08:34.363203] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-10T22:08:34.689420] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-10T22:08:35.145316] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-10T22:08:35.489464] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-10T22:08:36.289356] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-10T22:08:36.383281] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T22:08:37.089395] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-10T22:08:37.785530] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-10T22:08:37.889368] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-10T22:08:38.025357] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-10T22:08:38.689349] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-10T22:08:39.085371] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T22:08:39.489350] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-10T22:08:39.816860] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T22:08:40.289401] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-10T22:08:40.566246] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-10T22:08:41.089399] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-10T22:08:41.700679] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-10T22:08:41.817322] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-10T22:08:41.889369] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-10T22:08:42.689395] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-10T22:08:42.743398] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-10T22:08:43.489356] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-10T22:08:43.601886] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T22:08:44.289397] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-10T22:08:44.433397] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T22:08:45.089357] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-10T22:08:45.180500] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-10T22:08:45.889346] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-10T22:08:46.513597] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-10T22:08:46.689426] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-10T22:08:47.350490] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-10T22:08:47.356079] [INFO ] [REMOTE ] UNP: Full fetch complete (76907 records). [2025-10-10T22:08:47.356206] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-10T22:08:47.514780] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-10T22:08:47.579360] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-10T22:08:47.693761] [INFO ] [REMOTE ] UP: Full fetch complete (62738 records). [2025-10-10T22:08:47.713587] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-10T22:08:47.716929] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-10T22:08:47.975816] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-10T22:08:47.992032] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-10T22:08:48.027436] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-10T22:08:48.086276] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-10T22:08:48.142669] [DEBUG] [LOCAL ] UNP: Trimmed 76907 records to 54080 (keeping 200 days of data) [2025-10-10T22:08:48.291028] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-10T22:08:48.291178] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-10T22:08:48.291484] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-10T22:08:48.303237] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-10T22:08:48.331477] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-10T22:08:48.346139] [DEBUG] [LOCAL ] UP: Trimmed 62738 records to 44474 (keeping 200 days of data) [2025-10-10T22:08:48.842176] [DEBUG] [LOCAL ] UNP: Primary data saved (54080 records). [2025-10-10T22:08:48.851149] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-10T22:08:48.852420] [INFO ] [MAIN ] Update Progress: 2193/2373 symbols completed. UNP took 41.7s. Estimated remaining: 25m 21s. Rate: 7.1 symbols/min [2025-10-10T22:08:49.017240] [DEBUG] [LOCAL ] UP: Primary data saved (44474 records). [2025-10-10T22:08:49.018935] [INFO ] [MAIN ] UP: Full history saved. [2025-10-10T22:08:49.033125] [INFO ] [MAIN ] Update Progress: 2194/2373 symbols completed. UP took 33.7s. Estimated remaining: 25m 11s. Rate: 7.1 symbols/min [2025-10-10T22:08:49.035289] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:08:49.209889] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:08:49.240765] [DEBUG] [LOCAL ] USA: Loaded 36317 existing records from primary storage. [2025-10-10T22:08:49.241079] [INFO ] [MAIN ] USA: Loaded 36317 existing records. [2025-10-10T22:08:49.328818] [DEBUG] [LOCAL ] USAC: Loaded 21710 existing records from primary storage. [2025-10-10T22:08:49.356485] [INFO ] [MAIN ] USAC: Loaded 21710 existing records. [2025-10-10T22:08:49.392503] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T22:08:49.567816] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:08:49.580969] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-10T22:08:49.581836] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-10T22:08:49.599548] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-10T22:08:49.638623] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-10T22:08:49.673670] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:08:49.673868] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-10T22:08:49.673947] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-10T22:08:49.669692] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-10T22:08:49.705266] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-10T22:08:49.746783] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-10T22:08:50.398483] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:08:50.404042] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-10-10T22:08:50.473636] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:08:50.689401] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-10-10T22:08:50.761792] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-10T22:08:51.398269] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-10T22:08:51.489332] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-10T22:08:52.025569] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T22:08:52.050926] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-10T22:08:52.289367] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-10T22:08:53.089434] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-10T22:08:53.156396] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-10T22:08:53.262331] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T22:08:53.889383] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-10T22:08:54.689355] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-10T22:08:54.783450] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T22:08:54.982670] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-10T22:08:55.489363] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-10T22:08:56.289402] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-10T22:08:56.915725] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-10T22:08:57.000501] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-10T22:08:57.089362] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-10T22:08:57.744841] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T22:08:57.889400] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-10T22:08:58.689430] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-10T22:08:58.717027] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-10T22:08:59.326176] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-10T22:08:59.329615] [INFO ] [REMOTE ] URI: Full fetch complete (52864 records). [2025-10-10T22:08:59.329830] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-10T22:08:59.502542] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-10T22:08:59.789945] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-10T22:08:59.790145] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-10T22:08:59.791299] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-10T22:08:59.791363] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-10T22:08:59.792489] [DEBUG] [LOCAL ] URI: Trimmed 52864 records to 35626 (keeping 200 days of data) [2025-10-10T22:09:00.029769] [DEBUG] [LOCAL ] URI: Primary data saved (35626 records). [2025-10-10T22:09:00.029932] [INFO ] [MAIN ] URI: Full history saved. [2025-10-10T22:09:00.030030] [INFO ] [MAIN ] Update Progress: 2195/2373 symbols completed. URI took 31.1s. Estimated remaining: 25m 3s. Rate: 7.1 symbols/min [2025-10-10T22:09:00.210405] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:09:00.262812] [DEBUG] [LOCAL ] USB: Loaded 54078 existing records from primary storage. [2025-10-10T22:09:00.263168] [INFO ] [MAIN ] USB: Loaded 54078 existing records. [2025-10-10T22:09:00.294552] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-10T22:09:00.430221] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-10T22:09:00.493876] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:09:00.494561] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-10T22:09:00.494628] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-10T22:09:00.494901] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-10T22:09:00.494961] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-10T22:09:00.854126] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:09:00.876680] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T22:09:01.089359] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-10T22:09:01.487001] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-10T22:09:01.889467] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-10T22:09:02.694616] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-10-10T22:09:02.708828] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-10T22:09:03.173593] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-10T22:09:03.489383] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-10T22:09:03.628805] [DEBUG] [REMOTE ] UPS: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-10T22:09:03.629253] [WARN ] [REMOTE ] UPS: No data returned for month 2025-08 [2025-10-10T22:09:03.629354] [FATAL] [REMOTE ] UPS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T22:09:03.629457] [FATAL] [MAIN ] UPS: Failed to fetch primary data. [2025-10-10T22:09:03.629524] [WARN ] [MAIN ] UPS: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T22:09:03.629600] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-10T22:09:03.629698] [DEBUG] [LOCAL ] UPS: No primary data file found to delete. [2025-10-10T22:09:03.629757] [INFO ] [LOCAL ] UPS: Starting deletion of derivative data. [2025-10-10T22:09:03.630920] [DEBUG] [LOCAL ] UPS: Deleted derivative data file. [2025-10-10T22:09:03.631204] [INFO ] [MAIN ] Update Progress: 2196/2373 symbols completed. UPS took 35.0s. Estimated remaining: 24m 54s. Rate: 7.1 symbols/min [2025-10-10T22:09:03.804080] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:09:03.855782] [DEBUG] [LOCAL ] USFD: Loaded 51527 existing records from primary storage. [2025-10-10T22:09:03.856124] [INFO ] [MAIN ] USFD: Loaded 51527 existing records. [2025-10-10T22:09:04.034320] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:09:04.034562] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-10T22:09:04.034612] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-10T22:09:04.035248] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-10T22:09:04.035305] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-10T22:09:04.292006] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-10T22:09:04.402565] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:09:04.851719] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-10T22:09:05.089402] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-10T22:09:05.866219] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T22:09:05.889354] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-10T22:09:06.689349] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-10T22:09:06.854740] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T22:09:07.489394] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-10T22:09:07.681162] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T22:09:08.119884] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-10T22:09:08.289387] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-10T22:09:09.089398] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-10T22:09:09.505598] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T22:09:09.549970] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-10T22:09:09.889400] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-10-10T22:09:10.332113] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T22:09:10.689439] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-10T22:09:11.272197] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T22:09:11.489381] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-10T22:09:12.289382] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-10T22:09:12.401001] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T22:09:13.089390] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-10T22:09:13.271851] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T22:09:13.328159] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-10T22:09:13.889402] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-10T22:09:14.521524] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-10T22:09:14.525792] [INFO ] [REMOTE ] USA: Full fetch complete (52040 records). [2025-10-10T22:09:14.525917] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-10T22:09:14.701218] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-10T22:09:14.927633] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-10T22:09:14.927779] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-10T22:09:14.929317] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-10T22:09:14.929385] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-10T22:09:14.931077] [DEBUG] [LOCAL ] USA: Trimmed 52040 records to 36662 (keeping 200 days of data) [2025-10-10T22:09:15.147422] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-10T22:09:15.184878] [DEBUG] [LOCAL ] USA: Primary data saved (36662 records). [2025-10-10T22:09:15.185079] [INFO ] [MAIN ] USA: Full history saved. [2025-10-10T22:09:15.185188] [INFO ] [MAIN ] Update Progress: 2197/2373 symbols completed. USA took 26.3s. Estimated remaining: 24m 46s. Rate: 7.1 symbols/min [2025-10-10T22:09:15.489411] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-10T22:09:16.289350] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-10T22:09:16.917298] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-10T22:09:17.055710] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-10T22:09:17.089339] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-10T22:09:17.889416] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-10T22:09:18.125878] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-10T22:09:18.690229] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-10T22:09:18.704900] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-10T22:09:18.716924] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T22:09:18.720844] [INFO ] [REMOTE ] USAC: Full fetch complete (35135 records). [2025-10-10T22:09:18.721099] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-10T22:09:19.115112] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-10T22:09:19.115228] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-10T22:09:19.116604] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-10T22:09:19.116694] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-10T22:09:19.117731] [DEBUG] [LOCAL ] USAC: Trimmed 35135 records to 21905 (keeping 200 days of data) [2025-10-10T22:09:19.255206] [DEBUG] [LOCAL ] USAC: Primary data saved (21905 records). [2025-10-10T22:09:19.255378] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-10T22:09:19.255475] [INFO ] [MAIN ] Update Progress: 2198/2373 symbols completed. USAC took 30.2s. Estimated remaining: 24m 37s. Rate: 7.1 symbols/min [2025-10-10T22:09:19.489376] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-10T22:09:20.500970] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T22:09:20.512603] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-10T22:09:21.533770] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T22:09:21.545990] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-10T22:09:21.879534] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-10T22:09:21.891372] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-10T22:09:23.214104] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-10T22:09:23.227147] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-10T22:09:23.436178] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-10T22:09:23.489379] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-10T22:09:25.296693] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-10T22:09:25.310126] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-10T22:09:25.644953] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T22:09:25.657060] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-10T22:09:27.253263] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T22:09:27.266091] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-10T22:09:27.545045] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T22:09:27.557353] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-10T22:09:27.637001] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-10T22:09:27.642793] [INFO ] [REMOTE ] USB: Full fetch complete (77710 records). [2025-10-10T22:09:27.643014] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-10T22:09:28.050430] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-10T22:09:28.050534] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-10T22:09:28.051945] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-10T22:09:28.052013] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-10T22:09:28.054006] [DEBUG] [LOCAL ] USB: Trimmed 77710 records to 54468 (keeping 200 days of data) [2025-10-10T22:09:28.425349] [DEBUG] [LOCAL ] USB: Primary data saved (54468 records). [2025-10-10T22:09:28.425552] [INFO ] [MAIN ] USB: Full history saved. [2025-10-10T22:09:28.425890] [INFO ] [MAIN ] Update Progress: 2199/2373 symbols completed. USB took 28.4s. Estimated remaining: 24m 29s. Rate: 7.1 symbols/min [2025-10-10T22:09:29.487355] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-10T22:09:29.499496] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-10T22:09:31.536818] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-10T22:09:31.548426] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-10T22:09:32.983007] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-10T22:09:32.995394] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-10T22:09:34.602154] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-10T22:09:34.607381] [INFO ] [REMOTE ] USFD: Full fetch complete (73988 records). [2025-10-10T22:09:34.607547] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-10T22:09:34.997904] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-10T22:09:34.997999] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-10T22:09:34.999278] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-10T22:09:34.999348] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-10T22:09:35.002470] [DEBUG] [LOCAL ] USFD: Trimmed 73988 records to 51896 (keeping 200 days of data) [2025-10-10T22:09:35.335516] [DEBUG] [LOCAL ] USFD: Primary data saved (51896 records). [2025-10-10T22:09:35.335685] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-10T22:09:35.335788] [INFO ] [MAIN ] Update Progress: 2200/2373 symbols completed. USFD took 31.7s. Estimated remaining: 24m 20s. Rate: 7.1 symbols/min [2025-10-10T22:09:35.910051] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:09:36.011607] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:09:36.017901] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:09:36.044488] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:09:36.061392] [DEBUG] [LOCAL ] USNA: Loaded 17770 existing records from primary storage. [2025-10-10T22:09:36.061781] [INFO ] [MAIN ] USNA: Loaded 17770 existing records. [2025-10-10T22:09:36.192999] [DEBUG] [LOCAL ] USPH: Loaded 17114 existing records from primary storage. [2025-10-10T22:09:36.199455] [INFO ] [MAIN ] USPH: Loaded 17114 existing records. [2025-10-10T22:09:36.256614] [DEBUG] [LOCAL ] UTF: Loaded 30516 existing records from primary storage. [2025-10-10T22:09:36.347189] [INFO ] [MAIN ] UTF: Loaded 30516 existing records. [2025-10-10T22:09:36.361828] [DEBUG] [LOCAL ] UTI: Loaded 40842 existing records from primary storage. [2025-10-10T22:09:36.370381] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:09:36.412036] [INFO ] [MAIN ] UTI: Loaded 40842 existing records. [2025-10-10T22:09:36.412296] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-10T22:09:36.450243] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-10T22:09:36.548883] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-10T22:09:36.549069] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-10T22:09:36.880380] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:09:36.920991] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-10T22:09:36.921164] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-10T22:09:36.920856] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:09:36.986384] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-10T22:09:37.009301] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-10T22:09:37.015300] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-10T22:09:37.004051] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:09:37.038251] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-10T22:09:37.081773] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-10T22:09:37.150964] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-10T22:09:37.169151] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-10T22:09:37.142023] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-10T22:09:37.265408] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-10T22:09:37.278580] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-10T22:09:37.726449] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:09:37.841055] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-10-10T22:09:38.290771] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:09:38.320467] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-10-10T22:09:38.446375] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:09:38.463548] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-10-10T22:09:38.470863] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:09:38.471327] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-10-10T22:09:39.150846] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-10T22:09:39.154892] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-10T22:09:39.538382] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T22:09:39.542818] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-10T22:09:39.591566] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T22:09:39.599852] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-10T22:09:39.657928] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T22:09:39.664836] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-10T22:09:39.813921] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-10T22:09:39.818344] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-10T22:09:40.509610] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-10T22:09:40.516150] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-10T22:09:40.623823] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-10T22:09:40.627128] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-10T22:09:41.020746] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-10T22:09:41.026582] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-10T22:09:41.288995] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-10T22:09:41.297311] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-10T22:09:41.593426] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T22:09:41.596414] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-10T22:09:41.777288] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-10T22:09:41.783466] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-10T22:09:41.901500] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-10T22:09:41.907565] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-10T22:09:42.241517] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-10T22:09:42.689460] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-10T22:09:42.803775] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-10T22:09:43.171387] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T22:09:43.477860] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T22:09:43.494072] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-10T22:09:43.928202] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-10T22:09:44.289351] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-10T22:09:44.723210] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-10T22:09:45.089420] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-10T22:09:45.328045] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-10T22:09:45.889393] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-10T22:09:46.225340] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T22:09:46.689379] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-10T22:09:47.436524] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-10T22:09:47.489378] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-10T22:09:47.840408] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-10T22:09:48.289403] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-10T22:09:49.035808] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-10T22:09:49.089366] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-10T22:09:49.204380] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-10T22:09:49.889358] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-10T22:09:50.521532] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-10T22:09:50.631311] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-10T22:09:50.689345] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-10T22:09:51.489350] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-10T22:09:51.830287] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-10T22:09:52.289413] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-10T22:09:52.853619] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-10T22:09:53.089372] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-10T22:09:53.889339] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-10T22:09:54.115734] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T22:09:54.550128] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-10T22:09:54.689374] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-10T22:09:55.004461] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-10T22:09:55.489361] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-10T22:09:56.289350] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-10T22:09:56.474251] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-10T22:09:56.703676] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-10T22:09:57.089056] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-10T22:09:57.092962] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-10T22:09:57.889403] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-10T22:09:58.548359] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-10T22:09:58.550711] [INFO ] [REMOTE ] USNA: Full fetch complete (26672 records). [2025-10-10T22:09:58.550793] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-10T22:09:58.691095] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-10T22:09:58.899263] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-10T22:09:58.986606] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-10T22:09:58.986717] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-10T22:09:58.987481] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-10T22:09:58.987543] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-10T22:09:58.988231] [DEBUG] [LOCAL ] USNA: Trimmed 26672 records to 18076 (keeping 200 days of data) [2025-10-10T22:09:59.093729] [DEBUG] [LOCAL ] USNA: Primary data saved (18076 records). [2025-10-10T22:09:59.093890] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-10T22:09:59.093979] [INFO ] [MAIN ] Update Progress: 2201/2373 symbols completed. USNA took 23.8s. Estimated remaining: 24m 13s. Rate: 7.1 symbols/min [2025-10-10T22:09:59.257409] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:09:59.270838] [DEBUG] [LOCAL ] UTL: Loaded 11697 existing records from primary storage. [2025-10-10T22:09:59.271134] [INFO ] [MAIN ] UTL: Loaded 11697 existing records. [2025-10-10T22:09:59.444994] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:09:59.445210] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-10T22:09:59.445257] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-10T22:09:59.445439] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-10T22:09:59.445496] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-10T22:09:59.498465] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-10T22:09:59.801853] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:09:59.847708] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-10T22:09:59.850106] [INFO ] [REMOTE ] USPH: Full fetch complete (22927 records). [2025-10-10T22:09:59.850181] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-10T22:10:00.216381] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-10T22:10:00.216473] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-10T22:10:00.217120] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-10T22:10:00.217182] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-10T22:10:00.217788] [DEBUG] [LOCAL ] USPH: Trimmed 22927 records to 17233 (keeping 200 days of data) [2025-10-10T22:10:00.295189] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-10-10T22:10:00.328478] [DEBUG] [LOCAL ] USPH: Primary data saved (17233 records). [2025-10-10T22:10:00.328572] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-10T22:10:00.328720] [INFO ] [MAIN ] Update Progress: 2202/2373 symbols completed. USPH took 25.0s. Estimated remaining: 24m 4s. Rate: 7.1 symbols/min [2025-10-10T22:10:00.494109] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:10:00.537144] [DEBUG] [LOCAL ] UTZ: Loaded 44883 existing records from primary storage. [2025-10-10T22:10:00.537577] [INFO ] [MAIN ] UTZ: Loaded 44883 existing records. [2025-10-10T22:10:00.715093] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:10:00.715537] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-10T22:10:00.715592] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-10T22:10:00.715839] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-10T22:10:00.715895] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-10T22:10:01.088263] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T22:10:01.113622] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-10T22:10:01.122967] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:10:01.278304] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-10T22:10:01.889403] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-10T22:10:02.042292] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T22:10:02.689428] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-10T22:10:02.844576] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-10T22:10:03.489398] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-10T22:10:04.289455] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-10T22:10:04.482173] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-10T22:10:05.089399] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-10-10T22:10:05.233608] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-10T22:10:05.357025] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-10T22:10:05.889428] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-10T22:10:06.689430] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-10T22:10:07.030001] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-10T22:10:07.489360] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-10T22:10:07.521356] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-10T22:10:07.567150] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-10T22:10:08.289402] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-10T22:10:08.871881] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-10T22:10:09.089347] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-10T22:10:09.343903] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-10T22:10:09.889436] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-10T22:10:10.538016] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T22:10:10.542085] [INFO ] [REMOTE ] UTI: Full fetch complete (58433 records). [2025-10-10T22:10:10.542174] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-10T22:10:10.714180] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-10T22:10:10.926502] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-10T22:10:10.926737] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-10T22:10:10.928150] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-10T22:10:10.928313] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-10T22:10:10.940750] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T22:10:10.945087] [DEBUG] [LOCAL ] UTI: Trimmed 58433 records to 41054 (keeping 200 days of data) [2025-10-10T22:10:10.945884] [INFO ] [REMOTE ] UTF: Full fetch complete (42850 records). [2025-10-10T22:10:10.946173] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-10T22:10:11.445872] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-10T22:10:11.446827] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-10T22:10:11.447821] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-10T22:10:11.447900] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-10T22:10:11.453192] [DEBUG] [LOCAL ] UTF: Trimmed 42850 records to 30866 (keeping 200 days of data) [2025-10-10T22:10:11.509544] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-10T22:10:11.761135] [DEBUG] [LOCAL ] UTI: Primary data saved (41054 records). [2025-10-10T22:10:11.762010] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-10T22:10:11.762879] [INFO ] [MAIN ] Update Progress: 2203/2373 symbols completed. UTI took 36.4s. Estimated remaining: 23m 56s. Rate: 7.1 symbols/min [2025-10-10T22:10:11.877316] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-10T22:10:11.947993] [DEBUG] [LOCAL ] UTF: Primary data saved (30866 records). [2025-10-10T22:10:11.962782] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-10T22:10:11.963703] [INFO ] [MAIN ] Update Progress: 2204/2373 symbols completed. UTF took 36.6s. Estimated remaining: 23m 47s. Rate: 7.1 symbols/min [2025-10-10T22:10:11.970696] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:10:12.149260] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:10:12.157523] [DEBUG] [LOCAL ] UVE: Loaded 22004 existing records from primary storage. [2025-10-10T22:10:12.157846] [INFO ] [MAIN ] UVE: Loaded 22004 existing records. [2025-10-10T22:10:12.291623] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-10T22:10:12.346095] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:10:12.346826] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-10T22:10:12.347056] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-10T22:10:12.354544] [DEBUG] [LOCAL ] UVV: Loaded 22860 existing records from primary storage. [2025-10-10T22:10:12.354585] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-10T22:10:12.354862] [INFO ] [MAIN ] UVV: Loaded 22860 existing records. [2025-10-10T22:10:12.354918] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-10T22:10:12.793355] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:10:12.808869] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-10T22:10:12.821376] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-10T22:10:12.840432] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-10T22:10:12.844173] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-10T22:10:13.068325] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:10:13.130052] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-10-10T22:10:13.275820] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T22:10:13.366166] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:10:13.387414] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-10T22:10:13.889401] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-10T22:10:14.354229] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T22:10:14.689409] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-10T22:10:15.212506] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T22:10:15.489380] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-10T22:10:15.971016] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-10T22:10:16.289431] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-10T22:10:16.881584] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-10T22:10:17.089430] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-10-10T22:10:17.237582] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-10T22:10:17.889399] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-10T22:10:17.925065] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-10T22:10:18.689403] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-10T22:10:19.489378] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-10T22:10:19.801578] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T22:10:19.939192] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T22:10:20.289477] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-10T22:10:20.659985] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T22:10:21.089456] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-10T22:10:21.889370] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-10T22:10:22.017488] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-10T22:10:22.282018] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T22:10:22.689375] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-10T22:10:23.120464] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-10T22:10:23.489394] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-10T22:10:23.938028] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T22:10:24.289441] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-10T22:10:25.089363] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-10T22:10:25.631717] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-10T22:10:25.688778] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-10T22:10:25.889379] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-10T22:10:26.024216] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-10T22:10:26.026359] [INFO ] [REMOTE ] UTL: Full fetch complete (15638 records). [2025-10-10T22:10:26.026432] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-10T22:10:26.379015] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-10T22:10:26.379088] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-10T22:10:26.379510] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-10T22:10:26.379548] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-10T22:10:26.380091] [DEBUG] [LOCAL ] UTL: Trimmed 15638 records to 11823 (keeping 200 days of data) [2025-10-10T22:10:26.451638] [DEBUG] [LOCAL ] UTL: Primary data saved (11823 records). [2025-10-10T22:10:26.451798] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-10T22:10:26.451883] [INFO ] [MAIN ] Update Progress: 2205/2373 symbols completed. UTL took 27.4s. Estimated remaining: 23m 39s. Rate: 7.1 symbols/min [2025-10-10T22:10:26.617512] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:10:26.665084] [DEBUG] [LOCAL ] UWMC: Loaded 53243 existing records from primary storage. [2025-10-10T22:10:26.665395] [INFO ] [MAIN ] UWMC: Loaded 53243 existing records. [2025-10-10T22:10:26.694771] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-10T22:10:26.860330] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:10:26.856531] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T22:10:26.860625] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-10T22:10:26.864212] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-10T22:10:26.864428] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-10T22:10:26.864468] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-10T22:10:27.211710] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:10:27.489421] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-10-10T22:10:28.289378] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-10T22:10:28.437492] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T22:10:29.089417] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-10T22:10:29.415288] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T22:10:29.630255] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-10T22:10:29.889439] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-10T22:10:30.679628] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-10T22:10:30.689358] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-10T22:10:30.916973] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-10T22:10:31.489390] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-10T22:10:32.289386] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-10T22:10:32.588828] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T22:10:32.910619] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-10T22:10:33.089383] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-10T22:10:33.174117] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T22:10:33.178739] [INFO ] [REMOTE ] UTZ: Full fetch complete (64463 records). [2025-10-10T22:10:33.178936] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-10T22:10:33.604035] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-10T22:10:33.604174] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-10T22:10:33.605883] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-10T22:10:33.605957] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-10T22:10:33.608126] [DEBUG] [LOCAL ] UTZ: Trimmed 64463 records to 45169 (keeping 200 days of data) [2025-10-10T22:10:33.893994] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-10T22:10:33.928568] [DEBUG] [LOCAL ] UTZ: Primary data saved (45169 records). [2025-10-10T22:10:33.928813] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-10T22:10:33.928946] [INFO ] [MAIN ] Update Progress: 2206/2373 symbols completed. UTZ took 33.6s. Estimated remaining: 23m 30s. Rate: 7.1 symbols/min [2025-10-10T22:10:34.119752] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:10:34.129362] [DEBUG] [LOCAL ] UZD: Loaded 6439 existing records from primary storage. [2025-10-10T22:10:34.129586] [INFO ] [MAIN ] UZD: Loaded 6439 existing records. [2025-10-10T22:10:34.304321] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:10:34.304662] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-10T22:10:34.304727] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-10T22:10:34.304923] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-10T22:10:34.304981] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-10T22:10:34.575212] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-10T22:10:34.681159] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:10:34.689326] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-10-10T22:10:34.734414] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-10T22:10:35.489476] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-10T22:10:35.569978] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-10T22:10:36.289422] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-10T22:10:37.089392] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-10T22:10:37.334331] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T22:10:37.440908] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-10T22:10:37.889370] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-10T22:10:38.382134] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-10T22:10:38.689415] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-10T22:10:39.489423] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-10T22:10:39.884674] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T22:10:39.925585] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T22:10:39.988259] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-10T22:10:40.289413] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-10T22:10:41.089411] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-10T22:10:41.816289] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-10T22:10:41.889416] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-10T22:10:42.274373] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T22:10:42.689397] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-10T22:10:42.746871] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-10T22:10:43.489414] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-10T22:10:43.965609] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-10T22:10:44.289382] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-10T22:10:44.363919] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T22:10:45.089405] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-10T22:10:45.312617] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-10T22:10:45.315209] [INFO ] [REMOTE ] UVE: Full fetch complete (30018 records). [2025-10-10T22:10:45.315313] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-10T22:10:45.694847] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-10T22:10:45.694928] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-10T22:10:45.695590] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-10T22:10:45.695630] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-10T22:10:45.696372] [DEBUG] [LOCAL ] UVE: Trimmed 30018 records to 22150 (keeping 200 days of data) [2025-10-10T22:10:45.843012] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-10T22:10:45.847113] [DEBUG] [LOCAL ] UVE: Primary data saved (22150 records). [2025-10-10T22:10:45.847178] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-10T22:10:45.847274] [INFO ] [MAIN ] Update Progress: 2207/2373 symbols completed. UVE took 34.1s. Estimated remaining: 23m 22s. Rate: 7.1 symbols/min [2025-10-10T22:10:45.899521] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-10T22:10:46.018233] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:10:46.029102] [DEBUG] [LOCAL ] UZE: Loaded 7495 existing records from primary storage. [2025-10-10T22:10:46.029312] [INFO ] [MAIN ] UZE: Loaded 7495 existing records. [2025-10-10T22:10:46.203802] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:10:46.204055] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-10T22:10:46.204102] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-10T22:10:46.204608] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-10T22:10:46.204696] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-10T22:10:46.556234] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:10:46.689349] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-10-10T22:10:46.713853] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-10T22:10:47.489364] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-10T22:10:47.710586] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T22:10:48.161219] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-10T22:10:48.289352] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-10T22:10:49.089394] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-10T22:10:49.491783] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T22:10:49.889386] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-10T22:10:49.925136] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-10T22:10:50.689409] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-10T22:10:51.344760] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-10T22:10:51.355255] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-10T22:10:51.489398] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-10T22:10:52.289425] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-10T22:10:52.896313] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T22:10:53.089397] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-10T22:10:53.144799] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-10T22:10:53.889372] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-10T22:10:54.579227] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-10T22:10:54.689371] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-10T22:10:55.046328] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T22:10:55.462308] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-10T22:10:55.489334] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-10T22:10:56.289359] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-10T22:10:56.611867] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-10T22:10:56.614393] [INFO ] [REMOTE ] UVV: Full fetch complete (30035 records). [2025-10-10T22:10:56.614468] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-10T22:10:56.927023] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-10T22:10:56.928453] [INFO ] [REMOTE ] UZD: Full fetch complete (9304 records). [2025-10-10T22:10:56.939008] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-10T22:10:57.115586] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-10T22:10:57.113433] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-10T22:10:57.126677] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-10T22:10:57.144107] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-10T22:10:57.157381] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-10T22:10:57.301010] [DEBUG] [LOCAL ] UVV: Trimmed 30035 records to 22996 (keeping 200 days of data) [2025-10-10T22:10:57.476811] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-10T22:10:57.477675] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-10T22:10:57.478209] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-10T22:10:57.478285] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-10T22:10:57.481093] [DEBUG] [LOCAL ] UZD: Trimmed 9304 records to 6451 (keeping 200 days of data) [2025-10-10T22:10:57.530849] [DEBUG] [LOCAL ] UZD: Primary data saved (6451 records). [2025-10-10T22:10:57.531491] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-10T22:10:57.531865] [INFO ] [MAIN ] Update Progress: 2208/2373 symbols completed. UZD took 23.6s. Estimated remaining: 23m 14s. Rate: 7.1 symbols/min [2025-10-10T22:10:57.712691] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:10:57.725336] [DEBUG] [LOCAL ] UZF: Loaded 6371 existing records from primary storage. [2025-10-10T22:10:57.726075] [INFO ] [MAIN ] UZF: Loaded 6371 existing records. [2025-10-10T22:10:57.890733] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-10T22:10:57.902894] [DEBUG] [LOCAL ] UVV: Primary data saved (22996 records). [2025-10-10T22:10:57.913576] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-10T22:10:57.913751] [INFO ] [MAIN ] Update Progress: 2209/2373 symbols completed. UVV took 45.9s. Estimated remaining: 23m 5s. Rate: 7.1 symbols/min [2025-10-10T22:10:57.938445] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:10:57.965196] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-10T22:10:57.977451] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-10T22:10:58.014228] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-10-10T22:10:58.032502] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-10T22:10:58.216203] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:10:58.488047] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:10:58.503475] [DEBUG] [LOCAL ] V: Loaded 54142 existing records from primary storage. [2025-10-10T22:10:58.503786] [INFO ] [MAIN ] V: Loaded 54142 existing records. [2025-10-10T22:10:58.683553] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:10:58.683816] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-10T22:10:58.683870] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-10T22:10:58.684147] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-10T22:10:58.684204] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-10T22:10:58.714798] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-10-10T22:10:58.874002] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-10T22:10:59.061173] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:10:59.147704] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T22:10:59.489445] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-10T22:10:59.708016] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-10T22:11:00.289423] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-10T22:11:01.046242] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-10T22:11:01.089338] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-10T22:11:01.392113] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T22:11:01.885897] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-10T22:11:01.889319] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-10T22:11:02.569874] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-10T22:11:02.689401] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-10-10T22:11:03.489424] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-10T22:11:04.289407] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-10T22:11:05.092808] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-10T22:11:05.094843] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-10T22:11:05.160221] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-10T22:11:05.702850] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-10T22:11:05.889383] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-10T22:11:06.211980] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-10T22:11:06.689397] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-10T22:11:07.489376] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-10T22:11:08.161026] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-10T22:11:08.253448] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-10T22:11:08.289388] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-10T22:11:08.623949] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T22:11:09.089412] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-10T22:11:09.889409] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-10T22:11:09.935635] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-10T22:11:10.656300] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-10T22:11:10.689372] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-10T22:11:11.489346] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-10T22:11:11.643704] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T22:11:11.652470] [INFO ] [REMOTE ] UWMC: Full fetch complete (75670 records). [2025-10-10T22:11:11.652635] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-10T22:11:12.033831] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-10T22:11:12.033929] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-10T22:11:12.035155] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-10T22:11:12.035218] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-10T22:11:12.036672] [DEBUG] [LOCAL ] UWMC: Trimmed 75670 records to 53633 (keeping 200 days of data) [2025-10-10T22:11:12.290186] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-10T22:11:12.373149] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-10T22:11:12.408356] [DEBUG] [LOCAL ] UWMC: Primary data saved (53633 records). [2025-10-10T22:11:12.408776] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-10T22:11:12.408874] [INFO ] [MAIN ] Update Progress: 2210/2373 symbols completed. UWMC took 46.0s. Estimated remaining: 22m 57s. Rate: 7.1 symbols/min [2025-10-10T22:11:12.577533] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:11:12.612604] [DEBUG] [LOCAL ] VAC: Loaded 34438 existing records from primary storage. [2025-10-10T22:11:12.612937] [INFO ] [MAIN ] VAC: Loaded 34438 existing records. [2025-10-10T22:11:12.790346] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:11:12.790615] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-10T22:11:12.790694] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-10T22:11:12.790923] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-10T22:11:12.790979] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-10T22:11:13.094069] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-10T22:11:13.093315] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-10T22:11:13.169618] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:11:13.202692] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-10T22:11:13.889380] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-10T22:11:14.018071] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-10T22:11:14.480807] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-10T22:11:14.482034] [INFO ] [REMOTE ] UZE: Full fetch complete (10048 records). [2025-10-10T22:11:14.482104] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-10T22:11:14.697134] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-10T22:11:14.851803] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-10T22:11:14.851900] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-10T22:11:14.852206] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-10T22:11:14.852248] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-10T22:11:14.852728] [DEBUG] [LOCAL ] UZE: Trimmed 10048 records to 7576 (keeping 200 days of data) [2025-10-10T22:11:14.904690] [DEBUG] [LOCAL ] UZE: Primary data saved (7576 records). [2025-10-10T22:11:14.904880] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-10T22:11:14.904994] [INFO ] [MAIN ] Update Progress: 2211/2373 symbols completed. UZE took 29.1s. Estimated remaining: 22m 48s. Rate: 7.1 symbols/min [2025-10-10T22:11:15.074225] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:11:15.127136] [DEBUG] [LOCAL ] VAL: Loaded 50558 existing records from primary storage. [2025-10-10T22:11:15.127544] [INFO ] [MAIN ] VAL: Loaded 50558 existing records. [2025-10-10T22:11:15.310311] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:11:15.310723] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-10T22:11:15.310788] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-10T22:11:15.311170] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-10T22:11:15.311209] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-10T22:11:15.489666] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-10-10T22:11:15.556074] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-10T22:11:15.694824] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:11:16.289377] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-10T22:11:16.964702] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-10T22:11:16.965554] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-10T22:11:17.089336] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-10T22:11:17.889376] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-10T22:11:18.020744] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-10T22:11:18.689423] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-10T22:11:18.763244] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-10T22:11:19.489413] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-10T22:11:20.237577] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-10T22:11:20.289369] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-10T22:11:20.487351] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-10T22:11:21.089452] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-10-10T22:11:21.889363] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-10T22:11:21.912351] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T22:11:22.425179] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T22:11:22.517612] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-10T22:11:22.518700] [INFO ] [REMOTE ] UZF: Full fetch complete (8793 records). [2025-10-10T22:11:22.518770] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-10T22:11:22.691344] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-10T22:11:22.876331] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-10-10T22:11:22.876450] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-10-10T22:11:22.876845] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-10-10T22:11:22.876930] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-10-10T22:11:22.877626] [DEBUG] [LOCAL ] UZF: Trimmed 8793 records to 6403 (keeping 200 days of data) [2025-10-10T22:11:22.927620] [DEBUG] [LOCAL ] UZF: Primary data saved (6403 records). [2025-10-10T22:11:22.927795] [INFO ] [MAIN ] UZF: Full history saved. [2025-10-10T22:11:22.927893] [INFO ] [MAIN ] Update Progress: 2212/2373 symbols completed. UZF took 25.4s. Estimated remaining: 22m 40s. Rate: 7.1 symbols/min [2025-10-10T22:11:23.109629] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:11:23.161675] [DEBUG] [LOCAL ] VALE: Loaded 54083 existing records from primary storage. [2025-10-10T22:11:23.161999] [INFO ] [MAIN ] VALE: Loaded 54083 existing records. [2025-10-10T22:11:23.339866] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:11:23.340111] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-10T22:11:23.340159] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-10T22:11:23.340389] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-10T22:11:23.340449] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-10T22:11:23.496436] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-10T22:11:23.707692] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:11:24.289406] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-10T22:11:25.089389] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-10-10T22:11:25.366570] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-10T22:11:25.488927] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-10T22:11:25.889355] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-10T22:11:26.116346] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T22:11:26.689398] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-10T22:11:27.259786] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T22:11:27.489404] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-10T22:11:28.289397] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-10T22:11:28.410254] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-10T22:11:28.458074] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T22:11:28.644412] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-10T22:11:29.089478] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-10T22:11:29.889389] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-10T22:11:30.597631] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-10T22:11:30.689348] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-10T22:11:31.185139] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-10T22:11:31.489434] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-10T22:11:31.548672] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T22:11:32.289359] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-10T22:11:32.916279] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-10T22:11:33.089410] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-10T22:11:33.885988] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-10T22:11:33.893704] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-10T22:11:34.037616] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-10T22:11:34.689357] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-10T22:11:35.358220] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-10T22:11:35.489373] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-10T22:11:35.915078] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-10T22:11:36.014553] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T22:11:36.289380] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-10T22:11:37.089381] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-10T22:11:37.792615] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-10T22:11:37.889417] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-10T22:11:37.959122] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-10T22:11:38.701878] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-10T22:11:38.708904] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-10T22:11:39.489395] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-10T22:11:39.831576] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-10T22:11:40.289424] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-10T22:11:41.089356] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-10T22:11:41.157768] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-10T22:11:41.323835] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T22:11:41.889364] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-10T22:11:42.104079] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-10T22:11:42.689448] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-10T22:11:42.996534] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-10T22:11:43.016774] [INFO ] [REMOTE ] V: Full fetch complete (77819 records). [2025-10-10T22:11:43.033465] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-10T22:11:43.042517] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T22:11:43.448022] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-10T22:11:43.448110] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-10T22:11:43.449429] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-10T22:11:43.449509] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-10T22:11:43.451146] [DEBUG] [LOCAL ] V: Trimmed 77819 records to 54532 (keeping 200 days of data) [2025-10-10T22:11:43.506102] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-10T22:11:43.821195] [DEBUG] [LOCAL ] V: Primary data saved (54532 records). [2025-10-10T22:11:43.821342] [INFO ] [MAIN ] V: Full history saved. [2025-10-10T22:11:43.821439] [INFO ] [MAIN ] Update Progress: 2213/2373 symbols completed. V took 45.9s. Estimated remaining: 22m 32s. Rate: 7.1 symbols/min [2025-10-10T22:11:43.991416] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:11:43.999166] [DEBUG] [LOCAL ] VATE: Loaded 5295 existing records from primary storage. [2025-10-10T22:11:43.999393] [INFO ] [MAIN ] VATE: Loaded 5295 existing records. [2025-10-10T22:11:44.177973] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:11:44.178325] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-10T22:11:44.178381] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-10T22:11:44.194663] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-10T22:11:44.195601] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-10T22:11:44.295720] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-10T22:11:44.297323] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-10T22:11:44.573604] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:11:44.801351] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-10T22:11:44.804865] [INFO ] [REMOTE ] VAC: Full fetch complete (48466 records). [2025-10-10T22:11:44.804973] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-10T22:11:45.094534] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-10T22:11:45.176253] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-10T22:11:45.176329] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-10T22:11:45.177357] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-10T22:11:45.177418] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-10T22:11:45.178488] [DEBUG] [LOCAL ] VAC: Trimmed 48466 records to 34670 (keeping 200 days of data) [2025-10-10T22:11:45.389762] [DEBUG] [LOCAL ] VAC: Primary data saved (34670 records). [2025-10-10T22:11:45.389899] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-10T22:11:45.389977] [INFO ] [MAIN ] Update Progress: 2214/2373 symbols completed. VAC took 33.0s. Estimated remaining: 22m 23s. Rate: 7.1 symbols/min [2025-10-10T22:11:45.554271] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:11:45.563599] [DEBUG] [LOCAL ] VBF: Loaded 7049 existing records from primary storage. [2025-10-10T22:11:45.563829] [INFO ] [MAIN ] VBF: Loaded 7049 existing records. [2025-10-10T22:11:45.735228] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:11:45.735424] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-10T22:11:45.735470] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-10T22:11:45.735631] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-10T22:11:45.735718] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-10T22:11:45.896502] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-10-10T22:11:46.096850] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:11:46.132585] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-10T22:11:46.624598] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-10T22:11:46.689402] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-10T22:11:47.497997] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-10T22:11:47.525310] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-10T22:11:48.289357] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-10-10T22:11:48.650272] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T22:11:48.732786] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-10T22:11:49.051023] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-10T22:11:49.089336] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-10T22:11:49.870750] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-10T22:11:49.889330] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-10T22:11:50.689349] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-10T22:11:50.888314] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-10T22:11:51.489436] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-10T22:11:51.738825] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-10T22:11:52.289398] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-10T22:11:53.089437] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-10T22:11:53.393237] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-10T22:11:53.423720] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T22:11:53.889393] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-10T22:11:54.689381] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-10T22:11:54.880692] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-10T22:11:55.216099] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-10T22:11:55.489465] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-10T22:11:55.843560] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-10T22:11:55.849108] [INFO ] [REMOTE ] VAL: Full fetch complete (73121 records). [2025-10-10T22:11:55.849329] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-10T22:11:56.242040] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-10T22:11:56.242128] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-10T22:11:56.243696] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-10T22:11:56.243758] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-10T22:11:56.256746] [DEBUG] [LOCAL ] VAL: Trimmed 73121 records to 50921 (keeping 200 days of data) [2025-10-10T22:11:56.316582] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-10T22:11:56.360589] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T22:11:56.627033] [DEBUG] [LOCAL ] VAL: Primary data saved (50921 records). [2025-10-10T22:11:56.627175] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-10T22:11:56.627261] [INFO ] [MAIN ] Update Progress: 2215/2373 symbols completed. VAL took 41.7s. Estimated remaining: 22m 15s. Rate: 7.1 symbols/min [2025-10-10T22:11:56.793463] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:11:56.808565] [DEBUG] [LOCAL ] VCV: Loaded 13626 existing records from primary storage. [2025-10-10T22:11:56.808845] [INFO ] [MAIN ] VCV: Loaded 13626 existing records. [2025-10-10T22:11:56.986358] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:11:56.986543] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-10T22:11:56.986589] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-10T22:11:56.986787] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-10T22:11:56.986840] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-10T22:11:57.094511] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-10T22:11:57.252219] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-10T22:11:57.349595] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:11:57.842483] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-10T22:11:57.889350] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-10T22:11:58.598944] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-10T22:11:58.689409] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-10T22:11:59.058996] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-10T22:11:59.489356] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-10T22:12:00.231750] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-10T22:12:00.289392] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-10T22:12:01.089363] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-10T22:12:01.112712] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-10T22:12:01.810078] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-10T22:12:01.889381] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-10T22:12:02.689417] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-10-10T22:12:02.742777] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-10T22:12:03.489393] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-10T22:12:03.584421] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-10T22:12:04.116327] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-10T22:12:04.117579] [INFO ] [REMOTE ] VATE: Full fetch complete (10545 records). [2025-10-10T22:12:04.117675] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-10T22:12:04.290258] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-10T22:12:04.506805] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-10T22:12:04.507296] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-10T22:12:04.507793] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-10T22:12:04.507860] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-10T22:12:04.508390] [DEBUG] [LOCAL ] VATE: Trimmed 10545 records to 5369 (keeping 200 days of data) [2025-10-10T22:12:04.545975] [DEBUG] [LOCAL ] VATE: Primary data saved (5369 records). [2025-10-10T22:12:04.546142] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-10T22:12:04.546257] [INFO ] [MAIN ] Update Progress: 2216/2373 symbols completed. VATE took 20.7s. Estimated remaining: 22m 6s. Rate: 7.1 symbols/min [2025-10-10T22:12:04.726816] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:12:04.775150] [DEBUG] [LOCAL ] VEEV: Loaded 47509 existing records from primary storage. [2025-10-10T22:12:04.775538] [INFO ] [MAIN ] VEEV: Loaded 47509 existing records. [2025-10-10T22:12:04.965128] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:12:04.965911] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-10T22:12:04.966009] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-10T22:12:04.966324] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-10T22:12:04.966484] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-10T22:12:05.066772] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-10T22:12:05.094539] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-10T22:12:05.334214] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:12:05.889414] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-10T22:12:06.689430] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-10T22:12:06.867799] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-10T22:12:07.494536] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-10-10T22:12:07.516440] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-10T22:12:07.612577] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-10T22:12:08.289386] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-10T22:12:09.089398] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-10T22:12:09.377292] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T22:12:09.694553] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-10T22:12:09.889409] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-10T22:12:10.196017] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-10T22:12:10.201395] [INFO ] [REMOTE ] VALE: Full fetch complete (77763 records). [2025-10-10T22:12:10.201548] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-10T22:12:10.594014] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-10T22:12:10.594107] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-10T22:12:10.595396] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-10T22:12:10.595460] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-10T22:12:10.596879] [DEBUG] [LOCAL ] VALE: Trimmed 77763 records to 54473 (keeping 200 days of data) [2025-10-10T22:12:10.689468] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-10T22:12:10.954545] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-10T22:12:10.964591] [DEBUG] [LOCAL ] VALE: Primary data saved (54473 records). [2025-10-10T22:12:10.964814] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-10T22:12:10.964919] [INFO ] [MAIN ] Update Progress: 2217/2373 symbols completed. VALE took 48.0s. Estimated remaining: 21m 58s. Rate: 7.1 symbols/min [2025-10-10T22:12:11.160736] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:12:11.175364] [DEBUG] [LOCAL ] VEL: Loaded 12524 existing records from primary storage. [2025-10-10T22:12:11.175611] [INFO ] [MAIN ] VEL: Loaded 12524 existing records. [2025-10-10T22:12:11.282793] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-10T22:12:11.365124] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:12:11.365355] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-10T22:12:11.365444] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-10T22:12:11.365634] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-10T22:12:11.365720] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-10T22:12:11.494538] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-10T22:12:11.732796] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:12:12.289410] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-10T22:12:13.089383] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-10-10T22:12:13.395412] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T22:12:13.413284] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-10T22:12:13.889376] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-10T22:12:14.019220] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-10T22:12:14.689394] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-10T22:12:15.481623] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T22:12:15.490582] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-10T22:12:15.707906] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-10T22:12:16.289397] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-10T22:12:16.306681] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-10T22:12:17.089399] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-10T22:12:17.889359] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-10T22:12:18.033564] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-10T22:12:18.088725] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-10T22:12:18.689355] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-10T22:12:18.753989] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-10T22:12:19.489421] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-10T22:12:20.194735] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-10T22:12:20.289352] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-10T22:12:20.655559] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-10T22:12:21.089442] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-10T22:12:21.698512] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-10T22:12:21.889407] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-10T22:12:22.237599] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T22:12:22.664499] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T22:12:22.666176] [INFO ] [REMOTE ] VBF: Full fetch complete (10766 records). [2025-10-10T22:12:22.666244] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-10T22:12:22.695076] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-10T22:12:23.020491] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-10T22:12:23.020569] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-10T22:12:23.020886] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-10T22:12:23.020948] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-10T22:12:23.021396] [DEBUG] [LOCAL ] VBF: Trimmed 10766 records to 7204 (keeping 200 days of data) [2025-10-10T22:12:23.064537] [DEBUG] [LOCAL ] VBF: Primary data saved (7204 records). [2025-10-10T22:12:23.064685] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-10T22:12:23.064787] [INFO ] [MAIN ] Update Progress: 2218/2373 symbols completed. VBF took 37.7s. Estimated remaining: 21m 50s. Rate: 7.1 symbols/min [2025-10-10T22:12:23.230553] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:12:23.283523] [DEBUG] [LOCAL ] VET: Loaded 44339 existing records from primary storage. [2025-10-10T22:12:23.283857] [INFO ] [MAIN ] VET: Loaded 44339 existing records. [2025-10-10T22:12:23.455738] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:12:23.455974] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-10T22:12:23.456024] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-10T22:12:23.456215] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-10T22:12:23.456251] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-10T22:12:23.494710] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-10T22:12:23.810553] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:12:23.895813] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-10T22:12:24.289442] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-10-10T22:12:24.621541] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-10T22:12:25.089382] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-10T22:12:25.889384] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-10T22:12:26.122460] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-10T22:12:26.222489] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-10T22:12:26.689394] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-10T22:12:27.228405] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-10T22:12:27.489428] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-10T22:12:27.864618] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-10T22:12:28.289376] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-10T22:12:28.430074] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-10T22:12:29.089419] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-10T22:12:29.532211] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-10T22:12:29.889436] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-10T22:12:30.689421] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-10T22:12:30.861187] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-10T22:12:30.890252] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-10T22:12:31.489382] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-10T22:12:31.813820] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T22:12:32.289424] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-10T22:12:33.089366] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-10T22:12:33.249022] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-10T22:12:33.501353] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-10T22:12:33.677479] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-10T22:12:33.678791] [INFO ] [REMOTE ] VCV: Full fetch complete (18572 records). [2025-10-10T22:12:33.678861] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-10T22:12:33.894623] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-10T22:12:34.040906] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-10T22:12:34.040980] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-10T22:12:34.041407] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-10T22:12:34.041447] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-10T22:12:34.042031] [DEBUG] [LOCAL ] VCV: Trimmed 18572 records to 13672 (keeping 200 days of data) [2025-10-10T22:12:34.137133] [DEBUG] [LOCAL ] VCV: Primary data saved (13672 records). [2025-10-10T22:12:34.137269] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-10T22:12:34.137353] [INFO ] [MAIN ] Update Progress: 2219/2373 symbols completed. VCV took 37.5s. Estimated remaining: 21m 41s. Rate: 7.1 symbols/min [2025-10-10T22:12:34.303632] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:12:34.361216] [DEBUG] [LOCAL ] VFC: Loaded 53997 existing records from primary storage. [2025-10-10T22:12:34.361564] [INFO ] [MAIN ] VFC: Loaded 53997 existing records. [2025-10-10T22:12:34.533621] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:12:34.533866] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-10T22:12:34.533932] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-10T22:12:34.534395] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-10T22:12:34.534457] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-10T22:12:34.695073] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-10T22:12:34.889041] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:12:35.489409] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-10T22:12:35.607193] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-10T22:12:35.609137] [INFO ] [REMOTE ] VEL: Full fetch complete (17126 records). [2025-10-10T22:12:35.609353] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-10T22:12:35.980608] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-10T22:12:35.980776] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-10T22:12:35.981740] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-10T22:12:35.992389] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-10T22:12:36.009352] [DEBUG] [LOCAL ] VEL: Trimmed 17126 records to 12608 (keeping 200 days of data) [2025-10-10T22:12:36.011148] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-10T22:12:36.100527] [DEBUG] [LOCAL ] VEL: Primary data saved (12608 records). [2025-10-10T22:12:36.100681] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-10T22:12:36.100795] [INFO ] [MAIN ] Update Progress: 2220/2373 symbols completed. VEL took 25.1s. Estimated remaining: 21m 32s. Rate: 7.1 symbols/min [2025-10-10T22:12:36.266628] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:12:36.266799] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-10T22:12:36.266839] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-10T22:12:36.266968] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-10T22:12:36.267024] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-10T22:12:36.267068] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-10T22:12:36.267100] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-10T22:12:36.296699] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-10-10T22:12:36.613113] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:12:37.089410] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-10-10T22:12:37.313782] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T22:12:37.325610] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T22:12:37.326556] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-10-10T22:12:37.326685] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T22:12:37.326766] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-10-10T22:12:37.326834] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T22:12:37.326903] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-10T22:12:37.326992] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-10T22:12:37.327054] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-10T22:12:37.327148] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-10T22:12:37.327242] [INFO ] [MAIN ] Update Progress: 2221/2373 symbols completed. VG took 1.2s. Estimated remaining: 21m 23s. Rate: 7.1 symbols/min [2025-10-10T22:12:37.529541] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:12:37.537913] [DEBUG] [LOCAL ] VGI: Loaded 5227 existing records from primary storage. [2025-10-10T22:12:37.538155] [INFO ] [MAIN ] VGI: Loaded 5227 existing records. [2025-10-10T22:12:37.744098] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:12:37.744343] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-10T22:12:37.744428] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-10T22:12:37.744696] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-10T22:12:37.744763] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-10T22:12:37.894248] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-10T22:12:38.108226] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:12:38.347628] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T22:12:38.689377] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-10T22:12:39.489390] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-10T22:12:39.901194] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T22:12:40.289413] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-10T22:12:40.712855] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T22:12:40.846743] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-10T22:12:41.089347] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-10T22:12:41.889360] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-10-10T22:12:42.235347] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-10T22:12:42.610075] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-10T22:12:42.689340] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-10T22:12:42.834883] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T22:12:42.840114] [INFO ] [REMOTE ] VEEV: Full fetch complete (68244 records). [2025-10-10T22:12:42.840364] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-10T22:12:43.241211] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-10T22:12:43.241293] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-10T22:12:43.242544] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-10T22:12:43.242634] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-10T22:12:43.244112] [DEBUG] [LOCAL ] VEEV: Trimmed 68244 records to 47874 (keeping 200 days of data) [2025-10-10T22:12:43.504797] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-10T22:12:43.536502] [DEBUG] [LOCAL ] VEEV: Primary data saved (47874 records). [2025-10-10T22:12:43.536671] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-10T22:12:43.537032] [INFO ] [MAIN ] Update Progress: 2222/2373 symbols completed. VEEV took 39.0s. Estimated remaining: 21m 15s. Rate: 7.1 symbols/min [2025-10-10T22:12:43.732133] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:12:43.752434] [DEBUG] [LOCAL ] VGM: Loaded 18599 existing records from primary storage. [2025-10-10T22:12:43.752731] [INFO ] [MAIN ] VGM: Loaded 18599 existing records. [2025-10-10T22:12:43.932677] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:12:43.932922] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-10T22:12:43.932971] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-10T22:12:43.933181] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-10T22:12:43.933239] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-10T22:12:44.290688] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-10T22:12:44.328328] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:12:44.354692] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-10T22:12:44.356622] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T22:12:45.089362] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-10T22:12:45.889363] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-10-10T22:12:46.320342] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-10T22:12:46.689420] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-10T22:12:46.722677] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T22:12:47.080485] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T22:12:47.385269] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-10T22:12:47.489402] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-10T22:12:48.207929] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-10T22:12:48.289388] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-10T22:12:48.705931] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-10T22:12:49.089410] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-10T22:12:49.889403] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-10T22:12:50.689356] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-10T22:12:50.839112] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-10T22:12:50.871629] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T22:12:51.489404] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-10T22:12:51.746911] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-10T22:12:52.184166] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-10T22:12:52.289355] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-10T22:12:53.089356] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-10T22:12:53.489710] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-10T22:12:53.889368] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-10T22:12:54.695154] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-10T22:12:54.700931] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-10T22:12:54.995252] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-10T22:12:55.489399] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-10T22:12:56.212268] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T22:12:56.289365] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-10T22:12:56.716336] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T22:12:57.089402] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-10T22:12:57.889407] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-10T22:12:58.310740] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-10T22:12:58.348583] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-10T22:12:58.621122] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-10T22:12:58.689346] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-10T22:12:59.489469] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-10T22:12:59.496682] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-10T22:13:00.289374] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-10T22:13:00.758037] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-10T22:13:01.089422] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-10T22:13:01.889380] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-10T22:13:02.072678] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T22:13:02.624403] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-10T22:13:02.689354] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-10T22:13:03.195788] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-10T22:13:03.489379] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-10T22:13:04.289381] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-10T22:13:04.670557] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-10T22:13:04.697528] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-10T22:13:05.089400] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-10T22:13:05.881001] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-10T22:13:05.885562] [INFO ] [REMOTE ] VET: Full fetch complete (64641 records). [2025-10-10T22:13:05.885714] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-10T22:13:05.897555] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-10T22:13:06.291218] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-10T22:13:06.291570] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-10T22:13:06.293353] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-10T22:13:06.293420] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-10T22:13:06.295162] [DEBUG] [LOCAL ] VET: Trimmed 64641 records to 44718 (keeping 200 days of data) [2025-10-10T22:13:06.593026] [DEBUG] [LOCAL ] VET: Primary data saved (44718 records). [2025-10-10T22:13:06.593203] [INFO ] [MAIN ] VET: Full history saved. [2025-10-10T22:13:06.593337] [INFO ] [MAIN ] Update Progress: 2223/2373 symbols completed. VET took 43.5s. Estimated remaining: 21m 7s. Rate: 7.1 symbols/min [2025-10-10T22:13:06.694486] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-10T22:13:06.768335] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:13:06.774009] [DEBUG] [LOCAL ] VHI: Loaded 2752 existing records from primary storage. [2025-10-10T22:13:06.774179] [INFO ] [MAIN ] VHI: Loaded 2752 existing records. [2025-10-10T22:13:06.952774] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:13:06.953247] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-10T22:13:06.953306] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-10T22:13:06.953583] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-10T22:13:06.953667] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-10T22:13:07.330926] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-10T22:13:07.334484] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:13:07.365368] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T22:13:07.366703] [INFO ] [REMOTE ] VGI: Full fetch complete (7646 records). [2025-10-10T22:13:07.366920] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-10T22:13:07.494485] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-10-10T22:13:07.514591] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-10T22:13:07.816051] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-10T22:13:07.816131] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-10T22:13:07.816381] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-10T22:13:07.816419] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-10T22:13:07.816841] [DEBUG] [LOCAL ] VGI: Trimmed 7646 records to 5267 (keeping 200 days of data) [2025-10-10T22:13:07.851560] [DEBUG] [LOCAL ] VGI: Primary data saved (5267 records). [2025-10-10T22:13:07.851798] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-10T22:13:07.851991] [INFO ] [MAIN ] Update Progress: 2224/2373 symbols completed. VGI took 30.5s. Estimated remaining: 20m 58s. Rate: 7.1 symbols/min [2025-10-10T22:13:08.028789] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:13:08.029029] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-10T22:13:08.029068] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-10T22:13:08.029296] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-10T22:13:08.029346] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-10T22:13:08.029388] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-10T22:13:08.029421] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-10T22:13:08.289684] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-10T22:13:08.322354] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-10T22:13:08.402509] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:13:09.089376] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-10T22:13:09.763232] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-10T22:13:09.765360] [INFO ] [REMOTE ] VGM: Full fetch complete (26048 records). [2025-10-10T22:13:09.765430] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-10T22:13:09.901539] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-10T22:13:10.165401] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-10T22:13:10.165535] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-10T22:13:10.166195] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-10T22:13:10.166300] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-10T22:13:10.167104] [DEBUG] [LOCAL ] VGM: Trimmed 26048 records to 18737 (keeping 200 days of data) [2025-10-10T22:13:10.277833] [DEBUG] [LOCAL ] VGM: Primary data saved (18737 records). [2025-10-10T22:13:10.278097] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-10T22:13:10.278262] [INFO ] [MAIN ] Update Progress: 2225/2373 symbols completed. VGM took 26.7s. Estimated remaining: 20m 50s. Rate: 7.1 symbols/min [2025-10-10T22:13:10.448476] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:13:10.480164] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-10T22:13:10.537113] [DEBUG] [LOCAL ] VICI: Loaded 54040 existing records from primary storage. [2025-10-10T22:13:10.537417] [INFO ] [MAIN ] VICI: Loaded 54040 existing records. [2025-10-10T22:13:10.690146] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-10-10T22:13:10.713304] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:13:10.717982] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-10T22:13:10.718117] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-10T22:13:10.718263] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-10T22:13:10.720727] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-10T22:13:10.720786] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-10T22:13:11.000625] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T22:13:11.016595] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-10-10T22:13:11.043222] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T22:13:11.049984] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-10T22:13:11.075484] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:13:11.075565] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T22:13:11.075999] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-10T22:13:11.076135] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-10T22:13:11.076188] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-10T22:13:11.076229] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-10T22:13:11.076276] [INFO ] [MAIN ] Update Progress: 2226/2373 symbols completed. VIA took 3.2s. Estimated remaining: 20m 41s. Rate: 7.1 symbols/min [2025-10-10T22:13:11.239738] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:13:11.293260] [DEBUG] [LOCAL ] VIK: Loaded 52834 existing records from primary storage. [2025-10-10T22:13:11.293610] [INFO ] [MAIN ] VIK: Loaded 52834 existing records. [2025-10-10T22:13:11.469801] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:13:11.470120] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-10T22:13:11.470167] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-10T22:13:11.470382] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-10T22:13:11.470436] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-10T22:13:11.498980] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-10T22:13:11.819051] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:13:11.952799] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-10T22:13:12.289381] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-10-10T22:13:13.089397] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-10-10T22:13:13.889436] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-10T22:13:14.240880] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T22:13:14.689406] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-10T22:13:14.884625] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-10T22:13:15.489357] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-10T22:13:15.999849] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-10T22:13:16.289410] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-10T22:13:16.693069] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-10T22:13:17.089348] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-10T22:13:17.200323] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-10T22:13:17.889340] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-10T22:13:18.018815] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-10T22:13:18.023986] [INFO ] [REMOTE ] VFC: Full fetch complete (77590 records). [2025-10-10T22:13:18.024120] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-10T22:13:18.421615] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-10T22:13:18.421733] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-10T22:13:18.423027] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-10T22:13:18.423089] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-10T22:13:18.425795] [DEBUG] [LOCAL ] VFC: Trimmed 77590 records to 54387 (keeping 200 days of data) [2025-10-10T22:13:18.712523] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-10T22:13:18.776175] [DEBUG] [LOCAL ] VFC: Primary data saved (54387 records). [2025-10-10T22:13:18.776419] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-10T22:13:18.776566] [INFO ] [MAIN ] Update Progress: 2227/2373 symbols completed. VFC took 44.6s. Estimated remaining: 20m 32s. Rate: 7.1 symbols/min [2025-10-10T22:13:18.955942] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:13:18.984466] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T22:13:19.045671] [DEBUG] [LOCAL ] VIPS: Loaded 51610 existing records from primary storage. [2025-10-10T22:13:19.046087] [INFO ] [MAIN ] VIPS: Loaded 51610 existing records. [2025-10-10T22:13:19.228520] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:13:19.228831] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-10T22:13:19.228886] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-10T22:13:19.229284] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-10T22:13:19.229342] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-10T22:13:19.510370] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-10T22:13:19.493034] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-10T22:13:19.610068] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:13:19.909256] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T22:13:20.289389] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-10T22:13:21.089416] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-10-10T22:13:21.541063] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T22:13:21.889384] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-10T22:13:22.540615] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-10T22:13:22.644212] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T22:13:22.689342] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-10T22:13:23.489355] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-10T22:13:23.842882] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T22:13:24.111430] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-10T22:13:24.289387] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-10T22:13:24.704776] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T22:13:25.089387] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-10T22:13:25.718861] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-10T22:13:25.889354] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-10T22:13:26.633118] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-10T22:13:26.689363] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-10T22:13:27.489399] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-10T22:13:27.889444] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-10T22:13:28.289409] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-10T22:13:28.702408] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T22:13:29.089381] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-10T22:13:29.484121] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T22:13:29.853857] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-10T22:13:29.889388] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-10T22:13:30.249849] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T22:13:30.689400] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-10T22:13:31.395324] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-10T22:13:31.489363] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-10T22:13:31.543144] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T22:13:32.289390] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-10T22:13:33.089407] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-10T22:13:33.526611] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-10T22:13:33.889364] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-10T22:13:34.399805] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T22:13:34.689415] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-10T22:13:35.068104] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T22:13:35.489400] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-10T22:13:36.100857] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-10T22:13:36.105025] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-10T22:13:36.289385] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-10T22:13:36.366912] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-10T22:13:36.837636] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-10T22:13:37.089403] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-10T22:13:37.889420] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-10T22:13:38.376505] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-10T22:13:38.377607] [INFO ] [REMOTE ] VHI: Full fetch complete (4376 records). [2025-10-10T22:13:38.377706] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-10T22:13:38.694556] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-10T22:13:38.828487] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-10T22:13:38.828605] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-10T22:13:38.828941] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-10T22:13:38.829007] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-10T22:13:38.829411] [DEBUG] [LOCAL ] VHI: Trimmed 4376 records to 2774 (keeping 200 days of data) [2025-10-10T22:13:38.847874] [DEBUG] [LOCAL ] VHI: Primary data saved (2774 records). [2025-10-10T22:13:38.847987] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-10T22:13:38.848084] [INFO ] [MAIN ] Update Progress: 2228/2373 symbols completed. VHI took 32.3s. Estimated remaining: 20m 24s. Rate: 7.1 symbols/min [2025-10-10T22:13:39.017130] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:13:39.066327] [DEBUG] [LOCAL ] VIRT: Loaded 47109 existing records from primary storage. [2025-10-10T22:13:39.066765] [INFO ] [MAIN ] VIRT: Loaded 47109 existing records. [2025-10-10T22:13:39.254108] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:13:39.254742] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-10T22:13:39.254992] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-10T22:13:39.255299] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-10T22:13:39.255374] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-10T22:13:39.395156] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-10T22:13:39.492413] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-10T22:13:39.694728] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:13:40.289387] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-10-10T22:13:40.610580] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T22:13:41.089341] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-10T22:13:41.544685] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T22:13:41.654811] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-10T22:13:41.889375] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-10T22:13:42.638287] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-10T22:13:42.689397] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-10T22:13:43.489396] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-10T22:13:43.735960] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-10T22:13:44.015777] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-10T22:13:44.020904] [INFO ] [REMOTE ] VICI: Full fetch complete (77658 records). [2025-10-10T22:13:44.021019] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-10T22:13:44.295841] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-10T22:13:44.433559] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-10T22:13:44.433746] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-10T22:13:44.435566] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-10T22:13:44.435636] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-10T22:13:44.437864] [DEBUG] [LOCAL ] VICI: Trimmed 77658 records to 54430 (keeping 200 days of data) [2025-10-10T22:13:44.578054] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-10T22:13:44.844826] [DEBUG] [LOCAL ] VICI: Primary data saved (54430 records). [2025-10-10T22:13:44.845015] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-10T22:13:44.845295] [INFO ] [MAIN ] Update Progress: 2229/2373 symbols completed. VICI took 34.6s. Estimated remaining: 20m 16s. Rate: 7.1 symbols/min [2025-10-10T22:13:45.027735] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:13:45.078614] [DEBUG] [LOCAL ] VIST: Loaded 46544 existing records from primary storage. [2025-10-10T22:13:45.079046] [INFO ] [MAIN ] VIST: Loaded 46544 existing records. [2025-10-10T22:13:45.094615] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-10T22:13:45.270882] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:13:45.271144] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-10T22:13:45.271198] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-10T22:13:45.271466] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-10T22:13:45.271523] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-10T22:13:45.638417] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:13:45.675504] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-10T22:13:45.681057] [INFO ] [REMOTE ] VIK: Full fetch complete (75898 records). [2025-10-10T22:13:45.681248] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-10T22:13:45.898783] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-10-10T22:13:46.074213] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-10T22:13:46.074399] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-10T22:13:46.075871] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-10T22:13:46.075938] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-10T22:13:46.077907] [DEBUG] [LOCAL ] VIK: Trimmed 75898 records to 53216 (keeping 200 days of data) [2025-10-10T22:13:46.405104] [DEBUG] [LOCAL ] VIK: Primary data saved (53216 records). [2025-10-10T22:13:46.405294] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-10T22:13:46.405396] [INFO ] [MAIN ] Update Progress: 2230/2373 symbols completed. VIK took 35.3s. Estimated remaining: 20m 7s. Rate: 7.1 symbols/min [2025-10-10T22:13:46.581398] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:13:46.628078] [DEBUG] [LOCAL ] VIV: Loaded 45144 existing records from primary storage. [2025-10-10T22:13:46.628491] [INFO ] [MAIN ] VIV: Loaded 45144 existing records. [2025-10-10T22:13:46.689380] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-10T22:13:46.819233] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:13:46.819504] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-10T22:13:46.819557] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-10T22:13:46.819816] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-10T22:13:46.819874] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-10T22:13:47.250107] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:13:47.253830] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-10T22:13:47.296117] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T22:13:47.489393] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-10T22:13:48.289441] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-10-10T22:13:48.530764] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T22:13:49.089478] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-10T22:13:49.362556] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T22:13:49.889412] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-10T22:13:50.143037] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T22:13:50.365817] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T22:13:50.689394] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-10T22:13:51.238785] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-10T22:13:51.489404] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-10T22:13:52.289393] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-10T22:13:52.591602] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-10T22:13:53.089444] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-10T22:13:53.350402] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T22:13:53.489347] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-10T22:13:53.889383] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-10T22:13:54.689425] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-10T22:13:54.973339] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T22:13:55.489483] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-10T22:13:55.639413] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-10T22:13:56.151948] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-10T22:13:56.289432] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-10T22:13:57.089403] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-10T22:13:57.163968] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-10T22:13:57.169976] [INFO ] [REMOTE ] VIPS: Full fetch complete (74596 records). [2025-10-10T22:13:57.170167] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-10T22:13:57.587156] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-10T22:13:57.587310] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-10T22:13:57.589085] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-10T22:13:57.589162] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-10T22:13:57.594685] [DEBUG] [LOCAL ] VIPS: Trimmed 74596 records to 52000 (keeping 200 days of data) [2025-10-10T22:13:57.895303] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-10T22:13:57.938220] [DEBUG] [LOCAL ] VIPS: Primary data saved (52000 records). [2025-10-10T22:13:57.938514] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-10T22:13:57.938636] [INFO ] [MAIN ] Update Progress: 2231/2373 symbols completed. VIPS took 39.2s. Estimated remaining: 19m 59s. Rate: 7.1 symbols/min [2025-10-10T22:13:58.117006] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:13:58.136966] [DEBUG] [LOCAL ] VKQ: Loaded 17513 existing records from primary storage. [2025-10-10T22:13:58.137281] [INFO ] [MAIN ] VKQ: Loaded 17513 existing records. [2025-10-10T22:13:58.356878] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:13:58.360462] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-10T22:13:58.370240] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-10T22:13:58.371917] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-10T22:13:58.372668] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-10T22:13:58.372734] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-10T22:13:58.706450] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-10T22:13:58.739144] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:13:58.943497] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T22:13:59.489361] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-10T22:13:59.851796] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T22:14:00.289404] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-10-10T22:14:00.564593] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T22:14:01.089432] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-10T22:14:01.360450] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T22:14:01.500345] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-10T22:14:01.889418] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-10T22:14:02.689373] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-10T22:14:03.011478] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T22:14:03.489420] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-10T22:14:03.748606] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T22:14:04.289383] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-10T22:14:04.523369] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-10T22:14:04.594313] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-10T22:14:05.089400] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-10T22:14:05.889404] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-10T22:14:06.067831] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-10T22:14:06.689343] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-10T22:14:06.928815] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T22:14:07.186720] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T22:14:07.489372] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-10T22:14:08.289349] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-10T22:14:08.626100] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-10T22:14:09.089367] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-10T22:14:09.256880] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T22:14:09.737845] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T22:14:09.889381] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-10T22:14:10.689388] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-10T22:14:10.891997] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T22:14:11.489432] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-10T22:14:11.808391] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T22:14:12.266850] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T22:14:12.272025] [INFO ] [REMOTE ] VIRT: Full fetch complete (67321 records). [2025-10-10T22:14:12.272165] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-10T22:14:12.294555] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-10T22:14:12.596404] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T22:14:12.677704] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-10T22:14:12.677793] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-10T22:14:12.679076] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-10T22:14:12.679139] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-10T22:14:12.680530] [DEBUG] [LOCAL ] VIRT: Trimmed 67321 records to 47459 (keeping 200 days of data) [2025-10-10T22:14:12.977331] [DEBUG] [LOCAL ] VIRT: Primary data saved (47459 records). [2025-10-10T22:14:12.977613] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-10T22:14:12.977746] [INFO ] [MAIN ] Update Progress: 2232/2373 symbols completed. VIRT took 34.1s. Estimated remaining: 19m 51s. Rate: 7.1 symbols/min [2025-10-10T22:14:13.094570] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-10T22:14:13.148132] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:14:13.192539] [DEBUG] [LOCAL ] VLN: Loaded 30025 existing records from primary storage. [2025-10-10T22:14:13.192861] [INFO ] [MAIN ] VLN: Loaded 30025 existing records. [2025-10-10T22:14:13.365566] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:14:13.365792] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-10T22:14:13.365841] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-10T22:14:13.366062] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-10T22:14:13.366139] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-10T22:14:13.714618] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:14:13.889335] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-10-10T22:14:14.152971] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T22:14:14.240373] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-10T22:14:14.689365] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-10T22:14:15.489346] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-10T22:14:15.621156] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T22:14:15.707321] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-10T22:14:16.289425] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-10T22:14:17.089366] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-10T22:14:17.509126] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-10T22:14:17.578398] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T22:14:17.889373] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-10T22:14:18.254934] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T22:14:18.689385] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-10T22:14:19.065349] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T22:14:19.489367] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-10T22:14:19.855404] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-10T22:14:19.859873] [INFO ] [REMOTE ] VIV: Full fetch complete (64457 records). [2025-10-10T22:14:19.859978] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-10T22:14:20.242442] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-10T22:14:20.242521] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-10T22:14:20.243773] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-10T22:14:20.243838] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-10T22:14:20.245148] [DEBUG] [LOCAL ] VIV: Trimmed 64457 records to 45510 (keeping 200 days of data) [2025-10-10T22:14:20.297965] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-10T22:14:20.538615] [DEBUG] [LOCAL ] VIV: Primary data saved (45510 records). [2025-10-10T22:14:20.538803] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-10T22:14:20.538901] [INFO ] [MAIN ] Update Progress: 2233/2373 symbols completed. VIV took 34.1s. Estimated remaining: 19m 42s. Rate: 7.1 symbols/min [2025-10-10T22:14:20.728693] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:14:20.780574] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T22:14:20.825343] [DEBUG] [LOCAL ] VLO: Loaded 53457 existing records from primary storage. [2025-10-10T22:14:20.825690] [INFO ] [MAIN ] VLO: Loaded 53457 existing records. [2025-10-10T22:14:20.997461] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:14:20.997717] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-10T22:14:20.997798] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-10T22:14:20.998002] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-10T22:14:20.998042] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-10T22:14:21.094840] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-10T22:14:21.386208] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:14:21.550302] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-10T22:14:21.889403] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-10T22:14:22.447632] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-10T22:14:22.689411] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-10T22:14:23.161907] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-10T22:14:23.489375] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-10T22:14:24.289365] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-10T22:14:24.407875] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-10T22:14:24.413012] [INFO ] [REMOTE ] VIST: Full fetch complete (66780 records). [2025-10-10T22:14:24.413180] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-10T22:14:24.775972] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T22:14:24.859126] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-10T22:14:24.859243] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-10T22:14:24.860965] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-10T22:14:24.861038] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-10T22:14:24.862924] [DEBUG] [LOCAL ] VIST: Trimmed 66780 records to 46928 (keeping 200 days of data) [2025-10-10T22:14:25.089470] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-10-10T22:14:25.174564] [DEBUG] [LOCAL ] VIST: Primary data saved (46928 records). [2025-10-10T22:14:25.174786] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-10T22:14:25.175088] [INFO ] [MAIN ] Update Progress: 2234/2373 symbols completed. VIST took 40.3s. Estimated remaining: 19m 34s. Rate: 7.1 symbols/min [2025-10-10T22:14:25.367247] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:14:25.380123] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-10T22:14:25.430515] [DEBUG] [LOCAL ] VLRS: Loaded 40415 existing records from primary storage. [2025-10-10T22:14:25.430950] [INFO ] [MAIN ] VLRS: Loaded 40415 existing records. [2025-10-10T22:14:25.617186] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:14:25.617496] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-10T22:14:25.617550] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-10T22:14:25.617977] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-10T22:14:25.618036] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-10T22:14:25.894749] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-10T22:14:26.010488] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:14:26.689396] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-10T22:14:27.242837] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-10T22:14:27.294253] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-10T22:14:27.489368] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-10T22:14:27.755260] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-10T22:14:27.757450] [INFO ] [REMOTE ] VKQ: Full fetch complete (24408 records). [2025-10-10T22:14:27.757518] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-10T22:14:28.114332] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-10T22:14:28.114460] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-10T22:14:28.115074] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-10T22:14:28.115134] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-10T22:14:28.115785] [DEBUG] [LOCAL ] VKQ: Trimmed 24408 records to 17616 (keeping 200 days of data) [2025-10-10T22:14:28.221573] [DEBUG] [LOCAL ] VKQ: Primary data saved (17616 records). [2025-10-10T22:14:28.221744] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-10T22:14:28.221862] [INFO ] [MAIN ] Update Progress: 2235/2373 symbols completed. VKQ took 30.3s. Estimated remaining: 19m 25s. Rate: 7.1 symbols/min [2025-10-10T22:14:28.295321] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-10T22:14:28.392534] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:14:28.400853] [DEBUG] [LOCAL ] VLT: Loaded 4541 existing records from primary storage. [2025-10-10T22:14:28.401080] [INFO ] [MAIN ] VLT: Loaded 4541 existing records. [2025-10-10T22:14:28.582045] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:14:28.582307] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-10T22:14:28.582357] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-10T22:14:28.582602] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-10T22:14:28.582703] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-10T22:14:28.946477] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T22:14:28.975367] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:14:29.089395] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-10T22:14:29.889411] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-10-10T22:14:30.508444] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-10T22:14:30.652314] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-10T22:14:30.689367] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-10T22:14:30.799751] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-10T22:14:31.489402] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-10-10T22:14:32.289446] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-10T22:14:32.675017] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-10T22:14:32.770527] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-10T22:14:33.089369] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-10T22:14:33.889374] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-10T22:14:34.053252] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-10T22:14:34.689387] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-10T22:14:34.715366] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T22:14:35.489402] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-10T22:14:35.687357] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-10T22:14:36.052765] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-10T22:14:36.289408] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-10T22:14:37.089392] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-10T22:14:37.118592] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T22:14:37.889363] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-10T22:14:38.650051] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-10T22:14:38.670934] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-10T22:14:38.689356] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-10T22:14:38.744666] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-10T22:14:39.489360] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-10T22:14:40.289390] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-10T22:14:40.831226] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-10T22:14:40.884409] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-10T22:14:41.089385] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-10T22:14:41.337763] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T22:14:41.889420] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-10T22:14:42.689386] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-10T22:14:42.782179] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-10T22:14:43.091349] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-10T22:14:43.489403] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-10T22:14:44.223441] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-10T22:14:44.227909] [INFO ] [REMOTE ] VLN: Full fetch complete (43384 records). [2025-10-10T22:14:44.228075] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-10T22:14:44.299123] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-10T22:14:44.623464] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-10T22:14:44.623570] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-10T22:14:44.624811] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-10T22:14:44.624876] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-10T22:14:44.626213] [DEBUG] [LOCAL ] VLN: Trimmed 43384 records to 30383 (keeping 200 days of data) [2025-10-10T22:14:44.817145] [DEBUG] [LOCAL ] VLN: Primary data saved (30383 records). [2025-10-10T22:14:44.817572] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-10T22:14:44.817833] [INFO ] [MAIN ] Update Progress: 2236/2373 symbols completed. VLN took 31.8s. Estimated remaining: 19m 17s. Rate: 7.1 symbols/min [2025-10-10T22:14:45.009798] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:14:45.046418] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-10T22:14:45.101704] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-10T22:14:45.107183] [DEBUG] [LOCAL ] VLTO: Loaded 46451 existing records from primary storage. [2025-10-10T22:14:45.107811] [INFO ] [MAIN ] VLTO: Loaded 46451 existing records. [2025-10-10T22:14:45.295433] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:14:45.295756] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-10T22:14:45.295813] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-10T22:14:45.296035] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-10T22:14:45.296073] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-10T22:14:45.664098] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:14:45.889381] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-10T22:14:46.544745] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-10T22:14:46.591171] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-10T22:14:46.689363] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-10T22:14:46.875823] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-10T22:14:47.407804] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-10T22:14:47.489410] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-10T22:14:48.102533] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-10T22:14:48.289400] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-10T22:14:49.089452] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-10T22:14:49.889463] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-10T22:14:50.328401] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-10T22:14:50.593704] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-10T22:14:50.694846] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-10T22:14:50.705758] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-10T22:14:51.489422] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-10-10T22:14:52.289444] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-10T22:14:52.923971] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-10T22:14:53.061476] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-10T22:14:53.089408] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-10T22:14:53.377495] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T22:14:53.857521] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T22:14:53.863164] [INFO ] [REMOTE ] VLO: Full fetch complete (76877 records). [2025-10-10T22:14:53.863322] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-10T22:14:53.894509] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-10T22:14:54.277358] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-10T22:14:54.277481] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-10T22:14:54.279199] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-10T22:14:54.279291] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-10T22:14:54.281237] [DEBUG] [LOCAL ] VLO: Trimmed 76877 records to 53837 (keeping 200 days of data) [2025-10-10T22:14:54.613082] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-10T22:14:54.635014] [INFO ] [REMOTE ] VLT: Full fetch complete (7483 records). [2025-10-10T22:14:54.636112] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-10T22:14:54.697072] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-10T22:14:55.069501] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-10T22:14:55.069183] [DEBUG] [LOCAL ] VLO: Primary data saved (53837 records). [2025-10-10T22:14:55.069783] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-10T22:14:55.069907] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-10T22:14:55.070259] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-10T22:14:55.070470] [INFO ] [MAIN ] Update Progress: 2237/2373 symbols completed. VLO took 34.5s. Estimated remaining: 19m 8s. Rate: 7.1 symbols/min [2025-10-10T22:14:55.070595] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-10T22:14:55.071490] [DEBUG] [LOCAL ] VLT: Trimmed 7483 records to 4574 (keeping 200 days of data) [2025-10-10T22:14:55.101838] [DEBUG] [LOCAL ] VLT: Primary data saved (4574 records). [2025-10-10T22:14:55.102031] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-10T22:14:55.102180] [INFO ] [MAIN ] Update Progress: 2238/2373 symbols completed. VLT took 26.9s. Estimated remaining: 18m 60s. Rate: 7.1 symbols/min [2025-10-10T22:14:55.489458] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-10T22:14:56.534327] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-10T22:14:56.545247] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-10T22:14:57.289181] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T22:14:57.298873] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-10T22:14:58.213188] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-10T22:14:58.221872] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-10T22:14:59.127957] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-10T22:14:59.138359] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-10T22:14:59.765440] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-10T22:14:59.773974] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-10T22:15:01.034483] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T22:15:01.049616] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-10T22:15:01.244779] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-10T22:15:01.249053] [INFO ] [REMOTE ] VLRS: Full fetch complete (58361 records). [2025-10-10T22:15:01.249261] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-10T22:15:01.650815] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-10T22:15:01.650937] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-10T22:15:01.652256] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-10T22:15:01.652328] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-10T22:15:01.653998] [DEBUG] [LOCAL ] VLRS: Trimmed 58361 records to 40669 (keeping 200 days of data) [2025-10-10T22:15:01.920488] [DEBUG] [LOCAL ] VLRS: Primary data saved (40669 records). [2025-10-10T22:15:01.920739] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-10T22:15:01.921066] [INFO ] [MAIN ] Update Progress: 2239/2373 symbols completed. VLRS took 36.7s. Estimated remaining: 18m 51s. Rate: 7.1 symbols/min [2025-10-10T22:15:03.110065] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-10T22:15:03.121624] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-10T22:15:05.101208] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-10T22:15:05.112695] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-10T22:15:06.755108] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-10T22:15:06.764629] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-10T22:15:08.700618] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-10T22:15:08.715089] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-10T22:15:10.638825] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T22:15:10.649732] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-10T22:15:12.541141] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T22:15:12.553031] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-10T22:15:13.312842] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-10T22:15:13.317538] [INFO ] [REMOTE ] VLTO: Full fetch complete (66987 records). [2025-10-10T22:15:13.317704] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-10T22:15:13.715144] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-10T22:15:13.715227] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-10T22:15:13.716417] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-10T22:15:13.716481] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-10T22:15:13.717935] [DEBUG] [LOCAL ] VLTO: Trimmed 66987 records to 46814 (keeping 200 days of data) [2025-10-10T22:15:14.038666] [DEBUG] [LOCAL ] VLTO: Primary data saved (46814 records). [2025-10-10T22:15:14.038833] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-10T22:15:14.038922] [INFO ] [MAIN ] Update Progress: 2240/2373 symbols completed. VLTO took 29.2s. Estimated remaining: 18m 43s. Rate: 7.1 symbols/min [2025-10-10T22:15:14.972288] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:15:14.989759] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:15:15.040579] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:15:15.045817] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:15:15.064162] [DEBUG] [LOCAL ] VNCE: Loaded 8599 existing records from primary storage. [2025-10-10T22:15:15.064790] [INFO ] [MAIN ] VNCE: Loaded 8599 existing records. [2025-10-10T22:15:15.114084] [DEBUG] [LOCAL ] VMI: Loaded 15383 existing records from primary storage. [2025-10-10T22:15:15.136299] [INFO ] [MAIN ] VMI: Loaded 15383 existing records. [2025-10-10T22:15:15.232949] [DEBUG] [LOCAL ] VMO: Loaded 21053 existing records from primary storage. [2025-10-10T22:15:15.268050] [INFO ] [MAIN ] VMO: Loaded 21053 existing records. [2025-10-10T22:15:15.463795] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:15:15.497713] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-10-10T22:15:15.503042] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-10-10T22:15:15.534888] [DEBUG] [LOCAL ] VMC: Loaded 43080 existing records from primary storage. [2025-10-10T22:15:15.560985] [INFO ] [MAIN ] VMC: Loaded 43080 existing records. [2025-10-10T22:15:15.560861] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-10-10T22:15:15.720623] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-10-10T22:15:15.718876] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:15:15.796795] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:15:15.840746] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-10T22:15:15.859532] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-10T22:15:15.854325] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-10T22:15:15.878376] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-10T22:15:15.892297] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-10T22:15:15.897668] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-10T22:15:15.971974] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-10T22:15:15.974324] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-10T22:15:16.063728] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:15:16.118338] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-10T22:15:16.123620] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-10T22:15:16.169406] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-10T22:15:16.190010] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-10T22:15:16.849333] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:15:16.900490] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-10-10T22:15:17.174198] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:15:17.174833] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-10-10T22:15:17.332364] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:15:17.337780] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-10-10T22:15:17.337407] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:15:17.338903] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-10-10T22:15:18.308972] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-10T22:15:18.312414] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-10T22:15:18.416530] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-10T22:15:18.421198] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-10-10T22:15:18.525205] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-10T22:15:18.530997] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-10T22:15:19.144537] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T22:15:19.153348] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-10T22:15:19.162034] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-10T22:15:19.165358] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-10T22:15:19.732251] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-10T22:15:19.737193] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-10T22:15:19.876976] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T22:15:19.883113] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-10-10T22:15:20.001755] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-10T22:15:20.004943] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-10T22:15:20.677940] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-10T22:15:20.686587] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-10T22:15:20.732187] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-10T22:15:20.738769] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-10T22:15:20.829510] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-10T22:15:20.832772] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-10-10T22:15:21.344967] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-10T22:15:21.349862] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-10T22:15:21.571576] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-10T22:15:21.574420] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-10-10T22:15:21.955013] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-10T22:15:21.960973] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-10T22:15:22.038256] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-10T22:15:22.040318] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-10-10T22:15:22.552846] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-10T22:15:22.561941] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-10T22:15:22.668088] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T22:15:22.672903] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-10T22:15:22.815243] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-10T22:15:22.819168] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-10-10T22:15:22.836686] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-10T22:15:23.489387] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-10T22:15:23.731146] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-10T22:15:23.773867] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-10T22:15:24.274563] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-10T22:15:24.295029] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-10T22:15:24.324917] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T22:15:25.089406] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-10-10T22:15:25.588687] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-10T22:15:25.866546] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-10T22:15:25.889392] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-10T22:15:26.689387] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-10-10T22:15:27.110992] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T22:15:27.360964] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-10T22:15:27.489357] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-10T22:15:28.289354] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-10T22:15:28.694419] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-10T22:15:29.089358] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-10T22:15:29.489580] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-10T22:15:29.889346] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-10-10T22:15:30.314927] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-10T22:15:30.689345] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-10T22:15:31.489397] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-10T22:15:31.517786] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T22:15:31.981885] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T22:15:32.289415] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-10. [2025-10-10T22:15:32.714223] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T22:15:33.089430] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-10T22:15:33.252137] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T22:15:33.254457] [INFO ] [REMOTE ] VNCE: Full fetch complete (15849 records). [2025-10-10T22:15:33.254527] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-10-10T22:15:33.604183] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-10-10T22:15:33.604259] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-10-10T22:15:33.604683] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-10-10T22:15:33.604768] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-10-10T22:15:33.605230] [DEBUG] [LOCAL ] VNCE: Trimmed 15849 records to 8751 (keeping 200 days of data) [2025-10-10T22:15:33.653018] [DEBUG] [LOCAL ] VNCE: Primary data saved (8751 records). [2025-10-10T22:15:33.653121] [INFO ] [MAIN ] VNCE: Full history saved. [2025-10-10T22:15:33.653201] [INFO ] [MAIN ] Update Progress: 2241/2373 symbols completed. VNCE took 19.6s. Estimated remaining: 18m 35s. Rate: 7.1 symbols/min [2025-10-10T22:15:33.821882] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:15:33.866348] [DEBUG] [LOCAL ] VNO: Loaded 49196 existing records from primary storage. [2025-10-10T22:15:33.866665] [INFO ] [MAIN ] VNO: Loaded 49196 existing records. [2025-10-10T22:15:33.896637] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-10T22:15:34.040937] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:15:34.041138] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-10T22:15:34.041184] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-10T22:15:34.041395] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-10T22:15:34.041450] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-10T22:15:34.388532] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:15:34.689345] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-10-10T22:15:35.141699] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-10T22:15:35.188365] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T22:15:35.489387] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-10T22:15:36.289422] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-10T22:15:36.581290] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-10T22:15:36.582958] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T22:15:36.595830] [INFO ] [REMOTE ] VMO: Full fetch complete (31186 records). [2025-10-10T22:15:36.595960] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-10T22:15:36.955498] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-10T22:15:36.955575] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-10T22:15:36.956286] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-10T22:15:36.956352] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-10T22:15:36.957167] [DEBUG] [LOCAL ] VMO: Trimmed 31186 records to 21176 (keeping 200 days of data) [2025-10-10T22:15:37.083632] [DEBUG] [LOCAL ] VMO: Primary data saved (21176 records). [2025-10-10T22:15:37.083789] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-10T22:15:37.083871] [INFO ] [MAIN ] Update Progress: 2242/2373 symbols completed. VMO took 23.0s. Estimated remaining: 18m 26s. Rate: 7.1 symbols/min [2025-10-10T22:15:37.094753] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-10T22:15:37.251366] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:15:37.292151] [DEBUG] [LOCAL ] VNT: Loaded 43984 existing records from primary storage. [2025-10-10T22:15:37.292466] [INFO ] [MAIN ] VNT: Loaded 43984 existing records. [2025-10-10T22:15:37.466874] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:15:37.467143] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-10T22:15:37.467196] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-10T22:15:37.467448] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-10T22:15:37.467498] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-10T22:15:37.813316] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:15:37.889339] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-10-10T22:15:38.088108] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T22:15:38.089935] [INFO ] [REMOTE ] VMI: Full fetch complete (21045 records). [2025-10-10T22:15:38.090012] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-10T22:15:38.484491] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-10T22:15:38.484589] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-10T22:15:38.485115] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-10T22:15:38.485251] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-10T22:15:38.487362] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-10T22:15:38.487458] [DEBUG] [LOCAL ] VMI: Trimmed 21045 records to 15456 (keeping 200 days of data) [2025-10-10T22:15:38.595419] [DEBUG] [LOCAL ] VMI: Primary data saved (15456 records). [2025-10-10T22:15:38.595553] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-10T22:15:38.595634] [INFO ] [MAIN ] Update Progress: 2243/2373 symbols completed. VMI took 24.6s. Estimated remaining: 18m 17s. Rate: 7.1 symbols/min [2025-10-10T22:15:38.694451] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-10T22:15:38.766909] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:15:38.778061] [DEBUG] [LOCAL ] VOC: Loaded 9062 existing records from primary storage. [2025-10-10T22:15:38.778312] [INFO ] [MAIN ] VOC: Loaded 9062 existing records. [2025-10-10T22:15:38.958552] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:15:38.958835] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-10T22:15:38.958896] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-10T22:15:38.959118] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-10T22:15:38.959228] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-10T22:15:39.310095] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:15:39.489342] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-10-10T22:15:39.581585] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-10T22:15:40.289370] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-10T22:15:40.393282] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-10T22:15:40.576453] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T22:15:41.089404] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-10T22:15:41.889343] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-10T22:15:42.419611] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-10T22:15:42.689366] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-10T22:15:42.792409] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-10T22:15:42.821362] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T22:15:43.489416] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-10T22:15:44.289371] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-10T22:15:44.433045] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-10T22:15:44.807297] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-10T22:15:45.089485] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-10T22:15:45.258020] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T22:15:45.889394] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-10T22:15:46.086774] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-10T22:15:46.689397] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-10T22:15:47.489355] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-10T22:15:47.712216] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-10T22:15:47.746411] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T22:15:48.289396] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-10T22:15:48.939493] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-10T22:15:49.089371] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-10T22:15:49.815307] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-10T22:15:49.889352] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-10T22:15:50.689386] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-10T22:15:50.911404] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T22:15:51.489402] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-10T22:15:51.623450] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-10T22:15:51.811422] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T22:15:52.289421] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-10T22:15:53.089355] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-10T22:15:53.209991] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-10T22:15:53.278368] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-10T22:15:53.889395] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-10T22:15:54.689367] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-10T22:15:54.770199] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T22:15:54.850947] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-10T22:15:55.418623] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T22:15:55.422572] [INFO ] [REMOTE ] VMC: Full fetch complete (62159 records). [2025-10-10T22:15:55.422709] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-10T22:15:55.494709] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-10T22:15:55.801583] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-10T22:15:55.801695] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-10T22:15:55.802785] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-10T22:15:55.802849] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-10T22:15:55.804116] [DEBUG] [LOCAL ] VMC: Trimmed 62159 records to 43347 (keeping 200 days of data) [2025-10-10T22:15:56.073014] [DEBUG] [LOCAL ] VMC: Primary data saved (43347 records). [2025-10-10T22:15:56.073143] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-10T22:15:56.073220] [INFO ] [MAIN ] Update Progress: 2244/2373 symbols completed. VMC took 42.0s. Estimated remaining: 18m 9s. Rate: 7.1 symbols/min [2025-10-10T22:15:56.241284] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:15:56.280154] [DEBUG] [LOCAL ] VOYA: Loaded 42548 existing records from primary storage. [2025-10-10T22:15:56.280490] [INFO ] [MAIN ] VOYA: Loaded 42548 existing records. [2025-10-10T22:15:56.294626] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-10T22:15:56.458123] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:15:56.458357] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-10T22:15:56.458405] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-10T22:15:56.458608] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-10T22:15:56.458677] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-10T22:15:56.804675] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:15:57.089348] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-10-10T22:15:57.424921] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-10T22:15:57.889412] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-10T22:15:58.310916] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T22:15:58.689356] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-10T22:15:58.844256] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-10T22:15:58.924861] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T22:15:59.489375] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-10T22:16:00.289390] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-10T22:16:00.499171] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T22:16:01.089401] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-10T22:16:01.407467] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T22:16:01.437546] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-10T22:16:01.889412] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-10T22:16:02.689435] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-10T22:16:02.900129] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-10T22:16:03.489393] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-10T22:16:03.552452] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-10T22:16:03.553965] [INFO ] [REMOTE ] VOC: Full fetch complete (13172 records). [2025-10-10T22:16:03.554040] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-10T22:16:03.867876] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T22:16:03.967713] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-10T22:16:03.967803] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-10T22:16:03.968223] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-10T22:16:03.968265] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-10T22:16:03.968846] [DEBUG] [LOCAL ] VOC: Trimmed 13172 records to 9114 (keeping 200 days of data) [2025-10-10T22:16:04.022524] [DEBUG] [LOCAL ] VOC: Primary data saved (9114 records). [2025-10-10T22:16:04.022695] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-10T22:16:04.022795] [INFO ] [MAIN ] Update Progress: 2245/2373 symbols completed. VOC took 25.4s. Estimated remaining: 18m 1s. Rate: 7.1 symbols/min [2025-10-10T22:16:04.189275] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:16:04.189453] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-10T22:16:04.189491] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-10T22:16:04.189627] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-10T22:16:04.189701] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-10T22:16:04.189754] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-10T22:16:04.189787] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-10T22:16:04.294571] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-10T22:16:04.585000] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:16:05.089382] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-10-10T22:16:05.235869] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-10T22:16:05.355081] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T22:16:05.355762] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-10-10T22:16:05.355903] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T22:16:05.355983] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-10T22:16:05.356059] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T22:16:05.356140] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-10T22:16:05.356220] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-10T22:16:05.356259] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-10T22:16:05.356457] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-10T22:16:05.356710] [INFO ] [MAIN ] Update Progress: 2246/2373 symbols completed. VOYG took 1.3s. Estimated remaining: 17m 52s. Rate: 7.1 symbols/min [2025-10-10T22:16:05.525633] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:16:05.543971] [DEBUG] [LOCAL ] VPG: Loaded 17148 existing records from primary storage. [2025-10-10T22:16:05.544242] [INFO ] [MAIN ] VPG: Loaded 17148 existing records. [2025-10-10T22:16:05.721074] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:16:05.721301] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-10T22:16:05.721348] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-10T22:16:05.721515] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-10T22:16:05.721552] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-10T22:16:05.889350] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-10T22:16:06.113026] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:16:06.248829] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-10T22:16:06.689445] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-10-10T22:16:07.489372] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-10T22:16:07.777728] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-10T22:16:07.854979] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-10T22:16:08.289444] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-10T22:16:08.813127] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-10T22:16:09.089396] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-10T22:16:09.889387] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-10T22:16:10.067217] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T22:16:10.689462] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-10T22:16:10.785068] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-10T22:16:10.789773] [INFO ] [REMOTE ] VNO: Full fetch complete (70336 records). [2025-10-10T22:16:10.789879] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-10T22:16:11.174785] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-10T22:16:11.174862] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-10T22:16:11.176073] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-10T22:16:11.176135] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-10T22:16:11.177511] [DEBUG] [LOCAL ] VNO: Trimmed 70336 records to 49551 (keeping 200 days of data) [2025-10-10T22:16:11.489688] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-10T22:16:11.493970] [DEBUG] [LOCAL ] VNO: Primary data saved (49551 records). [2025-10-10T22:16:11.494153] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-10T22:16:11.494278] [INFO ] [MAIN ] Update Progress: 2247/2373 symbols completed. VNO took 37.8s. Estimated remaining: 17m 44s. Rate: 7.1 symbols/min [2025-10-10T22:16:11.685912] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:16:11.695137] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-10T22:16:11.725206] [DEBUG] [LOCAL ] VPV: Loaded 5450 existing records from primary storage. [2025-10-10T22:16:11.728198] [INFO ] [MAIN ] VPV: Loaded 5450 existing records. [2025-10-10T22:16:11.773092] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T22:16:11.919202] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:16:11.919420] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-10T22:16:11.919466] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-10T22:16:11.919615] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-10T22:16:11.919739] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-10T22:16:12.276676] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:16:12.289343] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-10-10T22:16:12.907815] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-10T22:16:13.089367] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-10T22:16:13.250176] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-10T22:16:13.889409] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-10T22:16:14.538628] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T22:16:14.543305] [INFO ] [REMOTE ] VNT: Full fetch complete (63527 records). [2025-10-10T22:16:14.543406] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-10T22:16:14.694558] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-10T22:16:14.933038] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-10T22:16:14.933115] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-10T22:16:14.934211] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-10T22:16:14.934272] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-10T22:16:14.935491] [DEBUG] [LOCAL ] VNT: Trimmed 63527 records to 44351 (keeping 200 days of data) [2025-10-10T22:16:15.211717] [DEBUG] [LOCAL ] VNT: Primary data saved (44351 records). [2025-10-10T22:16:15.211849] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-10T22:16:15.212149] [INFO ] [MAIN ] Update Progress: 2248/2373 symbols completed. VNT took 38.1s. Estimated remaining: 17m 35s. Rate: 7.1 symbols/min [2025-10-10T22:16:15.382467] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:16:15.418608] [DEBUG] [LOCAL ] VRE: Loaded 35315 existing records from primary storage. [2025-10-10T22:16:15.418915] [INFO ] [MAIN ] VRE: Loaded 35315 existing records. [2025-10-10T22:16:15.492667] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-10T22:16:15.602278] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:16:15.602674] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-10T22:16:15.602781] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-10T22:16:15.603004] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-10T22:16:15.603061] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-10T22:16:15.778298] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-10T22:16:15.929908] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T22:16:16.001950] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:16:16.012484] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-10T22:16:16.289389] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-10-10T22:16:17.089373] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-10T22:16:17.840703] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-10T22:16:17.889380] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-10T22:16:17.986547] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-10T22:16:18.689380] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-10T22:16:19.440020] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-10T22:16:19.489464] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-10T22:16:19.776004] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-10T22:16:20.289394] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-10T22:16:20.464503] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-10T22:16:21.089436] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-10T22:16:21.889415] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-10T22:16:21.994870] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-10T22:16:22.080392] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-10T22:16:22.473541] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-10T22:16:22.689433] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-10T22:16:23.489407] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-10T22:16:24.294461] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-10T22:16:24.307010] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T22:16:24.871262] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-10T22:16:25.089377] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-10T22:16:25.889369] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-10T22:16:26.109340] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T22:16:26.191566] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-10T22:16:26.689385] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-10T22:16:27.040307] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T22:16:27.489383] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-10T22:16:27.966427] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T22:16:28.289365] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-10T22:16:28.447540] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-10T22:16:29.089357] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-10T22:16:29.889372] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-10T22:16:30.074539] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T22:16:30.154839] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-10T22:16:30.630472] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-10T22:16:30.689334] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-10T22:16:31.443231] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-10T22:16:31.489417] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-10T22:16:32.289372] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-10T22:16:33.004569] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-10T22:16:33.089491] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-10T22:16:33.219048] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T22:16:33.889372] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-10T22:16:34.213373] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-10T22:16:34.689377] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-10T22:16:35.482847] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-10T22:16:35.489700] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-10T22:16:35.767503] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-10T22:16:36.282630] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-10T22:16:36.289321] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-10T22:16:37.089413] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-10T22:16:37.126220] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-10T22:16:37.889378] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-10T22:16:38.689374] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-10T22:16:38.694941] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-10T22:16:38.696665] [INFO ] [REMOTE ] VPG: Full fetch complete (22673 records). [2025-10-10T22:16:38.696803] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-10T22:16:38.826863] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-10T22:16:39.097033] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-10T22:16:39.097113] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-10T22:16:39.097632] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-10T22:16:39.097707] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-10T22:16:39.098392] [DEBUG] [LOCAL ] VPG: Trimmed 22673 records to 17234 (keeping 200 days of data) [2025-10-10T22:16:39.198595] [DEBUG] [LOCAL ] VPG: Primary data saved (17234 records). [2025-10-10T22:16:39.198773] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-10T22:16:39.198865] [INFO ] [MAIN ] Update Progress: 2249/2373 symbols completed. VPG took 33.8s. Estimated remaining: 17m 27s. Rate: 7.1 symbols/min [2025-10-10T22:16:39.368397] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-10T22:16:39.371696] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:16:39.373417] [INFO ] [REMOTE ] VPV: Full fetch complete (9099 records). [2025-10-10T22:16:39.373498] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-10T22:16:39.494534] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-10T22:16:39.781871] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-10T22:16:39.781988] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-10T22:16:39.783465] [DEBUG] [LOCAL ] VRT: Loaded 54143 existing records from primary storage. [2025-10-10T22:16:39.782258] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-10T22:16:39.783570] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-10T22:16:39.783936] [INFO ] [MAIN ] VRT: Loaded 54143 existing records. [2025-10-10T22:16:39.827957] [DEBUG] [LOCAL ] VPV: Trimmed 9099 records to 5516 (keeping 200 days of data) [2025-10-10T22:16:40.001089] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:16:40.004764] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-10T22:16:40.005410] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-10T22:16:40.006407] [DEBUG] [LOCAL ] VPV: Primary data saved (5516 records). [2025-10-10T22:16:40.006583] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-10T22:16:40.006703] [INFO ] [MAIN ] Update Progress: 2250/2373 symbols completed. VPV took 28.5s. Estimated remaining: 17m 18s. Rate: 7.1 symbols/min [2025-10-10T22:16:40.038389] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-10T22:16:40.076548] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-10T22:16:40.296979] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-10T22:16:40.330821] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:16:40.497383] [DEBUG] [LOCAL ] VRTS: Loaded 9355 existing records from primary storage. [2025-10-10T22:16:40.508551] [INFO ] [MAIN ] VRTS: Loaded 9355 existing records. [2025-10-10T22:16:40.773058] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:16:40.810227] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:16:40.810451] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-10T22:16:40.810500] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-10T22:16:40.810743] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-10T22:16:40.810805] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-10T22:16:41.109402] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-10-10T22:16:41.183347] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:16:41.184595] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-10T22:16:41.189609] [INFO ] [REMOTE ] VOYA: Full fetch complete (61611 records). [2025-10-10T22:16:41.189761] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-10T22:16:41.576068] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-10T22:16:41.576151] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-10T22:16:41.577325] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-10T22:16:41.577389] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-10T22:16:41.578726] [DEBUG] [LOCAL ] VOYA: Trimmed 61611 records to 42862 (keeping 200 days of data) [2025-10-10T22:16:41.846668] [DEBUG] [LOCAL ] VOYA: Primary data saved (42862 records). [2025-10-10T22:16:41.846805] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-10T22:16:41.846911] [INFO ] [MAIN ] Update Progress: 2251/2373 symbols completed. VOYA took 45.8s. Estimated remaining: 17m 10s. Rate: 7.1 symbols/min [2025-10-10T22:16:41.893012] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-10-10T22:16:42.026166] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:16:42.049197] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-10T22:16:42.103134] [DEBUG] [LOCAL ] VSCO: Loaded 53132 existing records from primary storage. [2025-10-10T22:16:42.103487] [INFO ] [MAIN ] VSCO: Loaded 53132 existing records. [2025-10-10T22:16:42.280511] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:16:42.280760] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-10T22:16:42.280820] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-10T22:16:42.281104] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-10T22:16:42.281159] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-10T22:16:42.644008] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:16:42.682238] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-10T22:16:42.689321] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-10T22:16:43.456338] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-10T22:16:43.489336] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-10T22:16:43.536456] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-10T22:16:44.289439] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-10T22:16:45.047950] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-10T22:16:45.089364] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-10T22:16:45.889391] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-10T22:16:46.053553] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-10T22:16:46.110932] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-10T22:16:46.689375] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-10T22:16:47.489427] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-10-10T22:16:47.490537] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-10T22:16:47.588670] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-10T22:16:48.289392] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-10T22:16:49.089387] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-10T22:16:49.345604] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T22:16:49.889433] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-10T22:16:50.383952] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T22:16:50.689381] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-10T22:16:50.873358] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-10T22:16:51.448363] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-10T22:16:51.489346] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-10T22:16:51.903510] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-10T22:16:52.289363] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-10T22:16:52.625945] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T22:16:53.089370] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-10T22:16:53.826179] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-10T22:16:53.830001] [INFO ] [REMOTE ] VRE: Full fetch complete (48362 records). [2025-10-10T22:16:53.830123] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-10T22:16:53.894339] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-10T22:16:54.029074] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-10T22:16:54.263920] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-10T22:16:54.264009] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-10T22:16:54.265219] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-10T22:16:54.265289] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-10T22:16:54.266527] [DEBUG] [LOCAL ] VRE: Trimmed 48362 records to 35549 (keeping 200 days of data) [2025-10-10T22:16:54.513546] [DEBUG] [LOCAL ] VRE: Primary data saved (35549 records). [2025-10-10T22:16:54.513768] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-10T22:16:54.513881] [INFO ] [MAIN ] Update Progress: 2252/2373 symbols completed. VRE took 39.3s. Estimated remaining: 17m 1s. Rate: 7.1 symbols/min [2025-10-10T22:16:54.694595] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-10T22:16:54.696916] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:16:54.750781] [DEBUG] [LOCAL ] VSH: Loaded 48557 existing records from primary storage. [2025-10-10T22:16:54.751251] [INFO ] [MAIN ] VSH: Loaded 48557 existing records. [2025-10-10T22:16:54.939830] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:16:54.940123] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-10T22:16:54.940177] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-10T22:16:54.940408] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-10T22:16:54.940450] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-10T22:16:55.313875] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:16:55.489367] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-10T22:16:55.604890] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T22:16:55.731439] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T22:16:56.289441] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-10T22:16:57.089386] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-10T22:16:57.177351] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-10T22:16:57.889413] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-10-10T22:16:58.270889] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-10-10T22:16:58.689366] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-10T22:16:59.085794] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T22:16:59.489430] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-10T22:16:59.836887] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T22:17:00.289399] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-10T22:17:01.021890] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T22:17:01.023244] [INFO ] [REMOTE ] VRTS: Full fetch complete (11488 records). [2025-10-10T22:17:01.023321] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-10T22:17:01.098092] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-10T22:17:01.448801] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-10T22:17:01.448999] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-10T22:17:01.449692] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-10T22:17:01.449825] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-10T22:17:01.450625] [DEBUG] [LOCAL ] VRTS: Trimmed 11488 records to 9421 (keeping 200 days of data) [2025-10-10T22:17:01.533174] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-10-10T22:17:01.562624] [DEBUG] [LOCAL ] VRTS: Primary data saved (9421 records). [2025-10-10T22:17:01.562775] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-10T22:17:01.562884] [INFO ] [MAIN ] Update Progress: 2253/2373 symbols completed. VRTS took 21.6s. Estimated remaining: 16m 53s. Rate: 7.1 symbols/min [2025-10-10T22:17:01.734356] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:17:01.845910] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-10T22:17:01.875851] [DEBUG] [LOCAL ] VST: Loaded 54102 existing records from primary storage. [2025-10-10T22:17:01.876185] [INFO ] [MAIN ] VST: Loaded 54102 existing records. [2025-10-10T22:17:01.896226] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-10T22:17:02.052229] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:17:02.052475] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-10T22:17:02.052533] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-10T22:17:02.053188] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-10T22:17:02.053246] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-10T22:17:02.422860] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:17:02.570015] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-10T22:17:02.689450] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-10T22:17:03.489354] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-10T22:17:04.153488] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-10T22:17:04.279516] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T22:17:04.289516] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-10T22:17:05.089366] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-10T22:17:05.889338] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-10-10T22:17:06.248596] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-10-10T22:17:06.288569] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-10T22:17:06.689360] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-10T22:17:06.917743] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-10T22:17:07.489389] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-10T22:17:08.289397] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-10T22:17:08.577691] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-10-10T22:17:08.679431] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T22:17:09.089403] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-10T22:17:09.544996] [DEBUG] [REMOTE ] VST: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-10T22:17:09.545333] [WARN ] [REMOTE ] VST: No data returned for month 2025-01 [2025-10-10T22:17:09.545461] [FATAL] [REMOTE ] VST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T22:17:09.545541] [FATAL] [MAIN ] VST: Failed to fetch primary data. [2025-10-10T22:17:09.545576] [WARN ] [MAIN ] VST: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T22:17:09.545613] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-10T22:17:09.545703] [DEBUG] [LOCAL ] VST: No primary data file found to delete. [2025-10-10T22:17:09.545756] [INFO ] [LOCAL ] VST: Starting deletion of derivative data. [2025-10-10T22:17:09.546340] [DEBUG] [LOCAL ] VST: Deleted derivative data file. [2025-10-10T22:17:09.547206] [INFO ] [MAIN ] Update Progress: 2254/2373 symbols completed. VST took 8.0s. Estimated remaining: 16m 44s. Rate: 7.1 symbols/min [2025-10-10T22:17:09.752237] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:17:09.759615] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-10T22:17:09.816796] [DEBUG] [LOCAL ] VSTS: Loaded 49305 existing records from primary storage. [2025-10-10T22:17:09.817203] [INFO ] [MAIN ] VSTS: Loaded 49305 existing records. [2025-10-10T22:17:09.890316] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-10T22:17:10.006143] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:17:10.006666] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-10T22:17:10.006735] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-10T22:17:10.007004] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-10T22:17:10.007063] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-10T22:17:10.372018] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:17:10.399613] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T22:17:10.689372] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-10T22:17:11.489361] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-10-10T22:17:11.863572] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T22:17:12.289435] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-10T22:17:13.089419] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-10T22:17:13.377273] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T22:17:13.571009] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-10-10T22:17:13.889403] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-10T22:17:14.136277] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T22:17:14.689405] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-10T22:17:15.269038] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-10T22:17:15.489491] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-10T22:17:15.785680] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T22:17:16.289473] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-10T22:17:16.563255] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-10T22:17:16.569073] [INFO ] [REMOTE ] VSCO: Full fetch complete (76219 records). [2025-10-10T22:17:16.569353] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-10T22:17:16.988572] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-10T22:17:16.988723] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-10T22:17:16.990402] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-10T22:17:16.990551] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-10T22:17:16.992205] [DEBUG] [LOCAL ] VSCO: Trimmed 76219 records to 53514 (keeping 200 days of data) [2025-10-10T22:17:17.089518] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-10T22:17:17.244771] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-10T22:17:17.400192] [DEBUG] [LOCAL ] VSCO: Primary data saved (53514 records). [2025-10-10T22:17:17.400352] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-10T22:17:17.400449] [INFO ] [MAIN ] Update Progress: 2255/2373 symbols completed. VSCO took 35.6s. Estimated remaining: 16m 36s. Rate: 7.1 symbols/min [2025-10-10T22:17:17.577558] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:17:17.618417] [DEBUG] [LOCAL ] VTEX: Loaded 43274 existing records from primary storage. [2025-10-10T22:17:17.618804] [INFO ] [MAIN ] VTEX: Loaded 43274 existing records. [2025-10-10T22:17:17.807136] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:17:17.807591] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-10T22:17:17.807880] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-10T22:17:17.808162] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-10T22:17:17.808223] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-10T22:17:17.896613] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-10T22:17:18.178965] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T22:17:18.226869] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:17:18.689416] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-10-10T22:17:19.489487] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-10T22:17:19.554919] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-10T22:17:19.773176] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-10-10T22:17:20.289444] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-10T22:17:20.349107] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-10T22:17:20.810076] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T22:17:21.089436] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-10T22:17:21.630922] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-10T22:17:21.889444] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-10T22:17:22.689413] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-10T22:17:23.489416] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-10T22:17:23.752249] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-10T22:17:23.918906] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-10T22:17:24.294075] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-10T22:17:24.299507] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-10T22:17:24.719834] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-10T22:17:25.089434] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-10T22:17:25.889426] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-10T22:17:26.689366] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-10T22:17:26.775266] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-10T22:17:26.802457] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-10T22:17:26.808486] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-10-10T22:17:26.808765] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-10T22:17:27.212557] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-10T22:17:27.212690] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-10T22:17:27.214141] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-10T22:17:27.214206] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-10T22:17:27.217020] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 54533 (keeping 200 days of data) [2025-10-10T22:17:27.490699] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-10T22:17:27.600219] [DEBUG] [LOCAL ] VRT: Primary data saved (54533 records). [2025-10-10T22:17:27.600410] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-10T22:17:27.600515] [INFO ] [MAIN ] Update Progress: 2256/2373 symbols completed. VRT took 48.4s. Estimated remaining: 16m 28s. Rate: 7.1 symbols/min [2025-10-10T22:17:27.787291] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:17:27.837758] [DEBUG] [LOCAL ] VTLE: Loaded 48528 existing records from primary storage. [2025-10-10T22:17:27.838140] [INFO ] [MAIN ] VTLE: Loaded 48528 existing records. [2025-10-10T22:17:28.075387] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:17:28.075851] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-10T22:17:28.075931] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-10T22:17:28.087448] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-10T22:17:28.092870] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-10T22:17:28.180235] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-10T22:17:28.307162] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-10T22:17:28.435867] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T22:17:28.494911] [INFO ] [REMOTE ] VSH: Full fetch complete (70771 records). [2025-10-10T22:17:28.518244] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-10T22:17:28.524338] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:17:28.918757] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-10T22:17:28.918937] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-10T22:17:28.920208] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-10T22:17:28.920368] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-10T22:17:28.953165] [DEBUG] [LOCAL ] VSH: Trimmed 70771 records to 48908 (keeping 200 days of data) [2025-10-10T22:17:28.955466] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-10T22:17:29.093704] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-10T22:17:29.292778] [DEBUG] [LOCAL ] VSH: Primary data saved (48908 records). [2025-10-10T22:17:29.292990] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-10T22:17:29.293292] [INFO ] [MAIN ] Update Progress: 2257/2373 symbols completed. VSH took 34.8s. Estimated remaining: 16m 19s. Rate: 7.1 symbols/min [2025-10-10T22:17:29.471690] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:17:29.492609] [DEBUG] [LOCAL ] VTMX: Loaded 17652 existing records from primary storage. [2025-10-10T22:17:29.492962] [INFO ] [MAIN ] VTMX: Loaded 17652 existing records. [2025-10-10T22:17:29.674819] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:17:29.675068] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-10T22:17:29.675123] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-10T22:17:29.675314] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-10T22:17:29.675352] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-10T22:17:29.896495] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-10-10T22:17:30.040952] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:17:30.079573] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T22:17:30.305944] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-10T22:17:30.689421] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-10T22:17:31.489407] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-10T22:17:31.770174] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T22:17:31.881785] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-10T22:17:32.289402] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-10T22:17:33.089432] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-10T22:17:33.504317] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-10T22:17:33.623689] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-10T22:17:33.889399] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-10T22:17:34.149231] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-10T22:17:34.689398] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-10T22:17:35.489389] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-10-10T22:17:35.641820] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-10T22:17:36.289350] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-10T22:17:36.401148] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-10T22:17:36.830316] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-10T22:17:37.089376] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-10T22:17:37.889369] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-10T22:17:38.200442] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-10T22:17:38.689386] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-10T22:17:38.980412] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T22:17:39.489386] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-10T22:17:40.046799] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-10T22:17:40.289352] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-10T22:17:40.629951] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T22:17:41.089394] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-10T22:17:41.224379] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T22:17:41.712800] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-10T22:17:41.889367] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-10T22:17:42.689397] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-10T22:17:43.078915] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T22:17:43.279592] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-10T22:17:43.283633] [INFO ] [REMOTE ] VTEX: Full fetch complete (60570 records). [2025-10-10T22:17:43.283802] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-10T22:17:43.494633] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-10T22:17:43.664727] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-10T22:17:43.664817] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-10T22:17:43.665984] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-10T22:17:43.666050] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-10T22:17:43.667434] [DEBUG] [LOCAL ] VTEX: Trimmed 60570 records to 43617 (keeping 200 days of data) [2025-10-10T22:17:43.922631] [DEBUG] [LOCAL ] VTEX: Primary data saved (43617 records). [2025-10-10T22:17:43.922867] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-10T22:17:43.923037] [INFO ] [MAIN ] Update Progress: 2258/2373 symbols completed. VTEX took 26.5s. Estimated remaining: 16m 11s. Rate: 7.1 symbols/min [2025-10-10T22:17:44.114340] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:17:44.125330] [DEBUG] [LOCAL ] VTN: Loaded 7036 existing records from primary storage. [2025-10-10T22:17:44.125603] [INFO ] [MAIN ] VTN: Loaded 7036 existing records. [2025-10-10T22:17:44.291493] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-10T22:17:44.327247] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:17:44.331393] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-10T22:17:44.332282] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-10T22:17:44.332452] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-10T22:17:44.337401] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-10T22:17:44.337915] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-10T22:17:44.351685] [INFO ] [REMOTE ] VSTS: Full fetch complete (69644 records). [2025-10-10T22:17:44.383039] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-10T22:17:45.092902] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:17:45.105391] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-10-10T22:17:45.144600] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-10T22:17:45.145610] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-10T22:17:45.147126] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-10T22:17:45.147322] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-10T22:17:45.150341] [DEBUG] [LOCAL ] VSTS: Trimmed 69644 records to 49658 (keeping 200 days of data) [2025-10-10T22:17:45.447159] [DEBUG] [LOCAL ] VSTS: Primary data saved (49658 records). [2025-10-10T22:17:45.447355] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-10T22:17:45.447470] [INFO ] [MAIN ] Update Progress: 2259/2373 symbols completed. VSTS took 35.9s. Estimated remaining: 16m 2s. Rate: 7.1 symbols/min [2025-10-10T22:17:45.580245] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-10T22:17:45.602986] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T22:17:45.702087] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:17:45.724634] [DEBUG] [LOCAL ] VTOL: Loaded 19596 existing records from primary storage. [2025-10-10T22:17:45.724952] [INFO ] [MAIN ] VTOL: Loaded 19596 existing records. [2025-10-10T22:17:45.896613] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-10T22:17:45.902420] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:17:45.903615] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-10T22:17:45.903696] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-10T22:17:45.903906] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-10T22:17:45.903962] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-10T22:17:46.211136] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-10T22:17:46.290733] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:17:46.689404] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-10-10T22:17:47.489405] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-10T22:17:47.870284] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-10T22:17:47.892873] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-10T22:17:48.261439] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-10T22:17:48.289346] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-10T22:17:49.089489] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-10T22:17:49.451367] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-10T22:17:49.889380] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-10T22:17:50.029859] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-10T22:17:50.689380] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-10T22:17:51.489339] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-10T22:17:51.831270] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-10T22:17:51.910561] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-10T22:17:52.289386] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-10T22:17:52.376418] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-10T22:17:53.089366] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-10T22:17:53.454378] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-10T22:17:53.889364] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-10T22:17:54.292354] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T22:17:54.689364] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-10T22:17:54.769992] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-10T22:17:55.489423] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-10T22:17:55.828574] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-10T22:17:56.289402] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-10T22:17:56.387616] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-10T22:17:57.089384] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-10T22:17:57.148465] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-10T22:17:57.889381] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-10T22:17:58.689392] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-10T22:17:58.803962] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-10T22:17:58.863455] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-10T22:17:59.356964] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-10T22:17:59.489362] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-10T22:18:00.289386] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-10T22:18:01.088785] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T22:18:01.092884] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-10T22:18:01.094838] [INFO ] [REMOTE ] VTLE: Full fetch complete (68731 records). [2025-10-10T22:18:01.095021] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-10T22:18:01.416444] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-10T22:18:01.513974] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-10T22:18:01.514058] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-10T22:18:01.515454] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-10T22:18:01.515519] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-10T22:18:01.518281] [DEBUG] [LOCAL ] VTLE: Trimmed 68731 records to 48858 (keeping 200 days of data) [2025-10-10T22:18:01.849867] [DEBUG] [LOCAL ] VTLE: Primary data saved (48858 records). [2025-10-10T22:18:01.850035] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-10T22:18:01.850151] [INFO ] [MAIN ] Update Progress: 2260/2373 symbols completed. VTLE took 34.2s. Estimated remaining: 15m 54s. Rate: 7.1 symbols/min [2025-10-10T22:18:01.894540] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-10T22:18:02.002576] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-10T22:18:02.069548] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:18:02.124857] [DEBUG] [LOCAL ] VTR: Loaded 53144 existing records from primary storage. [2025-10-10T22:18:02.125264] [INFO ] [MAIN ] VTR: Loaded 53144 existing records. [2025-10-10T22:18:02.307106] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:18:02.307356] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-10T22:18:02.307405] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-10T22:18:02.307860] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-10T22:18:02.307918] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-10T22:18:02.657001] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:18:02.689350] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-10-10T22:18:03.106801] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-10T22:18:03.489422] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-10T22:18:04.289405] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-10T22:18:04.667636] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T22:18:04.858768] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-10T22:18:04.942567] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-10T22:18:04.944494] [INFO ] [REMOTE ] VTMX: Full fetch complete (25588 records). [2025-10-10T22:18:04.944566] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-10T22:18:05.096366] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-10T22:18:05.320518] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-10T22:18:05.320687] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-10T22:18:05.321468] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-10T22:18:05.321533] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-10T22:18:05.322579] [DEBUG] [LOCAL ] VTMX: Trimmed 25588 records to 17778 (keeping 200 days of data) [2025-10-10T22:18:05.432027] [DEBUG] [LOCAL ] VTMX: Primary data saved (17778 records). [2025-10-10T22:18:05.432175] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-10T22:18:05.432261] [INFO ] [MAIN ] Update Progress: 2261/2373 symbols completed. VTMX took 36.1s. Estimated remaining: 15m 45s. Rate: 7.1 symbols/min [2025-10-10T22:18:05.598217] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:18:05.630081] [DEBUG] [LOCAL ] VTS: Loaded 30351 existing records from primary storage. [2025-10-10T22:18:05.630375] [INFO ] [MAIN ] VTS: Loaded 30351 existing records. [2025-10-10T22:18:05.832154] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:18:05.832372] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-10T22:18:05.832420] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-10T22:18:05.832673] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-10T22:18:05.832731] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-10T22:18:05.894529] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-10T22:18:06.183160] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-10T22:18:06.202881] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:18:06.689423] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-10-10T22:18:07.256314] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T22:18:07.489391] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-10T22:18:07.910555] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T22:18:08.289478] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-10T22:18:08.880805] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-10T22:18:09.089372] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-10T22:18:09.710543] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-10T22:18:09.889413] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-10T22:18:10.307162] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-10T22:18:10.689377] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-10T22:18:11.489450] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-10T22:18:11.862799] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-10T22:18:12.049044] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T22:18:12.165394] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-10T22:18:12.289383] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-10T22:18:13.089407] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-10T22:18:13.201288] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-10T22:18:13.889417] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-10T22:18:14.299540] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T22:18:14.689357] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-10T22:18:15.081381] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T22:18:15.489381] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-10T22:18:16.289364] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-10T22:18:16.654103] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-10T22:18:16.893592] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-10T22:18:17.089355] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-10T22:18:17.202722] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-10T22:18:17.889372] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-10T22:18:18.434207] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-10T22:18:18.435397] [INFO ] [REMOTE ] VTN: Full fetch complete (11016 records). [2025-10-10T22:18:18.435465] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-10T22:18:18.689698] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-10T22:18:18.804497] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-10T22:18:18.804576] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-10T22:18:18.804927] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-10T22:18:18.804990] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-10T22:18:18.805410] [DEBUG] [LOCAL ] VTN: Trimmed 11016 records to 7080 (keeping 200 days of data) [2025-10-10T22:18:18.855075] [DEBUG] [LOCAL ] VTN: Primary data saved (7080 records). [2025-10-10T22:18:18.855198] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-10T22:18:18.855282] [INFO ] [MAIN ] Update Progress: 2262/2373 symbols completed. VTN took 34.9s. Estimated remaining: 15m 37s. Rate: 7.1 symbols/min [2025-10-10T22:18:19.025785] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:18:19.057974] [DEBUG] [LOCAL ] VVR: Loaded 31723 existing records from primary storage. [2025-10-10T22:18:19.058258] [INFO ] [MAIN ] VVR: Loaded 31723 existing records. [2025-10-10T22:18:19.239422] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:18:19.240067] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-10T22:18:19.240256] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-10T22:18:19.250684] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-10T22:18:19.264882] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-10T22:18:19.350571] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-10T22:18:19.494593] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-10T22:18:19.641907] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T22:18:19.646114] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:18:19.648323] [INFO ] [REMOTE ] VTOL: Full fetch complete (26030 records). [2025-10-10T22:18:19.648392] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-10T22:18:20.002740] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-10T22:18:20.002821] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-10T22:18:20.003460] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-10T22:18:20.003514] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-10T22:18:20.004251] [DEBUG] [LOCAL ] VTOL: Trimmed 26030 records to 19730 (keeping 200 days of data) [2025-10-10T22:18:20.118116] [DEBUG] [LOCAL ] VTOL: Primary data saved (19730 records). [2025-10-10T22:18:20.118261] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-10T22:18:20.118342] [INFO ] [MAIN ] Update Progress: 2263/2373 symbols completed. VTOL took 34.7s. Estimated remaining: 15m 28s. Rate: 7.1 symbols/min [2025-10-10T22:18:20.284521] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:18:20.289368] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-10-10T22:18:20.331461] [DEBUG] [LOCAL ] VVV: Loaded 50631 existing records from primary storage. [2025-10-10T22:18:20.331805] [INFO ] [MAIN ] VVV: Loaded 50631 existing records. [2025-10-10T22:18:20.507876] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:18:20.508113] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-10T22:18:20.508171] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-10T22:18:20.508364] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-10T22:18:20.508402] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-10T22:18:20.865691] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:18:20.940500] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-10T22:18:21.089382] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-10-10T22:18:21.370438] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-10T22:18:21.889363] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-10T22:18:22.689360] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-10T22:18:23.034919] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T22:18:23.472780] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-10T22:18:23.489321] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-10T22:18:24.289354] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-10T22:18:24.626624] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-10T22:18:24.977285] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-10T22:18:25.089406] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-10T22:18:25.889695] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-10T22:18:25.893935] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-10T22:18:26.689398] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-10T22:18:27.068281] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-10T22:18:27.489387] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-10T22:18:27.580836] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T22:18:28.289392] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-10T22:18:28.461397] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T22:18:29.089385] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-10T22:18:29.637675] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T22:18:29.839058] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-10T22:18:29.889361] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-10T22:18:30.375206] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-10T22:18:30.689368] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-10T22:18:31.431675] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-10T22:18:31.489398] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-10T22:18:32.049679] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-10T22:18:32.289455] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-10T22:18:33.090277] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-10T22:18:33.094671] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-10T22:18:33.889369] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-10T22:18:34.299097] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-10T22:18:34.689424] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-10T22:18:35.059261] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-10T22:18:35.254178] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-10T22:18:35.489388] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-10T22:18:36.289383] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-10T22:18:36.624017] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-10T22:18:37.089351] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-10T22:18:37.308521] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-10T22:18:37.459623] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T22:18:37.889384] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-10T22:18:38.262278] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-10T22:18:38.689455] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-10T22:18:39.489422] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-10T22:18:39.705730] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T22:18:40.160202] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-10T22:18:40.289346] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-10T22:18:40.373386] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T22:18:40.378747] [INFO ] [REMOTE ] VTR: Full fetch complete (76325 records). [2025-10-10T22:18:40.378871] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-10T22:18:40.778197] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-10T22:18:40.778274] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-10T22:18:40.779461] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-10T22:18:40.779523] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-10T22:18:40.781082] [DEBUG] [LOCAL ] VTR: Trimmed 76325 records to 53530 (keeping 200 days of data) [2025-10-10T22:18:41.092463] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-10T22:18:41.116511] [DEBUG] [LOCAL ] VTR: Primary data saved (53530 records). [2025-10-10T22:18:41.116716] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-10T22:18:41.116848] [INFO ] [MAIN ] Update Progress: 2264/2373 symbols completed. VTR took 39.3s. Estimated remaining: 15m 20s. Rate: 7.1 symbols/min [2025-10-10T22:18:41.304342] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:18:41.329698] [DEBUG] [LOCAL ] VVX: Loaded 23044 existing records from primary storage. [2025-10-10T22:18:41.329944] [INFO ] [MAIN ] VVX: Loaded 23044 existing records. [2025-10-10T22:18:41.507001] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:18:41.507323] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-10T22:18:41.507369] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-10T22:18:41.507535] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-10T22:18:41.507591] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-10T22:18:41.854351] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:18:41.889380] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-10T22:18:42.057628] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T22:18:42.681237] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-10T22:18:42.689320] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-10T22:18:43.489368] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-10-10T22:18:43.743474] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-10T22:18:43.942057] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-10T22:18:43.945480] [INFO ] [REMOTE ] VTS: Full fetch complete (41349 records). [2025-10-10T22:18:43.945584] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-10T22:18:44.300536] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-10T22:18:44.357671] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-10T22:18:44.357770] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-10T22:18:44.358759] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-10T22:18:44.358820] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-10T22:18:44.359771] [DEBUG] [LOCAL ] VTS: Trimmed 41349 records to 30552 (keeping 200 days of data) [2025-10-10T22:18:44.563991] [DEBUG] [LOCAL ] VTS: Primary data saved (30552 records). [2025-10-10T22:18:44.564150] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-10T22:18:44.564240] [INFO ] [MAIN ] Update Progress: 2265/2373 symbols completed. VTS took 39.1s. Estimated remaining: 15m 12s. Rate: 7.1 symbols/min [2025-10-10T22:18:44.741538] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:18:44.787699] [DEBUG] [LOCAL ] VYX: Loaded 48885 existing records from primary storage. [2025-10-10T22:18:44.788246] [INFO ] [MAIN ] VYX: Loaded 48885 existing records. [2025-10-10T22:18:44.878605] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T22:18:44.998345] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:18:44.998616] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-10T22:18:44.998701] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-10T22:18:44.998966] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-10T22:18:44.999026] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-10T22:18:45.094580] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-10T22:18:45.391295] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:18:45.889414] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-10T22:18:46.158493] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-10T22:18:46.689371] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-10-10T22:18:46.806340] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-10T22:18:47.081892] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-10T22:18:47.489381] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-10T22:18:48.289355] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-10T22:18:48.534485] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T22:18:49.076843] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-10T22:18:49.085072] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T22:18:49.088819] [INFO ] [REMOTE ] VVR: Full fetch complete (46646 records). [2025-10-10T22:18:49.088900] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-10T22:18:49.094575] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-10T22:18:49.459163] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-10T22:18:49.459255] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-10T22:18:49.460274] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-10T22:18:49.460337] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-10T22:18:49.461357] [DEBUG] [LOCAL ] VVR: Trimmed 46646 records to 32015 (keeping 200 days of data) [2025-10-10T22:18:49.649900] [DEBUG] [LOCAL ] VVR: Primary data saved (32015 records). [2025-10-10T22:18:49.650050] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-10T22:18:49.650135] [INFO ] [MAIN ] Update Progress: 2266/2373 symbols completed. VVR took 30.8s. Estimated remaining: 15m 3s. Rate: 7.1 symbols/min [2025-10-10T22:18:49.813237] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:18:49.863383] [DEBUG] [LOCAL ] VZ: Loaded 54181 existing records from primary storage. [2025-10-10T22:18:49.863740] [INFO ] [MAIN ] VZ: Loaded 54181 existing records. [2025-10-10T22:18:49.894593] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-10T22:18:50.040277] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:18:50.040513] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-10T22:18:50.040563] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-10T22:18:50.040795] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-10T22:18:50.040851] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-10T22:18:50.392212] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:18:50.528440] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-10T22:18:50.689373] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-10-10T22:18:51.489389] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-10T22:18:51.912185] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-10T22:18:52.289337] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-10T22:18:52.740392] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-10T22:18:53.089366] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-10T22:18:53.361836] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-10T22:18:53.889369] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-10T22:18:54.150514] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T22:18:54.259840] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-10T22:18:54.689379] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-10T22:18:55.303297] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-10T22:18:55.489405] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-10T22:18:56.289413] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-10T22:18:57.089396] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-10T22:18:57.273255] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T22:18:57.348099] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-10T22:18:57.889346] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-10T22:18:57.987114] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-10T22:18:57.991934] [INFO ] [REMOTE ] VVV: Full fetch complete (72388 records). [2025-10-10T22:18:57.992038] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-10T22:18:58.398503] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-10T22:18:58.403875] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-10T22:18:58.413283] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-10T22:18:58.414099] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-10T22:18:58.414906] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-10T22:18:58.421773] [DEBUG] [LOCAL ] VVV: Trimmed 72388 records to 51012 (keeping 200 days of data) [2025-10-10T22:18:58.705228] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-10T22:18:58.746532] [DEBUG] [LOCAL ] VVV: Primary data saved (51012 records). [2025-10-10T22:18:58.746743] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-10T22:18:58.746879] [INFO ] [MAIN ] Update Progress: 2267/2373 symbols completed. VVV took 38.6s. Estimated remaining: 14m 55s. Rate: 7.1 symbols/min [2025-10-10T22:18:58.916838] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:18:58.967435] [DEBUG] [LOCAL ] W: Loaded 53828 existing records from primary storage. [2025-10-10T22:18:58.967783] [INFO ] [MAIN ] W: Loaded 53828 existing records. [2025-10-10T22:18:59.149774] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:18:59.150018] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-10T22:18:59.150064] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-10T22:18:59.150254] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-10T22:18:59.150291] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-10T22:18:59.495084] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-10T22:18:59.504350] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:19:00.289396] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-10-10T22:19:00.496861] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-10T22:19:00.655859] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T22:19:00.754910] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-10T22:19:01.089383] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-10T22:19:01.889437] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-10T22:19:02.385937] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-10T22:19:02.689416] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-10T22:19:02.712121] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-10T22:19:03.489412] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-10T22:19:04.289426] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-10T22:19:04.685941] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.80 seconds). [2025-10-10T22:19:04.835579] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-10T22:19:04.973018] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T22:19:05.089396] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-10T22:19:05.889370] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-10T22:19:05.995420] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T22:19:06.689441] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-10T22:19:07.115901] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-10T22:19:07.118518] [INFO ] [REMOTE ] VVX: Full fetch complete (33134 records). [2025-10-10T22:19:07.118599] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-10T22:19:07.496586] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-10T22:19:07.528687] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-10T22:19:07.583093] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-10T22:19:07.583364] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-10T22:19:07.584562] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-10T22:19:07.584690] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-10T22:19:07.586246] [DEBUG] [LOCAL ] VVX: Trimmed 33134 records to 23187 (keeping 200 days of data) [2025-10-10T22:19:07.736366] [DEBUG] [LOCAL ] VVX: Primary data saved (23187 records). [2025-10-10T22:19:07.736558] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-10T22:19:07.736698] [INFO ] [MAIN ] Update Progress: 2268/2373 symbols completed. VVX took 26.6s. Estimated remaining: 14m 46s. Rate: 7.1 symbols/min [2025-10-10T22:19:07.919543] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:19:07.966886] [DEBUG] [LOCAL ] WAB: Loaded 44351 existing records from primary storage. [2025-10-10T22:19:07.967464] [INFO ] [MAIN ] WAB: Loaded 44351 existing records. [2025-10-10T22:19:08.152722] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:19:08.152997] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-10T22:19:08.153047] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-10T22:19:08.153406] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-10T22:19:08.153444] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-10T22:19:08.299919] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-10T22:19:08.543461] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:19:08.585832] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-10T22:19:09.089411] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-10-10T22:19:09.731874] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-10T22:19:09.889399] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-10T22:19:10.689354] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-10T22:19:10.795859] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-10T22:19:10.992316] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T22:19:11.489443] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-10T22:19:11.891277] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T22:19:12.289390] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-10T22:19:12.494531] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-10T22:19:13.089382] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-10T22:19:13.889418] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-10T22:19:14.029795] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-10T22:19:14.172351] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T22:19:14.689438] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-10T22:19:14.958637] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-10T22:19:15.489371] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-10T22:19:16.083400] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-10T22:19:16.289406] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-10T22:19:16.903029] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-10T22:19:17.094503] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-10T22:19:17.109108] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T22:19:17.562079] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-10T22:19:17.889437] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-10T22:19:18.689394] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-10T22:19:19.084629] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T22:19:19.417000] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-10T22:19:19.489404] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-10T22:19:20.289437] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-10T22:19:21.089424] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-10T22:19:21.484541] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-10T22:19:21.710056] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-10T22:19:21.889389] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-10T22:19:22.462618] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-10T22:19:22.689392] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-10T22:19:22.966533] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-10T22:19:23.489399] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-10T22:19:23.973156] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T22:19:24.289380] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-10T22:19:24.524423] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T22:19:25.009905] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-10T22:19:25.015180] [INFO ] [REMOTE ] VYX: Full fetch complete (70074 records). [2025-10-10T22:19:25.015378] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-10T22:19:25.094523] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-10T22:19:25.493300] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-10T22:19:25.493417] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-10T22:19:25.495385] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-10T22:19:25.495482] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-10T22:19:25.497442] [DEBUG] [LOCAL ] VYX: Trimmed 70074 records to 49261 (keeping 200 days of data) [2025-10-10T22:19:25.822805] [DEBUG] [LOCAL ] VYX: Primary data saved (49261 records). [2025-10-10T22:19:25.823003] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-10T22:19:25.823383] [INFO ] [MAIN ] Update Progress: 2269/2373 symbols completed. VYX took 41.3s. Estimated remaining: 14m 38s. Rate: 7.1 symbols/min [2025-10-10T22:19:25.896763] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-10T22:19:26.009133] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:19:26.058179] [DEBUG] [LOCAL ] WAL: Loaded 45558 existing records from primary storage. [2025-10-10T22:19:26.058566] [INFO ] [MAIN ] WAL: Loaded 45558 existing records. [2025-10-10T22:19:26.245325] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:19:26.245846] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-10T22:19:26.245908] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-10T22:19:26.246170] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-10T22:19:26.246229] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-10T22:19:26.643868] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:19:26.689370] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-10-10T22:19:26.779357] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-10T22:19:26.860401] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T22:19:27.489378] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-10T22:19:27.981557] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-10T22:19:28.289372] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-10T22:19:28.548437] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T22:19:28.892788] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-10T22:19:29.056004] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T22:19:29.062503] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-10-10T22:19:29.062835] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-10T22:19:29.097281] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-10T22:19:29.486298] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-10T22:19:29.486421] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-10T22:19:29.488196] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-10T22:19:29.488271] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-10T22:19:29.490347] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 54571 (keeping 200 days of data) [2025-10-10T22:19:29.867475] [DEBUG] [LOCAL ] VZ: Primary data saved (54571 records). [2025-10-10T22:19:29.867751] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-10T22:19:29.867903] [INFO ] [MAIN ] Update Progress: 2270/2373 symbols completed. VZ took 40.2s. Estimated remaining: 14m 30s. Rate: 7.1 symbols/min [2025-10-10T22:19:29.899081] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-10T22:19:30.049734] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:19:30.087861] [DEBUG] [LOCAL ] WAT: Loaded 35717 existing records from primary storage. [2025-10-10T22:19:30.088240] [INFO ] [MAIN ] WAT: Loaded 35717 existing records. [2025-10-10T22:19:30.268887] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:19:30.269275] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-10T22:19:30.269329] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-10T22:19:30.269630] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-10T22:19:30.269750] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-10T22:19:30.632233] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:19:30.689350] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-10T22:19:31.296792] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-10T22:19:31.414437] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-10T22:19:31.489337] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-10T22:19:32.289360] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-10T22:19:32.505388] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T22:19:33.089357] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-10T22:19:33.314309] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T22:19:33.593275] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-10T22:19:33.598702] [INFO ] [REMOTE ] W: Full fetch complete (77390 records). [2025-10-10T22:19:33.598864] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-10T22:19:33.894180] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-10-10T22:19:33.993235] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-10T22:19:33.993328] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-10T22:19:33.994904] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-10T22:19:33.994976] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-10T22:19:33.996631] [DEBUG] [LOCAL ] W: Trimmed 77390 records to 54218 (keeping 200 days of data) [2025-10-10T22:19:34.340134] [DEBUG] [LOCAL ] W: Primary data saved (54218 records). [2025-10-10T22:19:34.340354] [INFO ] [MAIN ] W: Full history saved. [2025-10-10T22:19:34.340527] [INFO ] [MAIN ] Update Progress: 2271/2373 symbols completed. W took 35.6s. Estimated remaining: 14m 21s. Rate: 7.1 symbols/min [2025-10-10T22:19:34.516949] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:19:34.517171] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-10T22:19:34.517240] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-10T22:19:34.517517] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-10T22:19:34.517672] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-10T22:19:34.517801] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-10T22:19:34.517865] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-10T22:19:34.703712] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-10T22:19:34.807904] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-10T22:19:34.926759] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:19:35.494860] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-10-10T22:19:35.504022] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-10T22:19:35.765507] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T22:19:35.766039] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-10-10T22:19:35.766144] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T22:19:35.766194] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-10T22:19:35.766258] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T22:19:35.766336] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-10T22:19:35.766413] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-10T22:19:35.766452] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-10T22:19:35.766492] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-10T22:19:35.766546] [INFO ] [MAIN ] Update Progress: 2272/2373 symbols completed. WBI took 1.4s. Estimated remaining: 14m 12s. Rate: 7.1 symbols/min [2025-10-10T22:19:35.942941] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:19:35.992974] [DEBUG] [LOCAL ] WBS: Loaded 49017 existing records from primary storage. [2025-10-10T22:19:35.993376] [INFO ] [MAIN ] WBS: Loaded 49017 existing records. [2025-10-10T22:19:36.183327] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:19:36.183604] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-10T22:19:36.183684] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-10T22:19:36.183978] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-10T22:19:36.184037] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-10T22:19:36.294694] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-10T22:19:36.569247] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:19:36.627723] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T22:19:37.089439] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-10-10T22:19:37.129752] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-10T22:19:37.135037] [INFO ] [REMOTE ] WAB: Full fetch complete (64115 records). [2025-10-10T22:19:37.135265] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-10T22:19:37.528961] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-10T22:19:37.529066] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-10T22:19:37.530519] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-10T22:19:37.530585] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-10T22:19:37.533158] [DEBUG] [LOCAL ] WAB: Trimmed 64115 records to 44672 (keeping 200 days of data) [2025-10-10T22:19:37.839016] [DEBUG] [LOCAL ] WAB: Primary data saved (44672 records). [2025-10-10T22:19:37.839203] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-10T22:19:37.839305] [INFO ] [MAIN ] Update Progress: 2273/2373 symbols completed. WAB took 30.1s. Estimated remaining: 14m 4s. Rate: 7.1 symbols/min [2025-10-10T22:19:37.896888] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-10T22:19:38.018111] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:19:38.031884] [DEBUG] [LOCAL ] WBX: Loaded 11071 existing records from primary storage. [2025-10-10T22:19:38.032157] [INFO ] [MAIN ] WBX: Loaded 11071 existing records. [2025-10-10T22:19:38.210833] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:19:38.211101] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-10T22:19:38.211153] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-10T22:19:38.211862] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-10T22:19:38.211922] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-10T22:19:38.575993] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:19:38.689354] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-10T22:19:38.936595] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-10T22:19:39.489431] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-10T22:19:39.941363] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T22:19:40.289370] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-10T22:19:40.320743] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T22:19:40.912212] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-10T22:19:41.089368] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-10T22:19:41.889407] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-10T22:19:42.662098] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-10T22:19:42.689344] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-10T22:19:42.852266] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-10T22:19:43.489459] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-10T22:19:43.856205] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-10T22:19:44.289460] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-10-10T22:19:44.794990] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-10T22:19:44.943174] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-10T22:19:45.089386] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-10T22:19:45.889415] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-10T22:19:45.891131] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-10T22:19:46.689416] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-10T22:19:46.963206] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-10T22:19:47.489408] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-10T22:19:47.665331] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T22:19:48.289401] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-10T22:19:48.381201] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T22:19:48.713395] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-10T22:19:49.089434] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-10T22:19:49.889367] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-10T22:19:49.955278] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T22:19:50.689411] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-10T22:19:50.928787] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-10T22:19:51.046093] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T22:19:51.489363] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-10T22:19:52.289380] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-10T22:19:52.430403] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-10T22:19:52.872012] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T22:19:53.089453] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-10T22:19:53.889446] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-10T22:19:53.972947] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-10T22:19:53.979122] [INFO ] [REMOTE ] WAL: Full fetch complete (66716 records). [2025-10-10T22:19:53.979409] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-10T22:19:54.384424] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-10T22:19:54.384603] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-10T22:19:54.386860] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-10T22:19:54.386989] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-10T22:19:54.389189] [DEBUG] [LOCAL ] WAL: Trimmed 66716 records to 45940 (keeping 200 days of data) [2025-10-10T22:19:54.689770] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-10T22:19:54.735857] [DEBUG] [LOCAL ] WAL: Primary data saved (45940 records). [2025-10-10T22:19:54.736001] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-10T22:19:54.736360] [INFO ] [MAIN ] Update Progress: 2274/2373 symbols completed. WAL took 28.9s. Estimated remaining: 13m 55s. Rate: 7.1 symbols/min [2025-10-10T22:19:54.913003] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:19:54.942636] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-10T22:19:54.994115] [DEBUG] [LOCAL ] WCC: Loaded 39384 existing records from primary storage. [2025-10-10T22:19:54.994516] [INFO ] [MAIN ] WCC: Loaded 39384 existing records. [2025-10-10T22:19:55.180259] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:19:55.180609] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-10T22:19:55.180687] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-10T22:19:55.180922] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-10T22:19:55.180978] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-10T22:19:55.464329] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T22:19:55.490183] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-10T22:19:55.575157] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:19:56.161740] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-10T22:19:56.289420] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-10T22:19:57.015980] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-10T22:19:57.089341] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-10T22:19:57.491530] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-10T22:19:57.889401] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-10T22:19:58.689376] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-10-10T22:19:58.988572] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T22:19:59.169013] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-10T22:19:59.489363] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-10T22:20:00.289395] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-10T22:20:00.359694] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-10T22:20:01.089383] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-10T22:20:01.442775] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-10T22:20:01.678337] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-10T22:20:01.889421] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-10T22:20:02.689391] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-10T22:20:02.989679] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T22:20:03.489460] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-10T22:20:03.605322] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-10T22:20:03.863422] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-10T22:20:04.289436] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-10T22:20:05.089402] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-10T22:20:05.352416] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-10T22:20:05.578680] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-10T22:20:05.583791] [INFO ] [REMOTE ] WBS: Full fetch complete (69815 records). [2025-10-10T22:20:05.583936] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-10T22:20:05.894537] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-10T22:20:05.922028] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-10T22:20:06.019989] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-10T22:20:06.020089] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-10T22:20:06.021556] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-10T22:20:06.021627] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-10T22:20:06.023283] [DEBUG] [LOCAL ] WBS: Trimmed 69815 records to 49376 (keeping 200 days of data) [2025-10-10T22:20:06.332942] [DEBUG] [LOCAL ] WBS: Primary data saved (49376 records). [2025-10-10T22:20:06.333103] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-10T22:20:06.333198] [INFO ] [MAIN ] Update Progress: 2275/2373 symbols completed. WBS took 30.6s. Estimated remaining: 13m 47s. Rate: 7.1 symbols/min [2025-10-10T22:20:06.509583] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:20:06.559401] [DEBUG] [LOCAL ] WCN: Loaded 48291 existing records from primary storage. [2025-10-10T22:20:06.559737] [INFO ] [MAIN ] WCN: Loaded 48291 existing records. [2025-10-10T22:20:06.698946] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-10T22:20:06.738968] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:20:06.740480] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-10T22:20:06.740569] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-10T22:20:06.740992] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-10T22:20:06.741067] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-10T22:20:06.916194] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-10T22:20:07.172888] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:20:07.489411] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-10T22:20:07.533484] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-10T22:20:08.289452] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-10-10T22:20:09.089415] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-10T22:20:09.296742] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T22:20:09.817967] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T22:20:09.821753] [INFO ] [REMOTE ] WAT: Full fetch complete (50161 records). [2025-10-10T22:20:09.821843] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-10T22:20:09.892510] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-10T22:20:10.230547] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-10T22:20:10.230697] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-10T22:20:10.231859] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-10T22:20:10.231999] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-10T22:20:10.233255] [DEBUG] [LOCAL ] WAT: Trimmed 50161 records to 36046 (keeping 200 days of data) [2025-10-10T22:20:10.463417] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-10T22:20:10.502766] [DEBUG] [LOCAL ] WAT: Primary data saved (36046 records). [2025-10-10T22:20:10.502927] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-10T22:20:10.503037] [INFO ] [MAIN ] Update Progress: 2276/2373 symbols completed. WAT took 40.6s. Estimated remaining: 13m 39s. Rate: 7.1 symbols/min [2025-10-10T22:20:10.675303] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:20:10.689380] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-10T22:20:10.699674] [DEBUG] [LOCAL ] WD: Loaded 23234 existing records from primary storage. [2025-10-10T22:20:10.699950] [INFO ] [MAIN ] WD: Loaded 23234 existing records. [2025-10-10T22:20:10.881317] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:20:10.881506] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-10T22:20:10.881555] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-10T22:20:10.881799] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-10T22:20:10.881858] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-10T22:20:11.244706] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:20:11.436092] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-10T22:20:11.489406] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-10T22:20:11.623200] [DEBUG] [REMOTE ] WBX: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-10T22:20:11.623448] [WARN ] [REMOTE ] WBX: No data returned for month 2025-10 [2025-10-10T22:20:11.623553] [FATAL] [REMOTE ] WBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T22:20:11.623629] [FATAL] [MAIN ] WBX: Failed to fetch primary data. [2025-10-10T22:20:11.623741] [WARN ] [MAIN ] WBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T22:20:11.623810] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-10T22:20:11.623875] [DEBUG] [LOCAL ] WBX: No primary data file found to delete. [2025-10-10T22:20:11.623911] [INFO ] [LOCAL ] WBX: Starting deletion of derivative data. [2025-10-10T22:20:11.624113] [DEBUG] [LOCAL ] WBX: Deleted derivative data file. [2025-10-10T22:20:11.624215] [INFO ] [MAIN ] Update Progress: 2277/2373 symbols completed. WBX took 33.8s. Estimated remaining: 13m 30s. Rate: 7.1 symbols/min [2025-10-10T22:20:11.881460] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-10T22:20:12.289372] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-10T22:20:13.089438] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-10T22:20:13.889351] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-10-10T22:20:14.229156] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-10T22:20:14.647958] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-10T22:20:14.689336] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-10T22:20:15.102526] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-10T22:20:15.489381] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-10T22:20:16.289409] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-10T22:20:16.482597] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T22:20:17.089406] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-10T22:20:17.141447] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-10T22:20:17.434928] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T22:20:17.889375] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-10T22:20:18.198102] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-10T22:20:18.655496] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-10T22:20:18.689332] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-10T22:20:19.489419] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-10T22:20:20.073250] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-10T22:20:20.289410] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-10T22:20:21.089346] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-10T22:20:21.536067] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T22:20:21.602024] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-10T22:20:21.889350] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-10T22:20:22.493928] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-10T22:20:22.689389] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-10T22:20:23.489409] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-10T22:20:23.914419] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-10T22:20:23.982494] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-10T22:20:24.289384] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-10T22:20:24.898864] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-10T22:20:25.089374] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-10T22:20:25.889380] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-10T22:20:26.204500] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T22:20:26.689365] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-10T22:20:26.732315] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T22:20:27.194835] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T22:20:27.489384] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-10T22:20:28.289482] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-10T22:20:28.454811] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-10T22:20:28.817700] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T22:20:28.821552] [INFO ] [REMOTE ] WCC: Full fetch complete (57326 records). [2025-10-10T22:20:28.821793] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-10T22:20:29.089402] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-10T22:20:29.224478] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-10T22:20:29.224764] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-10T22:20:29.226843] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-10T22:20:29.226990] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-10T22:20:29.253446] [DEBUG] [LOCAL ] WCC: Trimmed 57326 records to 39666 (keeping 200 days of data) [2025-10-10T22:20:29.255939] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-10T22:20:29.552480] [DEBUG] [LOCAL ] WCC: Primary data saved (39666 records). [2025-10-10T22:20:29.552728] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-10T22:20:29.553205] [INFO ] [MAIN ] Update Progress: 2278/2373 symbols completed. WCC took 34.8s. Estimated remaining: 13m 22s. Rate: 7.1 symbols/min [2025-10-10T22:20:29.889382] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-10T22:20:31.124896] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-10T22:20:31.151357] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-10T22:20:31.153748] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-10T22:20:31.489401] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-10T22:20:32.801126] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T22:20:32.806529] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-10T22:20:33.226741] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-10T22:20:33.237500] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-10T22:20:33.760437] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-10T22:20:33.762701] [INFO ] [REMOTE ] WD: Full fetch complete (33191 records). [2025-10-10T22:20:33.762779] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-10T22:20:34.146809] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-10T22:20:34.146887] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-10T22:20:34.147665] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-10T22:20:34.147727] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-10T22:20:34.148412] [DEBUG] [LOCAL ] WD: Trimmed 33191 records to 23365 (keeping 200 days of data) [2025-10-10T22:20:34.293232] [DEBUG] [LOCAL ] WD: Primary data saved (23365 records). [2025-10-10T22:20:34.293369] [INFO ] [MAIN ] WD: Full history saved. [2025-10-10T22:20:34.293445] [INFO ] [MAIN ] Update Progress: 2279/2373 symbols completed. WD took 23.8s. Estimated remaining: 13m 13s. Rate: 7.1 symbols/min [2025-10-10T22:20:35.102427] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-10T22:20:35.113176] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-10T22:20:36.834500] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-10T22:20:36.839141] [INFO ] [REMOTE ] WCN: Full fetch complete (69319 records). [2025-10-10T22:20:36.839256] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-10T22:20:37.221739] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-10T22:20:37.221823] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-10T22:20:37.222989] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-10T22:20:37.223050] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-10T22:20:37.225438] [DEBUG] [LOCAL ] WCN: Trimmed 69319 records to 48658 (keeping 200 days of data) [2025-10-10T22:20:37.541872] [DEBUG] [LOCAL ] WCN: Primary data saved (48658 records). [2025-10-10T22:20:37.542003] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-10T22:20:37.542092] [INFO ] [MAIN ] Update Progress: 2280/2373 symbols completed. WCN took 31.2s. Estimated remaining: 13m 5s. Rate: 7.1 symbols/min [2025-10-10T22:20:38.126928] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:20:38.211282] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:20:38.231545] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:20:38.257258] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:20:38.268513] [DEBUG] [LOCAL ] WEA: Loaded 7554 existing records from primary storage. [2025-10-10T22:20:38.268795] [INFO ] [MAIN ] WEA: Loaded 7554 existing records. [2025-10-10T22:20:38.398994] [DEBUG] [LOCAL ] WDH: Loaded 18104 existing records from primary storage. [2025-10-10T22:20:38.398389] [DEBUG] [LOCAL ] WDI: Loaded 21207 existing records from primary storage. [2025-10-10T22:20:38.405167] [INFO ] [MAIN ] WDH: Loaded 18104 existing records. [2025-10-10T22:20:38.421055] [INFO ] [MAIN ] WDI: Loaded 21207 existing records. [2025-10-10T22:20:38.650587] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:20:38.707942] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-10T22:20:38.711630] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-10T22:20:38.722306] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-10T22:20:38.732807] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-10T22:20:38.726826] [DEBUG] [LOCAL ] WDS: Loaded 43398 existing records from primary storage. [2025-10-10T22:20:38.840110] [INFO ] [MAIN ] WDS: Loaded 43398 existing records. [2025-10-10T22:20:39.001382] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:20:39.010819] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:20:39.039713] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-10T22:20:39.080324] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-10T22:20:39.050461] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-10T22:20:39.124848] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-10T22:20:39.105307] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-10T22:20:39.164940] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-10T22:20:39.185059] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-10T22:20:39.185165] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-10T22:20:39.714523] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:20:39.757229] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-10T22:20:39.807452] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-10T22:20:40.015236] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-10T22:20:40.015481] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-10T22:20:40.040625] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:20:40.128527] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-10-10T22:20:40.345424] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:20:40.370176] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:20:40.386470] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-10-10T22:20:40.387278] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-10-10T22:20:40.646784] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:20:40.647135] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-10-10T22:20:40.950078] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-10T22:20:40.952425] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-10T22:20:41.191824] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-10T22:20:41.195769] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-10T22:20:41.368107] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-10T22:20:41.374033] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-10T22:20:41.709614] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-10T22:20:41.712051] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-10T22:20:41.766828] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-10T22:20:41.769588] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-10T22:20:42.107740] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-10T22:20:42.109322] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-10T22:20:42.214992] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-10T22:20:42.586773] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-10T22:20:42.689335] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-10T22:20:42.738467] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-10T22:20:42.839441] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-10T22:20:43.489360] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-10T22:20:43.539571] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-10T22:20:43.967716] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-10T22:20:44.289391] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-10T22:20:45.089422] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-10T22:20:45.170549] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-10T22:20:45.889385] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-10T22:20:46.689390] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-10T22:20:46.808195] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-10T22:20:46.840143] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-10T22:20:47.489355] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-10T22:20:47.886183] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-10T22:20:48.289375] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-10T22:20:48.700626] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-10T22:20:49.089388] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-10T22:20:49.405028] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-10T22:20:49.889364] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-10T22:20:50.121027] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-10T22:20:50.416503] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-10T22:20:50.689386] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-10T22:20:51.489430] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-10T22:20:51.646429] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-10T22:20:52.289356] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-10T22:20:52.738343] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-10T22:20:53.089479] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-10T22:20:53.889428] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-10T22:20:54.101723] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-10T22:20:54.413726] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-10T22:20:54.493071] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-10T22:20:54.689409] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-10T22:20:55.489406] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-10T22:20:55.958002] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-10T22:20:56.233477] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-10T22:20:56.289373] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-10T22:20:57.089350] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-10T22:20:57.174769] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-10T22:20:57.889414] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-10T22:20:58.689372] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-10T22:20:59.041476] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T22:20:59.239578] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-10T22:20:59.429745] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T22:20:59.431548] [INFO ] [REMOTE ] WEA: Full fetch complete (9925 records). [2025-10-10T22:20:59.431639] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-10T22:20:59.495422] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-10T22:20:59.793002] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-10T22:20:59.793078] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-10T22:20:59.793331] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-10T22:20:59.793370] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-10T22:20:59.793816] [DEBUG] [LOCAL ] WEA: Trimmed 9925 records to 7639 (keeping 200 days of data) [2025-10-10T22:20:59.840598] [DEBUG] [LOCAL ] WEA: Primary data saved (7639 records). [2025-10-10T22:20:59.840790] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-10T22:20:59.840877] [INFO ] [MAIN ] Update Progress: 2281/2373 symbols completed. WEA took 22.3s. Estimated remaining: 12m 57s. Rate: 7.1 symbols/min [2025-10-10T22:21:00.009566] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:21:00.057661] [DEBUG] [LOCAL ] WEAV: Loaded 42226 existing records from primary storage. [2025-10-10T22:21:00.058029] [INFO ] [MAIN ] WEAV: Loaded 42226 existing records. [2025-10-10T22:21:00.247368] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:21:00.247628] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-10T22:21:00.247713] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-10T22:21:00.247945] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-10T22:21:00.248002] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-10T22:21:00.294631] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-10T22:21:00.598705] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:21:00.854219] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-10T22:21:01.089471] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-10-10T22:21:01.889423] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-10T22:21:02.318405] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T22:21:02.689397] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-10T22:21:02.862368] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-10T22:21:03.489408] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-10T22:21:03.593665] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-10T22:21:04.289467] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-10T22:21:04.509851] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-10T22:21:05.089378] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-10T22:21:05.349669] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T22:21:05.552211] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-10T22:21:05.889367] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-10T22:21:06.338991] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-10T22:21:06.341955] [INFO ] [REMOTE ] WDH: Full fetch complete (23765 records). [2025-10-10T22:21:06.342033] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-10T22:21:06.706564] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-10T22:21:06.718769] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-10T22:21:06.718862] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-10T22:21:06.719422] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-10T22:21:06.719463] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-10T22:21:06.720263] [DEBUG] [LOCAL ] WDH: Trimmed 23765 records to 18268 (keeping 200 days of data) [2025-10-10T22:21:06.834537] [DEBUG] [LOCAL ] WDH: Primary data saved (18268 records). [2025-10-10T22:21:06.834724] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-10T22:21:06.834819] [INFO ] [MAIN ] Update Progress: 2282/2373 symbols completed. WDH took 29.3s. Estimated remaining: 12m 48s. Rate: 7.1 symbols/min [2025-10-10T22:21:07.013197] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:21:07.069338] [DEBUG] [LOCAL ] WEC: Loaded 52539 existing records from primary storage. [2025-10-10T22:21:07.069683] [INFO ] [MAIN ] WEC: Loaded 52539 existing records. [2025-10-10T22:21:07.203713] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T22:21:07.277011] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:21:07.277294] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-10T22:21:07.277343] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-10T22:21:07.277790] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-10T22:21:07.277848] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-10T22:21:07.498411] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-10T22:21:07.639554] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:21:08.289440] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-10T22:21:08.489759] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T22:21:09.089421] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-10T22:21:09.374143] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T22:21:09.377923] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T22:21:09.391388] [INFO ] [REMOTE ] WDI: Full fetch complete (30480 records). [2025-10-10T22:21:09.391819] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-10T22:21:09.806224] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-10T22:21:09.806334] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-10T22:21:09.807722] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-10T22:21:09.807793] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-10T22:21:09.808875] [DEBUG] [LOCAL ] WDI: Trimmed 30480 records to 21388 (keeping 200 days of data) [2025-10-10T22:21:09.896481] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-10T22:21:09.942407] [DEBUG] [LOCAL ] WDI: Primary data saved (21388 records). [2025-10-10T22:21:09.942578] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-10T22:21:09.942701] [INFO ] [MAIN ] Update Progress: 2283/2373 symbols completed. WDI took 32.4s. Estimated remaining: 12m 39s. Rate: 7.1 symbols/min [2025-10-10T22:21:10.112320] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:21:10.163127] [DEBUG] [LOCAL ] WELL: Loaded 52728 existing records from primary storage. [2025-10-10T22:21:10.163465] [INFO ] [MAIN ] WELL: Loaded 52728 existing records. [2025-10-10T22:21:10.336863] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:21:10.337173] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-10T22:21:10.337221] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-10T22:21:10.337447] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-10T22:21:10.337503] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-10T22:21:10.691347] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-10-10T22:21:10.736892] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:21:11.102707] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-10T22:21:11.329238] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-10T22:21:11.489385] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-10-10T22:21:12.289427] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-10T22:21:12.721886] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-10T22:21:13.089396] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-10T22:21:13.889414] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-10T22:21:13.970458] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-10T22:21:14.689401] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-10T22:21:14.900788] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-10T22:21:15.295383] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-10T22:21:15.489390] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-10T22:21:15.983244] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T22:21:16.289390] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-10T22:21:16.873545] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T22:21:17.052828] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (5.56 seconds). [2025-10-10T22:21:17.089331] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-10T22:21:17.331361] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-10T22:21:17.335790] [INFO ] [REMOTE ] WDS: Full fetch complete (64208 records). [2025-10-10T22:21:17.335942] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-10T22:21:17.726447] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-10T22:21:17.726529] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-10T22:21:17.727736] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-10T22:21:17.727801] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-10T22:21:17.729051] [DEBUG] [LOCAL ] WDS: Trimmed 64208 records to 43729 (keeping 200 days of data) [2025-10-10T22:21:17.911272] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-10T22:21:18.012778] [DEBUG] [LOCAL ] WDS: Primary data saved (43729 records). [2025-10-10T22:21:18.012917] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-10T22:21:18.013006] [INFO ] [MAIN ] Update Progress: 2284/2373 symbols completed. WDS took 40.5s. Estimated remaining: 12m 31s. Rate: 7.1 symbols/min [2025-10-10T22:21:18.188484] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:21:18.233503] [DEBUG] [LOCAL ] WES: Loaded 48662 existing records from primary storage. [2025-10-10T22:21:18.233838] [INFO ] [MAIN ] WES: Loaded 48662 existing records. [2025-10-10T22:21:18.407609] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:21:18.407941] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-10T22:21:18.407997] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-10T22:21:18.408199] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-10T22:21:18.408237] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-10T22:21:18.694522] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-10T22:21:18.764775] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:21:19.212380] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-10T22:21:19.489355] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-10T22:21:19.836349] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-10T22:21:19.994673] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-10T22:21:20.289424] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-10T22:21:21.089374] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-10-10T22:21:21.406801] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-10T22:21:21.889361] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-10T22:21:22.380309] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-10T22:21:22.689356] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-10T22:21:22.897207] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-10T22:21:23.489386] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-10T22:21:23.535131] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T22:21:24.289445] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-10T22:21:24.695899] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T22:21:25.011522] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-10T22:21:25.089343] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-10T22:21:25.889384] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-10T22:21:26.096610] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T22:21:26.689388] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-10T22:21:27.288861] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-10T22:21:27.489406] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-10T22:21:27.785690] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-10T22:21:28.289377] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-10T22:21:28.504503] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T22:21:29.035072] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-10T22:21:29.089426] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-10T22:21:29.742155] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-10T22:21:29.889355] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-10T22:21:30.689403] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-10T22:21:30.893986] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T22:21:31.489415] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-10T22:21:31.921728] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T22:21:32.091732] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-10T22:21:32.289361] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-10T22:21:33.089353] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-10T22:21:33.133634] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-10T22:21:33.889375] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-10T22:21:34.212004] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T22:21:34.668456] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T22:21:34.673222] [INFO ] [REMOTE ] WEAV: Full fetch complete (61651 records). [2025-10-10T22:21:34.673341] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-10T22:21:34.695521] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-10T22:21:35.072723] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-10T22:21:35.072835] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-10T22:21:35.073976] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-10T22:21:35.074061] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-10T22:21:35.075380] [DEBUG] [LOCAL ] WEAV: Trimmed 61651 records to 42583 (keeping 200 days of data) [2025-10-10T22:21:35.317529] [DEBUG] [LOCAL ] WEAV: Primary data saved (42583 records). [2025-10-10T22:21:35.317701] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-10T22:21:35.317802] [INFO ] [MAIN ] Update Progress: 2285/2373 symbols completed. WEAV took 35.5s. Estimated remaining: 12m 23s. Rate: 7.1 symbols/min [2025-10-10T22:21:35.484704] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:21:35.489357] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-10T22:21:35.527167] [DEBUG] [LOCAL ] WEX: Loaded 33944 existing records from primary storage. [2025-10-10T22:21:35.527545] [INFO ] [MAIN ] WEX: Loaded 33944 existing records. [2025-10-10T22:21:35.708615] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:21:35.708964] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-10T22:21:35.709124] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-10T22:21:35.709369] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-10T22:21:35.709552] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-10T22:21:36.063448] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-10T22:21:36.114399] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:21:36.289382] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-10-10T22:21:36.911144] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-10T22:21:37.025041] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-10T22:21:37.089341] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-10T22:21:37.848757] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-10T22:21:37.889341] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-10T22:21:38.689375] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-10T22:21:39.069151] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T22:21:39.489357] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-10T22:21:39.815943] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-10T22:21:40.289351] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-10T22:21:40.629408] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T22:21:41.089371] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-10T22:21:41.532479] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-10T22:21:41.726964] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-10T22:21:41.889395] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-10T22:21:42.512338] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-10T22:21:42.655149] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T22:21:42.660236] [INFO ] [REMOTE ] WEC: Full fetch complete (75537 records). [2025-10-10T22:21:42.660352] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-10T22:21:42.694679] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-10T22:21:43.046971] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-10T22:21:43.047059] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-10T22:21:43.048233] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-10T22:21:43.048296] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-10T22:21:43.051609] [DEBUG] [LOCAL ] WEC: Trimmed 75537 records to 52920 (keeping 200 days of data) [2025-10-10T22:21:43.391498] [DEBUG] [LOCAL ] WEC: Primary data saved (52920 records). [2025-10-10T22:21:43.391731] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-10T22:21:43.391842] [INFO ] [MAIN ] Update Progress: 2286/2373 symbols completed. WEC took 36.6s. Estimated remaining: 12m 14s. Rate: 7.1 symbols/min [2025-10-10T22:21:43.494981] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-10T22:21:43.558880] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:21:43.571499] [DEBUG] [LOCAL ] WF: Loaded 10809 existing records from primary storage. [2025-10-10T22:21:43.571738] [INFO ] [MAIN ] WF: Loaded 10809 existing records. [2025-10-10T22:21:43.745276] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:21:43.745602] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-10T22:21:43.745688] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-10T22:21:43.745888] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-10T22:21:43.745945] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-10T22:21:44.097975] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:21:44.173590] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-10T22:21:44.181024] [INFO ] [REMOTE ] WELL: Full fetch complete (75721 records). [2025-10-10T22:21:44.181143] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-10T22:21:44.294513] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-10T22:21:44.570461] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-10T22:21:44.570665] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-10T22:21:44.571886] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-10T22:21:44.572005] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-10T22:21:44.594756] [DEBUG] [LOCAL ] WELL: Trimmed 75721 records to 53103 (keeping 200 days of data) [2025-10-10T22:21:44.599859] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T22:21:44.943844] [DEBUG] [LOCAL ] WELL: Primary data saved (53103 records). [2025-10-10T22:21:44.944270] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-10T22:21:44.944872] [INFO ] [MAIN ] Update Progress: 2287/2373 symbols completed. WELL took 35.0s. Estimated remaining: 12m 6s. Rate: 7.1 symbols/min [2025-10-10T22:21:45.109931] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:21:45.107410] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-10-10T22:21:45.162006] [DEBUG] [LOCAL ] WFC: Loaded 54138 existing records from primary storage. [2025-10-10T22:21:45.162337] [INFO ] [MAIN ] WFC: Loaded 54138 existing records. [2025-10-10T22:21:45.350835] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:21:45.351180] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-10T22:21:45.351235] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-10T22:21:45.351959] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-10T22:21:45.352020] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-10T22:21:45.716187] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:21:45.889413] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-10T22:21:45.997037] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-10T22:21:46.319827] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-10T22:21:46.689396] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-10T22:21:47.489416] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-10-10T22:21:47.556167] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-10T22:21:48.289466] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-10T22:21:48.587005] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-10T22:21:49.089412] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-10T22:21:49.381499] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-10T22:21:49.747619] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-10T22:21:49.889398] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-10T22:21:50.689359] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-10T22:21:50.895085] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-10T22:21:50.983758] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-10T22:21:51.489430] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-10T22:21:52.289422] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-10T22:21:52.431662] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-10T22:21:52.467764] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T22:21:53.089410] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-10T22:21:53.889452] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-10T22:21:54.466792] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-10T22:21:54.699446] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-10T22:21:54.723115] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T22:21:55.066498] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-10T22:21:55.489415] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-10T22:21:55.931926] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-10T22:21:55.937736] [INFO ] [REMOTE ] WES: Full fetch complete (70094 records). [2025-10-10T22:21:55.937936] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-10T22:21:56.309758] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-10T22:21:56.332771] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-10T22:21:56.332859] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-10T22:21:56.334074] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-10T22:21:56.334254] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-10T22:21:56.335825] [DEBUG] [LOCAL ] WES: Trimmed 70094 records to 49050 (keeping 200 days of data) [2025-10-10T22:21:56.641803] [DEBUG] [LOCAL ] WES: Primary data saved (49050 records). [2025-10-10T22:21:56.641946] [INFO ] [MAIN ] WES: Full history saved. [2025-10-10T22:21:56.642026] [INFO ] [MAIN ] Update Progress: 2288/2373 symbols completed. WES took 38.6s. Estimated remaining: 11m 57s. Rate: 7.1 symbols/min [2025-10-10T22:21:56.808006] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:21:56.837222] [DEBUG] [LOCAL ] WFG: Loaded 25001 existing records from primary storage. [2025-10-10T22:21:56.837496] [INFO ] [MAIN ] WFG: Loaded 25001 existing records. [2025-10-10T22:21:57.018912] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:21:57.019872] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-10T22:21:57.019962] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-10T22:21:57.020329] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-10T22:21:57.020402] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-10T22:21:57.089622] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-10T22:21:57.401739] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-10T22:21:57.407273] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:21:57.451768] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-10T22:21:57.889403] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-10T22:21:58.689409] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-10T22:21:58.734551] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-10T22:21:58.867412] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-10T22:21:59.489400] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-10T22:22:00.289433] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-10-10T22:22:00.663793] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-10T22:22:01.097475] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-10T22:22:01.105712] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-10T22:22:01.172010] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-10T22:22:01.578190] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-10T22:22:01.889377] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-10T22:22:02.689401] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-10T22:22:03.309219] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-10T22:22:03.489432] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-10T22:22:04.289426] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-10T22:22:05.027314] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-10T22:22:05.078340] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-10T22:22:05.093917] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-10T22:22:05.656241] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T22:22:05.749308] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-10T22:22:05.889380] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-10T22:22:06.675540] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-10T22:22:06.677260] [INFO ] [REMOTE ] WF: Full fetch complete (16119 records). [2025-10-10T22:22:06.677335] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-10T22:22:06.697858] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-10T22:22:07.040518] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-10T22:22:07.040606] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-10T22:22:07.041045] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-10T22:22:07.041106] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-10T22:22:07.041724] [DEBUG] [LOCAL ] WF: Trimmed 16119 records to 10888 (keeping 200 days of data) [2025-10-10T22:22:07.109568] [DEBUG] [LOCAL ] WF: Primary data saved (10888 records). [2025-10-10T22:22:07.109740] [INFO ] [MAIN ] WF: Full history saved. [2025-10-10T22:22:07.109857] [INFO ] [MAIN ] Update Progress: 2289/2373 symbols completed. WF took 23.7s. Estimated remaining: 11m 49s. Rate: 7.1 symbols/min [2025-10-10T22:22:07.275409] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:22:07.314474] [DEBUG] [LOCAL ] WGO: Loaded 38744 existing records from primary storage. [2025-10-10T22:22:07.314791] [INFO ] [MAIN ] WGO: Loaded 38744 existing records. [2025-10-10T22:22:07.489568] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:22:07.490021] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-10T22:22:07.489686] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-10T22:22:07.490341] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-10T22:22:07.491362] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-10T22:22:07.491416] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-10T22:22:07.851737] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:22:08.289406] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-10-10T22:22:08.315463] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-10T22:22:09.089385] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-10T22:22:09.172021] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T22:22:09.889434] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-10T22:22:10.146470] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-10T22:22:10.689402] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-10T22:22:11.479170] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-10T22:22:11.492771] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-10T22:22:11.502215] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-10T22:22:11.868741] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-10T22:22:12.289422] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-10T22:22:13.058152] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-10T22:22:13.089386] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-10T22:22:13.889353] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-10T22:22:13.961141] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T22:22:14.269672] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-10T22:22:14.273683] [INFO ] [REMOTE ] WEX: Full fetch complete (50318 records). [2025-10-10T22:22:14.273790] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-10T22:22:14.689865] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-10T22:22:14.691160] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-10T22:22:14.691293] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-10T22:22:14.692855] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-10T22:22:14.693053] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-10T22:22:14.694874] [DEBUG] [LOCAL ] WEX: Trimmed 50318 records to 34207 (keeping 200 days of data) [2025-10-10T22:22:14.912308] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-10T22:22:14.946255] [DEBUG] [LOCAL ] WEX: Primary data saved (34207 records). [2025-10-10T22:22:14.946471] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-10T22:22:14.946585] [INFO ] [MAIN ] Update Progress: 2290/2373 symbols completed. WEX took 39.6s. Estimated remaining: 11m 41s. Rate: 7.1 symbols/min [2025-10-10T22:22:15.131523] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:22:15.180465] [DEBUG] [LOCAL ] WH: Loaded 45599 existing records from primary storage. [2025-10-10T22:22:15.180931] [INFO ] [MAIN ] WH: Loaded 45599 existing records. [2025-10-10T22:22:15.412843] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:22:15.413142] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-10T22:22:15.413191] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-10T22:22:15.413442] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-10T22:22:15.413497] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-10T22:22:15.494572] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-10T22:22:15.803028] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:22:16.289391] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-10T22:22:17.089398] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-10-10T22:22:17.273576] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-10T22:22:17.313482] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T22:22:17.579004] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-10T22:22:17.889377] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-10T22:22:18.472531] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-10T22:22:18.689373] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-10T22:22:19.489412] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-10T22:22:19.805924] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T22:22:20.289382] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-10T22:22:20.929019] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-10T22:22:21.098551] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-10T22:22:21.104871] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-10T22:22:21.889380] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-10T22:22:22.030777] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-10T22:22:22.689357] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-10T22:22:22.879229] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-10T22:22:23.489382] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-10T22:22:23.645544] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-10T22:22:24.271749] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-10T22:22:24.289337] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-10T22:22:24.862560] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T22:22:25.089433] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-10T22:22:25.496927] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-10T22:22:25.889381] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-10T22:22:26.689373] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-10T22:22:26.897440] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T22:22:27.441206] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-10T22:22:27.447728] [INFO ] [REMOTE ] WFC: Full fetch complete (77792 records). [2025-10-10T22:22:27.447888] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-10T22:22:27.494610] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-10T22:22:27.972205] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-10T22:22:27.973011] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-10T22:22:27.976409] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-10T22:22:27.974628] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-10T22:22:27.985298] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-10T22:22:27.987748] [DEBUG] [LOCAL ] WFC: Trimmed 77792 records to 54528 (keeping 200 days of data) [2025-10-10T22:22:28.291887] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-10T22:22:28.350922] [DEBUG] [LOCAL ] WFC: Primary data saved (54528 records). [2025-10-10T22:22:28.351145] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-10T22:22:28.351443] [INFO ] [MAIN ] Update Progress: 2291/2373 symbols completed. WFC took 43.4s. Estimated remaining: 11m 32s. Rate: 7.1 symbols/min [2025-10-10T22:22:28.525171] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:22:28.574793] [DEBUG] [LOCAL ] WHD: Loaded 40299 existing records from primary storage. [2025-10-10T22:22:28.575198] [INFO ] [MAIN ] WHD: Loaded 40299 existing records. [2025-10-10T22:22:28.763979] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:22:28.764251] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-10T22:22:28.764303] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-10T22:22:28.764578] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-10T22:22:28.764638] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-10T22:22:29.100999] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-10T22:22:29.147195] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:22:29.420939] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-10T22:22:29.889375] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-10-10T22:22:30.048198] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-10T22:22:30.614962] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-10T22:22:30.689350] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-10T22:22:31.489380] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-10T22:22:31.539392] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-10T22:22:32.069943] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T22:22:32.289489] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-10T22:22:33.089360] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-10T22:22:33.124355] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T22:22:33.889483] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-10T22:22:33.968436] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-10T22:22:34.689444] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-10T22:22:34.876022] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-10T22:22:34.941763] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T22:22:34.944319] [INFO ] [REMOTE ] WFG: Full fetch complete (35941 records). [2025-10-10T22:22:34.944392] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-10T22:22:35.323989] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-10T22:22:35.324075] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-10T22:22:35.324876] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-10T22:22:35.324937] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-10T22:22:35.325689] [DEBUG] [LOCAL ] WFG: Trimmed 35941 records to 25167 (keeping 200 days of data) [2025-10-10T22:22:35.479685] [DEBUG] [LOCAL ] WFG: Primary data saved (25167 records). [2025-10-10T22:22:35.479822] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-10T22:22:35.479923] [INFO ] [MAIN ] Update Progress: 2292/2373 symbols completed. WFG took 38.8s. Estimated remaining: 11m 24s. Rate: 7.1 symbols/min [2025-10-10T22:22:35.494497] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-10T22:22:35.649782] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:22:35.655723] [DEBUG] [LOCAL ] WHG: Loaded 3246 existing records from primary storage. [2025-10-10T22:22:35.655891] [INFO ] [MAIN ] WHG: Loaded 3246 existing records. [2025-10-10T22:22:35.830530] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:22:35.830827] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-10T22:22:35.830881] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-10T22:22:35.831028] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-10T22:22:35.831066] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-10T22:22:36.187621] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:22:36.247541] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-10T22:22:36.289333] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-10T22:22:37.073589] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T22:22:37.077359] [INFO ] [REMOTE ] WGO: Full fetch complete (57331 records). [2025-10-10T22:22:37.077465] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-10T22:22:37.098049] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-10T22:22:37.453318] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-10T22:22:37.453404] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-10T22:22:37.454450] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-10T22:22:37.454514] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-10T22:22:37.455807] [DEBUG] [LOCAL ] WGO: Trimmed 57331 records to 39034 (keeping 200 days of data) [2025-10-10T22:22:37.744108] [DEBUG] [LOCAL ] WGO: Primary data saved (39034 records). [2025-10-10T22:22:37.744249] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-10T22:22:37.744331] [INFO ] [MAIN ] Update Progress: 2293/2373 symbols completed. WGO took 30.6s. Estimated remaining: 11m 15s. Rate: 7.1 symbols/min [2025-10-10T22:22:37.894535] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-10-10T22:22:37.914018] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:22:37.961529] [DEBUG] [LOCAL ] WHR: Loaded 48754 existing records from primary storage. [2025-10-10T22:22:37.962000] [INFO ] [MAIN ] WHR: Loaded 48754 existing records. [2025-10-10T22:22:38.142252] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:22:38.142592] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-10T22:22:38.142720] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-10T22:22:38.143007] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-10T22:22:38.143066] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-10T22:22:38.463718] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-10T22:22:38.549727] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:22:38.553286] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-10T22:22:38.689334] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-10-10T22:22:38.963759] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-10T22:22:39.489395] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-10T22:22:40.289417] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-10T22:22:40.307102] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-10T22:22:40.563621] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-10T22:22:41.089385] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-10T22:22:41.796587] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-10T22:22:41.889399] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-10T22:22:42.213846] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T22:22:42.689365] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-10T22:22:43.489373] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-10T22:22:43.739935] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-10T22:22:43.915763] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-10T22:22:44.289400] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-10T22:22:44.483519] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T22:22:44.976145] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-10T22:22:45.089365] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-10T22:22:45.792509] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-10T22:22:45.889342] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-10T22:22:46.637785] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-10T22:22:46.689350] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-10T22:22:47.430439] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-10T22:22:47.489404] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-10T22:22:48.083155] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-10T22:22:48.289379] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-10T22:22:49.089430] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-10T22:22:49.889410] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-10T22:22:50.065150] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T22:22:50.689421] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-10T22:22:50.919235] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T22:22:51.489434] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-10T22:22:51.635602] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T22:22:52.289379] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-10T22:22:52.578946] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T22:22:53.089378] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-10T22:22:53.889384] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-10T22:23:05.498091] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (11.61 seconds). [2025-10-10T22:23:05.499260] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-10T22:23:06.838333] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (14.55 seconds). [2025-10-10T22:23:06.843515] [INFO ] [REMOTE ] WH: Full fetch complete (64966 records). [2025-10-10T22:23:06.843845] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-10T22:23:07.254032] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-10T22:23:07.254234] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-10T22:23:07.255568] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-10T22:23:07.255696] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-10T22:23:07.291406] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (14.20 seconds). [2025-10-10T22:23:07.302257] [DEBUG] [LOCAL ] WH: Trimmed 64966 records to 45953 (keeping 200 days of data) [2025-10-10T22:23:07.327625] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (15.84 seconds). [2025-10-10T22:23:07.328016] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-10T22:23:07.401280] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-10T22:23:07.624110] [DEBUG] [LOCAL ] WH: Primary data saved (45953 records). [2025-10-10T22:23:07.624258] [INFO ] [MAIN ] WH: Full history saved. [2025-10-10T22:23:07.624342] [INFO ] [MAIN ] Update Progress: 2294/2373 symbols completed. WH took 52.7s. Estimated remaining: 11m 8s. Rate: 7.1 symbols/min [2025-10-10T22:23:07.692326] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-10T22:23:07.704878] [INFO ] [REMOTE ] WHG: Full fetch complete (4551 records). [2025-10-10T22:23:07.720576] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-10T22:23:07.926741] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:23:08.076462] [DEBUG] [LOCAL ] WIA: Loaded 5003 existing records from primary storage. [2025-10-10T22:23:08.105418] [INFO ] [MAIN ] WIA: Loaded 5003 existing records. [2025-10-10T22:23:08.403043] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-10T22:23:08.412468] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-10T22:23:08.419177] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-10T22:23:08.422803] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-10T22:23:08.422708] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:23:08.423350] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-10T22:23:08.423447] [DEBUG] [LOCAL ] WHG: Trimmed 4551 records to 3257 (keeping 200 days of data) [2025-10-10T22:23:08.423535] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-10T22:23:08.424075] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-10T22:23:08.424136] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-10T22:23:08.635450] [DEBUG] [LOCAL ] WHG: Primary data saved (3257 records). [2025-10-10T22:23:08.643856] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-10T22:23:08.656876] [INFO ] [MAIN ] Update Progress: 2295/2373 symbols completed. WHG took 33.2s. Estimated remaining: 10m 59s. Rate: 7.1 symbols/min [2025-10-10T22:23:09.016256] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:23:09.017938] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:23:09.018783] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-10-10T22:23:09.031975] [DEBUG] [LOCAL ] WINN: Loaded 11606 existing records from primary storage. [2025-10-10T22:23:09.032217] [INFO ] [MAIN ] WINN: Loaded 11606 existing records. [2025-10-10T22:23:09.212154] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:23:09.212945] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-10T22:23:09.213127] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-10T22:23:09.213376] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-10T22:23:09.213431] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-10T22:23:09.460014] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-10T22:23:09.508306] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-10T22:23:09.617124] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:23:09.633471] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-10-10T22:23:09.640451] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-10T22:23:09.657835] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-10T22:23:09.666168] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-10T22:23:09.678012] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-10T22:23:10.463223] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-10T22:23:10.465403] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-10T22:23:10.679221] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-10T22:23:10.682502] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-10T22:23:11.033820] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-10T22:23:11.043474] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-10T22:23:11.302435] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-10T22:23:11.304541] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-10T22:23:11.805755] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-10T22:23:11.823444] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-10T22:23:11.827396] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-10T22:23:11.827623] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-10T22:23:12.001200] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-10T22:23:12.002878] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-10T22:23:12.787775] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-10T22:23:12.790005] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-10T22:23:12.802042] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-10T22:23:12.803696] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-10T22:23:12.850947] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-10T22:23:12.854818] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-10T22:23:13.503223] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-10T22:23:13.504953] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-10T22:23:13.616682] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-10T22:23:13.630492] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-10T22:23:13.906225] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-10T22:23:13.910421] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-10T22:23:14.235922] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-10T22:23:14.237633] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-10T22:23:14.605301] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T22:23:14.614800] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-10T22:23:14.690841] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-10T22:23:14.695167] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-10T22:23:14.903940] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-10T22:23:14.906437] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-10T22:23:15.333048] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-10T22:23:15.336307] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-10T22:23:15.743527] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-10T22:23:15.746474] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-10T22:23:15.783307] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-10T22:23:16.216416] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T22:23:16.220544] [INFO ] [REMOTE ] WHD: Full fetch complete (57559 records). [2025-10-10T22:23:16.220683] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-10T22:23:16.296974] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-10T22:23:16.393692] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-10T22:23:16.560756] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-10T22:23:16.660408] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-10T22:23:16.660551] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-10T22:23:16.661976] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-10T22:23:16.662123] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-10T22:23:16.664326] [DEBUG] [LOCAL ] WHD: Trimmed 57559 records to 40649 (keeping 200 days of data) [2025-10-10T22:23:16.933842] [DEBUG] [LOCAL ] WHD: Primary data saved (40649 records). [2025-10-10T22:23:16.934005] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-10T22:23:16.934350] [INFO ] [MAIN ] Update Progress: 2296/2373 symbols completed. WHD took 48.6s. Estimated remaining: 10m 50s. Rate: 7.1 symbols/min [2025-10-10T22:23:17.094793] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-10T22:23:17.123206] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:23:17.180732] [DEBUG] [LOCAL ] WIT: Loaded 52792 existing records from primary storage. [2025-10-10T22:23:17.181228] [INFO ] [MAIN ] WIT: Loaded 52792 existing records. [2025-10-10T22:23:17.370199] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:23:17.370567] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-10T22:23:17.370624] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-10T22:23:17.370977] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-10T22:23:17.371043] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-10T22:23:17.636448] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-10T22:23:17.678625] [INFO ] [REMOTE ] WIA: Full fetch complete (7294 records). [2025-10-10T22:23:17.678914] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-10T22:23:17.886966] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:23:17.893638] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-10T22:23:18.196241] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-10T22:23:18.196459] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-10T22:23:18.196801] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-10T22:23:18.197018] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-10T22:23:18.197743] [DEBUG] [LOCAL ] WIA: Trimmed 7294 records to 5040 (keeping 200 days of data) [2025-10-10T22:23:18.262092] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-10T22:23:18.274884] [DEBUG] [LOCAL ] WIA: Primary data saved (5040 records). [2025-10-10T22:23:18.275203] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-10T22:23:18.275328] [INFO ] [MAIN ] Update Progress: 2297/2373 symbols completed. WIA took 10.7s. Estimated remaining: 10m 42s. Rate: 7.1 symbols/min [2025-10-10T22:23:18.453257] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:23:18.475782] [DEBUG] [LOCAL ] WIW: Loaded 20563 existing records from primary storage. [2025-10-10T22:23:18.476110] [INFO ] [MAIN ] WIW: Loaded 20563 existing records. [2025-10-10T22:23:18.670332] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:23:18.670826] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-10T22:23:18.670954] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-10T22:23:18.671275] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-10T22:23:18.671349] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-10T22:23:18.694568] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-10T22:23:18.747275] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-10T22:23:19.051719] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:23:19.489412] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-10T22:23:20.289405] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-10-10T22:23:20.418545] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T22:23:20.907267] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-10T22:23:20.912620] [INFO ] [REMOTE ] WHR: Full fetch complete (69004 records). [2025-10-10T22:23:20.912851] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-10T22:23:21.099595] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-10-10T22:23:21.355002] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-10T22:23:21.355109] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-10T22:23:21.356632] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-10T22:23:21.356719] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-10T22:23:21.359099] [DEBUG] [LOCAL ] WHR: Trimmed 69004 records to 49139 (keeping 200 days of data) [2025-10-10T22:23:21.620301] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T22:23:21.733573] [DEBUG] [LOCAL ] WHR: Primary data saved (49139 records). [2025-10-10T22:23:21.733788] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-10T22:23:21.734077] [INFO ] [MAIN ] Update Progress: 2298/2373 symbols completed. WHR took 44.0s. Estimated remaining: 10m 33s. Rate: 7.1 symbols/min [2025-10-10T22:23:21.894568] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-10T22:23:21.928579] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:23:21.968745] [DEBUG] [LOCAL ] WK: Loaded 37473 existing records from primary storage. [2025-10-10T22:23:21.969123] [INFO ] [MAIN ] WK: Loaded 37473 existing records. [2025-10-10T22:23:22.150991] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:23:22.151339] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-10T22:23:22.151388] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-10T22:23:22.152135] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-10T22:23:22.152194] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-10T22:23:22.506036] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:23:22.689355] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-10-10T22:23:23.159070] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-10T22:23:23.494577] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-10T22:23:23.512901] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-10T22:23:24.233420] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T22:23:24.289427] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-10T22:23:24.406695] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-10T22:23:25.089403] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-10T22:23:25.889403] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-10T22:23:26.311039] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T22:23:26.689452] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-10T22:23:26.752116] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-10T22:23:26.773948] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-10T22:23:27.489425] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-10T22:23:28.128548] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-10T22:23:28.289396] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-10T22:23:28.337824] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-10T22:23:28.339545] [INFO ] [REMOTE ] WINN: Full fetch complete (17433 records). [2025-10-10T22:23:28.339623] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-10T22:23:28.708154] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-10T22:23:28.708252] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-10T22:23:28.708959] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-10T22:23:28.709024] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-10T22:23:28.709723] [DEBUG] [LOCAL ] WINN: Trimmed 17433 records to 11739 (keeping 200 days of data) [2025-10-10T22:23:28.785059] [DEBUG] [LOCAL ] WINN: Primary data saved (11739 records). [2025-10-10T22:23:28.785247] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-10T22:23:28.785356] [INFO ] [MAIN ] Update Progress: 2299/2373 symbols completed. WINN took 20.1s. Estimated remaining: 10m 25s. Rate: 7.1 symbols/min [2025-10-10T22:23:28.953518] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:23:28.993161] [DEBUG] [LOCAL ] WKC: Loaded 34872 existing records from primary storage. [2025-10-10T22:23:28.993500] [INFO ] [MAIN ] WKC: Loaded 34872 existing records. [2025-10-10T22:23:29.094537] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-10T22:23:29.182956] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:23:29.183268] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-10T22:23:29.183345] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-10T22:23:29.183629] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-10T22:23:29.183732] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-10T22:23:29.538244] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:23:29.889400] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-10T22:23:29.918768] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-10T22:23:30.634711] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-10T22:23:30.689389] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-10-10T22:23:31.101589] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-10T22:23:31.489426] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-10T22:23:32.014815] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-10T22:23:32.289380] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-10T22:23:32.806212] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T22:23:33.089418] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-10T22:23:33.889372] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-10T22:23:33.926326] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T22:23:34.689400] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-10T22:23:34.825950] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-10T22:23:35.489415] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-10T22:23:35.843736] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-10T22:23:35.896286] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T22:23:36.289412] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-10T22:23:37.089471] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-10T22:23:37.273808] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T22:23:37.889316] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-10T22:23:37.980420] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-10T22:23:38.290424] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T22:23:38.689399] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-10T22:23:39.489564] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-10T22:23:39.568118] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T22:23:39.788511] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-10T22:23:40.289428] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-10T22:23:40.954915] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-10T22:23:41.089381] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-10T22:23:41.769801] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-10T22:23:41.889355] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-10T22:23:42.689375] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-10T22:23:42.969008] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T22:23:43.144449] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-10T22:23:43.489401] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-10T22:23:44.144323] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-10T22:23:44.289408] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-10T22:23:45.089365] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-10T22:23:45.169117] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-10T22:23:45.684546] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-10T22:23:45.889380] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-10T22:23:46.689364] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-10T22:23:47.073065] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-10T22:23:47.103634] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-10T22:23:47.489383] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-10T22:23:47.891143] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T22:23:48.289368] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-10T22:23:49.089402] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-10T22:23:49.305899] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T22:23:49.894448] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-10T22:23:49.905744] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-10T22:23:50.689347] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-10T22:23:50.805629] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-10T22:23:51.489378] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-10T22:23:51.900590] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-10T22:23:51.968741] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-10T22:23:51.971026] [INFO ] [REMOTE ] WIW: Full fetch complete (29580 records). [2025-10-10T22:23:51.971120] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-10T22:23:52.294571] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-10T22:23:52.341268] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-10T22:23:52.341342] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-10T22:23:52.342055] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-10T22:23:52.342140] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-10T22:23:52.342907] [DEBUG] [LOCAL ] WIW: Trimmed 29580 records to 20672 (keeping 200 days of data) [2025-10-10T22:23:52.468782] [DEBUG] [LOCAL ] WIW: Primary data saved (20672 records). [2025-10-10T22:23:52.468968] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-10T22:23:52.469095] [INFO ] [MAIN ] Update Progress: 2300/2373 symbols completed. WIW took 34.2s. Estimated remaining: 10m 17s. Rate: 7.1 symbols/min [2025-10-10T22:23:52.639822] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:23:52.681151] [DEBUG] [LOCAL ] WLK: Loaded 45905 existing records from primary storage. [2025-10-10T22:23:52.681449] [INFO ] [MAIN ] WLK: Loaded 45905 existing records. [2025-10-10T22:23:52.861933] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:23:52.862190] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-10T22:23:52.862313] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-10T22:23:52.862633] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-10T22:23:52.862765] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-10T22:23:52.976470] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T22:23:53.094615] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-10T22:23:53.267469] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:23:53.482106] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-10T22:23:53.889383] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-10-10T22:23:54.421327] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-10T22:23:54.426546] [INFO ] [REMOTE ] WIT: Full fetch complete (75705 records). [2025-10-10T22:23:54.426703] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-10T22:23:54.697481] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-10T22:23:54.816902] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-10T22:23:54.817007] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-10T22:23:54.818211] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-10T22:23:54.818274] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-10T22:23:54.819711] [DEBUG] [LOCAL ] WIT: Trimmed 75705 records to 53178 (keeping 200 days of data) [2025-10-10T22:23:55.124579] [DEBUG] [LOCAL ] WIT: Primary data saved (53178 records). [2025-10-10T22:23:55.124777] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-10T22:23:55.125052] [INFO ] [MAIN ] Update Progress: 2301/2373 symbols completed. WIT took 38.2s. Estimated remaining: 10m 8s. Rate: 7.1 symbols/min [2025-10-10T22:23:55.293337] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:23:55.303833] [DEBUG] [LOCAL ] WLKP: Loaded 6946 existing records from primary storage. [2025-10-10T22:23:55.304067] [INFO ] [MAIN ] WLKP: Loaded 6946 existing records. [2025-10-10T22:23:55.481026] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:23:55.481330] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-10T22:23:55.481457] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-10T22:23:55.481710] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-10T22:23:55.481786] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-10T22:23:55.512066] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-10T22:23:55.836615] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T22:23:55.871037] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:23:56.148712] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T22:23:56.152559] [INFO ] [REMOTE ] WK: Full fetch complete (52722 records). [2025-10-10T22:23:56.152691] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-10T22:23:56.294601] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-10T22:23:56.528268] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-10T22:23:56.528352] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-10T22:23:56.529452] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-10T22:23:56.529515] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-10T22:23:56.533272] [DEBUG] [LOCAL ] WK: Trimmed 52722 records to 37775 (keeping 200 days of data) [2025-10-10T22:23:56.766466] [DEBUG] [LOCAL ] WK: Primary data saved (37775 records). [2025-10-10T22:23:56.766621] [INFO ] [MAIN ] WK: Full history saved. [2025-10-10T22:23:56.766738] [INFO ] [MAIN ] Update Progress: 2302/2373 symbols completed. WK took 35.0s. Estimated remaining: 9m 59s. Rate: 7.1 symbols/min [2025-10-10T22:23:56.958895] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-10T22:23:56.969857] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:23:56.970581] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-10T22:23:56.971089] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-10T22:23:56.971214] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-10T22:23:56.971256] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-10T22:23:56.971297] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-10T22:23:56.971331] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-10T22:23:57.094605] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-10-10T22:23:57.338177] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:23:57.889364] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-10T22:23:57.997968] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-10T22:23:58.084778] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-10T22:23:58.689417] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-10T22:23:59.489356] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-10T22:23:59.546162] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T22:24:00.289420] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-10-10T22:24:00.324444] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-10T22:24:00.407033] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-10T22:24:00.722881] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-10T22:24:01.089357] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-10T22:24:01.889393] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-10T22:24:02.663441] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-10T22:24:02.689348] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-10T22:24:02.912894] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T22:24:03.485136] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-10T22:24:03.489325] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-10T22:24:04.289373] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-10T22:24:04.361285] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-10T22:24:05.089443] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-10T22:24:05.501090] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-10T22:24:05.648180] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-10T22:24:05.651558] [INFO ] [REMOTE ] WKC: Full fetch complete (50400 records). [2025-10-10T22:24:05.651676] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-10T22:24:05.894553] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-10T22:24:06.031495] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-10T22:24:06.031574] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-10T22:24:06.032597] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-10T22:24:06.032685] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-10T22:24:06.033775] [DEBUG] [LOCAL ] WKC: Trimmed 50400 records to 35157 (keeping 200 days of data) [2025-10-10T22:24:06.247078] [DEBUG] [LOCAL ] WKC: Primary data saved (35157 records). [2025-10-10T22:24:06.247228] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-10T22:24:06.247314] [INFO ] [MAIN ] Update Progress: 2303/2373 symbols completed. WKC took 37.5s. Estimated remaining: 9m 51s. Rate: 7.1 symbols/min [2025-10-10T22:24:06.412673] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:24:06.444046] [DEBUG] [LOCAL ] WLY: Loaded 29747 existing records from primary storage. [2025-10-10T22:24:06.444330] [INFO ] [MAIN ] WLY: Loaded 29747 existing records. [2025-10-10T22:24:06.621256] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:24:06.621494] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-10T22:24:06.621547] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-10T22:24:06.621909] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-10T22:24:06.621968] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-10T22:24:06.695143] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-10T22:24:06.899005] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-10T22:24:06.991299] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:24:07.489370] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-10T22:24:08.289358] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-10-10T22:24:08.398843] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-10T22:24:08.663389] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-10T22:24:09.089357] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-10T22:24:09.312208] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-10T22:24:09.889329] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-10T22:24:10.689396] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-10T22:24:10.966820] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T22:24:11.087127] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-10T22:24:11.299314] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-10T22:24:11.489403] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-10T22:24:12.289357] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-10T22:24:12.816042] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T22:24:13.089411] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-10T22:24:13.889348] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-10T22:24:14.106038] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T22:24:14.628163] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-10T22:24:14.689393] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-10T22:24:14.733289] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-10T22:24:15.489351] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-10T22:24:15.585622] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-10T22:24:16.289431] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-10T22:24:17.046293] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-10T22:24:17.063325] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-10T22:24:17.089332] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-10T22:24:17.570738] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-10T22:24:17.889376] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-10T22:24:18.689408] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-10T22:24:19.489376] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-10T22:24:19.576302] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-10T22:24:19.712532] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-10T22:24:20.289412] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-10T22:24:20.982903] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-10T22:24:20.985266] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-10T22:24:20.993452] [INFO ] [REMOTE ] WLKP: Full fetch complete (10202 records). [2025-10-10T22:24:20.993945] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-10T22:24:21.096277] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-10T22:24:21.356428] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-10T22:24:21.356511] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-10T22:24:21.356865] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-10T22:24:21.356948] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-10T22:24:21.357394] [DEBUG] [LOCAL ] WLKP: Trimmed 10202 records to 7020 (keeping 200 days of data) [2025-10-10T22:24:21.399675] [DEBUG] [LOCAL ] WLKP: Primary data saved (7020 records). [2025-10-10T22:24:21.399812] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-10T22:24:21.399896] [INFO ] [MAIN ] Update Progress: 2304/2373 symbols completed. WLKP took 26.3s. Estimated remaining: 9m 43s. Rate: 7.1 symbols/min [2025-10-10T22:24:21.567382] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:24:21.620325] [DEBUG] [LOCAL ] WM: Loaded 51339 existing records from primary storage. [2025-10-10T22:24:21.620714] [INFO ] [MAIN ] WM: Loaded 51339 existing records. [2025-10-10T22:24:21.791893] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:24:21.792139] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-10T22:24:21.792194] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-10T22:24:21.792422] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-10T22:24:21.792480] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-10T22:24:21.894489] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-10T22:24:22.140155] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:24:22.251731] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-10T22:24:22.689358] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-10T22:24:23.006049] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-10T22:24:23.019660] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-10T22:24:23.489383] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-10T22:24:24.289386] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-10T22:24:25.009827] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-10T22:24:25.089343] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-10T22:24:25.524593] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-10T22:24:25.889477] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-10T22:24:26.690138] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-10-10T22:24:26.690006] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-10T22:24:27.157076] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-10T22:24:27.163445] [INFO ] [REMOTE ] WLK: Full fetch complete (63320 records). [2025-10-10T22:24:27.163727] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-10T22:24:27.494771] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-10T22:24:27.642515] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-10T22:24:27.642703] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-10T22:24:27.644666] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-10T22:24:27.644746] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-10T22:24:27.646771] [DEBUG] [LOCAL ] WLK: Trimmed 63320 records to 46251 (keeping 200 days of data) [2025-10-10T22:24:27.967206] [DEBUG] [LOCAL ] WLK: Primary data saved (46251 records). [2025-10-10T22:24:27.967407] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-10T22:24:27.967520] [INFO ] [MAIN ] Update Progress: 2305/2373 symbols completed. WLK took 35.5s. Estimated remaining: 9m 34s. Rate: 7.1 symbols/min [2025-10-10T22:24:28.152106] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:24:28.207164] [DEBUG] [LOCAL ] WMB: Loaded 54062 existing records from primary storage. [2025-10-10T22:24:28.207734] [INFO ] [MAIN ] WMB: Loaded 54062 existing records. [2025-10-10T22:24:28.300623] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-10T22:24:28.394029] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:24:28.394309] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-10T22:24:28.394363] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-10T22:24:28.394601] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-10T22:24:28.394716] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-10T22:24:28.774919] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:24:28.815011] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-10T22:24:28.843404] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-10T22:24:28.867889] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T22:24:29.089386] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-10T22:24:29.889400] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-10T22:24:30.415881] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-10T22:24:30.689343] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-10T22:24:31.238227] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-10T22:24:31.489421] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-10T22:24:31.893913] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-10T22:24:32.168184] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-10T22:24:32.289421] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-10T22:24:33.089390] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-10-10T22:24:33.889421] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-10T22:24:34.304719] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-10T22:24:34.307054] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-10T22:24:34.305992] [INFO ] [REMOTE ] WLTG: Full fetch complete (1674 records). [2025-10-10T22:24:34.307225] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-10T22:24:34.499260] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T22:24:34.499614] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-10T22:24:34.499879] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-10T22:24:34.499973] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-10T22:24:34.500150] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-10T22:24:34.500204] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-10T22:24:34.500247] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-10T22:24:34.500308] [INFO ] [MAIN ] Update Progress: 2306/2373 symbols completed. WLTG took 37.7s. Estimated remaining: 9m 26s. Rate: 7.1 symbols/min [2025-10-10T22:24:34.678105] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:24:34.699828] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-10T22:24:34.724438] [DEBUG] [LOCAL ] WMK: Loaded 14682 existing records from primary storage. [2025-10-10T22:24:34.724868] [INFO ] [MAIN ] WMK: Loaded 14682 existing records. [2025-10-10T22:24:34.747844] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-10T22:24:34.921697] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:24:34.921940] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-10T22:24:34.921991] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-10T22:24:34.922161] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-10T22:24:34.922199] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-10T22:24:35.268704] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:24:35.489349] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-10-10T22:24:36.039503] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T22:24:36.042604] [INFO ] [REMOTE ] WLY: Full fetch complete (42721 records). [2025-10-10T22:24:36.042703] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-10T22:24:36.300310] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-10T22:24:36.428295] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-10T22:24:36.428407] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-10T22:24:36.429354] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-10T22:24:36.429414] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-10T22:24:36.430312] [DEBUG] [LOCAL ] WLY: Trimmed 42721 records to 29980 (keeping 200 days of data) [2025-10-10T22:24:36.589596] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-10T22:24:36.622002] [DEBUG] [LOCAL ] WLY: Primary data saved (29980 records). [2025-10-10T22:24:36.622142] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-10T22:24:36.622223] [INFO ] [MAIN ] Update Progress: 2307/2373 symbols completed. WLY took 30.4s. Estimated remaining: 9m 17s. Rate: 7.1 symbols/min [2025-10-10T22:24:36.788193] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:24:36.828258] [DEBUG] [LOCAL ] WMS: Loaded 39854 existing records from primary storage. [2025-10-10T22:24:36.828578] [INFO ] [MAIN ] WMS: Loaded 39854 existing records. [2025-10-10T22:24:37.001602] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:24:37.001839] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-10T22:24:37.001886] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-10T22:24:37.002108] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-10T22:24:37.002163] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-10T22:24:37.097164] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-10T22:24:37.352195] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:24:37.889345] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-10T22:24:38.501881] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-10T22:24:38.689342] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-10T22:24:38.875932] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-10T22:24:39.220636] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-10T22:24:39.489376] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-10T22:24:40.289357] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-10T22:24:41.031337] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-10T22:24:41.082259] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-10T22:24:41.093133] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-10-10T22:24:41.250513] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-10T22:24:41.889398] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-10T22:24:42.689370] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-10T22:24:42.847023] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-10T22:24:43.008754] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-10T22:24:43.489425] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-10T22:24:44.289006] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-10T22:24:44.299996] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-10T22:24:45.089396] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-10T22:24:45.131746] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-10T22:24:45.464044] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-10T22:24:45.889378] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-10T22:24:46.689363] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-10T22:24:47.249077] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T22:24:47.489481] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-10T22:24:47.620218] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T22:24:47.881679] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-10T22:24:48.289393] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-10T22:24:49.089415] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-10T22:24:49.481466] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-10T22:24:49.607336] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T22:24:49.889439] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-10T22:24:50.689344] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-10T22:24:50.973499] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-10T22:24:51.175568] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-10T22:24:51.489373] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-10T22:24:52.289417] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-10T22:24:52.537579] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-10T22:24:53.094559] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-10T22:24:53.114174] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-10T22:24:53.889349] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-10T22:24:54.285034] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T22:24:54.442731] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-10T22:24:54.689402] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-10T22:24:55.489402] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-10T22:24:55.954709] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-10T22:24:56.289362] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-10T22:24:56.353875] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-10T22:24:57.089362] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-10T22:24:57.575049] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-10T22:24:57.889402] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-10T22:24:58.290926] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-10T22:24:58.689398] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-10T22:24:58.784842] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-10T22:24:59.071228] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-10T22:24:59.470312] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T22:24:59.475312] [INFO ] [REMOTE ] WM: Full fetch complete (73742 records). [2025-10-10T22:24:59.475445] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-10T22:24:59.496336] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-10T22:24:59.860481] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-10T22:24:59.860598] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-10T22:24:59.862023] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-10T22:24:59.862096] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-10T22:24:59.864185] [DEBUG] [LOCAL ] WM: Trimmed 73742 records to 51718 (keeping 200 days of data) [2025-10-10T22:25:00.220683] [DEBUG] [LOCAL ] WM: Primary data saved (51718 records). [2025-10-10T22:25:00.220880] [INFO ] [MAIN ] WM: Full history saved. [2025-10-10T22:25:00.221284] [INFO ] [MAIN ] Update Progress: 2308/2373 symbols completed. WM took 38.8s. Estimated remaining: 9m 9s. Rate: 7.1 symbols/min [2025-10-10T22:25:00.297790] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-10T22:25:00.404207] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:25:00.464227] [DEBUG] [LOCAL ] WMT: Loaded 54190 existing records from primary storage. [2025-10-10T22:25:00.464631] [INFO ] [MAIN ] WMT: Loaded 54190 existing records. [2025-10-10T22:25:00.661124] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:25:00.661387] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-10T22:25:00.661439] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-10T22:25:00.661721] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-10T22:25:00.661778] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-10T22:25:01.043760] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:25:01.089403] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-10-10T22:25:01.839360] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-10T22:25:01.889403] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-10T22:25:02.223447] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T22:25:02.689396] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-10T22:25:03.489355] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-10T22:25:04.066278] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-10T22:25:04.184138] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (3.09 seconds). [2025-10-10T22:25:04.294080] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-10T22:25:04.300282] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-10T22:25:04.476260] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-10T22:25:04.478322] [INFO ] [REMOTE ] WMK: Full fetch complete (19848 records). [2025-10-10T22:25:04.478438] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-10T22:25:04.867310] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-10T22:25:04.867410] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-10T22:25:04.868065] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-10T22:25:04.868127] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-10T22:25:04.868827] [DEBUG] [LOCAL ] WMK: Trimmed 19848 records to 14815 (keeping 200 days of data) [2025-10-10T22:25:04.969857] [DEBUG] [LOCAL ] WMK: Primary data saved (14815 records). [2025-10-10T22:25:04.970050] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-10T22:25:04.970174] [INFO ] [MAIN ] Update Progress: 2309/2373 symbols completed. WMK took 30.5s. Estimated remaining: 9m 1s. Rate: 7.1 symbols/min [2025-10-10T22:25:05.094523] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-10T22:25:05.151867] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:25:05.197211] [DEBUG] [LOCAL ] WNC: Loaded 39050 existing records from primary storage. [2025-10-10T22:25:05.197613] [INFO ] [MAIN ] WNC: Loaded 39050 existing records. [2025-10-10T22:25:05.381476] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:25:05.381764] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-10T22:25:05.381820] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-10T22:25:05.382287] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-10T22:25:05.382344] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-10T22:25:05.741071] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:25:05.889382] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-10-10T22:25:06.689440] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-10T22:25:06.982003] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T22:25:07.040681] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-10T22:25:07.415140] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-10T22:25:07.489367] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-10T22:25:08.246127] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-10T22:25:08.289345] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-10T22:25:08.693383] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-10T22:25:09.083330] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-10T22:25:09.088756] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-10-10T22:25:09.088895] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-10T22:25:09.089423] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-10T22:25:09.506585] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-10T22:25:09.506708] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-10T22:25:09.508351] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-10T22:25:09.508423] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-10T22:25:09.510263] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 54452 (keeping 200 days of data) [2025-10-10T22:25:09.859250] [DEBUG] [LOCAL ] WMB: Primary data saved (54452 records). [2025-10-10T22:25:09.859394] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-10T22:25:09.859478] [INFO ] [MAIN ] Update Progress: 2310/2373 symbols completed. WMB took 41.9s. Estimated remaining: 8m 52s. Rate: 7.1 symbols/min [2025-10-10T22:25:09.894468] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-10T22:25:10.029821] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:25:10.067391] [DEBUG] [LOCAL ] WNS: Loaded 40148 existing records from primary storage. [2025-10-10T22:25:10.067711] [INFO ] [MAIN ] WNS: Loaded 40148 existing records. [2025-10-10T22:25:10.239082] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:25:10.239292] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-10-10T22:25:10.239339] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-10-10T22:25:10.239544] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-10-10T22:25:10.239584] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-10-10T22:25:10.587962] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:25:10.689346] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-10-10T22:25:11.489364] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-10T22:25:11.731436] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-10T22:25:11.885945] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-10-10T22:25:12.248669] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-10T22:25:12.289348] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-10-10T22:25:13.089352] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-10T22:25:13.241900] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-10T22:25:13.891387] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-10T22:25:13.895903] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-10T22:25:14.689401] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-10T22:25:15.468961] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T22:25:15.473157] [INFO ] [REMOTE ] WMS: Full fetch complete (57136 records). [2025-10-10T22:25:15.473276] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-10T22:25:15.498470] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-10-10T22:25:15.888864] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-10T22:25:15.889043] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-10T22:25:15.891237] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-10T22:25:15.891335] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-10T22:25:15.893352] [DEBUG] [LOCAL ] WMS: Trimmed 57136 records to 40212 (keeping 200 days of data) [2025-10-10T22:25:16.066361] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-10-10T22:25:16.229128] [DEBUG] [LOCAL ] WMS: Primary data saved (40212 records). [2025-10-10T22:25:16.229273] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-10T22:25:16.229359] [INFO ] [MAIN ] Update Progress: 2311/2373 symbols completed. WMS took 39.6s. Estimated remaining: 8m 43s. Rate: 7.1 symbols/min [2025-10-10T22:25:16.293676] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-10T22:25:16.421038] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:25:16.474826] [DEBUG] [LOCAL ] WOLF: Loaded 53561 existing records from primary storage. [2025-10-10T22:25:16.475157] [INFO ] [MAIN ] WOLF: Loaded 53561 existing records. [2025-10-10T22:25:16.656091] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:25:16.656469] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-10T22:25:16.656558] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-10T22:25:16.666084] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-10T22:25:16.682207] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-10T22:25:16.728224] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T22:25:17.065398] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:25:17.082202] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-10T22:25:17.089338] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-10-10T22:25:17.889378] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-10T22:25:18.689439] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-10-10T22:25:19.178715] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.89 seconds). [2025-10-10T22:25:19.457555] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-10T22:25:19.489358] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-10T22:25:19.728042] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-10T22:25:19.761968] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-10T22:25:20.289426] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-10-10T22:25:21.089406] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-10T22:25:21.889358] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-10T22:25:22.026032] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-10T22:25:22.060451] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-10T22:25:22.689364] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-10T22:25:23.489445] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-10-10T22:25:23.701001] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T22:25:23.962310] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-10-10T22:25:24.289427] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-10T22:25:24.646523] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-10T22:25:25.089341] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-10T22:25:25.120624] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T22:25:25.889389] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-10-10T22:25:26.551588] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-10T22:25:26.689409] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-10T22:25:26.985359] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-10T22:25:27.431104] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-10T22:25:27.489369] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-10-10T22:25:28.289367] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-10T22:25:29.095582] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-10T22:25:29.109383] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-10T22:25:29.391842] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-10T22:25:29.889439] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-10-10T22:25:30.689469] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-10T22:25:30.919350] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-10T22:25:31.128116] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-10-10T22:25:31.489423] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-10T22:25:31.656195] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-10T22:25:32.289413] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-10T22:25:32.931934] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-10T22:25:33.089344] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-10-10T22:25:33.889342] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-10T22:25:34.015840] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-10T22:25:34.385073] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-10-10T22:25:34.689365] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-10T22:25:34.751144] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T22:25:35.489455] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-10. [2025-10-10T22:25:36.289411] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-10T22:25:36.612271] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-10T22:25:36.943597] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-10T22:25:36.949423] [INFO ] [REMOTE ] WNS: Full fetch complete (55124 records). [2025-10-10T22:25:36.949531] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-10-10T22:25:37.098554] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-10T22:25:37.352003] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-10-10T22:25:37.352258] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-10-10T22:25:37.354289] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-10-10T22:25:37.354491] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-10-10T22:25:37.374770] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-10T22:25:37.373971] [DEBUG] [LOCAL ] WNS: Trimmed 55124 records to 40459 (keeping 200 days of data) [2025-10-10T22:25:37.508113] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-10-10T22:25:37.667686] [DEBUG] [LOCAL ] WNS: Primary data saved (40459 records). [2025-10-10T22:25:37.667817] [INFO ] [MAIN ] WNS: Full history saved. [2025-10-10T22:25:37.667897] [INFO ] [MAIN ] Update Progress: 2312/2373 symbols completed. WNS took 27.8s. Estimated remaining: 8m 35s. Rate: 7.1 symbols/min [2025-10-10T22:25:37.835768] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:25:37.860925] [DEBUG] [LOCAL ] WOR: Loaded 24817 existing records from primary storage. [2025-10-10T22:25:37.861181] [INFO ] [MAIN ] WOR: Loaded 24817 existing records. [2025-10-10T22:25:37.895908] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-10T22:25:38.048921] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:25:38.049158] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-10T22:25:38.049225] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-10T22:25:38.049514] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-10T22:25:38.049579] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-10T22:25:38.437173] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:25:38.689351] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-10-10T22:25:38.715317] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T22:25:38.720619] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-10-10T22:25:38.720786] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-10T22:25:39.110323] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-10T22:25:39.110437] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-10T22:25:39.111631] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-10T22:25:39.111734] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-10T22:25:39.113155] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 54580 (keeping 200 days of data) [2025-10-10T22:25:39.455067] [DEBUG] [LOCAL ] WMT: Primary data saved (54580 records). [2025-10-10T22:25:39.455196] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-10T22:25:39.455486] [INFO ] [MAIN ] Update Progress: 2313/2373 symbols completed. WMT took 39.2s. Estimated remaining: 8m 27s. Rate: 7.1 symbols/min [2025-10-10T22:25:39.497905] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-10T22:25:39.655910] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:25:39.707033] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-10T22:25:39.757879] [DEBUG] [LOCAL ] WOW: Loaded 30654 existing records from primary storage. [2025-10-10T22:25:39.758311] [INFO ] [MAIN ] WOW: Loaded 30654 existing records. [2025-10-10T22:25:40.025540] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:25:40.026095] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-10T22:25:40.026285] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-10T22:25:40.026592] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-10T22:25:40.026720] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-10T22:25:40.302203] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-10T22:25:40.308233] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T22:25:40.547882] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-10T22:25:40.574779] [INFO ] [REMOTE ] WNC: Full fetch complete (57455 records). [2025-10-10T22:25:40.590749] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-10T22:25:40.701310] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:25:41.103054] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-10T22:25:41.099844] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-10T22:25:41.103456] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-10T22:25:41.105546] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-10T22:25:41.105620] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-10T22:25:41.107129] [DEBUG] [LOCAL ] WNC: Trimmed 57455 records to 39319 (keeping 200 days of data) [2025-10-10T22:25:41.358084] [DEBUG] [LOCAL ] WNC: Primary data saved (39319 records). [2025-10-10T22:25:41.358231] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-10T22:25:41.358354] [INFO ] [MAIN ] Update Progress: 2314/2373 symbols completed. WNC took 36.4s. Estimated remaining: 8m 18s. Rate: 7.1 symbols/min [2025-10-10T22:25:41.524194] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:25:41.567334] [DEBUG] [LOCAL ] WPC: Loaded 48659 existing records from primary storage. [2025-10-10T22:25:41.567690] [INFO ] [MAIN ] WPC: Loaded 48659 existing records. [2025-10-10T22:25:41.743378] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:25:41.743777] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-10T22:25:41.743829] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-10T22:25:41.744118] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-10T22:25:41.744176] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-10T22:25:41.894779] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-10-10T22:25:42.104230] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:25:42.463156] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-10T22:25:42.694979] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-10-10T22:25:42.715922] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-10T22:25:43.391473] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-10T22:25:43.489335] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-10T22:25:44.289396] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-10T22:25:44.745625] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T22:25:44.826474] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T22:25:45.089375] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-10T22:25:45.889381] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-10T22:25:46.618634] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-10T22:25:46.689341] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-10T22:25:47.015988] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-10T22:25:47.100784] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-10T22:25:47.489413] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-10T22:25:48.289424] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-10T22:25:48.718792] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-10T22:25:49.089439] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-10T22:25:49.354439] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-10-10T22:25:49.851999] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-10T22:25:49.889328] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-10T22:25:50.689355] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-10T22:25:50.904700] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-10T22:25:51.356138] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-10T22:25:51.489348] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-10T22:25:52.289438] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-10T22:25:53.089368] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-10T22:25:53.293637] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-10T22:25:53.298771] [INFO ] [REMOTE ] WOLF: Full fetch complete (77237 records). [2025-10-10T22:25:53.298903] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-10T22:25:53.701267] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-10T22:25:53.701548] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-10T22:25:53.702839] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-10T22:25:53.703004] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-10T22:25:53.748539] [DEBUG] [LOCAL ] WOLF: Trimmed 77237 records to 53950 (keeping 200 days of data) [2025-10-10T22:25:53.756194] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-10T22:25:53.759220] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-10T22:25:53.889678] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-10T22:25:54.100177] [DEBUG] [LOCAL ] WOLF: Primary data saved (53950 records). [2025-10-10T22:25:54.100331] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-10T22:25:54.100429] [INFO ] [MAIN ] Update Progress: 2315/2373 symbols completed. WOLF took 37.9s. Estimated remaining: 8m 10s. Rate: 7.1 symbols/min [2025-10-10T22:25:54.270143] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:25:54.325205] [DEBUG] [LOCAL ] WPM: Loaded 53128 existing records from primary storage. [2025-10-10T22:25:54.339846] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-10T22:25:54.345491] [INFO ] [MAIN ] WPM: Loaded 53128 existing records. [2025-10-10T22:25:54.522796] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:25:54.523075] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-10T22:25:54.523131] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-10T22:25:54.523898] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-10T22:25:54.523956] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-10T22:25:54.702614] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-10T22:25:54.889975] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:25:55.489407] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-10T22:25:55.975469] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-10T22:25:56.105505] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-10T22:25:56.289364] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-10T22:25:57.066216] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-10T22:25:57.089342] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-10T22:25:57.695434] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-10T22:25:57.889354] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-10-10T22:25:58.287251] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-10T22:25:58.689379] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-10T22:25:59.494483] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-10T22:25:59.512371] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-10T22:25:59.964932] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-10T22:26:00.289389] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-10T22:26:01.089399] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-10T22:26:01.479959] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-10T22:26:01.889432] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-10T22:26:02.369755] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-10T22:26:02.592929] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T22:26:02.689394] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-10T22:26:03.489377] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-10T22:26:03.789912] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T22:26:04.103059] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-10T22:26:04.289407] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-10T22:26:04.749572] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-10T22:26:05.089440] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-10T22:26:05.889359] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-10T22:26:06.346417] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-10T22:26:06.689392] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-10T22:26:07.044526] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-10T22:26:07.267746] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T22:26:07.489352] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-10T22:26:08.289350] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-10T22:26:08.512994] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-10T22:26:08.687548] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-10T22:26:08.691701] [INFO ] [REMOTE ] WOR: Full fetch complete (36287 records). [2025-10-10T22:26:08.691850] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-10T22:26:09.083238] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-10T22:26:09.083369] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-10T22:26:09.084163] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-10T22:26:09.084615] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-10T22:26:09.085497] [DEBUG] [LOCAL ] WOR: Trimmed 36287 records to 24978 (keeping 200 days of data) [2025-10-10T22:26:09.137597] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-10T22:26:09.238259] [DEBUG] [LOCAL ] WOR: Primary data saved (24978 records). [2025-10-10T22:26:09.238396] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-10T22:26:09.238478] [INFO ] [MAIN ] Update Progress: 2316/2373 symbols completed. WOR took 31.6s. Estimated remaining: 8m 2s. Rate: 7.1 symbols/min [2025-10-10T22:26:09.404500] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:26:09.437554] [DEBUG] [LOCAL ] WPP: Loaded 34404 existing records from primary storage. [2025-10-10T22:26:09.437855] [INFO ] [MAIN ] WPP: Loaded 34404 existing records. [2025-10-10T22:26:09.611493] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:26:09.611729] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-10T22:26:09.611785] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-10T22:26:09.612001] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-10T22:26:09.612085] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-10T22:26:09.894731] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-10T22:26:09.969417] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:26:10.561510] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-10T22:26:10.689345] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-10T22:26:11.090524] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-10T22:26:11.489357] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-10T22:26:11.638705] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-10T22:26:12.289432] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-10-10T22:26:12.645416] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T22:26:13.089390] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-10T22:26:13.427563] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-10T22:26:13.509488] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-10T22:26:13.889398] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-10T22:26:14.689404] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-10T22:26:15.120817] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T22:26:15.184321] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-10T22:26:15.188749] [INFO ] [REMOTE ] WOW: Full fetch complete (42535 records). [2025-10-10T22:26:15.189250] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-10T22:26:15.494498] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-10T22:26:15.562114] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-10T22:26:15.562201] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-10T22:26:15.563215] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-10T22:26:15.563277] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-10T22:26:15.564199] [DEBUG] [LOCAL ] WOW: Trimmed 42535 records to 31014 (keeping 200 days of data) [2025-10-10T22:26:15.669666] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-10T22:26:15.769778] [DEBUG] [LOCAL ] WOW: Primary data saved (31014 records). [2025-10-10T22:26:15.769941] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-10T22:26:15.770055] [INFO ] [MAIN ] Update Progress: 2317/2373 symbols completed. WOW took 36.3s. Estimated remaining: 7m 53s. Rate: 7.1 symbols/min [2025-10-10T22:26:16.289415] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-10T22:26:17.089391] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-10T22:26:17.155936] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-10T22:26:17.160745] [INFO ] [REMOTE ] WPC: Full fetch complete (70577 records). [2025-10-10T22:26:17.160891] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-10T22:26:17.551770] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-10T22:26:17.552054] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-10T22:26:17.553456] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-10T22:26:17.553684] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-10T22:26:17.555491] [DEBUG] [LOCAL ] WPC: Trimmed 70577 records to 48975 (keeping 200 days of data) [2025-10-10T22:26:17.668179] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-10T22:26:17.886528] [DEBUG] [LOCAL ] WPC: Primary data saved (48975 records). [2025-10-10T22:26:17.886675] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-10T22:26:17.886780] [INFO ] [MAIN ] Update Progress: 2318/2373 symbols completed. WPC took 36.5s. Estimated remaining: 7m 44s. Rate: 7.1 symbols/min [2025-10-10T22:26:17.889342] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-10T22:26:19.224570] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-10T22:26:19.237303] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-10T22:26:19.257837] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-10T22:26:19.489399] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-10T22:26:20.781407] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-10T22:26:20.789148] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-10T22:26:21.350325] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-10T22:26:21.361946] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-10T22:26:22.319718] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-10T22:26:22.327469] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-10T22:26:23.413894] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-10T22:26:23.427415] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-10T22:26:24.004935] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-10T22:26:24.012088] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-10T22:26:25.456792] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-10T22:26:25.462167] [INFO ] [REMOTE ] WPM: Full fetch complete (75978 records). [2025-10-10T22:26:25.462344] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-10T22:26:25.895852] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-10T22:26:25.898422] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-10T22:26:25.898586] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-10T22:26:25.910095] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-10T22:26:25.910521] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-10T22:26:25.911768] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-10T22:26:25.913993] [DEBUG] [LOCAL ] WPM: Trimmed 75978 records to 53518 (keeping 200 days of data) [2025-10-10T22:26:26.249913] [DEBUG] [LOCAL ] WPM: Primary data saved (53518 records). [2025-10-10T22:26:26.250050] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-10T22:26:26.250130] [INFO ] [MAIN ] Update Progress: 2319/2373 symbols completed. WPM took 32.1s. Estimated remaining: 7m 36s. Rate: 7.1 symbols/min [2025-10-10T22:26:27.646782] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-10T22:26:27.654967] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-10T22:26:29.312313] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-10T22:26:29.320539] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-10T22:26:30.859197] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-10T22:26:30.863055] [INFO ] [REMOTE ] WPP: Full fetch complete (46418 records). [2025-10-10T22:26:30.863149] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-10T22:26:31.238724] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-10T22:26:31.238826] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-10T22:26:31.240111] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-10T22:26:31.240178] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-10T22:26:31.241216] [DEBUG] [LOCAL ] WPP: Trimmed 46418 records to 34748 (keeping 200 days of data) [2025-10-10T22:26:31.461607] [DEBUG] [LOCAL ] WPP: Primary data saved (34748 records). [2025-10-10T22:26:31.461801] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-10T22:26:31.461894] [INFO ] [MAIN ] Update Progress: 2320/2373 symbols completed. WPP took 22.2s. Estimated remaining: 7m 27s. Rate: 7.1 symbols/min [2025-10-10T22:26:32.077707] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:26:32.149505] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:26:32.154631] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:26:32.184260] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:26:32.245167] [DEBUG] [LOCAL ] WS: Loaded 23727 existing records from primary storage. [2025-10-10T22:26:32.245787] [INFO ] [MAIN ] WS: Loaded 23727 existing records. [2025-10-10T22:26:32.441262] [DEBUG] [LOCAL ] WRB: Loaded 51053 existing records from primary storage. [2025-10-10T22:26:32.435909] [DEBUG] [LOCAL ] WRBY: Loaded 51073 existing records from primary storage. [2025-10-10T22:26:32.477520] [INFO ] [MAIN ] WRB: Loaded 51053 existing records. [2025-10-10T22:26:32.520520] [INFO ] [MAIN ] WRBY: Loaded 51073 existing records. [2025-10-10T22:26:32.594304] [DEBUG] [LOCAL ] WSM: Loaded 49654 existing records from primary storage. [2025-10-10T22:26:32.643293] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:26:32.700910] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-10T22:26:32.643600] [INFO ] [MAIN ] WSM: Loaded 49654 existing records. [2025-10-10T22:26:32.749379] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-10T22:26:32.831790] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-10T22:26:32.945241] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-10T22:26:33.329204] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:26:33.349004] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:26:33.369121] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-10T22:26:33.382695] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-10T22:26:33.388286] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-10T22:26:33.388223] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-10T22:26:33.482141] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-10T22:26:33.487716] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-10T22:26:33.487604] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-10T22:26:33.537414] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-10T22:26:33.538937] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:26:33.597075] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-10T22:26:33.652369] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-10T22:26:33.697939] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-10T22:26:33.708281] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-10T22:26:34.422099] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:26:34.601359] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-10-10T22:26:34.827776] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:26:34.847792] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-10-10T22:26:34.918100] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:26:34.943745] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:26:34.944312] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-10-10T22:26:34.944566] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-10-10T22:26:36.335381] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-10T22:26:36.345064] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-10T22:26:36.745065] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T22:26:36.755199] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-10T22:26:36.826778] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-10T22:26:36.836993] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-10T22:26:36.923957] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T22:26:36.935194] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-10T22:26:37.731609] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-10T22:26:37.737572] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-10T22:26:38.439872] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-10T22:26:38.451468] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-10T22:26:38.804073] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-10T22:26:38.814638] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-10T22:26:38.935119] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-10T22:26:38.945905] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-10T22:26:39.108939] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-10T22:26:39.115705] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-10T22:26:40.339147] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T22:26:40.349459] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-10T22:26:40.420686] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-10T22:26:40.430370] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-10T22:26:40.461365] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-10T22:26:40.471271] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-10T22:26:40.640913] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-10T22:26:40.647462] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-10T22:26:42.059154] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-10T22:26:42.064777] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-10T22:26:42.195232] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T22:26:42.207070] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-10T22:26:42.290361] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-10T22:26:42.301330] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-10T22:26:42.428409] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-10T22:26:42.689420] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-10T22:26:42.782125] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-10T22:26:43.489396] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-10T22:26:44.355673] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-10T22:26:44.367771] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-10T22:26:44.408429] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-10T22:26:44.671301] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-10T22:26:45.089405] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-10T22:26:45.278838] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T22:26:45.858229] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-10T22:26:45.889329] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-10T22:26:46.503885] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-10T22:26:46.689364] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-10T22:26:47.489353] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-10T22:26:47.733255] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-10T22:26:48.289412] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-10T22:26:48.634511] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T22:26:49.096971] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-10T22:26:49.117940] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T22:26:49.146327] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-10T22:26:49.889396] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-10T22:26:50.689431] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-10T22:26:51.083814] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-10T22:26:51.140830] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-10T22:26:51.489477] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-10T22:26:52.289336] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-10T22:26:52.725310] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-10T22:26:53.089435] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-10T22:26:53.267758] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-10T22:26:53.889358] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-10T22:26:54.298295] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-10T22:26:54.689346] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-10T22:26:55.019009] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T22:26:55.184880] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T22:26:55.489425] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-10T22:26:56.193896] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-10T22:26:56.289346] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-10T22:26:56.668332] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-10T22:26:56.671303] [INFO ] [REMOTE ] WS: Full fetch complete (36256 records). [2025-10-10T22:26:56.671398] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-10T22:26:57.053330] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-10T22:26:57.053435] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-10T22:26:57.054401] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-10T22:26:57.054469] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-10T22:26:57.055781] [DEBUG] [LOCAL ] WS: Trimmed 36256 records to 23878 (keeping 200 days of data) [2025-10-10T22:26:57.114327] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-10T22:26:57.209853] [DEBUG] [LOCAL ] WS: Primary data saved (23878 records). [2025-10-10T22:26:57.209990] [INFO ] [MAIN ] WS: Full history saved. [2025-10-10T22:26:57.210072] [INFO ] [MAIN ] Update Progress: 2321/2373 symbols completed. WS took 25.7s. Estimated remaining: 7m 19s. Rate: 7.1 symbols/min [2025-10-10T22:26:57.382535] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:26:57.408324] [DEBUG] [LOCAL ] WSO: Loaded 25356 existing records from primary storage. [2025-10-10T22:26:57.408602] [INFO ] [MAIN ] WSO: Loaded 25356 existing records. [2025-10-10T22:26:57.584751] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:26:57.584959] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-10T22:26:57.585007] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-10T22:26:57.585215] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-10T22:26:57.585272] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-10T22:26:57.902932] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-10T22:26:57.943176] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:26:58.204569] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-10T22:26:58.689368] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-10-10T22:26:59.156064] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-10T22:26:59.494590] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-10T22:26:59.509934] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-10T22:27:00.076002] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-10T22:27:00.266362] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-10T22:27:00.272023] [INFO ] [REMOTE ] WRB: Full fetch complete (73396 records). [2025-10-10T22:27:00.272182] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-10T22:27:00.294598] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-10T22:27:00.678528] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-10T22:27:00.678639] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-10T22:27:00.681054] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-10T22:27:00.681134] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-10T22:27:00.683297] [DEBUG] [LOCAL ] WRB: Trimmed 73396 records to 51438 (keeping 200 days of data) [2025-10-10T22:27:01.019251] [DEBUG] [LOCAL ] WRB: Primary data saved (51438 records). [2025-10-10T22:27:01.019398] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-10T22:27:01.019766] [INFO ] [MAIN ] Update Progress: 2322/2373 symbols completed. WRB took 29.6s. Estimated remaining: 7m 11s. Rate: 7.1 symbols/min [2025-10-10T22:27:01.094588] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-10T22:27:01.189386] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:27:01.214048] [DEBUG] [LOCAL ] WSR: Loaded 23050 existing records from primary storage. [2025-10-10T22:27:01.214314] [INFO ] [MAIN ] WSR: Loaded 23050 existing records. [2025-10-10T22:27:01.389256] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:27:01.389494] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-10T22:27:01.389540] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-10T22:27:01.389777] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-10T22:27:01.389832] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-10T22:27:01.737935] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:27:01.896859] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-10T22:27:01.899031] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-10T22:27:01.938958] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-10T22:27:02.689387] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-10T22:27:03.472780] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T22:27:03.477507] [INFO ] [REMOTE ] WSM: Full fetch complete (71615 records). [2025-10-10T22:27:03.477621] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-10T22:27:03.499210] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-10-10T22:27:03.637970] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-10T22:27:03.672785] [INFO ] [REMOTE ] WRBY: Full fetch complete (73530 records). [2025-10-10T22:27:03.692321] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-10T22:27:04.084206] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-10T22:27:04.117490] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-10T22:27:04.156554] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-10T22:27:04.167235] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-10T22:27:04.200145] [DEBUG] [LOCAL ] WSM: Trimmed 71615 records to 50013 (keeping 200 days of data) [2025-10-10T22:27:04.309121] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-10T22:27:04.362378] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-10T22:27:04.390377] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-10T22:27:04.391211] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-10T22:27:04.391741] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-10T22:27:04.397037] [DEBUG] [LOCAL ] WRBY: Trimmed 73530 records to 51446 (keeping 200 days of data) [2025-10-10T22:27:04.855035] [DEBUG] [LOCAL ] WRBY: Primary data saved (51446 records). [2025-10-10T22:27:04.855679] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-10T22:27:04.856259] [INFO ] [MAIN ] Update Progress: 2323/2373 symbols completed. WRBY took 33.4s. Estimated remaining: 7m 2s. Rate: 7.1 symbols/min [2025-10-10T22:27:05.035287] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-10T22:27:05.100482] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:27:05.101604] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-10T22:27:05.121101] [DEBUG] [LOCAL ] WSM: Primary data saved (50013 records). [2025-10-10T22:27:05.121579] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-10T22:27:05.121709] [INFO ] [MAIN ] Update Progress: 2324/2373 symbols completed. WSM took 33.6s. Estimated remaining: 6m 54s. Rate: 7.1 symbols/min [2025-10-10T22:27:05.311534] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:27:05.326715] [DEBUG] [LOCAL ] WST: Loaded 37212 existing records from primary storage. [2025-10-10T22:27:05.327268] [INFO ] [MAIN ] WST: Loaded 37212 existing records. [2025-10-10T22:27:05.485047] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-10T22:27:05.528019] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:27:05.541256] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-10T22:27:05.544977] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-10T22:27:05.546704] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-10T22:27:05.546774] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-10T22:27:05.666901] [DEBUG] [LOCAL ] WT: Loaded 48271 existing records from primary storage. [2025-10-10T22:27:05.683061] [INFO ] [MAIN ] WT: Loaded 48271 existing records. [2025-10-10T22:27:05.900765] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-10T22:27:06.077430] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:27:06.082878] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-10T22:27:06.114388] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-10T22:27:06.141070] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-10T22:27:06.150994] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-10T22:27:06.150790] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:27:06.440456] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-10T22:27:06.524635] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:27:06.689391] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-10T22:27:06.936456] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-10T22:27:07.489398] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-10-10T22:27:07.994975] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T22:27:08.289405] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-10T22:27:09.089408] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-10T22:27:09.324805] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-10T22:27:09.620753] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-10T22:27:09.889395] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-10-10T22:27:10.560926] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-10T22:27:10.689360] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-10T22:27:10.959114] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-10T22:27:11.489370] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-10T22:27:12.017993] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-10T22:27:12.289380] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-10T22:27:12.413271] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-10T22:27:13.089396] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-10T22:27:13.889398] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-10T22:27:14.018637] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T22:27:14.401746] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-10T22:27:14.689384] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-10T22:27:15.021847] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-10T22:27:15.489403] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-10T22:27:16.289422] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-10T22:27:16.463142] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T22:27:16.867617] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-10T22:27:17.089369] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-10T22:27:17.889358] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-10T22:27:18.068015] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-10T22:27:18.689443] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-10T22:27:18.951759] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-10T22:27:19.257473] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-10T22:27:19.489349] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-10T22:27:20.136597] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-10T22:27:20.289455] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-10T22:27:21.089394] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-10T22:27:21.343464] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-10T22:27:21.889417] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-10T22:27:21.958121] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-10T22:27:22.367416] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-10T22:27:22.689380] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-10T22:27:22.707760] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-10T22:27:23.489418] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-10T22:27:24.289373] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-10T22:27:24.647998] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-10T22:27:25.089501] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-10T22:27:25.529942] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T22:27:25.549339] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-10T22:27:25.552535] [INFO ] [REMOTE ] WSO: Full fetch complete (35030 records). [2025-10-10T22:27:25.552630] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-10T22:27:25.891524] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-10T22:27:25.927181] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-10T22:27:25.927257] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-10T22:27:25.927830] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-10T22:27:25.928056] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-10T22:27:25.928916] [DEBUG] [LOCAL ] WSO: Trimmed 35030 records to 25618 (keeping 200 days of data) [2025-10-10T22:27:26.088942] [DEBUG] [LOCAL ] WSO: Primary data saved (25618 records). [2025-10-10T22:27:26.089075] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-10T22:27:26.089156] [INFO ] [MAIN ] Update Progress: 2325/2373 symbols completed. WSO took 28.9s. Estimated remaining: 6m 46s. Rate: 7.1 symbols/min [2025-10-10T22:27:26.254933] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:27:26.295676] [DEBUG] [LOCAL ] WTI: Loaded 44511 existing records from primary storage. [2025-10-10T22:27:26.295966] [INFO ] [MAIN ] WTI: Loaded 44511 existing records. [2025-10-10T22:27:26.487405] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-10T22:27:26.490928] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:27:26.497156] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-10T22:27:26.497428] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-10T22:27:26.498619] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-10T22:27:26.498718] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-10T22:27:26.694618] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-10T22:27:26.850460] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:27:27.489431] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-10T22:27:27.773093] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-10T22:27:27.988660] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-10T22:27:28.289400] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-10T22:27:29.089419] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-10-10T22:27:29.248855] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-10T22:27:29.889362] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-10T22:27:30.201488] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-10T22:27:30.440841] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-10T22:27:30.674598] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-10T22:27:30.689326] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-10T22:27:31.489435] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-10T22:27:31.761430] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-10T22:27:31.764829] [INFO ] [REMOTE ] WSR: Full fetch complete (32652 records). [2025-10-10T22:27:31.764968] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-10T22:27:32.197585] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-10T22:27:32.197741] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-10T22:27:32.199046] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-10T22:27:32.199160] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-10T22:27:32.200481] [DEBUG] [LOCAL ] WSR: Trimmed 32652 records to 23191 (keeping 200 days of data) [2025-10-10T22:27:32.293774] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-10T22:27:32.358342] [DEBUG] [LOCAL ] WSR: Primary data saved (23191 records). [2025-10-10T22:27:32.358530] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-10T22:27:32.358637] [INFO ] [MAIN ] Update Progress: 2326/2373 symbols completed. WSR took 31.3s. Estimated remaining: 6m 37s. Rate: 7.1 symbols/min [2025-10-10T22:27:32.541781] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:27:32.542011] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-10T22:27:32.542052] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-10T22:27:32.542179] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-10T22:27:32.542221] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-10T22:27:32.542265] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-10T22:27:32.542302] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-10T22:27:32.920509] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:27:33.089387] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-10T22:27:33.175359] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T22:27:33.889423] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-10T22:27:34.275020] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T22:27:34.689415] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-10T22:27:35.008046] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-10T22:27:35.489426] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-10T22:27:35.710301] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-10T22:27:36.073368] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-10T22:27:36.289392] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-10T22:27:36.728405] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-10T22:27:37.089433] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-10T22:27:37.560575] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-10T22:27:37.566686] [INFO ] [REMOTE ] WT: Full fetch complete (69371 records). [2025-10-10T22:27:37.566918] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-10T22:27:37.894505] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-10T22:27:37.985347] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-10T22:27:37.985465] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-10T22:27:37.987352] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-10T22:27:37.987443] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-10T22:27:37.989433] [DEBUG] [LOCAL ] WT: Trimmed 69371 records to 48659 (keeping 200 days of data) [2025-10-10T22:27:38.348707] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T22:27:38.354189] [DEBUG] [LOCAL ] WT: Primary data saved (48659 records). [2025-10-10T22:27:38.363712] [INFO ] [MAIN ] WT: Full history saved. [2025-10-10T22:27:38.363870] [INFO ] [MAIN ] Update Progress: 2327/2373 symbols completed. WT took 33.2s. Estimated remaining: 6m 29s. Rate: 7.1 symbols/min [2025-10-10T22:27:38.547788] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:27:38.603442] [DEBUG] [LOCAL ] WTRG: Loaded 51344 existing records from primary storage. [2025-10-10T22:27:38.603895] [INFO ] [MAIN ] WTRG: Loaded 51344 existing records. [2025-10-10T22:27:38.696194] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-10T22:27:38.792276] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:27:38.792584] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-10T22:27:38.792636] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-10T22:27:38.792934] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-10T22:27:38.792992] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-10T22:27:39.191902] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:27:39.216663] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-10T22:27:39.489416] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-10-10T22:27:39.843081] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-10T22:27:40.289396] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-10T22:27:40.486775] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T22:27:40.835675] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-10T22:27:41.089459] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-10T22:27:41.889432] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-10T22:27:42.689357] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-10-10T22:27:42.820994] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-10T22:27:42.966228] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T22:27:43.489412] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-10T22:27:43.863110] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-10T22:27:44.182476] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-10T22:27:44.289381] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-10T22:27:44.821258] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-10T22:27:45.089393] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-10T22:27:45.889379] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-10T22:27:46.689413] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-10T22:27:47.083896] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-10T22:27:47.423589] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-10T22:27:47.427411] [INFO ] [REMOTE ] WST: Full fetch complete (53940 records). [2025-10-10T22:27:47.427508] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-10T22:27:47.494595] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-10T22:27:47.808839] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-10T22:27:47.809090] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-10T22:27:47.810425] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-10T22:27:47.810494] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-10T22:27:47.811895] [DEBUG] [LOCAL ] WST: Trimmed 53940 records to 37444 (keeping 200 days of data) [2025-10-10T22:27:47.939808] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-10T22:27:48.096848] [DEBUG] [LOCAL ] WST: Primary data saved (37444 records). [2025-10-10T22:27:48.097029] [INFO ] [MAIN ] WST: Full history saved. [2025-10-10T22:27:48.097122] [INFO ] [MAIN ] Update Progress: 2328/2373 symbols completed. WST took 43.2s. Estimated remaining: 6m 20s. Rate: 7.1 symbols/min [2025-10-10T22:27:48.194528] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-10T22:27:48.275123] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:27:48.289419] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-10T22:27:48.303707] [DEBUG] [LOCAL ] WTS: Loaded 17817 existing records from primary storage. [2025-10-10T22:27:48.304056] [INFO ] [MAIN ] WTS: Loaded 17817 existing records. [2025-10-10T22:27:48.481224] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:27:48.481463] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-10T22:27:48.481513] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-10T22:27:48.481746] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-10T22:27:48.481802] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-10T22:27:48.834587] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:27:49.089406] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-10-10T22:27:49.889397] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-10T22:27:50.208071] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T22:27:50.260535] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-10T22:27:50.335063] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-10T22:27:50.689398] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-10T22:27:51.259289] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-10T22:27:51.489382] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-10T22:27:52.289426] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-10T22:27:53.089376] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-10T22:27:53.196035] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T22:27:53.410179] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-10T22:27:53.695905] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-10T22:27:53.889377] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-10T22:27:54.478441] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-10T22:27:54.689431] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-10T22:27:55.489459] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-10T22:27:55.506269] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-10T22:27:56.289415] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-10T22:27:56.953437] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-10T22:27:56.956335] [INFO ] [REMOTE ] WTM: Full fetch complete (2647 records). [2025-10-10T22:27:56.956424] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-10T22:27:57.094543] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-10T22:27:57.154588] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-10T22:27:57.155053] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-10T22:27:57.155125] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-10T22:27:57.155210] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-10T22:27:57.155274] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-10T22:27:57.155314] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-10T22:27:57.155354] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-10T22:27:57.155425] [INFO ] [MAIN ] Update Progress: 2329/2373 symbols completed. WTM took 24.8s. Estimated remaining: 6m 12s. Rate: 7.1 symbols/min [2025-10-10T22:27:57.353700] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:27:57.358090] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T22:27:57.407756] [DEBUG] [LOCAL ] WTTR: Loaded 44933 existing records from primary storage. [2025-10-10T22:27:57.408103] [INFO ] [MAIN ] WTTR: Loaded 44933 existing records. [2025-10-10T22:27:57.586510] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:27:57.586757] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-10T22:27:57.586813] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-10T22:27:57.587138] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-10T22:27:57.587196] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-10T22:27:57.894625] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-10T22:27:57.949409] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:27:58.689357] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-10T22:27:59.024378] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T22:27:59.117737] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-10T22:27:59.122571] [INFO ] [REMOTE ] WTI: Full fetch complete (64036 records). [2025-10-10T22:27:59.122716] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-10T22:27:59.500048] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-10T22:27:59.549683] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-10T22:27:59.549781] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-10T22:27:59.550999] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-10T22:27:59.551063] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-10T22:27:59.552320] [DEBUG] [LOCAL ] WTI: Trimmed 64036 records to 44879 (keeping 200 days of data) [2025-10-10T22:27:59.817424] [DEBUG] [LOCAL ] WTI: Primary data saved (44879 records). [2025-10-10T22:27:59.817580] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-10T22:27:59.817702] [INFO ] [MAIN ] Update Progress: 2330/2373 symbols completed. WTI took 33.7s. Estimated remaining: 6m 3s. Rate: 7.1 symbols/min [2025-10-10T22:28:00.000206] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T22:28:00.002570] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:28:00.057920] [DEBUG] [LOCAL ] WU: Loaded 53845 existing records from primary storage. [2025-10-10T22:28:00.058289] [INFO ] [MAIN ] WU: Loaded 53845 existing records. [2025-10-10T22:28:00.232958] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:28:00.233244] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-10T22:28:00.233299] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-10T22:28:00.233533] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-10T22:28:00.233588] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-10T22:28:00.294508] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-10T22:28:00.578139] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:28:01.089363] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-10-10T22:28:01.245084] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T22:28:01.607616] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-10T22:28:01.889417] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-10T22:28:02.689378] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-10T22:28:02.871919] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-10T22:28:03.474744] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-10T22:28:03.489322] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-10T22:28:04.019715] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-10T22:28:04.289376] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-10T22:28:05.068331] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-10T22:28:05.089361] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-10T22:28:05.609959] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T22:28:05.889439] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-10T22:28:06.689395] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-10-10T22:28:06.918418] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-10T22:28:07.125931] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-10T22:28:07.489382] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-10T22:28:08.289356] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-10T22:28:08.740411] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T22:28:09.089384] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-10T22:28:09.257769] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-10T22:28:09.597968] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-10T22:28:09.889407] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-10T22:28:10.689449] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-10T22:28:11.025960] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-10T22:28:11.489363] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-10T22:28:11.622303] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-10T22:28:11.928428] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-10T22:28:12.289387] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-10T22:28:13.089423] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-10T22:28:13.523341] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-10T22:28:13.709759] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-10T22:28:13.889352] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-10T22:28:14.260848] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-10T22:28:14.689443] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-10T22:28:14.722788] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-10T22:28:14.724483] [INFO ] [REMOTE ] WTS: Full fetch complete (25663 records). [2025-10-10T22:28:14.724555] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-10T22:28:15.083901] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-10T22:28:15.083985] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-10T22:28:15.084541] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-10T22:28:15.084580] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-10T22:28:15.085339] [DEBUG] [LOCAL ] WTS: Trimmed 25663 records to 17923 (keeping 200 days of data) [2025-10-10T22:28:15.197857] [DEBUG] [LOCAL ] WTS: Primary data saved (17923 records). [2025-10-10T22:28:15.198010] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-10T22:28:15.198093] [INFO ] [MAIN ] Update Progress: 2331/2373 symbols completed. WTS took 27.1s. Estimated remaining: 5m 55s. Rate: 7.1 symbols/min [2025-10-10T22:28:15.367931] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:28:15.413752] [DEBUG] [LOCAL ] WWW: Loaded 49580 existing records from primary storage. [2025-10-10T22:28:15.414085] [INFO ] [MAIN ] WWW: Loaded 49580 existing records. [2025-10-10T22:28:15.494475] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-10T22:28:15.597536] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:28:15.597808] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-10T22:28:15.597876] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-10T22:28:15.598305] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-10T22:28:15.598382] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-10T22:28:15.944831] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:28:16.289413] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-10T22:28:16.714566] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-10T22:28:17.089346] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-10-10T22:28:17.714887] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-10T22:28:17.889339] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-10T22:28:18.141013] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-10T22:28:18.689404] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-10T22:28:18.847992] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-10T22:28:19.489351] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-10T22:28:19.938171] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-10T22:28:20.289410] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-10T22:28:21.089357] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-10T22:28:21.249479] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-10T22:28:21.325776] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-10T22:28:21.889348] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-10T22:28:22.017333] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-10T22:28:22.689404] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-10T22:28:23.284080] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-10T22:28:23.489350] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-10T22:28:23.591283] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-10T22:28:23.596453] [INFO ] [REMOTE ] WTRG: Full fetch complete (73526 records). [2025-10-10T22:28:23.596568] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-10T22:28:23.993522] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-10T22:28:23.993732] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-10T22:28:23.995017] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-10T22:28:23.995097] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-10T22:28:24.006012] [DEBUG] [LOCAL ] WTRG: Trimmed 73526 records to 51727 (keeping 200 days of data) [2025-10-10T22:28:24.023852] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-10T22:28:24.308020] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-10T22:28:24.355319] [DEBUG] [LOCAL ] WTRG: Primary data saved (51727 records). [2025-10-10T22:28:24.355447] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-10T22:28:24.355529] [INFO ] [MAIN ] Update Progress: 2332/2373 symbols completed. WTRG took 46.0s. Estimated remaining: 5m 46s. Rate: 7.1 symbols/min [2025-10-10T22:28:24.522668] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:28:24.571436] [DEBUG] [LOCAL ] WY: Loaded 53527 existing records from primary storage. [2025-10-10T22:28:24.571792] [INFO ] [MAIN ] WY: Loaded 53527 existing records. [2025-10-10T22:28:24.745250] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:28:24.745467] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-10T22:28:24.745514] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-10T22:28:24.745789] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-10T22:28:24.745846] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-10T22:28:25.095405] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-10T22:28:25.099986] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:28:25.534883] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-10T22:28:25.889391] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-10T22:28:25.988688] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-10T22:28:26.689442] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-10-10T22:28:26.979413] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-10T22:28:27.489380] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-10T22:28:27.870471] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-10T22:28:28.011399] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-10T22:28:28.289377] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-10T22:28:29.089359] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-10T22:28:29.202102] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-10T22:28:29.889348] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-10T22:28:30.399066] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-10T22:28:30.689379] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-10T22:28:31.076196] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-10T22:28:31.489440] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-10T22:28:31.742550] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T22:28:32.289409] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-10T22:28:32.781439] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-10T22:28:33.089474] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-10T22:28:33.343496] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-10T22:28:33.889416] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-10T22:28:34.174021] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-10T22:28:34.689346] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-10T22:28:34.814943] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-10T22:28:35.489406] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-10T22:28:35.809681] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-10T22:28:36.289388] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-10T22:28:36.901819] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-10T22:28:37.089371] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-10T22:28:37.670609] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-10T22:28:37.692033] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-10T22:28:37.696387] [INFO ] [REMOTE ] WTTR: Full fetch complete (65366 records). [2025-10-10T22:28:37.696486] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-10T22:28:37.899113] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-10T22:28:38.093245] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-10T22:28:38.093334] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-10T22:28:38.094622] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-10T22:28:38.094735] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-10T22:28:38.096273] [DEBUG] [LOCAL ] WTTR: Trimmed 65366 records to 45236 (keeping 200 days of data) [2025-10-10T22:28:38.374398] [DEBUG] [LOCAL ] WTTR: Primary data saved (45236 records). [2025-10-10T22:28:38.374562] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-10T22:28:38.374844] [INFO ] [MAIN ] Update Progress: 2333/2373 symbols completed. WTTR took 41.2s. Estimated remaining: 5m 38s. Rate: 7.1 symbols/min [2025-10-10T22:28:38.548563] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:28:38.581039] [DEBUG] [LOCAL ] XFLT: Loaded 30065 existing records from primary storage. [2025-10-10T22:28:38.581304] [INFO ] [MAIN ] XFLT: Loaded 30065 existing records. [2025-10-10T22:28:38.694551] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-10T22:28:38.766181] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:28:38.766386] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-10T22:28:38.766436] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-10T22:28:38.766686] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-10T22:28:38.766774] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-10T22:28:39.139921] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-10T22:28:39.153259] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:28:39.158615] [INFO ] [REMOTE ] WU: Full fetch complete (77347 records). [2025-10-10T22:28:39.158798] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-10T22:28:39.497994] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-10-10T22:28:39.549583] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-10T22:28:39.549691] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-10T22:28:39.551242] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-10T22:28:39.551307] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-10T22:28:39.552767] [DEBUG] [LOCAL ] WU: Trimmed 77347 records to 54235 (keeping 200 days of data) [2025-10-10T22:28:39.881224] [DEBUG] [LOCAL ] WU: Primary data saved (54235 records). [2025-10-10T22:28:39.881356] [INFO ] [MAIN ] WU: Full history saved. [2025-10-10T22:28:39.881436] [INFO ] [MAIN ] Update Progress: 2334/2373 symbols completed. WU took 40.1s. Estimated remaining: 5m 29s. Rate: 7.1 symbols/min [2025-10-10T22:28:40.057478] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:28:40.099177] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-10T22:28:40.149953] [DEBUG] [LOCAL ] XHR: Loaded 43952 existing records from primary storage. [2025-10-10T22:28:40.150292] [INFO ] [MAIN ] XHR: Loaded 43952 existing records. [2025-10-10T22:28:40.299926] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-10T22:28:40.330906] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:28:40.331471] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-10T22:28:40.331713] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-10T22:28:40.332004] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-10T22:28:40.332062] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-10T22:28:40.693241] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:28:40.720076] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-10T22:28:40.749039] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-10T22:28:41.089369] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-10T22:28:41.889386] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-10T22:28:42.445943] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-10T22:28:42.689405] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-10T22:28:43.155875] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T22:28:43.476747] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T22:28:43.489329] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-10T22:28:44.289450] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-10T22:28:44.705738] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-10T22:28:44.735365] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-10T22:28:45.089375] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-10T22:28:45.889381] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-10T22:28:46.245700] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-10T22:28:46.689370] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-10-10T22:28:47.185016] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-10T22:28:47.440837] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T22:28:47.489431] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-10T22:28:48.289352] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-10T22:28:48.316244] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-10T22:28:49.089383] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-10T22:28:49.686884] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-10T22:28:49.734238] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-10T22:28:49.889406] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-10T22:28:50.615405] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-10T22:28:50.689405] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-10T22:28:51.489352] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-10T22:28:51.564120] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-10T22:28:51.670514] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T22:28:52.289406] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-10T22:28:52.825921] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-10T22:28:52.831041] [INFO ] [REMOTE ] WWW: Full fetch complete (70333 records). [2025-10-10T22:28:52.831148] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-10T22:28:53.094592] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-10T22:28:53.214828] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-10T22:28:53.214927] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-10T22:28:53.216397] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-10T22:28:53.216464] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-10T22:28:53.219103] [DEBUG] [LOCAL ] WWW: Trimmed 70333 records to 49946 (keeping 200 days of data) [2025-10-10T22:28:53.541235] [DEBUG] [LOCAL ] WWW: Primary data saved (49946 records). [2025-10-10T22:28:53.541381] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-10T22:28:53.541469] [INFO ] [MAIN ] Update Progress: 2335/2373 symbols completed. WWW took 38.3s. Estimated remaining: 5m 21s. Rate: 7.1 symbols/min [2025-10-10T22:28:53.721594] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:28:53.722021] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-10T22:28:53.722152] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-10T22:28:53.722402] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-10T22:28:53.722448] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-10T22:28:53.722493] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-10T22:28:53.722528] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-10T22:28:53.910834] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-10T22:28:54.074973] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-10T22:28:54.193364] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-10T22:28:54.190416] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:28:54.202898] [INFO ] [REMOTE ] WY: Full fetch complete (76851 records). [2025-10-10T22:28:54.203549] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-10T22:28:54.631200] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-10T22:28:54.631383] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-10T22:28:54.633434] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-10T22:28:54.633509] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-10T22:28:54.635586] [DEBUG] [LOCAL ] WY: Trimmed 76851 records to 53917 (keeping 200 days of data) [2025-10-10T22:28:54.704169] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-10-10T22:28:54.977793] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T22:28:54.981480] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-10-10T22:28:54.982909] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T22:28:54.983702] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-10T22:28:54.984629] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T22:28:54.984785] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-10T22:28:54.984912] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-10T22:28:54.985248] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-10T22:28:54.986583] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-10T22:28:54.987018] [INFO ] [MAIN ] Update Progress: 2336/2373 symbols completed. XIFR took 1.4s. Estimated remaining: 5m 13s. Rate: 7.1 symbols/min [2025-10-10T22:28:55.194383] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:28:55.206269] [DEBUG] [LOCAL ] WY: Primary data saved (53917 records). [2025-10-10T22:28:55.206538] [INFO ] [MAIN ] WY: Full history saved. [2025-10-10T22:28:55.206678] [INFO ] [MAIN ] Update Progress: 2337/2373 symbols completed. WY took 30.9s. Estimated remaining: 5m 4s. Rate: 7.1 symbols/min [2025-10-10T22:28:55.391307] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:28:55.465915] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-10T22:28:55.464799] [DEBUG] [LOCAL ] XOM: Loaded 54183 existing records from primary storage. [2025-10-10T22:28:55.474385] [INFO ] [MAIN ] XOM: Loaded 54183 existing records. [2025-10-10T22:28:55.496136] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-10T22:28:55.508557] [DEBUG] [LOCAL ] XPER: Loaded 30306 existing records from primary storage. [2025-10-10T22:28:55.525995] [INFO ] [MAIN ] XPER: Loaded 30306 existing records. [2025-10-10T22:28:55.870562] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:28:55.893935] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-10T22:28:55.893837] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:28:55.894240] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-10T22:28:55.894197] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-10T22:28:55.894345] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-10T22:28:55.894627] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-10T22:28:55.894709] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-10T22:28:55.894764] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-10T22:28:55.894880] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-10T22:28:56.319576] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-10T22:28:56.648933] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:28:56.669639] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:28:57.089415] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-10-10T22:28:57.427117] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-10T22:28:57.736260] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-10T22:28:57.889400] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-10T22:28:58.588170] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-10T22:28:58.689411] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-10T22:28:59.478699] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-10T22:28:59.489337] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-10T22:29:00.289370] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-10T22:29:00.402989] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-10T22:29:01.089391] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-10T22:29:01.394829] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-10T22:29:01.615190] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-10T22:29:01.889391] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-10T22:29:02.410092] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-10T22:29:02.689352] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-10T22:29:03.424992] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-10T22:29:03.489359] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-10T22:29:04.289415] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-10T22:29:04.396898] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-10T22:29:04.775619] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-10T22:29:05.089377] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-10T22:29:05.807844] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-10T22:29:05.889394] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-10T22:29:06.530892] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-10T22:29:06.689405] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-10-10T22:29:07.489403] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-10T22:29:07.650059] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-10T22:29:08.289373] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-10T22:29:09.044924] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-10T22:29:09.089329] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-10T22:29:09.196501] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-10T22:29:09.594366] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-10T22:29:09.889381] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-10T22:29:10.433724] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-10T22:29:10.689402] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-10T22:29:10.806850] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-10T22:29:10.810059] [INFO ] [REMOTE ] XFLT: Full fetch complete (43836 records). [2025-10-10T22:29:10.810136] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-10T22:29:11.192671] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-10T22:29:11.192859] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-10T22:29:11.194372] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-10T22:29:11.194443] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-10T22:29:11.195568] [DEBUG] [LOCAL ] XFLT: Trimmed 43836 records to 30248 (keeping 200 days of data) [2025-10-10T22:29:11.382884] [DEBUG] [LOCAL ] XFLT: Primary data saved (30248 records). [2025-10-10T22:29:11.383068] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-10T22:29:11.383170] [INFO ] [MAIN ] Update Progress: 2338/2373 symbols completed. XFLT took 33.0s. Estimated remaining: 4m 56s. Rate: 7.1 symbols/min [2025-10-10T22:29:11.490761] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-10T22:29:11.574213] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:29:11.631633] [DEBUG] [LOCAL ] XPEV: Loaded 54024 existing records from primary storage. [2025-10-10T22:29:11.632072] [INFO ] [MAIN ] XPEV: Loaded 54024 existing records. [2025-10-10T22:29:11.810892] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-10T22:29:11.849716] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:29:11.850579] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-10T22:29:11.850633] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-10T22:29:11.850907] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-10T22:29:11.850965] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-10T22:29:12.211411] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:29:12.289380] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-10-10T22:29:13.089405] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-10T22:29:13.889420] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-10T22:29:14.202246] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-10-10T22:29:14.401213] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-10T22:29:14.440336] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-10T22:29:14.689470] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-10T22:29:15.489370] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-10T22:29:15.602434] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T22:29:16.270291] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T22:29:16.277306] [INFO ] [REMOTE ] XHR: Full fetch complete (61749 records). [2025-10-10T22:29:16.277489] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-10T22:29:16.294600] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-10T22:29:16.694221] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-10T22:29:16.694306] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-10T22:29:16.695441] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-10T22:29:16.695504] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-10T22:29:16.696713] [DEBUG] [LOCAL ] XHR: Trimmed 61749 records to 44269 (keeping 200 days of data) [2025-10-10T22:29:16.979261] [DEBUG] [LOCAL ] XHR: Primary data saved (44269 records). [2025-10-10T22:29:16.979401] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-10T22:29:16.979486] [INFO ] [MAIN ] Update Progress: 2339/2373 symbols completed. XHR took 37.1s. Estimated remaining: 4m 47s. Rate: 7.1 symbols/min [2025-10-10T22:29:17.089721] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-10T22:29:17.162807] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:29:17.207827] [DEBUG] [LOCAL ] XPO: Loaded 48148 existing records from primary storage. [2025-10-10T22:29:17.208142] [INFO ] [MAIN ] XPO: Loaded 48148 existing records. [2025-10-10T22:29:17.384818] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:29:17.385126] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-10T22:29:17.385204] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-10T22:29:17.385549] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-10T22:29:17.385619] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-10T22:29:17.749015] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:29:17.787127] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-10T22:29:17.889354] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-10-10T22:29:18.208295] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-10T22:29:18.689469] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-10T22:29:18.734365] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-10T22:29:19.489420] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-10T22:29:19.887892] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-10T22:29:20.289440] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-10T22:29:20.644130] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-10T22:29:20.648389] [INFO ] [REMOTE ] XPER: Full fetch complete (43321 records). [2025-10-10T22:29:20.648487] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-10T22:29:21.095640] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-10T22:29:21.095237] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-10T22:29:21.097766] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-10T22:29:21.099507] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-10T22:29:21.099873] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-10T22:29:21.101213] [DEBUG] [LOCAL ] XPER: Trimmed 43321 records to 30589 (keeping 200 days of data) [2025-10-10T22:29:21.301775] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-10T22:29:21.331803] [DEBUG] [LOCAL ] XPER: Primary data saved (30589 records). [2025-10-10T22:29:21.331957] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-10T22:29:21.332049] [INFO ] [MAIN ] Update Progress: 2340/2373 symbols completed. XPER took 26.1s. Estimated remaining: 4m 39s. Rate: 7.1 symbols/min [2025-10-10T22:29:21.501408] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:29:21.538024] [DEBUG] [LOCAL ] XPOF: Loaded 37887 existing records from primary storage. [2025-10-10T22:29:21.538459] [INFO ] [MAIN ] XPOF: Loaded 37887 existing records. [2025-10-10T22:29:21.714336] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:29:21.714571] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-10T22:29:21.714620] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-10T22:29:21.714906] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-10T22:29:21.714973] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-10T22:29:21.895858] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-10T22:29:22.121272] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:29:22.152893] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-10T22:29:22.689405] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-10T22:29:23.489400] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-10-10T22:29:23.684495] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-10T22:29:24.289391] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-10T22:29:24.622157] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-10T22:29:24.636224] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-10T22:29:24.673957] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-10T22:29:25.089452] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-10T22:29:25.889373] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-10T22:29:26.544533] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T22:29:26.689414] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-10T22:29:26.898415] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-10T22:29:27.489452] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-10T22:29:28.151543] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-10T22:29:28.289332] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-10T22:29:28.470901] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-10T22:29:29.089398] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-10T22:29:29.899521] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-10T22:29:29.906220] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-10T22:29:30.046591] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-10T22:29:30.689389] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-10T22:29:30.975182] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-10T22:29:31.489461] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-10T22:29:32.289390] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-10T22:29:32.377609] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-10T22:29:32.515601] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-10T22:29:33.089387] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-10T22:29:33.889394] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-10T22:29:34.170700] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-10T22:29:34.328319] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-10T22:29:34.689417] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-10T22:29:34.734098] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-10T22:29:35.489358] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-10T22:29:36.289421] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-10T22:29:36.343581] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-10T22:29:36.599331] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-10T22:29:36.981839] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-10T22:29:37.089349] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-10T22:29:37.889397] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-10T22:29:38.373456] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-10T22:29:38.676317] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-10T22:29:38.689331] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-10T22:29:39.489351] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-10T22:29:39.646343] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-10T22:29:40.289370] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-10T22:29:40.505787] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-10T22:29:41.089408] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-10T22:29:41.759718] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-10T22:29:41.889384] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-10T22:29:42.689364] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-10T22:29:42.799783] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-10T22:29:42.943400] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-10T22:29:43.489377] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-10T22:29:44.289390] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-10T22:29:44.470297] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-10T22:29:44.638092] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-10T22:29:44.734977] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-10T22:29:45.089492] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-10T22:29:45.889424] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-10T22:29:46.456454] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-10T22:29:46.460200] [INFO ] [REMOTE ] XPOF: Full fetch complete (52585 records). [2025-10-10T22:29:46.460291] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-10T22:29:46.693083] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-10T22:29:46.853833] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-10T22:29:46.871576] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-10T22:29:46.871702] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-10T22:29:46.873219] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-10-10T22:29:46.872966] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-10T22:29:46.873471] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-10T22:29:46.873564] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-10T22:29:46.954346] [DEBUG] [LOCAL ] XPOF: Trimmed 52585 records to 38159 (keeping 200 days of data) [2025-10-10T22:29:47.269688] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.98 seconds). [2025-10-10T22:29:47.432176] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-10T22:29:47.434441] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-10T22:29:47.436718] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-10T22:29:47.436807] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-10T22:29:47.442700] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 54573 (keeping 200 days of data) [2025-10-10T22:29:47.501422] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-10T22:29:47.766077] [DEBUG] [LOCAL ] XPOF: Primary data saved (38159 records). [2025-10-10T22:29:47.775497] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-10T22:29:47.775704] [INFO ] [MAIN ] Update Progress: 2341/2373 symbols completed. XPOF took 26.4s. Estimated remaining: 4m 30s. Rate: 7.1 symbols/min [2025-10-10T22:29:47.991362] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:29:48.096403] [DEBUG] [LOCAL ] XPRO: Loaded 46201 existing records from primary storage. [2025-10-10T22:29:48.116759] [INFO ] [MAIN ] XPRO: Loaded 46201 existing records. [2025-10-10T22:29:48.323215] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:29:48.332092] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-10T22:29:48.333038] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-10T22:29:48.335608] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-10T22:29:48.336397] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-10T22:29:48.434556] [DEBUG] [LOCAL ] XOM: Primary data saved (54573 records). [2025-10-10T22:29:48.451260] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-10T22:29:48.451479] [INFO ] [MAIN ] Update Progress: 2342/2373 symbols completed. XOM took 53.5s. Estimated remaining: 4m 22s. Rate: 7.1 symbols/min [2025-10-10T22:29:48.826341] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:29:48.926413] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-10T22:29:48.960488] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:29:48.961780] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-10-10T22:29:48.991284] [DEBUG] [LOCAL ] XYF: Loaded 28444 existing records from primary storage. [2025-10-10T22:29:48.991683] [INFO ] [MAIN ] XYF: Loaded 28444 existing records. [2025-10-10T22:29:49.091467] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-10T22:29:49.172502] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:29:49.172794] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-10T22:29:49.172847] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-10T22:29:49.173100] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-10T22:29:49.173155] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-10T22:29:49.544518] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:29:49.889473] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-10-10T22:29:50.329050] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-10T22:29:50.363335] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-10T22:29:50.368699] [INFO ] [REMOTE ] XPO: Full fetch complete (69811 records). [2025-10-10T22:29:50.368835] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-10T22:29:50.707391] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-10T22:29:50.722366] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-10T22:29:50.790692] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-10T22:29:50.790922] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-10T22:29:50.792752] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-10T22:29:50.792878] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-10T22:29:50.794994] [DEBUG] [LOCAL ] XPO: Trimmed 69811 records to 48522 (keeping 200 days of data) [2025-10-10T22:29:50.913290] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-10T22:29:51.153093] [DEBUG] [LOCAL ] XPO: Primary data saved (48522 records). [2025-10-10T22:29:51.153329] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-10T22:29:51.153498] [INFO ] [MAIN ] Update Progress: 2343/2373 symbols completed. XPO took 34.2s. Estimated remaining: 4m 13s. Rate: 7.1 symbols/min [2025-10-10T22:29:51.327024] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:29:51.377902] [DEBUG] [LOCAL ] XYL: Loaded 48238 existing records from primary storage. [2025-10-10T22:29:51.378367] [INFO ] [MAIN ] XYL: Loaded 48238 existing records. [2025-10-10T22:29:51.494520] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-10T22:29:51.565702] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:29:51.566106] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-10T22:29:51.566167] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-10T22:29:51.566400] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-10T22:29:51.566442] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-10T22:29:51.955427] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:29:52.289444] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-10-10T22:29:53.089383] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-10T22:29:53.278612] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-10T22:29:53.285238] [INFO ] [REMOTE ] XPEV: Full fetch complete (77681 records). [2025-10-10T22:29:53.285379] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-10T22:29:53.701517] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-10T22:29:53.760139] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-10T22:29:53.760232] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-10T22:29:53.761743] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-10T22:29:53.761812] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-10T22:29:53.763466] [DEBUG] [LOCAL ] XPEV: Trimmed 77681 records to 54414 (keeping 200 days of data) [2025-10-10T22:29:53.866542] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-10T22:29:53.889474] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-10T22:29:54.103188] [DEBUG] [LOCAL ] XPEV: Primary data saved (54414 records). [2025-10-10T22:29:54.103446] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-10T22:29:54.103782] [INFO ] [MAIN ] Update Progress: 2344/2373 symbols completed. XPEV took 42.7s. Estimated remaining: 4m 5s. Rate: 7.1 symbols/min [2025-10-10T22:29:54.307209] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:29:54.310480] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T22:29:54.310616] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-10T22:29:54.321884] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-10T22:29:54.322043] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-10T22:29:54.322098] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-10T22:29:54.322143] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-10T22:29:54.322176] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-10T22:29:54.673516] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:29:54.689328] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-10-10T22:29:54.873125] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-10T22:29:54.928500] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-10T22:29:54.928935] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-10-10T22:29:54.929028] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-10T22:29:54.929075] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-10-10T22:29:54.929130] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-10T22:29:54.929202] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-10T22:29:54.929265] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-10T22:29:54.929302] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-10T22:29:54.929341] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-10T22:29:54.929431] [INFO ] [MAIN ] Update Progress: 2345/2373 symbols completed. XYZ took 0.8s. Estimated remaining: 3m 56s. Rate: 7.1 symbols/min [2025-10-10T22:29:55.093668] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:29:55.131889] [DEBUG] [LOCAL ] YALA: Loaded 37208 existing records from primary storage. [2025-10-10T22:29:55.132185] [INFO ] [MAIN ] YALA: Loaded 37208 existing records. [2025-10-10T22:29:55.308145] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:29:55.308402] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-10T22:29:55.308450] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-10T22:29:55.308859] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-10T22:29:55.308916] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-10T22:29:55.498749] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-10T22:29:55.652971] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:29:56.289408] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-10T22:29:57.089372] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-10-10T22:29:57.474453] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T22:29:57.606444] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T22:29:57.889349] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-10T22:29:58.359116] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-10T22:29:58.689395] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-10T22:29:59.164961] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-10T22:29:59.489401] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-10T22:30:00.029176] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-10T22:30:00.289437] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-10T22:30:01.089358] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-10T22:30:01.221376] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-10T22:30:01.795573] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-10T22:30:01.889412] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-10T22:30:02.649631] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-10T22:30:02.689329] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-10T22:30:02.756178] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-10T22:30:03.489408] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-10T22:30:04.289413] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-10T22:30:04.673013] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-10T22:30:05.089378] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-10T22:30:05.140803] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-10T22:30:05.594319] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-10T22:30:05.889388] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-10T22:30:06.641327] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-10T22:30:06.689348] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-10T22:30:07.489401] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-10T22:30:07.600345] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-10T22:30:08.289409] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-10T22:30:08.504172] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T22:30:09.098598] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-10T22:30:09.100752] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-10T22:30:09.889383] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-10T22:30:10.516326] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-10T22:30:10.551769] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-10T22:30:10.689407] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-10T22:30:11.489394] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-10T22:30:11.647170] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-10T22:30:12.181304] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-10T22:30:12.248836] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-10T22:30:12.289347] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-10T22:30:13.089416] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-10T22:30:13.889353] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-10T22:30:14.102694] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-10T22:30:14.167973] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-10T22:30:14.170692] [INFO ] [REMOTE ] XYF: Full fetch complete (32816 records). [2025-10-10T22:30:14.170767] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-10T22:30:14.529702] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-10T22:30:14.529789] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-10T22:30:14.530479] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-10T22:30:14.530520] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-10T22:30:14.531375] [DEBUG] [LOCAL ] XYF: Trimmed 32816 records to 28704 (keeping 200 days of data) [2025-10-10T22:30:14.694485] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-10T22:30:14.710960] [DEBUG] [LOCAL ] XYF: Primary data saved (28704 records). [2025-10-10T22:30:14.711190] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-10T22:30:14.711281] [INFO ] [MAIN ] Update Progress: 2346/2373 symbols completed. XYF took 26.2s. Estimated remaining: 3m 48s. Rate: 7.1 symbols/min [2025-10-10T22:30:14.874623] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:30:14.917405] [DEBUG] [LOCAL ] YELP: Loaded 45748 existing records from primary storage. [2025-10-10T22:30:14.917755] [INFO ] [MAIN ] YELP: Loaded 45748 existing records. [2025-10-10T22:30:15.092050] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:30:15.092300] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-10T22:30:15.092349] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-10T22:30:15.092762] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-10T22:30:15.092819] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-10T22:30:15.437638] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:30:15.489350] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-10-10T22:30:15.697878] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-10T22:30:16.289427] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-10T22:30:16.514158] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-10T22:30:17.089439] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-10T22:30:17.392953] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-10T22:30:17.889391] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-10T22:30:18.362711] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T22:30:18.396123] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-10T22:30:18.689377] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-10T22:30:19.489407] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-10T22:30:19.702048] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-10T22:30:20.289371] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-10T22:30:20.319563] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-10T22:30:21.089428] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-10T22:30:21.331783] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-10T22:30:21.889396] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-10T22:30:22.090937] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-10T22:30:22.689422] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-10T22:30:23.010012] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T22:30:23.489457] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-10T22:30:23.696793] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-10T22:30:24.289385] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-10T22:30:24.476876] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-10T22:30:25.089411] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-10T22:30:25.414488] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-10T22:30:25.583096] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-10T22:30:25.889383] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-10T22:30:26.217933] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-10T22:30:26.223605] [INFO ] [REMOTE ] XYL: Full fetch complete (69689 records). [2025-10-10T22:30:26.223759] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-10T22:30:26.655208] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-10T22:30:26.655327] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-10T22:30:26.656847] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-10T22:30:26.657410] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-10T22:30:26.659777] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-10T22:30:26.671181] [DEBUG] [LOCAL ] XYL: Trimmed 69689 records to 48625 (keeping 200 days of data) [2025-10-10T22:30:26.732466] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-10T22:30:27.002459] [DEBUG] [LOCAL ] XYL: Primary data saved (48625 records). [2025-10-10T22:30:27.002662] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-10T22:30:27.002786] [INFO ] [MAIN ] Update Progress: 2347/2373 symbols completed. XYL took 35.8s. Estimated remaining: 3m 40s. Rate: 7.1 symbols/min [2025-10-10T22:30:27.181777] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:30:27.237479] [DEBUG] [LOCAL ] YETI: Loaded 52832 existing records from primary storage. [2025-10-10T22:30:27.237899] [INFO ] [MAIN ] YETI: Loaded 52832 existing records. [2025-10-10T22:30:27.420474] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:30:27.420780] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-10T22:30:27.420835] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-10T22:30:27.421739] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-10T22:30:27.421801] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-10T22:30:27.499486] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-10T22:30:27.781836] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:30:28.289436] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-10-10T22:30:28.518052] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-10T22:30:29.031831] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-10T22:30:29.089347] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-10T22:30:29.816505] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-10T22:30:29.869978] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T22:30:29.873065] [INFO ] [REMOTE ] YALA: Full fetch complete (46764 records). [2025-10-10T22:30:29.873147] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-10T22:30:29.894558] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-10T22:30:30.250392] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-10T22:30:30.250469] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-10T22:30:30.251515] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-10T22:30:30.251619] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-10T22:30:30.252734] [DEBUG] [LOCAL ] YALA: Trimmed 46764 records to 37416 (keeping 200 days of data) [2025-10-10T22:30:30.462466] [DEBUG] [LOCAL ] YALA: Primary data saved (37416 records). [2025-10-10T22:30:30.462602] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-10T22:30:30.462706] [INFO ] [MAIN ] Update Progress: 2348/2373 symbols completed. YALA took 35.5s. Estimated remaining: 3m 31s. Rate: 7.1 symbols/min [2025-10-10T22:30:30.630813] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:30:30.670556] [DEBUG] [LOCAL ] YEXT: Loaded 43406 existing records from primary storage. [2025-10-10T22:30:30.670873] [INFO ] [MAIN ] YEXT: Loaded 43406 existing records. [2025-10-10T22:30:30.701687] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-10T22:30:30.856148] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:30:30.856426] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-10T22:30:30.856485] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-10T22:30:30.856729] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-10T22:30:30.856787] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-10T22:30:31.211224] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:30:31.489379] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-10T22:30:31.756083] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-10T22:30:32.109922] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-10T22:30:32.289343] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-10T22:30:33.090700] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-10-10T22:30:33.091785] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-10T22:30:33.097792] [INFO ] [REMOTE ] XPRO: Full fetch complete (66352 records). [2025-10-10T22:30:33.097918] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-10T22:30:33.496725] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-10T22:30:33.496815] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-10T22:30:33.498217] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-10T22:30:33.498282] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-10T22:30:33.499731] [DEBUG] [LOCAL ] XPRO: Trimmed 66352 records to 46570 (keeping 200 days of data) [2025-10-10T22:30:33.764835] [DEBUG] [LOCAL ] XPRO: Primary data saved (46570 records). [2025-10-10T22:30:33.764968] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-10T22:30:33.765059] [INFO ] [MAIN ] Update Progress: 2349/2373 symbols completed. XPRO took 46.0s. Estimated remaining: 3m 23s. Rate: 7.1 symbols/min [2025-10-10T22:30:33.894507] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-10T22:30:33.954048] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:30:34.009957] [DEBUG] [LOCAL ] YMM: Loaded 52979 existing records from primary storage. [2025-10-10T22:30:34.010308] [INFO ] [MAIN ] YMM: Loaded 52979 existing records. [2025-10-10T22:30:34.239229] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:30:34.242851] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-10T22:30:34.243471] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-10T22:30:34.244975] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-10T22:30:34.255503] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-10T22:30:34.256213] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-10T22:30:34.647698] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:30:34.689344] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-10-10T22:30:35.016320] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T22:30:35.468763] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-10T22:30:35.489388] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-10T22:30:36.289432] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-10T22:30:36.666296] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-10T22:30:37.089442] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-10T22:30:37.261247] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-10T22:30:37.431739] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-10T22:30:37.889411] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-10T22:30:38.689393] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-10T22:30:39.072504] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T22:30:39.489367] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-10T22:30:39.804743] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-10T22:30:40.289377] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-10T22:30:40.580707] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-10T22:30:41.089415] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-10T22:30:41.443797] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-10T22:30:41.889349] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-10T22:30:42.247578] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-10T22:30:42.689396] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-10T22:30:42.909413] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-10T22:30:43.002766] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-10T22:30:43.489444] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-10T22:30:44.289402] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-10T22:30:44.697185] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-10T22:30:45.089354] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-10T22:30:45.294550] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-10T22:30:45.438330] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-10T22:30:45.443352] [INFO ] [REMOTE ] YELP: Full fetch complete (64603 records). [2025-10-10T22:30:45.443499] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-10T22:30:45.840380] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-10T22:30:45.840481] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-10T22:30:45.841622] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-10T22:30:45.841712] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-10T22:30:45.843716] [DEBUG] [LOCAL ] YELP: Trimmed 64603 records to 46061 (keeping 200 days of data) [2025-10-10T22:30:45.893958] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-10T22:30:46.112285] [DEBUG] [LOCAL ] YELP: Primary data saved (46061 records). [2025-10-10T22:30:46.112422] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-10T22:30:46.112503] [INFO ] [MAIN ] Update Progress: 2350/2373 symbols completed. YELP took 31.4s. Estimated remaining: 3m 14s. Rate: 7.1 symbols/min [2025-10-10T22:30:46.284054] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:30:46.328628] [DEBUG] [LOCAL ] YOU: Loaded 50065 existing records from primary storage. [2025-10-10T22:30:46.328954] [INFO ] [MAIN ] YOU: Loaded 50065 existing records. [2025-10-10T22:30:46.514480] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:30:46.514901] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-10T22:30:46.515017] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-10T22:30:46.515496] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-10T22:30:46.515570] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-10T22:30:46.691820] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-10T22:30:46.881292] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:30:46.911477] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-10T22:30:47.489350] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-10T22:30:47.821268] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-10T22:30:48.289363] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-10-10T22:30:48.472114] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-10T22:30:49.089357] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-10T22:30:49.223540] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-10T22:30:49.889394] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-10T22:30:50.300254] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-10T22:30:50.689346] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-10T22:30:50.809057] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-10T22:30:51.489361] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-10T22:30:51.861820] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T22:30:52.289344] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-10T22:30:52.838181] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-10T22:30:53.089405] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-10T22:30:53.561145] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-10T22:30:53.889400] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-10T22:30:54.230046] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T22:30:54.689386] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-10T22:30:55.022422] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T22:30:55.117367] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-10T22:30:55.489381] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-10T22:30:56.289413] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-10T22:30:56.340237] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-10T22:30:57.089366] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-10T22:30:57.342858] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-10T22:30:57.889382] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-10T22:30:58.384082] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-10T22:30:58.689366] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-10T22:30:59.045326] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-10T22:30:59.157536] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-10T22:30:59.489406] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-10T22:31:00.289373] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-10T22:31:00.692578] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-10T22:31:01.089406] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-10T22:31:01.533742] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-10T22:31:01.889374] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-10T22:31:02.426435] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-10T22:31:02.454584] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-10T22:31:02.460378] [INFO ] [REMOTE ] YEXT: Full fetch complete (63158 records). [2025-10-10T22:31:02.460582] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-10T22:31:02.694766] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-10T22:31:02.846277] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-10T22:31:02.846358] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-10T22:31:02.847515] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-10T22:31:02.847580] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-10T22:31:02.848935] [DEBUG] [LOCAL ] YEXT: Trimmed 63158 records to 43739 (keeping 200 days of data) [2025-10-10T22:31:03.094856] [DEBUG] [LOCAL ] YEXT: Primary data saved (43739 records). [2025-10-10T22:31:03.094987] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-10T22:31:03.095238] [INFO ] [MAIN ] Update Progress: 2351/2373 symbols completed. YEXT took 32.6s. Estimated remaining: 3m 6s. Rate: 7.1 symbols/min [2025-10-10T22:31:03.268203] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:31:03.316421] [DEBUG] [LOCAL ] YPF: Loaded 50911 existing records from primary storage. [2025-10-10T22:31:03.316758] [INFO ] [MAIN ] YPF: Loaded 50911 existing records. [2025-10-10T22:31:03.490961] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-10T22:31:03.494483] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:31:03.495751] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-10T22:31:03.495805] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-10T22:31:03.496031] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-10T22:31:03.496090] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-10T22:31:03.853267] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:31:03.998280] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-10T22:31:04.289369] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-10T22:31:04.784570] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-10T22:31:05.089411] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-10T22:31:05.374533] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-10T22:31:05.379513] [INFO ] [REMOTE ] YETI: Full fetch complete (75421 records). [2025-10-10T22:31:05.379677] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-10T22:31:05.766937] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-10T22:31:05.767060] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-10T22:31:05.768458] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-10T22:31:05.768761] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-10T22:31:05.770358] [DEBUG] [LOCAL ] YETI: Trimmed 75421 records to 53210 (keeping 200 days of data) [2025-10-10T22:31:05.898695] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-10-10T22:31:05.923440] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-10T22:31:06.162351] [DEBUG] [LOCAL ] YETI: Primary data saved (53210 records). [2025-10-10T22:31:06.162555] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-10T22:31:06.162691] [INFO ] [MAIN ] Update Progress: 2352/2373 symbols completed. YETI took 39.2s. Estimated remaining: 2m 57s. Rate: 7.1 symbols/min [2025-10-10T22:31:06.367109] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:31:06.384606] [DEBUG] [LOCAL ] YRD: Loaded 12033 existing records from primary storage. [2025-10-10T22:31:06.384884] [INFO ] [MAIN ] YRD: Loaded 12033 existing records. [2025-10-10T22:31:06.595736] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:31:06.596023] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-10T22:31:06.596085] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-10T22:31:06.596355] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-10T22:31:06.596417] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-10T22:31:06.690741] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-10T22:31:06.946372] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-10T22:31:06.984490] [INFO ] [REMOTE ] YMM: Full fetch complete (76328 records). [2025-10-10T22:31:06.993633] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-10T22:31:07.017441] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:31:07.443527] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-10T22:31:07.443635] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-10T22:31:07.445012] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-10T22:31:07.445217] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-10T22:31:07.446894] [DEBUG] [LOCAL ] YMM: Trimmed 76328 records to 53367 (keeping 200 days of data) [2025-10-10T22:31:07.500310] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-10-10T22:31:07.778962] [DEBUG] [LOCAL ] YMM: Primary data saved (53367 records). [2025-10-10T22:31:07.779219] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-10T22:31:07.779322] [INFO ] [MAIN ] Update Progress: 2353/2373 symbols completed. YMM took 34.0s. Estimated remaining: 2m 49s. Rate: 7.1 symbols/min [2025-10-10T22:31:07.949666] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:31:07.975843] [DEBUG] [LOCAL ] YSG: Loaded 25476 existing records from primary storage. [2025-10-10T22:31:07.976124] [INFO ] [MAIN ] YSG: Loaded 25476 existing records. [2025-10-10T22:31:08.182126] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-10T22:31:08.188239] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:31:08.198968] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-10T22:31:08.199967] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-10T22:31:08.200256] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-10T22:31:08.200313] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-10T22:31:08.305752] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-10T22:31:08.316724] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-10T22:31:08.568229] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:31:08.594533] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-10T22:31:09.089399] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-10T22:31:09.889397] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-10T22:31:10.327309] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-10T22:31:10.689398] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-10T22:31:10.831529] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-10T22:31:11.112560] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T22:31:11.489467] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-10-10T22:31:12.289417] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-10T22:31:12.702394] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-10T22:31:12.793714] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-10T22:31:13.089387] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-10T22:31:13.520391] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-10T22:31:13.889455] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-10T22:31:14.689352] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-10T22:31:15.068709] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-10T22:31:15.288843] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-10T22:31:15.489366] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-10T22:31:15.656451] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-10T22:31:16.289376] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-10T22:31:17.089408] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-10T22:31:17.359627] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-10T22:31:17.889430] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-10T22:31:18.122311] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-10T22:31:18.307839] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-10T22:31:18.689394] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-10T22:31:19.142495] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-10T22:31:19.489449] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-10T22:31:20.289460] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-10T22:31:20.655268] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T22:31:20.932716] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-10T22:31:20.938382] [INFO ] [REMOTE ] YOU: Full fetch complete (72186 records). [2025-10-10T22:31:20.938606] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-10T22:31:21.094373] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-10T22:31:21.239870] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-10T22:31:21.362825] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-10T22:31:21.362913] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-10T22:31:21.364153] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-10T22:31:21.364219] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-10T22:31:21.368767] [DEBUG] [LOCAL ] YOU: Trimmed 72186 records to 50448 (keeping 200 days of data) [2025-10-10T22:31:21.689979] [DEBUG] [LOCAL ] YOU: Primary data saved (50448 records). [2025-10-10T22:31:21.690179] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-10T22:31:21.690323] [INFO ] [MAIN ] Update Progress: 2354/2373 symbols completed. YOU took 35.6s. Estimated remaining: 2m 40s. Rate: 7.1 symbols/min [2025-10-10T22:31:21.857842] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:31:21.889393] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-10T22:31:21.909399] [DEBUG] [LOCAL ] YUM: Loaded 51558 existing records from primary storage. [2025-10-10T22:31:21.909798] [INFO ] [MAIN ] YUM: Loaded 51558 existing records. [2025-10-10T22:31:22.087542] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:31:22.087799] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-10T22:31:22.087849] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-10T22:31:22.088055] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-10T22:31:22.088112] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-10T22:31:22.458904] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:31:22.689383] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-10T22:31:22.882216] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-10T22:31:22.909875] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-10T22:31:23.489353] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-10T22:31:24.012544] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-10T22:31:24.289396] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-10T22:31:25.089385] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-10-10T22:31:25.442554] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-10T22:31:25.652377] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-10T22:31:25.889393] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-10T22:31:26.689386] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-10T22:31:27.014618] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-10T22:31:27.489358] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-10T22:31:27.805395] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T22:31:27.871751] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T22:31:28.289410] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-10T22:31:29.089365] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-10T22:31:29.315932] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-10T22:31:29.397055] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T22:31:29.889408] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-10T22:31:30.051583] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-10T22:31:30.689376] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-10T22:31:30.869029] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-10T22:31:31.489392] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-10T22:31:32.289360] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-10T22:31:32.719775] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-10T22:31:33.089368] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-10T22:31:33.272680] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-10T22:31:33.458706] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-10T22:31:33.889489] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-10T22:31:34.270630] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-10T22:31:34.689445] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-10T22:31:35.489412] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-10T22:31:35.569137] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-10T22:31:35.572022] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-10T22:31:35.584704] [INFO ] [REMOTE ] YRD: Full fetch complete (19071 records). [2025-10-10T22:31:35.585429] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-10T22:31:35.946956] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-10T22:31:35.947055] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-10T22:31:35.947632] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-10T22:31:35.947725] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-10T22:31:35.948319] [DEBUG] [LOCAL ] YRD: Trimmed 19071 records to 12135 (keeping 200 days of data) [2025-10-10T22:31:36.018332] [DEBUG] [LOCAL ] YRD: Primary data saved (12135 records). [2025-10-10T22:31:36.018491] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-10T22:31:36.018584] [INFO ] [MAIN ] Update Progress: 2355/2373 symbols completed. YRD took 29.9s. Estimated remaining: 2m 32s. Rate: 7.1 symbols/min [2025-10-10T22:31:36.181772] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:31:36.231814] [DEBUG] [LOCAL ] YUMC: Loaded 52975 existing records from primary storage. [2025-10-10T22:31:36.232187] [INFO ] [MAIN ] YUMC: Loaded 52975 existing records. [2025-10-10T22:31:36.298537] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-10T22:31:36.423131] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:31:36.423368] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-10T22:31:36.423417] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-10T22:31:36.423690] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-10T22:31:36.423748] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-10T22:31:36.782136] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:31:37.089387] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-10T22:31:37.296376] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-10T22:31:37.302144] [INFO ] [REMOTE ] YPF: Full fetch complete (73462 records). [2025-10-10T22:31:37.302317] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-10T22:31:37.741632] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-10T22:31:37.741866] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-10T22:31:37.743665] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-10T22:31:37.743734] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-10T22:31:37.745665] [DEBUG] [LOCAL ] YPF: Trimmed 73462 records to 51292 (keeping 200 days of data) [2025-10-10T22:31:37.928061] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-10-10T22:31:38.095507] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-10T22:31:38.130723] [DEBUG] [LOCAL ] YPF: Primary data saved (51292 records). [2025-10-10T22:31:38.130931] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-10T22:31:38.131300] [INFO ] [MAIN ] Update Progress: 2356/2373 symbols completed. YPF took 35.0s. Estimated remaining: 2m 24s. Rate: 7.1 symbols/min [2025-10-10T22:31:38.330735] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:31:38.380739] [DEBUG] [LOCAL ] ZBH: Loaded 51177 existing records from primary storage. [2025-10-10T22:31:38.381098] [INFO ] [MAIN ] ZBH: Loaded 51177 existing records. [2025-10-10T22:31:38.554377] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:31:38.554601] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-10T22:31:38.554668] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-10T22:31:38.555328] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-10T22:31:38.555384] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-10T22:31:38.692683] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-10T22:31:38.914929] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:31:39.233620] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-10T22:31:39.489338] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-10T22:31:39.979121] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-10T22:31:40.047945] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-10T22:31:40.289369] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-10T22:31:41.089428] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-10T22:31:41.519598] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-10T22:31:41.590955] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-10T22:31:41.889378] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-10T22:31:42.689458] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-10T22:31:42.995628] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T22:31:43.469707] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T22:31:43.472576] [INFO ] [REMOTE ] YSG: Full fetch complete (32331 records). [2025-10-10T22:31:43.472678] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-10T22:31:43.494469] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-10T22:31:43.844494] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-10T22:31:43.844606] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-10T22:31:43.845452] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-10T22:31:43.845571] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-10T22:31:43.846726] [DEBUG] [LOCAL ] YSG: Trimmed 32331 records to 25646 (keeping 200 days of data) [2025-10-10T22:31:43.960688] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-10T22:31:44.028893] [DEBUG] [LOCAL ] YSG: Primary data saved (25646 records). [2025-10-10T22:31:44.029049] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-10T22:31:44.029151] [INFO ] [MAIN ] Update Progress: 2357/2373 symbols completed. YSG took 36.2s. Estimated remaining: 2m 15s. Rate: 7.1 symbols/min [2025-10-10T22:31:44.289452] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-10-10T22:31:45.089417] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-10T22:31:45.385577] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-10T22:31:45.889382] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-10T22:31:46.184279] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-10T22:31:46.689397] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-10T22:31:47.083331] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-10T22:31:47.350939] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-10T22:31:47.489379] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-10T22:31:48.289428] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-10T22:31:48.670109] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-10T22:31:49.089412] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-10T22:31:49.576621] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-10T22:31:49.889448] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-10T22:31:50.363690] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-10T22:31:50.689413] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-10T22:31:51.132039] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-10T22:31:51.489405] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-10T22:31:51.924407] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-10T22:31:52.095561] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-10T22:31:52.289396] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-10T22:31:53.012600] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-10T22:31:53.017604] [INFO ] [REMOTE ] YUM: Full fetch complete (74449 records). [2025-10-10T22:31:53.017789] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-10T22:31:53.094530] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-10T22:31:53.407741] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-10T22:31:53.407925] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-10T22:31:53.409136] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-10T22:31:53.409200] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-10T22:31:53.430274] [DEBUG] [LOCAL ] YUM: Trimmed 74449 records to 51941 (keeping 200 days of data) [2025-10-10T22:31:53.444406] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-10T22:31:53.775886] [DEBUG] [LOCAL ] YUM: Primary data saved (51941 records). [2025-10-10T22:31:53.776333] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-10T22:31:53.776428] [INFO ] [MAIN ] Update Progress: 2358/2373 symbols completed. YUM took 32.1s. Estimated remaining: 2m 7s. Rate: 7.1 symbols/min [2025-10-10T22:31:53.889536] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-10T22:31:55.240732] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-10T22:31:55.252889] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-10T22:31:55.372439] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-10T22:31:55.489475] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-10T22:31:57.326606] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-10T22:31:57.338770] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-10T22:31:57.579002] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-10T22:31:57.590384] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-10T22:31:59.039557] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-10T22:31:59.052124] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-10T22:31:59.502007] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-10T22:31:59.512851] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-10T22:32:00.900505] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-10T22:32:00.912239] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-10T22:32:01.529805] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-10T22:32:01.541277] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-10T22:32:02.665801] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-10T22:32:02.670758] [INFO ] [REMOTE ] YUMC: Full fetch complete (76154 records). [2025-10-10T22:32:02.670880] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-10T22:32:03.075102] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-10T22:32:03.075320] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-10T22:32:03.076820] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-10T22:32:03.076993] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-10T22:32:03.078759] [DEBUG] [LOCAL ] YUMC: Trimmed 76154 records to 53362 (keeping 200 days of data) [2025-10-10T22:32:03.336906] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-10T22:32:03.350763] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-10T22:32:03.446891] [DEBUG] [LOCAL ] YUMC: Primary data saved (53362 records). [2025-10-10T22:32:03.447109] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-10T22:32:03.447207] [INFO ] [MAIN ] Update Progress: 2359/2373 symbols completed. YUMC took 27.4s. Estimated remaining: 1m 58s. Rate: 7.1 symbols/min [2025-10-10T22:32:04.341008] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-10T22:32:04.353666] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-10T22:32:05.090392] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-10T22:32:05.094996] [INFO ] [REMOTE ] ZBH: Full fetch complete (73661 records). [2025-10-10T22:32:05.095128] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-10T22:32:05.494180] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-10T22:32:05.494262] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-10T22:32:05.495449] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-10T22:32:05.495518] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-10T22:32:05.497085] [DEBUG] [LOCAL ] ZBH: Trimmed 73661 records to 51529 (keeping 200 days of data) [2025-10-10T22:32:05.848457] [DEBUG] [LOCAL ] ZBH: Primary data saved (51529 records). [2025-10-10T22:32:05.848630] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-10T22:32:05.848953] [INFO ] [MAIN ] Update Progress: 2360/2373 symbols completed. ZBH took 27.7s. Estimated remaining: 1m 50s. Rate: 7.1 symbols/min [2025-10-10T22:32:06.509162] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:32:06.544185] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:32:06.571099] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:32:06.592240] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:32:06.631701] [DEBUG] [LOCAL ] ZEPP: Loaded 18435 existing records from primary storage. [2025-10-10T22:32:06.632215] [INFO ] [MAIN ] ZEPP: Loaded 18435 existing records. [2025-10-10T22:32:06.709192] [DEBUG] [LOCAL ] ZH: Loaded 25874 existing records from primary storage. [2025-10-10T22:32:06.745703] [INFO ] [MAIN ] ZH: Loaded 25874 existing records. [2025-10-10T22:32:06.848537] [DEBUG] [LOCAL ] ZGN: Loaded 41074 existing records from primary storage. [2025-10-10T22:32:06.951283] [DEBUG] [LOCAL ] ZETA: Loaded 53999 existing records from primary storage. [2025-10-10T22:32:06.962858] [INFO ] [MAIN ] ZGN: Loaded 41074 existing records. [2025-10-10T22:32:07.012813] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:32:07.060435] [INFO ] [MAIN ] ZETA: Loaded 53999 existing records. [2025-10-10T22:32:07.105000] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-10T22:32:07.138119] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-10T22:32:07.209991] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:32:07.238042] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-10T22:32:07.269888] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-10T22:32:07.280456] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-10T22:32:07.275179] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-10T22:32:07.356074] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-10T22:32:07.451475] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-10T22:32:07.487051] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:32:07.528896] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:32:07.609927] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-10T22:32:07.610099] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-10T22:32:07.624187] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-10T22:32:07.634637] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-10T22:32:07.640308] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-10T22:32:07.640550] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-10T22:32:07.688492] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-10T22:32:07.743688] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-10T22:32:08.640837] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:32:08.705088] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-10-10T22:32:08.712216] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:32:08.759606] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-10-10T22:32:09.000218] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:32:09.006879] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:32:09.008044] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-10-10T22:32:09.007630] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-10-10T22:32:09.222267] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-10T22:32:09.223550] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-10T22:32:09.913836] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-10T22:32:09.915270] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-10T22:32:10.103828] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-10T22:32:10.109001] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-10T22:32:10.312118] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-10T22:32:10.321115] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-10T22:32:10.471282] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-10T22:32:10.472779] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-10T22:32:11.263782] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-10T22:32:11.272083] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-10T22:32:11.278752] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-10T22:32:11.278981] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-10T22:32:11.799754] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-10T22:32:11.801488] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-10T22:32:11.837820] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-10-10T22:32:11.915316] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-10T22:32:12.292449] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-10T22:32:12.293464] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-10T22:32:12.500674] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-10T22:32:13.089383] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-10T22:32:13.889395] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-10T22:32:14.690630] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-10T22:32:14.689740] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-10T22:32:14.813209] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-10T22:32:14.842621] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-10T22:32:15.209742] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-10T22:32:15.489391] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-10T22:32:16.289379] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-10T22:32:17.089404] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-10T22:32:17.881078] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-10T22:32:17.890255] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-10T22:32:17.955691] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-10T22:32:18.689393] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-10T22:32:18.807927] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T22:32:19.142135] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-10T22:32:19.489399] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-10T22:32:20.289392] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-10T22:32:21.089384] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-10T22:32:21.285285] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-10T22:32:21.312883] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-10T22:32:21.315609] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-10T22:32:21.889362] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-10T22:32:22.689414] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-10T22:32:23.020484] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-10T22:32:23.489402] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-10T22:32:23.793034] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-10T22:32:24.289355] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-10T22:32:24.419260] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-10T22:32:24.685683] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T22:32:25.089417] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-10T22:32:25.558593] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-10T22:32:25.889399] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-10T22:32:26.689392] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-10T22:32:26.780803] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-10T22:32:27.447139] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-10T22:32:27.489333] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-10T22:32:28.289389] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-10T22:32:28.814937] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-10T22:32:29.057166] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-10T22:32:29.089344] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-10T22:32:29.108544] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-10T22:32:29.111410] [INFO ] [REMOTE ] ZEPP: Full fetch complete (20179 records). [2025-10-10T22:32:29.111488] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-10T22:32:29.466745] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-10T22:32:29.466833] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-10T22:32:29.467315] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-10T22:32:29.467380] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-10T22:32:29.468006] [DEBUG] [LOCAL ] ZEPP: Trimmed 20179 records to 18685 (keeping 200 days of data) [2025-10-10T22:32:29.574425] [DEBUG] [LOCAL ] ZEPP: Primary data saved (18685 records). [2025-10-10T22:32:29.574588] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-10T22:32:29.574708] [INFO ] [MAIN ] Update Progress: 2361/2373 symbols completed. ZEPP took 23.7s. Estimated remaining: 1m 41s. Rate: 7.1 symbols/min [2025-10-10T22:32:29.747404] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:32:29.800335] [DEBUG] [LOCAL ] ZIM: Loaded 53891 existing records from primary storage. [2025-10-10T22:32:29.800715] [INFO ] [MAIN ] ZIM: Loaded 53891 existing records. [2025-10-10T22:32:29.896163] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-10T22:32:29.976311] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:32:29.976529] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-10T22:32:29.976578] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-10T22:32:29.976832] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-10T22:32:29.976889] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-10T22:32:30.320862] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:32:30.689393] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-10-10T22:32:31.485610] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-10T22:32:31.497057] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-10T22:32:31.650108] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-10T22:32:32.289445] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-10T22:32:32.991227] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-10T22:32:33.089379] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-10T22:32:33.135553] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-10T22:32:33.889434] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-10T22:32:34.283061] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-10T22:32:34.285572] [INFO ] [REMOTE ] ZH: Full fetch complete (40149 records). [2025-10-10T22:32:34.285686] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-10T22:32:34.658249] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-10T22:32:34.658437] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-10T22:32:34.659711] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-10T22:32:34.659862] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-10T22:32:34.660887] [DEBUG] [LOCAL ] ZH: Trimmed 40149 records to 26192 (keeping 200 days of data) [2025-10-10T22:32:34.703336] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-10T22:32:34.807086] [DEBUG] [LOCAL ] ZH: Primary data saved (26192 records). [2025-10-10T22:32:34.807247] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-10T22:32:34.807339] [INFO ] [MAIN ] Update Progress: 2362/2373 symbols completed. ZH took 29.0s. Estimated remaining: 1m 33s. Rate: 7.1 symbols/min [2025-10-10T22:32:34.976757] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:32:35.019268] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-10T22:32:35.065363] [DEBUG] [LOCAL ] ZIP: Loaded 44170 existing records from primary storage. [2025-10-10T22:32:35.065725] [INFO ] [MAIN ] ZIP: Loaded 44170 existing records. [2025-10-10T22:32:35.259561] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:32:35.259981] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-10T22:32:35.260039] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-10T22:32:35.260286] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-10T22:32:35.260344] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-10T22:32:35.498537] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-10T22:32:35.538703] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-10T22:32:35.672671] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:32:36.289444] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-10-10T22:32:37.089421] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-10T22:32:37.170108] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-10T22:32:37.748394] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-10T22:32:37.889411] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-10T22:32:38.160574] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-10-10T22:32:38.689447] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-10T22:32:38.715447] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-10T22:32:38.815317] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-10T22:32:39.489398] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-10T22:32:40.289409] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-10T22:32:41.019249] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-10T22:32:41.089325] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-10T22:32:41.354852] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-10-10T22:32:41.889399] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-10T22:32:42.136048] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-10T22:32:42.689362] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-10T22:32:42.939121] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-10T22:32:43.489400] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-10T22:32:44.289417] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-10T22:32:44.374872] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-10T22:32:44.380738] [INFO ] [REMOTE ] ZETA: Full fetch complete (77680 records). [2025-10-10T22:32:44.380989] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-10T22:32:44.815082] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-10T22:32:44.815188] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-10T22:32:44.817081] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-10T22:32:44.817153] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-10T22:32:44.819446] [DEBUG] [LOCAL ] ZETA: Trimmed 77680 records to 54389 (keeping 200 days of data) [2025-10-10T22:32:45.174589] [DEBUG] [LOCAL ] ZETA: Primary data saved (54389 records). [2025-10-10T22:32:45.174813] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-10T22:32:45.174924] [INFO ] [MAIN ] Update Progress: 2363/2373 symbols completed. ZETA took 39.3s. Estimated remaining: 1m 24s. Rate: 7.1 symbols/min [2025-10-10T22:32:45.357169] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:32:45.413223] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-10T22:32:45.428347] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-10T22:32:45.430407] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-10T22:32:45.480049] [DEBUG] [LOCAL ] ZK: Loaded 39481 existing records from primary storage. [2025-10-10T22:32:45.480435] [INFO ] [MAIN ] ZK: Loaded 39481 existing records. [2025-10-10T22:32:45.682712] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:32:45.683097] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-10T22:32:45.683155] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-10T22:32:45.683410] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-10T22:32:45.683468] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-10T22:32:45.811768] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-10T22:32:45.845566] [INFO ] [REMOTE ] ZGN: Full fetch complete (58144 records). [2025-10-10T22:32:45.856241] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-10T22:32:45.892972] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-10T22:32:46.343409] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:32:46.536153] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-10T22:32:46.536255] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-10T22:32:46.537890] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-10T22:32:46.537976] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-10T22:32:46.539387] [DEBUG] [LOCAL ] ZGN: Trimmed 58144 records to 41436 (keeping 200 days of data) [2025-10-10T22:32:46.707008] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-10-10T22:32:46.802125] [DEBUG] [LOCAL ] ZGN: Primary data saved (41436 records). [2025-10-10T22:32:46.802304] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-10T22:32:46.802408] [INFO ] [MAIN ] Update Progress: 2364/2373 symbols completed. ZGN took 40.9s. Estimated remaining: 1m 16s. Rate: 7.1 symbols/min [2025-10-10T22:32:47.005979] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:32:47.017423] [DEBUG] [LOCAL ] ZKH: Loaded 7684 existing records from primary storage. [2025-10-10T22:32:47.017786] [INFO ] [MAIN ] ZKH: Loaded 7684 existing records. [2025-10-10T22:32:47.208180] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:32:47.208606] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-10T22:32:47.208726] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-10T22:32:47.208992] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-10T22:32:47.209055] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-10T22:32:47.515626] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-10T22:32:47.554287] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-10T22:32:47.634624] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:32:48.003221] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-10T22:32:48.289431] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-10T22:32:48.588284] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-10T22:32:48.697501] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-10T22:32:49.089354] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-10T22:32:49.889401] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-10-10T22:32:49.921155] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-10T22:32:50.599977] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-10T22:32:50.689357] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-10T22:32:50.813364] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-10T22:32:51.489399] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-10T22:32:52.289414] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-10T22:32:53.089423] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-10T22:32:53.170814] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-10T22:32:53.263904] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-10T22:32:53.538548] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-10T22:32:53.889392] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-10T22:32:54.205484] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-10T22:32:54.689357] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-10T22:32:54.803701] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-10T22:32:55.489440] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-10T22:32:56.289397] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-10T22:32:57.040335] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-10T22:32:57.089390] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-10T22:32:57.487478] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-10T22:32:57.596718] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-10T22:32:57.889390] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-10T22:32:58.689432] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-10T22:32:59.175148] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-10T22:32:59.489412] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-10T22:32:59.571448] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-10T22:32:59.816008] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-10T22:33:00.289386] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-10T22:33:01.018089] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-10T22:33:01.089374] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-10T22:33:01.889403] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-10T22:33:02.004806] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-10T22:33:02.012993] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-10T22:33:02.689385] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-10T22:33:03.182714] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-10T22:33:03.411137] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-10T22:33:03.415752] [INFO ] [REMOTE ] ZIP: Full fetch complete (60010 records). [2025-10-10T22:33:03.415873] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-10T22:33:03.494558] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-10T22:33:03.814523] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-10T22:33:03.814623] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-10T22:33:03.816306] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-10T22:33:03.816371] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-10T22:33:03.818067] [DEBUG] [LOCAL ] ZIP: Trimmed 60010 records to 44484 (keeping 200 days of data) [2025-10-10T22:33:04.084510] [DEBUG] [LOCAL ] ZIP: Primary data saved (44484 records). [2025-10-10T22:33:04.084699] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-10T22:33:04.084984] [INFO ] [MAIN ] Update Progress: 2365/2373 symbols completed. ZIP took 29.3s. Estimated remaining: 1m 8s. Rate: 7.1 symbols/min [2025-10-10T22:33:04.267696] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:33:04.295349] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-10T22:33:04.321365] [DEBUG] [LOCAL ] ZTO: Loaded 49914 existing records from primary storage. [2025-10-10T22:33:04.321737] [INFO ] [MAIN ] ZTO: Loaded 49914 existing records. [2025-10-10T22:33:04.500604] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:33:04.501161] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-10T22:33:04.501533] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-10T22:33:04.501941] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-10T22:33:04.502005] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-10T22:33:04.804113] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-10T22:33:04.886744] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:33:05.089392] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-10-10T22:33:05.889396] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-10T22:33:06.170576] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-10T22:33:06.689361] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-10T22:33:06.820621] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-10T22:33:07.108004] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-10T22:33:07.489377] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-10T22:33:08.152737] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-10T22:33:08.289443] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-10T22:33:08.650788] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-10T22:33:09.089361] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-10T22:33:09.889525] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-10T22:33:09.959168] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-10T22:33:10.509889] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-10T22:33:10.511526] [INFO ] [REMOTE ] ZKH: Full fetch complete (11953 records). [2025-10-10T22:33:10.511667] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-10T22:33:10.698146] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-10T22:33:10.937617] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-10T22:33:10.937911] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-10T22:33:10.938397] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-10T22:33:10.938578] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-10T22:33:10.939458] [DEBUG] [LOCAL ] ZKH: Trimmed 11953 records to 7702 (keeping 200 days of data) [2025-10-10T22:33:10.998214] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-10T22:33:11.020744] [DEBUG] [LOCAL ] ZKH: Primary data saved (7702 records). [2025-10-10T22:33:11.020914] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-10T22:33:11.021010] [INFO ] [MAIN ] Update Progress: 2366/2373 symbols completed. ZKH took 24.2s. Estimated remaining: 59.1s. Rate: 7.1 symbols/min [2025-10-10T22:33:11.191518] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:33:11.209719] [DEBUG] [LOCAL ] ZTR: Loaded 16901 existing records from primary storage. [2025-10-10T22:33:11.210047] [INFO ] [MAIN ] ZTR: Loaded 16901 existing records. [2025-10-10T22:33:11.388115] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:33:11.388402] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-10T22:33:11.388450] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-10T22:33:11.388674] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-10T22:33:11.388735] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-10T22:33:11.494571] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-10T22:33:11.763929] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:33:11.835010] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-10T22:33:12.289459] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-10T22:33:13.094494] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-10T22:33:13.110123] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-10T22:33:13.889434] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-10T22:33:14.438219] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-10T22:33:14.443377] [INFO ] [REMOTE ] ZIM: Full fetch complete (77498 records). [2025-10-10T22:33:14.443509] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-10T22:33:14.703727] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-10-10T22:33:14.883639] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-10T22:33:14.887535] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-10T22:33:14.895811] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-10T22:33:14.897505] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-10T22:33:14.897596] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-10T22:33:14.899622] [DEBUG] [LOCAL ] ZIM: Trimmed 77498 records to 54281 (keeping 200 days of data) [2025-10-10T22:33:15.233926] [DEBUG] [LOCAL ] ZIM: Primary data saved (54281 records). [2025-10-10T22:33:15.234082] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-10T22:33:15.234170] [INFO ] [MAIN ] Update Progress: 2367/2373 symbols completed. ZIM took 45.7s. Estimated remaining: 50.7s. Rate: 7.1 symbols/min [2025-10-10T22:33:15.405418] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:33:15.438610] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-10T22:33:15.488541] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-10T22:33:15.493055] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-10T22:33:15.514108] [DEBUG] [LOCAL ] ZTS: Loaded 53465 existing records from primary storage. [2025-10-10T22:33:15.514472] [INFO ] [MAIN ] ZTS: Loaded 53465 existing records. [2025-10-10T22:33:15.687988] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:33:15.688219] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-10T22:33:15.688269] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-10T22:33:15.688469] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-10T22:33:15.688509] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-10T22:33:16.038399] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:33:16.289370] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-10-10T22:33:16.846503] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-10T22:33:17.089404] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-10T22:33:17.889372] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-10T22:33:18.375264] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-10T22:33:18.689386] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-10T22:33:18.966133] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-10T22:33:19.224955] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-10T22:33:19.489369] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-10T22:33:19.888172] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-10T22:33:20.289425] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-10T22:33:21.089382] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-10T22:33:21.456437] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-10T22:33:21.747773] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-10T22:33:21.889393] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-10T22:33:22.353912] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-10T22:33:22.689456] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-10T22:33:23.489438] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-10T22:33:23.915057] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-10T22:33:24.006290] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-10T22:33:24.289377] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-10T22:33:25.033429] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-10T22:33:25.037243] [INFO ] [REMOTE ] ZK: Full fetch complete (56971 records). [2025-10-10T22:33:25.037341] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-10T22:33:25.098724] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-10T22:33:25.423917] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-10T22:33:25.424119] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-10T22:33:25.425216] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-10T22:33:25.425323] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-10T22:33:25.438612] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-10T22:33:25.443846] [DEBUG] [LOCAL ] ZK: Trimmed 56971 records to 39847 (keeping 200 days of data) [2025-10-10T22:33:25.675919] [DEBUG] [LOCAL ] ZK: Primary data saved (39847 records). [2025-10-10T22:33:25.676096] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-10T22:33:25.676242] [INFO ] [MAIN ] Update Progress: 2368/2373 symbols completed. ZK took 40.5s. Estimated remaining: 42.2s. Rate: 7.1 symbols/min [2025-10-10T22:33:25.846965] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:33:25.881437] [DEBUG] [LOCAL ] ZVIA: Loaded 35698 existing records from primary storage. [2025-10-10T22:33:25.881786] [INFO ] [MAIN ] ZVIA: Loaded 35698 existing records. [2025-10-10T22:33:25.895000] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-10T22:33:26.088176] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:33:26.088438] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-10T22:33:26.088486] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-10T22:33:26.088718] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-10T22:33:26.088773] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-10T22:33:26.442772] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:33:26.689429] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-10T22:33:27.243716] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-10T22:33:27.489350] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-10T22:33:27.785116] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-10T22:33:27.848756] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-10T22:33:28.289411] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-10-10T22:33:29.089382] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-10T22:33:29.628988] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-10T22:33:29.889393] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-10T22:33:29.971223] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-10T22:33:30.689347] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-10T22:33:30.921843] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-10T22:33:31.489350] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-10T22:33:31.984034] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-10T22:33:32.051194] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-10T22:33:32.289388] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-10T22:33:32.963532] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-10T22:33:33.089382] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-10T22:33:33.889400] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-10T22:33:34.232339] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-10T22:33:34.693274] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-10T22:33:34.696695] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-10T22:33:35.103745] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-10T22:33:35.489454] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-10T22:33:36.289419] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-10T22:33:36.488764] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-10T22:33:37.095410] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-10T22:33:37.110766] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-10T22:33:37.889345] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-10T22:33:37.910929] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-10T22:33:38.616747] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-10T22:33:38.622170] [INFO ] [REMOTE ] ZTO: Full fetch complete (72698 records). [2025-10-10T22:33:38.622319] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-10T22:33:38.697537] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-10T22:33:39.023005] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-10T22:33:39.023097] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-10T22:33:39.024314] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-10T22:33:39.024387] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-10T22:33:39.025965] [DEBUG] [LOCAL ] ZTO: Trimmed 72698 records to 50281 (keeping 200 days of data) [2025-10-10T22:33:39.275074] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-10T22:33:39.388700] [DEBUG] [LOCAL ] ZTO: Primary data saved (50281 records). [2025-10-10T22:33:39.388891] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-10T22:33:39.389217] [INFO ] [MAIN ] Update Progress: 2369/2373 symbols completed. ZTO took 35.3s. Estimated remaining: 33.8s. Rate: 7.1 symbols/min [2025-10-10T22:33:39.494596] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-10T22:33:39.593901] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-10-02 to 2025-10-10. [2025-10-10T22:33:39.639601] [DEBUG] [LOCAL ] ZWS: Loaded 42540 existing records from primary storage. [2025-10-10T22:33:39.639968] [INFO ] [MAIN ] ZWS: Loaded 42540 existing records. [2025-10-10T22:33:39.875835] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-10T22:33:39.874125] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-23 for 200 day retention. Performing full refresh. [2025-10-10T22:33:39.876307] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-10T22:33:39.882753] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-10T22:33:39.884007] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-10T22:33:39.884091] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-10T22:33:40.286088] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-23 to 2025-10-10 (requires 11 months of data pull). [2025-10-10T22:33:40.289418] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-10T22:33:41.089404] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-10T22:33:41.704234] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-10T22:33:41.730759] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-10T22:33:41.889384] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-10T22:33:42.689360] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-10-10T22:33:42.769482] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-10T22:33:42.893352] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-10T22:33:42.895524] [INFO ] [REMOTE ] ZTR: Full fetch complete (26864 records). [2025-10-10T22:33:42.895600] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-10T22:33:43.250157] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-10T22:33:43.250242] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-10T22:33:43.250827] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-10T22:33:43.250915] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-10T22:33:43.251589] [DEBUG] [LOCAL ] ZTR: Trimmed 26864 records to 16994 (keeping 200 days of data) [2025-10-10T22:33:43.351113] [DEBUG] [LOCAL ] ZTR: Primary data saved (16994 records). [2025-10-10T22:33:43.351275] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-10T22:33:43.351376] [INFO ] [MAIN ] Update Progress: 2370/2373 symbols completed. ZTR took 32.3s. Estimated remaining: 25.3s. Rate: 7.1 symbols/min [2025-10-10T22:33:43.489453] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-10T22:33:44.289419] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-10T22:33:44.431839] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-10T22:33:45.089412] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-10T22:33:45.150495] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-10T22:33:45.889407] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-10T22:33:46.660556] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-10T22:33:46.694577] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-10T22:33:46.697364] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-10T22:33:47.477175] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-10T22:33:47.483122] [INFO ] [REMOTE ] ZTS: Full fetch complete (76719 records). [2025-10-10T22:33:47.483277] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-10T22:33:47.515007] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-10T22:33:47.805784] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-10T22:33:47.912434] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-10T22:33:47.912527] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-10T22:33:47.913950] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-10T22:33:47.914018] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-10T22:33:47.915578] [DEBUG] [LOCAL ] ZTS: Trimmed 76719 records to 53853 (keeping 200 days of data) [2025-10-10T22:33:48.245814] [DEBUG] [LOCAL ] ZTS: Primary data saved (53853 records). [2025-10-10T22:33:48.245978] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-10T22:33:48.246800] [INFO ] [MAIN ] Update Progress: 2371/2373 symbols completed. ZTS took 33.0s. Estimated remaining: 16.9s. Rate: 7.1 symbols/min [2025-10-10T22:33:48.289346] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-10T22:33:48.826608] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-10T22:33:49.089389] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-10T22:33:49.973859] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-10T22:33:49.982775] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-10T22:33:50.866327] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-10T22:33:50.875686] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-10T22:33:51.698832] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-10T22:33:51.707003] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-10T22:33:52.199409] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-10T22:33:52.289343] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-10T22:33:53.197422] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-10T22:33:53.201463] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52838 records). [2025-10-10T22:33:53.201620] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-10T22:33:53.607746] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-10T22:33:53.607861] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-10T22:33:53.609069] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-10T22:33:53.609149] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-10T22:33:53.610315] [DEBUG] [LOCAL ] ZVIA: Trimmed 52838 records to 35978 (keeping 200 days of data) [2025-10-10T22:33:53.815997] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35978 records). [2025-10-10T22:33:53.816172] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-10T22:33:53.816282] [INFO ] [MAIN ] Update Progress: 2372/2373 symbols completed. ZVIA took 28.1s. Estimated remaining: 8.4s. Rate: 7.1 symbols/min [2025-10-10T22:33:53.948946] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-10T22:33:53.957666] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-10T22:33:55.533673] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-10T22:33:55.541123] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-10T22:33:57.319829] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-10T22:33:57.329534] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-10T22:33:59.050534] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-10T22:33:59.060255] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-10T22:34:00.901442] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-10T22:34:00.911793] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-10T22:34:02.487181] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-10T22:34:02.493852] [INFO ] [REMOTE ] ZWS: Full fetch complete (61883 records). [2025-10-10T22:34:02.494164] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-10T22:34:02.983754] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-10T22:34:02.983876] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-10T22:34:02.985254] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-10T22:34:02.985320] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-10T22:34:02.986632] [DEBUG] [LOCAL ] ZWS: Trimmed 61883 records to 42839 (keeping 200 days of data) [2025-10-10T22:34:03.257421] [DEBUG] [LOCAL ] ZWS: Primary data saved (42839 records). [2025-10-10T22:34:03.257578] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-10T22:34:03.257857] [INFO ] [MAIN ] Update Progress: 2373/2373 symbols completed. ZWS took 23.9s. Estimated remaining: 0.0s. Rate: 7.1 symbols/min [2025-10-10T22:34:03.259971] [INFO ] [MAIN ] Parallel update completed in 5h 33m 59s [2025-10-10T22:34:03.260078] [WARN ] [MAIN ] Failed symbols (550): AAMI, AAM, AAUC, AB, ACA, ABT, AD, AEXA, AGD, AHL... [2025-10-10T22:34:03.260206] [INFO ] [MAIN ] Update success rate: 76.8% (1823/2373 symbols) [2025-10-10T22:34:03.791973] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (1823/2373 @ 76.82%)' [2025-10-10T22:34:03.792581] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-10T22:34:03.792694] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-10T22:34:03.792761] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-10T22:34:03.792884] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-10T22:34:03.792924] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-10T22:34:05.237918] [DEBUG] [SYMBOL ] Found 2425 valid NYSE symbols. [2025-10-10T22:34:05.238102] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-10T22:34:05.238311] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-10T22:34:05.240748] [INFO ] [LOCAL ] Symbols cache updated with 2373 symbols. [2025-10-10T22:34:05.240898] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-10T22:34:05.240978] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-10T22:34:05.241053] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-10T22:34:05.241089] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-10T22:34:05.241120] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-10T22:34:05.241500] [DEBUG] [LOCAL ] Found 2373 symbols in cached list. [2025-10-10T22:34:05.241534] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-10T22:34:05.241741] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-10T22:34:05.241799] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2373 valid symbols. [2025-10-10T22:34:05.241834] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-10T22:34:05.241866] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-10T22:34:05.264174] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-10T22:34:05.287328] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-10T22:34:05.287386] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-10T22:34:05.287418] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-10T22:34:05.287446] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-10T22:34:05.287496] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-10T22:34:05.287526] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-10T22:34:05.287558] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-10T22:34:05.289716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-10-10T22:34:05.290825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-10T22:34:05.290939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-10T22:34:05.291099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-10T22:34:05.291246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-10T22:34:05.291349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-10T22:34:05.291457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-10T22:34:05.291565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-10T22:34:05.291683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-10T22:34:05.291769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-10T22:34:05.292963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-10T22:34:05.293080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-10T22:34:05.293186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-10T22:34:05.293280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-10-10T22:34:05.293369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-10T22:34:05.293483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-10T22:34:05.293593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-10-10T22:34:05.293753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-10-10T22:34:05.293865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-10-10T22:34:05.293962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-10T22:34:05.294053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-10T22:34:05.294155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-10T22:34:05.294288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-10T22:34:05.294391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-10-10T22:34:05.294518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-10T22:34:05.294625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-10T22:34:05.294775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-10T22:34:05.294883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-10T22:34:05.294998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-10T22:34:05.295103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-10T22:34:05.295215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-10T22:34:05.295342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-10-10T22:34:05.295480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-10-10T22:34:05.295603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-10T22:34:05.295749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-10T22:34:05.295859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-10T22:34:05.295987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-10T22:34:05.296088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-10-10T22:34:05.296180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-10T22:34:05.296282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-10T22:34:05.296378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-10T22:34:05.296479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-10T22:34:05.296560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-10T22:34:05.296630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-10T22:34:05.296735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-10T22:34:05.296826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-10T22:34:05.296965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-10T22:34:05.297070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-10T22:34:05.297169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-10T22:34:05.297263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-10T22:34:05.297390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-10T22:34:05.297499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-10T22:34:05.297616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-10T22:34:05.297746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-10T22:34:05.297858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-10T22:34:05.297952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-10T22:34:05.298035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-10-10T22:34:05.298151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-10T22:34:05.298244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-10T22:34:05.298352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-10T22:34:05.298441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-10T22:34:05.298512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-10T22:34:05.298624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-10-10T22:34:05.298776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-10T22:34:05.298871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-10T22:34:05.299008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-10T22:34:05.299118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-10T22:34:05.299206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-10T22:34:05.299316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-10T22:34:05.299418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-10T22:34:05.299530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-10-10T22:34:05.299609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-10T22:34:05.299713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-10-10T22:34:05.299807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-10T22:34:05.299929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-10T22:34:05.300026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-10T22:34:05.300107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-10T22:34:05.300181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-10T22:34:05.300278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-10T22:34:05.300362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-10T22:34:05.300447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-10T22:34:05.300557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-10-10T22:34:05.300638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-10T22:34:05.300746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-10T22:34:05.300821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-10-10T22:34:05.300927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-10T22:34:05.301035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-10T22:34:05.301119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-10T22:34:05.301213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-10T22:34:05.301322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-10T22:34:05.301417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-10T22:34:05.301530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-10T22:34:05.301613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-10T22:34:05.301730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-10T22:34:05.301847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-10T22:34:05.301947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-10T22:34:05.302034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-10-10T22:34:05.302146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-10T22:34:05.302228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-10T22:34:05.302313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-10T22:34:05.302425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-10T22:34:05.302519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-10T22:34:05.302602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-10T22:34:05.302726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-10T22:34:05.302822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-10-10T22:34:05.302884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-10T22:34:05.302940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-10T22:34:05.303009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-10T22:34:05.303122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-10-10T22:34:05.303204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-10T22:34:05.303266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-10T22:34:05.303324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-10T22:34:05.303401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-10T22:34:05.303482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-10T22:34:05.303545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-10T22:34:05.303633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-10T22:34:05.303775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-10-10T22:34:05.303876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-10-10T22:34:05.303975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-10T22:34:05.304064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-10T22:34:05.304123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-10T22:34:05.304177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-10T22:34:05.304250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-10T22:34:05.304358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-10T22:34:05.304465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-10T22:34:05.304557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-10T22:34:05.304677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-10T22:34:05.304768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-10T22:34:05.304840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-10T22:34:05.304925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-10T22:34:05.305031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-10T22:34:05.305111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-10T22:34:05.305173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-10T22:34:05.305257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-10T22:34:05.305349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-10T22:34:05.305451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-10T22:34:05.305531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-10T22:34:05.305603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-10T22:34:05.305733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-10T22:34:05.305832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-10T22:34:05.305925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-10T22:34:05.306002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-10T22:34:05.306060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-10T22:34:05.306148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-10T22:34:05.306241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-10T22:34:05.306361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-10-10T22:34:05.306424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-10T22:34:05.306482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-10T22:34:05.306549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-10T22:34:05.306617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-10T22:34:05.306760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-10T22:34:05.306856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-10T22:34:05.306959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-10T22:34:05.307046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-10T22:34:05.307105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-10T22:34:05.307161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-10T22:34:05.307236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-10-10T22:34:05.307317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-10-10T22:34:05.307377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-10-10T22:34:05.307432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-10T22:34:05.307532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-10-10T22:34:05.307616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-10T22:34:05.307733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-10T22:34:05.307821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-10T22:34:05.307897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-10-10T22:34:05.308025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-10T22:34:05.308128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-10T22:34:05.308230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-10T22:34:05.308336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-10T22:34:05.308423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-10T22:34:05.308511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-10T22:34:05.308614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-10T22:34:05.308727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-10-10T22:34:05.308809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-10T22:34:05.308895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-10T22:34:05.308980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-10T22:34:05.309066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-10T22:34:05.309134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-10T22:34:05.309196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-10T22:34:05.309257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-10T22:34:05.309352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-10T22:34:05.309466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-10T22:34:05.309569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-10T22:34:05.309691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-10-10T22:34:05.309781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-10T22:34:05.309860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-10T22:34:05.309959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-10-10T22:34:05.310042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-10T22:34:05.310103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-10-10T22:34:05.310161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-10T22:34:05.310219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-10T22:34:05.310302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-10T22:34:05.310405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-10T22:34:05.310488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-10T22:34:05.310563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-10T22:34:05.310770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-10T22:34:05.310855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-10T22:34:05.310931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-10-10T22:34:05.311041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-10T22:34:05.311124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-10T22:34:05.311187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-10-10T22:34:05.311247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-10T22:34:05.311319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-10T22:34:05.311412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-10T22:34:05.311492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-10-10T22:34:05.311594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-10T22:34:05.311707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-10T22:34:05.311820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-10T22:34:05.311915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-10T22:34:05.312035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-10T22:34:05.312183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-10T22:34:05.312327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-10-10T22:34:05.312448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-10T22:34:05.312593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-10T22:34:05.312797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-10T22:34:05.312925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-10T22:34:05.313093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-10T22:34:05.313217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-10-10T22:34:05.313355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-10T22:34:05.313477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-10T22:34:05.313603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-10T22:34:05.313754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-10T22:34:05.314573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-10T22:34:05.314749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-10T22:34:05.314876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-10T22:34:05.315001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-10T22:34:05.315125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-10T22:34:05.315250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-10T22:34:05.315384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-10T22:34:05.315518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-10T22:34:05.315674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-10T22:34:05.315821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-10T22:34:05.315944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-10T22:34:05.316096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-10T22:34:05.316231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-10T22:34:05.316363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-10T22:34:05.316488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-10T22:34:05.316605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-10T22:34:05.316762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-10-10T22:34:05.316900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-10T22:34:05.323343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-10T22:34:05.323437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-10T22:34:05.323590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-10T22:34:05.323717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-10-10T22:34:05.323803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-10T22:34:05.323883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-10T22:34:05.323969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-10T22:34:05.324048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-10T22:34:05.324150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-10T22:34:05.324246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-10T22:34:05.324335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-10T22:34:05.324395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-10T22:34:05.324455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-10T22:34:05.324513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-10T22:34:05.324597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-10T22:34:05.324713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-10T22:34:05.324789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-10T22:34:05.324867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-10T22:34:05.324964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-10T22:34:05.325045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-10T22:34:05.325125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-10T22:34:05.325218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-10T22:34:05.325298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-10T22:34:05.325355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-10T22:34:05.325409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-10-10T22:34:05.325465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-10T22:34:05.325522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-10T22:34:05.325580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-10T22:34:05.325635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-10T22:34:05.325753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-10-10T22:34:05.325840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-10T22:34:05.325954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-10T22:34:05.326042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-10T22:34:05.326136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-10T22:34:05.326199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-10T22:34:05.326256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-10-10T22:34:05.326325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-10T22:34:05.326407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-10T22:34:05.326483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-10T22:34:05.326563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-10T22:34:05.326632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-10-10T22:34:05.326745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-10T22:34:05.326828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-10T22:34:05.326885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-10T22:34:05.326980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-10-10T22:34:05.327054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-10T22:34:05.327114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-10T22:34:05.327239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-10T22:34:05.327322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-10T22:34:05.327420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-10T22:34:05.327542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-10T22:34:05.327698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-10-10T22:34:05.327786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-10-10T22:34:05.327857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-10T22:34:05.327932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-10T22:34:05.328012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-10T22:34:05.328071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-10T22:34:05.328148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-10T22:34:05.328242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-10T22:34:05.328329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-10T22:34:05.328389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-10T22:34:05.328484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-10T22:34:05.328581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-10T22:34:05.328885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-10T22:34:05.328975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-10T22:34:05.329048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-10T22:34:05.329142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-10T22:34:05.329245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-10T22:34:05.329346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-10T22:34:05.329447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-10T22:34:05.329543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-10T22:34:05.329637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-10T22:34:05.329746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-10-10T22:34:05.329809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-10T22:34:05.329880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-10T22:34:05.329960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-10T22:34:05.330039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-10T22:34:05.330120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-10T22:34:05.330185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-10T22:34:05.330243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-10T22:34:05.330297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-10T22:34:05.330352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-10T22:34:05.330406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-10T22:34:05.330483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-10T22:34:05.330565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-10T22:34:05.330623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-10T22:34:05.330730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-10T22:34:05.330840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-10T22:34:05.330940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-10T22:34:05.331037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-10T22:34:05.331115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-10T22:34:05.331171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-10T22:34:05.331242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-10T22:34:05.331324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-10T22:34:05.331380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-10T22:34:05.331434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-10T22:34:05.331499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-10T22:34:05.331591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-10-10T22:34:05.331729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-10T22:34:05.331808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-10-10T22:34:05.331863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-10T22:34:05.331935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-10T22:34:05.332029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-10T22:34:05.332087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-10T22:34:05.332142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-10T22:34:05.332202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-10T22:34:05.332259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-10-10T22:34:05.332345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-10T22:34:05.332425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-10-10T22:34:05.332498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-10T22:34:05.332594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-10T22:34:05.332715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-10T22:34:05.332787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-10-10T22:34:05.332846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-10T22:34:05.332912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-10T22:34:05.333000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-10T22:34:05.333066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-10T22:34:05.333133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-10T22:34:05.333230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-10T22:34:05.333294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-10T22:34:05.333349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-10T22:34:05.333408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-10T22:34:05.333464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-10T22:34:05.333522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-10-10T22:34:05.333589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-10T22:34:05.333670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-10T22:34:05.333757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-10T22:34:05.333818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-10T22:34:05.333886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-10T22:34:05.333968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-10-10T22:34:05.334044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-10T22:34:05.334131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-10-10T22:34:05.334190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-10-10T22:34:05.334265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-10T22:34:05.334347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-10-10T22:34:05.334420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-10T22:34:05.334505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-10T22:34:05.334564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-10T22:34:05.334624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-10-10T22:34:05.334725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-10T22:34:05.334793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-10T22:34:05.334849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-10T22:34:05.334921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-10T22:34:05.335006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-10-10T22:34:05.335065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-10T22:34:05.335156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-10T22:34:05.335240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-10T22:34:05.335298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-10T22:34:05.335353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-10T22:34:05.335421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-10-10T22:34:05.335501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-10T22:34:05.335561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-10-10T22:34:05.335616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-10T22:34:05.335717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-10T22:34:05.335808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-10T22:34:05.335899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-10-10T22:34:05.335958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-10T22:34:05.336015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-10T22:34:05.336074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-10T22:34:05.336129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-10T22:34:05.336198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-10T22:34:05.336280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-10T22:34:05.336350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-10-10T22:34:05.336447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-10-10T22:34:05.336527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-10T22:34:05.336583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-10T22:34:05.336699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-10-10T22:34:05.336785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-10T22:34:05.336844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-10T22:34:05.336898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-10T22:34:05.336992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-10T22:34:05.337059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-10T22:34:05.337114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-10T22:34:05.337175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-10T22:34:05.337231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-10T22:34:05.337301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-10T22:34:05.337402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-10T22:34:05.337520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-10T22:34:05.337599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-10T22:34:05.337680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-10T22:34:05.337759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-10T22:34:05.337815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-10T22:34:05.337891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-10T22:34:05.337970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-10T22:34:05.338026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-10T22:34:05.338082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-10T22:34:05.338145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-10T22:34:05.338211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-10T22:34:05.338296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-10T22:34:05.338394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-10T22:34:05.338462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-10T22:34:05.338519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-10-10T22:34:05.338574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-10T22:34:05.338635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-10T22:34:05.338740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-10T22:34:05.338801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-10T22:34:05.338871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-10T22:34:05.338971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-10T22:34:05.339051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-10T22:34:05.339121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-10T22:34:05.339208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-10T22:34:05.339264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-10T22:34:05.339318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-10T22:34:05.339372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-10T22:34:05.339430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-10T22:34:05.339489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-10T22:34:05.339551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-10T22:34:05.339617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-10T22:34:05.339726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-10T22:34:05.339797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-10T22:34:05.339852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-10T22:34:05.339906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-10T22:34:05.339973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-10T22:34:05.340053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-10T22:34:05.340108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-10T22:34:05.340179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-10T22:34:05.340264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-10T22:34:05.340337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-10T22:34:05.340432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-10T22:34:05.340526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-10T22:34:05.340587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-10T22:34:05.340739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-10T22:34:05.340826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-10T22:34:05.340884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-10-10T22:34:05.340941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-10T22:34:05.341000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-10-10T22:34:05.341057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-10T22:34:05.341129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-10T22:34:05.341242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-10T22:34:05.341325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-10T22:34:05.341397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-10T22:34:05.341488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-10T22:34:05.341558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-10T22:34:05.341615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-10T22:34:05.341715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-10T22:34:05.341787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-10T22:34:05.341897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-10T22:34:05.341996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-10T22:34:05.342061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-10T22:34:05.342119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-10T22:34:05.342175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-10T22:34:05.342228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-10-10T22:34:05.342284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-10T22:34:05.342339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-10T22:34:05.342393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-10T22:34:05.342447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-10T22:34:05.342500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-10T22:34:05.342553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-10T22:34:05.342606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-10T22:34:05.342710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-10T22:34:05.342808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-10T22:34:05.342898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-10-10T22:34:05.342957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-10T22:34:05.343012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-10T22:34:05.343067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-10T22:34:05.343134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-10T22:34:05.343238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-10T22:34:05.343319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-10-10T22:34:05.343390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-10T22:34:05.343483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-10T22:34:05.343601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-10T22:34:05.343721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-10-10T22:34:05.343797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-10T22:34:05.343858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-10T22:34:05.343930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-10T22:34:05.344037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-10T22:34:05.344138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-10T22:34:05.344224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-10T22:34:05.344287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-10T22:34:05.344351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-10T22:34:05.344409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-10T22:34:05.344465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-10T22:34:05.344523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-10T22:34:05.344591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-10T22:34:05.344732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-10T22:34:05.344808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-10T22:34:05.344893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-10T22:34:05.344974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-10T22:34:05.345042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-10T22:34:05.345119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-10T22:34:05.345202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-10T22:34:05.345261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-10T22:34:05.345333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-10T22:34:05.345429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-10T22:34:05.345510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-10T22:34:05.345571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-10T22:34:05.345674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-10T22:34:05.345775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-10T22:34:05.345891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-10T22:34:05.345974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-10T22:34:05.346033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-10T22:34:05.346108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-10T22:34:05.346195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-10T22:34:05.346270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-10T22:34:05.346350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-10-10T22:34:05.346407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-10T22:34:05.346462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-10T22:34:05.346518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-10T22:34:05.346578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-10T22:34:05.346664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-10T22:34:05.346747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-10T22:34:05.346803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-10T22:34:05.346857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-10T22:34:05.346909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-10T22:34:05.347047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-10T22:34:05.347134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-10T22:34:05.347194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-10T22:34:05.347256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-10-10T22:34:05.347318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-10-10T22:34:05.347375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-10T22:34:05.347433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-10T22:34:05.347486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-10T22:34:05.347541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-10T22:34:05.347599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-10T22:34:05.347693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-10T22:34:05.347773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-10T22:34:05.347835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-10T22:34:05.347889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-10T22:34:05.347950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-10T22:34:05.348012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-10T22:34:05.348065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-10-10T22:34:05.348116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-10T22:34:05.348196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-10T22:34:05.348276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-10T22:34:05.348333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-10T22:34:05.348386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-10T22:34:05.348445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-10T22:34:05.348517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-10T22:34:05.348612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-10T22:34:05.348809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-10-10T22:34:05.348895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-10T22:34:05.349013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-10T22:34:05.349098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-10T22:34:05.349163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-10T22:34:05.349220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-10T22:34:05.349275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-10T22:34:05.349331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-10T22:34:05.349387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-10T22:34:05.349444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-10-10T22:34:05.349503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-10T22:34:05.349571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-10T22:34:05.349627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-10-10T22:34:05.349738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-10T22:34:05.349809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-10T22:34:05.349867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-10-10T22:34:05.349935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-10T22:34:05.350016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-10T22:34:05.350106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-10T22:34:05.350164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-10T22:34:05.350220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-10T22:34:05.350276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-10-10T22:34:05.350332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-10T22:34:05.350388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-10T22:34:05.350457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-10T22:34:05.350540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-10T22:34:05.350623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-10-10T22:34:05.350727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-10T22:34:05.350797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-10T22:34:05.350855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-10T22:34:05.350931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-10T22:34:05.351022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-10T22:34:05.351081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-10T22:34:05.351163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-10-10T22:34:05.351268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-10T22:34:05.351354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-10T22:34:05.351414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-10-10T22:34:05.351474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-10-10T22:34:05.351532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-10T22:34:05.351588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-10T22:34:05.351692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-10T22:34:05.351774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-10T22:34:05.351838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-10T22:34:05.351917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-10-10T22:34:05.351999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-10T22:34:05.352057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-10T22:34:05.352114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-10T22:34:05.352181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-10T22:34:05.352262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-10T22:34:05.352319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-10T22:34:05.352373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-10T22:34:05.352427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-10T22:34:05.352488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-10-10T22:34:05.352542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-10-10T22:34:05.352598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-10-10T22:34:05.352725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-10-10T22:34:05.352801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-10T22:34:05.352870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-10T22:34:05.352924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-10-10T22:34:05.353004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-10T22:34:05.353083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-10T22:34:05.353150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-10T22:34:05.353205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-10T22:34:05.353267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-10T22:34:05.353320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-10T22:34:05.353372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-10T22:34:05.353425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-10-10T22:34:05.353488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-10T22:34:05.353570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-10T22:34:05.353628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-10T22:34:05.353727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-10T22:34:05.353792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-10T22:34:05.353847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-10T22:34:05.353942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-10T22:34:05.354005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-10T22:34:05.354065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-10T22:34:05.354120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-10-10T22:34:05.354189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-10T22:34:05.354249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-10-10T22:34:05.354303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-10T22:34:05.354358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-10T22:34:05.354418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-10-10T22:34:05.354490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-10T22:34:05.354594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-10T22:34:05.354711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-10T22:34:05.354785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-10T22:34:05.354851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-10-10T22:34:05.354924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-10T22:34:05.355016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-10T22:34:05.355096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-10-10T22:34:05.355180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-10-10T22:34:05.355289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-10T22:34:05.355373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-10T22:34:05.355469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-10T22:34:05.355541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-10T22:34:05.355598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECCU.csv [2025-10-10T22:34:05.355682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-10T22:34:05.355763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-10T22:34:05.355821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-10T22:34:05.355874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-10T22:34:05.355938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-10T22:34:05.356007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-10T22:34:05.356133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-10T22:34:05.356216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-10T22:34:05.356275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-10T22:34:05.356332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-10T22:34:05.356387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-10T22:34:05.356447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-10T22:34:05.356517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-10T22:34:05.356572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-10T22:34:05.356627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-10T22:34:05.356758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-10T22:34:05.356824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-10T22:34:05.356899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-10-10T22:34:05.357005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-10T22:34:05.357072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-10T22:34:05.357129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-10T22:34:05.357183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-10T22:34:05.357238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-10T22:34:05.357308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-10T22:34:05.357391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-10T22:34:05.357448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-10-10T22:34:05.357502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-10T22:34:05.357559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-10T22:34:05.357627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-10T22:34:05.357732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-10T22:34:05.357801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-10T22:34:05.357859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-10T22:34:05.357924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-10T22:34:05.357980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-10T22:34:05.358033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-10T22:34:05.358095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-10T22:34:05.358167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-10T22:34:05.358258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-10T22:34:05.358340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-10T22:34:05.358435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-10T22:34:05.358492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-10T22:34:05.358563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-10T22:34:05.358670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-10-10T22:34:05.358752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-10T22:34:05.358809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-10T22:34:05.358865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-10T22:34:05.358938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-10-10T22:34:05.359041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-10T22:34:05.359155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-10T22:34:05.359221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-10T22:34:05.359280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-10-10T22:34:05.359339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-10T22:34:05.359395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-10T22:34:05.359451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-10T22:34:05.359506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-10T22:34:05.359560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-10T22:34:05.359616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-10T22:34:05.359720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-10T22:34:05.359794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-10T22:34:05.359853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-10T22:34:05.359919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-10T22:34:05.359976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-10T22:34:05.360030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-10T22:34:05.360101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-10-10T22:34:05.360179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-10T22:34:05.360238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-10T22:34:05.360293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-10-10T22:34:05.360355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-10T22:34:05.360434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-10T22:34:05.360516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-10T22:34:05.360578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-10T22:34:05.360636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-10T22:34:05.360739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-10T22:34:05.360807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-10-10T22:34:05.360879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-10T22:34:05.360958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-10T22:34:05.361016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-10T22:34:05.361073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-10T22:34:05.361133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-10T22:34:05.361188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-10T22:34:05.361263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-10-10T22:34:05.361344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-10T22:34:05.361400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-10T22:34:05.361455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-10T22:34:05.361510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-10T22:34:05.361564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-10T22:34:05.361620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-10T22:34:05.361712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-10T22:34:05.361784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-10T22:34:05.361842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-10T22:34:05.361896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-10T22:34:05.361950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-10-10T22:34:05.362013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-10T22:34:05.362088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-10-10T22:34:05.362166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-10T22:34:05.362225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-10-10T22:34:05.362284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-10T22:34:05.362342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-10T22:34:05.362393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-10T22:34:05.362445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-10-10T22:34:05.362510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-10-10T22:34:05.362564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-10T22:34:05.362630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-10T22:34:05.362743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-10T22:34:05.362806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-10T22:34:05.362860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-10T22:34:05.362915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-10T22:34:05.362968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-10T22:34:05.363019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-10T22:34:05.363076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-10T22:34:05.363132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-10T22:34:05.363189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-10T22:34:05.363258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-10T22:34:05.363311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-10-10T22:34:05.363364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-10T22:34:05.363416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-10T22:34:05.363473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-10T22:34:05.363529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-10T22:34:05.363617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-10T22:34:05.363759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-10T22:34:05.363833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-10-10T22:34:05.363890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-10T22:34:05.363947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-10T22:34:05.364037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-10T22:34:05.364136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-10T22:34:05.364199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-10T22:34:05.364257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-10T22:34:05.364313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-10-10T22:34:05.364380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-10T22:34:05.364437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-10T22:34:05.364501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-10T22:34:05.364558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-10T22:34:05.364614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-10-10T22:34:05.364783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-10T22:34:05.364858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-10-10T22:34:05.364933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-10T22:34:05.365014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-10T22:34:05.365074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-10T22:34:05.365130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-10T22:34:05.365186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-10T22:34:05.365242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-10T22:34:05.365306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-10T22:34:05.365366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-10-10T22:34:05.365422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-10T22:34:05.365487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-10T22:34:05.365545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-10T22:34:05.365611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-10T22:34:05.365697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-10-10T22:34:05.365775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-10T22:34:05.365836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-10T22:34:05.365926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-10T22:34:05.366025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-10-10T22:34:05.366110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-10T22:34:05.366173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-10T22:34:05.366229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-10T22:34:05.366287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-10T22:34:05.366344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-10T22:34:05.366402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-10T22:34:05.366478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-10-10T22:34:05.366559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-10-10T22:34:05.366617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-10T22:34:05.366715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-10T22:34:05.366788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-10T22:34:05.366843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-10-10T22:34:05.366897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-10T22:34:05.367008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-10T22:34:05.367074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-10T22:34:05.367132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-10T22:34:05.367186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-10T22:34:05.367256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-10T22:34:05.367311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-10T22:34:05.367363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-10-10T22:34:05.367416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-10T22:34:05.367469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-10T22:34:05.367522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-10T22:34:05.367589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-10T22:34:05.367712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-10T22:34:05.367793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-10T22:34:05.367850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-10T22:34:05.367925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-10T22:34:05.368006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-10T22:34:05.368066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-10T22:34:05.368121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-10T22:34:05.368175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-10T22:34:05.368232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-10T22:34:05.368286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-10T22:34:05.368354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-10T22:34:05.368448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-10T22:34:05.368532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-10T22:34:05.368588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-10T22:34:05.368717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-10T22:34:05.368790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-10T22:34:05.368855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-10T22:34:05.368911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-10T22:34:05.368966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-10T22:34:05.369021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-10T22:34:05.369093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-10T22:34:05.369176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-10T22:34:05.369234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-10T22:34:05.369293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-10T22:34:05.369348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-10T22:34:05.369401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-10T22:34:05.369459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-10T22:34:05.369514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-10T22:34:05.369568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-10T22:34:05.369626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-10T22:34:05.369729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-10T22:34:05.369793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-10T22:34:05.369849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-10T22:34:05.369918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-10T22:34:05.370003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-10T22:34:05.370065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-10-10T22:34:05.370122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-10-10T22:34:05.370175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-10T22:34:05.370230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-10T22:34:05.370284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-10T22:34:05.370342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-10T22:34:05.370400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-10T22:34:05.370488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-10T22:34:05.370569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-10T22:34:05.370626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-10T22:34:05.370729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-10T22:34:05.370802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-10T22:34:05.370858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-10T22:34:05.370912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-10T22:34:05.370964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-10T22:34:05.371030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-10T22:34:05.371114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-10T22:34:05.371198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-10T22:34:05.371256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-10-10T22:34:05.371313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-10T22:34:05.371369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-10T22:34:05.371426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-10T22:34:05.371483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-10T22:34:05.371552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-10T22:34:05.371610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-10T22:34:05.371721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-10-10T22:34:05.371801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-10T22:34:05.371858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-10T22:34:05.371924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-10T22:34:05.371990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-10T22:34:05.372069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-10T22:34:05.372156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-10-10T22:34:05.372215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-10T22:34:05.372270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-10-10T22:34:05.372324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-10T22:34:05.372380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-10T22:34:05.372435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-10T22:34:05.372488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-10T22:34:05.372541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-10-10T22:34:05.372595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-10-10T22:34:05.372766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-10T22:34:05.372850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-10T22:34:05.372911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-10T22:34:05.372967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-10T22:34:05.373021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-10T22:34:05.373078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-10T22:34:05.373134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-10T22:34:05.373205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-10T22:34:05.373283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-10T22:34:05.373338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-10T22:34:05.373447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-10T22:34:05.373515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-10T22:34:05.373574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-10T22:34:05.373634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-10-10T22:34:05.373747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-10T22:34:05.373811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-10T22:34:05.373878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-10T22:34:05.373933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-10T22:34:05.373989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-10T22:34:05.374048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-10T22:34:05.374168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-10T22:34:05.374305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-10T22:34:05.374457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-10T22:34:05.374580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-10T22:34:05.374740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-10T22:34:05.374873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-10T22:34:05.374996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-10T22:34:05.375117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-10-10T22:34:05.375237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-10T22:34:05.375366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-10T22:34:05.375531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-10T22:34:05.375695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-10-10T22:34:05.375818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-10T22:34:05.375940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-10T22:34:05.376069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-10T22:34:05.376191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-10T22:34:05.376320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-10T22:34:05.376438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-10T22:34:05.376558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-10T22:34:05.376814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-10T22:34:05.376962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-10-10T22:34:05.377087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-10T22:34:05.377216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-10T22:34:05.377351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-10T22:34:05.377470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-10T22:34:05.377596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-10T22:34:05.377757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-10T22:34:05.377874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-10T22:34:05.377991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-10T22:34:05.378130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-10T22:34:05.378262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-10-10T22:34:05.378384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-10-10T22:34:05.378510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-10T22:34:05.378628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-10T22:34:05.378776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-10T22:34:05.378902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-10T22:34:05.379022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-10T22:34:05.379145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-10T22:34:05.379272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-10-10T22:34:05.379395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-10T22:34:05.379509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-10T22:34:05.379623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-10T22:34:05.379781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-10-10T22:34:05.379917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-10T22:34:05.380047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-10T22:34:05.380163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-10T22:34:05.380285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-10T22:34:05.380402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-10T22:34:05.380516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-10T22:34:05.380630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-10T22:34:05.380768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-10T22:34:05.380895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-10-10T22:34:05.380974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-10T22:34:05.381037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-10T22:34:05.381096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-10T22:34:05.381151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-10T22:34:05.381223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-10T22:34:05.381303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-10T22:34:05.381363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-10-10T22:34:05.381417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-10T22:34:05.381470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-10T22:34:05.381570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-10T22:34:05.381639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-10T22:34:05.381747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-10T22:34:05.381819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-10T22:34:05.381880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-10T22:34:05.381937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-10T22:34:05.381991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-10T22:34:05.382049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-10-10T22:34:05.382108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-10T22:34:05.382171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-10T22:34:05.382240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-10T22:34:05.382296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-10T22:34:05.382374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-10-10T22:34:05.382455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-10T22:34:05.382515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-10T22:34:05.382572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-10T22:34:05.382627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-10T22:34:05.382728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-10T22:34:05.382795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-10T22:34:05.382857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-10T22:34:05.382914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-10T22:34:05.382969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-10T22:34:05.383024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-10T22:34:05.383078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-10T22:34:05.383133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-10T22:34:05.383189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-10T22:34:05.383243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-10T22:34:05.383297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-10-10T22:34:05.383354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-10T22:34:05.383416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-10T22:34:05.383470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-10T22:34:05.383524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-10T22:34:05.383582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-10T22:34:05.383637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-10T22:34:05.383753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-10T22:34:05.383838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-10T22:34:05.383958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-10T22:34:05.384082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-10T22:34:05.384201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-10T22:34:05.384323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-10T22:34:05.384444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-10T22:34:05.384563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-10T22:34:05.384822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-10T22:34:05.384942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-10T22:34:05.385063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-10T22:34:05.385185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-10T22:34:05.385303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-10T22:34:05.385436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-10T22:34:05.385554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-10T22:34:05.385697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-10T22:34:05.385812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-10T22:34:05.385929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-10T22:34:05.386057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-10T22:34:05.386177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-10T22:34:05.386295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-10T22:34:05.386421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-10T22:34:05.386539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-10T22:34:05.386686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-10T22:34:05.386804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-10T22:34:05.386952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-10-10T22:34:05.387073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-10-10T22:34:05.387191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-10T22:34:05.387355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-10T22:34:05.387476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-10T22:34:05.387598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-10T22:34:05.387751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-10T22:34:05.387869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-10T22:34:05.387987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-10T22:34:05.388104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-10-10T22:34:05.388223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-10T22:34:05.388347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-10T22:34:05.388509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-10T22:34:05.388674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-10-10T22:34:05.388795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-10T22:34:05.388922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-10T22:34:05.389041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-10T22:34:05.389164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-10T22:34:05.389291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-10T22:34:05.389411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-10T22:34:05.389546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-10T22:34:05.389690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-10T22:34:05.389812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-10T22:34:05.389932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-10T22:34:05.390057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-10T22:34:05.390178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-10T22:34:05.390305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-10T22:34:05.390425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-10T22:34:05.390546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-10T22:34:05.390693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-10-10T22:34:05.390825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-10-10T22:34:05.390947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-10T22:34:05.391075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-10T22:34:05.391197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-10T22:34:05.391314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-10T22:34:05.391441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-10T22:34:05.391556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-10-10T22:34:05.391715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-10T22:34:05.391848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-10T22:34:05.391965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-10-10T22:34:05.392099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-10T22:34:05.392214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-10-10T22:34:05.392341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-10T22:34:05.392459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-10T22:34:05.392575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-10T22:34:05.393537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-10T22:34:05.393682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-10T22:34:05.393831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-10T22:34:05.393954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-10-10T22:34:05.394073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-10T22:34:05.394192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-10T22:34:05.394318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-10T22:34:05.394440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-10T22:34:05.394570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-10-10T22:34:05.394710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-10-10T22:34:05.394830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-10T22:34:05.394948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-10T22:34:05.395070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-10T22:34:05.395209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-10T22:34:05.395343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-10T22:34:05.395466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-10T22:34:05.395605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-10T22:34:05.395759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-10T22:34:05.395879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-10T22:34:05.396007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-10-10T22:34:05.396151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-10T22:34:05.396275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-10T22:34:05.396393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-10T22:34:05.396508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-10T22:34:05.396627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-10-10T22:34:05.396784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-10T22:34:05.396901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-10-10T22:34:05.397039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-10T22:34:05.397160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-10T22:34:05.397283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-10T22:34:05.397416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-10T22:34:05.397553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-10T22:34:05.397692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-10T22:34:05.397812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-10T22:34:05.397945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-10T22:34:05.398078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-10T22:34:05.398199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-10T22:34:05.398320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-10T22:34:05.398487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-10T22:34:05.398612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-10T22:34:05.398760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-10T22:34:05.398892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-10T22:34:05.399014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-10T22:34:05.399134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-10T22:34:05.399262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-10T22:34:05.399425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-10T22:34:05.399552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-10T22:34:05.399698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-10T22:34:05.399820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-10T22:34:05.399943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-10-10T22:34:05.400066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-10T22:34:05.400195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-10-10T22:34:05.400329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-10T22:34:05.400466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-10T22:34:05.400590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-10T22:34:05.400820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-10T22:34:05.400949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-10-10T22:34:05.401067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-10T22:34:05.401197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-10T22:34:05.401329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-10T22:34:05.401450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-10T22:34:05.401569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-10T22:34:05.401731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-10T22:34:05.401851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-10T22:34:05.401973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-10T22:34:05.402090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-10-10T22:34:05.402204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-10T22:34:05.402331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-10T22:34:05.402463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-10T22:34:05.402579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-10T22:34:05.402721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-10T22:34:05.402847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-10T22:34:05.402967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-10T22:34:05.403107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-10T22:34:05.403228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-10T22:34:05.403345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-10T22:34:05.403465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-10T22:34:05.403592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-10T22:34:05.403745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-10T22:34:05.403864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-10T22:34:05.403986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-10T22:34:05.404070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-10-10T22:34:05.404127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-10T22:34:05.404181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-10T22:34:05.404234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-10-10T22:34:05.404288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-10T22:34:05.404344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-10-10T22:34:05.404413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-10T22:34:05.404491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-10T22:34:05.404580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-10T22:34:05.404685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-10T22:34:05.404764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-10T22:34:05.404820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-10T22:34:05.404883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-10T22:34:05.404944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-10T22:34:05.404996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-10T22:34:05.405081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-10T22:34:05.405151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-10T22:34:05.405206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-10T22:34:05.405259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-10T22:34:05.405312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-10T22:34:05.405375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-10T22:34:05.405429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-10T22:34:05.405481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-10T22:34:05.405538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-10T22:34:05.405590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-10T22:34:05.405663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-10T22:34:05.405745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-10-10T22:34:05.405801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-10T22:34:05.405907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-10T22:34:05.406004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-10T22:34:05.406070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-10T22:34:05.406137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-10T22:34:05.406205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-10T22:34:05.406262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-10T22:34:05.406320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-10-10T22:34:05.406381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-10T22:34:05.406439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-10-10T22:34:05.406495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-10T22:34:05.406561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-10T22:34:05.406625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-10T22:34:05.406728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-10T22:34:05.406800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-10T22:34:05.406859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-10-10T22:34:05.406943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-10T22:34:05.407194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-10T22:34:05.407332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-10T22:34:05.407445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-10T22:34:05.407555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-10T22:34:05.407722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-10T22:34:05.407917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-10-10T22:34:05.408082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-10T22:34:05.408198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-10T22:34:05.408296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-10T22:34:05.408366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-10T22:34:05.408428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-10-10T22:34:05.408487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-10T22:34:05.408543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-10T22:34:05.408601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-10T22:34:05.408739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-10T22:34:05.408825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-10T22:34:05.408882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-10T22:34:05.408935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-10T22:34:05.408989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-10T22:34:05.409043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-10-10T22:34:05.409095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-10T22:34:05.409148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-10-10T22:34:05.409200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-10T22:34:05.409252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-10T22:34:05.409310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-10T22:34:05.409363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-10T22:34:05.409430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-10T22:34:05.409484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-10T22:34:05.409537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-10T22:34:05.409587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-10T22:34:05.409638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-10T22:34:05.409742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-10T22:34:05.409799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-10T22:34:05.409853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-10T22:34:05.409912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-10T22:34:05.409967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-10T22:34:05.410020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-10T22:34:05.410072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-10T22:34:05.410125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-10T22:34:05.410181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-10T22:34:05.410234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-10T22:34:05.410285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-10T22:34:05.410346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-10T22:34:05.410440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-10T22:34:05.410523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-10T22:34:05.410578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-10-10T22:34:05.410632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-10T22:34:05.410750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-10T22:34:05.410826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-10T22:34:05.410884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-10T22:34:05.410936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-10T22:34:05.410988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-10T22:34:05.411040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-10T22:34:05.411095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-10T22:34:05.411147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-10T22:34:05.411242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-10T22:34:05.411305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-10T22:34:05.411359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-10-10T22:34:05.411413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-10T22:34:05.411488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-10-10T22:34:05.411579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-10-10T22:34:05.411667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-10T22:34:05.411751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-10T22:34:05.411824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-10-10T22:34:05.411879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-10T22:34:05.411934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-10T22:34:05.411986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-10T22:34:05.412040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-10T22:34:05.412102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-10T22:34:05.412154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-10T22:34:05.412215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-10T22:34:05.412269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-10T22:34:05.412321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-10T22:34:05.412379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-10T22:34:05.412438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-10-10T22:34:05.412503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-10T22:34:05.412555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-10T22:34:05.412607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-10T22:34:05.412689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-10T22:34:05.412773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-10T22:34:05.412829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-10T22:34:05.412882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-10-10T22:34:05.412962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-10T22:34:05.413045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-10T22:34:05.413102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-10T22:34:05.413163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-10T22:34:05.413227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-10T22:34:05.413287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-10T22:34:05.413342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-10T22:34:05.413396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-10-10T22:34:05.413450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-10T22:34:05.413509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-10-10T22:34:05.413564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-10-10T22:34:05.413621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-10-10T22:34:05.413726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-10T22:34:05.413799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-10T22:34:05.413866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-10T22:34:05.413953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-10T22:34:05.414011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-10T22:34:05.414069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-10T22:34:05.414125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-10T22:34:05.414178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-10T22:34:05.414247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-10T22:34:05.414326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-10T22:34:05.414381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-10T22:34:05.414439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-10T22:34:05.414496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-10T22:34:05.414551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-10T22:34:05.414603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-10-10T22:34:05.414689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-10-10T22:34:05.414768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-10T22:34:05.414825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-10T22:34:05.414877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-10-10T22:34:05.414929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-10T22:34:05.415026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-10T22:34:05.415106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-10T22:34:05.415165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-10T22:34:05.415219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-10T22:34:05.415270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-10T22:34:05.415327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-10T22:34:05.415382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-10T22:34:05.415438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-10T22:34:05.415490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-10T22:34:05.415564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-10T22:34:05.415698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-10T22:34:05.415786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-10T22:34:05.415887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-10-10T22:34:05.415952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-10T22:34:05.416008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-10-10T22:34:05.416063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-10T22:34:05.416118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-10T22:34:05.416177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-10T22:34:05.416249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-10T22:34:05.416333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-10T22:34:05.416434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-10T22:34:05.416503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-10T22:34:05.416558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-10T22:34:05.416614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-10T22:34:05.416752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-10T22:34:05.416825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-10T22:34:05.416883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-10T22:34:05.416977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-10T22:34:05.417051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-10T22:34:05.417117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-10T22:34:05.417172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-10-10T22:34:05.417233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-10T22:34:05.417299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-10T22:34:05.417354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-10T22:34:05.417408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-10T22:34:05.417461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-10T22:34:05.417532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-10T22:34:05.417590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-10T22:34:05.417676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-10T22:34:05.417758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-10-10T22:34:05.417825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-10T22:34:05.417890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-10T22:34:05.417943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-10T22:34:05.418005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-10T22:34:05.418059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-10T22:34:05.418113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-10T22:34:05.418165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-10T22:34:05.418218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-10T22:34:05.418280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-10T22:34:05.418337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-10T22:34:05.418391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-10T22:34:05.418455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-10T22:34:05.418510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-10T22:34:05.418568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-10T22:34:05.418625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-10-10T22:34:05.418742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-10-10T22:34:05.418821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-10T22:34:05.418876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-10T22:34:05.418928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-10T22:34:05.418988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-10T22:34:05.419040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-10T22:34:05.419096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-10T22:34:05.419181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-10-10T22:34:05.419260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-10T22:34:05.419323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-10T22:34:05.419375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-10-10T22:34:05.419426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-10T22:34:05.419481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-10-10T22:34:05.419533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-10-10T22:34:05.419591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-10T22:34:05.419685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-10-10T22:34:05.419792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-10T22:34:05.419884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-10T22:34:05.419943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-10T22:34:05.419998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-10T22:34:05.420050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-10-10T22:34:05.420107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-10T22:34:05.420169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-10T22:34:05.420225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-10T22:34:05.420281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-10T22:34:05.420356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-10T22:34:05.420439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-10-10T22:34:05.420497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-10T22:34:05.420597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-10T22:34:05.420691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-10T22:34:05.420777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-10T22:34:05.420843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-10T22:34:05.420917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-10T22:34:05.421005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-10T22:34:05.421066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-10T22:34:05.421126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-10-10T22:34:05.421181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-10T22:34:05.421237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-10T22:34:05.421292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-10T22:34:05.421348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-10T22:34:05.421403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-10T22:34:05.421459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-10T22:34:05.421514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-10T22:34:05.421571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-10-10T22:34:05.421629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-10T22:34:05.421728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-10T22:34:05.421799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-10T22:34:05.421857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-10T22:34:05.421919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-10T22:34:05.421977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-10T22:34:05.422038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-10T22:34:05.422096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-10T22:34:05.422154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-10T22:34:05.422221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-10T22:34:05.422280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-10T22:34:05.422335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-10-10T22:34:05.422390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-10T22:34:05.422452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-10T22:34:05.422524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-10-10T22:34:05.422610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-10T22:34:05.422717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-10T22:34:05.422792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-10T22:34:05.422857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-10T22:34:05.422913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-10T22:34:05.422968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-10T22:34:05.423060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-10T22:34:05.423141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-10-10T22:34:05.423199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-10T22:34:05.423255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-10-10T22:34:05.423345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-10T22:34:05.423417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-10T22:34:05.423473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-10T22:34:05.423530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-10T22:34:05.423588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-10T22:34:05.423682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-10T22:34:05.423762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-10T22:34:05.423827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-10T22:34:05.423881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-10-10T22:34:05.423937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-10-10T22:34:05.423991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-10T22:34:05.424042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-10-10T22:34:05.424098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-10T22:34:05.424151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-10T22:34:05.424207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-10T22:34:05.424268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-10T22:34:05.424327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-10-10T22:34:05.424388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-10T22:34:05.424440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-10T22:34:05.424495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-10-10T22:34:05.424562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-10-10T22:34:05.424616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-10T22:34:05.424786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-10T22:34:05.424861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-10-10T22:34:05.424917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-10T22:34:05.424971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-10T22:34:05.425023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-10-10T22:34:05.425093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-10-10T22:34:05.425175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-10T22:34:05.425230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-10T22:34:05.425338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-10T22:34:05.425411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-10T22:34:05.425467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-10-10T22:34:05.425521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-10T22:34:05.425580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-10T22:34:05.425681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-10T22:34:05.425765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-10T22:34:05.425831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-10T22:34:05.425887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-10T22:34:05.425948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-10T22:34:05.426008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-10T22:34:05.426063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-10T22:34:05.426117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-10T22:34:05.426170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-10T22:34:05.426222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-10T22:34:05.426279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-10T22:34:05.426335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-10T22:34:05.426395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-10T22:34:05.426449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-10T22:34:05.426506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-10-10T22:34:05.426561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-10T22:34:05.426617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-10T22:34:05.426706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-10-10T22:34:05.426779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-10T22:34:05.426836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-10-10T22:34:05.426892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-10T22:34:05.426983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-10T22:34:05.427055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-10T22:34:05.427111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-10T22:34:05.427167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-10T22:34:05.427230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-10T22:34:05.427285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-10T22:34:05.427342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-10-10T22:34:05.427394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-10-10T22:34:05.427446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-10-10T22:34:05.427497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-10T22:34:05.427550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-10T22:34:05.427606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-10-10T22:34:05.427700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-10T22:34:05.427794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-10T22:34:05.427868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-10T22:34:05.427925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-10T22:34:05.427991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-10T22:34:05.428045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-10T22:34:05.428099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-10T22:34:05.428152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-10T22:34:05.428204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-10T22:34:05.428264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-10T22:34:05.428318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-10T22:34:05.428372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-10T22:34:05.428425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-10T22:34:05.428479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-10T22:34:05.428542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-10T22:34:05.428595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-10T22:34:05.428681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-10-10T22:34:05.428771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-10T22:34:05.428837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-10T22:34:05.428891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-10T22:34:05.428943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-10T22:34:05.428995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-10T22:34:05.429048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-10T22:34:05.429110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-10T22:34:05.429163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-10T22:34:05.429217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-10T22:34:05.429271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-10T22:34:05.429323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-10T22:34:05.429385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-10T22:34:05.429441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-10T22:34:05.429503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-10T22:34:05.429556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-10T22:34:05.429608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-10T22:34:05.429743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-10T22:34:05.429828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-10T22:34:05.429884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-10T22:34:05.429937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-10T22:34:05.429992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-10T22:34:05.430044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-10T22:34:05.430100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-10T22:34:05.430152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-10T22:34:05.430208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-10-10T22:34:05.430269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-10T22:34:05.430321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-10T22:34:05.430382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-10T22:34:05.430438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-10T22:34:05.430490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-10T22:34:05.430549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-10T22:34:05.430617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-10T22:34:05.430708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-10T22:34:05.430777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-10T22:34:05.430833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-10-10T22:34:05.430886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-10T22:34:05.430937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-10T22:34:05.430989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-10T22:34:05.431049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-10T22:34:05.431101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-10T22:34:05.431171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-10-10T22:34:05.431248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-10T22:34:05.431305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-10T22:34:05.431362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-10-10T22:34:05.431417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-10T22:34:05.431470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-10T22:34:05.431523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-10T22:34:05.431576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-10-10T22:34:05.431630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-10T22:34:05.431734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-10T22:34:05.431798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-10T22:34:05.431854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-10T22:34:05.431921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-10T22:34:05.432004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-10T22:34:05.432059] [INFO ] [LOCAL ] Deleted 1603 derivative data files. [2025-10-10T22:34:05.432093] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-10T22:34:05.434084] [INFO ] [LOCAL ] Found 1823 symbols with primary data. [2025-10-10T22:34:05.434609] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 1823 symbols [2025-10-10T22:34:05.438315] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:05.438797] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:05.440260] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:05.536444] [DEBUG] [LOCAL ] AA: Loaded 54400 existing records from primary storage. [2025-10-10T22:34:05.550279] [INFO ] [MAIN ] AA: Loaded 54400 primary data records. [2025-10-10T22:34:05.535073] [DEBUG] [LOCAL ] AAP: Loaded 52653 existing records from primary storage. [2025-10-10T22:34:05.555818] [INFO ] [MAIN ] AAP: Loaded 52653 primary data records. [2025-10-10T22:34:05.587533] [DEBUG] [LOCAL ] A: Loaded 51489 existing records from primary storage. [2025-10-10T22:34:05.621800] [INFO ] [MAIN ] A: Loaded 51489 primary data records. [2025-10-10T22:34:06.642855] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:06.643599] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:06.656862] [INFO ] [MAIN ] AA: Generated 1820 derivative records from 54400 primary records. [2025-10-10T22:34:06.657759] [INFO ] [MAIN ] A: Generated 1820 derivative records from 51489 primary records. [2025-10-10T22:34:06.658199] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-10T22:34:06.658027] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-10T22:34:06.658445] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:06.661306] [INFO ] [MAIN ] AAP: Generated 1820 derivative records from 52653 primary records. [2025-10-10T22:34:06.668613] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-10T22:34:06.689013] [DEBUG] [LOCAL ] AA: Derivative data saved (1820 records). [2025-10-10T22:34:06.689532] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-10T22:34:06.698915] [INFO ] [MAIN ] Derivative Progress: 1/1823 symbols completed. AA took 1.3s. Estimated remaining: 38m 24s. Rate: 47.4 symbols/min [2025-10-10T22:34:06.702889] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:06.709132] [DEBUG] [LOCAL ] A: Derivative data saved (1820 records). [2025-10-10T22:34:06.712364] [DEBUG] [LOCAL ] AAP: Derivative data saved (1820 records). [2025-10-10T22:34:06.712466] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-10T22:34:06.712533] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-10T22:34:06.715060] [INFO ] [MAIN ] Derivative Progress: 2/1823 symbols completed. A took 1.3s. Estimated remaining: 19m 26s. Rate: 93.7 symbols/min [2025-10-10T22:34:06.717099] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:06.717154] [INFO ] [MAIN ] Derivative Progress: 3/1823 symbols completed. AAP took 1.3s. Estimated remaining: 12m 58s. Rate: 140.3 symbols/min [2025-10-10T22:34:06.717445] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:06.744960] [DEBUG] [LOCAL ] AAT: Loaded 30722 existing records from primary storage. [2025-10-10T22:34:06.747614] [INFO ] [MAIN ] AAT: Loaded 30722 primary data records. [2025-10-10T22:34:06.895279] [DEBUG] [LOCAL ] ABCB: Loaded 30965 existing records from primary storage. [2025-10-10T22:34:06.933692] [INFO ] [MAIN ] ABCB: Loaded 30965 primary data records. [2025-10-10T22:34:07.218120] [DEBUG] [LOCAL ] ABBV: Loaded 54466 existing records from primary storage. [2025-10-10T22:34:07.218926] [INFO ] [MAIN ] ABBV: Loaded 54466 primary data records. [2025-10-10T22:34:07.757597] [DEBUG] [MAIN ] AAT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:34:07.759061] [INFO ] [MAIN ] AAT: Generated 1819 derivative records from 30722 primary records. [2025-10-10T22:34:07.759494] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-10T22:34:07.796981] [DEBUG] [LOCAL ] AAT: Derivative data saved (1819 records). [2025-10-10T22:34:07.797881] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-10T22:34:07.799819] [INFO ] [MAIN ] Derivative Progress: 4/1823 symbols completed. AAT took 1.1s. Estimated remaining: 17m 56s. Rate: 101.5 symbols/min [2025-10-10T22:34:07.800349] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:07.801269] [INFO ] [MAIN ] ABCB: Generated 1820 derivative records from 30965 primary records. [2025-10-10T22:34:07.801670] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:07.801787] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-10T22:34:07.822971] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1820 records). [2025-10-10T22:34:07.823262] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-10T22:34:07.825070] [INFO ] [MAIN ] Derivative Progress: 5/1823 symbols completed. ABCB took 1.1s. Estimated remaining: 14m 29s. Rate: 125.5 symbols/min [2025-10-10T22:34:07.825344] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:07.839109] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:07.839990] [INFO ] [MAIN ] ABBV: Generated 1820 derivative records from 54466 primary records. [2025-10-10T22:34:07.840191] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-10-10T22:34:07.882844] [DEBUG] [LOCAL ] ABG: Loaded 18707 existing records from primary storage. [2025-10-10T22:34:07.882439] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1820 records). [2025-10-10T22:34:07.883145] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-10-10T22:34:07.887171] [INFO ] [MAIN ] ABG: Loaded 18707 primary data records. [2025-10-10T22:34:07.887044] [INFO ] [MAIN ] Derivative Progress: 6/1823 symbols completed. ABBV took 1.2s. Estimated remaining: 12m 23s. Rate: 146.8 symbols/min [2025-10-10T22:34:07.899536] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:08.005424] [DEBUG] [LOCAL ] ABEV: Loaded 54056 existing records from primary storage. [2025-10-10T22:34:08.009321] [INFO ] [MAIN ] ABEV: Loaded 54056 primary data records. [2025-10-10T22:34:08.385521] [DEBUG] [LOCAL ] ABM: Loaded 32404 existing records from primary storage. [2025-10-10T22:34:08.412459] [INFO ] [MAIN ] ABM: Loaded 32404 primary data records. [2025-10-10T22:34:08.911938] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:08.913496] [INFO ] [MAIN ] ABG: Generated 1820 derivative records from 18707 primary records. [2025-10-10T22:34:08.913620] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-10T22:34:08.936868] [DEBUG] [LOCAL ] ABG: Derivative data saved (1820 records). [2025-10-10T22:34:08.956255] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-10T22:34:08.959421] [INFO ] [MAIN ] Derivative Progress: 7/1823 symbols completed. ABG took 1.1s. Estimated remaining: 15m 15s. Rate: 119.1 symbols/min [2025-10-10T22:34:08.959773] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:08.961285] [INFO ] [MAIN ] ABEV: Generated 1820 derivative records from 54056 primary records. [2025-10-10T22:34:08.961621] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:08.961512] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-10T22:34:08.984611] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1820 records). [2025-10-10T22:34:08.986177] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-10T22:34:08.988213] [INFO ] [MAIN ] Derivative Progress: 8/1823 symbols completed. ABEV took 1.2s. Estimated remaining: 13m 26s. Rate: 135.1 symbols/min [2025-10-10T22:34:08.989548] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:09.004160] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:09.005027] [INFO ] [MAIN ] ABM: Generated 1820 derivative records from 32404 primary records. [2025-10-10T22:34:09.005157] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-10-10T22:34:09.022563] [DEBUG] [LOCAL ] ABM: Derivative data saved (1820 records). [2025-10-10T22:34:09.022771] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-10-10T22:34:09.025477] [INFO ] [MAIN ] Derivative Progress: 9/1823 symbols completed. ABM took 1.1s. Estimated remaining: 12m 4s. Rate: 150.4 symbols/min [2025-10-10T22:34:09.025967] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:09.070532] [DEBUG] [LOCAL ] ACCO: Loaded 37612 existing records from primary storage. [2025-10-10T22:34:09.089015] [INFO ] [MAIN ] ACCO: Loaded 37612 primary data records. [2025-10-10T22:34:09.089997] [DEBUG] [LOCAL ] ABR: Loaded 52712 existing records from primary storage. [2025-10-10T22:34:09.090107] [INFO ] [MAIN ] ABR: Loaded 52712 primary data records. [2025-10-10T22:34:09.270776] [DEBUG] [LOCAL ] ACEL: Loaded 27037 existing records from primary storage. [2025-10-10T22:34:09.311128] [INFO ] [MAIN ] ACEL: Loaded 27037 primary data records. [2025-10-10T22:34:10.031215] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:10.032360] [INFO ] [MAIN ] ACCO: Generated 1820 derivative records from 37612 primary records. [2025-10-10T22:34:10.032579] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-10-10T22:34:10.054522] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1820 records). [2025-10-10T22:34:10.067680] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-10-10T22:34:10.070281] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:10.069906] [INFO ] [MAIN ] Derivative Progress: 10/1823 symbols completed. ACCO took 1.1s. Estimated remaining: 14m 0s. Rate: 129.4 symbols/min [2025-10-10T22:34:10.071193] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:10.072552] [INFO ] [MAIN ] ABR: Generated 1820 derivative records from 52712 primary records. [2025-10-10T22:34:10.072844] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-10T22:34:10.093331] [DEBUG] [LOCAL ] ABR: Derivative data saved (1820 records). [2025-10-10T22:34:10.094745] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-10T22:34:10.097009] [INFO ] [MAIN ] Derivative Progress: 11/1823 symbols completed. ABR took 1.1s. Estimated remaining: 12m 48s. Rate: 141.5 symbols/min [2025-10-10T22:34:10.097546] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:10.111252] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:10.112172] [INFO ] [MAIN ] ACEL: Generated 1820 derivative records from 27037 primary records. [2025-10-10T22:34:10.112324] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-10T22:34:10.129172] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1820 records). [2025-10-10T22:34:10.144022] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-10-10T22:34:10.146831] [INFO ] [MAIN ] Derivative Progress: 12/1823 symbols completed. ACEL took 1.1s. Estimated remaining: 11m 51s. Rate: 152.8 symbols/min [2025-10-10T22:34:10.147334] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:10.182639] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-10-10T22:34:10.182891] [INFO ] [MAIN ] ACHR: Loaded 54598 primary data records. [2025-10-10T22:34:10.313594] [DEBUG] [LOCAL ] ACI: Loaded 54033 existing records from primary storage. [2025-10-10T22:34:10.340049] [INFO ] [MAIN ] ACI: Loaded 54033 primary data records. [2025-10-10T22:34:10.642476] [DEBUG] [LOCAL ] ACM: Loaded 43640 existing records from primary storage. [2025-10-10T22:34:10.654349] [INFO ] [MAIN ] ACM: Loaded 43640 primary data records. [2025-10-10T22:34:11.243013] [DEBUG] [MAIN ] ACHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:11.244743] [INFO ] [MAIN ] ACHR: Generated 1820 derivative records from 54598 primary records. [2025-10-10T22:34:11.246435] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-10T22:34:11.270286] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1820 records). [2025-10-10T22:34:11.270826] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-10T22:34:11.273108] [INFO ] [MAIN ] Derivative Progress: 13/1823 symbols completed. ACHR took 1.2s. Estimated remaining: 13m 33s. Rate: 133.6 symbols/min [2025-10-10T22:34:11.288089] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:11.289055] [INFO ] [MAIN ] ACI: Generated 1820 derivative records from 54033 primary records. [2025-10-10T22:34:11.289137] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-10T22:34:11.307841] [DEBUG] [LOCAL ] ACI: Derivative data saved (1820 records). [2025-10-10T22:34:11.308205] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-10T22:34:11.311423] [INFO ] [MAIN ] Derivative Progress: 14/1823 symbols completed. ACI took 1.2s. Estimated remaining: 12m 39s. Rate: 142.9 symbols/min [2025-10-10T22:34:11.327547] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:11.328196] [INFO ] [MAIN ] ACM: Generated 1820 derivative records from 43640 primary records. [2025-10-10T22:34:11.328259] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-10-10T22:34:11.344808] [DEBUG] [LOCAL ] ACM: Derivative data saved (1820 records). [2025-10-10T22:34:11.344875] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-10-10T22:34:11.348412] [INFO ] [MAIN ] Derivative Progress: 15/1823 symbols completed. ACM took 1.2s. Estimated remaining: 11m 53s. Rate: 152.2 symbols/min [2025-10-10T22:34:11.349181] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:11.349089] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:11.349859] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:11.359990] [DEBUG] [LOCAL ] ACR: Loaded 5659 existing records from primary storage. [2025-10-10T22:34:11.360315] [INFO ] [MAIN ] ACR: Loaded 5659 primary data records. [2025-10-10T22:34:11.694590] [DEBUG] [LOCAL ] ACP: Loaded 31455 existing records from primary storage. [2025-10-10T22:34:11.694889] [INFO ] [MAIN ] ACP: Loaded 31455 primary data records. [2025-10-10T22:34:11.851215] [DEBUG] [LOCAL ] ACN: Loaded 54208 existing records from primary storage. [2025-10-10T22:34:11.867561] [INFO ] [MAIN ] ACN: Loaded 54208 primary data records. [2025-10-10T22:34:12.254099] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:12.375627] [INFO ] [MAIN ] ACR: Generated 1820 derivative records from 5659 primary records. [2025-10-10T22:34:12.376527] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-10T22:34:12.397396] [DEBUG] [LOCAL ] ACR: Derivative data saved (1820 records). [2025-10-10T22:34:12.398867] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-10T22:34:12.401593] [INFO ] [MAIN ] Derivative Progress: 16/1823 symbols completed. ACR took 1.1s. Estimated remaining: 13m 7s. Rate: 137.8 symbols/min [2025-10-10T22:34:12.404852] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:12.421392] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:12.422384] [INFO ] [MAIN ] ACP: Generated 1820 derivative records from 31455 primary records. [2025-10-10T22:34:12.422600] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-10-10T22:34:12.439800] [DEBUG] [LOCAL ] ACP: Derivative data saved (1820 records). [2025-10-10T22:34:12.440055] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-10-10T22:34:12.442966] [INFO ] [MAIN ] Derivative Progress: 17/1823 symbols completed. ACP took 1.1s. Estimated remaining: 12m 25s. Rate: 145.5 symbols/min [2025-10-10T22:34:12.444169] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:12.477247] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:12.478447] [INFO ] [MAIN ] ACN: Generated 1820 derivative records from 54208 primary records. [2025-10-10T22:34:12.478688] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-10-10T22:34:12.495834] [DEBUG] [LOCAL ] ACV: Loaded 7819 existing records from primary storage. [2025-10-10T22:34:12.511267] [INFO ] [MAIN ] ACV: Loaded 7819 primary data records. [2025-10-10T22:34:12.540028] [DEBUG] [LOCAL ] ACN: Derivative data saved (1820 records). [2025-10-10T22:34:12.529687] [DEBUG] [LOCAL ] ACRE: Loaded 34101 existing records from primary storage. [2025-10-10T22:34:12.555397] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-10-10T22:34:12.558445] [INFO ] [MAIN ] ACRE: Loaded 34101 primary data records. [2025-10-10T22:34:12.558251] [INFO ] [MAIN ] Derivative Progress: 18/1823 symbols completed. ACN took 1.2s. Estimated remaining: 11m 54s. Rate: 151.6 symbols/min [2025-10-10T22:34:12.624769] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:13.201253] [DEBUG] [LOCAL ] ACVA: Loaded 49962 existing records from primary storage. [2025-10-10T22:34:13.201582] [INFO ] [MAIN ] ACVA: Loaded 49962 primary data records. [2025-10-10T22:34:13.523744] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:13.534781] [INFO ] [MAIN ] ACV: Generated 1820 derivative records from 7819 primary records. [2025-10-10T22:34:13.535788] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-10-10T22:34:13.558529] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:13.568804] [DEBUG] [LOCAL ] ACV: Derivative data saved (1820 records). [2025-10-10T22:34:13.569122] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-10-10T22:34:13.567992] [INFO ] [MAIN ] ACRE: Generated 1820 derivative records from 34101 primary records. [2025-10-10T22:34:13.571639] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-10T22:34:13.571443] [INFO ] [MAIN ] Derivative Progress: 19/1823 symbols completed. ACV took 1.1s. Estimated remaining: 12m 53s. Rate: 140.1 symbols/min [2025-10-10T22:34:13.572446] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:13.591499] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1820 records). [2025-10-10T22:34:13.591931] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-10T22:34:13.594127] [INFO ] [MAIN ] Derivative Progress: 20/1823 symbols completed. ACRE took 1.2s. Estimated remaining: 12m 16s. Rate: 147.1 symbols/min [2025-10-10T22:34:13.594322] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:13.614715] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:13.615424] [INFO ] [MAIN ] ACVA: Generated 1820 derivative records from 49962 primary records. [2025-10-10T22:34:13.615562] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-10-10T22:34:13.642892] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1820 records). [2025-10-10T22:34:13.643111] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-10-10T22:34:13.645544] [INFO ] [MAIN ] Derivative Progress: 21/1823 symbols completed. ACVA took 1.0s. Estimated remaining: 11m 45s. Rate: 153.4 symbols/min [2025-10-10T22:34:13.645913] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:13.685123] [DEBUG] [LOCAL ] ADCT: Loaded 35703 existing records from primary storage. [2025-10-10T22:34:13.686438] [DEBUG] [LOCAL ] ADC: Loaded 46856 existing records from primary storage. [2025-10-10T22:34:13.685419] [INFO ] [MAIN ] ADCT: Loaded 35703 primary data records. [2025-10-10T22:34:13.686585] [INFO ] [MAIN ] ADC: Loaded 46856 primary data records. [2025-10-10T22:34:14.243037] [DEBUG] [LOCAL ] ADM: Loaded 54168 existing records from primary storage. [2025-10-10T22:34:14.327941] [INFO ] [MAIN ] ADM: Loaded 54168 primary data records. [2025-10-10T22:34:14.723288] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:14.736984] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:14.739114] [INFO ] [MAIN ] ADCT: Generated 1820 derivative records from 35703 primary records. [2025-10-10T22:34:14.740158] [INFO ] [MAIN ] ADC: Generated 1820 derivative records from 46856 primary records. [2025-10-10T22:34:14.740511] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-10T22:34:14.740993] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-10-10T22:34:14.769947] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1820 records). [2025-10-10T22:34:14.774454] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-10T22:34:14.774522] [DEBUG] [LOCAL ] ADC: Derivative data saved (1820 records). [2025-10-10T22:34:14.774766] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-10-10T22:34:14.776776] [INFO ] [MAIN ] Derivative Progress: 22/1823 symbols completed. ADC took 1.2s. Estimated remaining: 12m 45s. Rate: 141.3 symbols/min [2025-10-10T22:34:14.779145] [INFO ] [MAIN ] Derivative Progress: 23/1823 symbols completed. ADCT took 1.2s. Estimated remaining: 12m 11s. Rate: 147.7 symbols/min [2025-10-10T22:34:14.779369] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:14.779038] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:14.802028] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:14.803051] [INFO ] [MAIN ] ADM: Generated 1820 derivative records from 54168 primary records. [2025-10-10T22:34:14.803211] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-10T22:34:14.824529] [DEBUG] [LOCAL ] ADM: Derivative data saved (1820 records). [2025-10-10T22:34:14.826556] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-10T22:34:14.829150] [INFO ] [MAIN ] Derivative Progress: 24/1823 symbols completed. ADM took 1.2s. Estimated remaining: 11m 44s. Rate: 153.3 symbols/min [2025-10-10T22:34:14.829308] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:14.896824] [DEBUG] [LOCAL ] ADT: Loaded 54223 existing records from primary storage. [2025-10-10T22:34:14.897521] [DEBUG] [LOCAL ] ADNT: Loaded 47843 existing records from primary storage. [2025-10-10T22:34:14.897828] [INFO ] [MAIN ] ADT: Loaded 54223 primary data records. [2025-10-10T22:34:14.898032] [INFO ] [MAIN ] ADNT: Loaded 47843 primary data records. [2025-10-10T22:34:15.077904] [DEBUG] [LOCAL ] ADX: Loaded 28006 existing records from primary storage. [2025-10-10T22:34:15.121833] [INFO ] [MAIN ] ADX: Loaded 28006 primary data records. [2025-10-10T22:34:15.827550] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:15.840251] [INFO ] [MAIN ] ADT: Generated 1820 derivative records from 54223 primary records. [2025-10-10T22:34:15.840414] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-10T22:34:15.840947] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:15.841623] [INFO ] [MAIN ] ADNT: Generated 1820 derivative records from 47843 primary records. [2025-10-10T22:34:15.842403] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-10-10T22:34:15.858380] [DEBUG] [LOCAL ] ADT: Derivative data saved (1820 records). [2025-10-10T22:34:15.865697] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-10T22:34:15.869036] [INFO ] [MAIN ] Derivative Progress: 25/1823 symbols completed. ADT took 1.1s. Estimated remaining: 12m 30s. Rate: 143.7 symbols/min [2025-10-10T22:34:15.870129] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:15.879399] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1820 records). [2025-10-10T22:34:15.879856] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-10-10T22:34:15.882027] [INFO ] [MAIN ] Derivative Progress: 26/1823 symbols completed. ADNT took 1.1s. Estimated remaining: 12m 2s. Rate: 149.3 symbols/min [2025-10-10T22:34:15.882389] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:15.895507] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:15.896550] [INFO ] [MAIN ] ADX: Generated 1820 derivative records from 28006 primary records. [2025-10-10T22:34:15.896675] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-10T22:34:15.916064] [DEBUG] [LOCAL ] ADX: Derivative data saved (1820 records). [2025-10-10T22:34:15.920119] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-10T22:34:15.920319] [DEBUG] [LOCAL ] AEFC: Loaded 8507 existing records from primary storage. [2025-10-10T22:34:15.922591] [INFO ] [MAIN ] Derivative Progress: 27/1823 symbols completed. ADX took 1.1s. Estimated remaining: 11m 38s. Rate: 154.5 symbols/min [2025-10-10T22:34:15.920435] [INFO ] [MAIN ] AEFC: Loaded 8507 primary data records. [2025-10-10T22:34:15.922912] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:16.261525] [DEBUG] [LOCAL ] AEE: Loaded 50867 existing records from primary storage. [2025-10-10T22:34:16.261742] [INFO ] [MAIN ] AEE: Loaded 50867 primary data records. [2025-10-10T22:34:16.380878] [DEBUG] [LOCAL ] AEG: Loaded 50280 existing records from primary storage. [2025-10-10T22:34:16.384915] [INFO ] [MAIN ] AEG: Loaded 50280 primary data records. [2025-10-10T22:34:17.040138] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:17.041690] [INFO ] [MAIN ] AEFC: Generated 1820 derivative records from 8507 primary records. [2025-10-10T22:34:17.042315] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-10T22:34:17.060451] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1820 records). [2025-10-10T22:34:17.060813] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-10T22:34:17.062937] [INFO ] [MAIN ] Derivative Progress: 28/1823 symbols completed. AEFC took 1.2s. Estimated remaining: 12m 25s. Rate: 144.5 symbols/min [2025-10-10T22:34:17.086803] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:17.088112] [INFO ] [MAIN ] AEE: Generated 1820 derivative records from 50867 primary records. [2025-10-10T22:34:17.088242] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-10T22:34:17.110632] [DEBUG] [LOCAL ] AEE: Derivative data saved (1820 records). [2025-10-10T22:34:17.111249] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-10T22:34:17.113689] [INFO ] [MAIN ] Derivative Progress: 29/1823 symbols completed. AEE took 1.2s. Estimated remaining: 12m 3s. Rate: 149.0 symbols/min [2025-10-10T22:34:17.134397] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:17.135100] [INFO ] [MAIN ] AEG: Generated 1820 derivative records from 50280 primary records. [2025-10-10T22:34:17.135162] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-10T22:34:17.150449] [DEBUG] [LOCAL ] AEG: Derivative data saved (1820 records). [2025-10-10T22:34:17.150508] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-10T22:34:17.153996] [INFO ] [MAIN ] Derivative Progress: 30/1823 symbols completed. AEG took 1.2s. Estimated remaining: 11m 40s. Rate: 153.6 symbols/min [2025-10-10T22:34:17.154777] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:17.154604] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:17.154716] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:17.250861] [DEBUG] [LOCAL ] AER: Loaded 48916 existing records from primary storage. [2025-10-10T22:34:17.266393] [DEBUG] [LOCAL ] AEO: Loaded 54343 existing records from primary storage. [2025-10-10T22:34:17.251111] [INFO ] [MAIN ] AER: Loaded 48916 primary data records. [2025-10-10T22:34:17.279069] [DEBUG] [LOCAL ] AEM: Loaded 54245 existing records from primary storage. [2025-10-10T22:34:17.272051] [INFO ] [MAIN ] AEO: Loaded 54343 primary data records. [2025-10-10T22:34:17.289504] [INFO ] [MAIN ] AEM: Loaded 54245 primary data records. [2025-10-10T22:34:18.256974] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:18.257336] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:18.271293] [INFO ] [MAIN ] AEO: Generated 1820 derivative records from 54343 primary records. [2025-10-10T22:34:18.271596] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-10T22:34:18.272368] [INFO ] [MAIN ] AEM: Generated 1820 derivative records from 54245 primary records. [2025-10-10T22:34:18.272945] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:18.273129] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-10T22:34:18.275170] [INFO ] [MAIN ] AER: Generated 1820 derivative records from 48916 primary records. [2025-10-10T22:34:18.276001] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-10T22:34:18.306613] [DEBUG] [LOCAL ] AEM: Derivative data saved (1820 records). [2025-10-10T22:34:18.307525] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-10T22:34:18.311192] [INFO ] [MAIN ] Derivative Progress: 31/1823 symbols completed. AEM took 1.2s. Estimated remaining: 12m 24s. Rate: 144.4 symbols/min [2025-10-10T22:34:18.311606] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:18.312593] [DEBUG] [LOCAL ] AEO: Derivative data saved (1820 records). [2025-10-10T22:34:18.321400] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-10T22:34:18.327356] [INFO ] [MAIN ] Derivative Progress: 32/1823 symbols completed. AEO took 1.2s. Estimated remaining: 12m 2s. Rate: 148.9 symbols/min [2025-10-10T22:34:18.333361] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:18.333093] [DEBUG] [LOCAL ] AER: Derivative data saved (1820 records). [2025-10-10T22:34:18.334062] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-10T22:34:18.336638] [INFO ] [MAIN ] Derivative Progress: 33/1823 symbols completed. AER took 1.2s. Estimated remaining: 11m 40s. Rate: 153.5 symbols/min [2025-10-10T22:34:18.336947] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:18.354694] [DEBUG] [LOCAL ] AFB: Loaded 11547 existing records from primary storage. [2025-10-10T22:34:18.354923] [INFO ] [MAIN ] AFB: Loaded 11547 primary data records. [2025-10-10T22:34:18.654935] [DEBUG] [LOCAL ] AESI: Loaded 50320 existing records from primary storage. [2025-10-10T22:34:18.748926] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-10-10T22:34:18.749137] [INFO ] [MAIN ] AESI: Loaded 50320 primary data records. [2025-10-10T22:34:18.749370] [INFO ] [MAIN ] AES: Loaded 54450 primary data records. [2025-10-10T22:34:19.392881] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:19.394248] [INFO ] [MAIN ] AFB: Generated 1820 derivative records from 11547 primary records. [2025-10-10T22:34:19.394352] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-10T22:34:19.412901] [DEBUG] [LOCAL ] AFB: Derivative data saved (1820 records). [2025-10-10T22:34:19.413183] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-10T22:34:19.415200] [INFO ] [MAIN ] Derivative Progress: 34/1823 symbols completed. AFB took 1.1s. Estimated remaining: 12m 16s. Rate: 145.9 symbols/min [2025-10-10T22:34:19.416195] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:19.437043] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:19.437928] [INFO ] [MAIN ] AES: Generated 1820 derivative records from 54450 primary records. [2025-10-10T22:34:19.449785] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-10T22:34:19.451121] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:19.452094] [INFO ] [MAIN ] AESI: Generated 1820 derivative records from 50320 primary records. [2025-10-10T22:34:19.459765] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-10T22:34:19.490170] [DEBUG] [LOCAL ] AES: Derivative data saved (1820 records). [2025-10-10T22:34:19.491457] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-10T22:34:19.494218] [INFO ] [MAIN ] Derivative Progress: 35/1823 symbols completed. AES took 1.2s. Estimated remaining: 11m 58s. Rate: 149.4 symbols/min [2025-10-10T22:34:19.494740] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:19.497084] [DEBUG] [LOCAL ] AESI: Derivative data saved (1820 records). [2025-10-10T22:34:19.497290] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-10T22:34:19.499374] [INFO ] [MAIN ] Derivative Progress: 36/1823 symbols completed. AESI took 1.2s. Estimated remaining: 11m 38s. Rate: 153.6 symbols/min [2025-10-10T22:34:19.509703] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:19.513256] [DEBUG] [LOCAL ] AFGB: Loaded 2330 existing records from primary storage. [2025-10-10T22:34:19.511177] [DEBUG] [LOCAL ] AFG: Loaded 32729 existing records from primary storage. [2025-10-10T22:34:19.513564] [INFO ] [MAIN ] AFG: Loaded 32729 primary data records. [2025-10-10T22:34:19.513523] [INFO ] [MAIN ] AFGB: Loaded 2330 primary data records. [2025-10-10T22:34:19.603449] [DEBUG] [LOCAL ] AFGC: Loaded 2568 existing records from primary storage. [2025-10-10T22:34:19.639229] [INFO ] [MAIN ] AFGC: Loaded 2568 primary data records. [2025-10-10T22:34:20.488305] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:20.490125] [INFO ] [MAIN ] AFG: Generated 1820 derivative records from 32729 primary records. [2025-10-10T22:34:20.490412] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-10T22:34:20.525834] [DEBUG] [LOCAL ] AFG: Derivative data saved (1820 records). [2025-10-10T22:34:20.526294] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-10T22:34:20.529445] [INFO ] [MAIN ] Derivative Progress: 37/1823 symbols completed. AFG took 1.1s. Estimated remaining: 12m 9s. Rate: 147.1 symbols/min [2025-10-10T22:34:20.526884] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:34:20.530506] [INFO ] [MAIN ] AFGB: Generated 1819 derivative records from 2330 primary records. [2025-10-10T22:34:20.530685] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-10-10T22:34:20.530962] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:20.545267] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:20.557311] [INFO ] [MAIN ] AFGC: Generated 1820 derivative records from 2568 primary records. [2025-10-10T22:34:20.557634] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-10T22:34:20.571962] [DEBUG] [LOCAL ] AFGD: Loaded 1816 existing records from primary storage. [2025-10-10T22:34:20.580560] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1820 records). [2025-10-10T22:34:20.581887] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-10T22:34:20.581996] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1819 records). [2025-10-10T22:34:20.582099] [INFO ] [MAIN ] AFGD: Loaded 1816 primary data records. [2025-10-10T22:34:20.584676] [INFO ] [MAIN ] Derivative Progress: 38/1823 symbols completed. AFGC took 1.1s. Estimated remaining: 11m 52s. Rate: 150.5 symbols/min [2025-10-10T22:34:20.617544] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-10-10T22:34:20.617758] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:20.632362] [INFO ] [MAIN ] Derivative Progress: 39/1823 symbols completed. AFGB took 1.1s. Estimated remaining: 11m 35s. Rate: 154.0 symbols/min [2025-10-10T22:34:20.638173] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:20.698471] [DEBUG] [LOCAL ] AFGE: Loaded 2444 existing records from primary storage. [2025-10-10T22:34:20.698715] [INFO ] [MAIN ] AFGE: Loaded 2444 primary data records. [2025-10-10T22:34:21.292328] [DEBUG] [LOCAL ] AFL: Loaded 53938 existing records from primary storage. [2025-10-10T22:34:21.294700] [INFO ] [MAIN ] AFL: Loaded 53938 primary data records. [2025-10-10T22:34:21.620990] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:21.622015] [INFO ] [MAIN ] AFGD: Generated 1820 derivative records from 1816 primary records. [2025-10-10T22:34:21.622210] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-10-10T22:34:21.656325] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:34:21.657883] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1820 records). [2025-10-10T22:34:21.658261] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-10-10T22:34:21.660473] [INFO ] [MAIN ] Derivative Progress: 40/1823 symbols completed. AFGD took 1.1s. Estimated remaining: 12m 3s. Rate: 147.9 symbols/min [2025-10-10T22:34:21.661853] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:21.661609] [INFO ] [MAIN ] AFGE: Generated 1819 derivative records from 2444 primary records. [2025-10-10T22:34:21.663930] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-10T22:34:21.681137] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1819 records). [2025-10-10T22:34:21.681481] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-10T22:34:21.683853] [INFO ] [MAIN ] Derivative Progress: 41/1823 symbols completed. AFGE took 1.1s. Estimated remaining: 11m 46s. Rate: 151.4 symbols/min [2025-10-10T22:34:21.684295] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:21.704529] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:21.705434] [INFO ] [MAIN ] AFL: Generated 1820 derivative records from 53938 primary records. [2025-10-10T22:34:21.705715] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-10T22:34:21.724006] [DEBUG] [LOCAL ] AFL: Derivative data saved (1820 records). [2025-10-10T22:34:21.738603] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-10T22:34:21.741544] [INFO ] [MAIN ] Derivative Progress: 42/1823 symbols completed. AFL took 1.1s. Estimated remaining: 11m 32s. Rate: 154.5 symbols/min [2025-10-10T22:34:21.741856] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:21.771453] [DEBUG] [LOCAL ] AG: Loaded 54422 existing records from primary storage. [2025-10-10T22:34:21.771797] [INFO ] [MAIN ] AG: Loaded 54422 primary data records. [2025-10-10T22:34:21.887565] [DEBUG] [LOCAL ] AGCO: Loaded 42959 existing records from primary storage. [2025-10-10T22:34:21.890904] [INFO ] [MAIN ] AGCO: Loaded 42959 primary data records. [2025-10-10T22:34:22.292492] [DEBUG] [LOCAL ] AGI: Loaded 54200 existing records from primary storage. [2025-10-10T22:34:22.303635] [INFO ] [MAIN ] AGI: Loaded 54200 primary data records. [2025-10-10T22:34:22.889732] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:22.891398] [INFO ] [MAIN ] AG: Generated 1820 derivative records from 54422 primary records. [2025-10-10T22:34:22.891749] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-10T22:34:22.911957] [DEBUG] [LOCAL ] AG: Derivative data saved (1820 records). [2025-10-10T22:34:22.913750] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-10T22:34:22.916024] [INFO ] [MAIN ] Derivative Progress: 43/1823 symbols completed. AG took 1.3s. Estimated remaining: 12m 4s. Rate: 147.6 symbols/min [2025-10-10T22:34:22.930981] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:22.932128] [INFO ] [MAIN ] AGCO: Generated 1820 derivative records from 42959 primary records. [2025-10-10T22:34:22.932217] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-10T22:34:22.949744] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1820 records). [2025-10-10T22:34:22.949863] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-10T22:34:22.953044] [INFO ] [MAIN ] Derivative Progress: 44/1823 symbols completed. AGCO took 1.3s. Estimated remaining: 11m 48s. Rate: 150.7 symbols/min [2025-10-10T22:34:22.966376] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:22.967051] [INFO ] [MAIN ] AGI: Generated 1820 derivative records from 54200 primary records. [2025-10-10T22:34:22.967114] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-10T22:34:22.982893] [DEBUG] [LOCAL ] AGI: Derivative data saved (1820 records). [2025-10-10T22:34:22.982952] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-10T22:34:22.985636] [INFO ] [MAIN ] Derivative Progress: 45/1823 symbols completed. AGI took 1.2s. Estimated remaining: 11m 33s. Rate: 153.8 symbols/min [2025-10-10T22:34:22.986141] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:22.986211] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:22.986380] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:23.002371] [DEBUG] [LOCAL ] AGM: Loaded 10669 existing records from primary storage. [2025-10-10T22:34:23.002587] [INFO ] [MAIN ] AGM: Loaded 10669 primary data records. [2025-10-10T22:34:23.214571] [DEBUG] [LOCAL ] AGO: Loaded 28322 existing records from primary storage. [2025-10-10T22:34:23.344483] [INFO ] [MAIN ] AGO: Loaded 28322 primary data records. [2025-10-10T22:34:23.345427] [DEBUG] [LOCAL ] AGL: Loaded 53272 existing records from primary storage. [2025-10-10T22:34:23.377901] [INFO ] [MAIN ] AGL: Loaded 53272 primary data records. [2025-10-10T22:34:23.979378] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:23.982220] [INFO ] [MAIN ] AGM: Generated 1820 derivative records from 10669 primary records. [2025-10-10T22:34:23.982343] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-10T22:34:24.000619] [DEBUG] [LOCAL ] AGM: Derivative data saved (1820 records). [2025-10-10T22:34:24.000983] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-10T22:34:24.003353] [INFO ] [MAIN ] Derivative Progress: 46/1823 symbols completed. AGM took 1.0s. Estimated remaining: 11m 57s. Rate: 148.6 symbols/min [2025-10-10T22:34:24.003909] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:24.036088] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:24.035814] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:24.037271] [INFO ] [MAIN ] AGO: Generated 1820 derivative records from 28322 primary records. [2025-10-10T22:34:24.038097] [INFO ] [MAIN ] AGL: Generated 1820 derivative records from 53272 primary records. [2025-10-10T22:34:24.038399] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-10T22:34:24.038212] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-10T22:34:24.066797] [DEBUG] [LOCAL ] AGL: Derivative data saved (1820 records). [2025-10-10T22:34:24.071171] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-10T22:34:24.071000] [DEBUG] [LOCAL ] AGO: Derivative data saved (1820 records). [2025-10-10T22:34:24.082854] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-10T22:34:24.082692] [INFO ] [MAIN ] Derivative Progress: 47/1823 symbols completed. AGL took 1.1s. Estimated remaining: 11m 45s. Rate: 151.2 symbols/min [2025-10-10T22:34:24.083058] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:24.085172] [INFO ] [MAIN ] Derivative Progress: 48/1823 symbols completed. AGO took 1.1s. Estimated remaining: 11m 30s. Rate: 154.4 symbols/min [2025-10-10T22:34:24.085884] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:24.100086] [DEBUG] [LOCAL ] AGRO: Loaded 33809 existing records from primary storage. [2025-10-10T22:34:24.100409] [INFO ] [MAIN ] AGRO: Loaded 33809 primary data records. [2025-10-10T22:34:24.307633] [DEBUG] [LOCAL ] AGX: Loaded 33549 existing records from primary storage. [2025-10-10T22:34:24.311008] [INFO ] [MAIN ] AGX: Loaded 33549 primary data records. [2025-10-10T22:34:24.532155] [DEBUG] [LOCAL ] AHH: Loaded 41288 existing records from primary storage. [2025-10-10T22:34:24.544397] [INFO ] [MAIN ] AHH: Loaded 41288 primary data records. [2025-10-10T22:34:25.129063] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:25.130546] [INFO ] [MAIN ] AGRO: Generated 1820 derivative records from 33809 primary records. [2025-10-10T22:34:25.131868] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-10T22:34:25.154614] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1820 records). [2025-10-10T22:34:25.155138] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-10T22:34:25.157980] [INFO ] [MAIN ] Derivative Progress: 49/1823 symbols completed. AGRO took 1.2s. Estimated remaining: 11m 54s. Rate: 149.1 symbols/min [2025-10-10T22:34:25.170837] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:25.172136] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:25.173387] [INFO ] [MAIN ] AGX: Generated 1820 derivative records from 33549 primary records. [2025-10-10T22:34:25.173762] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-10T22:34:25.193265] [DEBUG] [LOCAL ] AGX: Derivative data saved (1820 records). [2025-10-10T22:34:25.193579] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-10T22:34:25.196872] [INFO ] [MAIN ] Derivative Progress: 50/1823 symbols completed. AGX took 1.1s. Estimated remaining: 11m 41s. Rate: 151.8 symbols/min [2025-10-10T22:34:25.198169] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:25.212978] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:25.213732] [INFO ] [MAIN ] AHH: Generated 1820 derivative records from 41288 primary records. [2025-10-10T22:34:25.213953] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-10T22:34:25.233326] [DEBUG] [LOCAL ] AHT: Loaded 6364 existing records from primary storage. [2025-10-10T22:34:25.245134] [INFO ] [MAIN ] AHT: Loaded 6364 primary data records. [2025-10-10T22:34:25.291046] [DEBUG] [LOCAL ] AHH: Derivative data saved (1820 records). [2025-10-10T22:34:25.324757] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-10T22:34:25.358353] [INFO ] [MAIN ] Derivative Progress: 51/1823 symbols completed. AHH took 1.3s. Estimated remaining: 11m 32s. Rate: 153.6 symbols/min [2025-10-10T22:34:25.371945] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:25.371728] [DEBUG] [LOCAL ] AHR: Loaded 49812 existing records from primary storage. [2025-10-10T22:34:25.390064] [INFO ] [MAIN ] AHR: Loaded 49812 primary data records. [2025-10-10T22:34:25.909559] [DEBUG] [LOCAL ] AIG: Loaded 54250 existing records from primary storage. [2025-10-10T22:34:25.911119] [INFO ] [MAIN ] AIG: Loaded 54250 primary data records. [2025-10-10T22:34:26.003735] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:26.030810] [INFO ] [MAIN ] AHT: Generated 1820 derivative records from 6364 primary records. [2025-10-10T22:34:26.032115] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-10T22:34:26.101513] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:34:26.127563] [INFO ] [MAIN ] AHR: Generated 1819 derivative records from 49812 primary records. [2025-10-10T22:34:26.136116] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-10-10T22:34:26.279011] [DEBUG] [LOCAL ] AHR: Derivative data saved (1819 records). [2025-10-10T22:34:26.280700] [DEBUG] [LOCAL ] AHT: Derivative data saved (1820 records). [2025-10-10T22:34:26.281289] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-10-10T22:34:26.281669] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-10T22:34:26.284513] [INFO ] [MAIN ] Derivative Progress: 52/1823 symbols completed. AHT took 1.1s. Estimated remaining: 11m 50s. Rate: 149.6 symbols/min [2025-10-10T22:34:26.288536] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:26.288819] [INFO ] [MAIN ] Derivative Progress: 53/1823 symbols completed. AHR took 1.1s. Estimated remaining: 11m 36s. Rate: 152.5 symbols/min [2025-10-10T22:34:26.290180] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:26.322997] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:26.323890] [INFO ] [MAIN ] AIG: Generated 1820 derivative records from 54250 primary records. [2025-10-10T22:34:26.324049] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-10T22:34:26.356254] [DEBUG] [LOCAL ] AIN: Loaded 24875 existing records from primary storage. [2025-10-10T22:34:26.365285] [INFO ] [MAIN ] AIN: Loaded 24875 primary data records. [2025-10-10T22:34:26.375034] [DEBUG] [LOCAL ] AIG: Derivative data saved (1820 records). [2025-10-10T22:34:26.375270] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-10T22:34:26.377815] [INFO ] [MAIN ] Derivative Progress: 54/1823 symbols completed. AIG took 1.0s. Estimated remaining: 11m 26s. Rate: 154.7 symbols/min [2025-10-10T22:34:26.393349] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:26.411639] [DEBUG] [LOCAL ] AIR: Loaded 29366 existing records from primary storage. [2025-10-10T22:34:26.423482] [INFO ] [MAIN ] AIR: Loaded 29366 primary data records. [2025-10-10T22:34:26.749348] [DEBUG] [LOCAL ] AIT: Loaded 27469 existing records from primary storage. [2025-10-10T22:34:26.769101] [INFO ] [MAIN ] AIT: Loaded 27469 primary data records. [2025-10-10T22:34:27.367939] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:27.381170] [INFO ] [MAIN ] AIR: Generated 1820 derivative records from 29366 primary records. [2025-10-10T22:34:27.381578] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-10-10T22:34:27.382340] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:27.383590] [INFO ] [MAIN ] AIN: Generated 1820 derivative records from 24875 primary records. [2025-10-10T22:34:27.385491] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-10T22:34:27.410457] [DEBUG] [LOCAL ] AIR: Derivative data saved (1820 records). [2025-10-10T22:34:27.417020] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-10-10T22:34:27.420006] [INFO ] [MAIN ] Derivative Progress: 55/1823 symbols completed. AIR took 1.1s. Estimated remaining: 11m 47s. Rate: 150.1 symbols/min [2025-10-10T22:34:27.420415] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:27.421969] [DEBUG] [LOCAL ] AIN: Derivative data saved (1820 records). [2025-10-10T22:34:27.422152] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-10T22:34:27.425104] [INFO ] [MAIN ] Derivative Progress: 56/1823 symbols completed. AIN took 1.1s. Estimated remaining: 11m 34s. Rate: 152.8 symbols/min [2025-10-10T22:34:27.425795] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:27.443952] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:27.444894] [INFO ] [MAIN ] AIT: Generated 1820 derivative records from 27469 primary records. [2025-10-10T22:34:27.445084] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-10T22:34:27.484192] [DEBUG] [LOCAL ] AIT: Derivative data saved (1820 records). [2025-10-10T22:34:27.484473] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-10T22:34:27.487165] [INFO ] [MAIN ] Derivative Progress: 57/1823 symbols completed. AIT took 1.1s. Estimated remaining: 11m 23s. Rate: 155.1 symbols/min [2025-10-10T22:34:27.487613] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:27.500509] [DEBUG] [LOCAL ] AIZ: Loaded 30023 existing records from primary storage. [2025-10-10T22:34:27.512775] [INFO ] [MAIN ] AIZ: Loaded 30023 primary data records. [2025-10-10T22:34:27.535568] [DEBUG] [LOCAL ] AIV: Loaded 41565 existing records from primary storage. [2025-10-10T22:34:27.551336] [INFO ] [MAIN ] AIV: Loaded 41565 primary data records. [2025-10-10T22:34:27.625313] [DEBUG] [LOCAL ] AIZN: Loaded 4172 existing records from primary storage. [2025-10-10T22:34:27.667810] [INFO ] [MAIN ] AIZN: Loaded 4172 primary data records. [2025-10-10T22:34:28.444542] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:28.449732] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:28.450514] [INFO ] [MAIN ] AIV: Generated 1820 derivative records from 41565 primary records. [2025-10-10T22:34:28.451316] [INFO ] [MAIN ] AIZ: Generated 1820 derivative records from 30023 primary records. [2025-10-10T22:34:28.450763] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-10T22:34:28.458726] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-10T22:34:28.463875] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:28.465234] [INFO ] [MAIN ] AIZN: Generated 1820 derivative records from 4172 primary records. [2025-10-10T22:34:28.473048] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-10T22:34:28.494154] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1820 records). [2025-10-10T22:34:28.502789] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-10T22:34:28.509060] [INFO ] [MAIN ] Derivative Progress: 58/1823 symbols completed. AIZ took 1.1s. Estimated remaining: 11m 42s. Rate: 150.8 symbols/min [2025-10-10T22:34:28.512860] [DEBUG] [LOCAL ] AIV: Derivative data saved (1820 records). [2025-10-10T22:34:28.513823] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-10T22:34:28.516675] [INFO ] [MAIN ] Derivative Progress: 59/1823 symbols completed. AIV took 1.1s. Estimated remaining: 11m 30s. Rate: 153.4 symbols/min [2025-10-10T22:34:28.516760] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1820 records). [2025-10-10T22:34:28.516982] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-10T22:34:28.519665] [INFO ] [MAIN ] Derivative Progress: 60/1823 symbols completed. AIZN took 1.0s. Estimated remaining: 11m 18s. Rate: 155.9 symbols/min [2025-10-10T22:34:28.520339] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:28.520425] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:28.520285] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:28.580519] [DEBUG] [LOCAL ] AL: Loaded 45184 existing records from primary storage. [2025-10-10T22:34:28.580802] [INFO ] [MAIN ] AL: Loaded 45184 primary data records. [2025-10-10T22:34:28.709933] [DEBUG] [LOCAL ] AKR: Loaded 46485 existing records from primary storage. [2025-10-10T22:34:28.710777] [DEBUG] [LOCAL ] AJG: Loaded 47279 existing records from primary storage. [2025-10-10T22:34:28.711123] [INFO ] [MAIN ] AKR: Loaded 46485 primary data records. [2025-10-10T22:34:28.711340] [INFO ] [MAIN ] AJG: Loaded 47279 primary data records. [2025-10-10T22:34:29.589195] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:29.590210] [INFO ] [MAIN ] AL: Generated 1820 derivative records from 45184 primary records. [2025-10-10T22:34:29.590388] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-10T22:34:29.608979] [DEBUG] [LOCAL ] AL: Derivative data saved (1820 records). [2025-10-10T22:34:29.609925] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-10T22:34:29.612032] [INFO ] [MAIN ] Derivative Progress: 61/1823 symbols completed. AL took 1.1s. Estimated remaining: 11m 38s. Rate: 151.4 symbols/min [2025-10-10T22:34:29.624575] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:29.625545] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:29.626369] [INFO ] [MAIN ] AJG: Generated 1820 derivative records from 47279 primary records. [2025-10-10T22:34:29.626506] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-10T22:34:29.658254] [DEBUG] [LOCAL ] AJG: Derivative data saved (1820 records). [2025-10-10T22:34:29.659075] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-10T22:34:29.661403] [INFO ] [MAIN ] Derivative Progress: 62/1823 symbols completed. AJG took 1.1s. Estimated remaining: 11m 28s. Rate: 153.5 symbols/min [2025-10-10T22:34:29.659014] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:29.662337] [INFO ] [MAIN ] AKR: Generated 1820 derivative records from 46485 primary records. [2025-10-10T22:34:29.662461] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:29.662624] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-10T22:34:29.679810] [DEBUG] [LOCAL ] AKR: Derivative data saved (1820 records). [2025-10-10T22:34:29.680061] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-10T22:34:29.683206] [INFO ] [MAIN ] Derivative Progress: 63/1823 symbols completed. AKR took 1.2s. Estimated remaining: 11m 17s. Rate: 155.9 symbols/min [2025-10-10T22:34:29.683613] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:29.743324] [DEBUG] [LOCAL ] ALB: Loaded 54068 existing records from primary storage. [2025-10-10T22:34:29.743600] [INFO ] [MAIN ] ALB: Loaded 54068 primary data records. [2025-10-10T22:34:29.823912] [DEBUG] [LOCAL ] ALE: Loaded 31823 existing records from primary storage. [2025-10-10T22:34:29.867064] [INFO ] [MAIN ] ALE: Loaded 31823 primary data records. [2025-10-10T22:34:29.892116] [DEBUG] [LOCAL ] ALC: Loaded 51798 existing records from primary storage. [2025-10-10T22:34:29.923624] [INFO ] [MAIN ] ALC: Loaded 51798 primary data records. [2025-10-10T22:34:30.737526] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:30.738881] [INFO ] [MAIN ] ALB: Generated 1820 derivative records from 54068 primary records. [2025-10-10T22:34:30.739302] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-10T22:34:30.759603] [DEBUG] [LOCAL ] ALB: Derivative data saved (1820 records). [2025-10-10T22:34:30.769001] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-10T22:34:30.776960] [INFO ] [MAIN ] Derivative Progress: 64/1823 symbols completed. ALB took 1.2s. Estimated remaining: 11m 37s. Rate: 151.5 symbols/min [2025-10-10T22:34:30.790750] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:30.777631] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:30.791969] [INFO ] [MAIN ] ALE: Generated 1820 derivative records from 31823 primary records. [2025-10-10T22:34:30.792064] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-10T22:34:30.793341] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:30.794894] [INFO ] [MAIN ] ALC: Generated 1820 derivative records from 51798 primary records. [2025-10-10T22:34:30.802795] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-10T22:34:30.820515] [DEBUG] [LOCAL ] ALE: Derivative data saved (1820 records). [2025-10-10T22:34:30.820808] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-10T22:34:30.823704] [INFO ] [MAIN ] Derivative Progress: 65/1823 symbols completed. ALE took 1.1s. Estimated remaining: 11m 27s. Rate: 153.6 symbols/min [2025-10-10T22:34:30.828967] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:30.838346] [DEBUG] [LOCAL ] ALC: Derivative data saved (1820 records). [2025-10-10T22:34:30.838677] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-10T22:34:30.841855] [INFO ] [MAIN ] Derivative Progress: 66/1823 symbols completed. ALC took 1.2s. Estimated remaining: 11m 16s. Rate: 155.9 symbols/min [2025-10-10T22:34:30.842196] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:30.862468] [DEBUG] [LOCAL ] ALG: Loaded 9947 existing records from primary storage. [2025-10-10T22:34:30.862976] [INFO ] [MAIN ] ALG: Loaded 9947 primary data records. [2025-10-10T22:34:30.966550] [DEBUG] [LOCAL ] ALEX: Loaded 31679 existing records from primary storage. [2025-10-10T22:34:30.983086] [INFO ] [MAIN ] ALEX: Loaded 31679 primary data records. [2025-10-10T22:34:31.521767] [DEBUG] [LOCAL ] ALIT: Loaded 53554 existing records from primary storage. [2025-10-10T22:34:31.522120] [INFO ] [MAIN ] ALIT: Loaded 53554 primary data records. [2025-10-10T22:34:31.848403] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:31.851302] [INFO ] [MAIN ] ALG: Generated 1820 derivative records from 9947 primary records. [2025-10-10T22:34:31.852280] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-10T22:34:31.879578] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:31.882725] [INFO ] [MAIN ] ALEX: Generated 1820 derivative records from 31679 primary records. [2025-10-10T22:34:31.883070] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-10T22:34:31.902085] [DEBUG] [LOCAL ] ALG: Derivative data saved (1820 records). [2025-10-10T22:34:31.902402] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-10T22:34:31.907567] [INFO ] [MAIN ] Derivative Progress: 67/1823 symbols completed. ALG took 1.1s. Estimated remaining: 11m 34s. Rate: 151.9 symbols/min [2025-10-10T22:34:31.910419] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:31.911908] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1820 records). [2025-10-10T22:34:31.912730] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-10T22:34:31.915425] [INFO ] [MAIN ] Derivative Progress: 68/1823 symbols completed. ALEX took 1.1s. Estimated remaining: 11m 23s. Rate: 154.1 symbols/min [2025-10-10T22:34:31.917677] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:31.933184] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:31.933781] [INFO ] [MAIN ] ALIT: Generated 1820 derivative records from 53554 primary records. [2025-10-10T22:34:31.933888] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-10T22:34:31.951602] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1820 records). [2025-10-10T22:34:31.951892] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-10T22:34:31.954302] [INFO ] [MAIN ] Derivative Progress: 69/1823 symbols completed. ALIT took 1.1s. Estimated remaining: 11m 14s. Rate: 156.1 symbols/min [2025-10-10T22:34:31.954604] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:31.992014] [DEBUG] [LOCAL ] ALK: Loaded 53837 existing records from primary storage. [2025-10-10T22:34:31.992253] [INFO ] [MAIN ] ALK: Loaded 53837 primary data records. [2025-10-10T22:34:32.235844] [DEBUG] [LOCAL ] ALLE: Loaded 44999 existing records from primary storage. [2025-10-10T22:34:32.347736] [INFO ] [MAIN ] ALLE: Loaded 44999 primary data records. [2025-10-10T22:34:32.347585] [DEBUG] [LOCAL ] ALL: Loaded 50524 existing records from primary storage. [2025-10-10T22:34:32.369440] [INFO ] [MAIN ] ALL: Loaded 50524 primary data records. [2025-10-10T22:34:33.068192] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:33.069310] [INFO ] [MAIN ] ALK: Generated 1820 derivative records from 53837 primary records. [2025-10-10T22:34:33.069797] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-10T22:34:33.088828] [DEBUG] [LOCAL ] ALK: Derivative data saved (1820 records). [2025-10-10T22:34:33.089987] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-10T22:34:33.092766] [INFO ] [MAIN ] Derivative Progress: 70/1823 symbols completed. ALK took 1.2s. Estimated remaining: 11m 33s. Rate: 151.9 symbols/min [2025-10-10T22:34:33.093418] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:33.123980] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:33.129880] [INFO ] [MAIN ] ALL: Generated 1820 derivative records from 50524 primary records. [2025-10-10T22:34:33.130006] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-10T22:34:33.130756] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:33.132119] [INFO ] [MAIN ] ALLE: Generated 1820 derivative records from 44999 primary records. [2025-10-10T22:34:33.132381] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-10T22:34:33.157632] [DEBUG] [LOCAL ] ALL: Derivative data saved (1820 records). [2025-10-10T22:34:33.160356] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-10T22:34:33.165792] [INFO ] [MAIN ] Derivative Progress: 71/1823 symbols completed. ALL took 1.2s. Estimated remaining: 11m 24s. Rate: 153.6 symbols/min [2025-10-10T22:34:33.167397] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:33.167193] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1820 records). [2025-10-10T22:34:33.167613] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-10T22:34:33.183345] [INFO ] [MAIN ] Derivative Progress: 72/1823 symbols completed. ALLE took 1.2s. Estimated remaining: 11m 15s. Rate: 155.7 symbols/min [2025-10-10T22:34:33.183825] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:33.208553] [DEBUG] [LOCAL ] ALLY: Loaded 54004 existing records from primary storage. [2025-10-10T22:34:33.208906] [INFO ] [MAIN ] ALLY: Loaded 54004 primary data records. [2025-10-10T22:34:33.333441] [DEBUG] [LOCAL ] ALTG: Loaded 23947 existing records from primary storage. [2025-10-10T22:34:33.355584] [INFO ] [MAIN ] ALTG: Loaded 23947 primary data records. [2025-10-10T22:34:33.421015] [DEBUG] [LOCAL ] ALSN: Loaded 44031 existing records from primary storage. [2025-10-10T22:34:33.511783] [INFO ] [MAIN ] ALSN: Loaded 44031 primary data records. [2025-10-10T22:34:34.194864] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:34.196424] [INFO ] [MAIN ] ALLY: Generated 1820 derivative records from 54004 primary records. [2025-10-10T22:34:34.196965] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-10T22:34:34.216885] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1820 records). [2025-10-10T22:34:34.217374] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-10T22:34:34.219606] [INFO ] [MAIN ] Derivative Progress: 73/1823 symbols completed. ALLY took 1.1s. Estimated remaining: 11m 30s. Rate: 152.2 symbols/min [2025-10-10T22:34:34.237612] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:34.238566] [INFO ] [MAIN ] ALTG: Generated 1820 derivative records from 23947 primary records. [2025-10-10T22:34:34.238802] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-10T22:34:34.259877] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1820 records). [2025-10-10T22:34:34.260181] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-10T22:34:34.263743] [INFO ] [MAIN ] Derivative Progress: 74/1823 symbols completed. ALTG took 1.1s. Estimated remaining: 11m 21s. Rate: 154.0 symbols/min [2025-10-10T22:34:34.277538] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:34.278406] [INFO ] [MAIN ] ALSN: Generated 1820 derivative records from 44031 primary records. [2025-10-10T22:34:34.278470] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-10T22:34:34.294923] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1820 records). [2025-10-10T22:34:34.295036] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-10T22:34:34.297922] [INFO ] [MAIN ] Derivative Progress: 75/1823 symbols completed. ALSN took 1.1s. Estimated remaining: 11m 13s. Rate: 155.9 symbols/min [2025-10-10T22:34:34.298358] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:34.298616] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:34.298507] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:34.317801] [DEBUG] [LOCAL ] ALUR: Loaded 10535 existing records from primary storage. [2025-10-10T22:34:34.318121] [INFO ] [MAIN ] ALUR: Loaded 10535 primary data records. [2025-10-10T22:34:34.318381] [DEBUG] [LOCAL ] ALX: Loaded 6768 existing records from primary storage. [2025-10-10T22:34:34.338929] [INFO ] [MAIN ] ALX: Loaded 6768 primary data records. [2025-10-10T22:34:34.979300] [DEBUG] [LOCAL ] ALV: Loaded 42734 existing records from primary storage. [2025-10-10T22:34:34.990285] [INFO ] [MAIN ] ALV: Loaded 42734 primary data records. [2025-10-10T22:34:35.338124] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:35.340890] [INFO ] [MAIN ] ALUR: Generated 1820 derivative records from 10535 primary records. [2025-10-10T22:34:35.341963] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-10T22:34:35.357904] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:35.372672] [INFO ] [MAIN ] ALX: Generated 1820 derivative records from 6768 primary records. [2025-10-10T22:34:35.373425] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-10T22:34:35.377761] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1820 records). [2025-10-10T22:34:35.378328] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-10T22:34:35.380721] [INFO ] [MAIN ] Derivative Progress: 76/1823 symbols completed. ALUR took 1.1s. Estimated remaining: 11m 28s. Rate: 152.3 symbols/min [2025-10-10T22:34:35.380893] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:35.396688] [DEBUG] [LOCAL ] ALX: Derivative data saved (1820 records). [2025-10-10T22:34:35.397053] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-10T22:34:35.400867] [INFO ] [MAIN ] Derivative Progress: 77/1823 symbols completed. ALX took 1.1s. Estimated remaining: 11m 20s. Rate: 154.2 symbols/min [2025-10-10T22:34:35.401246] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:35.421572] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:35.422522] [INFO ] [MAIN ] ALV: Generated 1820 derivative records from 42734 primary records. [2025-10-10T22:34:35.422628] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-10T22:34:35.445809] [DEBUG] [LOCAL ] ALV: Derivative data saved (1820 records). [2025-10-10T22:34:35.446017] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-10T22:34:35.448675] [INFO ] [MAIN ] Derivative Progress: 78/1823 symbols completed. ALV took 1.2s. Estimated remaining: 11m 11s. Rate: 155.9 symbols/min [2025-10-10T22:34:35.460431] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:35.488165] [DEBUG] [LOCAL ] AMBC: Loaded 36913 existing records from primary storage. [2025-10-10T22:34:35.488384] [INFO ] [MAIN ] AMBC: Loaded 36913 primary data records. [2025-10-10T22:34:35.619388] [DEBUG] [LOCAL ] AM: Loaded 52754 existing records from primary storage. [2025-10-10T22:34:35.625416] [INFO ] [MAIN ] AM: Loaded 52754 primary data records. [2025-10-10T22:34:35.927316] [DEBUG] [LOCAL ] AMBP: Loaded 45241 existing records from primary storage. [2025-10-10T22:34:35.945629] [INFO ] [MAIN ] AMBP: Loaded 45241 primary data records. [2025-10-10T22:34:36.512070] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:36.513919] [INFO ] [MAIN ] AMBC: Generated 1820 derivative records from 36913 primary records. [2025-10-10T22:34:36.514401] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-10T22:34:36.532580] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1820 records). [2025-10-10T22:34:36.532833] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-10T22:34:36.534995] [INFO ] [MAIN ] Derivative Progress: 79/1823 symbols completed. AMBC took 1.1s. Estimated remaining: 11m 27s. Rate: 152.4 symbols/min [2025-10-10T22:34:36.535145] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:36.557700] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:36.558903] [INFO ] [MAIN ] AM: Generated 1820 derivative records from 52754 primary records. [2025-10-10T22:34:36.559164] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-10T22:34:36.573453] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:36.574784] [INFO ] [MAIN ] AMBP: Generated 1820 derivative records from 45241 primary records. [2025-10-10T22:34:36.582393] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-10T22:34:36.608762] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1820 records). [2025-10-10T22:34:36.610922] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-10T22:34:36.610851] [DEBUG] [LOCAL ] AM: Derivative data saved (1820 records). [2025-10-10T22:34:36.611102] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-10T22:34:36.613602] [INFO ] [MAIN ] Derivative Progress: 80/1823 symbols completed. AMBP took 1.2s. Estimated remaining: 11m 19s. Rate: 153.9 symbols/min [2025-10-10T22:34:36.616671] [INFO ] [MAIN ] Derivative Progress: 81/1823 symbols completed. AM took 1.2s. Estimated remaining: 11m 11s. Rate: 155.9 symbols/min [2025-10-10T22:34:36.616436] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:36.617429] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:36.658472] [DEBUG] [LOCAL ] AMC: Loaded 54541 existing records from primary storage. [2025-10-10T22:34:36.658955] [INFO ] [MAIN ] AMC: Loaded 54541 primary data records. [2025-10-10T22:34:36.913079] [DEBUG] [LOCAL ] AME: Loaded 49435 existing records from primary storage. [2025-10-10T22:34:36.912959] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-10-10T22:34:37.050054] [INFO ] [MAIN ] AME: Loaded 49435 primary data records. [2025-10-10T22:34:37.065473] [INFO ] [MAIN ] AMCR: Loaded 54449 primary data records. [2025-10-10T22:34:37.683909] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:37.685638] [INFO ] [MAIN ] AMC: Generated 1820 derivative records from 54541 primary records. [2025-10-10T22:34:37.685837] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-10T22:34:37.703993] [DEBUG] [LOCAL ] AMC: Derivative data saved (1820 records). [2025-10-10T22:34:37.704122] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-10T22:34:37.706154] [INFO ] [MAIN ] Derivative Progress: 82/1823 symbols completed. AMC took 1.2s. Estimated remaining: 11m 25s. Rate: 152.5 symbols/min [2025-10-10T22:34:37.707116] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:37.739278] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:37.744983] [INFO ] [MAIN ] AME: Generated 1820 derivative records from 49435 primary records. [2025-10-10T22:34:37.745222] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:37.745345] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-10T22:34:37.745934] [INFO ] [MAIN ] AMCR: Generated 1820 derivative records from 54449 primary records. [2025-10-10T22:34:37.746350] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-10T22:34:37.773810] [DEBUG] [LOCAL ] AME: Derivative data saved (1820 records). [2025-10-10T22:34:37.784155] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1820 records). [2025-10-10T22:34:37.783248] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-10T22:34:37.784286] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-10T22:34:37.786987] [INFO ] [MAIN ] Derivative Progress: 83/1823 symbols completed. AMCR took 1.2s. Estimated remaining: 11m 18s. Rate: 153.9 symbols/min [2025-10-10T22:34:37.789747] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:37.790732] [DEBUG] [LOCAL ] AMG: Loaded 20399 existing records from primary storage. [2025-10-10T22:34:37.790845] [INFO ] [MAIN ] Derivative Progress: 84/1823 symbols completed. AME took 1.2s. Estimated remaining: 11m 10s. Rate: 155.8 symbols/min [2025-10-10T22:34:37.791363] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:37.791282] [INFO ] [MAIN ] AMG: Loaded 20399 primary data records. [2025-10-10T22:34:38.130694] [DEBUG] [LOCAL ] AMH: Loaded 52533 existing records from primary storage. [2025-10-10T22:34:38.130941] [INFO ] [MAIN ] AMH: Loaded 52533 primary data records. [2025-10-10T22:34:38.187315] [DEBUG] [LOCAL ] AMN: Loaded 42328 existing records from primary storage. [2025-10-10T22:34:38.214500] [INFO ] [MAIN ] AMN: Loaded 42328 primary data records. [2025-10-10T22:34:38.619562] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:38.644461] [INFO ] [MAIN ] AMG: Generated 1820 derivative records from 20399 primary records. [2025-10-10T22:34:38.660700] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-10T22:34:38.833024] [DEBUG] [LOCAL ] AMG: Derivative data saved (1820 records). [2025-10-10T22:34:38.834025] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-10T22:34:38.836146] [INFO ] [MAIN ] Derivative Progress: 85/1823 symbols completed. AMG took 1.1s. Estimated remaining: 11m 23s. Rate: 152.7 symbols/min [2025-10-10T22:34:38.837490] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:38.858269] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:38.859098] [INFO ] [MAIN ] AMH: Generated 1820 derivative records from 52533 primary records. [2025-10-10T22:34:38.859458] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-10T22:34:38.875802] [DEBUG] [LOCAL ] AMH: Derivative data saved (1820 records). [2025-10-10T22:34:38.875934] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-10T22:34:38.878280] [INFO ] [MAIN ] Derivative Progress: 86/1823 symbols completed. AMH took 1.1s. Estimated remaining: 11m 15s. Rate: 154.3 symbols/min [2025-10-10T22:34:38.879736] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:38.903970] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:38.904998] [INFO ] [MAIN ] AMN: Generated 1820 derivative records from 42328 primary records. [2025-10-10T22:34:38.905134] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-10T22:34:38.932466] [DEBUG] [LOCAL ] AMP: Loaded 32366 existing records from primary storage. [2025-10-10T22:34:38.932604] [INFO ] [MAIN ] AMP: Loaded 32366 primary data records. [2025-10-10T22:34:38.931948] [DEBUG] [LOCAL ] AMN: Derivative data saved (1820 records). [2025-10-10T22:34:38.932911] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-10T22:34:38.946690] [INFO ] [MAIN ] Derivative Progress: 87/1823 symbols completed. AMN took 1.2s. Estimated remaining: 11m 9s. Rate: 155.8 symbols/min [2025-10-10T22:34:38.957087] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:39.277265] [DEBUG] [LOCAL ] AMPX: Loaded 53098 existing records from primary storage. [2025-10-10T22:34:39.277592] [INFO ] [MAIN ] AMPX: Loaded 53098 primary data records. [2025-10-10T22:34:39.392410] [DEBUG] [LOCAL ] AMPY: Loaded 39277 existing records from primary storage. [2025-10-10T22:34:39.396434] [INFO ] [MAIN ] AMPY: Loaded 39277 primary data records. [2025-10-10T22:34:39.938299] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:34:39.940010] [INFO ] [MAIN ] AMP: Generated 1819 derivative records from 32366 primary records. [2025-10-10T22:34:39.940375] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-10T22:34:39.960497] [DEBUG] [LOCAL ] AMP: Derivative data saved (1819 records). [2025-10-10T22:34:39.961514] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-10T22:34:39.964026] [INFO ] [MAIN ] Derivative Progress: 88/1823 symbols completed. AMP took 1.1s. Estimated remaining: 11m 21s. Rate: 152.9 symbols/min [2025-10-10T22:34:39.980144] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:39.982697] [INFO ] [MAIN ] AMPX: Generated 1820 derivative records from 53098 primary records. [2025-10-10T22:34:39.983518] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-10T22:34:40.004730] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:40.009353] [INFO ] [MAIN ] AMPY: Generated 1820 derivative records from 39277 primary records. [2025-10-10T22:34:40.009916] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-10T22:34:40.026246] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1820 records). [2025-10-10T22:34:40.029483] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-10-10T22:34:40.030756] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1820 records). [2025-10-10T22:34:40.032764] [INFO ] [MAIN ] Derivative Progress: 89/1823 symbols completed. AMPX took 1.2s. Estimated remaining: 11m 14s. Rate: 154.3 symbols/min [2025-10-10T22:34:40.033047] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-10T22:34:40.035296] [INFO ] [MAIN ] Derivative Progress: 90/1823 symbols completed. AMPY took 1.1s. Estimated remaining: 11m 6s. Rate: 156.1 symbols/min [2025-10-10T22:34:40.035696] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:40.035904] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:40.035826] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:40.107345] [DEBUG] [LOCAL ] AMRC: Loaded 38710 existing records from primary storage. [2025-10-10T22:34:40.105955] [DEBUG] [LOCAL ] AMR: Loaded 29346 existing records from primary storage. [2025-10-10T22:34:40.107566] [INFO ] [MAIN ] AMR: Loaded 29346 primary data records. [2025-10-10T22:34:40.107777] [INFO ] [MAIN ] AMRC: Loaded 38710 primary data records. [2025-10-10T22:34:40.307829] [DEBUG] [LOCAL ] AMT: Loaded 53216 existing records from primary storage. [2025-10-10T22:34:40.347589] [INFO ] [MAIN ] AMT: Loaded 53216 primary data records. [2025-10-10T22:34:41.139748] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:41.141735] [INFO ] [MAIN ] AMRC: Generated 1820 derivative records from 38710 primary records. [2025-10-10T22:34:41.140569] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:41.143213] [INFO ] [MAIN ] AMR: Generated 1820 derivative records from 29346 primary records. [2025-10-10T22:34:41.143361] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-10T22:34:41.142148] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-10T22:34:41.180578] [DEBUG] [LOCAL ] AMR: Derivative data saved (1820 records). [2025-10-10T22:34:41.195958] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-10T22:34:41.198189] [INFO ] [MAIN ] Derivative Progress: 91/1823 symbols completed. AMR took 1.2s. Estimated remaining: 11m 21s. Rate: 152.7 symbols/min [2025-10-10T22:34:41.195883] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:41.198434] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:41.199431] [INFO ] [MAIN ] AMT: Generated 1820 derivative records from 53216 primary records. [2025-10-10T22:34:41.200050] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-10T22:34:41.201396] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1820 records). [2025-10-10T22:34:41.202691] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-10T22:34:41.206447] [INFO ] [MAIN ] Derivative Progress: 92/1823 symbols completed. AMRC took 1.2s. Estimated remaining: 11m 13s. Rate: 154.3 symbols/min [2025-10-10T22:34:41.214437] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:41.234801] [DEBUG] [LOCAL ] AMT: Derivative data saved (1820 records). [2025-10-10T22:34:41.235036] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-10T22:34:41.238216] [INFO ] [MAIN ] Derivative Progress: 93/1823 symbols completed. AMT took 1.2s. Estimated remaining: 11m 6s. Rate: 155.8 symbols/min [2025-10-10T22:34:41.238554] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:41.235332] [DEBUG] [LOCAL ] AMTD: Loaded 3793 existing records from primary storage. [2025-10-10T22:34:41.238802] [INFO ] [MAIN ] AMTD: Loaded 3793 primary data records. [2025-10-10T22:34:41.334527] [DEBUG] [LOCAL ] AMTB: Loaded 20747 existing records from primary storage. [2025-10-10T22:34:41.345824] [INFO ] [MAIN ] AMTB: Loaded 20747 primary data records. [2025-10-10T22:34:41.892180] [DEBUG] [LOCAL ] AMTM: Loaded 51363 existing records from primary storage. [2025-10-10T22:34:41.893037] [INFO ] [MAIN ] AMTM: Loaded 51363 primary data records. [2025-10-10T22:34:42.212178] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:42.213339] [INFO ] [MAIN ] AMTD: Generated 1820 derivative records from 3793 primary records. [2025-10-10T22:34:42.213450] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-10T22:34:42.232125] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1820 records). [2025-10-10T22:34:42.244533] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-10T22:34:42.245254] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:42.247535] [INFO ] [MAIN ] Derivative Progress: 94/1823 symbols completed. AMTD took 1.0s. Estimated remaining: 11m 17s. Rate: 153.2 symbols/min [2025-10-10T22:34:42.248413] [INFO ] [MAIN ] AMTB: Generated 1820 derivative records from 20747 primary records. [2025-10-10T22:34:42.248770] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-10T22:34:42.248983] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:42.271075] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1820 records). [2025-10-10T22:34:42.271316] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-10T22:34:42.273748] [INFO ] [MAIN ] Derivative Progress: 95/1823 symbols completed. AMTB took 1.1s. Estimated remaining: 11m 10s. Rate: 154.7 symbols/min [2025-10-10T22:34:42.290075] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:42.290682] [DEBUG] [LOCAL ] AMWL: Loaded 9466 existing records from primary storage. [2025-10-10T22:34:42.291224] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:42.290873] [INFO ] [MAIN ] AMWL: Loaded 9466 primary data records. [2025-10-10T22:34:42.303162] [INFO ] [MAIN ] AMTM: Generated 1820 derivative records from 51363 primary records. [2025-10-10T22:34:42.328392] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-10T22:34:42.410811] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1820 records). [2025-10-10T22:34:42.411021] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-10T22:34:42.424358] [INFO ] [MAIN ] Derivative Progress: 96/1823 symbols completed. AMTM took 1.2s. Estimated remaining: 11m 5s. Rate: 155.7 symbols/min [2025-10-10T22:34:42.454011] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:42.674944] [DEBUG] [LOCAL ] AMX: Loaded 49829 existing records from primary storage. [2025-10-10T22:34:42.685790] [INFO ] [MAIN ] AMX: Loaded 49829 primary data records. [2025-10-10T22:34:42.824825] [DEBUG] [LOCAL ] AN: Loaded 32078 existing records from primary storage. [2025-10-10T22:34:42.855402] [INFO ] [MAIN ] AN: Loaded 32078 primary data records. [2025-10-10T22:34:42.906216] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:43.044213] [INFO ] [MAIN ] AMWL: Generated 1820 derivative records from 9466 primary records. [2025-10-10T22:34:43.075203] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-10T22:34:43.162159] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1820 records). [2025-10-10T22:34:43.165580] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-10T22:34:43.168250] [INFO ] [MAIN ] Derivative Progress: 97/1823 symbols completed. AMWL took 0.9s. Estimated remaining: 11m 11s. Rate: 154.2 symbols/min [2025-10-10T22:34:43.173697] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:43.404094] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:43.405372] [INFO ] [MAIN ] AMX: Generated 1820 derivative records from 49829 primary records. [2025-10-10T22:34:43.405759] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-10T22:34:43.440063] [DEBUG] [LOCAL ] AMX: Derivative data saved (1820 records). [2025-10-10T22:34:43.441107] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-10T22:34:43.442238] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-10-10T22:34:43.444661] [INFO ] [MAIN ] Derivative Progress: 98/1823 symbols completed. AMX took 1.2s. Estimated remaining: 11m 9s. Rate: 154.7 symbols/min [2025-10-10T22:34:43.444957] [INFO ] [MAIN ] ANET: Loaded 54546 primary data records. [2025-10-10T22:34:43.444897] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:43.494950] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:43.508302] [INFO ] [MAIN ] AN: Generated 1820 derivative records from 32078 primary records. [2025-10-10T22:34:43.533718] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-10T22:34:43.654961] [DEBUG] [LOCAL ] AN: Derivative data saved (1820 records). [2025-10-10T22:34:43.787976] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-10T22:34:43.791967] [INFO ] [MAIN ] Derivative Progress: 99/1823 symbols completed. AN took 1.3s. Estimated remaining: 11m 8s. Rate: 154.9 symbols/min [2025-10-10T22:34:43.792289] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:43.815073] [DEBUG] [LOCAL ] ANF: Loaded 52849 existing records from primary storage. [2025-10-10T22:34:43.815680] [INFO ] [MAIN ] ANF: Loaded 52849 primary data records. [2025-10-10T22:34:43.966739] [DEBUG] [LOCAL ] ANRO: Loaded 19612 existing records from primary storage. [2025-10-10T22:34:43.987478] [INFO ] [MAIN ] ANRO: Loaded 19612 primary data records. [2025-10-10T22:34:44.219934] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:44.243287] [INFO ] [MAIN ] ANET: Generated 1820 derivative records from 54546 primary records. [2025-10-10T22:34:44.248786] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-10T22:34:44.307195] [DEBUG] [LOCAL ] ANET: Derivative data saved (1820 records). [2025-10-10T22:34:44.307432] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-10T22:34:44.309660] [INFO ] [MAIN ] Derivative Progress: 100/1823 symbols completed. ANET took 1.1s. Estimated remaining: 11m 10s. Rate: 154.3 symbols/min [2025-10-10T22:34:44.334864] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:44.517129] [DEBUG] [LOCAL ] ANVS: Loaded 23802 existing records from primary storage. [2025-10-10T22:34:44.517923] [INFO ] [MAIN ] ANVS: Loaded 23802 primary data records. [2025-10-10T22:34:44.567097] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:44.601238] [INFO ] [MAIN ] ANF: Generated 1820 derivative records from 52849 primary records. [2025-10-10T22:34:44.613082] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-10T22:34:44.711380] [DEBUG] [LOCAL ] ANF: Derivative data saved (1820 records). [2025-10-10T22:34:44.901091] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-10T22:34:44.904918] [INFO ] [MAIN ] Derivative Progress: 101/1823 symbols completed. ANF took 1.5s. Estimated remaining: 11m 13s. Rate: 153.5 symbols/min [2025-10-10T22:34:44.905264] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:44.920811] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:44.921800] [INFO ] [MAIN ] ANRO: Generated 1820 derivative records from 19612 primary records. [2025-10-10T22:34:44.922746] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-10T22:34:44.941536] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1820 records). [2025-10-10T22:34:44.941667] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-10T22:34:44.944039] [INFO ] [MAIN ] Derivative Progress: 102/1823 symbols completed. ANRO took 1.2s. Estimated remaining: 11m 7s. Rate: 154.9 symbols/min [2025-10-10T22:34:44.944369] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:44.972461] [DEBUG] [LOCAL ] AOD: Loaded 31144 existing records from primary storage. [2025-10-10T22:34:44.972795] [INFO ] [MAIN ] AOD: Loaded 31144 primary data records. [2025-10-10T22:34:45.046548] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:45.062703] [INFO ] [MAIN ] ANVS: Generated 1820 derivative records from 23802 primary records. [2025-10-10T22:34:45.098043] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-10T22:34:45.215584] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1820 records). [2025-10-10T22:34:45.271797] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-10T22:34:45.356445] [INFO ] [MAIN ] Derivative Progress: 103/1823 symbols completed. ANVS took 1.0s. Estimated remaining: 11m 7s. Rate: 154.8 symbols/min [2025-10-10T22:34:45.367775] [DEBUG] [LOCAL ] AON: Loaded 45735 existing records from primary storage. [2025-10-10T22:34:45.367946] [INFO ] [MAIN ] AON: Loaded 45735 primary data records. [2025-10-10T22:34:45.702509] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:45.703788] [INFO ] [MAIN ] AOD: Generated 1820 derivative records from 31144 primary records. [2025-10-10T22:34:45.703874] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-10T22:34:45.722450] [DEBUG] [LOCAL ] AOD: Derivative data saved (1820 records). [2025-10-10T22:34:45.722561] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-10T22:34:45.724908] [INFO ] [MAIN ] Derivative Progress: 104/1823 symbols completed. AOD took 0.8s. Estimated remaining: 11m 6s. Rate: 154.9 symbols/min [2025-10-10T22:34:45.742113] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:45.742783] [INFO ] [MAIN ] AON: Generated 1820 derivative records from 45735 primary records. [2025-10-10T22:34:45.742846] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-10T22:34:45.758828] [DEBUG] [LOCAL ] AON: Derivative data saved (1820 records). [2025-10-10T22:34:45.758889] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-10T22:34:45.761560] [INFO ] [MAIN ] Derivative Progress: 105/1823 symbols completed. AON took 0.8s. Estimated remaining: 10m 60s. Rate: 156.2 symbols/min [2025-10-10T22:34:45.762064] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:45.761991] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:45.762277] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:45.774538] [DEBUG] [LOCAL ] AP: Loaded 7276 existing records from primary storage. [2025-10-10T22:34:45.774770] [INFO ] [MAIN ] AP: Loaded 7276 primary data records. [2025-10-10T22:34:45.910905] [DEBUG] [LOCAL ] AORT: Loaded 29573 existing records from primary storage. [2025-10-10T22:34:45.937235] [INFO ] [MAIN ] AORT: Loaded 29573 primary data records. [2025-10-10T22:34:46.214173] [DEBUG] [LOCAL ] AOS: Loaded 49405 existing records from primary storage. [2025-10-10T22:34:46.214879] [INFO ] [MAIN ] AOS: Loaded 49405 primary data records. [2025-10-10T22:34:46.825673] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:46.827020] [INFO ] [MAIN ] AP: Generated 1820 derivative records from 7276 primary records. [2025-10-10T22:34:46.827532] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-10T22:34:46.844909] [DEBUG] [LOCAL ] AP: Derivative data saved (1820 records). [2025-10-10T22:34:46.845314] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-10T22:34:46.847690] [INFO ] [MAIN ] Derivative Progress: 106/1823 symbols completed. AP took 1.1s. Estimated remaining: 11m 11s. Rate: 153.6 symbols/min [2025-10-10T22:34:46.849288] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:46.865295] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:46.866287] [INFO ] [MAIN ] AORT: Generated 1820 derivative records from 29573 primary records. [2025-10-10T22:34:46.866414] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-10T22:34:46.893779] [DEBUG] [LOCAL ] AORT: Derivative data saved (1820 records). [2025-10-10T22:34:46.899270] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-10T22:34:46.899207] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:46.901481] [INFO ] [MAIN ] Derivative Progress: 107/1823 symbols completed. AORT took 1.1s. Estimated remaining: 11m 5s. Rate: 154.8 symbols/min [2025-10-10T22:34:46.902378] [INFO ] [MAIN ] AOS: Generated 1820 derivative records from 49405 primary records. [2025-10-10T22:34:46.902782] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-10T22:34:46.902529] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:46.929509] [DEBUG] [LOCAL ] AOS: Derivative data saved (1820 records). [2025-10-10T22:34:46.942917] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-10T22:34:46.945564] [INFO ] [MAIN ] Derivative Progress: 108/1823 symbols completed. AOS took 1.2s. Estimated remaining: 10m 59s. Rate: 156.1 symbols/min [2025-10-10T22:34:46.945769] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:46.951674] [DEBUG] [LOCAL ] APAM: Loaded 36563 existing records from primary storage. [2025-10-10T22:34:46.952142] [INFO ] [MAIN ] APAM: Loaded 36563 primary data records. [2025-10-10T22:34:47.189250] [DEBUG] [LOCAL ] APD: Loaded 45975 existing records from primary storage. [2025-10-10T22:34:47.311033] [INFO ] [MAIN ] APD: Loaded 45975 primary data records. [2025-10-10T22:34:47.421682] [DEBUG] [LOCAL ] APG: Loaded 51201 existing records from primary storage. [2025-10-10T22:34:47.429774] [INFO ] [MAIN ] APG: Loaded 51201 primary data records. [2025-10-10T22:34:48.001066] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:48.003556] [INFO ] [MAIN ] APAM: Generated 1820 derivative records from 36563 primary records. [2025-10-10T22:34:48.003898] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-10-10T22:34:48.024170] [DEBUG] [LOCAL ] APAM: Derivative data saved (1820 records). [2025-10-10T22:34:48.024454] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-10-10T22:34:48.027042] [INFO ] [MAIN ] Derivative Progress: 109/1823 symbols completed. APAM took 1.2s. Estimated remaining: 11m 10s. Rate: 153.5 symbols/min [2025-10-10T22:34:48.027572] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:48.046084] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:48.047140] [INFO ] [MAIN ] APD: Generated 1820 derivative records from 45975 primary records. [2025-10-10T22:34:48.047315] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-10T22:34:48.078865] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:48.080569] [INFO ] [MAIN ] APG: Generated 1820 derivative records from 51201 primary records. [2025-10-10T22:34:48.082174] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-10T22:34:48.093676] [DEBUG] [LOCAL ] APD: Derivative data saved (1820 records). [2025-10-10T22:34:48.093841] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-10T22:34:48.100686] [INFO ] [MAIN ] Derivative Progress: 110/1823 symbols completed. APD took 1.2s. Estimated remaining: 11m 4s. Rate: 154.7 symbols/min [2025-10-10T22:34:48.101161] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:48.103353] [DEBUG] [LOCAL ] APG: Derivative data saved (1820 records). [2025-10-10T22:34:48.103576] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-10T22:34:48.105941] [INFO ] [MAIN ] Derivative Progress: 111/1823 symbols completed. APG took 1.2s. Estimated remaining: 10m 58s. Rate: 156.1 symbols/min [2025-10-10T22:34:48.119724] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:48.131041] [DEBUG] [LOCAL ] APOS: Loaded 7591 existing records from primary storage. [2025-10-10T22:34:48.131192] [INFO ] [MAIN ] APOS: Loaded 7591 primary data records. [2025-10-10T22:34:48.274604] [DEBUG] [LOCAL ] APLE: Loaded 52694 existing records from primary storage. [2025-10-10T22:34:48.280519] [INFO ] [MAIN ] APLE: Loaded 52694 primary data records. [2025-10-10T22:34:48.679787] [DEBUG] [LOCAL ] APO: Loaded 54163 existing records from primary storage. [2025-10-10T22:34:48.827734] [INFO ] [MAIN ] APO: Loaded 54163 primary data records. [2025-10-10T22:34:49.157123] [DEBUG] [MAIN ] APOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:49.158881] [INFO ] [MAIN ] APOS: Generated 1820 derivative records from 7591 primary records. [2025-10-10T22:34:49.159286] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-10-10T22:34:49.187121] [DEBUG] [LOCAL ] APOS: Derivative data saved (1820 records). [2025-10-10T22:34:49.192209] [DEBUG] [MAIN ] APLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:49.192383] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-10-10T22:34:49.193353] [INFO ] [MAIN ] APLE: Generated 1820 derivative records from 52694 primary records. [2025-10-10T22:34:49.195752] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-10-10T22:34:49.195684] [INFO ] [MAIN ] Derivative Progress: 112/1823 symbols completed. APOS took 1.1s. Estimated remaining: 11m 9s. Rate: 153.6 symbols/min [2025-10-10T22:34:49.197152] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:49.217396] [DEBUG] [LOCAL ] APLE: Derivative data saved (1820 records). [2025-10-10T22:34:49.217832] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-10-10T22:34:49.220014] [INFO ] [MAIN ] Derivative Progress: 113/1823 symbols completed. APLE took 1.2s. Estimated remaining: 11m 3s. Rate: 154.8 symbols/min [2025-10-10T22:34:49.220191] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:49.234813] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:49.236878] [INFO ] [MAIN ] APO: Generated 1820 derivative records from 54163 primary records. [2025-10-10T22:34:49.237178] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-10T22:34:49.248238] [DEBUG] [LOCAL ] AQNB: Loaded 4197 existing records from primary storage. [2025-10-10T22:34:49.252063] [INFO ] [MAIN ] AQNB: Loaded 4197 primary data records. [2025-10-10T22:34:49.374573] [DEBUG] [LOCAL ] APO: Derivative data saved (1820 records). [2025-10-10T22:34:49.375070] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-10T22:34:49.377635] [INFO ] [MAIN ] Derivative Progress: 114/1823 symbols completed. APO took 1.3s. Estimated remaining: 10m 59s. Rate: 155.7 symbols/min [2025-10-10T22:34:49.377827] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:49.434448] [DEBUG] [LOCAL ] APTV: Loaded 52790 existing records from primary storage. [2025-10-10T22:34:49.451414] [INFO ] [MAIN ] APTV: Loaded 52790 primary data records. [2025-10-10T22:34:49.942367] [DEBUG] [LOCAL ] AR: Loaded 54366 existing records from primary storage. [2025-10-10T22:34:49.942688] [INFO ] [MAIN ] AR: Loaded 54366 primary data records. [2025-10-10T22:34:50.158528] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:50.274831] [INFO ] [MAIN ] AQNB: Generated 1820 derivative records from 4197 primary records. [2025-10-10T22:34:50.276228] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-10T22:34:50.296813] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1820 records). [2025-10-10T22:34:50.298449] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-10T22:34:50.301305] [INFO ] [MAIN ] Derivative Progress: 115/1823 symbols completed. AQNB took 1.1s. Estimated remaining: 11m 6s. Rate: 153.8 symbols/min [2025-10-10T22:34:50.302638] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:50.321321] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:50.322239] [INFO ] [MAIN ] APTV: Generated 1820 derivative records from 52790 primary records. [2025-10-10T22:34:50.322586] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-10T22:34:50.353614] [DEBUG] [LOCAL ] ARDC: Loaded 15383 existing records from primary storage. [2025-10-10T22:34:50.356060] [INFO ] [MAIN ] ARDC: Loaded 15383 primary data records. [2025-10-10T22:34:50.361996] [DEBUG] [LOCAL ] APTV: Derivative data saved (1820 records). [2025-10-10T22:34:50.374522] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-10T22:34:50.391946] [INFO ] [MAIN ] Derivative Progress: 116/1823 symbols completed. APTV took 1.2s. Estimated remaining: 11m 2s. Rate: 154.8 symbols/min [2025-10-10T22:34:50.426856] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:50.433928] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:50.465876] [INFO ] [MAIN ] AR: Generated 1820 derivative records from 54366 primary records. [2025-10-10T22:34:50.477377] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-10-10T22:34:50.627964] [DEBUG] [LOCAL ] AR: Derivative data saved (1820 records). [2025-10-10T22:34:50.794372] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-10-10T22:34:50.807925] [INFO ] [MAIN ] Derivative Progress: 117/1823 symbols completed. AR took 1.4s. Estimated remaining: 11m 2s. Rate: 154.7 symbols/min [2025-10-10T22:34:50.808213] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:50.809348] [DEBUG] [LOCAL ] ARDT: Loaded 28107 existing records from primary storage. [2025-10-10T22:34:50.809885] [INFO ] [MAIN ] ARDT: Loaded 28107 primary data records. [2025-10-10T22:34:51.196053] [DEBUG] [LOCAL ] ARE: Loaded 51530 existing records from primary storage. [2025-10-10T22:34:51.194834] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:51.197017] [INFO ] [MAIN ] ARDC: Generated 1820 derivative records from 15383 primary records. [2025-10-10T22:34:51.197093] [INFO ] [MAIN ] ARE: Loaded 51530 primary data records. [2025-10-10T22:34:51.197331] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-10-10T22:34:51.353887] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1820 records). [2025-10-10T22:34:51.384213] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-10-10T22:34:51.388064] [INFO ] [MAIN ] Derivative Progress: 118/1823 symbols completed. ARDC took 1.1s. Estimated remaining: 11m 4s. Rate: 154.1 symbols/min [2025-10-10T22:34:51.549163] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:51.550197] [INFO ] [MAIN ] ARDT: Generated 1820 derivative records from 28107 primary records. [2025-10-10T22:34:51.550351] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-10T22:34:51.569225] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1820 records). [2025-10-10T22:34:51.570075] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-10T22:34:51.572471] [INFO ] [MAIN ] Derivative Progress: 119/1823 symbols completed. ARDT took 1.1s. Estimated remaining: 11m 1s. Rate: 154.8 symbols/min [2025-10-10T22:34:51.593186] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:51.593871] [INFO ] [MAIN ] ARE: Generated 1820 derivative records from 51530 primary records. [2025-10-10T22:34:51.593933] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-10T22:34:51.609634] [DEBUG] [LOCAL ] ARE: Derivative data saved (1820 records). [2025-10-10T22:34:51.609721] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-10T22:34:51.612507] [INFO ] [MAIN ] Derivative Progress: 120/1823 symbols completed. ARE took 0.8s. Estimated remaining: 10m 55s. Rate: 155.9 symbols/min [2025-10-10T22:34:51.613373] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:51.613079] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:51.613218] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:51.681348] [DEBUG] [LOCAL ] ARI: Loaded 44298 existing records from primary storage. [2025-10-10T22:34:51.681740] [INFO ] [MAIN ] ARI: Loaded 44298 primary data records. [2025-10-10T22:34:51.793808] [DEBUG] [LOCAL ] ARIS: Loaded 43096 existing records from primary storage. [2025-10-10T22:34:51.800829] [INFO ] [MAIN ] ARIS: Loaded 43096 primary data records. [2025-10-10T22:34:51.929277] [DEBUG] [LOCAL ] ARES: Loaded 50417 existing records from primary storage. [2025-10-10T22:34:51.980477] [INFO ] [MAIN ] ARES: Loaded 50417 primary data records. [2025-10-10T22:34:52.708351] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:52.712276] [INFO ] [MAIN ] ARI: Generated 1820 derivative records from 44298 primary records. [2025-10-10T22:34:52.712381] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-10T22:34:52.743839] [DEBUG] [MAIN ] ARIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:52.743426] [DEBUG] [LOCAL ] ARI: Derivative data saved (1820 records). [2025-10-10T22:34:52.744682] [INFO ] [MAIN ] ARIS: Generated 1820 derivative records from 43096 primary records. [2025-10-10T22:34:52.744008] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-10-10T22:34:52.744947] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-10-10T22:34:52.747574] [INFO ] [MAIN ] Derivative Progress: 121/1823 symbols completed. ARI took 1.1s. Estimated remaining: 11m 6s. Rate: 153.4 symbols/min [2025-10-10T22:34:52.748625] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:52.768615] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1820 records). [2025-10-10T22:34:52.771687] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-10-10T22:34:52.774513] [INFO ] [MAIN ] Derivative Progress: 122/1823 symbols completed. ARIS took 1.2s. Estimated remaining: 11m 0s. Rate: 154.6 symbols/min [2025-10-10T22:34:52.774721] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:52.793397] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:52.794347] [INFO ] [MAIN ] ARES: Generated 1820 derivative records from 50417 primary records. [2025-10-10T22:34:52.794498] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-10T22:34:52.833212] [DEBUG] [LOCAL ] ARES: Derivative data saved (1820 records). [2025-10-10T22:34:52.833477] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-10-10T22:34:52.836350] [INFO ] [MAIN ] Derivative Progress: 123/1823 symbols completed. ARES took 1.2s. Estimated remaining: 10m 55s. Rate: 155.7 symbols/min [2025-10-10T22:34:52.848455] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:52.865976] [DEBUG] [LOCAL ] ARMK: Loaded 51094 existing records from primary storage. [2025-10-10T22:34:52.866248] [INFO ] [MAIN ] ARMK: Loaded 51094 primary data records. [2025-10-10T22:34:52.992555] [DEBUG] [LOCAL ] AROC: Loaded 49688 existing records from primary storage. [2025-10-10T22:34:53.004279] [INFO ] [MAIN ] AROC: Loaded 49688 primary data records. [2025-10-10T22:34:53.411200] [DEBUG] [LOCAL ] ARR: Loaded 52847 existing records from primary storage. [2025-10-10T22:34:53.472914] [INFO ] [MAIN ] ARR: Loaded 52847 primary data records. [2025-10-10T22:34:53.995714] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:53.996971] [INFO ] [MAIN ] ARMK: Generated 1820 derivative records from 51094 primary records. [2025-10-10T22:34:53.997182] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-10T22:34:54.021318] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1820 records). [2025-10-10T22:34:54.021618] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-10T22:34:54.023887] [INFO ] [MAIN ] Derivative Progress: 124/1823 symbols completed. ARMK took 1.3s. Estimated remaining: 11m 6s. Rate: 153.1 symbols/min [2025-10-10T22:34:54.024318] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:54.040561] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:54.041496] [INFO ] [MAIN ] AROC: Generated 1820 derivative records from 49688 primary records. [2025-10-10T22:34:54.041708] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-10T22:34:54.062086] [DEBUG] [LOCAL ] AROC: Derivative data saved (1820 records). [2025-10-10T22:34:54.062347] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-10-10T22:34:54.064608] [INFO ] [MAIN ] Derivative Progress: 125/1823 symbols completed. AROC took 1.3s. Estimated remaining: 11m 1s. Rate: 154.2 symbols/min [2025-10-10T22:34:54.065811] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:54.093618] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:54.094338] [INFO ] [MAIN ] ARR: Generated 1820 derivative records from 52847 primary records. [2025-10-10T22:34:54.094537] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-10T22:34:54.123849] [DEBUG] [LOCAL ] ARR: Derivative data saved (1820 records). [2025-10-10T22:34:54.124009] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-10-10T22:34:54.133403] [INFO ] [MAIN ] Derivative Progress: 126/1823 symbols completed. ARR took 1.3s. Estimated remaining: 10m 56s. Rate: 155.2 symbols/min [2025-10-10T22:34:54.130329] [DEBUG] [LOCAL ] ASA: Loaded 15035 existing records from primary storage. [2025-10-10T22:34:54.124667] [DEBUG] [LOCAL ] ARW: Loaded 33344 existing records from primary storage. [2025-10-10T22:34:54.133765] [INFO ] [MAIN ] ASA: Loaded 15035 primary data records. [2025-10-10T22:34:54.134110] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:54.133910] [INFO ] [MAIN ] ARW: Loaded 33344 primary data records. [2025-10-10T22:34:54.771575] [DEBUG] [LOCAL ] ASAN: Loaded 53501 existing records from primary storage. [2025-10-10T22:34:54.773401] [INFO ] [MAIN ] ASAN: Loaded 53501 primary data records. [2025-10-10T22:34:55.056974] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:55.057918] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:55.267453] [INFO ] [MAIN ] ASA: Generated 1820 derivative records from 15035 primary records. [2025-10-10T22:34:55.266384] [INFO ] [MAIN ] ARW: Generated 1820 derivative records from 33344 primary records. [2025-10-10T22:34:55.287303] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-10T22:34:55.287406] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-10T22:34:55.332795] [DEBUG] [LOCAL ] ASA: Derivative data saved (1820 records). [2025-10-10T22:34:55.336978] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-10T22:34:55.342478] [INFO ] [MAIN ] Derivative Progress: 127/1823 symbols completed. ASA took 1.3s. Estimated remaining: 11m 6s. Rate: 152.7 symbols/min [2025-10-10T22:34:55.345804] [DEBUG] [LOCAL ] ARW: Derivative data saved (1820 records). [2025-10-10T22:34:55.345953] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-10T22:34:55.344337] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:55.349384] [INFO ] [MAIN ] Derivative Progress: 128/1823 symbols completed. ARW took 1.3s. Estimated remaining: 11m 1s. Rate: 153.9 symbols/min [2025-10-10T22:34:55.350392] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:55.365795] [DEBUG] [LOCAL ] ASBA: Loaded 3495 existing records from primary storage. [2025-10-10T22:34:55.366614] [INFO ] [MAIN ] ASBA: Loaded 3495 primary data records. [2025-10-10T22:34:55.592724] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:55.631851] [INFO ] [MAIN ] ASAN: Generated 1820 derivative records from 53501 primary records. [2025-10-10T22:34:55.649387] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-10T22:34:55.827338] [DEBUG] [LOCAL ] ASB: Loaded 50308 existing records from primary storage. [2025-10-10T22:34:55.828159] [INFO ] [MAIN ] ASB: Loaded 50308 primary data records. [2025-10-10T22:34:55.884370] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1820 records). [2025-10-10T22:34:55.890678] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-10T22:34:55.914815] [INFO ] [MAIN ] Derivative Progress: 129/1823 symbols completed. ASAN took 1.8s. Estimated remaining: 11m 3s. Rate: 153.3 symbols/min [2025-10-10T22:34:55.945844] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:56.220229] [DEBUG] [LOCAL ] ASC: Loaded 37942 existing records from primary storage. [2025-10-10T22:34:56.233880] [INFO ] [MAIN ] ASC: Loaded 37942 primary data records. [2025-10-10T22:34:56.234509] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:56.275101] [INFO ] [MAIN ] ASBA: Generated 1820 derivative records from 3495 primary records. [2025-10-10T22:34:56.308925] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-10T22:34:56.374218] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1820 records). [2025-10-10T22:34:56.379874] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-10T22:34:56.411005] [INFO ] [MAIN ] Derivative Progress: 130/1823 symbols completed. ASBA took 1.1s. Estimated remaining: 11m 4s. Rate: 153.0 symbols/min [2025-10-10T22:34:56.447772] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:56.581362] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:56.582264] [INFO ] [MAIN ] ASB: Generated 1820 derivative records from 50308 primary records. [2025-10-10T22:34:56.582476] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-10T22:34:56.605347] [DEBUG] [LOCAL ] ASB: Derivative data saved (1820 records). [2025-10-10T22:34:56.606571] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-10T22:34:56.609459] [INFO ] [MAIN ] Derivative Progress: 131/1823 symbols completed. ASB took 1.3s. Estimated remaining: 11m 1s. Rate: 153.6 symbols/min [2025-10-10T22:34:56.610009] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:56.618383] [DEBUG] [LOCAL ] ASG: Loaded 19812 existing records from primary storage. [2025-10-10T22:34:56.618684] [INFO ] [MAIN ] ASG: Loaded 19812 primary data records. [2025-10-10T22:34:56.781706] [DEBUG] [LOCAL ] ASGI: Loaded 23095 existing records from primary storage. [2025-10-10T22:34:56.790930] [INFO ] [MAIN ] ASGI: Loaded 23095 primary data records. [2025-10-10T22:34:57.073770] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:57.138462] [INFO ] [MAIN ] ASC: Generated 1820 derivative records from 37942 primary records. [2025-10-10T22:34:57.309452] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-10T22:34:57.329976] [DEBUG] [LOCAL ] ASC: Derivative data saved (1820 records). [2025-10-10T22:34:57.331466] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-10T22:34:57.334105] [INFO ] [MAIN ] Derivative Progress: 132/1823 symbols completed. ASC took 1.4s. Estimated remaining: 11m 5s. Rate: 152.6 symbols/min [2025-10-10T22:34:57.334889] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:57.354099] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:57.356405] [INFO ] [MAIN ] ASG: Generated 1820 derivative records from 19812 primary records. [2025-10-10T22:34:57.356599] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-10T22:34:57.375427] [DEBUG] [LOCAL ] ASG: Derivative data saved (1820 records). [2025-10-10T22:34:57.375591] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-10T22:34:57.378682] [INFO ] [MAIN ] Derivative Progress: 133/1823 symbols completed. ASG took 0.9s. Estimated remaining: 11m 0s. Rate: 153.6 symbols/min [2025-10-10T22:34:57.407405] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:57.408347] [INFO ] [MAIN ] ASGI: Generated 1820 derivative records from 23095 primary records. [2025-10-10T22:34:57.408510] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-10T22:34:57.434289] [DEBUG] [LOCAL ] ASGN: Loaded 36896 existing records from primary storage. [2025-10-10T22:34:57.435152] [INFO ] [MAIN ] ASGN: Loaded 36896 primary data records. [2025-10-10T22:34:57.544075] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1820 records). [2025-10-10T22:34:57.544312] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-10T22:34:57.547133] [INFO ] [MAIN ] Derivative Progress: 134/1823 symbols completed. ASGI took 0.9s. Estimated remaining: 10m 57s. Rate: 154.3 symbols/min [2025-10-10T22:34:57.763721] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:57.764399] [INFO ] [MAIN ] ASGN: Generated 1820 derivative records from 36896 primary records. [2025-10-10T22:34:57.764464] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-10T22:34:57.779965] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1820 records). [2025-10-10T22:34:57.780030] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-10T22:34:57.782106] [INFO ] [MAIN ] Derivative Progress: 135/1823 symbols completed. ASGN took 0.4s. Estimated remaining: 10m 55s. Rate: 154.7 symbols/min [2025-10-10T22:34:57.783043] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:57.783157] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:57.782907] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:57.807752] [DEBUG] [LOCAL ] ASIX: Loaded 23212 existing records from primary storage. [2025-10-10T22:34:57.807920] [INFO ] [MAIN ] ASIX: Loaded 23212 primary data records. [2025-10-10T22:34:57.981025] [DEBUG] [LOCAL ] ASH: Loaded 38182 existing records from primary storage. [2025-10-10T22:34:58.127017] [INFO ] [MAIN ] ASH: Loaded 38182 primary data records. [2025-10-10T22:34:58.192507] [DEBUG] [LOCAL ] ASPN: Loaded 50499 existing records from primary storage. [2025-10-10T22:34:58.205372] [INFO ] [MAIN ] ASPN: Loaded 50499 primary data records. [2025-10-10T22:34:58.790229] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:58.792206] [INFO ] [MAIN ] ASIX: Generated 1820 derivative records from 23212 primary records. [2025-10-10T22:34:58.792560] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-10T22:34:58.812366] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1820 records). [2025-10-10T22:34:58.812672] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-10T22:34:58.815049] [INFO ] [MAIN ] Derivative Progress: 136/1823 symbols completed. ASIX took 1.0s. Estimated remaining: 11m 2s. Rate: 152.9 symbols/min [2025-10-10T22:34:58.815206] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:58.832771] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:58.833699] [INFO ] [MAIN ] ASH: Generated 1820 derivative records from 38182 primary records. [2025-10-10T22:34:58.833873] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-10T22:34:58.857044] [DEBUG] [LOCAL ] ASR: Loaded 9416 existing records from primary storage. [2025-10-10T22:34:58.857791] [INFO ] [MAIN ] ASR: Loaded 9416 primary data records. [2025-10-10T22:34:58.938463] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:58.951479] [INFO ] [MAIN ] ASPN: Generated 1820 derivative records from 50499 primary records. [2025-10-10T22:34:58.952708] [DEBUG] [LOCAL ] ASH: Derivative data saved (1820 records). [2025-10-10T22:34:58.957998] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-10T22:34:58.963455] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-10T22:34:58.966359] [INFO ] [MAIN ] Derivative Progress: 137/1823 symbols completed. ASH took 1.2s. Estimated remaining: 10m 59s. Rate: 153.6 symbols/min [2025-10-10T22:34:58.982523] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:59.233455] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1820 records). [2025-10-10T22:34:59.234296] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-10T22:34:59.237782] [INFO ] [MAIN ] Derivative Progress: 138/1823 symbols completed. ASPN took 1.5s. Estimated remaining: 10m 57s. Rate: 153.9 symbols/min [2025-10-10T22:34:59.238120] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:59.285993] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:59.302127] [INFO ] [MAIN ] ASR: Generated 1820 derivative records from 9416 primary records. [2025-10-10T22:34:59.302213] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-10T22:34:59.304144] [DEBUG] [LOCAL ] ASX: Loaded 53634 existing records from primary storage. [2025-10-10T22:34:59.325425] [INFO ] [MAIN ] ASX: Loaded 53634 primary data records. [2025-10-10T22:34:59.328418] [DEBUG] [LOCAL ] ATEN: Loaded 39300 existing records from primary storage. [2025-10-10T22:34:59.339779] [INFO ] [MAIN ] ATEN: Loaded 39300 primary data records. [2025-10-10T22:34:59.533251] [DEBUG] [LOCAL ] ASR: Derivative data saved (1820 records). [2025-10-10T22:34:59.559727] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-10T22:34:59.584721] [INFO ] [MAIN ] Derivative Progress: 139/1823 symbols completed. ASR took 0.8s. Estimated remaining: 10m 56s. Rate: 154.0 symbols/min [2025-10-10T22:34:59.627171] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:34:59.971423] [DEBUG] [LOCAL ] ATGE: Loaded 31480 existing records from primary storage. [2025-10-10T22:34:59.972171] [INFO ] [MAIN ] ATGE: Loaded 31480 primary data records. [2025-10-10T22:34:59.972510] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:34:59.995515] [INFO ] [MAIN ] ASX: Generated 1820 derivative records from 53634 primary records. [2025-10-10T22:35:00.006676] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-10T22:35:00.094773] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:00.105510] [INFO ] [MAIN ] ATEN: Generated 1820 derivative records from 39300 primary records. [2025-10-10T22:35:00.114847] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-10T22:35:00.121569] [DEBUG] [LOCAL ] ASX: Derivative data saved (1820 records). [2025-10-10T22:35:00.140488] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-10T22:35:00.155406] [INFO ] [MAIN ] Derivative Progress: 140/1823 symbols completed. ASX took 1.2s. Estimated remaining: 10m 58s. Rate: 153.5 symbols/min [2025-10-10T22:35:00.191780] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1820 records). [2025-10-10T22:35:00.179789] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:00.201539] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-10T22:35:00.222894] [INFO ] [MAIN ] Derivative Progress: 141/1823 symbols completed. ATEN took 1.0s. Estimated remaining: 10m 54s. Rate: 154.4 symbols/min [2025-10-10T22:35:00.226819] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:00.352400] [DEBUG] [LOCAL ] ATHS: Loaded 6841 existing records from primary storage. [2025-10-10T22:35:00.352676] [INFO ] [MAIN ] ATHS: Loaded 6841 primary data records. [2025-10-10T22:35:00.523686] [DEBUG] [LOCAL ] ATHM: Loaded 32282 existing records from primary storage. [2025-10-10T22:35:00.524571] [INFO ] [MAIN ] ATHM: Loaded 32282 primary data records. [2025-10-10T22:35:00.899447] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:01.028374] [INFO ] [MAIN ] ATGE: Generated 1820 derivative records from 31480 primary records. [2025-10-10T22:35:01.028801] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-10T22:35:01.077640] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1820 records). [2025-10-10T22:35:01.078132] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:01.078596] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-10T22:35:01.079568] [INFO ] [MAIN ] ATHS: Generated 1820 derivative records from 6841 primary records. [2025-10-10T22:35:01.082523] [INFO ] [MAIN ] Derivative Progress: 142/1823 symbols completed. ATGE took 1.5s. Estimated remaining: 10m 59s. Rate: 153.1 symbols/min [2025-10-10T22:35:01.082885] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-10T22:35:01.083084] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:01.102849] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1820 records). [2025-10-10T22:35:01.103062] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-10T22:35:01.105450] [INFO ] [MAIN ] Derivative Progress: 143/1823 symbols completed. ATHS took 0.9s. Estimated remaining: 10m 54s. Rate: 154.1 symbols/min [2025-10-10T22:35:01.106126] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:01.126527] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:01.127833] [INFO ] [MAIN ] ATHM: Generated 1820 derivative records from 32282 primary records. [2025-10-10T22:35:01.128047] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-10T22:35:01.173628] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1820 records). [2025-10-10T22:35:01.173817] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-10T22:35:01.176117] [INFO ] [MAIN ] Derivative Progress: 144/1823 symbols completed. ATHM took 1.0s. Estimated remaining: 10m 50s. Rate: 155.0 symbols/min [2025-10-10T22:35:01.188594] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:01.190179] [DEBUG] [LOCAL ] ATMU: Loaded 39700 existing records from primary storage. [2025-10-10T22:35:01.207408] [INFO ] [MAIN ] ATMU: Loaded 39700 primary data records. [2025-10-10T22:35:01.251412] [DEBUG] [LOCAL ] ATI: Loaded 52075 existing records from primary storage. [2025-10-10T22:35:01.283746] [INFO ] [MAIN ] ATI: Loaded 52075 primary data records. [2025-10-10T22:35:01.836262] [DEBUG] [LOCAL ] ATO: Loaded 42368 existing records from primary storage. [2025-10-10T22:35:01.963316] [INFO ] [MAIN ] ATO: Loaded 42368 primary data records. [2025-10-10T22:35:02.336012] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:02.337214] [INFO ] [MAIN ] ATMU: Generated 1820 derivative records from 39700 primary records. [2025-10-10T22:35:02.337354] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-10T22:35:02.370204] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:02.374079] [INFO ] [MAIN ] ATI: Generated 1820 derivative records from 52075 primary records. [2025-10-10T22:35:02.374917] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-10T22:35:02.377167] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1820 records). [2025-10-10T22:35:02.390025] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-10T22:35:02.396469] [INFO ] [MAIN ] Derivative Progress: 145/1823 symbols completed. ATMU took 1.3s. Estimated remaining: 10m 59s. Rate: 152.7 symbols/min [2025-10-10T22:35:02.398634] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:02.400992] [DEBUG] [LOCAL ] ATI: Derivative data saved (1820 records). [2025-10-10T22:35:02.401472] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-10T22:35:02.404925] [INFO ] [MAIN ] Derivative Progress: 146/1823 symbols completed. ATI took 1.3s. Estimated remaining: 10m 54s. Rate: 153.8 symbols/min [2025-10-10T22:35:02.405681] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:02.433914] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:02.435140] [INFO ] [MAIN ] ATO: Generated 1820 derivative records from 42368 primary records. [2025-10-10T22:35:02.435269] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-10T22:35:02.462007] [DEBUG] [LOCAL ] ATS: Loaded 17912 existing records from primary storage. [2025-10-10T22:35:02.462723] [INFO ] [MAIN ] ATS: Loaded 17912 primary data records. [2025-10-10T22:35:02.464576] [DEBUG] [LOCAL ] ATO: Derivative data saved (1820 records). [2025-10-10T22:35:02.499115] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-10T22:35:02.556761] [INFO ] [MAIN ] Derivative Progress: 147/1823 symbols completed. ATO took 1.4s. Estimated remaining: 10m 51s. Rate: 154.4 symbols/min [2025-10-10T22:35:02.575206] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:02.649199] [DEBUG] [LOCAL ] ATR: Loaded 31070 existing records from primary storage. [2025-10-10T22:35:02.687425] [INFO ] [MAIN ] ATR: Loaded 31070 primary data records. [2025-10-10T22:35:03.189177] [DEBUG] [LOCAL ] ATUS: Loaded 50199 existing records from primary storage. [2025-10-10T22:35:03.191489] [INFO ] [MAIN ] ATUS: Loaded 50199 primary data records. [2025-10-10T22:35:03.605297] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:03.607546] [INFO ] [MAIN ] ATS: Generated 1820 derivative records from 17912 primary records. [2025-10-10T22:35:03.607849] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-10T22:35:03.629876] [DEBUG] [LOCAL ] ATS: Derivative data saved (1820 records). [2025-10-10T22:35:03.630536] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-10T22:35:03.646351] [INFO ] [MAIN ] Derivative Progress: 148/1823 symbols completed. ATS took 1.2s. Estimated remaining: 10m 59s. Rate: 152.5 symbols/min [2025-10-10T22:35:03.647113] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:03.647987] [INFO ] [MAIN ] ATR: Generated 1820 derivative records from 31070 primary records. [2025-10-10T22:35:03.648438] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-10T22:35:03.669367] [DEBUG] [LOCAL ] ATR: Derivative data saved (1820 records). [2025-10-10T22:35:03.669726] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-10T22:35:03.673032] [INFO ] [MAIN ] Derivative Progress: 149/1823 symbols completed. ATR took 1.3s. Estimated remaining: 10m 54s. Rate: 153.5 symbols/min [2025-10-10T22:35:03.688421] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:03.689106] [INFO ] [MAIN ] ATUS: Generated 1820 derivative records from 50199 primary records. [2025-10-10T22:35:03.689173] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-10T22:35:03.704596] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1820 records). [2025-10-10T22:35:03.704695] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-10T22:35:03.707537] [INFO ] [MAIN ] Derivative Progress: 150/1823 symbols completed. ATUS took 1.1s. Estimated remaining: 10m 50s. Rate: 154.4 symbols/min [2025-10-10T22:35:03.708269] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:03.708408] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:03.709076] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:03.719702] [DEBUG] [LOCAL ] AUNA: Loaded 5124 existing records from primary storage. [2025-10-10T22:35:03.719940] [INFO ] [MAIN ] AUNA: Loaded 5124 primary data records. [2025-10-10T22:35:04.110734] [DEBUG] [LOCAL ] AU: Loaded 53767 existing records from primary storage. [2025-10-10T22:35:04.112949] [DEBUG] [LOCAL ] AUB: Loaded 46863 existing records from primary storage. [2025-10-10T22:35:04.114151] [INFO ] [MAIN ] AUB: Loaded 46863 primary data records. [2025-10-10T22:35:04.113132] [INFO ] [MAIN ] AU: Loaded 53767 primary data records. [2025-10-10T22:35:04.783865] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:04.787549] [INFO ] [MAIN ] AUNA: Generated 1820 derivative records from 5124 primary records. [2025-10-10T22:35:04.788217] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-10T22:35:04.807689] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1820 records). [2025-10-10T22:35:04.808127] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-10T22:35:04.811617] [INFO ] [MAIN ] Derivative Progress: 151/1823 symbols completed. AUNA took 1.1s. Estimated remaining: 10m 57s. Rate: 152.6 symbols/min [2025-10-10T22:35:04.813024] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:04.842713] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:04.844080] [INFO ] [MAIN ] AUB: Generated 1820 derivative records from 46863 primary records. [2025-10-10T22:35:04.857157] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-10T22:35:04.858044] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:04.859784] [INFO ] [MAIN ] AU: Generated 1820 derivative records from 53767 primary records. [2025-10-10T22:35:04.870991] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-10T22:35:04.901902] [DEBUG] [LOCAL ] AU: Derivative data saved (1820 records). [2025-10-10T22:35:04.902575] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-10T22:35:04.905392] [INFO ] [MAIN ] Derivative Progress: 152/1823 symbols completed. AU took 1.2s. Estimated remaining: 10m 54s. Rate: 153.4 symbols/min [2025-10-10T22:35:04.905920] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:04.920270] [DEBUG] [LOCAL ] AUB: Derivative data saved (1820 records). [2025-10-10T22:35:04.920587] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-10T22:35:04.923937] [INFO ] [MAIN ] Derivative Progress: 153/1823 symbols completed. AUB took 1.2s. Estimated remaining: 10m 49s. Rate: 154.3 symbols/min [2025-10-10T22:35:04.926025] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:04.925915] [DEBUG] [LOCAL ] AVA: Loaded 39567 existing records from primary storage. [2025-10-10T22:35:04.926611] [INFO ] [MAIN ] AVA: Loaded 39567 primary data records. [2025-10-10T22:35:04.979945] [DEBUG] [LOCAL ] AVAL: Loaded 8816 existing records from primary storage. [2025-10-10T22:35:05.001023] [INFO ] [MAIN ] AVAL: Loaded 8816 primary data records. [2025-10-10T22:35:05.670367] [DEBUG] [LOCAL ] AVB: Loaded 42671 existing records from primary storage. [2025-10-10T22:35:05.670867] [INFO ] [MAIN ] AVB: Loaded 42671 primary data records. [2025-10-10T22:35:06.017439] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:06.019891] [INFO ] [MAIN ] AVA: Generated 1820 derivative records from 39567 primary records. [2025-10-10T22:35:06.034076] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-10T22:35:06.034509] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:06.035676] [INFO ] [MAIN ] AVAL: Generated 1820 derivative records from 8816 primary records. [2025-10-10T22:35:06.036179] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-10T22:35:06.070712] [DEBUG] [LOCAL ] AVA: Derivative data saved (1820 records). [2025-10-10T22:35:06.071613] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-10T22:35:06.076288] [INFO ] [MAIN ] Derivative Progress: 154/1823 symbols completed. AVA took 1.3s. Estimated remaining: 10m 57s. Rate: 152.4 symbols/min [2025-10-10T22:35:06.074002] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1820 records). [2025-10-10T22:35:06.089700] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:06.089482] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:06.089830] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-10T22:35:06.091476] [INFO ] [MAIN ] AVB: Generated 1820 derivative records from 42671 primary records. [2025-10-10T22:35:06.091583] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-10T22:35:06.095178] [INFO ] [MAIN ] Derivative Progress: 155/1823 symbols completed. AVAL took 1.2s. Estimated remaining: 10m 53s. Rate: 153.3 symbols/min [2025-10-10T22:35:06.096489] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:06.113113] [DEBUG] [LOCAL ] AVB: Derivative data saved (1820 records). [2025-10-10T22:35:06.113369] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-10T22:35:06.116235] [INFO ] [MAIN ] Derivative Progress: 156/1823 symbols completed. AVB took 1.2s. Estimated remaining: 10m 48s. Rate: 154.2 symbols/min [2025-10-10T22:35:06.116576] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:06.139781] [DEBUG] [LOCAL ] AVD: Loaded 22475 existing records from primary storage. [2025-10-10T22:35:06.139980] [INFO ] [MAIN ] AVD: Loaded 22475 primary data records. [2025-10-10T22:35:06.212877] [DEBUG] [LOCAL ] AVK: Loaded 18620 existing records from primary storage. [2025-10-10T22:35:06.228243] [INFO ] [MAIN ] AVK: Loaded 18620 primary data records. [2025-10-10T22:35:06.370259] [DEBUG] [LOCAL ] AVNS: Loaded 33979 existing records from primary storage. [2025-10-10T22:35:06.391367] [INFO ] [MAIN ] AVNS: Loaded 33979 primary data records. [2025-10-10T22:35:07.146307] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:07.150694] [INFO ] [MAIN ] AVD: Generated 1820 derivative records from 22475 primary records. [2025-10-10T22:35:07.150999] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-10T22:35:07.179163] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:07.180834] [INFO ] [MAIN ] AVK: Generated 1820 derivative records from 18620 primary records. [2025-10-10T22:35:07.181253] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-10T22:35:07.182597] [DEBUG] [LOCAL ] AVD: Derivative data saved (1820 records). [2025-10-10T22:35:07.183028] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-10T22:35:07.185255] [INFO ] [MAIN ] Derivative Progress: 157/1823 symbols completed. AVD took 1.1s. Estimated remaining: 10m 55s. Rate: 152.5 symbols/min [2025-10-10T22:35:07.185923] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:07.210240] [DEBUG] [LOCAL ] AVK: Derivative data saved (1820 records). [2025-10-10T22:35:07.210533] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-10T22:35:07.213070] [INFO ] [MAIN ] Derivative Progress: 158/1823 symbols completed. AVK took 1.1s. Estimated remaining: 10m 51s. Rate: 153.5 symbols/min [2025-10-10T22:35:07.221137] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:07.226989] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:07.227665] [INFO ] [MAIN ] AVNS: Generated 1820 derivative records from 33979 primary records. [2025-10-10T22:35:07.227728] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-10T22:35:07.245702] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1820 records). [2025-10-10T22:35:07.255468] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-10T22:35:07.257958] [INFO ] [MAIN ] Derivative Progress: 159/1823 symbols completed. AVNS took 1.1s. Estimated remaining: 10m 47s. Rate: 154.3 symbols/min [2025-10-10T22:35:07.258223] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:07.275149] [DEBUG] [LOCAL ] AVNT: Loaded 39655 existing records from primary storage. [2025-10-10T22:35:07.275363] [INFO ] [MAIN ] AVNT: Loaded 39655 primary data records. [2025-10-10T22:35:07.476534] [DEBUG] [LOCAL ] AWF: Loaded 24541 existing records from primary storage. [2025-10-10T22:35:07.505033] [INFO ] [MAIN ] AWF: Loaded 24541 primary data records. [2025-10-10T22:35:07.499674] [DEBUG] [LOCAL ] AVTR: Loaded 54340 existing records from primary storage. [2025-10-10T22:35:07.505372] [INFO ] [MAIN ] AVTR: Loaded 54340 primary data records. [2025-10-10T22:35:08.320284] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:08.321554] [INFO ] [MAIN ] AVNT: Generated 1820 derivative records from 39655 primary records. [2025-10-10T22:35:08.321968] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-10T22:35:08.341983] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1820 records). [2025-10-10T22:35:08.342565] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-10T22:35:08.344709] [INFO ] [MAIN ] Derivative Progress: 160/1823 symbols completed. AVNT took 1.2s. Estimated remaining: 10m 54s. Rate: 152.6 symbols/min [2025-10-10T22:35:08.345111] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:08.364837] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:08.378427] [INFO ] [MAIN ] AWF: Generated 1820 derivative records from 24541 primary records. [2025-10-10T22:35:08.377675] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:08.379426] [INFO ] [MAIN ] AVTR: Generated 1820 derivative records from 54340 primary records. [2025-10-10T22:35:08.379499] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-10T22:35:08.380371] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-10T22:35:08.427570] [DEBUG] [LOCAL ] AWF: Derivative data saved (1820 records). [2025-10-10T22:35:08.428667] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-10T22:35:08.429235] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1820 records). [2025-10-10T22:35:08.431583] [INFO ] [MAIN ] Derivative Progress: 161/1823 symbols completed. AWF took 1.2s. Estimated remaining: 10m 50s. Rate: 153.3 symbols/min [2025-10-10T22:35:08.431757] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-10T22:35:08.429117] [DEBUG] [LOCAL ] AWI: Loaded 25695 existing records from primary storage. [2025-10-10T22:35:08.432006] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:08.435054] [INFO ] [MAIN ] AWI: Loaded 25695 primary data records. [2025-10-10T22:35:08.434549] [INFO ] [MAIN ] Derivative Progress: 162/1823 symbols completed. AVTR took 1.2s. Estimated remaining: 10m 46s. Rate: 154.3 symbols/min [2025-10-10T22:35:08.435238] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:08.738311] [DEBUG] [LOCAL ] AWP: Loaded 21748 existing records from primary storage. [2025-10-10T22:35:08.760235] [INFO ] [MAIN ] AWP: Loaded 21748 primary data records. [2025-10-10T22:35:08.897032] [DEBUG] [LOCAL ] AWK: Loaded 49396 existing records from primary storage. [2025-10-10T22:35:08.898442] [INFO ] [MAIN ] AWK: Loaded 49396 primary data records. [2025-10-10T22:35:09.434691] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:09.435586] [INFO ] [MAIN ] AWI: Generated 1820 derivative records from 25695 primary records. [2025-10-10T22:35:09.435740] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-10T22:35:09.456405] [DEBUG] [LOCAL ] AWI: Derivative data saved (1820 records). [2025-10-10T22:35:09.458532] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-10T22:35:09.461549] [INFO ] [MAIN ] Derivative Progress: 163/1823 symbols completed. AWI took 1.1s. Estimated remaining: 10m 52s. Rate: 152.7 symbols/min [2025-10-10T22:35:09.475507] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:09.476198] [INFO ] [MAIN ] AWP: Generated 1820 derivative records from 21748 primary records. [2025-10-10T22:35:09.476340] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-10T22:35:09.506421] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:09.507743] [DEBUG] [LOCAL ] AWP: Derivative data saved (1820 records). [2025-10-10T22:35:09.507449] [INFO ] [MAIN ] AWK: Generated 1820 derivative records from 49396 primary records. [2025-10-10T22:35:09.507854] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-10T22:35:09.510161] [INFO ] [MAIN ] Derivative Progress: 164/1823 symbols completed. AWP took 1.1s. Estimated remaining: 10m 48s. Rate: 153.6 symbols/min [2025-10-10T22:35:09.510249] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-10T22:35:09.526504] [DEBUG] [LOCAL ] AWK: Derivative data saved (1820 records). [2025-10-10T22:35:09.526562] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-10T22:35:09.528980] [INFO ] [MAIN ] Derivative Progress: 165/1823 symbols completed. AWK took 1.1s. Estimated remaining: 10m 44s. Rate: 154.5 symbols/min [2025-10-10T22:35:09.529361] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:09.529412] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:09.529535] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:09.562374] [DEBUG] [LOCAL ] AWR: Loaded 23017 existing records from primary storage. [2025-10-10T22:35:09.562551] [INFO ] [MAIN ] AWR: Loaded 23017 primary data records. [2025-10-10T22:35:09.687542] [DEBUG] [LOCAL ] AX: Loaded 28446 existing records from primary storage. [2025-10-10T22:35:09.687736] [INFO ] [MAIN ] AX: Loaded 28446 primary data records. [2025-10-10T22:35:09.871117] [DEBUG] [LOCAL ] AXL: Loaded 51267 existing records from primary storage. [2025-10-10T22:35:09.878783] [INFO ] [MAIN ] AXL: Loaded 51267 primary data records. [2025-10-10T22:35:10.537922] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:10.539031] [INFO ] [MAIN ] AWR: Generated 1820 derivative records from 23017 primary records. [2025-10-10T22:35:10.551124] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-10T22:35:10.551688] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:10.553020] [INFO ] [MAIN ] AX: Generated 1820 derivative records from 28446 primary records. [2025-10-10T22:35:10.553345] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-10T22:35:10.585757] [DEBUG] [LOCAL ] AX: Derivative data saved (1820 records). [2025-10-10T22:35:10.585936] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-10T22:35:10.585883] [DEBUG] [LOCAL ] AWR: Derivative data saved (1820 records). [2025-10-10T22:35:10.595520] [INFO ] [MAIN ] Derivative Progress: 166/1823 symbols completed. AX took 1.1s. Estimated remaining: 10m 50s. Rate: 152.9 symbols/min [2025-10-10T22:35:10.600402] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-10T22:35:10.600560] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:10.601017] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:10.601831] [INFO ] [MAIN ] AXL: Generated 1820 derivative records from 51267 primary records. [2025-10-10T22:35:10.604477] [INFO ] [MAIN ] Derivative Progress: 167/1823 symbols completed. AWR took 1.1s. Estimated remaining: 10m 46s. Rate: 153.8 symbols/min [2025-10-10T22:35:10.604746] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-10T22:35:10.604855] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:10.621612] [DEBUG] [LOCAL ] AXL: Derivative data saved (1820 records). [2025-10-10T22:35:10.621779] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-10T22:35:10.624916] [INFO ] [MAIN ] Derivative Progress: 168/1823 symbols completed. AXL took 1.1s. Estimated remaining: 10m 42s. Rate: 154.6 symbols/min [2025-10-10T22:35:10.625565] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:10.686402] [DEBUG] [LOCAL ] AXS: Loaded 39207 existing records from primary storage. [2025-10-10T22:35:10.686808] [INFO ] [MAIN ] AXS: Loaded 39207 primary data records. [2025-10-10T22:35:10.769835] [DEBUG] [LOCAL ] AXP: Loaded 53949 existing records from primary storage. [2025-10-10T22:35:10.790252] [INFO ] [MAIN ] AXP: Loaded 53949 primary data records. [2025-10-10T22:35:10.822536] [DEBUG] [LOCAL ] AXTA: Loaded 52953 existing records from primary storage. [2025-10-10T22:35:10.876818] [INFO ] [MAIN ] AXTA: Loaded 52953 primary data records. [2025-10-10T22:35:11.696311] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:11.697687] [INFO ] [MAIN ] AXS: Generated 1820 derivative records from 39207 primary records. [2025-10-10T22:35:11.696824] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:11.698694] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-10T22:35:11.699451] [INFO ] [MAIN ] AXP: Generated 1820 derivative records from 53949 primary records. [2025-10-10T22:35:11.701832] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-10T22:35:11.717546] [DEBUG] [LOCAL ] AXS: Derivative data saved (1820 records). [2025-10-10T22:35:11.717664] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-10T22:35:11.732180] [INFO ] [MAIN ] Derivative Progress: 169/1823 symbols completed. AXS took 1.1s. Estimated remaining: 10m 49s. Rate: 152.9 symbols/min [2025-10-10T22:35:11.741549] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:11.732332] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:11.745308] [INFO ] [MAIN ] AXTA: Generated 1820 derivative records from 52953 primary records. [2025-10-10T22:35:11.745678] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-10T22:35:11.765939] [DEBUG] [LOCAL ] AXP: Derivative data saved (1820 records). [2025-10-10T22:35:11.766123] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-10T22:35:11.768453] [INFO ] [MAIN ] Derivative Progress: 170/1823 symbols completed. AXP took 1.2s. Estimated remaining: 10m 45s. Rate: 153.8 symbols/min [2025-10-10T22:35:11.768819] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:11.769711] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1820 records). [2025-10-10T22:35:11.770242] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-10T22:35:11.773609] [INFO ] [MAIN ] Derivative Progress: 171/1823 symbols completed. AXTA took 1.1s. Estimated remaining: 10m 41s. Rate: 154.7 symbols/min [2025-10-10T22:35:11.773808] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:11.795336] [DEBUG] [LOCAL ] AYI: Loaded 25627 existing records from primary storage. [2025-10-10T22:35:11.795527] [INFO ] [MAIN ] AYI: Loaded 25627 primary data records. [2025-10-10T22:35:11.860101] [DEBUG] [LOCAL ] AZO: Loaded 11422 existing records from primary storage. [2025-10-10T22:35:11.891005] [INFO ] [MAIN ] AZO: Loaded 11422 primary data records. [2025-10-10T22:35:12.032135] [DEBUG] [LOCAL ] AZZ: Loaded 22750 existing records from primary storage. [2025-10-10T22:35:12.093422] [INFO ] [MAIN ] AZZ: Loaded 22750 primary data records. [2025-10-10T22:35:12.765256] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:12.766569] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:35:12.767427] [INFO ] [MAIN ] AZO: Generated 1820 derivative records from 11422 primary records. [2025-10-10T22:35:12.768048] [INFO ] [MAIN ] AYI: Generated 1819 derivative records from 25627 primary records. [2025-10-10T22:35:12.768434] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-10T22:35:12.768525] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-10T22:35:12.798566] [DEBUG] [LOCAL ] AZO: Derivative data saved (1820 records). [2025-10-10T22:35:12.799026] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-10T22:35:12.801603] [INFO ] [MAIN ] Derivative Progress: 172/1823 symbols completed. AZO took 1.0s. Estimated remaining: 10m 47s. Rate: 153.2 symbols/min [2025-10-10T22:35:12.802575] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:12.807809] [DEBUG] [LOCAL ] AYI: Derivative data saved (1819 records). [2025-10-10T22:35:12.807992] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-10T22:35:12.810279] [INFO ] [MAIN ] Derivative Progress: 173/1823 symbols completed. AYI took 1.1s. Estimated remaining: 10m 43s. Rate: 154.1 symbols/min [2025-10-10T22:35:12.810503] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:12.823539] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:12.824250] [INFO ] [MAIN ] AZZ: Generated 1820 derivative records from 22750 primary records. [2025-10-10T22:35:12.824357] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-10T22:35:12.842283] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1820 records). [2025-10-10T22:35:12.842490] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-10T22:35:12.845023] [INFO ] [MAIN ] Derivative Progress: 174/1823 symbols completed. AZZ took 1.1s. Estimated remaining: 10m 39s. Rate: 154.9 symbols/min [2025-10-10T22:35:12.845763] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:12.912535] [DEBUG] [LOCAL ] BA: Loaded 54570 existing records from primary storage. [2025-10-10T22:35:12.912825] [INFO ] [MAIN ] BA: Loaded 54570 primary data records. [2025-10-10T22:35:13.042702] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-10-10T22:35:13.069102] [INFO ] [MAIN ] BABA: Loaded 54600 primary data records. [2025-10-10T22:35:13.349618] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-10-10T22:35:13.361354] [INFO ] [MAIN ] BAC: Loaded 54588 primary data records. [2025-10-10T22:35:13.902415] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:13.903299] [INFO ] [MAIN ] BA: Generated 1820 derivative records from 54570 primary records. [2025-10-10T22:35:13.903558] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-10T22:35:13.922379] [DEBUG] [LOCAL ] BA: Derivative data saved (1820 records). [2025-10-10T22:35:13.923845] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-10T22:35:13.925848] [INFO ] [MAIN ] Derivative Progress: 175/1823 symbols completed. BA took 1.1s. Estimated remaining: 10m 45s. Rate: 153.3 symbols/min [2025-10-10T22:35:13.926129] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:13.940539] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:13.941304] [INFO ] [MAIN ] BABA: Generated 1820 derivative records from 54600 primary records. [2025-10-10T22:35:13.941500] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-10T22:35:13.974853] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:13.977294] [INFO ] [MAIN ] BAC: Generated 1820 derivative records from 54588 primary records. [2025-10-10T22:35:13.977427] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-10T22:35:13.976459] [DEBUG] [LOCAL ] BABA: Derivative data saved (1820 records). [2025-10-10T22:35:13.992356] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-10T22:35:13.995543] [DEBUG] [LOCAL ] BAC: Derivative data saved (1820 records). [2025-10-10T22:35:13.998977] [INFO ] [MAIN ] Derivative Progress: 176/1823 symbols completed. BABA took 1.2s. Estimated remaining: 10m 42s. Rate: 154.0 symbols/min [2025-10-10T22:35:13.999171] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-10T22:35:13.999354] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:14.002447] [INFO ] [MAIN ] Derivative Progress: 177/1823 symbols completed. BAC took 1.2s. Estimated remaining: 10m 38s. Rate: 154.9 symbols/min [2025-10-10T22:35:14.002704] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:14.041536] [DEBUG] [LOCAL ] BAH: Loaded 52445 existing records from primary storage. [2025-10-10T22:35:14.041950] [INFO ] [MAIN ] BAH: Loaded 52445 primary data records. [2025-10-10T22:35:14.313956] [DEBUG] [LOCAL ] BAM: Loaded 52777 existing records from primary storage. [2025-10-10T22:35:14.379706] [INFO ] [MAIN ] BAM: Loaded 52777 primary data records. [2025-10-10T22:35:14.379550] [DEBUG] [LOCAL ] BALL: Loaded 52599 existing records from primary storage. [2025-10-10T22:35:14.405281] [INFO ] [MAIN ] BALL: Loaded 52599 primary data records. [2025-10-10T22:35:15.030272] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:15.032699] [INFO ] [MAIN ] BAH: Generated 1820 derivative records from 52445 primary records. [2025-10-10T22:35:15.033608] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-10-10T22:35:15.056212] [DEBUG] [LOCAL ] BAH: Derivative data saved (1820 records). [2025-10-10T22:35:15.057153] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-10-10T22:35:15.059427] [INFO ] [MAIN ] Derivative Progress: 178/1823 symbols completed. BAH took 1.1s. Estimated remaining: 10m 43s. Rate: 153.4 symbols/min [2025-10-10T22:35:15.094378] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:15.094731] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:15.096328] [INFO ] [MAIN ] BALL: Generated 1820 derivative records from 52599 primary records. [2025-10-10T22:35:15.095591] [INFO ] [MAIN ] BAM: Generated 1820 derivative records from 52777 primary records. [2025-10-10T22:35:15.096538] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-10T22:35:15.096460] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-10T22:35:15.126721] [DEBUG] [LOCAL ] BAM: Derivative data saved (1820 records). [2025-10-10T22:35:15.127079] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-10T22:35:15.130059] [INFO ] [MAIN ] Derivative Progress: 179/1823 symbols completed. BAM took 1.1s. Estimated remaining: 10m 40s. Rate: 154.1 symbols/min [2025-10-10T22:35:15.132255] [DEBUG] [LOCAL ] BALL: Derivative data saved (1820 records). [2025-10-10T22:35:15.132323] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-10T22:35:15.134970] [INFO ] [MAIN ] Derivative Progress: 180/1823 symbols completed. BALL took 1.1s. Estimated remaining: 10m 36s. Rate: 154.9 symbols/min [2025-10-10T22:35:15.135404] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:15.135457] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:15.135348] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:15.174005] [DEBUG] [LOCAL ] BAP: Loaded 26295 existing records from primary storage. [2025-10-10T22:35:15.174156] [INFO ] [MAIN ] BAP: Loaded 26295 primary data records. [2025-10-10T22:35:15.284929] [DEBUG] [LOCAL ] BARK: Loaded 38560 existing records from primary storage. [2025-10-10T22:35:15.290720] [INFO ] [MAIN ] BARK: Loaded 38560 primary data records. [2025-10-10T22:35:15.689187] [DEBUG] [LOCAL ] BANC: Loaded 52050 existing records from primary storage. [2025-10-10T22:35:15.721719] [INFO ] [MAIN ] BANC: Loaded 52050 primary data records. [2025-10-10T22:35:16.198392] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:16.199617] [INFO ] [MAIN ] BAP: Generated 1820 derivative records from 26295 primary records. [2025-10-10T22:35:16.200437] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-10T22:35:16.222217] [DEBUG] [LOCAL ] BAP: Derivative data saved (1820 records). [2025-10-10T22:35:16.222722] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-10T22:35:16.225099] [INFO ] [MAIN ] Derivative Progress: 181/1823 symbols completed. BAP took 1.1s. Estimated remaining: 10m 42s. Rate: 153.4 symbols/min [2025-10-10T22:35:16.239713] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:16.240270] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:16.242014] [INFO ] [MAIN ] BARK: Generated 1820 derivative records from 38560 primary records. [2025-10-10T22:35:16.243563] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-10T22:35:16.269126] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:16.274142] [INFO ] [MAIN ] BANC: Generated 1820 derivative records from 52050 primary records. [2025-10-10T22:35:16.276390] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-10T22:35:16.278847] [DEBUG] [LOCAL ] BARK: Derivative data saved (1820 records). [2025-10-10T22:35:16.279309] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-10T22:35:16.281755] [INFO ] [MAIN ] Derivative Progress: 182/1823 symbols completed. BARK took 1.1s. Estimated remaining: 10m 39s. Rate: 154.1 symbols/min [2025-10-10T22:35:16.281984] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:16.312791] [DEBUG] [LOCAL ] BANC: Derivative data saved (1820 records). [2025-10-10T22:35:16.313089] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-10T22:35:16.315731] [INFO ] [MAIN ] Derivative Progress: 183/1823 symbols completed. BANC took 1.2s. Estimated remaining: 10m 35s. Rate: 154.9 symbols/min [2025-10-10T22:35:16.316011] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:16.335264] [DEBUG] [LOCAL ] BAX: Loaded 54283 existing records from primary storage. [2025-10-10T22:35:16.335437] [INFO ] [MAIN ] BAX: Loaded 54283 primary data records. [2025-10-10T22:35:16.680387] [DEBUG] [LOCAL ] BB: Loaded 53713 existing records from primary storage. [2025-10-10T22:35:16.680741] [INFO ] [MAIN ] BB: Loaded 53713 primary data records. [2025-10-10T22:35:16.802566] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-10-10T22:35:16.824082] [INFO ] [MAIN ] BBAI: Loaded 54600 primary data records. [2025-10-10T22:35:17.322457] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:17.323464] [INFO ] [MAIN ] BAX: Generated 1820 derivative records from 54283 primary records. [2025-10-10T22:35:17.323620] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-10T22:35:17.353692] [DEBUG] [LOCAL ] BAX: Derivative data saved (1820 records). [2025-10-10T22:35:17.354037] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-10T22:35:17.357073] [INFO ] [MAIN ] Derivative Progress: 184/1823 symbols completed. BAX took 1.1s. Estimated remaining: 10m 41s. Rate: 153.5 symbols/min [2025-10-10T22:35:17.357615] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:17.371726] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:17.373320] [INFO ] [MAIN ] BB: Generated 1820 derivative records from 53713 primary records. [2025-10-10T22:35:17.373620] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-10T22:35:17.409194] [DEBUG] [LOCAL ] BB: Derivative data saved (1820 records). [2025-10-10T22:35:17.409954] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-10T22:35:17.409699] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:17.415163] [INFO ] [MAIN ] BBAI: Generated 1820 derivative records from 54600 primary records. [2025-10-10T22:35:17.414026] [INFO ] [MAIN ] Derivative Progress: 185/1823 symbols completed. BB took 1.1s. Estimated remaining: 10m 37s. Rate: 154.2 symbols/min [2025-10-10T22:35:17.415379] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:17.415725] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-10T22:35:17.443778] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1820 records). [2025-10-10T22:35:17.444103] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-10T22:35:17.447088] [INFO ] [MAIN ] Derivative Progress: 186/1823 symbols completed. BBAI took 1.1s. Estimated remaining: 10m 34s. Rate: 155.0 symbols/min [2025-10-10T22:35:17.447378] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:17.464450] [DEBUG] [LOCAL ] BBAR: Loaded 42518 existing records from primary storage. [2025-10-10T22:35:17.464605] [INFO ] [MAIN ] BBAR: Loaded 42518 primary data records. [2025-10-10T22:35:17.684346] [DEBUG] [LOCAL ] BBDC: Loaded 33535 existing records from primary storage. [2025-10-10T22:35:17.832327] [INFO ] [MAIN ] BBDC: Loaded 33535 primary data records. [2025-10-10T22:35:17.884034] [DEBUG] [LOCAL ] BBD: Loaded 54018 existing records from primary storage. [2025-10-10T22:35:17.909225] [INFO ] [MAIN ] BBD: Loaded 54018 primary data records. [2025-10-10T22:35:18.478519] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:18.480503] [INFO ] [MAIN ] BBAR: Generated 1820 derivative records from 42518 primary records. [2025-10-10T22:35:18.480678] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-10T22:35:18.499384] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1820 records). [2025-10-10T22:35:18.499585] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-10T22:35:18.501979] [INFO ] [MAIN ] Derivative Progress: 187/1823 symbols completed. BBAR took 1.1s. Estimated remaining: 10m 39s. Rate: 153.6 symbols/min [2025-10-10T22:35:18.502278] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:18.529398] [DEBUG] [LOCAL ] BBDO: Loaded 5077 existing records from primary storage. [2025-10-10T22:35:18.530133] [INFO ] [MAIN ] BBDO: Loaded 5077 primary data records. [2025-10-10T22:35:18.530024] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:18.561789] [INFO ] [MAIN ] BBDC: Generated 1820 derivative records from 33535 primary records. [2025-10-10T22:35:18.573751] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-10T22:35:18.698317] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:18.715829] [INFO ] [MAIN ] BBD: Generated 1820 derivative records from 54018 primary records. [2025-10-10T22:35:18.814736] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1820 records). [2025-10-10T22:35:18.857589] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-10T22:35:18.858765] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-10T22:35:18.861242] [INFO ] [MAIN ] Derivative Progress: 188/1823 symbols completed. BBDC took 1.4s. Estimated remaining: 10m 39s. Rate: 153.6 symbols/min [2025-10-10T22:35:18.861849] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:18.881955] [DEBUG] [LOCAL ] BBD: Derivative data saved (1820 records). [2025-10-10T22:35:18.882246] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-10T22:35:18.885151] [INFO ] [MAIN ] Derivative Progress: 189/1823 symbols completed. BBD took 1.5s. Estimated remaining: 10m 35s. Rate: 154.4 symbols/min [2025-10-10T22:35:18.891134] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:18.901421] [DEBUG] [LOCAL ] BBN: Loaded 18236 existing records from primary storage. [2025-10-10T22:35:18.903141] [INFO ] [MAIN ] BBN: Loaded 18236 primary data records. [2025-10-10T22:35:18.943031] [DEBUG] [LOCAL ] BBU: Loaded 5254 existing records from primary storage. [2025-10-10T22:35:18.969764] [INFO ] [MAIN ] BBU: Loaded 5254 primary data records. [2025-10-10T22:35:19.195956] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:19.206208] [INFO ] [MAIN ] BBDO: Generated 1820 derivative records from 5077 primary records. [2025-10-10T22:35:19.216885] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-10T22:35:19.601421] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1820 records). [2025-10-10T22:35:19.602686] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-10T22:35:19.605306] [INFO ] [MAIN ] Derivative Progress: 190/1823 symbols completed. BBDO took 1.1s. Estimated remaining: 10m 37s. Rate: 153.7 symbols/min [2025-10-10T22:35:19.605627] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:19.625696] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:19.626384] [INFO ] [MAIN ] BBN: Generated 1820 derivative records from 18236 primary records. [2025-10-10T22:35:19.626544] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-10T22:35:19.648559] [DEBUG] [LOCAL ] BBN: Derivative data saved (1820 records). [2025-10-10T22:35:19.648888] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-10-10T22:35:19.650942] [INFO ] [MAIN ] Derivative Progress: 191/1823 symbols completed. BBN took 0.8s. Estimated remaining: 10m 34s. Rate: 154.4 symbols/min [2025-10-10T22:35:19.651312] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:19.664986] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:19.665757] [INFO ] [MAIN ] BBU: Generated 1820 derivative records from 5254 primary records. [2025-10-10T22:35:19.665855] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-10T22:35:19.699815] [DEBUG] [LOCAL ] BBU: Derivative data saved (1820 records). [2025-10-10T22:35:19.700149] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-10-10T22:35:19.709165] [INFO ] [MAIN ] Derivative Progress: 192/1823 symbols completed. BBU took 0.8s. Estimated remaining: 10m 31s. Rate: 155.1 symbols/min [2025-10-10T22:35:19.722596] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:19.725258] [DEBUG] [LOCAL ] BBVA: Loaded 49892 existing records from primary storage. [2025-10-10T22:35:19.725519] [INFO ] [MAIN ] BBVA: Loaded 49892 primary data records. [2025-10-10T22:35:19.771817] [DEBUG] [LOCAL ] BBW: Loaded 27623 existing records from primary storage. [2025-10-10T22:35:19.792512] [INFO ] [MAIN ] BBW: Loaded 27623 primary data records. [2025-10-10T22:35:20.359147] [DEBUG] [LOCAL ] BBWI: Loaded 54362 existing records from primary storage. [2025-10-10T22:35:20.359970] [INFO ] [MAIN ] BBWI: Loaded 54362 primary data records. [2025-10-10T22:35:20.685919] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:20.687052] [INFO ] [MAIN ] BBVA: Generated 1820 derivative records from 49892 primary records. [2025-10-10T22:35:20.688316] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-10T22:35:20.724921] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:20.725712] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1820 records). [2025-10-10T22:35:20.726513] [INFO ] [MAIN ] BBW: Generated 1820 derivative records from 27623 primary records. [2025-10-10T22:35:20.726767] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-10T22:35:20.727311] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-10T22:35:20.729749] [INFO ] [MAIN ] Derivative Progress: 193/1823 symbols completed. BBVA took 1.1s. Estimated remaining: 10m 36s. Rate: 153.8 symbols/min [2025-10-10T22:35:20.749091] [DEBUG] [LOCAL ] BBW: Derivative data saved (1820 records). [2025-10-10T22:35:20.749339] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-10T22:35:20.763581] [INFO ] [MAIN ] Derivative Progress: 194/1823 symbols completed. BBW took 1.1s. Estimated remaining: 10m 33s. Rate: 154.5 symbols/min [2025-10-10T22:35:20.764767] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:20.765424] [INFO ] [MAIN ] BBWI: Generated 1820 derivative records from 54362 primary records. [2025-10-10T22:35:20.765483] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-10T22:35:20.781352] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1820 records). [2025-10-10T22:35:20.781473] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-10T22:35:20.783899] [INFO ] [MAIN ] Derivative Progress: 195/1823 symbols completed. BBWI took 1.1s. Estimated remaining: 10m 29s. Rate: 155.3 symbols/min [2025-10-10T22:35:20.784622] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:20.784544] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:20.784773] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:20.836057] [DEBUG] [LOCAL ] BCC: Loaded 28719 existing records from primary storage. [2025-10-10T22:35:20.836212] [INFO ] [MAIN ] BCC: Loaded 28719 primary data records. [2025-10-10T22:35:20.980049] [DEBUG] [LOCAL ] BC: Loaded 44741 existing records from primary storage. [2025-10-10T22:35:21.008664] [INFO ] [MAIN ] BC: Loaded 44741 primary data records. [2025-10-10T22:35:20.998182] [DEBUG] [LOCAL ] BBY: Loaded 54230 existing records from primary storage. [2025-10-10T22:35:21.008875] [INFO ] [MAIN ] BBY: Loaded 54230 primary data records. [2025-10-10T22:35:21.850998] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:21.852310] [INFO ] [MAIN ] BCC: Generated 1820 derivative records from 28719 primary records. [2025-10-10T22:35:21.852412] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-10T22:35:21.867823] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:21.877185] [INFO ] [MAIN ] BC: Generated 1820 derivative records from 44741 primary records. [2025-10-10T22:35:21.877291] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-10T22:35:21.905000] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:21.913594] [INFO ] [MAIN ] BBY: Generated 1820 derivative records from 54230 primary records. [2025-10-10T22:35:21.915533] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-10T22:35:21.928017] [DEBUG] [LOCAL ] BC: Derivative data saved (1820 records). [2025-10-10T22:35:21.926420] [DEBUG] [LOCAL ] BCC: Derivative data saved (1820 records). [2025-10-10T22:35:21.928163] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-10T22:35:21.934199] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-10T22:35:21.931444] [INFO ] [MAIN ] Derivative Progress: 196/1823 symbols completed. BCC took 1.1s. Estimated remaining: 10m 35s. Rate: 153.7 symbols/min [2025-10-10T22:35:21.937020] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:21.937169] [INFO ] [MAIN ] Derivative Progress: 197/1823 symbols completed. BC took 1.2s. Estimated remaining: 10m 31s. Rate: 154.5 symbols/min [2025-10-10T22:35:21.938865] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:21.942567] [DEBUG] [LOCAL ] BBY: Derivative data saved (1820 records). [2025-10-10T22:35:21.943666] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-10T22:35:21.946183] [INFO ] [MAIN ] Derivative Progress: 198/1823 symbols completed. BBY took 1.2s. Estimated remaining: 10m 28s. Rate: 155.3 symbols/min [2025-10-10T22:35:21.946509] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:21.999887] [DEBUG] [LOCAL ] BCO: Loaded 26031 existing records from primary storage. [2025-10-10T22:35:22.000022] [INFO ] [MAIN ] BCO: Loaded 26031 primary data records. [2025-10-10T22:35:22.108381] [DEBUG] [LOCAL ] BCH: Loaded 30383 existing records from primary storage. [2025-10-10T22:35:22.125918] [INFO ] [MAIN ] BCH: Loaded 30383 primary data records. [2025-10-10T22:35:22.144506] [DEBUG] [LOCAL ] BCE: Loaded 52976 existing records from primary storage. [2025-10-10T22:35:22.159799] [INFO ] [MAIN ] BCE: Loaded 52976 primary data records. [2025-10-10T22:35:22.944621] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:22.945515] [INFO ] [MAIN ] BCO: Generated 1820 derivative records from 26031 primary records. [2025-10-10T22:35:22.945709] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-10T22:35:22.963149] [DEBUG] [LOCAL ] BCO: Derivative data saved (1820 records). [2025-10-10T22:35:22.963674] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-10T22:35:22.966159] [INFO ] [MAIN ] Derivative Progress: 199/1823 symbols completed. BCO took 1.0s. Estimated remaining: 10m 33s. Rate: 154.0 symbols/min [2025-10-10T22:35:22.969222] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:22.991981] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:22.997546] [INFO ] [MAIN ] BCH: Generated 1820 derivative records from 30383 primary records. [2025-10-10T22:35:22.997793] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-10T22:35:22.998137] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:22.999371] [INFO ] [MAIN ] BCE: Generated 1820 derivative records from 52976 primary records. [2025-10-10T22:35:22.999703] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-10T22:35:23.032422] [DEBUG] [LOCAL ] BCH: Derivative data saved (1820 records). [2025-10-10T22:35:23.032668] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-10T22:35:23.031746] [DEBUG] [LOCAL ] BCE: Derivative data saved (1820 records). [2025-10-10T22:35:23.034866] [INFO ] [MAIN ] Derivative Progress: 200/1823 symbols completed. BCH took 1.1s. Estimated remaining: 10m 30s. Rate: 154.6 symbols/min [2025-10-10T22:35:23.035215] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-10T22:35:23.035075] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:23.037705] [INFO ] [MAIN ] Derivative Progress: 201/1823 symbols completed. BCE took 1.1s. Estimated remaining: 10m 26s. Rate: 155.4 symbols/min [2025-10-10T22:35:23.038203] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:23.080526] [DEBUG] [LOCAL ] BCX: Loaded 22009 existing records from primary storage. [2025-10-10T22:35:23.095194] [INFO ] [MAIN ] BCX: Loaded 22009 primary data records. [2025-10-10T22:35:23.096250] [DEBUG] [LOCAL ] BCS: Loaded 54222 existing records from primary storage. [2025-10-10T22:35:23.107543] [INFO ] [MAIN ] BCS: Loaded 54222 primary data records. [2025-10-10T22:35:23.207961] [DEBUG] [LOCAL ] BCSF: Loaded 28477 existing records from primary storage. [2025-10-10T22:35:23.276730] [INFO ] [MAIN ] BCSF: Loaded 28477 primary data records. [2025-10-10T22:35:24.105167] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:24.106142] [INFO ] [MAIN ] BCX: Generated 1820 derivative records from 22009 primary records. [2025-10-10T22:35:24.117911] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-10T22:35:24.119482] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:24.121199] [INFO ] [MAIN ] BCS: Generated 1820 derivative records from 54222 primary records. [2025-10-10T22:35:24.129607] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-10T22:35:24.163318] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:24.164876] [INFO ] [MAIN ] BCSF: Generated 1820 derivative records from 28477 primary records. [2025-10-10T22:35:24.165194] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-10T22:35:24.163962] [DEBUG] [LOCAL ] BCS: Derivative data saved (1820 records). [2025-10-10T22:35:24.165978] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-10T22:35:24.169808] [INFO ] [MAIN ] Derivative Progress: 202/1823 symbols completed. BCS took 1.2s. Estimated remaining: 10m 32s. Rate: 153.9 symbols/min [2025-10-10T22:35:24.170223] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:24.178335] [DEBUG] [LOCAL ] BCX: Derivative data saved (1820 records). [2025-10-10T22:35:24.182391] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-10T22:35:24.185714] [INFO ] [MAIN ] Derivative Progress: 203/1823 symbols completed. BCX took 1.1s. Estimated remaining: 10m 28s. Rate: 154.7 symbols/min [2025-10-10T22:35:24.186033] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:24.190974] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1820 records). [2025-10-10T22:35:24.191275] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-10T22:35:24.194127] [INFO ] [MAIN ] Derivative Progress: 204/1823 symbols completed. BCSF took 1.2s. Estimated remaining: 10m 25s. Rate: 155.4 symbols/min [2025-10-10T22:35:24.194307] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:24.224200] [DEBUG] [LOCAL ] BDC: Loaded 24890 existing records from primary storage. [2025-10-10T22:35:24.224394] [INFO ] [MAIN ] BDC: Loaded 24890 primary data records. [2025-10-10T22:35:24.323915] [DEBUG] [LOCAL ] BDJ: Loaded 29717 existing records from primary storage. [2025-10-10T22:35:24.334974] [INFO ] [MAIN ] BDJ: Loaded 29717 primary data records. [2025-10-10T22:35:24.656732] [DEBUG] [LOCAL ] BDN: Loaded 48258 existing records from primary storage. [2025-10-10T22:35:24.667755] [INFO ] [MAIN ] BDN: Loaded 48258 primary data records. [2025-10-10T22:35:25.167301] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:25.169592] [INFO ] [MAIN ] BDC: Generated 1820 derivative records from 24890 primary records. [2025-10-10T22:35:25.170047] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-10T22:35:25.190461] [DEBUG] [LOCAL ] BDC: Derivative data saved (1820 records). [2025-10-10T22:35:25.191017] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-10T22:35:25.193451] [INFO ] [MAIN ] Derivative Progress: 205/1823 symbols completed. BDC took 1.0s. Estimated remaining: 10m 30s. Rate: 154.2 symbols/min [2025-10-10T22:35:25.194171] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:25.210496] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:25.212589] [INFO ] [MAIN ] BDJ: Generated 1820 derivative records from 29717 primary records. [2025-10-10T22:35:25.213689] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-10T22:35:25.240063] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:25.242776] [INFO ] [MAIN ] BDN: Generated 1820 derivative records from 48258 primary records. [2025-10-10T22:35:25.243184] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-10T22:35:25.255227] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1820 records). [2025-10-10T22:35:25.255404] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-10T22:35:25.258669] [INFO ] [MAIN ] Derivative Progress: 206/1823 symbols completed. BDJ took 1.1s. Estimated remaining: 10m 27s. Rate: 154.8 symbols/min [2025-10-10T22:35:25.258958] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:25.282411] [DEBUG] [LOCAL ] BDN: Derivative data saved (1820 records). [2025-10-10T22:35:25.282611] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-10-10T22:35:25.285019] [INFO ] [MAIN ] Derivative Progress: 207/1823 symbols completed. BDN took 1.1s. Estimated remaining: 10m 23s. Rate: 155.5 symbols/min [2025-10-10T22:35:25.285463] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:25.317365] [DEBUG] [LOCAL ] BDX: Loaded 52941 existing records from primary storage. [2025-10-10T22:35:25.317527] [INFO ] [MAIN ] BDX: Loaded 52941 primary data records. [2025-10-10T22:35:25.503887] [DEBUG] [LOCAL ] BE: Loaded 54439 existing records from primary storage. [2025-10-10T22:35:25.663328] [INFO ] [MAIN ] BE: Loaded 54439 primary data records. [2025-10-10T22:35:25.804174] [DEBUG] [LOCAL ] BEKE: Loaded 54007 existing records from primary storage. [2025-10-10T22:35:25.805137] [INFO ] [MAIN ] BEKE: Loaded 54007 primary data records. [2025-10-10T22:35:26.321881] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:26.323305] [INFO ] [MAIN ] BDX: Generated 1820 derivative records from 52941 primary records. [2025-10-10T22:35:26.324346] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-10T22:35:26.343926] [DEBUG] [LOCAL ] BDX: Derivative data saved (1820 records). [2025-10-10T22:35:26.344218] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-10T22:35:26.347020] [INFO ] [MAIN ] Derivative Progress: 208/1823 symbols completed. BDX took 1.2s. Estimated remaining: 10m 28s. Rate: 154.2 symbols/min [2025-10-10T22:35:26.360324] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:26.361084] [INFO ] [MAIN ] BE: Generated 1820 derivative records from 54439 primary records. [2025-10-10T22:35:26.361434] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-10T22:35:26.393167] [DEBUG] [LOCAL ] BE: Derivative data saved (1820 records). [2025-10-10T22:35:26.393422] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:26.393515] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-10T22:35:26.395859] [INFO ] [MAIN ] Derivative Progress: 209/1823 symbols completed. BE took 1.1s. Estimated remaining: 10m 25s. Rate: 154.9 symbols/min [2025-10-10T22:35:26.396668] [INFO ] [MAIN ] BEKE: Generated 1820 derivative records from 54007 primary records. [2025-10-10T22:35:26.396767] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-10T22:35:26.412343] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1820 records). [2025-10-10T22:35:26.412402] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-10T22:35:26.414499] [INFO ] [MAIN ] Derivative Progress: 210/1823 symbols completed. BEKE took 1.1s. Estimated remaining: 10m 22s. Rate: 155.6 symbols/min [2025-10-10T22:35:26.414896] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:26.414988] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:26.415434] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:26.482628] [DEBUG] [LOCAL ] BEPC: Loaded 47216 existing records from primary storage. [2025-10-10T22:35:26.482986] [INFO ] [MAIN ] BEPC: Loaded 47216 primary data records. [2025-10-10T22:35:26.615124] [DEBUG] [LOCAL ] BEP: Loaded 39584 existing records from primary storage. [2025-10-10T22:35:26.615769] [INFO ] [MAIN ] BEP: Loaded 39584 primary data records. [2025-10-10T22:35:26.754184] [DEBUG] [LOCAL ] BEN: Loaded 53824 existing records from primary storage. [2025-10-10T22:35:26.800711] [INFO ] [MAIN ] BEN: Loaded 53824 primary data records. [2025-10-10T22:35:27.520288] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:27.521847] [INFO ] [MAIN ] BEPC: Generated 1820 derivative records from 47216 primary records. [2025-10-10T22:35:27.522111] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-10T22:35:27.552160] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1820 records). [2025-10-10T22:35:27.557980] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-10T22:35:27.560082] [INFO ] [MAIN ] Derivative Progress: 211/1823 symbols completed. BEPC took 1.1s. Estimated remaining: 10m 27s. Rate: 154.2 symbols/min [2025-10-10T22:35:27.560263] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:27.557767] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:27.562791] [INFO ] [MAIN ] BEP: Generated 1820 derivative records from 39584 primary records. [2025-10-10T22:35:27.563020] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-10T22:35:27.596120] [DEBUG] [LOCAL ] BEP: Derivative data saved (1820 records). [2025-10-10T22:35:27.595927] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:27.599282] [DEBUG] [LOCAL ] BEPH: Loaded 5407 existing records from primary storage. [2025-10-10T22:35:27.599059] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-10T22:35:27.600170] [INFO ] [MAIN ] BEPH: Loaded 5407 primary data records. [2025-10-10T22:35:27.600025] [INFO ] [MAIN ] BEN: Generated 1820 derivative records from 53824 primary records. [2025-10-10T22:35:27.611418] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-10T22:35:27.614155] [INFO ] [MAIN ] Derivative Progress: 212/1823 symbols completed. BEP took 1.2s. Estimated remaining: 10m 24s. Rate: 154.8 symbols/min [2025-10-10T22:35:27.639231] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:27.742126] [DEBUG] [LOCAL ] BEPI: Loaded 3641 existing records from primary storage. [2025-10-10T22:35:27.764352] [INFO ] [MAIN ] BEPI: Loaded 3641 primary data records. [2025-10-10T22:35:27.857222] [DEBUG] [LOCAL ] BEN: Derivative data saved (1820 records). [2025-10-10T22:35:27.984699] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-10T22:35:28.014404] [INFO ] [MAIN ] Derivative Progress: 213/1823 symbols completed. BEN took 1.6s. Estimated remaining: 10m 24s. Rate: 154.8 symbols/min [2025-10-10T22:35:28.052832] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:28.137848] [DEBUG] [LOCAL ] BEPJ: Loaded 3156 existing records from primary storage. [2025-10-10T22:35:28.160422] [INFO ] [MAIN ] BEPJ: Loaded 3156 primary data records. [2025-10-10T22:35:28.598804] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:28.600246] [INFO ] [MAIN ] BEPH: Generated 1820 derivative records from 5407 primary records. [2025-10-10T22:35:28.600377] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-10T22:35:28.622018] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1820 records). [2025-10-10T22:35:28.622499] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-10-10T22:35:28.624596] [INFO ] [MAIN ] Derivative Progress: 214/1823 symbols completed. BEPH took 1.1s. Estimated remaining: 10m 25s. Rate: 154.3 symbols/min [2025-10-10T22:35:28.625090] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:28.638749] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:28.639817] [INFO ] [MAIN ] BEPI: Generated 1820 derivative records from 3641 primary records. [2025-10-10T22:35:28.640057] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-10T22:35:28.657952] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1820 records). [2025-10-10T22:35:28.658128] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-10T22:35:28.660401] [INFO ] [MAIN ] Derivative Progress: 215/1823 symbols completed. BEPI took 1.0s. Estimated remaining: 10m 22s. Rate: 155.0 symbols/min [2025-10-10T22:35:28.660601] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:28.675318] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:28.676246] [INFO ] [MAIN ] BEPJ: Generated 1820 derivative records from 3156 primary records. [2025-10-10T22:35:28.676369] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-10T22:35:28.700517] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1820 records). [2025-10-10T22:35:28.700798] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-10T22:35:28.703283] [INFO ] [MAIN ] Derivative Progress: 216/1823 symbols completed. BEPJ took 0.7s. Estimated remaining: 10m 20s. Rate: 155.6 symbols/min [2025-10-10T22:35:28.704933] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:28.717539] [DEBUG] [LOCAL ] BFAM: Loaded 33979 existing records from primary storage. [2025-10-10T22:35:28.717771] [INFO ] [MAIN ] BFAM: Loaded 33979 primary data records. [2025-10-10T22:35:28.871094] [DEBUG] [LOCAL ] BFH: Loaded 42048 existing records from primary storage. [2025-10-10T22:35:28.870003] [DEBUG] [LOCAL ] BFK: Loaded 13833 existing records from primary storage. [2025-10-10T22:35:28.886807] [INFO ] [MAIN ] BFK: Loaded 13833 primary data records. [2025-10-10T22:35:28.881580] [INFO ] [MAIN ] BFH: Loaded 42048 primary data records. [2025-10-10T22:35:29.797678] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:29.798504] [INFO ] [MAIN ] BFAM: Generated 1820 derivative records from 33979 primary records. [2025-10-10T22:35:29.798911] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-10T22:35:29.816333] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1820 records). [2025-10-10T22:35:29.816519] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-10T22:35:29.820761] [INFO ] [MAIN ] Derivative Progress: 217/1823 symbols completed. BFAM took 1.2s. Estimated remaining: 10m 25s. Rate: 154.3 symbols/min [2025-10-10T22:35:29.822086] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:29.838590] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:29.840365] [INFO ] [MAIN ] BFK: Generated 1820 derivative records from 13833 primary records. [2025-10-10T22:35:29.840599] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-10T22:35:29.854605] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:29.855430] [INFO ] [MAIN ] BFH: Generated 1820 derivative records from 42048 primary records. [2025-10-10T22:35:29.855823] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-10T22:35:29.900327] [DEBUG] [LOCAL ] BFH: Derivative data saved (1820 records). [2025-10-10T22:35:29.900994] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-10-10T22:35:29.903498] [INFO ] [MAIN ] Derivative Progress: 218/1823 symbols completed. BFH took 1.2s. Estimated remaining: 10m 22s. Rate: 154.8 symbols/min [2025-10-10T22:35:29.904057] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:29.905565] [DEBUG] [LOCAL ] BFK: Derivative data saved (1820 records). [2025-10-10T22:35:29.905701] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-10T22:35:29.908079] [INFO ] [MAIN ] Derivative Progress: 219/1823 symbols completed. BFK took 1.2s. Estimated remaining: 10m 19s. Rate: 155.6 symbols/min [2025-10-10T22:35:29.908390] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:29.928862] [DEBUG] [LOCAL ] BFLY: Loaded 52599 existing records from primary storage. [2025-10-10T22:35:29.936074] [DEBUG] [LOCAL ] BFS: Loaded 9495 existing records from primary storage. [2025-10-10T22:35:29.936300] [INFO ] [MAIN ] BFLY: Loaded 52599 primary data records. [2025-10-10T22:35:29.936392] [INFO ] [MAIN ] BFS: Loaded 9495 primary data records. [2025-10-10T22:35:30.031892] [DEBUG] [LOCAL ] BFZ: Loaded 12034 existing records from primary storage. [2025-10-10T22:35:30.128495] [INFO ] [MAIN ] BFZ: Loaded 12034 primary data records. [2025-10-10T22:35:30.900611] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:30.913753] [INFO ] [MAIN ] BFS: Generated 1820 derivative records from 9495 primary records. [2025-10-10T22:35:30.914188] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:30.913936] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-10T22:35:30.914882] [INFO ] [MAIN ] BFLY: Generated 1820 derivative records from 52599 primary records. [2025-10-10T22:35:30.917060] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-10T22:35:30.956139] [DEBUG] [LOCAL ] BFS: Derivative data saved (1820 records). [2025-10-10T22:35:30.956314] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-10T22:35:30.956704] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:30.958902] [INFO ] [MAIN ] Derivative Progress: 220/1823 symbols completed. BFS took 1.1s. Estimated remaining: 10m 23s. Rate: 154.3 symbols/min [2025-10-10T22:35:30.960790] [INFO ] [MAIN ] BFZ: Generated 1820 derivative records from 12034 primary records. [2025-10-10T22:35:30.960897] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-10T22:35:30.959421] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:30.978395] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1820 records). [2025-10-10T22:35:30.979479] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-10T22:35:30.981797] [INFO ] [MAIN ] Derivative Progress: 221/1823 symbols completed. BFLY took 1.2s. Estimated remaining: 10m 20s. Rate: 155.0 symbols/min [2025-10-10T22:35:30.982250] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:30.985680] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1820 records). [2025-10-10T22:35:30.985843] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-10T22:35:30.988414] [INFO ] [MAIN ] Derivative Progress: 222/1823 symbols completed. BFZ took 1.1s. Estimated remaining: 10m 17s. Rate: 155.7 symbols/min [2025-10-10T22:35:30.988739] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:31.021356] [DEBUG] [LOCAL ] BGB: Loaded 18164 existing records from primary storage. [2025-10-10T22:35:31.021606] [INFO ] [MAIN ] BGB: Loaded 18164 primary data records. [2025-10-10T22:35:31.096000] [DEBUG] [LOCAL ] BGH: Loaded 17497 existing records from primary storage. [2025-10-10T22:35:31.107691] [INFO ] [MAIN ] BGH: Loaded 17497 primary data records. [2025-10-10T22:35:31.219861] [DEBUG] [LOCAL ] BG: Loaded 51146 existing records from primary storage. [2025-10-10T22:35:31.288061] [INFO ] [MAIN ] BG: Loaded 51146 primary data records. [2025-10-10T22:35:32.003465] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:32.004823] [INFO ] [MAIN ] BGB: Generated 1820 derivative records from 18164 primary records. [2025-10-10T22:35:32.004927] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-10T22:35:32.038386] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:32.041083] [DEBUG] [LOCAL ] BGB: Derivative data saved (1820 records). [2025-10-10T22:35:32.042578] [INFO ] [MAIN ] BGH: Generated 1820 derivative records from 17497 primary records. [2025-10-10T22:35:32.043060] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-10T22:35:32.042988] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-10T22:35:32.045351] [INFO ] [MAIN ] Derivative Progress: 223/1823 symbols completed. BGB took 1.1s. Estimated remaining: 10m 21s. Rate: 154.5 symbols/min [2025-10-10T22:35:32.059396] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:32.060324] [INFO ] [MAIN ] BG: Generated 1820 derivative records from 51146 primary records. [2025-10-10T22:35:32.067433] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-10T22:35:32.075983] [DEBUG] [LOCAL ] BGH: Derivative data saved (1820 records). [2025-10-10T22:35:32.076257] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-10T22:35:32.085633] [INFO ] [MAIN ] Derivative Progress: 224/1823 symbols completed. BGH took 1.1s. Estimated remaining: 10m 19s. Rate: 155.1 symbols/min [2025-10-10T22:35:32.093245] [DEBUG] [LOCAL ] BG: Derivative data saved (1820 records). [2025-10-10T22:35:32.093331] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-10T22:35:32.095545] [INFO ] [MAIN ] Derivative Progress: 225/1823 symbols completed. BG took 1.1s. Estimated remaining: 10m 15s. Rate: 155.8 symbols/min [2025-10-10T22:35:32.096056] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:32.096154] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:32.096475] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:32.113921] [DEBUG] [LOCAL ] BGSF: Loaded 7869 existing records from primary storage. [2025-10-10T22:35:32.114126] [INFO ] [MAIN ] BGSF: Loaded 7869 primary data records. [2025-10-10T22:35:32.182742] [DEBUG] [LOCAL ] BGR: Loaded 13729 existing records from primary storage. [2025-10-10T22:35:32.217095] [INFO ] [MAIN ] BGR: Loaded 13729 primary data records. [2025-10-10T22:35:32.622574] [DEBUG] [LOCAL ] BGS: Loaded 51214 existing records from primary storage. [2025-10-10T22:35:32.627155] [INFO ] [MAIN ] BGS: Loaded 51214 primary data records. [2025-10-10T22:35:33.101586] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:33.102474] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7798 incomplete bins [2025-10-10T22:35:33.103989] [INFO ] [MAIN ] BGSF: Generated 1816 derivative records from 7869 primary records. [2025-10-10T22:35:33.103390] [INFO ] [MAIN ] BGR: Generated 1820 derivative records from 13729 primary records. [2025-10-10T22:35:33.104263] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-10T22:35:33.104308] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-10T22:35:33.131413] [DEBUG] [LOCAL ] BGR: Derivative data saved (1820 records). [2025-10-10T22:35:33.132102] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-10T22:35:33.134175] [INFO ] [MAIN ] Derivative Progress: 226/1823 symbols completed. BGR took 1.0s. Estimated remaining: 10m 20s. Rate: 154.6 symbols/min [2025-10-10T22:35:33.134572] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:33.140616] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1816 records). [2025-10-10T22:35:33.140848] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-10T22:35:33.143186] [INFO ] [MAIN ] Derivative Progress: 227/1823 symbols completed. BGSF took 1.0s. Estimated remaining: 10m 17s. Rate: 155.3 symbols/min [2025-10-10T22:35:33.143447] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:33.169515] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:33.176088] [INFO ] [MAIN ] BGS: Generated 1820 derivative records from 51214 primary records. [2025-10-10T22:35:33.176269] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-10T22:35:33.176607] [DEBUG] [LOCAL ] BGT: Loaded 16808 existing records from primary storage. [2025-10-10T22:35:33.177566] [INFO ] [MAIN ] BGT: Loaded 16808 primary data records. [2025-10-10T22:35:33.202327] [DEBUG] [LOCAL ] BGX: Loaded 11399 existing records from primary storage. [2025-10-10T22:35:33.212469] [INFO ] [MAIN ] BGX: Loaded 11399 primary data records. [2025-10-10T22:35:33.436828] [DEBUG] [LOCAL ] BGS: Derivative data saved (1820 records). [2025-10-10T22:35:33.464993] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-10T22:35:33.480990] [INFO ] [MAIN ] Derivative Progress: 228/1823 symbols completed. BGS took 1.4s. Estimated remaining: 10m 16s. Rate: 155.4 symbols/min [2025-10-10T22:35:33.713214] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:33.862295] [DEBUG] [LOCAL ] BGY: Loaded 22421 existing records from primary storage. [2025-10-10T22:35:33.863977] [INFO ] [MAIN ] BGY: Loaded 22421 primary data records. [2025-10-10T22:35:33.996300] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:34.014243] [INFO ] [MAIN ] BGT: Generated 1820 derivative records from 16808 primary records. [2025-10-10T22:35:34.020042] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-10T22:35:34.072374] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:34.126476] [INFO ] [MAIN ] BGX: Generated 1820 derivative records from 11399 primary records. [2025-10-10T22:35:34.150185] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-10T22:35:34.275840] [DEBUG] [LOCAL ] BGT: Derivative data saved (1820 records). [2025-10-10T22:35:34.277936] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-10T22:35:34.280327] [INFO ] [MAIN ] Derivative Progress: 229/1823 symbols completed. BGT took 1.1s. Estimated remaining: 10m 18s. Rate: 154.6 symbols/min [2025-10-10T22:35:34.280625] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:34.277879] [DEBUG] [LOCAL ] BGX: Derivative data saved (1820 records). [2025-10-10T22:35:34.281177] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-10T22:35:34.283321] [INFO ] [MAIN ] Derivative Progress: 230/1823 symbols completed. BGX took 1.1s. Estimated remaining: 10m 15s. Rate: 155.3 symbols/min [2025-10-10T22:35:34.284514] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:34.305867] [DEBUG] [LOCAL ] BH: Loaded 16341 existing records from primary storage. [2025-10-10T22:35:34.306170] [INFO ] [MAIN ] BH: Loaded 16341 primary data records. [2025-10-10T22:35:34.455260] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:34.456871] [INFO ] [MAIN ] BGY: Generated 1820 derivative records from 22421 primary records. [2025-10-10T22:35:34.463033] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-10T22:35:34.520630] [DEBUG] [LOCAL ] BHC: Loaded 47488 existing records from primary storage. [2025-10-10T22:35:34.535836] [INFO ] [MAIN ] BHC: Loaded 47488 primary data records. [2025-10-10T22:35:34.793498] [DEBUG] [LOCAL ] BGY: Derivative data saved (1820 records). [2025-10-10T22:35:34.793786] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-10T22:35:34.796158] [INFO ] [MAIN ] Derivative Progress: 231/1823 symbols completed. BGY took 1.1s. Estimated remaining: 10m 16s. Rate: 155.1 symbols/min [2025-10-10T22:35:34.821047] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:35.045208] [DEBUG] [LOCAL ] BHE: Loaded 24326 existing records from primary storage. [2025-10-10T22:35:35.047172] [INFO ] [MAIN ] BHE: Loaded 24326 primary data records. [2025-10-10T22:35:35.172308] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:35.173744] [INFO ] [MAIN ] BH: Generated 1820 derivative records from 16341 primary records. [2025-10-10T22:35:35.173948] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-10T22:35:35.436099] [DEBUG] [LOCAL ] BH: Derivative data saved (1820 records). [2025-10-10T22:35:35.448886] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-10-10T22:35:35.451115] [INFO ] [MAIN ] Derivative Progress: 232/1823 symbols completed. BH took 1.2s. Estimated remaining: 10m 17s. Rate: 154.6 symbols/min [2025-10-10T22:35:35.451409] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:35.451907] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:35.453059] [INFO ] [MAIN ] BHC: Generated 1820 derivative records from 47488 primary records. [2025-10-10T22:35:35.453775] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-10T22:35:35.474909] [DEBUG] [LOCAL ] BHC: Derivative data saved (1820 records). [2025-10-10T22:35:35.480345] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-10T22:35:35.483013] [INFO ] [MAIN ] Derivative Progress: 233/1823 symbols completed. BHC took 1.2s. Estimated remaining: 10m 14s. Rate: 155.2 symbols/min [2025-10-10T22:35:35.483382] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:35.493859] [DEBUG] [LOCAL ] BHR: Loaded 22281 existing records from primary storage. [2025-10-10T22:35:35.494243] [INFO ] [MAIN ] BHR: Loaded 22281 primary data records. [2025-10-10T22:35:35.611882] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:35.633251] [INFO ] [MAIN ] BHE: Generated 1820 derivative records from 24326 primary records. [2025-10-10T22:35:35.633380] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-10T22:35:35.850006] [DEBUG] [LOCAL ] BHE: Derivative data saved (1820 records). [2025-10-10T22:35:35.852913] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-10T22:35:35.855360] [INFO ] [MAIN ] Derivative Progress: 234/1823 symbols completed. BHE took 1.0s. Estimated remaining: 10m 14s. Rate: 155.3 symbols/min [2025-10-10T22:35:35.852601] [DEBUG] [LOCAL ] BHVN: Loaded 50961 existing records from primary storage. [2025-10-10T22:35:35.856454] [INFO ] [MAIN ] BHVN: Loaded 50961 primary data records. [2025-10-10T22:35:35.855576] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:36.204093] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:36.204932] [INFO ] [MAIN ] BHR: Generated 1820 derivative records from 22281 primary records. [2025-10-10T22:35:36.203818] [DEBUG] [LOCAL ] BILL: Loaded 53182 existing records from primary storage. [2025-10-10T22:35:36.205519] [INFO ] [MAIN ] BILL: Loaded 53182 primary data records. [2025-10-10T22:35:36.206015] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-10T22:35:36.356424] [DEBUG] [LOCAL ] BHR: Derivative data saved (1820 records). [2025-10-10T22:35:36.369604] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-10T22:35:36.380733] [INFO ] [MAIN ] Derivative Progress: 235/1823 symbols completed. BHR took 0.9s. Estimated remaining: 10m 15s. Rate: 155.0 symbols/min [2025-10-10T22:35:36.410928] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:36.547505] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:36.548585] [INFO ] [MAIN ] BHVN: Generated 1820 derivative records from 50961 primary records. [2025-10-10T22:35:36.548766] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-10T22:35:36.572229] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1820 records). [2025-10-10T22:35:36.572454] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-10T22:35:36.574597] [INFO ] [MAIN ] Derivative Progress: 236/1823 symbols completed. BHVN took 1.1s. Estimated remaining: 10m 13s. Rate: 155.4 symbols/min [2025-10-10T22:35:36.575968] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:36.584765] [DEBUG] [LOCAL ] BIO: Loaded 24502 existing records from primary storage. [2025-10-10T22:35:36.584866] [INFO ] [MAIN ] BIO: Loaded 24502 primary data records. [2025-10-10T22:35:36.886089] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:36.901931] [INFO ] [MAIN ] BILL: Generated 1820 derivative records from 53182 primary records. [2025-10-10T22:35:36.913731] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-10T22:35:36.934361] [DEBUG] [LOCAL ] BILL: Derivative data saved (1820 records). [2025-10-10T22:35:36.935540] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-10T22:35:36.938045] [INFO ] [MAIN ] Derivative Progress: 237/1823 symbols completed. BILL took 1.1s. Estimated remaining: 10m 12s. Rate: 155.4 symbols/min [2025-10-10T22:35:36.939031] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:36.958556] [DEBUG] [LOCAL ] BIPC: Loaded 41873 existing records from primary storage. [2025-10-10T22:35:36.961925] [DEBUG] [LOCAL ] BIPH: Loaded 2591 existing records from primary storage. [2025-10-10T22:35:36.962347] [INFO ] [MAIN ] BIPC: Loaded 41873 primary data records. [2025-10-10T22:35:36.962460] [INFO ] [MAIN ] BIPH: Loaded 2591 primary data records. [2025-10-10T22:35:37.225910] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:37.265256] [INFO ] [MAIN ] BIO: Generated 1820 derivative records from 24502 primary records. [2025-10-10T22:35:37.293218] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-10T22:35:37.645893] [DEBUG] [LOCAL ] BIO: Derivative data saved (1820 records). [2025-10-10T22:35:37.646449] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-10T22:35:37.649172] [INFO ] [MAIN ] Derivative Progress: 238/1823 symbols completed. BIO took 1.2s. Estimated remaining: 10m 14s. Rate: 154.9 symbols/min [2025-10-10T22:35:37.672947] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:37.674096] [INFO ] [MAIN ] BIPH: Generated 1820 derivative records from 2591 primary records. [2025-10-10T22:35:37.674199] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-10T22:35:37.691973] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1820 records). [2025-10-10T22:35:37.692202] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-10T22:35:37.694631] [INFO ] [MAIN ] Derivative Progress: 239/1823 symbols completed. BIPH took 0.8s. Estimated remaining: 10m 11s. Rate: 155.4 symbols/min [2025-10-10T22:35:37.707301] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:37.707927] [INFO ] [MAIN ] BIPC: Generated 1820 derivative records from 41873 primary records. [2025-10-10T22:35:37.707987] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-10T22:35:37.723504] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1820 records). [2025-10-10T22:35:37.723582] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-10T22:35:37.726528] [INFO ] [MAIN ] Derivative Progress: 240/1823 symbols completed. BIPC took 1.2s. Estimated remaining: 10m 9s. Rate: 156.0 symbols/min [2025-10-10T22:35:37.727066] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:37.727146] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:37.726989] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:37.737928] [DEBUG] [LOCAL ] BIPI: Loaded 3192 existing records from primary storage. [2025-10-10T22:35:37.738516] [INFO ] [MAIN ] BIPI: Loaded 3192 primary data records. [2025-10-10T22:35:37.738434] [DEBUG] [LOCAL ] BIPJ: Loaded 3196 existing records from primary storage. [2025-10-10T22:35:37.738724] [INFO ] [MAIN ] BIPJ: Loaded 3196 primary data records. [2025-10-10T22:35:38.400515] [DEBUG] [LOCAL ] BIRK: Loaded 51758 existing records from primary storage. [2025-10-10T22:35:38.402472] [INFO ] [MAIN ] BIRK: Loaded 51758 primary data records. [2025-10-10T22:35:38.736019] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:38.738121] [INFO ] [MAIN ] BIPI: Generated 1820 derivative records from 3192 primary records. [2025-10-10T22:35:38.738314] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-10T22:35:38.752404] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:38.767485] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1820 records). [2025-10-10T22:35:38.768763] [INFO ] [MAIN ] BIPJ: Generated 1820 derivative records from 3196 primary records. [2025-10-10T22:35:38.769017] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-10T22:35:38.771336] [INFO ] [MAIN ] Derivative Progress: 241/1823 symbols completed. BIPI took 1.0s. Estimated remaining: 10m 13s. Rate: 154.9 symbols/min [2025-10-10T22:35:38.771472] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-10T22:35:38.771884] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:38.790183] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1820 records). [2025-10-10T22:35:38.790472] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-10T22:35:38.792736] [INFO ] [MAIN ] Derivative Progress: 242/1823 symbols completed. BIPJ took 1.1s. Estimated remaining: 10m 10s. Rate: 155.5 symbols/min [2025-10-10T22:35:38.793013] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:38.806813] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:38.807741] [INFO ] [MAIN ] BIRK: Generated 1820 derivative records from 51758 primary records. [2025-10-10T22:35:38.807850] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-10T22:35:38.830624] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1820 records). [2025-10-10T22:35:38.838322] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-10T22:35:38.839859] [DEBUG] [LOCAL ] BIT: Loaded 23580 existing records from primary storage. [2025-10-10T22:35:38.842214] [INFO ] [MAIN ] Derivative Progress: 243/1823 symbols completed. BIRK took 1.1s. Estimated remaining: 10m 7s. Rate: 156.1 symbols/min [2025-10-10T22:35:38.842364] [INFO ] [MAIN ] BIT: Loaded 23580 primary data records. [2025-10-10T22:35:38.842766] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:39.205195] [DEBUG] [LOCAL ] BJ: Loaded 52284 existing records from primary storage. [2025-10-10T22:35:39.205588] [INFO ] [MAIN ] BJ: Loaded 52284 primary data records. [2025-10-10T22:35:39.521465] [DEBUG] [LOCAL ] BK: Loaded 54309 existing records from primary storage. [2025-10-10T22:35:39.535408] [INFO ] [MAIN ] BK: Loaded 54309 primary data records. [2025-10-10T22:35:39.858996] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:39.860203] [INFO ] [MAIN ] BIT: Generated 1820 derivative records from 23580 primary records. [2025-10-10T22:35:39.861211] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-10T22:35:39.880686] [DEBUG] [LOCAL ] BIT: Derivative data saved (1820 records). [2025-10-10T22:35:39.881403] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-10T22:35:39.883837] [INFO ] [MAIN ] Derivative Progress: 244/1823 symbols completed. BIT took 1.1s. Estimated remaining: 10m 11s. Rate: 155.0 symbols/min [2025-10-10T22:35:39.884059] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:39.902756] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:39.903714] [INFO ] [MAIN ] BJ: Generated 1820 derivative records from 52284 primary records. [2025-10-10T22:35:39.903914] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-10T22:35:39.923098] [DEBUG] [LOCAL ] BJ: Derivative data saved (1820 records). [2025-10-10T22:35:39.923282] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-10T22:35:39.926954] [INFO ] [MAIN ] Derivative Progress: 245/1823 symbols completed. BJ took 1.1s. Estimated remaining: 10m 9s. Rate: 155.6 symbols/min [2025-10-10T22:35:39.927405] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:39.941137] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:39.941855] [INFO ] [MAIN ] BK: Generated 1820 derivative records from 54309 primary records. [2025-10-10T22:35:39.941944] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-10T22:35:39.972543] [DEBUG] [LOCAL ] BK: Derivative data saved (1820 records). [2025-10-10T22:35:39.972606] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-10T22:35:39.974928] [INFO ] [MAIN ] Derivative Progress: 246/1823 symbols completed. BK took 1.1s. Estimated remaining: 10m 6s. Rate: 156.1 symbols/min [2025-10-10T22:35:39.975153] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:39.994423] [DEBUG] [LOCAL ] BKD: Loaded 51097 existing records from primary storage. [2025-10-10T22:35:40.004130] [INFO ] [MAIN ] BKD: Loaded 51097 primary data records. [2025-10-10T22:35:40.125839] [DEBUG] [LOCAL ] BKE: Loaded 34527 existing records from primary storage. [2025-10-10T22:35:40.132131] [INFO ] [MAIN ] BKE: Loaded 34527 primary data records. [2025-10-10T22:35:40.279310] [DEBUG] [LOCAL ] BKH: Loaded 37451 existing records from primary storage. [2025-10-10T22:35:40.292700] [INFO ] [MAIN ] BKH: Loaded 37451 primary data records. [2025-10-10T22:35:40.983596] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:40.984612] [INFO ] [MAIN ] BKD: Generated 1820 derivative records from 51097 primary records. [2025-10-10T22:35:40.985061] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-10T22:35:41.006242] [DEBUG] [LOCAL ] BKD: Derivative data saved (1820 records). [2025-10-10T22:35:41.008935] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-10T22:35:41.011957] [INFO ] [MAIN ] Derivative Progress: 247/1823 symbols completed. BKD took 1.1s. Estimated remaining: 10m 10s. Rate: 155.1 symbols/min [2025-10-10T22:35:41.012349] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:41.026933] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:41.027683] [INFO ] [MAIN ] BKE: Generated 1820 derivative records from 34527 primary records. [2025-10-10T22:35:41.027903] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-10T22:35:41.059528] [DEBUG] [LOCAL ] BKE: Derivative data saved (1820 records). [2025-10-10T22:35:41.059712] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-10T22:35:41.062193] [INFO ] [MAIN ] Derivative Progress: 248/1823 symbols completed. BKE took 1.1s. Estimated remaining: 10m 7s. Rate: 155.6 symbols/min [2025-10-10T22:35:41.062549] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:41.063595] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:41.065051] [INFO ] [MAIN ] BKH: Generated 1820 derivative records from 37451 primary records. [2025-10-10T22:35:41.065168] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-10T22:35:41.093583] [DEBUG] [LOCAL ] BKH: Derivative data saved (1820 records). [2025-10-10T22:35:41.104670] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-10T22:35:41.107674] [INFO ] [MAIN ] Derivative Progress: 249/1823 symbols completed. BKH took 1.1s. Estimated remaining: 10m 5s. Rate: 156.2 symbols/min [2025-10-10T22:35:41.108430] [DEBUG] [LOCAL ] BKKT: Loaded 36488 existing records from primary storage. [2025-10-10T22:35:41.111638] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:41.112232] [DEBUG] [LOCAL ] BKN: Loaded 7736 existing records from primary storage. [2025-10-10T22:35:41.111947] [INFO ] [MAIN ] BKKT: Loaded 36488 primary data records. [2025-10-10T22:35:41.112965] [INFO ] [MAIN ] BKN: Loaded 7736 primary data records. [2025-10-10T22:35:41.778922] [DEBUG] [LOCAL ] BKSY: Loaded 49237 existing records from primary storage. [2025-10-10T22:35:41.779767] [INFO ] [MAIN ] BKSY: Loaded 49237 primary data records. [2025-10-10T22:35:42.114518] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:42.116395] [INFO ] [MAIN ] BKN: Generated 1820 derivative records from 7736 primary records. [2025-10-10T22:35:42.116606] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:42.116977] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-10T22:35:42.117572] [INFO ] [MAIN ] BKKT: Generated 1820 derivative records from 36488 primary records. [2025-10-10T22:35:42.118679] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-10T22:35:42.148830] [DEBUG] [LOCAL ] BKN: Derivative data saved (1820 records). [2025-10-10T22:35:42.149800] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-10T22:35:42.150326] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1820 records). [2025-10-10T22:35:42.150576] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-10T22:35:42.153098] [INFO ] [MAIN ] Derivative Progress: 250/1823 symbols completed. BKN took 1.1s. Estimated remaining: 10m 9s. Rate: 155.1 symbols/min [2025-10-10T22:35:42.155627] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:42.156961] [INFO ] [MAIN ] Derivative Progress: 251/1823 symbols completed. BKKT took 1.1s. Estimated remaining: 10m 6s. Rate: 155.7 symbols/min [2025-10-10T22:35:42.157474] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:42.173019] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:42.173949] [INFO ] [MAIN ] BKSY: Generated 1820 derivative records from 49237 primary records. [2025-10-10T22:35:42.174256] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-10T22:35:42.198438] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1820 records). [2025-10-10T22:35:42.198596] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-10T22:35:42.197394] [DEBUG] [LOCAL ] BKT: Loaded 12155 existing records from primary storage. [2025-10-10T22:35:42.200828] [INFO ] [MAIN ] Derivative Progress: 252/1823 symbols completed. BKSY took 1.1s. Estimated remaining: 10m 3s. Rate: 156.3 symbols/min [2025-10-10T22:35:42.201250] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:42.201061] [INFO ] [MAIN ] BKT: Loaded 12155 primary data records. [2025-10-10T22:35:42.351963] [DEBUG] [LOCAL ] BKV: Loaded 30370 existing records from primary storage. [2025-10-10T22:35:42.407212] [INFO ] [MAIN ] BKV: Loaded 30370 primary data records. [2025-10-10T22:35:42.670149] [DEBUG] [LOCAL ] BLCO: Loaded 36059 existing records from primary storage. [2025-10-10T22:35:42.683455] [INFO ] [MAIN ] BLCO: Loaded 36059 primary data records. [2025-10-10T22:35:43.216901] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:43.218740] [INFO ] [MAIN ] BKT: Generated 1820 derivative records from 12155 primary records. [2025-10-10T22:35:43.218871] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-10T22:35:43.240478] [DEBUG] [LOCAL ] BKT: Derivative data saved (1820 records). [2025-10-10T22:35:43.253408] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-10T22:35:43.253879] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:43.254600] [INFO ] [MAIN ] BKV: Generated 1820 derivative records from 30370 primary records. [2025-10-10T22:35:43.257117] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-10T22:35:43.257032] [INFO ] [MAIN ] Derivative Progress: 253/1823 symbols completed. BKT took 1.1s. Estimated remaining: 10m 7s. Rate: 155.2 symbols/min [2025-10-10T22:35:43.276138] [DEBUG] [LOCAL ] BKV: Derivative data saved (1820 records). [2025-10-10T22:35:43.288319] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-10T22:35:43.290669] [INFO ] [MAIN ] Derivative Progress: 254/1823 symbols completed. BKV took 1.1s. Estimated remaining: 10m 4s. Rate: 155.7 symbols/min [2025-10-10T22:35:43.290906] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:43.291702] [INFO ] [MAIN ] BLCO: Generated 1820 derivative records from 36059 primary records. [2025-10-10T22:35:43.291766] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-10T22:35:43.306854] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1820 records). [2025-10-10T22:35:43.306933] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-10T22:35:43.309144] [INFO ] [MAIN ] Derivative Progress: 255/1823 symbols completed. BLCO took 1.1s. Estimated remaining: 10m 2s. Rate: 156.3 symbols/min [2025-10-10T22:35:43.309763] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:43.309997] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:43.309824] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:43.327494] [DEBUG] [LOCAL ] BLE: Loaded 14251 existing records from primary storage. [2025-10-10T22:35:43.327825] [INFO ] [MAIN ] BLE: Loaded 14251 primary data records. [2025-10-10T22:35:43.530092] [DEBUG] [LOCAL ] BLD: Loaded 28106 existing records from primary storage. [2025-10-10T22:35:43.535928] [INFO ] [MAIN ] BLD: Loaded 28106 primary data records. [2025-10-10T22:35:43.738159] [DEBUG] [LOCAL ] BLDR: Loaded 52473 existing records from primary storage. [2025-10-10T22:35:43.749304] [INFO ] [MAIN ] BLDR: Loaded 52473 primary data records. [2025-10-10T22:35:44.301304] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:44.302957] [INFO ] [MAIN ] BLE: Generated 1820 derivative records from 14251 primary records. [2025-10-10T22:35:44.303764] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-10T22:35:44.338034] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:44.338119] [DEBUG] [LOCAL ] BLE: Derivative data saved (1820 records). [2025-10-10T22:35:44.338631] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-10T22:35:44.339364] [INFO ] [MAIN ] BLD: Generated 1820 derivative records from 28106 primary records. [2025-10-10T22:35:44.339591] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-10T22:35:44.342080] [INFO ] [MAIN ] Derivative Progress: 256/1823 symbols completed. BLE took 1.0s. Estimated remaining: 10m 5s. Rate: 155.3 symbols/min [2025-10-10T22:35:44.342718] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:44.375863] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:44.377247] [DEBUG] [LOCAL ] BLD: Derivative data saved (1820 records). [2025-10-10T22:35:44.377353] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-10T22:35:44.378247] [INFO ] [MAIN ] BLDR: Generated 1820 derivative records from 52473 primary records. [2025-10-10T22:35:44.380419] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-10T22:35:44.380190] [INFO ] [MAIN ] Derivative Progress: 257/1823 symbols completed. BLD took 1.1s. Estimated remaining: 10m 3s. Rate: 155.8 symbols/min [2025-10-10T22:35:44.380937] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:44.401059] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1820 records). [2025-10-10T22:35:44.401222] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-10T22:35:44.411939] [INFO ] [MAIN ] Derivative Progress: 258/1823 symbols completed. BLDR took 1.1s. Estimated remaining: 10m 0s. Rate: 156.4 symbols/min [2025-10-10T22:35:44.412384] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:44.433183] [DEBUG] [LOCAL ] BLK: Loaded 34578 existing records from primary storage. [2025-10-10T22:35:44.433344] [INFO ] [MAIN ] BLK: Loaded 34578 primary data records. [2025-10-10T22:35:44.542681] [DEBUG] [LOCAL ] BLW: Loaded 13518 existing records from primary storage. [2025-10-10T22:35:44.560183] [INFO ] [MAIN ] BLW: Loaded 13518 primary data records. [2025-10-10T22:35:44.607055] [DEBUG] [LOCAL ] BLND: Loaded 49952 existing records from primary storage. [2025-10-10T22:35:44.716844] [INFO ] [MAIN ] BLND: Loaded 49952 primary data records. [2025-10-10T22:35:45.472487] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:45.473527] [INFO ] [MAIN ] BLK: Generated 1820 derivative records from 34578 primary records. [2025-10-10T22:35:45.473671] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-10T22:35:45.492315] [DEBUG] [LOCAL ] BLK: Derivative data saved (1820 records). [2025-10-10T22:35:45.492724] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-10T22:35:45.495803] [INFO ] [MAIN ] Derivative Progress: 259/1823 symbols completed. BLK took 1.2s. Estimated remaining: 10m 4s. Rate: 155.3 symbols/min [2025-10-10T22:35:45.497503] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:45.513626] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:45.514791] [INFO ] [MAIN ] BLW: Generated 1820 derivative records from 13518 primary records. [2025-10-10T22:35:45.514877] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-10T22:35:45.547253] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:45.554977] [INFO ] [MAIN ] BLND: Generated 1820 derivative records from 49952 primary records. [2025-10-10T22:35:45.556051] [DEBUG] [LOCAL ] BLX: Loaded 15813 existing records from primary storage. [2025-10-10T22:35:45.556937] [INFO ] [MAIN ] BLX: Loaded 15813 primary data records. [2025-10-10T22:35:45.557116] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-10T22:35:45.557065] [DEBUG] [LOCAL ] BLW: Derivative data saved (1820 records). [2025-10-10T22:35:45.569286] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-10T22:35:45.592216] [INFO ] [MAIN ] Derivative Progress: 260/1823 symbols completed. BLW took 1.2s. Estimated remaining: 10m 2s. Rate: 155.8 symbols/min [2025-10-10T22:35:45.657082] [DEBUG] [LOCAL ] BLND: Derivative data saved (1820 records). [2025-10-10T22:35:45.662331] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:45.667738] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-10T22:35:45.678117] [INFO ] [MAIN ] Derivative Progress: 261/1823 symbols completed. BLND took 1.3s. Estimated remaining: 9m 60s. Rate: 156.2 symbols/min [2025-10-10T22:35:45.681513] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:45.890123] [DEBUG] [LOCAL ] BME: Loaded 11309 existing records from primary storage. [2025-10-10T22:35:45.890291] [INFO ] [MAIN ] BME: Loaded 11309 primary data records. [2025-10-10T22:35:46.022769] [DEBUG] [LOCAL ] BMA: Loaded 36296 existing records from primary storage. [2025-10-10T22:35:46.049619] [INFO ] [MAIN ] BMA: Loaded 36296 primary data records. [2025-10-10T22:35:46.541070] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:46.542125] [INFO ] [MAIN ] BLX: Generated 1820 derivative records from 15813 primary records. [2025-10-10T22:35:46.542262] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-10T22:35:46.578970] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:46.580273] [INFO ] [MAIN ] BME: Generated 1820 derivative records from 11309 primary records. [2025-10-10T22:35:46.579413] [DEBUG] [LOCAL ] BLX: Derivative data saved (1820 records). [2025-10-10T22:35:46.580890] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-10T22:35:46.583290] [INFO ] [MAIN ] Derivative Progress: 262/1823 symbols completed. BLX took 1.1s. Estimated remaining: 10m 3s. Rate: 155.4 symbols/min [2025-10-10T22:35:46.583727] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:46.580521] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-10T22:35:46.601349] [DEBUG] [LOCAL ] BME: Derivative data saved (1820 records). [2025-10-10T22:35:46.602370] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-10T22:35:46.604913] [INFO ] [MAIN ] Derivative Progress: 263/1823 symbols completed. BME took 0.9s. Estimated remaining: 10m 0s. Rate: 156.0 symbols/min [2025-10-10T22:35:46.605140] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:46.620360] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:46.621097] [INFO ] [MAIN ] BMA: Generated 1820 derivative records from 36296 primary records. [2025-10-10T22:35:46.621195] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-10T22:35:46.650074] [DEBUG] [LOCAL ] BMA: Derivative data saved (1820 records). [2025-10-10T22:35:46.650188] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-10T22:35:46.652499] [INFO ] [MAIN ] Derivative Progress: 264/1823 symbols completed. BMA took 1.0s. Estimated remaining: 9m 58s. Rate: 156.5 symbols/min [2025-10-10T22:35:46.652749] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:46.670750] [DEBUG] [LOCAL ] BMEZ: Loaded 26860 existing records from primary storage. [2025-10-10T22:35:46.671746] [DEBUG] [LOCAL ] BMI: Loaded 24727 existing records from primary storage. [2025-10-10T22:35:46.671036] [INFO ] [MAIN ] BMEZ: Loaded 26860 primary data records. [2025-10-10T22:35:46.683196] [INFO ] [MAIN ] BMI: Loaded 24727 primary data records. [2025-10-10T22:35:47.318561] [DEBUG] [LOCAL ] BMO: Loaded 41706 existing records from primary storage. [2025-10-10T22:35:47.332878] [INFO ] [MAIN ] BMO: Loaded 41706 primary data records. [2025-10-10T22:35:47.699533] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:47.700492] [INFO ] [MAIN ] BMEZ: Generated 1820 derivative records from 26860 primary records. [2025-10-10T22:35:47.700813] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-10T22:35:47.715359] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:47.723963] [INFO ] [MAIN ] BMI: Generated 1820 derivative records from 24727 primary records. [2025-10-10T22:35:47.729072] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-10T22:35:47.761751] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:47.767329] [INFO ] [MAIN ] BMO: Generated 1820 derivative records from 41706 primary records. [2025-10-10T22:35:47.767788] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-10T22:35:47.769005] [DEBUG] [LOCAL ] BMI: Derivative data saved (1820 records). [2025-10-10T22:35:47.766267] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1820 records). [2025-10-10T22:35:47.769159] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-10T22:35:47.769230] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-10T22:35:47.772795] [INFO ] [MAIN ] Derivative Progress: 265/1823 symbols completed. BMI took 1.2s. Estimated remaining: 10m 2s. Rate: 155.4 symbols/min [2025-10-10T22:35:47.784076] [INFO ] [MAIN ] Derivative Progress: 266/1823 symbols completed. BMEZ took 1.2s. Estimated remaining: 9m 59s. Rate: 155.9 symbols/min [2025-10-10T22:35:47.783936] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:47.792765] [DEBUG] [LOCAL ] BMO: Derivative data saved (1820 records). [2025-10-10T22:35:47.793193] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:47.793409] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-10T22:35:47.795982] [INFO ] [MAIN ] Derivative Progress: 267/1823 symbols completed. BMO took 1.1s. Estimated remaining: 9m 57s. Rate: 156.5 symbols/min [2025-10-10T22:35:47.796234] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:47.831759] [DEBUG] [LOCAL ] BNED: Loaded 29437 existing records from primary storage. [2025-10-10T22:35:47.831903] [INFO ] [MAIN ] BNED: Loaded 29437 primary data records. [2025-10-10T22:35:48.067219] [DEBUG] [LOCAL ] BN: Loaded 53765 existing records from primary storage. [2025-10-10T22:35:48.049346] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-10-10T22:35:48.184247] [INFO ] [MAIN ] BMY: Loaded 54537 primary data records. [2025-10-10T22:35:48.175913] [INFO ] [MAIN ] BN: Loaded 53765 primary data records. [2025-10-10T22:35:48.812034] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:48.815062] [INFO ] [MAIN ] BNED: Generated 1820 derivative records from 29437 primary records. [2025-10-10T22:35:48.815410] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-10T22:35:48.832942] [DEBUG] [LOCAL ] BNED: Derivative data saved (1820 records). [2025-10-10T22:35:48.833376] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-10T22:35:48.835540] [INFO ] [MAIN ] Derivative Progress: 268/1823 symbols completed. BNED took 1.0s. Estimated remaining: 9m 60s. Rate: 155.5 symbols/min [2025-10-10T22:35:48.868565] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:48.869869] [INFO ] [MAIN ] BN: Generated 1820 derivative records from 53765 primary records. [2025-10-10T22:35:48.870182] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-10T22:35:48.870121] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:48.871700] [INFO ] [MAIN ] BMY: Generated 1820 derivative records from 54537 primary records. [2025-10-10T22:35:48.872000] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-10T22:35:48.904355] [DEBUG] [LOCAL ] BN: Derivative data saved (1820 records). [2025-10-10T22:35:48.904045] [DEBUG] [LOCAL ] BMY: Derivative data saved (1820 records). [2025-10-10T22:35:48.904493] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-10T22:35:48.906943] [INFO ] [MAIN ] Derivative Progress: 269/1823 symbols completed. BMY took 1.1s. Estimated remaining: 9m 58s. Rate: 156.0 symbols/min [2025-10-10T22:35:48.907075] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-10T22:35:48.909636] [INFO ] [MAIN ] Derivative Progress: 270/1823 symbols completed. BN took 1.1s. Estimated remaining: 9m 55s. Rate: 156.6 symbols/min [2025-10-10T22:35:48.910113] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:48.910234] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:48.910025] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:48.918774] [DEBUG] [LOCAL ] BNJ: Loaded 2710 existing records from primary storage. [2025-10-10T22:35:48.922016] [DEBUG] [LOCAL ] BNH: Loaded 5306 existing records from primary storage. [2025-10-10T22:35:48.922383] [INFO ] [MAIN ] BNJ: Loaded 2710 primary data records. [2025-10-10T22:35:48.922501] [INFO ] [MAIN ] BNH: Loaded 5306 primary data records. [2025-10-10T22:35:49.586394] [DEBUG] [LOCAL ] BNL: Loaded 47890 existing records from primary storage. [2025-10-10T22:35:49.586846] [INFO ] [MAIN ] BNL: Loaded 47890 primary data records. [2025-10-10T22:35:49.906017] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:49.907747] [INFO ] [MAIN ] BNH: Generated 1820 derivative records from 5306 primary records. [2025-10-10T22:35:49.909935] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-10T22:35:49.935322] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:49.939542] [DEBUG] [LOCAL ] BNH: Derivative data saved (1820 records). [2025-10-10T22:35:49.940049] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-10T22:35:49.940942] [INFO ] [MAIN ] BNJ: Generated 1820 derivative records from 2710 primary records. [2025-10-10T22:35:49.941063] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-10T22:35:49.943179] [INFO ] [MAIN ] Derivative Progress: 271/1823 symbols completed. BNH took 1.0s. Estimated remaining: 9m 59s. Rate: 155.6 symbols/min [2025-10-10T22:35:49.943798] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:49.960275] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1820 records). [2025-10-10T22:35:49.960518] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-10T22:35:49.963064] [INFO ] [MAIN ] Derivative Progress: 272/1823 symbols completed. BNJ took 1.1s. Estimated remaining: 9m 56s. Rate: 156.1 symbols/min [2025-10-10T22:35:49.963243] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:49.970057] [DEBUG] [LOCAL ] BNT: Loaded 3433 existing records from primary storage. [2025-10-10T22:35:49.971330] [INFO ] [MAIN ] BNT: Loaded 3433 primary data records. [2025-10-10T22:35:50.087174] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:50.122175] [INFO ] [MAIN ] BNL: Generated 1820 derivative records from 47890 primary records. [2025-10-10T22:35:50.127714] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-10T22:35:50.347873] [DEBUG] [LOCAL ] BNS: Loaded 52233 existing records from primary storage. [2025-10-10T22:35:50.349071] [DEBUG] [LOCAL ] BNL: Derivative data saved (1820 records). [2025-10-10T22:35:50.349951] [INFO ] [MAIN ] BNS: Loaded 52233 primary data records. [2025-10-10T22:35:50.350242] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-10T22:35:50.353182] [INFO ] [MAIN ] Derivative Progress: 273/1823 symbols completed. BNL took 1.4s. Estimated remaining: 9m 56s. Rate: 156.1 symbols/min [2025-10-10T22:35:50.353670] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:50.465074] [DEBUG] [LOCAL ] BNY: Loaded 7231 existing records from primary storage. [2025-10-10T22:35:50.471392] [INFO ] [MAIN ] BNY: Loaded 7231 primary data records. [2025-10-10T22:35:50.893049] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:35:51.041298] [INFO ] [MAIN ] BNT: Generated 1819 derivative records from 3433 primary records. [2025-10-10T22:35:51.042995] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-10T22:35:51.062774] [DEBUG] [LOCAL ] BNT: Derivative data saved (1819 records). [2025-10-10T22:35:51.063593] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-10T22:35:51.066770] [INFO ] [MAIN ] Derivative Progress: 274/1823 symbols completed. BNT took 1.1s. Estimated remaining: 9m 57s. Rate: 155.6 symbols/min [2025-10-10T22:35:51.067284] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:51.091040] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:51.092096] [INFO ] [MAIN ] BNS: Generated 1820 derivative records from 52233 primary records. [2025-10-10T22:35:51.092344] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-10T22:35:51.143706] [DEBUG] [LOCAL ] BNS: Derivative data saved (1820 records). [2025-10-10T22:35:51.144306] [DEBUG] [LOCAL ] BOC: Loaded 18790 existing records from primary storage. [2025-10-10T22:35:51.144732] [INFO ] [MAIN ] BOC: Loaded 18790 primary data records. [2025-10-10T22:35:51.145073] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:51.145999] [INFO ] [MAIN ] BNY: Generated 1820 derivative records from 7231 primary records. [2025-10-10T22:35:51.144593] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-10T22:35:51.146194] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-10T22:35:51.160296] [INFO ] [MAIN ] Derivative Progress: 275/1823 symbols completed. BNS took 1.2s. Estimated remaining: 9m 55s. Rate: 156.1 symbols/min [2025-10-10T22:35:51.187404] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:51.287624] [DEBUG] [LOCAL ] BNY: Derivative data saved (1820 records). [2025-10-10T22:35:51.298138] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-10T22:35:51.300369] [INFO ] [MAIN ] Derivative Progress: 276/1823 symbols completed. BNY took 0.9s. Estimated remaining: 9m 53s. Rate: 156.4 symbols/min [2025-10-10T22:35:51.311260] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:51.340008] [DEBUG] [LOCAL ] BOE: Loaded 18415 existing records from primary storage. [2025-10-10T22:35:51.448741] [INFO ] [MAIN ] BOE: Loaded 18415 primary data records. [2025-10-10T22:35:51.810087] [DEBUG] [LOCAL ] BOH: Loaded 30903 existing records from primary storage. [2025-10-10T22:35:51.810390] [INFO ] [MAIN ] BOH: Loaded 30903 primary data records. [2025-10-10T22:35:52.137412] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:52.138395] [INFO ] [MAIN ] BOC: Generated 1820 derivative records from 18790 primary records. [2025-10-10T22:35:52.138559] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-10T22:35:52.157850] [DEBUG] [LOCAL ] BOC: Derivative data saved (1820 records). [2025-10-10T22:35:52.158024] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-10T22:35:52.160140] [INFO ] [MAIN ] Derivative Progress: 277/1823 symbols completed. BOC took 1.1s. Estimated remaining: 9m 56s. Rate: 155.7 symbols/min [2025-10-10T22:35:52.163825] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:52.178708] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:52.179405] [INFO ] [MAIN ] BOE: Generated 1820 derivative records from 18415 primary records. [2025-10-10T22:35:52.179578] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-10T22:35:52.196637] [DEBUG] [LOCAL ] BOE: Derivative data saved (1820 records). [2025-10-10T22:35:52.197737] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-10T22:35:52.201972] [INFO ] [MAIN ] Derivative Progress: 278/1823 symbols completed. BOE took 1.0s. Estimated remaining: 9m 53s. Rate: 156.2 symbols/min [2025-10-10T22:35:52.202289] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:52.225607] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:52.226321] [INFO ] [MAIN ] BOH: Generated 1820 derivative records from 30903 primary records. [2025-10-10T22:35:52.226479] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-10T22:35:52.252097] [DEBUG] [LOCAL ] BOH: Derivative data saved (1820 records). [2025-10-10T22:35:52.252862] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-10T22:35:52.252699] [DEBUG] [LOCAL ] BOND: Loaded 32729 existing records from primary storage. [2025-10-10T22:35:52.255244] [INFO ] [MAIN ] Derivative Progress: 279/1823 symbols completed. BOH took 0.9s. Estimated remaining: 9m 51s. Rate: 156.7 symbols/min [2025-10-10T22:35:52.255421] [INFO ] [MAIN ] BOND: Loaded 32729 primary data records. [2025-10-10T22:35:52.255536] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:52.587388] [DEBUG] [LOCAL ] BOOT: Loaded 40592 existing records from primary storage. [2025-10-10T22:35:52.588290] [INFO ] [MAIN ] BOOT: Loaded 40592 primary data records. [2025-10-10T22:35:52.708357] [DEBUG] [LOCAL ] BORR: Loaded 51843 existing records from primary storage. [2025-10-10T22:35:52.708628] [INFO ] [MAIN ] BORR: Loaded 51843 primary data records. [2025-10-10T22:35:53.250826] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:53.251762] [INFO ] [MAIN ] BOND: Generated 1820 derivative records from 32729 primary records. [2025-10-10T22:35:53.252167] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-10T22:35:53.270002] [DEBUG] [LOCAL ] BOND: Derivative data saved (1820 records). [2025-10-10T22:35:53.270453] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-10T22:35:53.272703] [INFO ] [MAIN ] Derivative Progress: 280/1823 symbols completed. BOND took 1.1s. Estimated remaining: 9m 54s. Rate: 155.8 symbols/min [2025-10-10T22:35:53.273077] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:53.289508] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:53.290236] [INFO ] [MAIN ] BOOT: Generated 1820 derivative records from 40592 primary records. [2025-10-10T22:35:53.290412] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-10T22:35:53.315851] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1820 records). [2025-10-10T22:35:53.316150] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-10T22:35:53.318128] [INFO ] [MAIN ] Derivative Progress: 281/1823 symbols completed. BOOT took 1.1s. Estimated remaining: 9m 52s. Rate: 156.3 symbols/min [2025-10-10T22:35:53.318524] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:53.338625] [DEBUG] [LOCAL ] BOW: Loaded 24153 existing records from primary storage. [2025-10-10T22:35:53.338866] [INFO ] [MAIN ] BOW: Loaded 24153 primary data records. [2025-10-10T22:35:53.339153] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:53.339931] [INFO ] [MAIN ] BORR: Generated 1820 derivative records from 51843 primary records. [2025-10-10T22:35:53.340008] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-10T22:35:53.431283] [DEBUG] [LOCAL ] BORR: Derivative data saved (1820 records). [2025-10-10T22:35:53.454295] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-10-10T22:35:53.459692] [INFO ] [MAIN ] Derivative Progress: 282/1823 symbols completed. BORR took 1.2s. Estimated remaining: 9m 50s. Rate: 156.6 symbols/min [2025-10-10T22:35:53.459863] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:53.700965] [DEBUG] [LOCAL ] BOX: Loaded 50941 existing records from primary storage. [2025-10-10T22:35:53.702486] [INFO ] [MAIN ] BOX: Loaded 50941 primary data records. [2025-10-10T22:35:53.918194] [DEBUG] [LOCAL ] BP: Loaded 54489 existing records from primary storage. [2025-10-10T22:35:53.924535] [INFO ] [MAIN ] BP: Loaded 54489 primary data records. [2025-10-10T22:35:54.345028] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:54.360137] [INFO ] [MAIN ] BOW: Generated 1820 derivative records from 24153 primary records. [2025-10-10T22:35:54.362916] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-10T22:35:54.387281] [DEBUG] [LOCAL ] BOW: Derivative data saved (1820 records). [2025-10-10T22:35:54.388233] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-10T22:35:54.390698] [INFO ] [MAIN ] Derivative Progress: 283/1823 symbols completed. BOW took 1.1s. Estimated remaining: 9m 53s. Rate: 155.8 symbols/min [2025-10-10T22:35:54.403851] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:54.404490] [INFO ] [MAIN ] BOX: Generated 1820 derivative records from 50941 primary records. [2025-10-10T22:35:54.404687] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-10T22:35:54.421269] [DEBUG] [LOCAL ] BOX: Derivative data saved (1820 records). [2025-10-10T22:35:54.421555] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-10T22:35:54.423599] [INFO ] [MAIN ] Derivative Progress: 284/1823 symbols completed. BOX took 1.1s. Estimated remaining: 9m 51s. Rate: 156.3 symbols/min [2025-10-10T22:35:54.438347] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:54.438922] [INFO ] [MAIN ] BP: Generated 1820 derivative records from 54489 primary records. [2025-10-10T22:35:54.438983] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-10T22:35:54.454063] [DEBUG] [LOCAL ] BP: Derivative data saved (1820 records). [2025-10-10T22:35:54.454126] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-10T22:35:54.456337] [INFO ] [MAIN ] Derivative Progress: 285/1823 symbols completed. BP took 1.0s. Estimated remaining: 9m 48s. Rate: 156.8 symbols/min [2025-10-10T22:35:54.456927] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:54.457336] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:54.457042] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:54.484781] [DEBUG] [LOCAL ] BRC: Loaded 19046 existing records from primary storage. [2025-10-10T22:35:54.485033] [INFO ] [MAIN ] BRC: Loaded 19046 primary data records. [2025-10-10T22:35:54.638301] [DEBUG] [LOCAL ] BR: Loaded 35349 existing records from primary storage. [2025-10-10T22:35:54.689899] [INFO ] [MAIN ] BR: Loaded 35349 primary data records. [2025-10-10T22:35:54.684609] [DEBUG] [LOCAL ] BRBR: Loaded 52223 existing records from primary storage. [2025-10-10T22:35:54.786594] [INFO ] [MAIN ] BRBR: Loaded 52223 primary data records. [2025-10-10T22:35:55.517831] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:55.518858] [INFO ] [MAIN ] BRC: Generated 1820 derivative records from 19046 primary records. [2025-10-10T22:35:55.518960] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-10T22:35:55.552274] [DEBUG] [LOCAL ] BRC: Derivative data saved (1820 records). [2025-10-10T22:35:55.553284] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-10T22:35:55.553586] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:55.557512] [INFO ] [MAIN ] BR: Generated 1820 derivative records from 35349 primary records. [2025-10-10T22:35:55.556761] [INFO ] [MAIN ] Derivative Progress: 286/1823 symbols completed. BRC took 1.1s. Estimated remaining: 9m 52s. Rate: 155.8 symbols/min [2025-10-10T22:35:55.557617] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-10T22:35:55.558122] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:55.584831] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:55.587227] [INFO ] [MAIN ] BRBR: Generated 1820 derivative records from 52223 primary records. [2025-10-10T22:35:55.588343] [DEBUG] [LOCAL ] BR: Derivative data saved (1820 records). [2025-10-10T22:35:55.588499] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-10T22:35:55.588566] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-10T22:35:55.591396] [INFO ] [MAIN ] Derivative Progress: 287/1823 symbols completed. BR took 1.1s. Estimated remaining: 9m 50s. Rate: 156.3 symbols/min [2025-10-10T22:35:55.591850] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:55.609224] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1820 records). [2025-10-10T22:35:55.609467] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-10T22:35:55.611851] [INFO ] [MAIN ] Derivative Progress: 288/1823 symbols completed. BRBR took 1.2s. Estimated remaining: 9m 47s. Rate: 156.8 symbols/min [2025-10-10T22:35:55.612199] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:55.643966] [DEBUG] [LOCAL ] BRCC: Loaded 40648 existing records from primary storage. [2025-10-10T22:35:55.644292] [INFO ] [MAIN ] BRCC: Loaded 40648 primary data records. [2025-10-10T22:35:55.836183] [DEBUG] [LOCAL ] BRO: Loaded 52722 existing records from primary storage. [2025-10-10T22:35:55.862520] [INFO ] [MAIN ] BRO: Loaded 52722 primary data records. [2025-10-10T22:35:56.072215] [DEBUG] [LOCAL ] BROS: Loaded 54079 existing records from primary storage. [2025-10-10T22:35:56.100546] [INFO ] [MAIN ] BROS: Loaded 54079 primary data records. [2025-10-10T22:35:56.628353] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:56.630018] [INFO ] [MAIN ] BRCC: Generated 1820 derivative records from 40648 primary records. [2025-10-10T22:35:56.630683] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-10T22:35:56.664353] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1820 records). [2025-10-10T22:35:56.664826] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-10T22:35:56.668087] [INFO ] [MAIN ] Derivative Progress: 289/1823 symbols completed. BRCC took 1.1s. Estimated remaining: 9m 50s. Rate: 155.9 symbols/min [2025-10-10T22:35:56.665603] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:56.669210] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:56.670702] [INFO ] [MAIN ] BRO: Generated 1820 derivative records from 52722 primary records. [2025-10-10T22:35:56.670920] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-10T22:35:56.689233] [DEBUG] [LOCAL ] BRO: Derivative data saved (1820 records). [2025-10-10T22:35:56.689390] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-10-10T22:35:56.691437] [INFO ] [MAIN ] Derivative Progress: 290/1823 symbols completed. BRO took 1.1s. Estimated remaining: 9m 48s. Rate: 156.4 symbols/min [2025-10-10T22:35:56.691731] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:56.708796] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:56.709568] [INFO ] [MAIN ] BROS: Generated 1820 derivative records from 54079 primary records. [2025-10-10T22:35:56.718952] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-10T22:35:56.740351] [DEBUG] [LOCAL ] BROS: Derivative data saved (1820 records). [2025-10-10T22:35:56.750394] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-10T22:35:56.754140] [INFO ] [MAIN ] Derivative Progress: 291/1823 symbols completed. BROS took 1.1s. Estimated remaining: 9m 46s. Rate: 156.8 symbols/min [2025-10-10T22:35:56.761535] [DEBUG] [LOCAL ] BRSP: Loaded 37280 existing records from primary storage. [2025-10-10T22:35:56.761701] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:56.762833] [INFO ] [MAIN ] BRSP: Loaded 37280 primary data records. [2025-10-10T22:35:56.775339] [DEBUG] [LOCAL ] BRW: Loaded 21087 existing records from primary storage. [2025-10-10T22:35:56.795560] [INFO ] [MAIN ] BRW: Loaded 21087 primary data records. [2025-10-10T22:35:57.439353] [DEBUG] [LOCAL ] BRX: Loaded 52530 existing records from primary storage. [2025-10-10T22:35:57.439893] [INFO ] [MAIN ] BRX: Loaded 52530 primary data records. [2025-10-10T22:35:57.770901] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:57.772262] [INFO ] [MAIN ] BRSP: Generated 1820 derivative records from 37280 primary records. [2025-10-10T22:35:57.772512] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-10T22:35:57.788064] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:57.801099] [INFO ] [MAIN ] BRW: Generated 1820 derivative records from 21087 primary records. [2025-10-10T22:35:57.803833] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-10-10T22:35:57.808365] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1820 records). [2025-10-10T22:35:57.815982] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-10T22:35:57.819254] [INFO ] [MAIN ] Derivative Progress: 292/1823 symbols completed. BRSP took 1.2s. Estimated remaining: 9m 49s. Rate: 155.9 symbols/min [2025-10-10T22:35:57.838488] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:57.839245] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:57.841026] [INFO ] [MAIN ] BRX: Generated 1820 derivative records from 52530 primary records. [2025-10-10T22:35:57.841470] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-10T22:35:57.843198] [DEBUG] [LOCAL ] BRW: Derivative data saved (1820 records). [2025-10-10T22:35:57.844694] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-10-10T22:35:57.847628] [INFO ] [MAIN ] Derivative Progress: 293/1823 symbols completed. BRW took 1.2s. Estimated remaining: 9m 47s. Rate: 156.4 symbols/min [2025-10-10T22:35:57.855275] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:57.865201] [DEBUG] [LOCAL ] BRX: Derivative data saved (1820 records). [2025-10-10T22:35:57.865449] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-10T22:35:57.868164] [INFO ] [MAIN ] Derivative Progress: 294/1823 symbols completed. BRX took 1.1s. Estimated remaining: 9m 45s. Rate: 156.9 symbols/min [2025-10-10T22:35:57.868517] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:57.890384] [DEBUG] [LOCAL ] BSL: Loaded 8430 existing records from primary storage. [2025-10-10T22:35:57.890575] [INFO ] [MAIN ] BSL: Loaded 8430 primary data records. [2025-10-10T22:35:57.980375] [DEBUG] [LOCAL ] BSAC: Loaded 33396 existing records from primary storage. [2025-10-10T22:35:58.020687] [INFO ] [MAIN ] BSAC: Loaded 33396 primary data records. [2025-10-10T22:35:58.339320] [DEBUG] [LOCAL ] BSBR: Loaded 35864 existing records from primary storage. [2025-10-10T22:35:58.354423] [INFO ] [MAIN ] BSBR: Loaded 35864 primary data records. [2025-10-10T22:35:58.928358] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:58.932501] [INFO ] [MAIN ] BSL: Generated 1820 derivative records from 8430 primary records. [2025-10-10T22:35:58.932951] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-10T22:35:58.963564] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:58.967883] [DEBUG] [LOCAL ] BSL: Derivative data saved (1820 records). [2025-10-10T22:35:58.969055] [INFO ] [MAIN ] BSAC: Generated 1820 derivative records from 33396 primary records. [2025-10-10T22:35:58.969297] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-10-10T22:35:58.981799] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-10-10T22:35:58.984693] [INFO ] [MAIN ] Derivative Progress: 295/1823 symbols completed. BSL took 1.1s. Estimated remaining: 9m 48s. Rate: 155.9 symbols/min [2025-10-10T22:35:58.985946] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:35:58.986313] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:58.988029] [INFO ] [MAIN ] BSBR: Generated 1820 derivative records from 35864 primary records. [2025-10-10T22:35:58.988123] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-10T22:35:59.019365] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1820 records). [2025-10-10T22:35:59.020211] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-10T22:35:59.022745] [INFO ] [MAIN ] Derivative Progress: 296/1823 symbols completed. BSBR took 1.2s. Estimated remaining: 9m 46s. Rate: 156.4 symbols/min [2025-10-10T22:35:59.022870] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1820 records). [2025-10-10T22:35:59.023123] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-10-10T22:35:59.025756] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:59.025965] [INFO ] [MAIN ] Derivative Progress: 297/1823 symbols completed. BSAC took 1.2s. Estimated remaining: 9m 44s. Rate: 156.9 symbols/min [2025-10-10T22:35:59.026622] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:35:59.055863] [DEBUG] [LOCAL ] BSM: Loaded 32627 existing records from primary storage. [2025-10-10T22:35:59.064024] [INFO ] [MAIN ] BSM: Loaded 32627 primary data records. [2025-10-10T22:35:59.107059] [DEBUG] [LOCAL ] BST: Loaded 19239 existing records from primary storage. [2025-10-10T22:35:59.165243] [DEBUG] [LOCAL ] BSTZ: Loaded 25316 existing records from primary storage. [2025-10-10T22:35:59.164752] [INFO ] [MAIN ] BST: Loaded 19239 primary data records. [2025-10-10T22:35:59.189154] [INFO ] [MAIN ] BSTZ: Loaded 25316 primary data records. [2025-10-10T22:36:00.037974] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:00.040014] [INFO ] [MAIN ] BSM: Generated 1820 derivative records from 32627 primary records. [2025-10-10T22:36:00.041451] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-10-10T22:36:00.071834] [DEBUG] [LOCAL ] BSM: Derivative data saved (1820 records). [2025-10-10T22:36:00.072242] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-10-10T22:36:00.074473] [INFO ] [MAIN ] Derivative Progress: 298/1823 symbols completed. BSM took 1.1s. Estimated remaining: 9m 47s. Rate: 156.0 symbols/min [2025-10-10T22:36:00.074725] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:00.076611] [INFO ] [MAIN ] BSTZ: Generated 1820 derivative records from 25316 primary records. [2025-10-10T22:36:00.077039] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-10T22:36:00.110948] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:00.113954] [INFO ] [MAIN ] BST: Generated 1820 derivative records from 19239 primary records. [2025-10-10T22:36:00.114071] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-10T22:36:00.113797] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1820 records). [2025-10-10T22:36:00.115768] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-10-10T22:36:00.125752] [INFO ] [MAIN ] Derivative Progress: 299/1823 symbols completed. BSTZ took 1.1s. Estimated remaining: 9m 45s. Rate: 156.4 symbols/min [2025-10-10T22:36:00.134275] [DEBUG] [LOCAL ] BST: Derivative data saved (1820 records). [2025-10-10T22:36:00.134346] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-10-10T22:36:00.136468] [INFO ] [MAIN ] Derivative Progress: 300/1823 symbols completed. BST took 1.1s. Estimated remaining: 9m 42s. Rate: 156.9 symbols/min [2025-10-10T22:36:00.136990] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:00.137181] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:00.137057] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:00.147912] [DEBUG] [LOCAL ] BTA: Loaded 5614 existing records from primary storage. [2025-10-10T22:36:00.152932] [INFO ] [MAIN ] BTA: Loaded 5614 primary data records. [2025-10-10T22:36:00.251097] [DEBUG] [LOCAL ] BTCM: Loaded 16477 existing records from primary storage. [2025-10-10T22:36:00.265582] [INFO ] [MAIN ] BTCM: Loaded 16477 primary data records. [2025-10-10T22:36:00.605507] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-10-10T22:36:00.635954] [INFO ] [MAIN ] BSX: Loaded 54468 primary data records. [2025-10-10T22:36:01.160209] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:01.162581] [INFO ] [MAIN ] BTA: Generated 1820 derivative records from 5614 primary records. [2025-10-10T22:36:01.162812] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-10T22:36:01.193624] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:36:01.195180] [INFO ] [MAIN ] BTCM: Generated 1819 derivative records from 16477 primary records. [2025-10-10T22:36:01.195274] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-10-10T22:36:01.195751] [DEBUG] [LOCAL ] BTA: Derivative data saved (1820 records). [2025-10-10T22:36:01.195836] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-10T22:36:01.198245] [INFO ] [MAIN ] Derivative Progress: 301/1823 symbols completed. BTA took 1.1s. Estimated remaining: 9m 45s. Rate: 156.0 symbols/min [2025-10-10T22:36:01.199257] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:01.230496] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1819 records). [2025-10-10T22:36:01.231123] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-10-10T22:36:01.233221] [INFO ] [MAIN ] Derivative Progress: 302/1823 symbols completed. BTCM took 1.1s. Estimated remaining: 9m 43s. Rate: 156.5 symbols/min [2025-10-10T22:36:01.233441] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:01.230951] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:01.234498] [INFO ] [MAIN ] BSX: Generated 1820 derivative records from 54468 primary records. [2025-10-10T22:36:01.234585] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-10T22:36:01.256162] [DEBUG] [LOCAL ] BTO: Loaded 8861 existing records from primary storage. [2025-10-10T22:36:01.257332] [INFO ] [MAIN ] BTO: Loaded 8861 primary data records. [2025-10-10T22:36:01.338615] [DEBUG] [LOCAL ] BSX: Derivative data saved (1820 records). [2025-10-10T22:36:01.351317] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-10-10T22:36:01.370006] [INFO ] [MAIN ] Derivative Progress: 303/1823 symbols completed. BSX took 1.2s. Estimated remaining: 9m 42s. Rate: 156.8 symbols/min [2025-10-10T22:36:01.381527] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:01.454774] [DEBUG] [LOCAL ] BTE: Loaded 53492 existing records from primary storage. [2025-10-10T22:36:01.555738] [INFO ] [MAIN ] BTE: Loaded 53492 primary data records. [2025-10-10T22:36:01.702266] [DEBUG] [LOCAL ] BTT: Loaded 16040 existing records from primary storage. [2025-10-10T22:36:01.714923] [INFO ] [MAIN ] BTT: Loaded 16040 primary data records. [2025-10-10T22:36:02.248118] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:02.250181] [INFO ] [MAIN ] BTO: Generated 1820 derivative records from 8861 primary records. [2025-10-10T22:36:02.250355] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-10T22:36:02.272327] [DEBUG] [LOCAL ] BTO: Derivative data saved (1820 records). [2025-10-10T22:36:02.272957] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-10T22:36:02.276101] [INFO ] [MAIN ] Derivative Progress: 304/1823 symbols completed. BTO took 1.0s. Estimated remaining: 9m 44s. Rate: 156.1 symbols/min [2025-10-10T22:36:02.277161] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:02.299000] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:02.300402] [INFO ] [MAIN ] BTE: Generated 1820 derivative records from 53492 primary records. [2025-10-10T22:36:02.300823] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-10T22:36:02.334148] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:02.335891] [INFO ] [MAIN ] BTT: Generated 1820 derivative records from 16040 primary records. [2025-10-10T22:36:02.336320] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-10T22:36:02.339786] [DEBUG] [LOCAL ] BTE: Derivative data saved (1820 records). [2025-10-10T22:36:02.339869] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-10-10T22:36:02.348994] [INFO ] [MAIN ] Derivative Progress: 305/1823 symbols completed. BTE took 1.1s. Estimated remaining: 9m 42s. Rate: 156.5 symbols/min [2025-10-10T22:36:02.349381] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:02.376986] [DEBUG] [LOCAL ] BTT: Derivative data saved (1820 records). [2025-10-10T22:36:02.381939] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-10-10T22:36:02.384150] [INFO ] [MAIN ] Derivative Progress: 306/1823 symbols completed. BTT took 1.0s. Estimated remaining: 9m 40s. Rate: 157.0 symbols/min [2025-10-10T22:36:02.384513] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:02.397628] [DEBUG] [LOCAL ] BTZ: Loaded 23117 existing records from primary storage. [2025-10-10T22:36:02.397972] [INFO ] [MAIN ] BTZ: Loaded 23117 primary data records. [2025-10-10T22:36:02.448702] [DEBUG] [LOCAL ] BTU: Loaded 54095 existing records from primary storage. [2025-10-10T22:36:02.476444] [INFO ] [MAIN ] BTU: Loaded 54095 primary data records. [2025-10-10T22:36:02.801273] [DEBUG] [LOCAL ] BUD: Loaded 53443 existing records from primary storage. [2025-10-10T22:36:03.004017] [INFO ] [MAIN ] BUD: Loaded 53443 primary data records. [2025-10-10T22:36:03.498750] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:03.643060] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:03.654870] [INFO ] [MAIN ] BTZ: Generated 1820 derivative records from 23117 primary records. [2025-10-10T22:36:03.654086] [INFO ] [MAIN ] BTU: Generated 1820 derivative records from 54095 primary records. [2025-10-10T22:36:03.654999] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-10T22:36:03.655107] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-10T22:36:03.698006] [DEBUG] [LOCAL ] BTU: Derivative data saved (1820 records). [2025-10-10T22:36:03.699383] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1820 records). [2025-10-10T22:36:03.699006] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-10T22:36:03.699544] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-10T22:36:03.701701] [INFO ] [MAIN ] Derivative Progress: 307/1823 symbols completed. BTZ took 1.4s. Estimated remaining: 9m 44s. Rate: 155.7 symbols/min [2025-10-10T22:36:03.704517] [INFO ] [MAIN ] Derivative Progress: 308/1823 symbols completed. BTU took 1.4s. Estimated remaining: 9m 42s. Rate: 156.3 symbols/min [2025-10-10T22:36:03.704425] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:03.706254] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:03.737237] [DEBUG] [LOCAL ] BUI: Loaded 12043 existing records from primary storage. [2025-10-10T22:36:03.737536] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:03.738319] [INFO ] [MAIN ] BUD: Generated 1820 derivative records from 53443 primary records. [2025-10-10T22:36:03.738467] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-10T22:36:03.738552] [INFO ] [MAIN ] BUI: Loaded 12043 primary data records. [2025-10-10T22:36:03.886770] [DEBUG] [LOCAL ] BUD: Derivative data saved (1820 records). [2025-10-10T22:36:03.887097] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-10T22:36:03.889346] [INFO ] [MAIN ] Derivative Progress: 309/1823 symbols completed. BUD took 1.5s. Estimated remaining: 9m 40s. Rate: 156.5 symbols/min [2025-10-10T22:36:03.912300] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:04.127464] [DEBUG] [LOCAL ] BUR: Loaded 45896 existing records from primary storage. [2025-10-10T22:36:04.128483] [INFO ] [MAIN ] BUR: Loaded 45896 primary data records. [2025-10-10T22:36:04.496104] [DEBUG] [LOCAL ] BURL: Loaded 46344 existing records from primary storage. [2025-10-10T22:36:04.496508] [INFO ] [MAIN ] BURL: Loaded 46344 primary data records. [2025-10-10T22:36:04.700503] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:04.715627] [INFO ] [MAIN ] BUI: Generated 1820 derivative records from 12043 primary records. [2025-10-10T22:36:04.818336] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-10T22:36:04.839748] [DEBUG] [LOCAL ] BUI: Derivative data saved (1820 records). [2025-10-10T22:36:04.841424] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-10T22:36:04.843696] [INFO ] [MAIN ] Derivative Progress: 310/1823 symbols completed. BUI took 1.1s. Estimated remaining: 9m 43s. Rate: 155.8 symbols/min [2025-10-10T22:36:04.844114] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:04.859128] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:04.860043] [INFO ] [MAIN ] BUR: Generated 1820 derivative records from 45896 primary records. [2025-10-10T22:36:04.860321] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-10T22:36:04.881618] [DEBUG] [LOCAL ] BUR: Derivative data saved (1820 records). [2025-10-10T22:36:04.882516] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-10T22:36:04.884996] [INFO ] [MAIN ] Derivative Progress: 311/1823 symbols completed. BUR took 1.2s. Estimated remaining: 9m 41s. Rate: 156.2 symbols/min [2025-10-10T22:36:04.886426] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:04.892824] [DEBUG] [LOCAL ] BUXX: Loaded 15454 existing records from primary storage. [2025-10-10T22:36:04.893054] [INFO ] [MAIN ] BUXX: Loaded 15454 primary data records. [2025-10-10T22:36:04.905796] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:04.929140] [INFO ] [MAIN ] BURL: Generated 1820 derivative records from 46344 primary records. [2025-10-10T22:36:04.939700] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-10T22:36:05.010445] [DEBUG] [LOCAL ] BURL: Derivative data saved (1820 records). [2025-10-10T22:36:05.025578] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-10T22:36:05.030760] [INFO ] [MAIN ] Derivative Progress: 312/1823 symbols completed. BURL took 1.1s. Estimated remaining: 9m 39s. Rate: 156.5 symbols/min [2025-10-10T22:36:05.045820] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:05.265953] [DEBUG] [LOCAL ] BV: Loaded 39079 existing records from primary storage. [2025-10-10T22:36:05.267538] [INFO ] [MAIN ] BV: Loaded 39079 primary data records. [2025-10-10T22:36:05.465024] [DEBUG] [LOCAL ] BW: Loaded 40915 existing records from primary storage. [2025-10-10T22:36:05.468189] [INFO ] [MAIN ] BW: Loaded 40915 primary data records. [2025-10-10T22:36:05.758707] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:05.768517] [INFO ] [MAIN ] BUXX: Generated 1820 derivative records from 15454 primary records. [2025-10-10T22:36:05.768771] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-10T22:36:05.926944] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1820 records). [2025-10-10T22:36:05.928288] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-10T22:36:05.931006] [INFO ] [MAIN ] Derivative Progress: 313/1823 symbols completed. BUXX took 1.1s. Estimated remaining: 9m 41s. Rate: 155.9 symbols/min [2025-10-10T22:36:05.948095] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:05.949009] [INFO ] [MAIN ] BV: Generated 1820 derivative records from 39079 primary records. [2025-10-10T22:36:05.949359] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-10-10T22:36:05.966665] [DEBUG] [LOCAL ] BV: Derivative data saved (1820 records). [2025-10-10T22:36:05.967010] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-10-10T22:36:05.969443] [INFO ] [MAIN ] Derivative Progress: 314/1823 symbols completed. BV took 1.1s. Estimated remaining: 9m 39s. Rate: 156.3 symbols/min [2025-10-10T22:36:05.984206] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:05.984878] [INFO ] [MAIN ] BW: Generated 1820 derivative records from 40915 primary records. [2025-10-10T22:36:05.984941] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-10T22:36:06.000391] [DEBUG] [LOCAL ] BW: Derivative data saved (1820 records). [2025-10-10T22:36:06.000448] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-10T22:36:06.002592] [INFO ] [MAIN ] Derivative Progress: 315/1823 symbols completed. BW took 1.0s. Estimated remaining: 9m 37s. Rate: 156.8 symbols/min [2025-10-10T22:36:06.002994] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:06.003184] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:06.003065] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:06.021285] [DEBUG] [LOCAL ] BWG: Loaded 12767 existing records from primary storage. [2025-10-10T22:36:06.021470] [INFO ] [MAIN ] BWG: Loaded 12767 primary data records. [2025-10-10T22:36:06.243151] [DEBUG] [LOCAL ] BWLP: Loaded 32930 existing records from primary storage. [2025-10-10T22:36:06.248130] [INFO ] [MAIN ] BWLP: Loaded 32930 primary data records. [2025-10-10T22:36:06.354770] [DEBUG] [LOCAL ] BWA: Loaded 52923 existing records from primary storage. [2025-10-10T22:36:06.389293] [INFO ] [MAIN ] BWA: Loaded 52923 primary data records. [2025-10-10T22:36:07.030326] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:07.031479] [INFO ] [MAIN ] BWG: Generated 1820 derivative records from 12767 primary records. [2025-10-10T22:36:07.032061] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-10T22:36:07.051380] [DEBUG] [LOCAL ] BWG: Derivative data saved (1820 records). [2025-10-10T22:36:07.051808] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-10T22:36:07.054341] [INFO ] [MAIN ] Derivative Progress: 316/1823 symbols completed. BWG took 1.1s. Estimated remaining: 9m 40s. Rate: 155.9 symbols/min [2025-10-10T22:36:07.054594] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:07.082076] [DEBUG] [LOCAL ] BWMX: Loaded 7816 existing records from primary storage. [2025-10-10T22:36:07.082355] [INFO ] [MAIN ] BWMX: Loaded 7816 primary data records. [2025-10-10T22:36:07.127452] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:07.127232] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:07.140337] [INFO ] [MAIN ] BWA: Generated 1820 derivative records from 52923 primary records. [2025-10-10T22:36:07.161618] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-10T22:36:07.152948] [INFO ] [MAIN ] BWLP: Generated 1820 derivative records from 32930 primary records. [2025-10-10T22:36:07.189305] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-10T22:36:07.425612] [DEBUG] [LOCAL ] BWA: Derivative data saved (1820 records). [2025-10-10T22:36:07.426554] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-10T22:36:07.426962] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1820 records). [2025-10-10T22:36:07.429401] [INFO ] [MAIN ] Derivative Progress: 317/1823 symbols completed. BWA took 1.4s. Estimated remaining: 9m 40s. Rate: 155.9 symbols/min [2025-10-10T22:36:07.429609] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-10T22:36:07.429748] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:07.432048] [INFO ] [MAIN ] Derivative Progress: 318/1823 symbols completed. BWLP took 1.4s. Estimated remaining: 9m 37s. Rate: 156.4 symbols/min [2025-10-10T22:36:07.433116] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:07.442200] [DEBUG] [LOCAL ] BWSN: Loaded 5205 existing records from primary storage. [2025-10-10T22:36:07.442696] [INFO ] [MAIN ] BWSN: Loaded 5205 primary data records. [2025-10-10T22:36:07.780018] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:07.781957] [INFO ] [MAIN ] BWMX: Generated 1820 derivative records from 7816 primary records. [2025-10-10T22:36:07.783067] [DEBUG] [LOCAL ] BWXT: Loaded 47543 existing records from primary storage. [2025-10-10T22:36:07.784100] [INFO ] [MAIN ] BWXT: Loaded 47543 primary data records. [2025-10-10T22:36:07.783632] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-10T22:36:07.905357] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1820 records). [2025-10-10T22:36:07.905620] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-10T22:36:07.909550] [INFO ] [MAIN ] Derivative Progress: 319/1823 symbols completed. BWMX took 0.9s. Estimated remaining: 9m 37s. Rate: 156.3 symbols/min [2025-10-10T22:36:07.909976] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:08.124225] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:08.125736] [INFO ] [MAIN ] BWSN: Generated 1820 derivative records from 5205 primary records. [2025-10-10T22:36:08.126185] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-10T22:36:08.156695] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1820 records). [2025-10-10T22:36:08.157025] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-10T22:36:08.159200] [INFO ] [MAIN ] Derivative Progress: 320/1823 symbols completed. BWSN took 0.7s. Estimated remaining: 9m 36s. Rate: 156.4 symbols/min [2025-10-10T22:36:08.159587] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:08.181901] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:08.197019] [INFO ] [MAIN ] BWXT: Generated 1820 derivative records from 47543 primary records. [2025-10-10T22:36:08.197225] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-10T22:36:08.198555] [DEBUG] [LOCAL ] BX: Loaded 54259 existing records from primary storage. [2025-10-10T22:36:08.198725] [INFO ] [MAIN ] BX: Loaded 54259 primary data records. [2025-10-10T22:36:08.246434] [DEBUG] [LOCAL ] BXC: Loaded 13860 existing records from primary storage. [2025-10-10T22:36:08.258729] [INFO ] [MAIN ] BXC: Loaded 13860 primary data records. [2025-10-10T22:36:08.335769] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1820 records). [2025-10-10T22:36:08.346157] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-10T22:36:08.364958] [INFO ] [MAIN ] Derivative Progress: 321/1823 symbols completed. BWXT took 0.9s. Estimated remaining: 9m 35s. Rate: 156.7 symbols/min [2025-10-10T22:36:08.376951] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:08.899046] [DEBUG] [LOCAL ] BXMT: Loaded 47937 existing records from primary storage. [2025-10-10T22:36:08.899663] [INFO ] [MAIN ] BXMT: Loaded 47937 primary data records. [2025-10-10T22:36:09.092086] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:09.217867] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:09.227809] [INFO ] [MAIN ] BX: Generated 1820 derivative records from 54259 primary records. [2025-10-10T22:36:09.227160] [INFO ] [MAIN ] BXC: Generated 1820 derivative records from 13860 primary records. [2025-10-10T22:36:09.227915] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-10T22:36:09.227998] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-10T22:36:09.260625] [DEBUG] [LOCAL ] BXC: Derivative data saved (1820 records). [2025-10-10T22:36:09.261121] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-10T22:36:09.264569] [INFO ] [MAIN ] Derivative Progress: 322/1823 symbols completed. BXC took 1.1s. Estimated remaining: 9m 37s. Rate: 156.0 symbols/min [2025-10-10T22:36:09.265438] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:09.267753] [DEBUG] [LOCAL ] BX: Derivative data saved (1820 records). [2025-10-10T22:36:09.267902] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-10T22:36:09.270440] [INFO ] [MAIN ] Derivative Progress: 323/1823 symbols completed. BX took 1.4s. Estimated remaining: 9m 35s. Rate: 156.5 symbols/min [2025-10-10T22:36:09.270690] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:09.289353] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:09.294745] [INFO ] [MAIN ] BXMT: Generated 1820 derivative records from 47937 primary records. [2025-10-10T22:36:09.294933] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-10T22:36:09.317830] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1820 records). [2025-10-10T22:36:09.319439] [DEBUG] [LOCAL ] BXMX: Loaded 19803 existing records from primary storage. [2025-10-10T22:36:09.319547] [INFO ] [MAIN ] BXMX: Loaded 19803 primary data records. [2025-10-10T22:36:09.330823] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-10T22:36:09.342987] [INFO ] [MAIN ] Derivative Progress: 324/1823 symbols completed. BXMT took 1.0s. Estimated remaining: 9m 33s. Rate: 156.9 symbols/min [2025-10-10T22:36:09.358868] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:09.638472] [DEBUG] [LOCAL ] BXP: Loaded 50547 existing records from primary storage. [2025-10-10T22:36:09.662567] [INFO ] [MAIN ] BXP: Loaded 50547 primary data records. [2025-10-10T22:36:09.788769] [DEBUG] [LOCAL ] BXSL: Loaded 48607 existing records from primary storage. [2025-10-10T22:36:09.799750] [INFO ] [MAIN ] BXSL: Loaded 48607 primary data records. [2025-10-10T22:36:10.291412] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:10.293040] [INFO ] [MAIN ] BXMX: Generated 1820 derivative records from 19803 primary records. [2025-10-10T22:36:10.293526] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-10T22:36:10.329444] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:10.329056] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1820 records). [2025-10-10T22:36:10.329617] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-10T22:36:10.331933] [INFO ] [MAIN ] Derivative Progress: 325/1823 symbols completed. BXMX took 1.1s. Estimated remaining: 9m 36s. Rate: 156.1 symbols/min [2025-10-10T22:36:10.332206] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:10.333564] [INFO ] [MAIN ] BXP: Generated 1820 derivative records from 50547 primary records. [2025-10-10T22:36:10.333734] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-10T22:36:10.352800] [DEBUG] [LOCAL ] BXP: Derivative data saved (1820 records). [2025-10-10T22:36:10.353051] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-10T22:36:10.355286] [INFO ] [MAIN ] Derivative Progress: 326/1823 symbols completed. BXP took 1.1s. Estimated remaining: 9m 34s. Rate: 156.6 symbols/min [2025-10-10T22:36:10.355566] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:10.368819] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:10.369502] [INFO ] [MAIN ] BXSL: Generated 1820 derivative records from 48607 primary records. [2025-10-10T22:36:10.369700] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-10T22:36:10.390154] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1820 records). [2025-10-10T22:36:10.390414] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-10-10T22:36:10.392563] [INFO ] [MAIN ] Derivative Progress: 327/1823 symbols completed. BXSL took 1.0s. Estimated remaining: 9m 32s. Rate: 157.0 symbols/min [2025-10-10T22:36:10.392751] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:10.408929] [DEBUG] [LOCAL ] BYM: Loaded 12105 existing records from primary storage. [2025-10-10T22:36:10.409240] [INFO ] [MAIN ] BYM: Loaded 12105 primary data records. [2025-10-10T22:36:10.528119] [DEBUG] [LOCAL ] BYD: Loaded 45519 existing records from primary storage. [2025-10-10T22:36:10.528751] [INFO ] [MAIN ] BYD: Loaded 45519 primary data records. [2025-10-10T22:36:10.705902] [DEBUG] [LOCAL ] BZH: Loaded 32907 existing records from primary storage. [2025-10-10T22:36:10.868230] [INFO ] [MAIN ] BZH: Loaded 32907 primary data records. [2025-10-10T22:36:11.425859] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:11.428853] [INFO ] [MAIN ] BYM: Generated 1820 derivative records from 12105 primary records. [2025-10-10T22:36:11.429753] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-10T22:36:11.454862] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:11.456331] [INFO ] [MAIN ] BYD: Generated 1820 derivative records from 45519 primary records. [2025-10-10T22:36:11.458260] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-10T22:36:11.470513] [DEBUG] [LOCAL ] BYM: Derivative data saved (1820 records). [2025-10-10T22:36:11.473831] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-10T22:36:11.476584] [INFO ] [MAIN ] Derivative Progress: 328/1823 symbols completed. BYM took 1.1s. Estimated remaining: 9m 34s. Rate: 156.1 symbols/min [2025-10-10T22:36:11.493948] [DEBUG] [LOCAL ] BYD: Derivative data saved (1820 records). [2025-10-10T22:36:11.494134] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-10T22:36:11.496576] [INFO ] [MAIN ] Derivative Progress: 329/1823 symbols completed. BYD took 1.2s. Estimated remaining: 9m 32s. Rate: 156.6 symbols/min [2025-10-10T22:36:11.494334] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:11.497929] [INFO ] [MAIN ] BZH: Generated 1820 derivative records from 32907 primary records. [2025-10-10T22:36:11.498120] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-10T22:36:11.514100] [DEBUG] [LOCAL ] BZH: Derivative data saved (1820 records). [2025-10-10T22:36:11.514164] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-10T22:36:11.516478] [INFO ] [MAIN ] Derivative Progress: 330/1823 symbols completed. BZH took 1.1s. Estimated remaining: 9m 30s. Rate: 157.0 symbols/min [2025-10-10T22:36:11.517024] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:11.516904] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:11.517122] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:11.542150] [DEBUG] [LOCAL ] CABO: Loaded 17073 existing records from primary storage. [2025-10-10T22:36:11.542310] [INFO ] [MAIN ] CABO: Loaded 17073 primary data records. [2025-10-10T22:36:11.613474] [DEBUG] [LOCAL ] CAAP: Loaded 20121 existing records from primary storage. [2025-10-10T22:36:11.626555] [INFO ] [MAIN ] CAAP: Loaded 20121 primary data records. [2025-10-10T22:36:12.039680] [DEBUG] [LOCAL ] C: Loaded 54520 existing records from primary storage. [2025-10-10T22:36:12.063986] [INFO ] [MAIN ] C: Loaded 54520 primary data records. [2025-10-10T22:36:12.598574] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:12.601851] [INFO ] [MAIN ] CABO: Generated 1820 derivative records from 17073 primary records. [2025-10-10T22:36:12.603341] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-10T22:36:12.626990] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:12.633787] [INFO ] [MAIN ] CAAP: Generated 1820 derivative records from 20121 primary records. [2025-10-10T22:36:12.633963] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-10T22:36:12.656627] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1820 records). [2025-10-10T22:36:12.658254] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-10T22:36:12.662197] [INFO ] [MAIN ] Derivative Progress: 331/1823 symbols completed. CAAP took 1.1s. Estimated remaining: 9m 33s. Rate: 156.1 symbols/min [2025-10-10T22:36:12.663871] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:12.663701] [DEBUG] [LOCAL ] CABO: Derivative data saved (1820 records). [2025-10-10T22:36:12.664271] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-10T22:36:12.666799] [INFO ] [MAIN ] Derivative Progress: 332/1823 symbols completed. CABO took 1.1s. Estimated remaining: 9m 31s. Rate: 156.6 symbols/min [2025-10-10T22:36:12.667329] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:12.681133] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:12.681985] [INFO ] [MAIN ] C: Generated 1820 derivative records from 54520 primary records. [2025-10-10T22:36:12.682133] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-10T22:36:12.699395] [DEBUG] [LOCAL ] C: Derivative data saved (1820 records). [2025-10-10T22:36:12.699593] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-10T22:36:12.701773] [INFO ] [MAIN ] Derivative Progress: 333/1823 symbols completed. C took 1.2s. Estimated remaining: 9m 29s. Rate: 157.0 symbols/min [2025-10-10T22:36:12.702097] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:12.720362] [DEBUG] [LOCAL ] CACI: Loaded 24045 existing records from primary storage. [2025-10-10T22:36:12.720522] [INFO ] [MAIN ] CACI: Loaded 24045 primary data records. [2025-10-10T22:36:12.885006] [DEBUG] [LOCAL ] CADE: Loaded 49940 existing records from primary storage. [2025-10-10T22:36:12.891797] [INFO ] [MAIN ] CADE: Loaded 49940 primary data records. [2025-10-10T22:36:12.990587] [DEBUG] [LOCAL ] CAE: Loaded 39779 existing records from primary storage. [2025-10-10T22:36:13.014315] [INFO ] [MAIN ] CAE: Loaded 39779 primary data records. [2025-10-10T22:36:13.771074] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:13.773370] [INFO ] [MAIN ] CACI: Generated 1820 derivative records from 24045 primary records. [2025-10-10T22:36:13.773829] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-10T22:36:13.799230] [DEBUG] [LOCAL ] CACI: Derivative data saved (1820 records). [2025-10-10T22:36:13.807822] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-10T22:36:13.815737] [INFO ] [MAIN ] Derivative Progress: 334/1823 symbols completed. CACI took 1.2s. Estimated remaining: 9m 32s. Rate: 156.1 symbols/min [2025-10-10T22:36:13.816130] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:13.816547] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:13.818855] [INFO ] [MAIN ] CADE: Generated 1820 derivative records from 49940 primary records. [2025-10-10T22:36:13.819099] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-10T22:36:13.839313] [DEBUG] [LOCAL ] CAF: Loaded 3477 existing records from primary storage. [2025-10-10T22:36:13.848466] [INFO ] [MAIN ] CAF: Loaded 3477 primary data records. [2025-10-10T22:36:13.865884] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:13.886330] [INFO ] [MAIN ] CAE: Generated 1820 derivative records from 39779 primary records. [2025-10-10T22:36:13.891973] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-10T22:36:13.964461] [DEBUG] [LOCAL ] CADE: Derivative data saved (1820 records). [2025-10-10T22:36:13.976237] [DEBUG] [LOCAL ] CAE: Derivative data saved (1820 records). [2025-10-10T22:36:13.992032] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-10T22:36:13.986784] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-10T22:36:14.005243] [INFO ] [MAIN ] Derivative Progress: 335/1823 symbols completed. CAE took 1.3s. Estimated remaining: 9m 31s. Rate: 156.3 symbols/min [2025-10-10T22:36:14.018402] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:14.030375] [INFO ] [MAIN ] Derivative Progress: 336/1823 symbols completed. CADE took 1.4s. Estimated remaining: 9m 29s. Rate: 156.8 symbols/min [2025-10-10T22:36:14.062032] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:14.225689] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:14.226475] [INFO ] [MAIN ] CAF: Generated 1820 derivative records from 3477 primary records. [2025-10-10T22:36:14.226692] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-10T22:36:14.255492] [DEBUG] [LOCAL ] CAF: Derivative data saved (1820 records). [2025-10-10T22:36:14.255793] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-10T22:36:14.258039] [INFO ] [MAIN ] Derivative Progress: 337/1823 symbols completed. CAF took 0.4s. Estimated remaining: 9m 28s. Rate: 157.0 symbols/min [2025-10-10T22:36:14.258375] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:14.276990] [DEBUG] [LOCAL ] CAG: Loaded 54444 existing records from primary storage. [2025-10-10T22:36:14.278070] [INFO ] [MAIN ] CAG: Loaded 54444 primary data records. [2025-10-10T22:36:14.375834] [DEBUG] [LOCAL ] CAH: Loaded 52215 existing records from primary storage. [2025-10-10T22:36:14.395038] [INFO ] [MAIN ] CAH: Loaded 52215 primary data records. [2025-10-10T22:36:14.985506] [DEBUG] [LOCAL ] CAL: Loaded 43674 existing records from primary storage. [2025-10-10T22:36:15.044623] [INFO ] [MAIN ] CAL: Loaded 43674 primary data records. [2025-10-10T22:36:15.417738] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:15.427928] [INFO ] [MAIN ] CAG: Generated 1820 derivative records from 54444 primary records. [2025-10-10T22:36:15.434074] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:15.434200] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-10T22:36:15.435117] [INFO ] [MAIN ] CAH: Generated 1820 derivative records from 52215 primary records. [2025-10-10T22:36:15.435209] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-10T22:36:15.469043] [DEBUG] [LOCAL ] CAH: Derivative data saved (1820 records). [2025-10-10T22:36:15.471060] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-10T22:36:15.473291] [INFO ] [MAIN ] Derivative Progress: 338/1823 symbols completed. CAH took 1.4s. Estimated remaining: 9m 31s. Rate: 156.0 symbols/min [2025-10-10T22:36:15.473835] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:15.476393] [DEBUG] [LOCAL ] CAG: Derivative data saved (1820 records). [2025-10-10T22:36:15.476789] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-10T22:36:15.479876] [INFO ] [MAIN ] Derivative Progress: 339/1823 symbols completed. CAG took 1.5s. Estimated remaining: 9m 29s. Rate: 156.4 symbols/min [2025-10-10T22:36:15.480852] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:15.504534] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:15.506132] [INFO ] [MAIN ] CAL: Generated 1820 derivative records from 43674 primary records. [2025-10-10T22:36:15.509967] [DEBUG] [LOCAL ] CAPL: Loaded 5797 existing records from primary storage. [2025-10-10T22:36:15.509585] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-10T22:36:15.511190] [INFO ] [MAIN ] CAPL: Loaded 5797 primary data records. [2025-10-10T22:36:15.647520] [DEBUG] [LOCAL ] CAL: Derivative data saved (1820 records). [2025-10-10T22:36:15.667008] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-10T22:36:15.662945] [DEBUG] [LOCAL ] CALX: Loaded 38212 existing records from primary storage. [2025-10-10T22:36:15.667380] [INFO ] [MAIN ] CALX: Loaded 38212 primary data records. [2025-10-10T22:36:15.670473] [INFO ] [MAIN ] Derivative Progress: 340/1823 symbols completed. CAL took 1.4s. Estimated remaining: 9m 28s. Rate: 156.6 symbols/min [2025-10-10T22:36:15.694582] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:16.254325] [DEBUG] [LOCAL ] CARR: Loaded 54377 existing records from primary storage. [2025-10-10T22:36:16.254976] [INFO ] [MAIN ] CARR: Loaded 54377 primary data records. [2025-10-10T22:36:16.286731] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:16.310557] [INFO ] [MAIN ] CAPL: Generated 1820 derivative records from 5797 primary records. [2025-10-10T22:36:16.311387] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-10T22:36:16.404562] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:16.427460] [INFO ] [MAIN ] CALX: Generated 1820 derivative records from 38212 primary records. [2025-10-10T22:36:16.446007] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1820 records). [2025-10-10T22:36:16.451501] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-10T22:36:16.464055] [INFO ] [MAIN ] Derivative Progress: 341/1823 symbols completed. CAPL took 1.0s. Estimated remaining: 9m 29s. Rate: 156.1 symbols/min [2025-10-10T22:36:16.451373] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-10T22:36:16.491817] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:16.657866] [DEBUG] [LOCAL ] CALX: Derivative data saved (1820 records). [2025-10-10T22:36:16.659143] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-10T22:36:16.661886] [INFO ] [MAIN ] Derivative Progress: 342/1823 symbols completed. CALX took 1.2s. Estimated remaining: 9m 28s. Rate: 156.4 symbols/min [2025-10-10T22:36:16.662369] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:16.700131] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:16.713423] [INFO ] [MAIN ] CARR: Generated 1820 derivative records from 54377 primary records. [2025-10-10T22:36:16.713684] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-10T22:36:16.714639] [DEBUG] [LOCAL ] CARS: Loaded 40395 existing records from primary storage. [2025-10-10T22:36:16.714963] [INFO ] [MAIN ] CARS: Loaded 40395 primary data records. [2025-10-10T22:36:16.818840] [DEBUG] [LOCAL ] CARR: Derivative data saved (1820 records). [2025-10-10T22:36:16.830203] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-10T22:36:16.843825] [INFO ] [MAIN ] Derivative Progress: 343/1823 symbols completed. CARR took 1.1s. Estimated remaining: 9m 27s. Rate: 156.6 symbols/min [2025-10-10T22:36:16.933996] [DEBUG] [LOCAL ] CAT: Loaded 53689 existing records from primary storage. [2025-10-10T22:36:16.953799] [INFO ] [MAIN ] CAT: Loaded 53689 primary data records. [2025-10-10T22:36:17.450042] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:17.450944] [INFO ] [MAIN ] CARS: Generated 1820 derivative records from 40395 primary records. [2025-10-10T22:36:17.451492] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-10T22:36:17.470480] [DEBUG] [LOCAL ] CARS: Derivative data saved (1820 records). [2025-10-10T22:36:17.470765] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-10T22:36:17.472939] [INFO ] [MAIN ] Derivative Progress: 344/1823 symbols completed. CARS took 1.0s. Estimated remaining: 9m 28s. Rate: 156.3 symbols/min [2025-10-10T22:36:17.488807] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:17.489534] [INFO ] [MAIN ] CAT: Generated 1820 derivative records from 53689 primary records. [2025-10-10T22:36:17.489598] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-10T22:36:17.505568] [DEBUG] [LOCAL ] CAT: Derivative data saved (1820 records). [2025-10-10T22:36:17.505661] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-10T22:36:17.508097] [INFO ] [MAIN ] Derivative Progress: 345/1823 symbols completed. CAT took 0.8s. Estimated remaining: 9m 26s. Rate: 156.7 symbols/min [2025-10-10T22:36:17.508679] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:17.508880] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:17.508586] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:17.520152] [DEBUG] [LOCAL ] CATO: Loaded 6958 existing records from primary storage. [2025-10-10T22:36:17.520506] [INFO ] [MAIN ] CATO: Loaded 6958 primary data records. [2025-10-10T22:36:17.903013] [DEBUG] [LOCAL ] CAVA: Loaded 54334 existing records from primary storage. [2025-10-10T22:36:17.904152] [INFO ] [MAIN ] CAVA: Loaded 54334 primary data records. [2025-10-10T22:36:17.903918] [DEBUG] [LOCAL ] CB: Loaded 50652 existing records from primary storage. [2025-10-10T22:36:17.904412] [INFO ] [MAIN ] CB: Loaded 50652 primary data records. [2025-10-10T22:36:18.533496] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:18.550300] [INFO ] [MAIN ] CATO: Generated 1820 derivative records from 6958 primary records. [2025-10-10T22:36:18.550855] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-10T22:36:18.578562] [DEBUG] [LOCAL ] CATO: Derivative data saved (1820 records). [2025-10-10T22:36:18.580627] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-10T22:36:18.586214] [INFO ] [MAIN ] Derivative Progress: 346/1823 symbols completed. CATO took 1.1s. Estimated remaining: 9m 28s. Rate: 155.9 symbols/min [2025-10-10T22:36:18.586870] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:18.610083] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:18.610972] [INFO ] [MAIN ] CAVA: Generated 1820 derivative records from 54334 primary records. [2025-10-10T22:36:18.611208] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-10T22:36:18.651698] [DEBUG] [LOCAL ] CBAN: Loaded 10765 existing records from primary storage. [2025-10-10T22:36:18.653763] [INFO ] [MAIN ] CBAN: Loaded 10765 primary data records. [2025-10-10T22:36:18.653390] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:18.667173] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1820 records). [2025-10-10T22:36:18.690566] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-10T22:36:18.692687] [INFO ] [MAIN ] Derivative Progress: 347/1823 symbols completed. CAVA took 1.2s. Estimated remaining: 9m 27s. Rate: 156.2 symbols/min [2025-10-10T22:36:18.693764] [INFO ] [MAIN ] CB: Generated 1820 derivative records from 50652 primary records. [2025-10-10T22:36:18.706500] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:18.721375] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-10T22:36:18.849086] [DEBUG] [LOCAL ] CB: Derivative data saved (1820 records). [2025-10-10T22:36:18.874774] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-10T22:36:18.889730] [INFO ] [MAIN ] Derivative Progress: 348/1823 symbols completed. CB took 1.4s. Estimated remaining: 9m 26s. Rate: 156.5 symbols/min [2025-10-10T22:36:19.018179] [DEBUG] [LOCAL ] CBL: Loaded 16498 existing records from primary storage. [2025-10-10T22:36:19.043367] [INFO ] [MAIN ] CBL: Loaded 16498 primary data records. [2025-10-10T22:36:19.035451] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:19.150302] [DEBUG] [LOCAL ] CBNA: Loaded 2931 existing records from primary storage. [2025-10-10T22:36:19.154540] [INFO ] [MAIN ] CBNA: Loaded 2931 primary data records. [2025-10-10T22:36:19.675123] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:19.676231] [INFO ] [MAIN ] CBAN: Generated 1820 derivative records from 10765 primary records. [2025-10-10T22:36:19.676684] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-10T22:36:19.696807] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1820 records). [2025-10-10T22:36:19.697541] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-10T22:36:19.699586] [INFO ] [MAIN ] Derivative Progress: 349/1823 symbols completed. CBAN took 1.1s. Estimated remaining: 9m 27s. Rate: 156.0 symbols/min [2025-10-10T22:36:19.700078] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:19.719097] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:19.720154] [INFO ] [MAIN ] CBL: Generated 1820 derivative records from 16498 primary records. [2025-10-10T22:36:19.720311] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-10T22:36:19.749635] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:19.750554] [INFO ] [MAIN ] CBNA: Generated 1820 derivative records from 2931 primary records. [2025-10-10T22:36:19.751582] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-10T22:36:19.766211] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1820 records). [2025-10-10T22:36:19.766569] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-10T22:36:19.769495] [INFO ] [MAIN ] Derivative Progress: 350/1823 symbols completed. CBNA took 0.7s. Estimated remaining: 9m 25s. Rate: 156.3 symbols/min [2025-10-10T22:36:19.770014] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:19.770542] [DEBUG] [LOCAL ] CBL: Derivative data saved (1820 records). [2025-10-10T22:36:19.770626] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-10T22:36:19.772769] [INFO ] [MAIN ] Derivative Progress: 351/1823 symbols completed. CBL took 1.1s. Estimated remaining: 9m 23s. Rate: 156.8 symbols/min [2025-10-10T22:36:19.773207] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:19.814489] [DEBUG] [LOCAL ] CBRE: Loaded 51146 existing records from primary storage. [2025-10-10T22:36:19.814897] [INFO ] [MAIN ] CBRE: Loaded 51146 primary data records. [2025-10-10T22:36:19.998842] [DEBUG] [LOCAL ] CBT: Loaded 31283 existing records from primary storage. [2025-10-10T22:36:20.035019] [INFO ] [MAIN ] CBT: Loaded 31283 primary data records. [2025-10-10T22:36:20.154702] [DEBUG] [LOCAL ] CBZ: Loaded 34491 existing records from primary storage. [2025-10-10T22:36:20.155103] [INFO ] [MAIN ] CBZ: Loaded 34491 primary data records. [2025-10-10T22:36:20.793602] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:20.796407] [INFO ] [MAIN ] CBRE: Generated 1820 derivative records from 51146 primary records. [2025-10-10T22:36:20.796749] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-10T22:36:20.815510] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1820 records). [2025-10-10T22:36:20.815872] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-10T22:36:20.818561] [INFO ] [MAIN ] Derivative Progress: 352/1823 symbols completed. CBRE took 1.1s. Estimated remaining: 9m 26s. Rate: 156.0 symbols/min [2025-10-10T22:36:20.818964] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:20.840323] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:20.841319] [INFO ] [MAIN ] CBT: Generated 1820 derivative records from 31283 primary records. [2025-10-10T22:36:20.854087] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-10T22:36:20.854385] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:20.856460] [INFO ] [MAIN ] CBZ: Generated 1820 derivative records from 34491 primary records. [2025-10-10T22:36:20.863668] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-10T22:36:20.880072] [DEBUG] [LOCAL ] CBT: Derivative data saved (1820 records). [2025-10-10T22:36:20.880295] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-10T22:36:20.882771] [INFO ] [MAIN ] Derivative Progress: 353/1823 symbols completed. CBT took 1.1s. Estimated remaining: 9m 24s. Rate: 156.4 symbols/min [2025-10-10T22:36:20.882954] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:20.892707] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1820 records). [2025-10-10T22:36:20.892952] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-10T22:36:20.895340] [INFO ] [MAIN ] Derivative Progress: 354/1823 symbols completed. CBZ took 1.1s. Estimated remaining: 9m 22s. Rate: 156.8 symbols/min [2025-10-10T22:36:20.909299] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:20.936217] [DEBUG] [LOCAL ] CC: Loaded 53769 existing records from primary storage. [2025-10-10T22:36:20.936573] [INFO ] [MAIN ] CC: Loaded 53769 primary data records. [2025-10-10T22:36:21.062842] [DEBUG] [LOCAL ] CCIF: Loaded 15808 existing records from primary storage. [2025-10-10T22:36:21.066862] [INFO ] [MAIN ] CCIF: Loaded 15808 primary data records. [2025-10-10T22:36:21.208718] [DEBUG] [LOCAL ] CCI: Loaded 53905 existing records from primary storage. [2025-10-10T22:36:21.220768] [INFO ] [MAIN ] CCI: Loaded 53905 primary data records. [2025-10-10T22:36:21.928981] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:21.931031] [INFO ] [MAIN ] CC: Generated 1820 derivative records from 53769 primary records. [2025-10-10T22:36:21.931227] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-10T22:36:21.950273] [DEBUG] [LOCAL ] CC: Derivative data saved (1820 records). [2025-10-10T22:36:21.950561] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-10T22:36:21.952850] [INFO ] [MAIN ] Derivative Progress: 355/1823 symbols completed. CC took 1.1s. Estimated remaining: 9m 25s. Rate: 156.0 symbols/min [2025-10-10T22:36:21.965748] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:21.966204] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:21.967290] [INFO ] [MAIN ] CCIF: Generated 1820 derivative records from 15808 primary records. [2025-10-10T22:36:21.967443] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-10T22:36:21.998097] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1820 records). [2025-10-10T22:36:21.998299] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:21.999275] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-10T22:36:22.001439] [INFO ] [MAIN ] Derivative Progress: 356/1823 symbols completed. CCIF took 1.1s. Estimated remaining: 9m 23s. Rate: 156.4 symbols/min [2025-10-10T22:36:22.001702] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:21.999145] [INFO ] [MAIN ] CCI: Generated 1820 derivative records from 53905 primary records. [2025-10-10T22:36:22.002313] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-10T22:36:22.019540] [DEBUG] [LOCAL ] CCI: Derivative data saved (1820 records). [2025-10-10T22:36:22.019811] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-10T22:36:22.022069] [INFO ] [MAIN ] Derivative Progress: 357/1823 symbols completed. CCI took 1.1s. Estimated remaining: 9m 21s. Rate: 156.8 symbols/min [2025-10-10T22:36:22.022304] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:22.065915] [DEBUG] [LOCAL ] CCJ: Loaded 54455 existing records from primary storage. [2025-10-10T22:36:22.066323] [INFO ] [MAIN ] CCJ: Loaded 54455 primary data records. [2025-10-10T22:36:22.232801] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-10-10T22:36:22.254561] [INFO ] [MAIN ] CCL: Loaded 54580 primary data records. [2025-10-10T22:36:22.304620] [DEBUG] [LOCAL ] CCO: Loaded 48697 existing records from primary storage. [2025-10-10T22:36:22.328964] [INFO ] [MAIN ] CCO: Loaded 48697 primary data records. [2025-10-10T22:36:23.084973] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:23.087354] [INFO ] [MAIN ] CCJ: Generated 1820 derivative records from 54455 primary records. [2025-10-10T22:36:23.087840] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-10T22:36:23.106347] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1820 records). [2025-10-10T22:36:23.106477] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-10T22:36:23.109136] [INFO ] [MAIN ] Derivative Progress: 358/1823 symbols completed. CCJ took 1.1s. Estimated remaining: 9m 23s. Rate: 156.0 symbols/min [2025-10-10T22:36:23.127545] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:23.129297] [INFO ] [MAIN ] CCL: Generated 1820 derivative records from 54580 primary records. [2025-10-10T22:36:23.130179] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-10T22:36:23.159969] [DEBUG] [LOCAL ] CCL: Derivative data saved (1820 records). [2025-10-10T22:36:23.156987] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:23.160097] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-10T22:36:23.162328] [INFO ] [MAIN ] Derivative Progress: 359/1823 symbols completed. CCL took 1.2s. Estimated remaining: 9m 22s. Rate: 156.4 symbols/min [2025-10-10T22:36:23.163234] [INFO ] [MAIN ] CCO: Generated 1820 derivative records from 48697 primary records. [2025-10-10T22:36:23.163457] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-10T22:36:23.179039] [DEBUG] [LOCAL ] CCO: Derivative data saved (1820 records). [2025-10-10T22:36:23.179096] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-10T22:36:23.181453] [INFO ] [MAIN ] Derivative Progress: 360/1823 symbols completed. CCO took 1.2s. Estimated remaining: 9m 20s. Rate: 156.8 symbols/min [2025-10-10T22:36:23.181839] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:23.181931] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:23.182085] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:23.197541] [DEBUG] [LOCAL ] CCRD: Loaded 9338 existing records from primary storage. [2025-10-10T22:36:23.197820] [INFO ] [MAIN ] CCRD: Loaded 9338 primary data records. [2025-10-10T22:36:23.327508] [DEBUG] [LOCAL ] CCU: Loaded 23079 existing records from primary storage. [2025-10-10T22:36:23.354333] [INFO ] [MAIN ] CCU: Loaded 23079 primary data records. [2025-10-10T22:36:23.354759] [DEBUG] [LOCAL ] CCS: Loaded 30681 existing records from primary storage. [2025-10-10T22:36:23.367989] [INFO ] [MAIN ] CCS: Loaded 30681 primary data records. [2025-10-10T22:36:24.166311] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-10T22:36:24.167833] [INFO ] [MAIN ] CCRD: Generated 1818 derivative records from 9338 primary records. [2025-10-10T22:36:24.168082] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-10T22:36:24.188420] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1818 records). [2025-10-10T22:36:24.189487] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-10T22:36:24.205320] [INFO ] [MAIN ] Derivative Progress: 361/1823 symbols completed. CCRD took 1.0s. Estimated remaining: 9m 22s. Rate: 156.1 symbols/min [2025-10-10T22:36:24.206008] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:24.206901] [INFO ] [MAIN ] CCU: Generated 1820 derivative records from 23079 primary records. [2025-10-10T22:36:24.214639] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-10T22:36:24.220004] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:24.229377] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:24.232727] [INFO ] [MAIN ] CCS: Generated 1820 derivative records from 30681 primary records. [2025-10-10T22:36:24.238140] [DEBUG] [LOCAL ] CCU: Derivative data saved (1820 records). [2025-10-10T22:36:24.238334] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-10T22:36:24.240739] [INFO ] [MAIN ] Derivative Progress: 362/1823 symbols completed. CCU took 1.1s. Estimated remaining: 9m 20s. Rate: 156.5 symbols/min [2025-10-10T22:36:24.241035] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:24.236971] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-10T22:36:24.263575] [DEBUG] [LOCAL ] CCS: Derivative data saved (1820 records). [2025-10-10T22:36:24.267893] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-10T22:36:24.270585] [INFO ] [MAIN ] Derivative Progress: 363/1823 symbols completed. CCS took 1.1s. Estimated remaining: 9m 18s. Rate: 156.9 symbols/min [2025-10-10T22:36:24.271348] [DEBUG] [LOCAL ] CDLR: Loaded 10107 existing records from primary storage. [2025-10-10T22:36:24.271585] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:24.271673] [INFO ] [MAIN ] CDLR: Loaded 10107 primary data records. [2025-10-10T22:36:24.584445] [DEBUG] [LOCAL ] CDE: Loaded 54422 existing records from primary storage. [2025-10-10T22:36:24.592107] [INFO ] [MAIN ] CDE: Loaded 54422 primary data records. [2025-10-10T22:36:24.723259] [DEBUG] [LOCAL ] CDP: Loaded 43086 existing records from primary storage. [2025-10-10T22:36:24.785806] [INFO ] [MAIN ] CDP: Loaded 43086 primary data records. [2025-10-10T22:36:25.310765] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:25.311981] [INFO ] [MAIN ] CDLR: Generated 1820 derivative records from 10107 primary records. [2025-10-10T22:36:25.312238] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-10T22:36:25.334334] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1820 records). [2025-10-10T22:36:25.335499] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-10T22:36:25.338351] [INFO ] [MAIN ] Derivative Progress: 364/1823 symbols completed. CDLR took 1.1s. Estimated remaining: 9m 21s. Rate: 156.1 symbols/min [2025-10-10T22:36:25.339876] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:25.356121] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:25.357132] [INFO ] [MAIN ] CDE: Generated 1820 derivative records from 54422 primary records. [2025-10-10T22:36:25.357539] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-10T22:36:25.374323] [DEBUG] [LOCAL ] CDE: Derivative data saved (1820 records). [2025-10-10T22:36:25.374608] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-10T22:36:25.376843] [INFO ] [MAIN ] Derivative Progress: 365/1823 symbols completed. CDE took 1.2s. Estimated remaining: 9m 19s. Rate: 156.5 symbols/min [2025-10-10T22:36:25.377119] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:25.401387] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:25.402283] [INFO ] [MAIN ] CDP: Generated 1820 derivative records from 43086 primary records. [2025-10-10T22:36:25.410450] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-10T22:36:25.411754] [DEBUG] [LOCAL ] CDRE: Loaded 25069 existing records from primary storage. [2025-10-10T22:36:25.423047] [INFO ] [MAIN ] CDRE: Loaded 25069 primary data records. [2025-10-10T22:36:25.546334] [DEBUG] [LOCAL ] CDP: Derivative data saved (1820 records). [2025-10-10T22:36:25.550959] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-10T22:36:25.568720] [INFO ] [MAIN ] Derivative Progress: 366/1823 symbols completed. CDP took 1.3s. Estimated remaining: 9m 18s. Rate: 156.7 symbols/min [2025-10-10T22:36:25.604237] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:25.765054] [DEBUG] [LOCAL ] CE: Loaded 52193 existing records from primary storage. [2025-10-10T22:36:25.765410] [INFO ] [MAIN ] CE: Loaded 52193 primary data records. [2025-10-10T22:36:25.769009] [DEBUG] [LOCAL ] CEE: Loaded 5690 existing records from primary storage. [2025-10-10T22:36:25.780736] [INFO ] [MAIN ] CEE: Loaded 5690 primary data records. [2025-10-10T22:36:26.410066] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:26.411343] [INFO ] [MAIN ] CDRE: Generated 1820 derivative records from 25069 primary records. [2025-10-10T22:36:26.411543] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-10T22:36:26.430703] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1820 records). [2025-10-10T22:36:26.430856] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-10T22:36:26.433053] [INFO ] [MAIN ] Derivative Progress: 367/1823 symbols completed. CDRE took 1.1s. Estimated remaining: 9m 19s. Rate: 156.2 symbols/min [2025-10-10T22:36:26.433248] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:26.455034] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:26.457856] [INFO ] [MAIN ] CEE: Generated 1820 derivative records from 5690 primary records. [2025-10-10T22:36:26.459154] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-10T22:36:26.496855] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:26.498962] [INFO ] [MAIN ] CE: Generated 1820 derivative records from 52193 primary records. [2025-10-10T22:36:26.510355] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-10T22:36:26.513309] [DEBUG] [LOCAL ] CEPU: Loaded 26570 existing records from primary storage. [2025-10-10T22:36:26.514115] [INFO ] [MAIN ] CEPU: Loaded 26570 primary data records. [2025-10-10T22:36:26.512698] [DEBUG] [LOCAL ] CEE: Derivative data saved (1820 records). [2025-10-10T22:36:26.525895] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-10T22:36:26.528437] [INFO ] [MAIN ] Derivative Progress: 368/1823 symbols completed. CEE took 0.9s. Estimated remaining: 9m 18s. Rate: 156.5 symbols/min [2025-10-10T22:36:26.565070] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:26.635923] [DEBUG] [LOCAL ] CE: Derivative data saved (1820 records). [2025-10-10T22:36:26.642219] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-10T22:36:26.644797] [INFO ] [MAIN ] Derivative Progress: 369/1823 symbols completed. CE took 1.3s. Estimated remaining: 9m 16s. Rate: 156.8 symbols/min [2025-10-10T22:36:26.644969] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:26.940415] [DEBUG] [LOCAL ] CFR: Loaded 33311 existing records from primary storage. [2025-10-10T22:36:26.942169] [DEBUG] [LOCAL ] CF: Loaded 52873 existing records from primary storage. [2025-10-10T22:36:26.942292] [INFO ] [MAIN ] CFR: Loaded 33311 primary data records. [2025-10-10T22:36:26.943882] [INFO ] [MAIN ] CF: Loaded 52873 primary data records. [2025-10-10T22:36:27.145733] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:27.177964] [INFO ] [MAIN ] CEPU: Generated 1820 derivative records from 26570 primary records. [2025-10-10T22:36:27.188339] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-10T22:36:27.583459] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1820 records). [2025-10-10T22:36:27.584111] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-10T22:36:27.586388] [INFO ] [MAIN ] Derivative Progress: 370/1823 symbols completed. CEPU took 1.2s. Estimated remaining: 9m 18s. Rate: 156.2 symbols/min [2025-10-10T22:36:27.586689] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:27.612551] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:27.613286] [INFO ] [MAIN ] CFR: Generated 1820 derivative records from 33311 primary records. [2025-10-10T22:36:27.613532] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-10T22:36:27.651359] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:27.653154] [INFO ] [MAIN ] CF: Generated 1820 derivative records from 52873 primary records. [2025-10-10T22:36:27.653253] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-10T22:36:27.668555] [DEBUG] [LOCAL ] CGAU: Loaded 43834 existing records from primary storage. [2025-10-10T22:36:27.675987] [INFO ] [MAIN ] CGAU: Loaded 43834 primary data records. [2025-10-10T22:36:27.676451] [DEBUG] [LOCAL ] CFR: Derivative data saved (1820 records). [2025-10-10T22:36:27.679867] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-10-10T22:36:27.693217] [INFO ] [MAIN ] Derivative Progress: 371/1823 symbols completed. CFR took 1.0s. Estimated remaining: 9m 17s. Rate: 156.5 symbols/min [2025-10-10T22:36:27.703683] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:27.755056] [DEBUG] [LOCAL ] CF: Derivative data saved (1820 records). [2025-10-10T22:36:27.755214] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-10T22:36:27.774253] [INFO ] [MAIN ] Derivative Progress: 372/1823 symbols completed. CF took 1.2s. Estimated remaining: 9m 15s. Rate: 156.8 symbols/min [2025-10-10T22:36:27.792026] [DEBUG] [LOCAL ] CGV: Loaded 1406 existing records from primary storage. [2025-10-10T22:36:27.787258] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:27.792228] [INFO ] [MAIN ] CGV: Loaded 1406 primary data records. [2025-10-10T22:36:28.271591] [DEBUG] [LOCAL ] CHCT: Loaded 24273 existing records from primary storage. [2025-10-10T22:36:28.285436] [INFO ] [MAIN ] CHCT: Loaded 24273 primary data records. [2025-10-10T22:36:28.611568] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:28.614315] [INFO ] [MAIN ] CGAU: Generated 1820 derivative records from 43834 primary records. [2025-10-10T22:36:28.614843] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-10T22:36:28.637380] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1820 records). [2025-10-10T22:36:28.649976] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-10T22:36:28.650988] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-10T22:36:28.654150] [INFO ] [MAIN ] CGV: Generated 1818 derivative records from 1406 primary records. [2025-10-10T22:36:28.653210] [INFO ] [MAIN ] Derivative Progress: 373/1823 symbols completed. CGAU took 1.1s. Estimated remaining: 9m 17s. Rate: 156.3 symbols/min [2025-10-10T22:36:28.654561] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-10T22:36:28.670801] [DEBUG] [LOCAL ] CGV: Derivative data saved (1818 records). [2025-10-10T22:36:28.670886] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-10T22:36:28.673560] [INFO ] [MAIN ] Derivative Progress: 374/1823 symbols completed. CGV took 1.0s. Estimated remaining: 9m 15s. Rate: 156.7 symbols/min [2025-10-10T22:36:28.686423] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:28.687149] [INFO ] [MAIN ] CHCT: Generated 1820 derivative records from 24273 primary records. [2025-10-10T22:36:28.687213] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-10T22:36:28.702603] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1820 records). [2025-10-10T22:36:28.702689] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-10T22:36:28.705366] [INFO ] [MAIN ] Derivative Progress: 375/1823 symbols completed. CHCT took 0.9s. Estimated remaining: 9m 13s. Rate: 157.0 symbols/min [2025-10-10T22:36:28.705918] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:28.706159] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:28.706068] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:28.727531] [DEBUG] [LOCAL ] CHE: Loaded 15536 existing records from primary storage. [2025-10-10T22:36:28.738805] [INFO ] [MAIN ] CHE: Loaded 15536 primary data records. [2025-10-10T22:36:28.868454] [DEBUG] [LOCAL ] CHGG: Loaded 48509 existing records from primary storage. [2025-10-10T22:36:28.868798] [INFO ] [MAIN ] CHGG: Loaded 48509 primary data records. [2025-10-10T22:36:29.265132] [DEBUG] [LOCAL ] CHD: Loaded 52964 existing records from primary storage. [2025-10-10T22:36:29.281291] [INFO ] [MAIN ] CHD: Loaded 52964 primary data records. [2025-10-10T22:36:29.765954] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:29.767679] [INFO ] [MAIN ] CHE: Generated 1820 derivative records from 15536 primary records. [2025-10-10T22:36:29.767761] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-10T22:36:29.803022] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:29.805750] [INFO ] [MAIN ] CHGG: Generated 1820 derivative records from 48509 primary records. [2025-10-10T22:36:29.807712] [DEBUG] [LOCAL ] CHE: Derivative data saved (1820 records). [2025-10-10T22:36:29.808134] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-10T22:36:29.811152] [INFO ] [MAIN ] Derivative Progress: 376/1823 symbols completed. CHE took 1.1s. Estimated remaining: 9m 16s. Rate: 156.3 symbols/min [2025-10-10T22:36:29.807886] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-10T22:36:29.811572] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:29.831045] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1820 records). [2025-10-10T22:36:29.831188] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-10T22:36:29.833304] [INFO ] [MAIN ] Derivative Progress: 377/1823 symbols completed. CHGG took 1.1s. Estimated remaining: 9m 14s. Rate: 156.6 symbols/min [2025-10-10T22:36:29.833823] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:29.851994] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:29.852722] [INFO ] [MAIN ] CHD: Generated 1820 derivative records from 52964 primary records. [2025-10-10T22:36:29.860063] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-10T22:36:29.903769] [DEBUG] [LOCAL ] CHD: Derivative data saved (1820 records). [2025-10-10T22:36:29.904125] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-10T22:36:29.907731] [INFO ] [MAIN ] Derivative Progress: 378/1823 symbols completed. CHD took 1.2s. Estimated remaining: 9m 12s. Rate: 157.0 symbols/min [2025-10-10T22:36:29.909684] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:29.909469] [DEBUG] [LOCAL ] CHMI: Loaded 21964 existing records from primary storage. [2025-10-10T22:36:29.920444] [INFO ] [MAIN ] CHMI: Loaded 21964 primary data records. [2025-10-10T22:36:29.922829] [DEBUG] [LOCAL ] CHH: Loaded 32827 existing records from primary storage. [2025-10-10T22:36:29.957097] [INFO ] [MAIN ] CHH: Loaded 32827 primary data records. [2025-10-10T22:36:30.043705] [DEBUG] [LOCAL ] CHN: Loaded 4832 existing records from primary storage. [2025-10-10T22:36:30.074624] [INFO ] [MAIN ] CHN: Loaded 4832 primary data records. [2025-10-10T22:36:30.930514] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:30.931939] [INFO ] [MAIN ] CHMI: Generated 1820 derivative records from 21964 primary records. [2025-10-10T22:36:30.932261] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-10T22:36:30.966191] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:30.967012] [INFO ] [MAIN ] CHN: Generated 1820 derivative records from 4832 primary records. [2025-10-10T22:36:30.965804] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1820 records). [2025-10-10T22:36:30.967104] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-10T22:36:30.974765] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-10T22:36:30.982392] [INFO ] [MAIN ] Derivative Progress: 379/1823 symbols completed. CHMI took 1.1s. Estimated remaining: 9m 15s. Rate: 156.2 symbols/min [2025-10-10T22:36:30.983082] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:30.991095] [INFO ] [MAIN ] CHH: Generated 1820 derivative records from 32827 primary records. [2025-10-10T22:36:30.994046] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:30.994249] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-10T22:36:30.997986] [DEBUG] [LOCAL ] CHN: Derivative data saved (1820 records). [2025-10-10T22:36:30.999106] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-10T22:36:31.001594] [INFO ] [MAIN ] Derivative Progress: 380/1823 symbols completed. CHN took 1.1s. Estimated remaining: 9m 13s. Rate: 156.6 symbols/min [2025-10-10T22:36:31.001884] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:31.020248] [DEBUG] [LOCAL ] CHH: Derivative data saved (1820 records). [2025-10-10T22:36:31.020460] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-10T22:36:31.022840] [INFO ] [MAIN ] Derivative Progress: 381/1823 symbols completed. CHH took 1.2s. Estimated remaining: 9m 11s. Rate: 157.0 symbols/min [2025-10-10T22:36:31.023204] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:31.040721] [DEBUG] [LOCAL ] CHT: Loaded 19798 existing records from primary storage. [2025-10-10T22:36:31.040887] [INFO ] [MAIN ] CHT: Loaded 19798 primary data records. [2025-10-10T22:36:31.324296] [DEBUG] [LOCAL ] CHPT: Loaded 48725 existing records from primary storage. [2025-10-10T22:36:31.380726] [INFO ] [MAIN ] CHPT: Loaded 48725 primary data records. [2025-10-10T22:36:31.470065] [DEBUG] [LOCAL ] CHWY: Loaded 54433 existing records from primary storage. [2025-10-10T22:36:31.477457] [INFO ] [MAIN ] CHWY: Loaded 54433 primary data records. [2025-10-10T22:36:32.045263] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:32.048854] [INFO ] [MAIN ] CHT: Generated 1820 derivative records from 19798 primary records. [2025-10-10T22:36:32.049567] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-10-10T22:36:32.074810] [DEBUG] [LOCAL ] CHT: Derivative data saved (1820 records). [2025-10-10T22:36:32.075210] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-10-10T22:36:32.077556] [INFO ] [MAIN ] Derivative Progress: 382/1823 symbols completed. CHT took 1.1s. Estimated remaining: 9m 13s. Rate: 156.3 symbols/min [2025-10-10T22:36:32.077748] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:32.123277] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:32.123679] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:32.126050] [INFO ] [MAIN ] CHWY: Generated 1820 derivative records from 54433 primary records. [2025-10-10T22:36:32.125876] [INFO ] [MAIN ] CHPT: Generated 1820 derivative records from 48725 primary records. [2025-10-10T22:36:32.126180] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-10T22:36:32.127293] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-10T22:36:32.143791] [DEBUG] [LOCAL ] CIA: Loaded 17004 existing records from primary storage. [2025-10-10T22:36:32.156774] [INFO ] [MAIN ] CIA: Loaded 17004 primary data records. [2025-10-10T22:36:32.159345] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1820 records). [2025-10-10T22:36:32.186189] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-10T22:36:32.204727] [INFO ] [MAIN ] Derivative Progress: 383/1823 symbols completed. CHWY took 1.2s. Estimated remaining: 9m 12s. Rate: 156.6 symbols/min [2025-10-10T22:36:32.217046] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1820 records). [2025-10-10T22:36:32.217439] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-10-10T22:36:32.219507] [INFO ] [MAIN ] Derivative Progress: 384/1823 symbols completed. CHPT took 1.2s. Estimated remaining: 9m 10s. Rate: 157.0 symbols/min [2025-10-10T22:36:32.217185] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:32.233303] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:32.299124] [DEBUG] [LOCAL ] CIF: Loaded 4139 existing records from primary storage. [2025-10-10T22:36:32.314906] [INFO ] [MAIN ] CIF: Loaded 4139 primary data records. [2025-10-10T22:36:32.614463] [DEBUG] [LOCAL ] CIB: Loaded 31088 existing records from primary storage. [2025-10-10T22:36:32.620109] [INFO ] [MAIN ] CIB: Loaded 31088 primary data records. [2025-10-10T22:36:33.180436] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:33.182488] [INFO ] [MAIN ] CIA: Generated 1820 derivative records from 17004 primary records. [2025-10-10T22:36:33.182819] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-10T22:36:33.199902] [DEBUG] [LOCAL ] CIA: Derivative data saved (1820 records). [2025-10-10T22:36:33.201145] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-10T22:36:33.203305] [INFO ] [MAIN ] Derivative Progress: 385/1823 symbols completed. CIA took 1.1s. Estimated remaining: 9m 12s. Rate: 156.3 symbols/min [2025-10-10T22:36:33.203614] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:33.222695] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:33.223409] [INFO ] [MAIN ] CIF: Generated 1820 derivative records from 4139 primary records. [2025-10-10T22:36:33.223718] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-10T22:36:33.245102] [DEBUG] [LOCAL ] CIF: Derivative data saved (1820 records). [2025-10-10T22:36:33.250498] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-10T22:36:33.253399] [INFO ] [MAIN ] Derivative Progress: 386/1823 symbols completed. CIF took 1.0s. Estimated remaining: 9m 10s. Rate: 156.7 symbols/min [2025-10-10T22:36:33.266094] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:33.250845] [DEBUG] [LOCAL ] CII: Loaded 15532 existing records from primary storage. [2025-10-10T22:36:33.266489] [INFO ] [MAIN ] CII: Loaded 15532 primary data records. [2025-10-10T22:36:33.278697] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:33.298894] [INFO ] [MAIN ] CIB: Generated 1820 derivative records from 31088 primary records. [2025-10-10T22:36:33.304995] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-10T22:36:33.370293] [DEBUG] [LOCAL ] CIB: Derivative data saved (1820 records). [2025-10-10T22:36:33.381547] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-10-10T22:36:33.384147] [INFO ] [MAIN ] Derivative Progress: 387/1823 symbols completed. CIB took 1.2s. Estimated remaining: 9m 9s. Rate: 156.9 symbols/min [2025-10-10T22:36:33.384404] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:33.451585] [DEBUG] [LOCAL ] CINT: Loaded 19896 existing records from primary storage. [2025-10-10T22:36:33.480242] [INFO ] [MAIN ] CINT: Loaded 19896 primary data records. [2025-10-10T22:36:33.739967] [DEBUG] [LOCAL ] CIO: Loaded 20876 existing records from primary storage. [2025-10-10T22:36:33.756179] [INFO ] [MAIN ] CIO: Loaded 20876 primary data records. [2025-10-10T22:36:34.171317] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:34.180681] [INFO ] [MAIN ] CII: Generated 1820 derivative records from 15532 primary records. [2025-10-10T22:36:34.181014] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-10T22:36:34.328270] [DEBUG] [LOCAL ] CII: Derivative data saved (1820 records). [2025-10-10T22:36:34.328573] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-10T22:36:34.330797] [INFO ] [MAIN ] Derivative Progress: 388/1823 symbols completed. CII took 1.1s. Estimated remaining: 9m 11s. Rate: 156.4 symbols/min [2025-10-10T22:36:34.349875] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:34.350768] [INFO ] [MAIN ] CINT: Generated 1820 derivative records from 19896 primary records. [2025-10-10T22:36:34.351677] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-10T22:36:34.367716] [DEBUG] [LOCAL ] CINT: Derivative data saved (1820 records). [2025-10-10T22:36:34.367981] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-10T22:36:34.370374] [INFO ] [MAIN ] Derivative Progress: 389/1823 symbols completed. CINT took 1.1s. Estimated remaining: 9m 9s. Rate: 156.7 symbols/min [2025-10-10T22:36:34.386679] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:34.387345] [INFO ] [MAIN ] CIO: Generated 1820 derivative records from 20876 primary records. [2025-10-10T22:36:34.387407] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-10T22:36:34.402735] [DEBUG] [LOCAL ] CIO: Derivative data saved (1820 records). [2025-10-10T22:36:34.402808] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-10T22:36:34.405970] [INFO ] [MAIN ] Derivative Progress: 390/1823 symbols completed. CIO took 1.0s. Estimated remaining: 9m 7s. Rate: 157.1 symbols/min [2025-10-10T22:36:34.406479] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:34.406770] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:34.406607] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:34.440342] [DEBUG] [LOCAL ] CION: Loaded 28885 existing records from primary storage. [2025-10-10T22:36:34.440573] [INFO ] [MAIN ] CION: Loaded 28885 primary data records. [2025-10-10T22:36:34.835406] [DEBUG] [LOCAL ] CIVI: Loaded 53392 existing records from primary storage. [2025-10-10T22:36:34.844600] [INFO ] [MAIN ] CIVI: Loaded 53392 primary data records. [2025-10-10T22:36:34.858828] [DEBUG] [LOCAL ] CL: Loaded 54428 existing records from primary storage. [2025-10-10T22:36:34.885260] [INFO ] [MAIN ] CL: Loaded 54428 primary data records. [2025-10-10T22:36:35.487921] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:35.489695] [INFO ] [MAIN ] CION: Generated 1820 derivative records from 28885 primary records. [2025-10-10T22:36:35.490229] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-10-10T22:36:35.509923] [DEBUG] [LOCAL ] CION: Derivative data saved (1820 records). [2025-10-10T22:36:35.510169] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-10-10T22:36:35.512952] [INFO ] [MAIN ] Derivative Progress: 391/1823 symbols completed. CION took 1.1s. Estimated remaining: 9m 10s. Rate: 156.3 symbols/min [2025-10-10T22:36:35.514026] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:35.539907] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:35.541330] [INFO ] [MAIN ] CIVI: Generated 1820 derivative records from 53392 primary records. [2025-10-10T22:36:35.541712] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-10T22:36:35.548064] [DEBUG] [LOCAL ] CLCO: Loaded 13109 existing records from primary storage. [2025-10-10T22:36:35.548910] [INFO ] [MAIN ] CLCO: Loaded 13109 primary data records. [2025-10-10T22:36:35.688923] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1820 records). [2025-10-10T22:36:35.778094] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-10T22:36:35.779584] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:35.783823] [INFO ] [MAIN ] CL: Generated 1820 derivative records from 54428 primary records. [2025-10-10T22:36:35.783996] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-10T22:36:35.782424] [INFO ] [MAIN ] Derivative Progress: 392/1823 symbols completed. CIVI took 1.4s. Estimated remaining: 9m 9s. Rate: 156.4 symbols/min [2025-10-10T22:36:35.784378] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:35.930824] [DEBUG] [LOCAL ] CL: Derivative data saved (1820 records). [2025-10-10T22:36:35.931003] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-10T22:36:35.934585] [INFO ] [MAIN ] Derivative Progress: 393/1823 symbols completed. CL took 1.5s. Estimated remaining: 9m 8s. Rate: 156.7 symbols/min [2025-10-10T22:36:35.935200] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:35.960202] [DEBUG] [LOCAL ] CLDT: Loaded 25799 existing records from primary storage. [2025-10-10T22:36:35.960626] [INFO ] [MAIN ] CLDT: Loaded 25799 primary data records. [2025-10-10T22:36:36.172044] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:36.191763] [INFO ] [MAIN ] CLCO: Generated 1820 derivative records from 13109 primary records. [2025-10-10T22:36:36.307677] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-10T22:36:36.310611] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-10-10T22:36:36.317783] [INFO ] [MAIN ] CLF: Loaded 54521 primary data records. [2025-10-10T22:36:36.350622] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1820 records). [2025-10-10T22:36:36.363230] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-10-10T22:36:36.378511] [INFO ] [MAIN ] Derivative Progress: 394/1823 symbols completed. CLCO took 0.9s. Estimated remaining: 9m 7s. Rate: 156.6 symbols/min [2025-10-10T22:36:36.392047] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:36.540611] [DEBUG] [LOCAL ] CLPR: Loaded 10667 existing records from primary storage. [2025-10-10T22:36:36.657692] [INFO ] [MAIN ] CLPR: Loaded 10667 primary data records. [2025-10-10T22:36:36.959780] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:37.074126] [INFO ] [MAIN ] CLDT: Generated 1820 derivative records from 25799 primary records. [2025-10-10T22:36:37.074685] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-10T22:36:37.094178] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1820 records). [2025-10-10T22:36:37.094686] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-10T22:36:37.097451] [INFO ] [MAIN ] Derivative Progress: 395/1823 symbols completed. CLDT took 1.3s. Estimated remaining: 9m 8s. Rate: 156.3 symbols/min [2025-10-10T22:36:37.097622] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:37.121593] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:37.122877] [INFO ] [MAIN ] CLF: Generated 1820 derivative records from 54521 primary records. [2025-10-10T22:36:37.123123] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-10T22:36:37.143405] [DEBUG] [LOCAL ] CLF: Derivative data saved (1820 records). [2025-10-10T22:36:37.146450] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-10T22:36:37.150218] [INFO ] [MAIN ] Derivative Progress: 396/1823 symbols completed. CLF took 1.2s. Estimated remaining: 9m 7s. Rate: 156.6 symbols/min [2025-10-10T22:36:37.150704] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:37.165735] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:37.166715] [INFO ] [MAIN ] CLPR: Generated 1820 derivative records from 10667 primary records. [2025-10-10T22:36:37.166991] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-10-10T22:36:37.199147] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1820 records). [2025-10-10T22:36:37.199465] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-10-10T22:36:37.203429] [INFO ] [MAIN ] Derivative Progress: 397/1823 symbols completed. CLPR took 0.8s. Estimated remaining: 9m 5s. Rate: 156.9 symbols/min [2025-10-10T22:36:37.204035] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:37.223674] [DEBUG] [LOCAL ] CLS: Loaded 54367 existing records from primary storage. [2025-10-10T22:36:37.224019] [INFO ] [MAIN ] CLS: Loaded 54367 primary data records. [2025-10-10T22:36:37.434780] [DEBUG] [LOCAL ] CLVT: Loaded 52731 existing records from primary storage. [2025-10-10T22:36:37.570405] [DEBUG] [LOCAL ] CLW: Loaded 21986 existing records from primary storage. [2025-10-10T22:36:37.564445] [INFO ] [MAIN ] CLVT: Loaded 52731 primary data records. [2025-10-10T22:36:37.579004] [INFO ] [MAIN ] CLW: Loaded 21986 primary data records. [2025-10-10T22:36:38.207262] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:38.208814] [INFO ] [MAIN ] CLS: Generated 1820 derivative records from 54367 primary records. [2025-10-10T22:36:38.209075] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-10T22:36:38.228872] [DEBUG] [LOCAL ] CLS: Derivative data saved (1820 records). [2025-10-10T22:36:38.229206] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-10T22:36:38.231715] [INFO ] [MAIN ] Derivative Progress: 398/1823 symbols completed. CLS took 1.1s. Estimated remaining: 9m 7s. Rate: 156.3 symbols/min [2025-10-10T22:36:38.232048] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:38.251164] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:38.253516] [INFO ] [MAIN ] CLVT: Generated 1820 derivative records from 52731 primary records. [2025-10-10T22:36:38.253730] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-10T22:36:38.288085] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:38.290305] [INFO ] [MAIN ] CLW: Generated 1820 derivative records from 21986 primary records. [2025-10-10T22:36:38.290954] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-10T22:36:38.293371] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1820 records). [2025-10-10T22:36:38.300943] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-10T22:36:38.307038] [INFO ] [MAIN ] Derivative Progress: 399/1823 symbols completed. CLVT took 1.2s. Estimated remaining: 9m 6s. Rate: 156.6 symbols/min [2025-10-10T22:36:38.307512] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:38.327331] [DEBUG] [LOCAL ] CLW: Derivative data saved (1820 records). [2025-10-10T22:36:38.327508] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-10T22:36:38.330608] [INFO ] [MAIN ] Derivative Progress: 400/1823 symbols completed. CLW took 1.1s. Estimated remaining: 9m 4s. Rate: 157.0 symbols/min [2025-10-10T22:36:38.330945] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:38.352829] [DEBUG] [LOCAL ] CLX: Loaded 52350 existing records from primary storage. [2025-10-10T22:36:38.353076] [INFO ] [MAIN ] CLX: Loaded 52350 primary data records. [2025-10-10T22:36:38.608615] [DEBUG] [LOCAL ] CM: Loaded 49467 existing records from primary storage. [2025-10-10T22:36:38.624868] [INFO ] [MAIN ] CM: Loaded 49467 primary data records. [2025-10-10T22:36:38.874998] [DEBUG] [LOCAL ] CMA: Loaded 50699 existing records from primary storage. [2025-10-10T22:36:38.891032] [INFO ] [MAIN ] CMA: Loaded 50699 primary data records. [2025-10-10T22:36:39.407129] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:39.408137] [INFO ] [MAIN ] CLX: Generated 1820 derivative records from 52350 primary records. [2025-10-10T22:36:39.408902] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-10T22:36:39.441979] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:39.443312] [INFO ] [MAIN ] CM: Generated 1820 derivative records from 49467 primary records. [2025-10-10T22:36:39.443681] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-10T22:36:39.445060] [DEBUG] [LOCAL ] CLX: Derivative data saved (1820 records). [2025-10-10T22:36:39.452711] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-10T22:36:39.456222] [INFO ] [MAIN ] Derivative Progress: 401/1823 symbols completed. CLX took 1.2s. Estimated remaining: 9m 6s. Rate: 156.2 symbols/min [2025-10-10T22:36:39.459054] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:39.465813] [DEBUG] [LOCAL ] CM: Derivative data saved (1820 records). [2025-10-10T22:36:39.466973] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-10T22:36:39.469404] [INFO ] [MAIN ] Derivative Progress: 402/1823 symbols completed. CM took 1.2s. Estimated remaining: 9m 4s. Rate: 156.6 symbols/min [2025-10-10T22:36:39.470369] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:39.485927] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:39.486617] [INFO ] [MAIN ] CMA: Generated 1820 derivative records from 50699 primary records. [2025-10-10T22:36:39.486713] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-10T22:36:39.502676] [DEBUG] [LOCAL ] CMA: Derivative data saved (1820 records). [2025-10-10T22:36:39.509629] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-10T22:36:39.512121] [INFO ] [MAIN ] Derivative Progress: 403/1823 symbols completed. CMA took 1.2s. Estimated remaining: 9m 3s. Rate: 156.9 symbols/min [2025-10-10T22:36:39.523553] [DEBUG] [LOCAL ] CMBT: Loaded 25517 existing records from primary storage. [2025-10-10T22:36:39.523718] [INFO ] [MAIN ] CMBT: Loaded 25517 primary data records. [2025-10-10T22:36:39.720986] [DEBUG] [LOCAL ] CMC: Loaded 46065 existing records from primary storage. [2025-10-10T22:36:39.820847] [INFO ] [MAIN ] CMC: Loaded 46065 primary data records. [2025-10-10T22:36:40.144981] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:40.146342] [INFO ] [MAIN ] CMBT: Generated 1820 derivative records from 25517 primary records. [2025-10-10T22:36:40.146635] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-10T22:36:40.164046] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1820 records). [2025-10-10T22:36:40.164234] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-10T22:36:40.166565] [INFO ] [MAIN ] Derivative Progress: 404/1823 symbols completed. CMBT took 0.7s. Estimated remaining: 9m 3s. Rate: 156.7 symbols/min [2025-10-10T22:36:40.183581] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:40.184199] [INFO ] [MAIN ] CMC: Generated 1820 derivative records from 46065 primary records. [2025-10-10T22:36:40.184260] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-10T22:36:40.199444] [DEBUG] [LOCAL ] CMC: Derivative data saved (1820 records). [2025-10-10T22:36:40.199500] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-10T22:36:40.201581] [INFO ] [MAIN ] Derivative Progress: 405/1823 symbols completed. CMC took 0.7s. Estimated remaining: 9m 2s. Rate: 157.0 symbols/min [2025-10-10T22:36:40.202399] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:40.202611] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:40.202530] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:40.212114] [DEBUG] [LOCAL ] CMCM: Loaded 4862 existing records from primary storage. [2025-10-10T22:36:40.212420] [INFO ] [MAIN ] CMCM: Loaded 4862 primary data records. [2025-10-10T22:36:40.561136] [DEBUG] [LOCAL ] CMI: Loaded 42226 existing records from primary storage. [2025-10-10T22:36:40.562469] [INFO ] [MAIN ] CMI: Loaded 42226 primary data records. [2025-10-10T22:36:40.655358] [DEBUG] [LOCAL ] CMG: Loaded 54500 existing records from primary storage. [2025-10-10T22:36:40.678865] [INFO ] [MAIN ] CMG: Loaded 54500 primary data records. [2025-10-10T22:36:40.881792] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:41.043103] [INFO ] [MAIN ] CMCM: Generated 1820 derivative records from 4862 primary records. [2025-10-10T22:36:41.043507] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-10T22:36:41.273149] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1820 records). [2025-10-10T22:36:41.273865] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-10T22:36:41.276405] [INFO ] [MAIN ] Derivative Progress: 406/1823 symbols completed. CMCM took 1.1s. Estimated remaining: 9m 4s. Rate: 156.3 symbols/min [2025-10-10T22:36:41.276737] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:41.302237] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:41.303172] [INFO ] [MAIN ] CMI: Generated 1820 derivative records from 42226 primary records. [2025-10-10T22:36:41.303465] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-10T22:36:41.323513] [DEBUG] [LOCAL ] CMI: Derivative data saved (1820 records). [2025-10-10T22:36:41.345565] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-10T22:36:41.348199] [INFO ] [MAIN ] Derivative Progress: 407/1823 symbols completed. CMI took 1.1s. Estimated remaining: 9m 2s. Rate: 156.6 symbols/min [2025-10-10T22:36:41.348489] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:41.346122] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:41.349607] [INFO ] [MAIN ] CMG: Generated 1820 derivative records from 54500 primary records. [2025-10-10T22:36:41.349749] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-10T22:36:41.374937] [DEBUG] [LOCAL ] CMP: Loaded 36590 existing records from primary storage. [2025-10-10T22:36:41.375351] [INFO ] [MAIN ] CMP: Loaded 36590 primary data records. [2025-10-10T22:36:41.532142] [DEBUG] [LOCAL ] CMG: Derivative data saved (1820 records). [2025-10-10T22:36:41.542966] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-10-10T22:36:41.699071] [DEBUG] [LOCAL ] CMPO: Loaded 39544 existing records from primary storage. [2025-10-10T22:36:41.584049] [INFO ] [MAIN ] Derivative Progress: 408/1823 symbols completed. CMG took 1.4s. Estimated remaining: 9m 2s. Rate: 156.8 symbols/min [2025-10-10T22:36:41.699952] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:41.700079] [INFO ] [MAIN ] CMPO: Loaded 39544 primary data records. [2025-10-10T22:36:42.033483] [DEBUG] [LOCAL ] CMRE: Loaded 36148 existing records from primary storage. [2025-10-10T22:36:42.034136] [INFO ] [MAIN ] CMRE: Loaded 36148 primary data records. [2025-10-10T22:36:42.237383] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:42.240308] [INFO ] [MAIN ] CMP: Generated 1820 derivative records from 36590 primary records. [2025-10-10T22:36:42.256165] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-10T22:36:42.430399] [DEBUG] [LOCAL ] CMP: Derivative data saved (1820 records). [2025-10-10T22:36:42.435626] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-10T22:36:42.438042] [INFO ] [MAIN ] Derivative Progress: 409/1823 symbols completed. CMP took 1.2s. Estimated remaining: 9m 3s. Rate: 156.3 symbols/min [2025-10-10T22:36:42.439168] [DEBUG] [MAIN ] CMPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:42.440100] [INFO ] [MAIN ] CMPO: Generated 1820 derivative records from 39544 primary records. [2025-10-10T22:36:42.440316] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-10T22:36:42.440257] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:42.461692] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1820 records). [2025-10-10T22:36:42.461968] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-10T22:36:42.464181] [INFO ] [MAIN ] Derivative Progress: 410/1823 symbols completed. CMPO took 1.1s. Estimated remaining: 9m 1s. Rate: 156.7 symbols/min [2025-10-10T22:36:42.464491] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:42.475060] [DEBUG] [LOCAL ] CMSA: Loaded 3556 existing records from primary storage. [2025-10-10T22:36:42.488383] [INFO ] [MAIN ] CMSA: Loaded 3556 primary data records. [2025-10-10T22:36:42.494498] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:42.511520] [INFO ] [MAIN ] CMRE: Generated 1820 derivative records from 36148 primary records. [2025-10-10T22:36:42.511718] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-10T22:36:42.853044] [DEBUG] [LOCAL ] CMS: Loaded 53373 existing records from primary storage. [2025-10-10T22:36:42.869380] [INFO ] [MAIN ] CMS: Loaded 53373 primary data records. [2025-10-10T22:36:42.878122] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1820 records). [2025-10-10T22:36:42.900566] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-10T22:36:42.929708] [INFO ] [MAIN ] Derivative Progress: 411/1823 symbols completed. CMRE took 1.2s. Estimated remaining: 9m 1s. Rate: 156.6 symbols/min [2025-10-10T22:36:42.972405] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:43.091914] [DEBUG] [LOCAL ] CMSC: Loaded 5028 existing records from primary storage. [2025-10-10T22:36:43.206426] [INFO ] [MAIN ] CMSC: Loaded 5028 primary data records. [2025-10-10T22:36:43.435167] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:36:43.552752] [INFO ] [MAIN ] CMSA: Generated 1819 derivative records from 3556 primary records. [2025-10-10T22:36:43.562511] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-10T22:36:43.580903] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1819 records). [2025-10-10T22:36:43.582481] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-10T22:36:43.586289] [INFO ] [MAIN ] Derivative Progress: 412/1823 symbols completed. CMSA took 1.1s. Estimated remaining: 9m 2s. Rate: 156.3 symbols/min [2025-10-10T22:36:43.586582] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:43.603311] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:43.604285] [INFO ] [MAIN ] CMS: Generated 1820 derivative records from 53373 primary records. [2025-10-10T22:36:43.604683] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-10T22:36:43.627264] [DEBUG] [LOCAL ] CMSD: Loaded 8081 existing records from primary storage. [2025-10-10T22:36:43.627376] [INFO ] [MAIN ] CMSD: Loaded 8081 primary data records. [2025-10-10T22:36:43.711784] [DEBUG] [LOCAL ] CMS: Derivative data saved (1820 records). [2025-10-10T22:36:43.732831] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-10-10T22:36:43.747526] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:43.760064] [INFO ] [MAIN ] Derivative Progress: 413/1823 symbols completed. CMS took 1.3s. Estimated remaining: 9m 1s. Rate: 156.5 symbols/min [2025-10-10T22:36:43.766232] [INFO ] [MAIN ] CMSC: Generated 1820 derivative records from 5028 primary records. [2025-10-10T22:36:43.776694] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:43.771446] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-10T22:36:43.976490] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1820 records). [2025-10-10T22:36:43.986088] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-10T22:36:43.988319] [INFO ] [MAIN ] Derivative Progress: 414/1823 symbols completed. CMSC took 1.0s. Estimated remaining: 8m 60s. Rate: 156.7 symbols/min [2025-10-10T22:36:43.988471] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:44.006483] [DEBUG] [LOCAL ] CMTG: Loaded 36633 existing records from primary storage. [2025-10-10T22:36:44.009099] [INFO ] [MAIN ] CMTG: Loaded 36633 primary data records. [2025-10-10T22:36:44.056424] [DEBUG] [LOCAL ] CMU: Loaded 6399 existing records from primary storage. [2025-10-10T22:36:44.077746] [INFO ] [MAIN ] CMU: Loaded 6399 primary data records. [2025-10-10T22:36:44.313954] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:44.386154] [INFO ] [MAIN ] CMSD: Generated 1820 derivative records from 8081 primary records. [2025-10-10T22:36:44.393365] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-10T22:36:44.652329] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1820 records). [2025-10-10T22:36:44.653017] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-10T22:36:44.655207] [INFO ] [MAIN ] Derivative Progress: 415/1823 symbols completed. CMSD took 1.1s. Estimated remaining: 9m 0s. Rate: 156.4 symbols/min [2025-10-10T22:36:44.655387] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:44.675632] [DEBUG] [LOCAL ] CNF: Loaded 10690 existing records from primary storage. [2025-10-10T22:36:44.688003] [INFO ] [MAIN ] CNF: Loaded 10690 primary data records. [2025-10-10T22:36:44.719389] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:44.743845] [INFO ] [MAIN ] CMU: Generated 1820 derivative records from 6399 primary records. [2025-10-10T22:36:44.744051] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-10T22:36:44.806899] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:44.815955] [INFO ] [MAIN ] CMTG: Generated 1820 derivative records from 36633 primary records. [2025-10-10T22:36:44.822248] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-10T22:36:44.859738] [DEBUG] [LOCAL ] CMU: Derivative data saved (1820 records). [2025-10-10T22:36:44.893741] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-10T22:36:44.897080] [INFO ] [MAIN ] Derivative Progress: 416/1823 symbols completed. CMU took 0.9s. Estimated remaining: 8m 59s. Rate: 156.5 symbols/min [2025-10-10T22:36:44.913004] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:45.070187] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1820 records). [2025-10-10T22:36:45.070378] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-10T22:36:45.073928] [INFO ] [MAIN ] Derivative Progress: 417/1823 symbols completed. CMTG took 1.3s. Estimated remaining: 8m 58s. Rate: 156.7 symbols/min [2025-10-10T22:36:45.074558] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:45.116721] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:45.117466] [INFO ] [MAIN ] CNF: Generated 1820 derivative records from 10690 primary records. [2025-10-10T22:36:45.117632] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-10-10T22:36:45.146227] [DEBUG] [LOCAL ] CNI: Loaded 52437 existing records from primary storage. [2025-10-10T22:36:45.146920] [INFO ] [MAIN ] CNI: Loaded 52437 primary data records. [2025-10-10T22:36:45.184010] [DEBUG] [LOCAL ] CNF: Derivative data saved (1820 records). [2025-10-10T22:36:45.217142] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-10-10T22:36:45.227999] [INFO ] [MAIN ] Derivative Progress: 418/1823 symbols completed. CNF took 0.6s. Estimated remaining: 8m 57s. Rate: 157.0 symbols/min [2025-10-10T22:36:45.309319] [DEBUG] [LOCAL ] CNM: Loaded 51806 existing records from primary storage. [2025-10-10T22:36:45.333686] [INFO ] [MAIN ] CNM: Loaded 51806 primary data records. [2025-10-10T22:36:45.838246] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:45.839255] [INFO ] [MAIN ] CNI: Generated 1820 derivative records from 52437 primary records. [2025-10-10T22:36:45.839526] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-10T22:36:45.856746] [DEBUG] [LOCAL ] CNI: Derivative data saved (1820 records). [2025-10-10T22:36:45.857719] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-10T22:36:45.860624] [INFO ] [MAIN ] Derivative Progress: 419/1823 symbols completed. CNI took 0.9s. Estimated remaining: 8m 58s. Rate: 156.7 symbols/min [2025-10-10T22:36:45.874403] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:45.875077] [INFO ] [MAIN ] CNM: Generated 1820 derivative records from 51806 primary records. [2025-10-10T22:36:45.875141] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-10T22:36:45.890945] [DEBUG] [LOCAL ] CNM: Derivative data saved (1820 records). [2025-10-10T22:36:45.891007] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-10T22:36:45.893236] [INFO ] [MAIN ] Derivative Progress: 420/1823 symbols completed. CNM took 0.8s. Estimated remaining: 8m 56s. Rate: 157.0 symbols/min [2025-10-10T22:36:45.894155] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:45.894094] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:45.893985] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:45.942609] [DEBUG] [LOCAL ] CNNE: Loaded 36726 existing records from primary storage. [2025-10-10T22:36:45.956982] [INFO ] [MAIN ] CNNE: Loaded 36726 primary data records. [2025-10-10T22:36:46.011339] [DEBUG] [LOCAL ] CNO: Loaded 41472 existing records from primary storage. [2025-10-10T22:36:46.043680] [INFO ] [MAIN ] CNO: Loaded 41472 primary data records. [2025-10-10T22:36:46.229708] [DEBUG] [LOCAL ] CNP: Loaded 54250 existing records from primary storage. [2025-10-10T22:36:46.261719] [INFO ] [MAIN ] CNP: Loaded 54250 primary data records. [2025-10-10T22:36:46.957766] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:46.958915] [INFO ] [MAIN ] CNNE: Generated 1820 derivative records from 36726 primary records. [2025-10-10T22:36:46.959287] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-10-10T22:36:46.972275] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:46.973634] [INFO ] [MAIN ] CNO: Generated 1820 derivative records from 41472 primary records. [2025-10-10T22:36:46.974046] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-10T22:36:47.019499] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:47.021276] [INFO ] [MAIN ] CNP: Generated 1820 derivative records from 54250 primary records. [2025-10-10T22:36:47.022306] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1820 records). [2025-10-10T22:36:47.022635] [DEBUG] [LOCAL ] CNO: Derivative data saved (1820 records). [2025-10-10T22:36:47.022778] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-10T22:36:47.022902] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-10-10T22:36:47.022972] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-10T22:36:47.025672] [INFO ] [MAIN ] Derivative Progress: 421/1823 symbols completed. CNNE took 1.1s. Estimated remaining: 8m 58s. Rate: 156.3 symbols/min [2025-10-10T22:36:47.036828] [INFO ] [MAIN ] Derivative Progress: 422/1823 symbols completed. CNO took 1.1s. Estimated remaining: 8m 57s. Rate: 156.7 symbols/min [2025-10-10T22:36:47.028322] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:47.037039] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:47.045047] [DEBUG] [LOCAL ] CNP: Derivative data saved (1820 records). [2025-10-10T22:36:47.045138] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-10T22:36:47.047573] [INFO ] [MAIN ] Derivative Progress: 423/1823 symbols completed. CNP took 1.2s. Estimated remaining: 8m 55s. Rate: 157.0 symbols/min [2025-10-10T22:36:47.048387] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:47.135938] [DEBUG] [LOCAL ] CODI: Loaded 41380 existing records from primary storage. [2025-10-10T22:36:47.136108] [INFO ] [MAIN ] CODI: Loaded 41380 primary data records. [2025-10-10T22:36:47.267187] [DEBUG] [LOCAL ] CNX: Loaded 52074 existing records from primary storage. [2025-10-10T22:36:47.268210] [DEBUG] [LOCAL ] CNQ: Loaded 54357 existing records from primary storage. [2025-10-10T22:36:47.273616] [INFO ] [MAIN ] CNQ: Loaded 54357 primary data records. [2025-10-10T22:36:47.289104] [INFO ] [MAIN ] CNX: Loaded 52074 primary data records. [2025-10-10T22:36:48.094393] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:48.095294] [INFO ] [MAIN ] CODI: Generated 1820 derivative records from 41380 primary records. [2025-10-10T22:36:48.095392] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-10T22:36:48.114512] [DEBUG] [LOCAL ] CODI: Derivative data saved (1820 records). [2025-10-10T22:36:48.114723] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-10T22:36:48.116619] [INFO ] [MAIN ] Derivative Progress: 424/1823 symbols completed. CODI took 1.1s. Estimated remaining: 8m 57s. Rate: 156.4 symbols/min [2025-10-10T22:36:48.117102] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:48.131762] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:48.132518] [INFO ] [MAIN ] CNX: Generated 1820 derivative records from 52074 primary records. [2025-10-10T22:36:48.133329] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-10T22:36:48.159778] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:48.161264] [INFO ] [MAIN ] CNQ: Generated 1820 derivative records from 54357 primary records. [2025-10-10T22:36:48.164233] [DEBUG] [LOCAL ] CNX: Derivative data saved (1820 records). [2025-10-10T22:36:48.164394] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-10-10T22:36:48.164158] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-10T22:36:48.167882] [INFO ] [MAIN ] Derivative Progress: 425/1823 symbols completed. CNX took 1.1s. Estimated remaining: 8m 55s. Rate: 156.7 symbols/min [2025-10-10T22:36:48.168089] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:48.185689] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1820 records). [2025-10-10T22:36:48.185884] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-10T22:36:48.187937] [INFO ] [MAIN ] Derivative Progress: 426/1823 symbols completed. CNQ took 1.2s. Estimated remaining: 8m 54s. Rate: 157.0 symbols/min [2025-10-10T22:36:48.188158] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:48.236026] [DEBUG] [LOCAL ] COF: Loaded 54392 existing records from primary storage. [2025-10-10T22:36:48.236328] [INFO ] [MAIN ] COF: Loaded 54392 primary data records. [2025-10-10T22:36:48.412107] [DEBUG] [LOCAL ] CON: Loaded 39376 existing records from primary storage. [2025-10-10T22:36:48.462178] [INFO ] [MAIN ] CON: Loaded 39376 primary data records. [2025-10-10T22:36:48.580463] [DEBUG] [LOCAL ] COHR: Loaded 54151 existing records from primary storage. [2025-10-10T22:36:48.642283] [INFO ] [MAIN ] COHR: Loaded 54151 primary data records. [2025-10-10T22:36:49.230915] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:49.232535] [INFO ] [MAIN ] COF: Generated 1820 derivative records from 54392 primary records. [2025-10-10T22:36:49.232760] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-10T22:36:49.255094] [DEBUG] [LOCAL ] COF: Derivative data saved (1820 records). [2025-10-10T22:36:49.256300] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-10T22:36:49.259023] [INFO ] [MAIN ] Derivative Progress: 427/1823 symbols completed. COF took 1.1s. Estimated remaining: 8m 56s. Rate: 156.4 symbols/min [2025-10-10T22:36:49.259410] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:49.278219] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:49.279210] [INFO ] [MAIN ] CON: Generated 1820 derivative records from 39376 primary records. [2025-10-10T22:36:49.279305] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-10-10T22:36:49.314032] [DEBUG] [LOCAL ] CON: Derivative data saved (1820 records). [2025-10-10T22:36:49.319304] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-10-10T22:36:49.319242] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:49.321132] [INFO ] [MAIN ] Derivative Progress: 428/1823 symbols completed. CON took 1.1s. Estimated remaining: 8m 54s. Rate: 156.7 symbols/min [2025-10-10T22:36:49.327752] [INFO ] [MAIN ] COHR: Generated 1820 derivative records from 54151 primary records. [2025-10-10T22:36:49.326834] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:49.327968] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-10-10T22:36:49.353437] [DEBUG] [LOCAL ] COOK: Loaded 24888 existing records from primary storage. [2025-10-10T22:36:49.354107] [INFO ] [MAIN ] COOK: Loaded 24888 primary data records. [2025-10-10T22:36:49.470129] [DEBUG] [LOCAL ] COHR: Derivative data saved (1820 records). [2025-10-10T22:36:49.487246] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-10-10T22:36:49.495612] [INFO ] [MAIN ] Derivative Progress: 429/1823 symbols completed. COHR took 1.3s. Estimated remaining: 8m 53s. Rate: 156.9 symbols/min [2025-10-10T22:36:49.506188] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:49.718401] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-10-10T22:36:49.718750] [INFO ] [MAIN ] COP: Loaded 54507 primary data records. [2025-10-10T22:36:50.090289] [DEBUG] [LOCAL ] COR: Loaded 47440 existing records from primary storage. [2025-10-10T22:36:50.091222] [INFO ] [MAIN ] COR: Loaded 47440 primary data records. [2025-10-10T22:36:50.269116] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:50.289513] [INFO ] [MAIN ] COOK: Generated 1820 derivative records from 24888 primary records. [2025-10-10T22:36:50.289742] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-10T22:36:50.439499] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:50.441503] [INFO ] [MAIN ] COP: Generated 1820 derivative records from 54507 primary records. [2025-10-10T22:36:50.441868] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-10T22:36:50.460177] [DEBUG] [LOCAL ] COOK: Derivative data saved (1820 records). [2025-10-10T22:36:50.461360] [DEBUG] [LOCAL ] COP: Derivative data saved (1820 records). [2025-10-10T22:36:50.461686] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-10T22:36:50.460310] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-10T22:36:50.464104] [INFO ] [MAIN ] Derivative Progress: 430/1823 symbols completed. COP took 1.1s. Estimated remaining: 8m 55s. Rate: 156.3 symbols/min [2025-10-10T22:36:50.464345] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:50.466487] [INFO ] [MAIN ] Derivative Progress: 431/1823 symbols completed. COOK took 1.2s. Estimated remaining: 8m 53s. Rate: 156.7 symbols/min [2025-10-10T22:36:50.467234] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:50.485797] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:50.486594] [INFO ] [MAIN ] COR: Generated 1820 derivative records from 47440 primary records. [2025-10-10T22:36:50.486842] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-10T22:36:50.514942] [DEBUG] [LOCAL ] COR: Derivative data saved (1820 records). [2025-10-10T22:36:50.515166] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-10T22:36:50.517883] [INFO ] [MAIN ] Derivative Progress: 432/1823 symbols completed. COR took 1.0s. Estimated remaining: 8m 52s. Rate: 157.0 symbols/min [2025-10-10T22:36:50.518128] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:50.549838] [DEBUG] [LOCAL ] COUR: Loaded 49778 existing records from primary storage. [2025-10-10T22:36:50.550038] [INFO ] [MAIN ] COUR: Loaded 49778 primary data records. [2025-10-10T22:36:50.693312] [DEBUG] [LOCAL ] CPA: Loaded 28742 existing records from primary storage. [2025-10-10T22:36:50.678459] [DEBUG] [LOCAL ] CP: Loaded 54043 existing records from primary storage. [2025-10-10T22:36:50.698745] [INFO ] [MAIN ] CPA: Loaded 28742 primary data records. [2025-10-10T22:36:50.698671] [INFO ] [MAIN ] CP: Loaded 54043 primary data records. [2025-10-10T22:36:51.537590] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:51.538527] [INFO ] [MAIN ] COUR: Generated 1820 derivative records from 49778 primary records. [2025-10-10T22:36:51.538885] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-10T22:36:51.555877] [DEBUG] [LOCAL ] COUR: Derivative data saved (1820 records). [2025-10-10T22:36:51.556345] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-10T22:36:51.558446] [INFO ] [MAIN ] Derivative Progress: 433/1823 symbols completed. COUR took 1.1s. Estimated remaining: 8m 53s. Rate: 156.4 symbols/min [2025-10-10T22:36:51.588901] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:51.589325] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:51.590158] [INFO ] [MAIN ] CP: Generated 1820 derivative records from 54043 primary records. [2025-10-10T22:36:51.590881] [INFO ] [MAIN ] CPA: Generated 1820 derivative records from 28742 primary records. [2025-10-10T22:36:51.591057] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-10T22:36:51.590984] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-10T22:36:51.620454] [DEBUG] [LOCAL ] CP: Derivative data saved (1820 records). [2025-10-10T22:36:51.620554] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-10T22:36:51.623592] [INFO ] [MAIN ] Derivative Progress: 434/1823 symbols completed. CP took 1.2s. Estimated remaining: 8m 52s. Rate: 156.7 symbols/min [2025-10-10T22:36:51.625958] [DEBUG] [LOCAL ] CPA: Derivative data saved (1820 records). [2025-10-10T22:36:51.626027] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-10T22:36:51.628426] [INFO ] [MAIN ] Derivative Progress: 435/1823 symbols completed. CPA took 1.1s. Estimated remaining: 8m 50s. Rate: 157.0 symbols/min [2025-10-10T22:36:51.629086] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:51.628919] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:51.629016] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:51.650410] [DEBUG] [LOCAL ] CPK: Loaded 13880 existing records from primary storage. [2025-10-10T22:36:51.650693] [INFO ] [MAIN ] CPK: Loaded 13880 primary data records. [2025-10-10T22:36:51.722354] [DEBUG] [LOCAL ] CPF: Loaded 15445 existing records from primary storage. [2025-10-10T22:36:51.748262] [INFO ] [MAIN ] CPF: Loaded 15445 primary data records. [2025-10-10T22:36:51.897262] [DEBUG] [LOCAL ] CPAY: Loaded 30808 existing records from primary storage. [2025-10-10T22:36:51.931636] [INFO ] [MAIN ] CPAY: Loaded 30808 primary data records. [2025-10-10T22:36:52.673773] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:52.691000] [INFO ] [MAIN ] CPK: Generated 1820 derivative records from 13880 primary records. [2025-10-10T22:36:52.698466] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-10T22:36:52.699276] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:52.701203] [INFO ] [MAIN ] CPF: Generated 1820 derivative records from 15445 primary records. [2025-10-10T22:36:52.701452] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-10T22:36:52.729465] [DEBUG] [LOCAL ] CPK: Derivative data saved (1820 records). [2025-10-10T22:36:52.730871] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-10T22:36:52.736868] [INFO ] [MAIN ] Derivative Progress: 436/1823 symbols completed. CPK took 1.1s. Estimated remaining: 8m 52s. Rate: 156.4 symbols/min [2025-10-10T22:36:52.737240] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:52.759394] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:52.760723] [INFO ] [MAIN ] CPAY: Generated 1820 derivative records from 30808 primary records. [2025-10-10T22:36:52.761269] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-10T22:36:52.761148] [DEBUG] [LOCAL ] CPF: Derivative data saved (1820 records). [2025-10-10T22:36:52.762423] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-10T22:36:52.764699] [INFO ] [MAIN ] Derivative Progress: 437/1823 symbols completed. CPF took 1.1s. Estimated remaining: 8m 51s. Rate: 156.7 symbols/min [2025-10-10T22:36:52.802777] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1820 records). [2025-10-10T22:36:52.776321] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:52.803882] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-10T22:36:52.806384] [INFO ] [MAIN ] Derivative Progress: 438/1823 symbols completed. CPAY took 1.2s. Estimated remaining: 8m 49s. Rate: 157.0 symbols/min [2025-10-10T22:36:52.806825] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:52.867870] [DEBUG] [LOCAL ] CPNG: Loaded 54450 existing records from primary storage. [2025-10-10T22:36:52.868253] [INFO ] [MAIN ] CPNG: Loaded 54450 primary data records. [2025-10-10T22:36:53.100434] [DEBUG] [LOCAL ] CPRI: Loaded 53277 existing records from primary storage. [2025-10-10T22:36:53.095461] [DEBUG] [LOCAL ] CPT: Loaded 45033 existing records from primary storage. [2025-10-10T22:36:53.100805] [INFO ] [MAIN ] CPT: Loaded 45033 primary data records. [2025-10-10T22:36:53.100725] [INFO ] [MAIN ] CPRI: Loaded 53277 primary data records. [2025-10-10T22:36:53.857059] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:53.858222] [INFO ] [MAIN ] CPNG: Generated 1820 derivative records from 54450 primary records. [2025-10-10T22:36:53.858613] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-10T22:36:53.877740] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1820 records). [2025-10-10T22:36:53.877945] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-10-10T22:36:53.881088] [INFO ] [MAIN ] Derivative Progress: 439/1823 symbols completed. CPNG took 1.1s. Estimated remaining: 8m 51s. Rate: 156.4 symbols/min [2025-10-10T22:36:53.881914] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:53.897832] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:53.898927] [INFO ] [MAIN ] CPT: Generated 1820 derivative records from 45033 primary records. [2025-10-10T22:36:53.899147] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-10T22:36:53.920295] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:53.928696] [INFO ] [MAIN ] CPRI: Generated 1820 derivative records from 53277 primary records. [2025-10-10T22:36:53.929094] [DEBUG] [LOCAL ] CPT: Derivative data saved (1820 records). [2025-10-10T22:36:53.929298] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-10T22:36:53.929405] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-10T22:36:53.932210] [INFO ] [MAIN ] Derivative Progress: 440/1823 symbols completed. CPT took 1.1s. Estimated remaining: 8m 50s. Rate: 156.7 symbols/min [2025-10-10T22:36:53.932679] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:53.957538] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1820 records). [2025-10-10T22:36:53.957680] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-10T22:36:53.959806] [INFO ] [MAIN ] Derivative Progress: 441/1823 symbols completed. CPRI took 1.2s. Estimated remaining: 8m 48s. Rate: 157.0 symbols/min [2025-10-10T22:36:53.966685] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:53.967598] [DEBUG] [LOCAL ] CQP: Loaded 19096 existing records from primary storage. [2025-10-10T22:36:53.967796] [INFO ] [MAIN ] CQP: Loaded 19096 primary data records. [2025-10-10T22:36:54.090872] [DEBUG] [LOCAL ] CR: Loaded 24473 existing records from primary storage. [2025-10-10T22:36:54.090466] [DEBUG] [LOCAL ] CRBD: Loaded 9109 existing records from primary storage. [2025-10-10T22:36:54.091364] [INFO ] [MAIN ] CRBD: Loaded 9109 primary data records. [2025-10-10T22:36:54.096701] [INFO ] [MAIN ] CR: Loaded 24473 primary data records. [2025-10-10T22:36:55.000028] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:55.001820] [INFO ] [MAIN ] CQP: Generated 1820 derivative records from 19096 primary records. [2025-10-10T22:36:55.002046] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-10T22:36:55.040066] [DEBUG] [MAIN ] CRBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:55.044282] [INFO ] [MAIN ] CRBD: Generated 1820 derivative records from 9109 primary records. [2025-10-10T22:36:55.043553] [DEBUG] [LOCAL ] CQP: Derivative data saved (1820 records). [2025-10-10T22:36:55.045492] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-10T22:36:55.048306] [INFO ] [MAIN ] Derivative Progress: 442/1823 symbols completed. CQP took 1.2s. Estimated remaining: 8m 50s. Rate: 156.4 symbols/min [2025-10-10T22:36:55.048527] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:55.045676] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-10T22:36:55.087976] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:55.090534] [INFO ] [MAIN ] CR: Generated 1820 derivative records from 24473 primary records. [2025-10-10T22:36:55.091181] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-10T22:36:55.091104] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1820 records). [2025-10-10T22:36:55.092255] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-10T22:36:55.094855] [INFO ] [MAIN ] Derivative Progress: 443/1823 symbols completed. CRBD took 1.1s. Estimated remaining: 8m 49s. Rate: 156.7 symbols/min [2025-10-10T22:36:55.113991] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:55.122618] [DEBUG] [LOCAL ] CR: Derivative data saved (1820 records). [2025-10-10T22:36:55.122899] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-10T22:36:55.125676] [INFO ] [MAIN ] Derivative Progress: 444/1823 symbols completed. CR took 1.2s. Estimated remaining: 8m 47s. Rate: 157.0 symbols/min [2025-10-10T22:36:55.126273] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:55.186284] [DEBUG] [LOCAL ] CRBG: Loaded 53226 existing records from primary storage. [2025-10-10T22:36:55.186753] [INFO ] [MAIN ] CRBG: Loaded 53226 primary data records. [2025-10-10T22:36:55.378158] [DEBUG] [LOCAL ] CRC: Loaded 44489 existing records from primary storage. [2025-10-10T22:36:55.413355] [INFO ] [MAIN ] CRC: Loaded 44489 primary data records. [2025-10-10T22:36:55.437160] [DEBUG] [LOCAL ] CRGY: Loaded 53242 existing records from primary storage. [2025-10-10T22:36:55.443564] [INFO ] [MAIN ] CRGY: Loaded 53242 primary data records. [2025-10-10T22:36:56.482436] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:56.484217] [INFO ] [MAIN ] CRC: Generated 1820 derivative records from 44489 primary records. [2025-10-10T22:36:56.484401] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:56.484542] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-10T22:36:56.487450] [INFO ] [MAIN ] CRBG: Generated 1820 derivative records from 53226 primary records. [2025-10-10T22:36:56.487715] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-10T22:36:56.521250] [DEBUG] [LOCAL ] CRC: Derivative data saved (1820 records). [2025-10-10T22:36:56.521677] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-10T22:36:56.524198] [INFO ] [MAIN ] Derivative Progress: 445/1823 symbols completed. CRC took 1.4s. Estimated remaining: 8m 50s. Rate: 156.1 symbols/min [2025-10-10T22:36:56.521592] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1820 records). [2025-10-10T22:36:56.524509] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-10T22:36:56.527514] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:56.527610] [INFO ] [MAIN ] Derivative Progress: 446/1823 symbols completed. CRBG took 1.5s. Estimated remaining: 8m 48s. Rate: 156.4 symbols/min [2025-10-10T22:36:56.541129] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:56.543123] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:56.544315] [INFO ] [MAIN ] CRGY: Generated 1820 derivative records from 53242 primary records. [2025-10-10T22:36:56.544457] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-10T22:36:56.561861] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1820 records). [2025-10-10T22:36:56.574270] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-10T22:36:56.576767] [INFO ] [MAIN ] Derivative Progress: 447/1823 symbols completed. CRGY took 1.5s. Estimated remaining: 8m 47s. Rate: 156.7 symbols/min [2025-10-10T22:36:56.577145] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:56.639188] [DEBUG] [LOCAL ] CRH: Loaded 54229 existing records from primary storage. [2025-10-10T22:36:56.639429] [INFO ] [MAIN ] CRH: Loaded 54229 primary data records. [2025-10-10T22:36:56.759416] [DEBUG] [LOCAL ] CRI: Loaded 50425 existing records from primary storage. [2025-10-10T22:36:56.780354] [INFO ] [MAIN ] CRI: Loaded 50425 primary data records. [2025-10-10T22:36:57.120744] [DEBUG] [LOCAL ] CRK: Loaded 52981 existing records from primary storage. [2025-10-10T22:36:57.120970] [INFO ] [MAIN ] CRK: Loaded 52981 primary data records. [2025-10-10T22:36:57.740155] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:57.742385] [INFO ] [MAIN ] CRH: Generated 1820 derivative records from 54229 primary records. [2025-10-10T22:36:57.742845] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-10T22:36:57.777178] [DEBUG] [LOCAL ] CRH: Derivative data saved (1820 records). [2025-10-10T22:36:57.783975] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-10T22:36:57.783532] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:57.786524] [INFO ] [MAIN ] Derivative Progress: 448/1823 symbols completed. CRH took 1.3s. Estimated remaining: 8m 49s. Rate: 156.0 symbols/min [2025-10-10T22:36:57.787599] [INFO ] [MAIN ] CRI: Generated 1820 derivative records from 50425 primary records. [2025-10-10T22:36:57.788326] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-10T22:36:57.824074] [DEBUG] [LOCAL ] CRI: Derivative data saved (1820 records). [2025-10-10T22:36:57.823990] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:57.824238] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-10T22:36:57.825084] [INFO ] [MAIN ] CRK: Generated 1820 derivative records from 52981 primary records. [2025-10-10T22:36:57.828631] [INFO ] [MAIN ] Derivative Progress: 449/1823 symbols completed. CRI took 1.3s. Estimated remaining: 8m 48s. Rate: 156.3 symbols/min [2025-10-10T22:36:57.828955] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-10T22:36:57.845902] [DEBUG] [LOCAL ] CRK: Derivative data saved (1820 records). [2025-10-10T22:36:57.846008] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-10T22:36:57.848227] [INFO ] [MAIN ] Derivative Progress: 450/1823 symbols completed. CRK took 1.3s. Estimated remaining: 8m 46s. Rate: 156.6 symbols/min [2025-10-10T22:36:57.848967] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:57.849065] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:57.849423] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:57.930639] [DEBUG] [LOCAL ] CRL: Loaded 43459 existing records from primary storage. [2025-10-10T22:36:57.931329] [INFO ] [MAIN ] CRL: Loaded 43459 primary data records. [2025-10-10T22:36:57.988777] [DEBUG] [LOCAL ] CRS: Loaded 43725 existing records from primary storage. [2025-10-10T22:36:58.001332] [INFO ] [MAIN ] CRS: Loaded 43725 primary data records. [2025-10-10T22:36:58.024934] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-10-10T22:36:58.080272] [INFO ] [MAIN ] CRM: Loaded 54550 primary data records. [2025-10-10T22:36:58.934429] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:58.936549] [INFO ] [MAIN ] CRL: Generated 1820 derivative records from 43459 primary records. [2025-10-10T22:36:58.936756] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-10T22:36:58.958163] [DEBUG] [LOCAL ] CRL: Derivative data saved (1820 records). [2025-10-10T22:36:58.971525] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-10T22:36:58.984366] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:58.986366] [INFO ] [MAIN ] Derivative Progress: 451/1823 symbols completed. CRL took 1.1s. Estimated remaining: 8m 48s. Rate: 155.9 symbols/min [2025-10-10T22:36:58.988223] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:36:58.987548] [INFO ] [MAIN ] CRM: Generated 1820 derivative records from 54550 primary records. [2025-10-10T22:36:58.989209] [INFO ] [MAIN ] CRS: Generated 1820 derivative records from 43725 primary records. [2025-10-10T22:36:58.988446] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-10T22:36:58.987885] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:58.989300] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-10T22:36:59.019856] [DEBUG] [LOCAL ] CRM: Derivative data saved (1820 records). [2025-10-10T22:36:59.020261] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-10T22:36:59.024399] [DEBUG] [LOCAL ] CRS: Derivative data saved (1820 records). [2025-10-10T22:36:59.026627] [INFO ] [MAIN ] Derivative Progress: 452/1823 symbols completed. CRM took 1.2s. Estimated remaining: 8m 47s. Rate: 156.2 symbols/min [2025-10-10T22:36:59.024633] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-10T22:36:59.029148] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:59.029700] [INFO ] [MAIN ] Derivative Progress: 453/1823 symbols completed. CRS took 1.2s. Estimated remaining: 8m 45s. Rate: 156.6 symbols/min [2025-10-10T22:36:59.029929] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:36:59.036121] [DEBUG] [LOCAL ] CRT: Loaded 5025 existing records from primary storage. [2025-10-10T22:36:59.036414] [INFO ] [MAIN ] CRT: Loaded 5025 primary data records. [2025-10-10T22:36:59.373837] [DEBUG] [LOCAL ] CSL: Loaded 31969 existing records from primary storage. [2025-10-10T22:36:59.403734] [DEBUG] [LOCAL ] CSAN: Loaded 42688 existing records from primary storage. [2025-10-10T22:36:59.403926] [INFO ] [MAIN ] CSL: Loaded 31969 primary data records. [2025-10-10T22:36:59.404717] [INFO ] [MAIN ] CSAN: Loaded 42688 primary data records. [2025-10-10T22:37:00.050386] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:00.051346] [INFO ] [MAIN ] CRT: Generated 1820 derivative records from 5025 primary records. [2025-10-10T22:37:00.051505] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-10T22:37:00.070179] [DEBUG] [LOCAL ] CRT: Derivative data saved (1820 records). [2025-10-10T22:37:00.070388] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-10T22:37:00.072576] [INFO ] [MAIN ] Derivative Progress: 454/1823 symbols completed. CRT took 1.1s. Estimated remaining: 8m 47s. Rate: 156.0 symbols/min [2025-10-10T22:37:00.072940] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:00.116849] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:00.117588] [DEBUG] [LOCAL ] CSV: Loaded 12872 existing records from primary storage. [2025-10-10T22:37:00.118997] [INFO ] [MAIN ] CSL: Generated 1820 derivative records from 31969 primary records. [2025-10-10T22:37:00.118167] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:00.120149] [INFO ] [MAIN ] CSV: Loaded 12872 primary data records. [2025-10-10T22:37:00.120075] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-10T22:37:00.119969] [INFO ] [MAIN ] CSAN: Generated 1820 derivative records from 42688 primary records. [2025-10-10T22:37:00.131762] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-10T22:37:00.247902] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1820 records). [2025-10-10T22:37:00.255360] [DEBUG] [LOCAL ] CSL: Derivative data saved (1820 records). [2025-10-10T22:37:00.255509] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-10T22:37:00.255592] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-10T22:37:00.257709] [INFO ] [MAIN ] Derivative Progress: 455/1823 symbols completed. CSL took 1.2s. Estimated remaining: 8m 46s. Rate: 156.2 symbols/min [2025-10-10T22:37:00.263442] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:00.276800] [INFO ] [MAIN ] Derivative Progress: 456/1823 symbols completed. CSAN took 1.2s. Estimated remaining: 8m 44s. Rate: 156.5 symbols/min [2025-10-10T22:37:00.287465] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:00.460106] [DEBUG] [LOCAL ] CTDD: Loaded 5856 existing records from primary storage. [2025-10-10T22:37:00.460389] [INFO ] [MAIN ] CTDD: Loaded 5856 primary data records. [2025-10-10T22:37:00.475723] [DEBUG] [LOCAL ] CTBB: Loaded 7130 existing records from primary storage. [2025-10-10T22:37:00.485216] [INFO ] [MAIN ] CTBB: Loaded 7130 primary data records. [2025-10-10T22:37:01.097703] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:01.098864] [INFO ] [MAIN ] CSV: Generated 1820 derivative records from 12872 primary records. [2025-10-10T22:37:01.099455] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-10T22:37:01.117309] [DEBUG] [LOCAL ] CSV: Derivative data saved (1820 records). [2025-10-10T22:37:01.117540] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-10T22:37:01.119705] [INFO ] [MAIN ] Derivative Progress: 457/1823 symbols completed. CSV took 1.0s. Estimated remaining: 8m 45s. Rate: 156.1 symbols/min [2025-10-10T22:37:01.119879] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:01.139622] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:37:01.142214] [INFO ] [MAIN ] CTDD: Generated 1819 derivative records from 5856 primary records. [2025-10-10T22:37:01.142505] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-10T22:37:01.168326] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:01.172251] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1819 records). [2025-10-10T22:37:01.172576] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-10T22:37:01.175773] [INFO ] [MAIN ] Derivative Progress: 458/1823 symbols completed. CTDD took 0.9s. Estimated remaining: 8m 44s. Rate: 156.4 symbols/min [2025-10-10T22:37:01.176000] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:01.173630] [INFO ] [MAIN ] CTBB: Generated 1820 derivative records from 7130 primary records. [2025-10-10T22:37:01.176215] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-10T22:37:01.204693] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1820 records). [2025-10-10T22:37:01.204910] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-10T22:37:01.206865] [INFO ] [MAIN ] Derivative Progress: 459/1823 symbols completed. CTBB took 0.9s. Estimated remaining: 8m 42s. Rate: 156.7 symbols/min [2025-10-10T22:37:01.207414] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:01.229269] [DEBUG] [LOCAL ] CTRE: Loaded 50027 existing records from primary storage. [2025-10-10T22:37:01.229571] [INFO ] [MAIN ] CTRE: Loaded 50027 primary data records. [2025-10-10T22:37:01.347528] [DEBUG] [LOCAL ] CTS: Loaded 19662 existing records from primary storage. [2025-10-10T22:37:01.359149] [INFO ] [MAIN ] CTS: Loaded 19662 primary data records. [2025-10-10T22:37:01.797956] [DEBUG] [LOCAL ] CUBE: Loaded 51520 existing records from primary storage. [2025-10-10T22:37:01.906124] [INFO ] [MAIN ] CUBE: Loaded 51520 primary data records. [2025-10-10T22:37:02.104603] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:02.146526] [INFO ] [MAIN ] CTRE: Generated 1820 derivative records from 50027 primary records. [2025-10-10T22:37:02.146778] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-10T22:37:02.292058] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1820 records). [2025-10-10T22:37:02.293281] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-10-10T22:37:02.297272] [INFO ] [MAIN ] Derivative Progress: 460/1823 symbols completed. CTRE took 1.2s. Estimated remaining: 8m 44s. Rate: 156.1 symbols/min [2025-10-10T22:37:02.298919] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:02.313755] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:02.317452] [INFO ] [MAIN ] CTS: Generated 1820 derivative records from 19662 primary records. [2025-10-10T22:37:02.317717] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-10T22:37:02.337336] [DEBUG] [LOCAL ] CTS: Derivative data saved (1820 records). [2025-10-10T22:37:02.338108] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-10T22:37:02.340149] [INFO ] [MAIN ] Derivative Progress: 461/1823 symbols completed. CTS took 1.2s. Estimated remaining: 8m 43s. Rate: 156.4 symbols/min [2025-10-10T22:37:02.340534] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:02.368039] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:02.369237] [INFO ] [MAIN ] CUBE: Generated 1820 derivative records from 51520 primary records. [2025-10-10T22:37:02.370083] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-10T22:37:02.393418] [DEBUG] [LOCAL ] CUBI: Loaded 27426 existing records from primary storage. [2025-10-10T22:37:02.397903] [INFO ] [MAIN ] CUBI: Loaded 27426 primary data records. [2025-10-10T22:37:02.397769] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1820 records). [2025-10-10T22:37:02.398208] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-10T22:37:02.400224] [INFO ] [MAIN ] Derivative Progress: 462/1823 symbols completed. CUBE took 1.2s. Estimated remaining: 8m 41s. Rate: 156.6 symbols/min [2025-10-10T22:37:02.423072] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:02.498844] [DEBUG] [LOCAL ] CULP: Loaded 2919 existing records from primary storage. [2025-10-10T22:37:02.513631] [INFO ] [MAIN ] CULP: Loaded 2919 primary data records. [2025-10-10T22:37:02.913265] [DEBUG] [LOCAL ] CUK: Loaded 51722 existing records from primary storage. [2025-10-10T22:37:03.037010] [INFO ] [MAIN ] CUK: Loaded 51722 primary data records. [2025-10-10T22:37:03.456406] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:03.457934] [INFO ] [MAIN ] CUBI: Generated 1820 derivative records from 27426 primary records. [2025-10-10T22:37:03.458042] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-10T22:37:03.457029] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-10-10T22:37:03.459193] [INFO ] [MAIN ] CULP: Generated 1817 derivative records from 2919 primary records. [2025-10-10T22:37:03.459782] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-10T22:37:03.486457] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1820 records). [2025-10-10T22:37:03.488451] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-10T22:37:03.490096] [DEBUG] [LOCAL ] CULP: Derivative data saved (1817 records). [2025-10-10T22:37:03.492351] [INFO ] [MAIN ] Derivative Progress: 463/1823 symbols completed. CUBI took 1.2s. Estimated remaining: 8m 43s. Rate: 156.0 symbols/min [2025-10-10T22:37:03.492838] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-10-10T22:37:03.494788] [INFO ] [MAIN ] Derivative Progress: 464/1823 symbols completed. CULP took 1.1s. Estimated remaining: 8m 42s. Rate: 156.4 symbols/min [2025-10-10T22:37:03.513922] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:03.514786] [INFO ] [MAIN ] CUK: Generated 1820 derivative records from 51722 primary records. [2025-10-10T22:37:03.514869] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-10T22:37:03.531722] [DEBUG] [LOCAL ] CUK: Derivative data saved (1820 records). [2025-10-10T22:37:03.531785] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-10T22:37:03.534398] [INFO ] [MAIN ] Derivative Progress: 465/1823 symbols completed. CUK took 1.2s. Estimated remaining: 8m 40s. Rate: 156.7 symbols/min [2025-10-10T22:37:03.534817] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:03.534927] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:03.535342] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:03.565882] [DEBUG] [LOCAL ] CURV: Loaded 27271 existing records from primary storage. [2025-10-10T22:37:03.566013] [INFO ] [MAIN ] CURV: Loaded 27271 primary data records. [2025-10-10T22:37:03.940194] [DEBUG] [LOCAL ] CUZ: Loaded 50127 existing records from primary storage. [2025-10-10T22:37:03.948963] [INFO ] [MAIN ] CUZ: Loaded 50127 primary data records. [2025-10-10T22:37:03.950560] [DEBUG] [LOCAL ] CVE: Loaded 54339 existing records from primary storage. [2025-10-10T22:37:03.982610] [INFO ] [MAIN ] CVE: Loaded 54339 primary data records. [2025-10-10T22:37:04.581125] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:04.582123] [INFO ] [MAIN ] CURV: Generated 1820 derivative records from 27271 primary records. [2025-10-10T22:37:04.582462] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-10T22:37:04.614144] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:04.615547] [INFO ] [MAIN ] CUZ: Generated 1820 derivative records from 50127 primary records. [2025-10-10T22:37:04.615917] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-10T22:37:04.628235] [DEBUG] [LOCAL ] CURV: Derivative data saved (1820 records). [2025-10-10T22:37:04.632469] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-10T22:37:04.639023] [INFO ] [MAIN ] Derivative Progress: 466/1823 symbols completed. CURV took 1.1s. Estimated remaining: 8m 42s. Rate: 156.0 symbols/min [2025-10-10T22:37:04.639166] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:04.636774] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1820 records). [2025-10-10T22:37:04.652273] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-10T22:37:04.654550] [INFO ] [MAIN ] Derivative Progress: 467/1823 symbols completed. CUZ took 1.1s. Estimated remaining: 8m 40s. Rate: 156.3 symbols/min [2025-10-10T22:37:04.654839] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:04.652557] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:04.656242] [INFO ] [MAIN ] CVE: Generated 1820 derivative records from 54339 primary records. [2025-10-10T22:37:04.656433] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-10T22:37:04.678014] [DEBUG] [LOCAL ] CVE: Derivative data saved (1820 records). [2025-10-10T22:37:04.683809] [DEBUG] [LOCAL ] CVEO: Loaded 15540 existing records from primary storage. [2025-10-10T22:37:04.683998] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-10T22:37:04.684069] [INFO ] [MAIN ] CVEO: Loaded 15540 primary data records. [2025-10-10T22:37:04.685945] [INFO ] [MAIN ] Derivative Progress: 468/1823 symbols completed. CVE took 1.2s. Estimated remaining: 8m 39s. Rate: 156.7 symbols/min [2025-10-10T22:37:04.686323] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:05.025449] [DEBUG] [LOCAL ] CVI: Loaded 47237 existing records from primary storage. [2025-10-10T22:37:05.026074] [INFO ] [MAIN ] CVI: Loaded 47237 primary data records. [2025-10-10T22:37:05.240694] [DEBUG] [LOCAL ] CVNA: Loaded 53666 existing records from primary storage. [2025-10-10T22:37:05.264146] [INFO ] [MAIN ] CVNA: Loaded 53666 primary data records. [2025-10-10T22:37:05.581004] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:05.582020] [INFO ] [MAIN ] CVEO: Generated 1820 derivative records from 15540 primary records. [2025-10-10T22:37:05.588287] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-10-10T22:37:05.806247] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1820 records). [2025-10-10T22:37:05.806691] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-10-10T22:37:05.809009] [INFO ] [MAIN ] Derivative Progress: 469/1823 symbols completed. CVEO took 1.2s. Estimated remaining: 8m 41s. Rate: 156.0 symbols/min [2025-10-10T22:37:05.809244] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:05.834272] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:05.835298] [INFO ] [MAIN ] CVI: Generated 1820 derivative records from 47237 primary records. [2025-10-10T22:37:05.835448] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-10-10T22:37:05.857575] [DEBUG] [LOCAL ] CVI: Derivative data saved (1820 records). [2025-10-10T22:37:05.857850] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-10-10T22:37:05.860464] [INFO ] [MAIN ] Derivative Progress: 470/1823 symbols completed. CVI took 1.2s. Estimated remaining: 8m 39s. Rate: 156.3 symbols/min [2025-10-10T22:37:05.861520] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:05.898066] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:05.899064] [INFO ] [MAIN ] CVNA: Generated 1820 derivative records from 53666 primary records. [2025-10-10T22:37:05.899245] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-10T22:37:05.933152] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1820 records). [2025-10-10T22:37:05.934693] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-10T22:37:05.934369] [DEBUG] [LOCAL ] CVS: Loaded 54474 existing records from primary storage. [2025-10-10T22:37:05.938871] [INFO ] [MAIN ] Derivative Progress: 471/1823 symbols completed. CVNA took 1.3s. Estimated remaining: 8m 38s. Rate: 156.6 symbols/min [2025-10-10T22:37:05.939378] [INFO ] [MAIN ] CVS: Loaded 54474 primary data records. [2025-10-10T22:37:05.939556] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:06.151550] [DEBUG] [LOCAL ] CW: Loaded 22494 existing records from primary storage. [2025-10-10T22:37:06.300620] [INFO ] [MAIN ] CW: Loaded 22494 primary data records. [2025-10-10T22:37:06.324582] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-10-10T22:37:06.341591] [INFO ] [MAIN ] CVX: Loaded 54540 primary data records. [2025-10-10T22:37:06.963498] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:06.964593] [INFO ] [MAIN ] CVS: Generated 1820 derivative records from 54474 primary records. [2025-10-10T22:37:06.965257] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-10T22:37:06.985507] [DEBUG] [LOCAL ] CVS: Derivative data saved (1820 records). [2025-10-10T22:37:06.986237] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-10T22:37:06.988448] [INFO ] [MAIN ] Derivative Progress: 472/1823 symbols completed. CVS took 1.2s. Estimated remaining: 8m 40s. Rate: 156.0 symbols/min [2025-10-10T22:37:06.989005] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:07.028978] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:07.029389] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:07.030633] [INFO ] [MAIN ] CVX: Generated 1820 derivative records from 54540 primary records. [2025-10-10T22:37:07.031851] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-10T22:37:07.031558] [INFO ] [MAIN ] CW: Generated 1820 derivative records from 22494 primary records. [2025-10-10T22:37:07.032843] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-10T22:37:07.080282] [DEBUG] [LOCAL ] CVX: Derivative data saved (1820 records). [2025-10-10T22:37:07.081462] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-10T22:37:07.081585] [DEBUG] [LOCAL ] CW: Derivative data saved (1820 records). [2025-10-10T22:37:07.085037] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-10T22:37:07.084618] [INFO ] [MAIN ] Derivative Progress: 473/1823 symbols completed. CVX took 1.2s. Estimated remaining: 8m 38s. Rate: 156.2 symbols/min [2025-10-10T22:37:07.089250] [INFO ] [MAIN ] Derivative Progress: 474/1823 symbols completed. CW took 1.1s. Estimated remaining: 8m 37s. Rate: 156.6 symbols/min [2025-10-10T22:37:07.089058] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:07.089774] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:07.108222] [DEBUG] [LOCAL ] CWAN: Loaded 53226 existing records from primary storage. [2025-10-10T22:37:07.108603] [INFO ] [MAIN ] CWAN: Loaded 53226 primary data records. [2025-10-10T22:37:07.487758] [DEBUG] [LOCAL ] CWK: Loaded 50175 existing records from primary storage. [2025-10-10T22:37:07.489293] [INFO ] [MAIN ] CWK: Loaded 50175 primary data records. [2025-10-10T22:37:07.527173] [DEBUG] [LOCAL ] CWEN: Loaded 45951 existing records from primary storage. [2025-10-10T22:37:07.555364] [INFO ] [MAIN ] CWEN: Loaded 45951 primary data records. [2025-10-10T22:37:08.138513] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:08.140340] [INFO ] [MAIN ] CWAN: Generated 1820 derivative records from 53226 primary records. [2025-10-10T22:37:08.140702] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-10T22:37:08.158626] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1820 records). [2025-10-10T22:37:08.160842] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-10T22:37:08.165021] [INFO ] [MAIN ] Derivative Progress: 475/1823 symbols completed. CWAN took 1.2s. Estimated remaining: 8m 39s. Rate: 156.0 symbols/min [2025-10-10T22:37:08.165505] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:08.180271] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:08.181375] [INFO ] [MAIN ] CWK: Generated 1820 derivative records from 50175 primary records. [2025-10-10T22:37:08.181674] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-10T22:37:08.199353] [DEBUG] [LOCAL ] CWK: Derivative data saved (1820 records). [2025-10-10T22:37:08.199535] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-10T22:37:08.201414] [INFO ] [MAIN ] Derivative Progress: 476/1823 symbols completed. CWK took 1.1s. Estimated remaining: 8m 37s. Rate: 156.3 symbols/min [2025-10-10T22:37:08.202194] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:08.254906] [DEBUG] [LOCAL ] CWT: Loaded 28469 existing records from primary storage. [2025-10-10T22:37:08.255861] [INFO ] [MAIN ] CWT: Loaded 28469 primary data records. [2025-10-10T22:37:08.255481] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:08.270172] [INFO ] [MAIN ] CWEN: Generated 1820 derivative records from 45951 primary records. [2025-10-10T22:37:08.313957] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-10T22:37:08.609045] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1820 records). [2025-10-10T22:37:08.610141] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-10-10T22:37:08.611220] [DEBUG] [LOCAL ] CX: Loaded 53583 existing records from primary storage. [2025-10-10T22:37:08.614270] [INFO ] [MAIN ] Derivative Progress: 477/1823 symbols completed. CWEN took 1.5s. Estimated remaining: 8m 37s. Rate: 156.2 symbols/min [2025-10-10T22:37:08.615871] [INFO ] [MAIN ] CX: Loaded 53583 primary data records. [2025-10-10T22:37:08.615792] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:08.757051] [DEBUG] [LOCAL ] CXE: Loaded 6249 existing records from primary storage. [2025-10-10T22:37:08.762614] [INFO ] [MAIN ] CXE: Loaded 6249 primary data records. [2025-10-10T22:37:09.104900] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:09.143526] [INFO ] [MAIN ] CWT: Generated 1820 derivative records from 28469 primary records. [2025-10-10T22:37:09.148199] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-10T22:37:09.286810] [DEBUG] [LOCAL ] CWT: Derivative data saved (1820 records). [2025-10-10T22:37:09.287787] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-10T22:37:09.290915] [INFO ] [MAIN ] Derivative Progress: 478/1823 symbols completed. CWT took 1.1s. Estimated remaining: 8m 37s. Rate: 156.0 symbols/min [2025-10-10T22:37:09.309185] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:09.310219] [INFO ] [MAIN ] CX: Generated 1820 derivative records from 53583 primary records. [2025-10-10T22:37:09.310445] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-10T22:37:09.329106] [DEBUG] [LOCAL ] CX: Derivative data saved (1820 records). [2025-10-10T22:37:09.329282] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-10T22:37:09.332897] [INFO ] [MAIN ] Derivative Progress: 479/1823 symbols completed. CX took 1.1s. Estimated remaining: 8m 36s. Rate: 156.3 symbols/min [2025-10-10T22:37:09.348715] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:09.349543] [INFO ] [MAIN ] CXE: Generated 1820 derivative records from 6249 primary records. [2025-10-10T22:37:09.349610] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-10T22:37:09.364724] [DEBUG] [LOCAL ] CXE: Derivative data saved (1820 records). [2025-10-10T22:37:09.364844] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-10T22:37:09.369979] [INFO ] [MAIN ] Derivative Progress: 480/1823 symbols completed. CXE took 0.8s. Estimated remaining: 8m 35s. Rate: 156.6 symbols/min [2025-10-10T22:37:09.370500] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:09.370680] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:09.371292] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:09.382768] [DEBUG] [LOCAL ] CXH: Loaded 4448 existing records from primary storage. [2025-10-10T22:37:09.383254] [INFO ] [MAIN ] CXH: Loaded 4448 primary data records. [2025-10-10T22:37:09.764884] [DEBUG] [LOCAL ] CXM: Loaded 48285 existing records from primary storage. [2025-10-10T22:37:09.767372] [INFO ] [MAIN ] CXM: Loaded 48285 primary data records. [2025-10-10T22:37:09.766999] [DEBUG] [LOCAL ] CXT: Loaded 31466 existing records from primary storage. [2025-10-10T22:37:09.768345] [INFO ] [MAIN ] CXT: Loaded 31466 primary data records. [2025-10-10T22:37:10.424434] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:10.429712] [INFO ] [MAIN ] CXH: Generated 1820 derivative records from 4448 primary records. [2025-10-10T22:37:10.429829] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-10T22:37:10.446981] [DEBUG] [LOCAL ] CXH: Derivative data saved (1820 records). [2025-10-10T22:37:10.447513] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-10T22:37:10.449949] [INFO ] [MAIN ] Derivative Progress: 481/1823 symbols completed. CXH took 1.1s. Estimated remaining: 8m 36s. Rate: 156.0 symbols/min [2025-10-10T22:37:10.450682] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:10.477938] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:10.479777] [INFO ] [MAIN ] CXM: Generated 1820 derivative records from 48285 primary records. [2025-10-10T22:37:10.479938] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-10T22:37:10.506140] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:10.507988] [INFO ] [MAIN ] CXT: Generated 1820 derivative records from 31466 primary records. [2025-10-10T22:37:10.508408] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-10T22:37:10.539060] [DEBUG] [LOCAL ] CXT: Derivative data saved (1820 records). [2025-10-10T22:37:10.539608] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-10T22:37:10.542272] [INFO ] [MAIN ] Derivative Progress: 482/1823 symbols completed. CXT took 1.2s. Estimated remaining: 8m 35s. Rate: 156.2 symbols/min [2025-10-10T22:37:10.542895] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:10.544973] [DEBUG] [LOCAL ] CXM: Derivative data saved (1820 records). [2025-10-10T22:37:10.545072] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-10T22:37:10.547291] [INFO ] [MAIN ] Derivative Progress: 483/1823 symbols completed. CXM took 1.2s. Estimated remaining: 8m 34s. Rate: 156.6 symbols/min [2025-10-10T22:37:10.548222] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:10.561626] [DEBUG] [LOCAL ] CXW: Loaded 44569 existing records from primary storage. [2025-10-10T22:37:10.561805] [INFO ] [MAIN ] CXW: Loaded 44569 primary data records. [2025-10-10T22:37:10.880977] [DEBUG] [LOCAL ] CYD: Loaded 26901 existing records from primary storage. [2025-10-10T22:37:10.889722] [INFO ] [MAIN ] CYD: Loaded 26901 primary data records. [2025-10-10T22:37:10.989179] [DEBUG] [LOCAL ] CYH: Loaded 48319 existing records from primary storage. [2025-10-10T22:37:11.021364] [INFO ] [MAIN ] CYH: Loaded 48319 primary data records. [2025-10-10T22:37:11.619241] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:11.620552] [INFO ] [MAIN ] CXW: Generated 1820 derivative records from 44569 primary records. [2025-10-10T22:37:11.621371] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-10T22:37:11.645841] [DEBUG] [LOCAL ] CXW: Derivative data saved (1820 records). [2025-10-10T22:37:11.646962] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-10T22:37:11.651247] [INFO ] [MAIN ] Derivative Progress: 484/1823 symbols completed. CXW took 1.2s. Estimated remaining: 8m 35s. Rate: 155.9 symbols/min [2025-10-10T22:37:11.652464] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:11.666971] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:11.667840] [INFO ] [MAIN ] CYD: Generated 1820 derivative records from 26901 primary records. [2025-10-10T22:37:11.668027] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-10T22:37:11.702473] [DEBUG] [LOCAL ] CYD: Derivative data saved (1820 records). [2025-10-10T22:37:11.700346] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:11.706821] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-10-10T22:37:11.708906] [INFO ] [MAIN ] Derivative Progress: 485/1823 symbols completed. CYD took 1.2s. Estimated remaining: 8m 34s. Rate: 156.2 symbols/min [2025-10-10T22:37:11.709132] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:11.710521] [INFO ] [MAIN ] CYH: Generated 1820 derivative records from 48319 primary records. [2025-10-10T22:37:11.710724] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-10T22:37:11.750923] [DEBUG] [LOCAL ] DAC: Loaded 12754 existing records from primary storage. [2025-10-10T22:37:11.751342] [INFO ] [MAIN ] DAC: Loaded 12754 primary data records. [2025-10-10T22:37:11.804864] [DEBUG] [LOCAL ] CYH: Derivative data saved (1820 records). [2025-10-10T22:37:11.854049] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-10T22:37:11.855018] [DEBUG] [LOCAL ] D: Loaded 54427 existing records from primary storage. [2025-10-10T22:37:11.870221] [INFO ] [MAIN ] Derivative Progress: 486/1823 symbols completed. CYH took 1.3s. Estimated remaining: 8m 33s. Rate: 156.4 symbols/min [2025-10-10T22:37:11.873853] [INFO ] [MAIN ] D: Loaded 54427 primary data records. [2025-10-10T22:37:11.873554] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:12.431247] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:12.432713] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-10-10T22:37:12.434121] [INFO ] [MAIN ] DAL: Loaded 54533 primary data records. [2025-10-10T22:37:12.434029] [INFO ] [MAIN ] DAC: Generated 1820 derivative records from 12754 primary records. [2025-10-10T22:37:12.434760] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-10T22:37:12.573398] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:12.576302] [INFO ] [MAIN ] D: Generated 1820 derivative records from 54427 primary records. [2025-10-10T22:37:12.576736] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-10T22:37:12.583213] [DEBUG] [LOCAL ] DAC: Derivative data saved (1820 records). [2025-10-10T22:37:12.612277] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-10T22:37:12.632063] [INFO ] [MAIN ] Derivative Progress: 487/1823 symbols completed. DAC took 0.9s. Estimated remaining: 8m 34s. Rate: 156.1 symbols/min [2025-10-10T22:37:12.652323] [DEBUG] [LOCAL ] D: Derivative data saved (1820 records). [2025-10-10T22:37:12.641901] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:12.671052] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-10-10T22:37:12.673331] [INFO ] [MAIN ] Derivative Progress: 488/1823 symbols completed. D took 1.0s. Estimated remaining: 8m 32s. Rate: 156.4 symbols/min [2025-10-10T22:37:12.678948] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:12.824535] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:12.825322] [INFO ] [MAIN ] DAL: Generated 1820 derivative records from 54533 primary records. [2025-10-10T22:37:12.825502] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-10T22:37:12.855518] [DEBUG] [LOCAL ] DAL: Derivative data saved (1820 records). [2025-10-10T22:37:12.855739] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-10T22:37:12.858033] [INFO ] [MAIN ] Derivative Progress: 489/1823 symbols completed. DAL took 1.0s. Estimated remaining: 8m 31s. Rate: 156.5 symbols/min [2025-10-10T22:37:12.858271] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:12.889826] [DEBUG] [LOCAL ] DAN: Loaded 49881 existing records from primary storage. [2025-10-10T22:37:12.890228] [INFO ] [MAIN ] DAN: Loaded 49881 primary data records. [2025-10-10T22:37:13.017399] [DEBUG] [LOCAL ] DAR: Loaded 52630 existing records from primary storage. [2025-10-10T22:37:13.043790] [INFO ] [MAIN ] DAR: Loaded 52630 primary data records. [2025-10-10T22:37:13.336557] [DEBUG] [LOCAL ] DAVA: Loaded 42130 existing records from primary storage. [2025-10-10T22:37:13.348287] [INFO ] [MAIN ] DAVA: Loaded 42130 primary data records. [2025-10-10T22:37:13.897844] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:13.899244] [INFO ] [MAIN ] DAN: Generated 1820 derivative records from 49881 primary records. [2025-10-10T22:37:13.899346] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-10-10T22:37:13.933067] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:13.934125] [INFO ] [MAIN ] DAR: Generated 1820 derivative records from 52630 primary records. [2025-10-10T22:37:13.934461] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-10T22:37:13.950554] [DEBUG] [LOCAL ] DAN: Derivative data saved (1820 records). [2025-10-10T22:37:13.951881] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-10-10T22:37:13.954491] [INFO ] [MAIN ] Derivative Progress: 490/1823 symbols completed. DAN took 1.3s. Estimated remaining: 8m 33s. Rate: 156.0 symbols/min [2025-10-10T22:37:13.956237] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:13.960758] [DEBUG] [LOCAL ] DAR: Derivative data saved (1820 records). [2025-10-10T22:37:13.960863] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-10T22:37:13.962928] [INFO ] [MAIN ] Derivative Progress: 491/1823 symbols completed. DAR took 1.3s. Estimated remaining: 8m 31s. Rate: 156.3 symbols/min [2025-10-10T22:37:13.963216] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:13.976230] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:13.976883] [INFO ] [MAIN ] DAVA: Generated 1820 derivative records from 42130 primary records. [2025-10-10T22:37:13.976973] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-10T22:37:13.994461] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1820 records). [2025-10-10T22:37:13.994580] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-10T22:37:13.996780] [INFO ] [MAIN ] Derivative Progress: 492/1823 symbols completed. DAVA took 1.1s. Estimated remaining: 8m 30s. Rate: 156.6 symbols/min [2025-10-10T22:37:13.996976] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:14.070470] [DEBUG] [LOCAL ] DB: Loaded 53277 existing records from primary storage. [2025-10-10T22:37:14.071244] [INFO ] [MAIN ] DB: Loaded 53277 primary data records. [2025-10-10T22:37:14.145005] [DEBUG] [LOCAL ] DAY: Loaded 49936 existing records from primary storage. [2025-10-10T22:37:14.180183] [INFO ] [MAIN ] DAY: Loaded 49936 primary data records. [2025-10-10T22:37:14.391966] [DEBUG] [LOCAL ] DBI: Loaded 44863 existing records from primary storage. [2025-10-10T22:37:14.533030] [INFO ] [MAIN ] DBI: Loaded 44863 primary data records. [2025-10-10T22:37:15.060223] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:15.062326] [INFO ] [MAIN ] DB: Generated 1820 derivative records from 53277 primary records. [2025-10-10T22:37:15.062456] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-10T22:37:15.087872] [DEBUG] [LOCAL ] DB: Derivative data saved (1820 records). [2025-10-10T22:37:15.088433] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-10T22:37:15.091342] [INFO ] [MAIN ] Derivative Progress: 493/1823 symbols completed. DB took 1.1s. Estimated remaining: 8m 32s. Rate: 156.0 symbols/min [2025-10-10T22:37:15.106479] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:15.108733] [INFO ] [MAIN ] DAY: Generated 1820 derivative records from 49936 primary records. [2025-10-10T22:37:15.108912] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-10-10T22:37:15.121888] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:15.122697] [INFO ] [MAIN ] DBI: Generated 1820 derivative records from 44863 primary records. [2025-10-10T22:37:15.129857] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-10T22:37:15.151869] [DEBUG] [LOCAL ] DAY: Derivative data saved (1820 records). [2025-10-10T22:37:15.152356] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-10-10T22:37:15.154829] [INFO ] [MAIN ] Derivative Progress: 494/1823 symbols completed. DAY took 1.2s. Estimated remaining: 8m 30s. Rate: 156.2 symbols/min [2025-10-10T22:37:15.156773] [DEBUG] [LOCAL ] DBI: Derivative data saved (1820 records). [2025-10-10T22:37:15.156835] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-10T22:37:15.159693] [INFO ] [MAIN ] Derivative Progress: 495/1823 symbols completed. DBI took 1.2s. Estimated remaining: 8m 29s. Rate: 156.5 symbols/min [2025-10-10T22:37:15.160668] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:15.160572] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:15.160830] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:15.178972] [DEBUG] [LOCAL ] DCO: Loaded 14259 existing records from primary storage. [2025-10-10T22:37:15.179205] [INFO ] [MAIN ] DCO: Loaded 14259 primary data records. [2025-10-10T22:37:15.572337] [DEBUG] [LOCAL ] DCI: Loaded 37528 existing records from primary storage. [2025-10-10T22:37:15.587343] [DEBUG] [LOCAL ] DBRG: Loaded 50515 existing records from primary storage. [2025-10-10T22:37:15.587830] [INFO ] [MAIN ] DBRG: Loaded 50515 primary data records. [2025-10-10T22:37:15.588137] [INFO ] [MAIN ] DCI: Loaded 37528 primary data records. [2025-10-10T22:37:16.221753] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:16.223408] [INFO ] [MAIN ] DCO: Generated 1820 derivative records from 14259 primary records. [2025-10-10T22:37:16.223835] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-10T22:37:16.244406] [DEBUG] [LOCAL ] DCO: Derivative data saved (1820 records). [2025-10-10T22:37:16.246246] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-10-10T22:37:16.248783] [INFO ] [MAIN ] Derivative Progress: 496/1823 symbols completed. DCO took 1.1s. Estimated remaining: 8m 31s. Rate: 156.0 symbols/min [2025-10-10T22:37:16.249384] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:16.263755] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:16.264587] [INFO ] [MAIN ] DBRG: Generated 1820 derivative records from 50515 primary records. [2025-10-10T22:37:16.264822] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-10T22:37:16.295726] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:16.327221] [INFO ] [MAIN ] DCI: Generated 1820 derivative records from 37528 primary records. [2025-10-10T22:37:16.328605] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-10T22:37:16.329989] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1820 records). [2025-10-10T22:37:16.330612] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-10T22:37:16.333070] [INFO ] [MAIN ] Derivative Progress: 497/1823 symbols completed. DBRG took 1.2s. Estimated remaining: 8m 29s. Rate: 156.2 symbols/min [2025-10-10T22:37:16.333556] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:16.350042] [DEBUG] [LOCAL ] DCI: Derivative data saved (1820 records). [2025-10-10T22:37:16.350426] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-10-10T22:37:16.352894] [INFO ] [MAIN ] Derivative Progress: 498/1823 symbols completed. DCI took 1.2s. Estimated remaining: 8m 28s. Rate: 156.5 symbols/min [2025-10-10T22:37:16.353231] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:16.372383] [DEBUG] [LOCAL ] DDT: Loaded 2119 existing records from primary storage. [2025-10-10T22:37:16.372825] [INFO ] [MAIN ] DDT: Loaded 2119 primary data records. [2025-10-10T22:37:16.498632] [DEBUG] [LOCAL ] DD: Loaded 53623 existing records from primary storage. [2025-10-10T22:37:16.514849] [INFO ] [MAIN ] DD: Loaded 53623 primary data records. [2025-10-10T22:37:16.839139] [DEBUG] [LOCAL ] DDD: Loaded 51691 existing records from primary storage. [2025-10-10T22:37:16.865388] [INFO ] [MAIN ] DDD: Loaded 51691 primary data records. [2025-10-10T22:37:17.443563] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:17.444746] [INFO ] [MAIN ] DDT: Generated 1820 derivative records from 2119 primary records. [2025-10-10T22:37:17.445291] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-10-10T22:37:17.463252] [DEBUG] [LOCAL ] DDT: Derivative data saved (1820 records). [2025-10-10T22:37:17.464352] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-10-10T22:37:17.466408] [INFO ] [MAIN ] Derivative Progress: 499/1823 symbols completed. DDT took 1.1s. Estimated remaining: 8m 30s. Rate: 155.9 symbols/min [2025-10-10T22:37:17.467123] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:17.490336] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:37:17.491571] [INFO ] [MAIN ] DD: Generated 1819 derivative records from 53623 primary records. [2025-10-10T22:37:17.491733] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-10T22:37:17.529777] [DEBUG] [LOCAL ] DD: Derivative data saved (1819 records). [2025-10-10T22:37:17.530545] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-10T22:37:17.530272] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:17.534309] [INFO ] [MAIN ] Derivative Progress: 500/1823 symbols completed. DD took 1.3s. Estimated remaining: 8m 28s. Rate: 156.2 symbols/min [2025-10-10T22:37:17.535668] [INFO ] [MAIN ] DDD: Generated 1820 derivative records from 51691 primary records. [2025-10-10T22:37:17.536231] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-10T22:37:17.535999] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:17.565735] [DEBUG] [LOCAL ] DDD: Derivative data saved (1820 records). [2025-10-10T22:37:17.566025] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-10T22:37:17.568249] [INFO ] [MAIN ] Derivative Progress: 501/1823 symbols completed. DDD took 1.2s. Estimated remaining: 8m 27s. Rate: 156.5 symbols/min [2025-10-10T22:37:17.568462] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:17.589294] [DEBUG] [LOCAL ] DE: Loaded 48254 existing records from primary storage. [2025-10-10T22:37:17.589555] [INFO ] [MAIN ] DE: Loaded 48254 primary data records. [2025-10-10T22:37:17.725472] [DEBUG] [LOCAL ] DEC: Loaded 30887 existing records from primary storage. [2025-10-10T22:37:17.732479] [INFO ] [MAIN ] DEC: Loaded 30887 primary data records. [2025-10-10T22:37:17.829695] [DEBUG] [LOCAL ] DEA: Loaded 41091 existing records from primary storage. [2025-10-10T22:37:17.907949] [INFO ] [MAIN ] DEA: Loaded 41091 primary data records. [2025-10-10T22:37:18.625773] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:18.626899] [INFO ] [MAIN ] DE: Generated 1820 derivative records from 48254 primary records. [2025-10-10T22:37:18.627119] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-10T22:37:18.655394] [DEBUG] [LOCAL ] DE: Derivative data saved (1820 records). [2025-10-10T22:37:18.660523] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-10T22:37:18.660816] [DEBUG] [MAIN ] DEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:18.664777] [INFO ] [MAIN ] Derivative Progress: 502/1823 symbols completed. DE took 1.2s. Estimated remaining: 8m 28s. Rate: 155.9 symbols/min [2025-10-10T22:37:18.661755] [INFO ] [MAIN ] DEC: Generated 1820 derivative records from 30887 primary records. [2025-10-10T22:37:18.665084] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:18.665004] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-10-10T22:37:18.682473] [DEBUG] [LOCAL ] DEC: Derivative data saved (1820 records). [2025-10-10T22:37:18.682666] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-10-10T22:37:18.684912] [INFO ] [MAIN ] Derivative Progress: 503/1823 symbols completed. DEC took 1.1s. Estimated remaining: 8m 27s. Rate: 156.2 symbols/min [2025-10-10T22:37:18.685169] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:18.702764] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:18.703523] [INFO ] [MAIN ] DEA: Generated 1820 derivative records from 41091 primary records. [2025-10-10T22:37:18.703689] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-10-10T22:37:18.721271] [DEBUG] [LOCAL ] DEA: Derivative data saved (1820 records). [2025-10-10T22:37:18.721399] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-10-10T22:37:18.723476] [INFO ] [MAIN ] Derivative Progress: 504/1823 symbols completed. DEA took 1.2s. Estimated remaining: 8m 26s. Rate: 156.4 symbols/min [2025-10-10T22:37:18.737497] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:18.765872] [DEBUG] [LOCAL ] DEI: Loaded 49010 existing records from primary storage. [2025-10-10T22:37:18.766182] [INFO ] [MAIN ] DEI: Loaded 49010 primary data records. [2025-10-10T22:37:18.970245] [DEBUG] [LOCAL ] DFH: Loaded 32600 existing records from primary storage. [2025-10-10T22:37:18.990722] [INFO ] [MAIN ] DFH: Loaded 32600 primary data records. [2025-10-10T22:37:19.155797] [DEBUG] [LOCAL ] DELL: Loaded 54516 existing records from primary storage. [2025-10-10T22:37:19.195421] [INFO ] [MAIN ] DELL: Loaded 54516 primary data records. [2025-10-10T22:37:19.833704] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:19.835897] [INFO ] [MAIN ] DEI: Generated 1820 derivative records from 49010 primary records. [2025-10-10T22:37:19.836468] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-10T22:37:19.857338] [DEBUG] [LOCAL ] DEI: Derivative data saved (1820 records). [2025-10-10T22:37:19.857731] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-10-10T22:37:19.861270] [INFO ] [MAIN ] Derivative Progress: 505/1823 symbols completed. DEI took 1.2s. Estimated remaining: 8m 27s. Rate: 155.8 symbols/min [2025-10-10T22:37:19.861602] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:19.895821] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:19.896061] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:19.897245] [INFO ] [MAIN ] DFH: Generated 1820 derivative records from 32600 primary records. [2025-10-10T22:37:19.898126] [INFO ] [MAIN ] DELL: Generated 1820 derivative records from 54516 primary records. [2025-10-10T22:37:19.898235] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-10-10T22:37:19.898330] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-10-10T22:37:19.945497] [DEBUG] [LOCAL ] DFIN: Loaded 23143 existing records from primary storage. [2025-10-10T22:37:19.947534] [INFO ] [MAIN ] DFIN: Loaded 23143 primary data records. [2025-10-10T22:37:19.954208] [DEBUG] [LOCAL ] DELL: Derivative data saved (1820 records). [2025-10-10T22:37:19.962420] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-10-10T22:37:19.968380] [DEBUG] [LOCAL ] DFH: Derivative data saved (1820 records). [2025-10-10T22:37:19.988830] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-10-10T22:37:19.988702] [INFO ] [MAIN ] Derivative Progress: 506/1823 symbols completed. DELL took 1.3s. Estimated remaining: 8m 26s. Rate: 156.0 symbols/min [2025-10-10T22:37:20.004183] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:20.017953] [INFO ] [MAIN ] Derivative Progress: 507/1823 symbols completed. DFH took 1.3s. Estimated remaining: 8m 25s. Rate: 156.3 symbols/min [2025-10-10T22:37:20.033672] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:20.288389] [DEBUG] [LOCAL ] DHF: Loaded 21463 existing records from primary storage. [2025-10-10T22:37:20.288560] [INFO ] [MAIN ] DHF: Loaded 21463 primary data records. [2025-10-10T22:37:20.518264] [DEBUG] [LOCAL ] DHI: Loaded 54122 existing records from primary storage. [2025-10-10T22:37:20.641219] [INFO ] [MAIN ] DHI: Loaded 54122 primary data records. [2025-10-10T22:37:20.980361] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:20.982755] [INFO ] [MAIN ] DFIN: Generated 1820 derivative records from 23143 primary records. [2025-10-10T22:37:20.983073] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-10T22:37:21.007856] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1820 records). [2025-10-10T22:37:21.008516] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-10-10T22:37:21.024150] [INFO ] [MAIN ] Derivative Progress: 508/1823 symbols completed. DFIN took 1.2s. Estimated remaining: 8m 26s. Rate: 155.8 symbols/min [2025-10-10T22:37:21.025250] [DEBUG] [MAIN ] DHF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:21.027992] [INFO ] [MAIN ] DHF: Generated 1820 derivative records from 21463 primary records. [2025-10-10T22:37:21.028364] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-10T22:37:21.048184] [DEBUG] [LOCAL ] DHF: Derivative data saved (1820 records). [2025-10-10T22:37:21.050324] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-10-10T22:37:21.052682] [INFO ] [MAIN ] Derivative Progress: 509/1823 symbols completed. DHF took 1.0s. Estimated remaining: 8m 25s. Rate: 156.1 symbols/min [2025-10-10T22:37:21.066499] [DEBUG] [MAIN ] DHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:21.067320] [INFO ] [MAIN ] DHI: Generated 1820 derivative records from 54122 primary records. [2025-10-10T22:37:21.067390] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-10-10T22:37:21.083854] [DEBUG] [LOCAL ] DHI: Derivative data saved (1820 records). [2025-10-10T22:37:21.084023] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-10-10T22:37:21.087367] [INFO ] [MAIN ] Derivative Progress: 510/1823 symbols completed. DHI took 1.1s. Estimated remaining: 8m 24s. Rate: 156.4 symbols/min [2025-10-10T22:37:21.088194] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:21.088350] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:21.088450] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:21.104983] [DEBUG] [LOCAL ] DHX: Loaded 13393 existing records from primary storage. [2025-10-10T22:37:21.105238] [INFO ] [MAIN ] DHX: Loaded 13393 primary data records. [2025-10-10T22:37:21.475271] [DEBUG] [LOCAL ] DHT: Loaded 48622 existing records from primary storage. [2025-10-10T22:37:21.476592] [INFO ] [MAIN ] DHT: Loaded 48622 primary data records. [2025-10-10T22:37:21.498411] [DEBUG] [LOCAL ] DHR: Loaded 54151 existing records from primary storage. [2025-10-10T22:37:21.515089] [INFO ] [MAIN ] DHR: Loaded 54151 primary data records. [2025-10-10T22:37:22.156778] [DEBUG] [MAIN ] DHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:22.159192] [INFO ] [MAIN ] DHX: Generated 1820 derivative records from 13393 primary records. [2025-10-10T22:37:22.159607] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-10-10T22:37:22.195000] [DEBUG] [LOCAL ] DHX: Derivative data saved (1820 records). [2025-10-10T22:37:22.200754] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-10-10T22:37:22.204233] [INFO ] [MAIN ] Derivative Progress: 511/1823 symbols completed. DHX took 1.1s. Estimated remaining: 8m 25s. Rate: 155.8 symbols/min [2025-10-10T22:37:22.212574] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:22.213118] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:22.221002] [INFO ] [MAIN ] DHT: Generated 1820 derivative records from 48622 primary records. [2025-10-10T22:37:22.221338] [DEBUG] [MAIN ] DHR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:37:22.221700] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-10T22:37:22.222628] [INFO ] [MAIN ] DHR: Generated 1819 derivative records from 54151 primary records. [2025-10-10T22:37:22.223499] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-10-10T22:37:22.262553] [DEBUG] [LOCAL ] DHT: Derivative data saved (1820 records). [2025-10-10T22:37:22.268712] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-10-10T22:37:22.272393] [INFO ] [MAIN ] Derivative Progress: 512/1823 symbols completed. DHT took 1.2s. Estimated remaining: 8m 24s. Rate: 156.1 symbols/min [2025-10-10T22:37:22.273411] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:22.272832] [DEBUG] [LOCAL ] DIAX: Loaded 13282 existing records from primary storage. [2025-10-10T22:37:22.275297] [INFO ] [MAIN ] DIAX: Loaded 13282 primary data records. [2025-10-10T22:37:22.276320] [DEBUG] [LOCAL ] DHR: Derivative data saved (1819 records). [2025-10-10T22:37:22.276456] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-10-10T22:37:22.279285] [INFO ] [MAIN ] Derivative Progress: 513/1823 symbols completed. DHR took 1.2s. Estimated remaining: 8m 23s. Rate: 156.4 symbols/min [2025-10-10T22:37:22.279746] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:22.645290] [DEBUG] [LOCAL ] DIN: Loaded 37849 existing records from primary storage. [2025-10-10T22:37:22.646403] [INFO ] [MAIN ] DIN: Loaded 37849 primary data records. [2025-10-10T22:37:22.769698] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-10-10T22:37:22.776440] [INFO ] [MAIN ] DIS: Loaded 54568 primary data records. [2025-10-10T22:37:23.351089] [DEBUG] [MAIN ] DIAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:23.352318] [INFO ] [MAIN ] DIAX: Generated 1820 derivative records from 13282 primary records. [2025-10-10T22:37:23.352604] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-10T22:37:23.375575] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1820 records). [2025-10-10T22:37:23.376520] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-10T22:37:23.379962] [INFO ] [MAIN ] Derivative Progress: 514/1823 symbols completed. DIAX took 1.2s. Estimated remaining: 8m 24s. Rate: 155.8 symbols/min [2025-10-10T22:37:23.380393] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:23.400316] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:23.401193] [INFO ] [MAIN ] DIN: Generated 1820 derivative records from 37849 primary records. [2025-10-10T22:37:23.401466] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-10T22:37:23.419063] [DEBUG] [LOCAL ] DIN: Derivative data saved (1820 records). [2025-10-10T22:37:23.419240] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-10T22:37:23.421590] [INFO ] [MAIN ] Derivative Progress: 515/1823 symbols completed. DIN took 1.1s. Estimated remaining: 8m 23s. Rate: 156.1 symbols/min [2025-10-10T22:37:23.423753] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:23.438787] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:23.439601] [INFO ] [MAIN ] DIS: Generated 1820 derivative records from 54568 primary records. [2025-10-10T22:37:23.439796] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-10T22:37:23.456290] [DEBUG] [LOCAL ] DIS: Derivative data saved (1820 records). [2025-10-10T22:37:23.456500] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-10-10T22:37:23.458865] [INFO ] [MAIN ] Derivative Progress: 516/1823 symbols completed. DIS took 1.2s. Estimated remaining: 8m 22s. Rate: 156.3 symbols/min [2025-10-10T22:37:23.459017] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:23.486505] [DEBUG] [LOCAL ] DLNG: Loaded 6234 existing records from primary storage. [2025-10-10T22:37:23.486702] [INFO ] [MAIN ] DLNG: Loaded 6234 primary data records. [2025-10-10T22:37:23.637633] [DEBUG] [LOCAL ] DK: Loaded 50055 existing records from primary storage. [2025-10-10T22:37:23.672965] [INFO ] [MAIN ] DK: Loaded 50055 primary data records. [2025-10-10T22:37:23.880699] [DEBUG] [LOCAL ] DKS: Loaded 50431 existing records from primary storage. [2025-10-10T22:37:23.887298] [INFO ] [MAIN ] DKS: Loaded 50431 primary data records. [2025-10-10T22:37:24.570617] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:24.573396] [INFO ] [MAIN ] DLNG: Generated 1820 derivative records from 6234 primary records. [2025-10-10T22:37:24.573836] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-10T22:37:24.594026] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1820 records). [2025-10-10T22:37:24.595294] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-10T22:37:24.599273] [INFO ] [MAIN ] Derivative Progress: 517/1823 symbols completed. DLNG took 1.1s. Estimated remaining: 8m 23s. Rate: 155.8 symbols/min [2025-10-10T22:37:24.600180] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:24.615839] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:24.616949] [INFO ] [MAIN ] DKS: Generated 1820 derivative records from 50431 primary records. [2025-10-10T22:37:24.617308] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-10T22:37:24.640135] [DEBUG] [LOCAL ] DKS: Derivative data saved (1820 records). [2025-10-10T22:37:24.640620] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-10T22:37:24.643356] [INFO ] [MAIN ] Derivative Progress: 518/1823 symbols completed. DKS took 1.2s. Estimated remaining: 8m 22s. Rate: 156.0 symbols/min [2025-10-10T22:37:24.649849] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:24.666205] [DEBUG] [MAIN ] DK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:24.667420] [INFO ] [MAIN ] DK: Generated 1820 derivative records from 50055 primary records. [2025-10-10T22:37:24.667635] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-10T22:37:24.693887] [DEBUG] [LOCAL ] DK: Derivative data saved (1820 records). [2025-10-10T22:37:24.694199] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-10T22:37:24.711419] [INFO ] [MAIN ] Derivative Progress: 519/1823 symbols completed. DK took 1.3s. Estimated remaining: 8m 21s. Rate: 156.3 symbols/min [2025-10-10T22:37:24.711902] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:24.721762] [DEBUG] [LOCAL ] DLY: Loaded 20638 existing records from primary storage. [2025-10-10T22:37:24.723622] [INFO ] [MAIN ] DLY: Loaded 20638 primary data records. [2025-10-10T22:37:24.759249] [DEBUG] [LOCAL ] DMA: Loaded 4760 existing records from primary storage. [2025-10-10T22:37:24.794454] [INFO ] [MAIN ] DMA: Loaded 4760 primary data records. [2025-10-10T22:37:24.912528] [DEBUG] [LOCAL ] DLR: Loaded 51583 existing records from primary storage. [2025-10-10T22:37:24.936106] [INFO ] [MAIN ] DLR: Loaded 51583 primary data records. [2025-10-10T22:37:25.780348] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:25.780966] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:25.782136] [INFO ] [MAIN ] DLY: Generated 1820 derivative records from 20638 primary records. [2025-10-10T22:37:25.782603] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-10T22:37:25.785084] [INFO ] [MAIN ] DMA: Generated 1820 derivative records from 4760 primary records. [2025-10-10T22:37:25.787930] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-10T22:37:25.824438] [DEBUG] [LOCAL ] DLY: Derivative data saved (1820 records). [2025-10-10T22:37:25.827057] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-10-10T22:37:25.833602] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:25.829744] [INFO ] [MAIN ] Derivative Progress: 520/1823 symbols completed. DLY took 1.2s. Estimated remaining: 8m 22s. Rate: 155.7 symbols/min [2025-10-10T22:37:25.836867] [DEBUG] [LOCAL ] DMA: Derivative data saved (1820 records). [2025-10-10T22:37:25.838016] [INFO ] [MAIN ] DLR: Generated 1820 derivative records from 51583 primary records. [2025-10-10T22:37:25.838473] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-10T22:37:25.841667] [INFO ] [MAIN ] Derivative Progress: 521/1823 symbols completed. DMA took 1.1s. Estimated remaining: 8m 21s. Rate: 156.0 symbols/min [2025-10-10T22:37:25.838228] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:25.842246] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-10T22:37:25.841895] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:25.861579] [DEBUG] [LOCAL ] DLR: Derivative data saved (1820 records). [2025-10-10T22:37:25.861821] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-10T22:37:25.864109] [INFO ] [MAIN ] Derivative Progress: 522/1823 symbols completed. DLR took 1.3s. Estimated remaining: 8m 20s. Rate: 156.3 symbols/min [2025-10-10T22:37:25.871299] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:25.878015] [DEBUG] [LOCAL ] DMO: Loaded 10068 existing records from primary storage. [2025-10-10T22:37:25.885626] [INFO ] [MAIN ] DMO: Loaded 10068 primary data records. [2025-10-10T22:37:25.885507] [DEBUG] [LOCAL ] DMB: Loaded 10356 existing records from primary storage. [2025-10-10T22:37:25.909806] [INFO ] [MAIN ] DMB: Loaded 10356 primary data records. [2025-10-10T22:37:26.279782] [DEBUG] [LOCAL ] DNA: Loaded 49242 existing records from primary storage. [2025-10-10T22:37:26.348007] [INFO ] [MAIN ] DNA: Loaded 49242 primary data records. [2025-10-10T22:37:26.989536] [DEBUG] [MAIN ] DMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:26.992068] [INFO ] [MAIN ] DMB: Generated 1820 derivative records from 10356 primary records. [2025-10-10T22:37:26.992244] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-10-10T22:37:27.004875] [DEBUG] [MAIN ] DMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:27.006428] [INFO ] [MAIN ] DMO: Generated 1820 derivative records from 10068 primary records. [2025-10-10T22:37:27.006944] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-10T22:37:27.037280] [DEBUG] [LOCAL ] DMB: Derivative data saved (1820 records). [2025-10-10T22:37:27.037622] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-10-10T22:37:27.040108] [INFO ] [MAIN ] Derivative Progress: 523/1823 symbols completed. DMB took 1.2s. Estimated remaining: 8m 21s. Rate: 155.7 symbols/min [2025-10-10T22:37:27.061678] [DEBUG] [LOCAL ] DMO: Derivative data saved (1820 records). [2025-10-10T22:37:27.061808] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-10-10T22:37:27.064441] [INFO ] [MAIN ] Derivative Progress: 524/1823 symbols completed. DMO took 1.2s. Estimated remaining: 8m 20s. Rate: 155.9 symbols/min [2025-10-10T22:37:27.062293] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:27.065914] [INFO ] [MAIN ] DNA: Generated 1820 derivative records from 49242 primary records. [2025-10-10T22:37:27.065982] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-10T22:37:27.083597] [DEBUG] [LOCAL ] DNA: Derivative data saved (1820 records). [2025-10-10T22:37:27.083726] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-10-10T22:37:27.085966] [INFO ] [MAIN ] Derivative Progress: 525/1823 symbols completed. DNA took 1.2s. Estimated remaining: 8m 19s. Rate: 156.2 symbols/min [2025-10-10T22:37:27.086555] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:27.086711] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:27.086497] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:27.138980] [DEBUG] [LOCAL ] DNOW: Loaded 44295 existing records from primary storage. [2025-10-10T22:37:27.139234] [INFO ] [MAIN ] DNOW: Loaded 44295 primary data records. [2025-10-10T22:37:27.307814] [DEBUG] [LOCAL ] DNP: Loaded 33717 existing records from primary storage. [2025-10-10T22:37:27.316461] [INFO ] [MAIN ] DNP: Loaded 33717 primary data records. [2025-10-10T22:37:27.362814] [DEBUG] [LOCAL ] DOC: Loaded 54327 existing records from primary storage. [2025-10-10T22:37:27.398778] [INFO ] [MAIN ] DOC: Loaded 54327 primary data records. [2025-10-10T22:37:28.288301] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:28.290457] [INFO ] [MAIN ] DNOW: Generated 1820 derivative records from 44295 primary records. [2025-10-10T22:37:28.290714] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-10T22:37:28.323793] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:28.327808] [INFO ] [MAIN ] DNP: Generated 1820 derivative records from 33717 primary records. [2025-10-10T22:37:28.328602] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-10T22:37:28.345081] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1820 records). [2025-10-10T22:37:28.352494] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-10T22:37:28.356720] [INFO ] [MAIN ] Derivative Progress: 526/1823 symbols completed. DNOW took 1.3s. Estimated remaining: 8m 20s. Rate: 155.5 symbols/min [2025-10-10T22:37:28.360116] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:28.357218] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:28.362198] [INFO ] [MAIN ] DOC: Generated 1820 derivative records from 54327 primary records. [2025-10-10T22:37:28.362287] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-10T22:37:28.381239] [DEBUG] [LOCAL ] DNP: Derivative data saved (1820 records). [2025-10-10T22:37:28.382891] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-10T22:37:28.388948] [INFO ] [MAIN ] Derivative Progress: 527/1823 symbols completed. DNP took 1.3s. Estimated remaining: 8m 19s. Rate: 155.8 symbols/min [2025-10-10T22:37:28.389384] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:28.392939] [DEBUG] [LOCAL ] DOC: Derivative data saved (1820 records). [2025-10-10T22:37:28.393338] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-10T22:37:28.397918] [INFO ] [MAIN ] Derivative Progress: 528/1823 symbols completed. DOC took 1.3s. Estimated remaining: 8m 18s. Rate: 156.1 symbols/min [2025-10-10T22:37:28.398419] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:28.487547] [DEBUG] [LOCAL ] DOLE: Loaded 39510 existing records from primary storage. [2025-10-10T22:37:28.497052] [INFO ] [MAIN ] DOLE: Loaded 39510 primary data records. [2025-10-10T22:37:28.486846] [DEBUG] [LOCAL ] DOCN: Loaded 51555 existing records from primary storage. [2025-10-10T22:37:28.531295] [INFO ] [MAIN ] DOCN: Loaded 51555 primary data records. [2025-10-10T22:37:28.537507] [DEBUG] [LOCAL ] DOUG: Loaded 34887 existing records from primary storage. [2025-10-10T22:37:28.550298] [INFO ] [MAIN ] DOUG: Loaded 34887 primary data records. [2025-10-10T22:37:29.515403] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:29.529083] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:29.528525] [INFO ] [MAIN ] DOLE: Generated 1820 derivative records from 39510 primary records. [2025-10-10T22:37:29.529838] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-10T22:37:29.531396] [INFO ] [MAIN ] DOCN: Generated 1820 derivative records from 51555 primary records. [2025-10-10T22:37:29.530342] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:29.533681] [INFO ] [MAIN ] DOUG: Generated 1820 derivative records from 34887 primary records. [2025-10-10T22:37:29.532566] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-10T22:37:29.541259] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-10T22:37:29.581866] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1820 records). [2025-10-10T22:37:29.582240] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-10T22:37:29.584435] [INFO ] [MAIN ] Derivative Progress: 529/1823 symbols completed. DOUG took 1.2s. Estimated remaining: 8m 19s. Rate: 155.5 symbols/min [2025-10-10T22:37:29.586188] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:29.585303] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1820 records). [2025-10-10T22:37:29.587216] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-10T22:37:29.590838] [INFO ] [MAIN ] Derivative Progress: 530/1823 symbols completed. DOCN took 1.2s. Estimated remaining: 8m 18s. Rate: 155.8 symbols/min [2025-10-10T22:37:29.593171] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1820 records). [2025-10-10T22:37:29.593531] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-10-10T22:37:29.593389] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:29.595898] [INFO ] [MAIN ] Derivative Progress: 531/1823 symbols completed. DOLE took 1.2s. Estimated remaining: 8m 17s. Rate: 156.1 symbols/min [2025-10-10T22:37:29.596711] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:29.616349] [DEBUG] [LOCAL ] DPG: Loaded 13769 existing records from primary storage. [2025-10-10T22:37:29.616558] [INFO ] [MAIN ] DPG: Loaded 13769 primary data records. [2025-10-10T22:37:29.778292] [DEBUG] [LOCAL ] DOV: Loaded 46220 existing records from primary storage. [2025-10-10T22:37:29.810477] [INFO ] [MAIN ] DOV: Loaded 46220 primary data records. [2025-10-10T22:37:30.096992] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-10-10T22:37:30.102389] [INFO ] [MAIN ] DOW: Loaded 54513 primary data records. [2025-10-10T22:37:30.669836] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:30.672251] [INFO ] [MAIN ] DPG: Generated 1820 derivative records from 13769 primary records. [2025-10-10T22:37:30.672384] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-10T22:37:30.703877] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:30.706355] [INFO ] [MAIN ] DOV: Generated 1820 derivative records from 46220 primary records. [2025-10-10T22:37:30.707163] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-10T22:37:30.707256] [DEBUG] [LOCAL ] DPG: Derivative data saved (1820 records). [2025-10-10T22:37:30.708245] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-10T22:37:30.710688] [INFO ] [MAIN ] Derivative Progress: 532/1823 symbols completed. DPG took 1.1s. Estimated remaining: 8m 18s. Rate: 155.5 symbols/min [2025-10-10T22:37:30.710869] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:30.744122] [DEBUG] [LOCAL ] DOV: Derivative data saved (1820 records). [2025-10-10T22:37:30.744399] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-10T22:37:30.746446] [INFO ] [MAIN ] Derivative Progress: 533/1823 symbols completed. DOV took 1.2s. Estimated remaining: 8m 17s. Rate: 155.8 symbols/min [2025-10-10T22:37:30.747029] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:30.746940] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:30.748119] [INFO ] [MAIN ] DOW: Generated 1820 derivative records from 54513 primary records. [2025-10-10T22:37:30.748201] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-10T22:37:30.767508] [DEBUG] [LOCAL ] DOW: Derivative data saved (1820 records). [2025-10-10T22:37:30.767736] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-10T22:37:30.769933] [INFO ] [MAIN ] Derivative Progress: 534/1823 symbols completed. DOW took 1.2s. Estimated remaining: 8m 16s. Rate: 156.0 symbols/min [2025-10-10T22:37:30.770152] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:30.807087] [DEBUG] [LOCAL ] DRLL: Loaded 9406 existing records from primary storage. [2025-10-10T22:37:30.807282] [INFO ] [MAIN ] DRLL: Loaded 9406 primary data records. [2025-10-10T22:37:30.926730] [DEBUG] [LOCAL ] DRI: Loaded 48366 existing records from primary storage. [2025-10-10T22:37:30.938672] [DEBUG] [LOCAL ] DRD: Loaded 37897 existing records from primary storage. [2025-10-10T22:37:30.939174] [INFO ] [MAIN ] DRI: Loaded 48366 primary data records. [2025-10-10T22:37:30.949634] [INFO ] [MAIN ] DRD: Loaded 37897 primary data records. [2025-10-10T22:37:31.782312] [DEBUG] [MAIN ] DRLL: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:37:31.784397] [INFO ] [MAIN ] DRLL: Generated 1819 derivative records from 9406 primary records. [2025-10-10T22:37:31.784791] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-10-10T22:37:31.823634] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:31.838363] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1819 records). [2025-10-10T22:37:31.838774] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-10-10T22:37:31.840899] [INFO ] [MAIN ] Derivative Progress: 535/1823 symbols completed. DRLL took 1.1s. Estimated remaining: 8m 17s. Rate: 155.5 symbols/min [2025-10-10T22:37:31.841843] [INFO ] [MAIN ] DRD: Generated 1820 derivative records from 37897 primary records. [2025-10-10T22:37:31.842068] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:31.842214] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:31.842422] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-10T22:37:31.844371] [INFO ] [MAIN ] DRI: Generated 1820 derivative records from 48366 primary records. [2025-10-10T22:37:31.851682] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-10-10T22:37:31.869134] [DEBUG] [LOCAL ] DRD: Derivative data saved (1820 records). [2025-10-10T22:37:31.871826] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-10T22:37:31.874027] [INFO ] [MAIN ] Derivative Progress: 536/1823 symbols completed. DRD took 1.2s. Estimated remaining: 8m 16s. Rate: 155.8 symbols/min [2025-10-10T22:37:31.874631] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:31.879237] [DEBUG] [LOCAL ] DRI: Derivative data saved (1820 records). [2025-10-10T22:37:31.879389] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-10-10T22:37:31.882771] [INFO ] [MAIN ] Derivative Progress: 537/1823 symbols completed. DRI took 1.1s. Estimated remaining: 8m 14s. Rate: 156.1 symbols/min [2025-10-10T22:37:31.883217] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:31.887633] [DEBUG] [LOCAL ] DSMC: Loaded 1870 existing records from primary storage. [2025-10-10T22:37:31.891526] [INFO ] [MAIN ] DSMC: Loaded 1870 primary data records. [2025-10-10T22:37:31.981242] [DEBUG] [LOCAL ] DSM: Loaded 14743 existing records from primary storage. [2025-10-10T22:37:31.992860] [INFO ] [MAIN ] DSM: Loaded 14743 primary data records. [2025-10-10T22:37:32.022147] [DEBUG] [LOCAL ] DSL: Loaded 29051 existing records from primary storage. [2025-10-10T22:37:32.056640] [INFO ] [MAIN ] DSL: Loaded 29051 primary data records. [2025-10-10T22:37:32.919775] [DEBUG] [MAIN ] DSMC: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-10-10T22:37:32.921273] [INFO ] [MAIN ] DSMC: Generated 1817 derivative records from 1870 primary records. [2025-10-10T22:37:32.921522] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-10-10T22:37:32.935605] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:32.945605] [INFO ] [MAIN ] DSM: Generated 1820 derivative records from 14743 primary records. [2025-10-10T22:37:32.954168] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-10T22:37:32.959411] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1817 records). [2025-10-10T22:37:32.960419] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-10-10T22:37:32.969431] [INFO ] [MAIN ] Derivative Progress: 538/1823 symbols completed. DSMC took 1.1s. Estimated remaining: 8m 16s. Rate: 155.5 symbols/min [2025-10-10T22:37:32.990732] [DEBUG] [LOCAL ] DSM: Derivative data saved (1820 records). [2025-10-10T22:37:32.991425] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-10-10T22:37:32.993738] [INFO ] [MAIN ] Derivative Progress: 539/1823 symbols completed. DSM took 1.1s. Estimated remaining: 8m 14s. Rate: 155.8 symbols/min [2025-10-10T22:37:32.991343] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:32.994509] [INFO ] [MAIN ] DSL: Generated 1820 derivative records from 29051 primary records. [2025-10-10T22:37:32.994579] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-10T22:37:33.011762] [DEBUG] [LOCAL ] DSL: Derivative data saved (1820 records). [2025-10-10T22:37:33.011894] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-10-10T22:37:33.014423] [INFO ] [MAIN ] Derivative Progress: 540/1823 symbols completed. DSL took 1.2s. Estimated remaining: 8m 13s. Rate: 156.1 symbols/min [2025-10-10T22:37:33.014951] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:33.014896] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:33.015058] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:33.050049] [DEBUG] [LOCAL ] DSU: Loaded 23217 existing records from primary storage. [2025-10-10T22:37:33.050286] [INFO ] [MAIN ] DSU: Loaded 23217 primary data records. [2025-10-10T22:37:33.181199] [DEBUG] [LOCAL ] DSX: Loaded 24407 existing records from primary storage. [2025-10-10T22:37:33.181480] [INFO ] [MAIN ] DSX: Loaded 24407 primary data records. [2025-10-10T22:37:33.511380] [DEBUG] [LOCAL ] DT: Loaded 53704 existing records from primary storage. [2025-10-10T22:37:33.512078] [INFO ] [MAIN ] DT: Loaded 53704 primary data records. [2025-10-10T22:37:34.039376] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:34.040631] [INFO ] [MAIN ] DSU: Generated 1820 derivative records from 23217 primary records. [2025-10-10T22:37:34.041486] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-10T22:37:34.058459] [DEBUG] [LOCAL ] DSU: Derivative data saved (1820 records). [2025-10-10T22:37:34.058990] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-10T22:37:34.061872] [INFO ] [MAIN ] Derivative Progress: 541/1823 symbols completed. DSU took 1.0s. Estimated remaining: 8m 14s. Rate: 155.6 symbols/min [2025-10-10T22:37:34.062159] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:34.079773] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:34.080559] [INFO ] [MAIN ] DSX: Generated 1820 derivative records from 24407 primary records. [2025-10-10T22:37:34.080993] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-10T22:37:34.099220] [DEBUG] [LOCAL ] DSX: Derivative data saved (1820 records). [2025-10-10T22:37:34.099411] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-10-10T22:37:34.101809] [INFO ] [MAIN ] Derivative Progress: 542/1823 symbols completed. DSX took 1.1s. Estimated remaining: 8m 13s. Rate: 155.8 symbols/min [2025-10-10T22:37:34.102012] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:34.119401] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:34.120262] [INFO ] [MAIN ] DT: Generated 1820 derivative records from 53704 primary records. [2025-10-10T22:37:34.120332] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-10T22:37:34.138474] [DEBUG] [LOCAL ] DT: Derivative data saved (1820 records). [2025-10-10T22:37:34.138731] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-10-10T22:37:34.143216] [INFO ] [MAIN ] Derivative Progress: 543/1823 symbols completed. DT took 1.1s. Estimated remaining: 8m 12s. Rate: 156.1 symbols/min [2025-10-10T22:37:34.143714] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:34.153213] [DEBUG] [LOCAL ] DTG: Loaded 5919 existing records from primary storage. [2025-10-10T22:37:34.155252] [INFO ] [MAIN ] DTG: Loaded 5919 primary data records. [2025-10-10T22:37:34.240749] [DEBUG] [LOCAL ] DTW: Loaded 4937 existing records from primary storage. [2025-10-10T22:37:34.269143] [INFO ] [MAIN ] DTW: Loaded 4937 primary data records. [2025-10-10T22:37:34.433549] [DEBUG] [LOCAL ] DTE: Loaded 48226 existing records from primary storage. [2025-10-10T22:37:34.445923] [INFO ] [MAIN ] DTE: Loaded 48226 primary data records. [2025-10-10T22:37:35.180955] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:35.182214] [INFO ] [MAIN ] DTG: Generated 1820 derivative records from 5919 primary records. [2025-10-10T22:37:35.182572] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-10T22:37:35.211484] [DEBUG] [LOCAL ] DTG: Derivative data saved (1820 records). [2025-10-10T22:37:35.217045] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-10-10T22:37:35.220092] [INFO ] [MAIN ] Derivative Progress: 544/1823 symbols completed. DTG took 1.1s. Estimated remaining: 8m 13s. Rate: 155.6 symbols/min [2025-10-10T22:37:35.220738] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:35.217796] [DEBUG] [MAIN ] DTW: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:37:35.221973] [INFO ] [MAIN ] DTW: Generated 1819 derivative records from 4937 primary records. [2025-10-10T22:37:35.222565] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-10-10T22:37:35.242270] [DEBUG] [LOCAL ] DTW: Derivative data saved (1819 records). [2025-10-10T22:37:35.243575] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-10-10T22:37:35.248089] [INFO ] [MAIN ] Derivative Progress: 545/1823 symbols completed. DTW took 1.1s. Estimated remaining: 8m 12s. Rate: 155.9 symbols/min [2025-10-10T22:37:35.248686] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:35.262521] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:35.263312] [INFO ] [MAIN ] DTE: Generated 1820 derivative records from 48226 primary records. [2025-10-10T22:37:35.263415] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-10T22:37:35.281131] [DEBUG] [LOCAL ] DTE: Derivative data saved (1820 records). [2025-10-10T22:37:35.281211] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-10-10T22:37:35.283721] [INFO ] [MAIN ] Derivative Progress: 546/1823 symbols completed. DTE took 1.2s. Estimated remaining: 8m 11s. Rate: 156.1 symbols/min [2025-10-10T22:37:35.283866] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:35.336917] [DEBUG] [LOCAL ] DUK: Loaded 54219 existing records from primary storage. [2025-10-10T22:37:35.337074] [INFO ] [MAIN ] DUK: Loaded 54219 primary data records. [2025-10-10T22:37:35.496457] [DEBUG] [LOCAL ] DV: Loaded 52041 existing records from primary storage. [2025-10-10T22:37:35.523617] [INFO ] [MAIN ] DV: Loaded 52041 primary data records. [2025-10-10T22:37:35.731086] [DEBUG] [LOCAL ] DVA: Loaded 41566 existing records from primary storage. [2025-10-10T22:37:35.737066] [INFO ] [MAIN ] DVA: Loaded 41566 primary data records. [2025-10-10T22:37:36.453749] [DEBUG] [MAIN ] DUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:36.457036] [INFO ] [MAIN ] DUK: Generated 1820 derivative records from 54219 primary records. [2025-10-10T22:37:36.457465] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-10-10T22:37:36.476376] [DEBUG] [LOCAL ] DUK: Derivative data saved (1820 records). [2025-10-10T22:37:36.477295] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-10-10T22:37:36.479423] [INFO ] [MAIN ] Derivative Progress: 547/1823 symbols completed. DUK took 1.3s. Estimated remaining: 8m 12s. Rate: 155.5 symbols/min [2025-10-10T22:37:36.480916] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:36.508703] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:36.511384] [INFO ] [MAIN ] DV: Generated 1820 derivative records from 52041 primary records. [2025-10-10T22:37:36.513828] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-10T22:37:36.539523] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:36.543941] [INFO ] [MAIN ] DVA: Generated 1820 derivative records from 41566 primary records. [2025-10-10T22:37:36.544243] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-10T22:37:36.576673] [DEBUG] [LOCAL ] DV: Derivative data saved (1820 records). [2025-10-10T22:37:36.578814] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-10T22:37:36.583922] [INFO ] [MAIN ] Derivative Progress: 548/1823 symbols completed. DV took 1.3s. Estimated remaining: 8m 11s. Rate: 155.7 symbols/min [2025-10-10T22:37:36.584157] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:36.580326] [DEBUG] [LOCAL ] DVA: Derivative data saved (1820 records). [2025-10-10T22:37:36.584444] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-10T22:37:36.587575] [INFO ] [MAIN ] Derivative Progress: 549/1823 symbols completed. DVA took 1.3s. Estimated remaining: 8m 10s. Rate: 156.0 symbols/min [2025-10-10T22:37:36.587974] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:36.607638] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-10-10T22:37:36.607858] [INFO ] [MAIN ] DVN: Loaded 54479 primary data records. [2025-10-10T22:37:36.939283] [DEBUG] [LOCAL ] DXYZ: Loaded 37713 existing records from primary storage. [2025-10-10T22:37:36.940250] [INFO ] [MAIN ] DXYZ: Loaded 37713 primary data records. [2025-10-10T22:37:37.006542] [DEBUG] [LOCAL ] DXC: Loaded 50583 existing records from primary storage. [2025-10-10T22:37:37.020953] [INFO ] [MAIN ] DXC: Loaded 50583 primary data records. [2025-10-10T22:37:37.644001] [DEBUG] [MAIN ] DVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:37.645636] [INFO ] [MAIN ] DVN: Generated 1820 derivative records from 54479 primary records. [2025-10-10T22:37:37.646163] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-10-10T22:37:37.672168] [DEBUG] [LOCAL ] DVN: Derivative data saved (1820 records). [2025-10-10T22:37:37.672937] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-10-10T22:37:37.676391] [INFO ] [MAIN ] Derivative Progress: 550/1823 symbols completed. DVN took 1.2s. Estimated remaining: 8m 11s. Rate: 155.5 symbols/min [2025-10-10T22:37:37.677410] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:37.698377] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:37.707963] [INFO ] [MAIN ] DXC: Generated 1820 derivative records from 50583 primary records. [2025-10-10T22:37:37.713549] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-10T22:37:37.722793] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:37.725153] [INFO ] [MAIN ] DXYZ: Generated 1820 derivative records from 37713 primary records. [2025-10-10T22:37:37.725237] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-10T22:37:37.734748] [DEBUG] [LOCAL ] DXC: Derivative data saved (1820 records). [2025-10-10T22:37:37.757143] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-10-10T22:37:37.760091] [INFO ] [MAIN ] Derivative Progress: 551/1823 symbols completed. DXC took 1.2s. Estimated remaining: 8m 10s. Rate: 155.7 symbols/min [2025-10-10T22:37:37.760921] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:37.765929] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1820 records). [2025-10-10T22:37:37.766395] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-10T22:37:37.768621] [INFO ] [MAIN ] Derivative Progress: 552/1823 symbols completed. DXYZ took 1.2s. Estimated remaining: 8m 9s. Rate: 156.0 symbols/min [2025-10-10T22:37:37.768966] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:37.781807] [DEBUG] [LOCAL ] E: Loaded 33622 existing records from primary storage. [2025-10-10T22:37:37.783496] [INFO ] [MAIN ] E: Loaded 33622 primary data records. [2025-10-10T22:37:37.824999] [DEBUG] [LOCAL ] EAI: Loaded 4046 existing records from primary storage. [2025-10-10T22:37:37.845008] [INFO ] [MAIN ] EAI: Loaded 4046 primary data records. [2025-10-10T22:37:38.285603] [DEBUG] [LOCAL ] EAF: Loaded 42686 existing records from primary storage. [2025-10-10T22:37:38.306205] [INFO ] [MAIN ] EAF: Loaded 42686 primary data records. [2025-10-10T22:37:38.840077] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:38.841193] [INFO ] [MAIN ] E: Generated 1820 derivative records from 33622 primary records. [2025-10-10T22:37:38.842143] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-10T22:37:38.875100] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:38.876923] [INFO ] [MAIN ] EAI: Generated 1820 derivative records from 4046 primary records. [2025-10-10T22:37:38.876143] [DEBUG] [LOCAL ] E: Derivative data saved (1820 records). [2025-10-10T22:37:38.877426] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-10-10T22:37:38.877523] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-10-10T22:37:38.879766] [INFO ] [MAIN ] Derivative Progress: 553/1823 symbols completed. E took 1.2s. Estimated remaining: 8m 10s. Rate: 155.4 symbols/min [2025-10-10T22:37:38.910308] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:38.911821] [INFO ] [MAIN ] EAF: Generated 1820 derivative records from 42686 primary records. [2025-10-10T22:37:38.912152] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-10-10T22:37:38.928378] [DEBUG] [LOCAL ] EAI: Derivative data saved (1820 records). [2025-10-10T22:37:38.929061] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-10-10T22:37:38.933062] [INFO ] [MAIN ] Derivative Progress: 554/1823 symbols completed. EAI took 1.2s. Estimated remaining: 8m 9s. Rate: 155.7 symbols/min [2025-10-10T22:37:38.938346] [DEBUG] [LOCAL ] EAF: Derivative data saved (1820 records). [2025-10-10T22:37:38.938483] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-10-10T22:37:38.940847] [INFO ] [MAIN ] Derivative Progress: 555/1823 symbols completed. EAF took 1.2s. Estimated remaining: 8m 8s. Rate: 156.0 symbols/min [2025-10-10T22:37:38.941434] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:38.941355] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:38.941738] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:38.999298] [DEBUG] [LOCAL ] EARN: Loaded 29576 existing records from primary storage. [2025-10-10T22:37:39.013120] [INFO ] [MAIN ] EARN: Loaded 29576 primary data records. [2025-10-10T22:37:39.026585] [DEBUG] [LOCAL ] EB: Loaded 37311 existing records from primary storage. [2025-10-10T22:37:39.052742] [INFO ] [MAIN ] EB: Loaded 37311 primary data records. [2025-10-10T22:37:39.167361] [DEBUG] [LOCAL ] EAT: Loaded 50552 existing records from primary storage. [2025-10-10T22:37:39.189543] [INFO ] [MAIN ] EAT: Loaded 50552 primary data records. [2025-10-10T22:37:40.035740] [DEBUG] [MAIN ] EARN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:40.036958] [INFO ] [MAIN ] EARN: Generated 1820 derivative records from 29576 primary records. [2025-10-10T22:37:40.037164] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-10-10T22:37:40.074295] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:40.089415] [DEBUG] [LOCAL ] EARN: Derivative data saved (1820 records). [2025-10-10T22:37:40.090190] [DEBUG] [MAIN ] EAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:40.090307] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-10-10T22:37:40.093484] [INFO ] [MAIN ] Derivative Progress: 556/1823 symbols completed. EARN took 1.2s. Estimated remaining: 8m 9s. Rate: 155.4 symbols/min [2025-10-10T22:37:40.084595] [INFO ] [MAIN ] EB: Generated 1820 derivative records from 37311 primary records. [2025-10-10T22:37:40.093832] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-10-10T22:37:40.094622] [INFO ] [MAIN ] EAT: Generated 1820 derivative records from 50552 primary records. [2025-10-10T22:37:40.095799] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-10T22:37:40.095963] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:40.114553] [DEBUG] [LOCAL ] EB: Derivative data saved (1820 records). [2025-10-10T22:37:40.122213] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-10-10T22:37:40.126107] [INFO ] [MAIN ] Derivative Progress: 557/1823 symbols completed. EB took 1.2s. Estimated remaining: 8m 8s. Rate: 155.7 symbols/min [2025-10-10T22:37:40.131734] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:40.137228] [DEBUG] [LOCAL ] EAT: Derivative data saved (1820 records). [2025-10-10T22:37:40.137367] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-10T22:37:40.139937] [INFO ] [MAIN ] Derivative Progress: 558/1823 symbols completed. EAT took 1.2s. Estimated remaining: 8m 7s. Rate: 155.9 symbols/min [2025-10-10T22:37:40.140105] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:40.159603] [DEBUG] [LOCAL ] EBF: Loaded 19352 existing records from primary storage. [2025-10-10T22:37:40.159867] [INFO ] [MAIN ] EBF: Loaded 19352 primary data records. [2025-10-10T22:37:40.360719] [DEBUG] [LOCAL ] ECAT: Loaded 29861 existing records from primary storage. [2025-10-10T22:37:40.374453] [INFO ] [MAIN ] ECAT: Loaded 29861 primary data records. [2025-10-10T22:37:40.410975] [DEBUG] [LOCAL ] EBR: Loaded 43824 existing records from primary storage. [2025-10-10T22:37:40.547432] [INFO ] [MAIN ] EBR: Loaded 43824 primary data records. [2025-10-10T22:37:41.263354] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:41.266224] [INFO ] [MAIN ] EBF: Generated 1820 derivative records from 19352 primary records. [2025-10-10T22:37:41.266336] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-10-10T22:37:41.289290] [DEBUG] [LOCAL ] EBF: Derivative data saved (1820 records). [2025-10-10T22:37:41.289463] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-10-10T22:37:41.292152] [INFO ] [MAIN ] Derivative Progress: 559/1823 symbols completed. EBF took 1.2s. Estimated remaining: 8m 8s. Rate: 155.4 symbols/min [2025-10-10T22:37:41.292905] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:41.314570] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:41.315913] [INFO ] [MAIN ] ECAT: Generated 1820 derivative records from 29861 primary records. [2025-10-10T22:37:41.316105] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-10T22:37:41.330422] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:41.331708] [INFO ] [MAIN ] EBR: Generated 1820 derivative records from 43824 primary records. [2025-10-10T22:37:41.339697] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-10T22:37:41.350110] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1820 records). [2025-10-10T22:37:41.357862] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-10-10T22:37:41.363204] [INFO ] [MAIN ] Derivative Progress: 560/1823 symbols completed. ECAT took 1.2s. Estimated remaining: 8m 7s. Rate: 155.6 symbols/min [2025-10-10T22:37:41.368405] [DEBUG] [LOCAL ] EBR: Derivative data saved (1820 records). [2025-10-10T22:37:41.366041] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:41.380004] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-10T22:37:41.383163] [INFO ] [MAIN ] Derivative Progress: 561/1823 symbols completed. EBR took 1.3s. Estimated remaining: 8m 6s. Rate: 155.9 symbols/min [2025-10-10T22:37:41.383528] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:41.387490] [DEBUG] [LOCAL ] ECCU: Loaded 2271 existing records from primary storage. [2025-10-10T22:37:41.387846] [INFO ] [MAIN ] ECCU: Loaded 2271 primary data records. [2025-10-10T22:37:41.518092] [DEBUG] [LOCAL ] ECC: Loaded 43742 existing records from primary storage. [2025-10-10T22:37:41.521787] [INFO ] [MAIN ] ECC: Loaded 43742 primary data records. [2025-10-10T22:37:42.073833] [DEBUG] [LOCAL ] ECL: Loaded 47324 existing records from primary storage. [2025-10-10T22:37:42.074102] [INFO ] [MAIN ] ECL: Loaded 47324 primary data records. [2025-10-10T22:37:42.457535] [DEBUG] [MAIN ] ECCU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:42.458444] [INFO ] [MAIN ] ECCU: Generated 1820 derivative records from 2271 primary records. [2025-10-10T22:37:42.458792] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-10-10T22:37:42.496173] [DEBUG] [LOCAL ] ECCU: Derivative data saved (1820 records). [2025-10-10T22:37:42.496933] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:42.496544] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-10-10T22:37:42.499172] [INFO ] [MAIN ] Derivative Progress: 562/1823 symbols completed. ECCU took 1.1s. Estimated remaining: 8m 7s. Rate: 155.3 symbols/min [2025-10-10T22:37:42.500264] [INFO ] [MAIN ] ECC: Generated 1820 derivative records from 43742 primary records. [2025-10-10T22:37:42.500442] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-10T22:37:42.500576] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:42.522350] [DEBUG] [LOCAL ] ECC: Derivative data saved (1820 records). [2025-10-10T22:37:42.522565] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-10T22:37:42.527077] [INFO ] [MAIN ] Derivative Progress: 563/1823 symbols completed. ECC took 1.2s. Estimated remaining: 8m 6s. Rate: 155.6 symbols/min [2025-10-10T22:37:42.527459] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:42.544724] [DEBUG] [LOCAL ] ECO: Loaded 18639 existing records from primary storage. [2025-10-10T22:37:42.546046] [INFO ] [MAIN ] ECO: Loaded 18639 primary data records. [2025-10-10T22:37:42.650597] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:42.662436] [INFO ] [MAIN ] ECL: Generated 1820 derivative records from 47324 primary records. [2025-10-10T22:37:42.673850] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-10T22:37:42.911596] [DEBUG] [LOCAL ] ECL: Derivative data saved (1820 records). [2025-10-10T22:37:42.927689] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-10T22:37:42.931064] [INFO ] [MAIN ] Derivative Progress: 564/1823 symbols completed. ECL took 1.5s. Estimated remaining: 8m 6s. Rate: 155.6 symbols/min [2025-10-10T22:37:42.931485] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:42.957770] [DEBUG] [LOCAL ] ED: Loaded 53462 existing records from primary storage. [2025-10-10T22:37:42.958601] [INFO ] [MAIN ] ED: Loaded 53462 primary data records. [2025-10-10T22:37:43.105264] [DEBUG] [LOCAL ] EDD: Loaded 27263 existing records from primary storage. [2025-10-10T22:37:43.111167] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:43.116757] [INFO ] [MAIN ] EDD: Loaded 27263 primary data records. [2025-10-10T22:37:43.123022] [INFO ] [MAIN ] ECO: Generated 1820 derivative records from 18639 primary records. [2025-10-10T22:37:43.163347] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-10T22:37:43.422191] [DEBUG] [LOCAL ] ECO: Derivative data saved (1820 records). [2025-10-10T22:37:43.429199] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-10T22:37:43.440134] [INFO ] [MAIN ] Derivative Progress: 565/1823 symbols completed. ECO took 0.9s. Estimated remaining: 8m 5s. Rate: 155.5 symbols/min [2025-10-10T22:37:43.440596] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:43.680872] [DEBUG] [LOCAL ] EDF: Loaded 13415 existing records from primary storage. [2025-10-10T22:37:43.681032] [INFO ] [MAIN ] EDF: Loaded 13415 primary data records. [2025-10-10T22:37:44.003290] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:44.004548] [INFO ] [MAIN ] ED: Generated 1820 derivative records from 53462 primary records. [2025-10-10T22:37:44.004976] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-10T22:37:44.026597] [DEBUG] [LOCAL ] ED: Derivative data saved (1820 records). [2025-10-10T22:37:44.028140] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-10T22:37:44.031955] [INFO ] [MAIN ] Derivative Progress: 566/1823 symbols completed. ED took 1.5s. Estimated remaining: 8m 5s. Rate: 155.4 symbols/min [2025-10-10T22:37:44.032375] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:44.056018] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:44.063480] [INFO ] [MAIN ] EDD: Generated 1820 derivative records from 27263 primary records. [2025-10-10T22:37:44.063877] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-10T22:37:44.093080] [DEBUG] [LOCAL ] EDN: Loaded 18681 existing records from primary storage. [2025-10-10T22:37:44.102211] [INFO ] [MAIN ] EDN: Loaded 18681 primary data records. [2025-10-10T22:37:44.094052] [DEBUG] [LOCAL ] EDD: Derivative data saved (1820 records). [2025-10-10T22:37:44.135688] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-10T22:37:44.138581] [INFO ] [MAIN ] Derivative Progress: 567/1823 symbols completed. EDD took 1.2s. Estimated remaining: 8m 4s. Rate: 155.6 symbols/min [2025-10-10T22:37:44.121383] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:44.149524] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:44.150842] [INFO ] [MAIN ] EDF: Generated 1820 derivative records from 13415 primary records. [2025-10-10T22:37:44.180409] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-10T22:37:44.252062] [DEBUG] [LOCAL ] EDF: Derivative data saved (1820 records). [2025-10-10T22:37:44.252636] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-10T22:37:44.268927] [INFO ] [MAIN ] Derivative Progress: 568/1823 symbols completed. EDF took 0.8s. Estimated remaining: 8m 4s. Rate: 155.7 symbols/min [2025-10-10T22:37:44.509468] [DEBUG] [LOCAL ] EDU: Loaded 45535 existing records from primary storage. [2025-10-10T22:37:44.511120] [INFO ] [MAIN ] EDU: Loaded 45535 primary data records. [2025-10-10T22:37:44.862815] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:44.863460] [INFO ] [MAIN ] EDN: Generated 1820 derivative records from 18681 primary records. [2025-10-10T22:37:44.863521] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-10T22:37:44.882216] [DEBUG] [LOCAL ] EDN: Derivative data saved (1820 records). [2025-10-10T22:37:44.882403] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-10T22:37:44.884799] [INFO ] [MAIN ] Derivative Progress: 569/1823 symbols completed. EDN took 0.9s. Estimated remaining: 8m 4s. Rate: 155.6 symbols/min [2025-10-10T22:37:44.904238] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:44.904914] [INFO ] [MAIN ] EDU: Generated 1820 derivative records from 45535 primary records. [2025-10-10T22:37:44.905262] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-10T22:37:44.923823] [DEBUG] [LOCAL ] EDU: Derivative data saved (1820 records). [2025-10-10T22:37:44.923912] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-10T22:37:44.926248] [INFO ] [MAIN ] Derivative Progress: 570/1823 symbols completed. EDU took 0.8s. Estimated remaining: 8m 2s. Rate: 155.8 symbols/min [2025-10-10T22:37:44.927204] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:44.927368] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:44.927479] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:44.942216] [DEBUG] [LOCAL ] EEX: Loaded 10898 existing records from primary storage. [2025-10-10T22:37:44.942418] [INFO ] [MAIN ] EEX: Loaded 10898 primary data records. [2025-10-10T22:37:45.116205] [DEBUG] [LOCAL ] EE: Loaded 33445 existing records from primary storage. [2025-10-10T22:37:45.141128] [INFO ] [MAIN ] EE: Loaded 33445 primary data records. [2025-10-10T22:37:45.418523] [DEBUG] [LOCAL ] EFC: Loaded 47108 existing records from primary storage. [2025-10-10T22:37:45.447142] [INFO ] [MAIN ] EFC: Loaded 47108 primary data records. [2025-10-10T22:37:45.931623] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:45.933531] [INFO ] [MAIN ] EEX: Generated 1820 derivative records from 10898 primary records. [2025-10-10T22:37:45.934268] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-10T22:37:45.957147] [DEBUG] [LOCAL ] EEX: Derivative data saved (1820 records). [2025-10-10T22:37:45.957624] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-10T22:37:45.960163] [INFO ] [MAIN ] Derivative Progress: 571/1823 symbols completed. EEX took 1.0s. Estimated remaining: 8m 4s. Rate: 155.4 symbols/min [2025-10-10T22:37:45.960472] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:45.975203] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:45.976306] [INFO ] [MAIN ] EE: Generated 1820 derivative records from 33445 primary records. [2025-10-10T22:37:45.976614] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-10T22:37:45.993957] [DEBUG] [LOCAL ] EE: Derivative data saved (1820 records). [2025-10-10T22:37:45.998768] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-10T22:37:46.002769] [INFO ] [MAIN ] Derivative Progress: 572/1823 symbols completed. EE took 1.1s. Estimated remaining: 8m 2s. Rate: 155.6 symbols/min [2025-10-10T22:37:46.003184] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:46.022554] [DEBUG] [LOCAL ] EFR: Loaded 15218 existing records from primary storage. [2025-10-10T22:37:46.022249] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:46.023464] [INFO ] [MAIN ] EFR: Loaded 15218 primary data records. [2025-10-10T22:37:46.023387] [INFO ] [MAIN ] EFC: Generated 1820 derivative records from 47108 primary records. [2025-10-10T22:37:46.023591] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-10-10T22:37:46.141722] [DEBUG] [LOCAL ] EFC: Derivative data saved (1820 records). [2025-10-10T22:37:46.147529] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-10-10T22:37:46.155184] [INFO ] [MAIN ] Derivative Progress: 573/1823 symbols completed. EFC took 1.2s. Estimated remaining: 8m 2s. Rate: 155.8 symbols/min [2025-10-10T22:37:46.171113] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:46.381996] [DEBUG] [LOCAL ] EFXT: Loaded 29929 existing records from primary storage. [2025-10-10T22:37:46.383192] [INFO ] [MAIN ] EFXT: Loaded 29929 primary data records. [2025-10-10T22:37:46.384142] [DEBUG] [LOCAL ] EFX: Loaded 45270 existing records from primary storage. [2025-10-10T22:37:46.384698] [INFO ] [MAIN ] EFX: Loaded 45270 primary data records. [2025-10-10T22:37:46.923194] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:46.924686] [INFO ] [MAIN ] EFR: Generated 1820 derivative records from 15218 primary records. [2025-10-10T22:37:46.924848] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-10T22:37:47.068006] [DEBUG] [LOCAL ] EFR: Derivative data saved (1820 records). [2025-10-10T22:37:47.068490] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-10T22:37:47.071750] [INFO ] [MAIN ] Derivative Progress: 574/1823 symbols completed. EFR took 1.1s. Estimated remaining: 8m 2s. Rate: 155.4 symbols/min [2025-10-10T22:37:47.072125] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:47.108006] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:47.109968] [INFO ] [MAIN ] EFX: Generated 1820 derivative records from 45270 primary records. [2025-10-10T22:37:47.110132] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-10T22:37:47.146044] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:47.148384] [INFO ] [MAIN ] EFXT: Generated 1820 derivative records from 29929 primary records. [2025-10-10T22:37:47.151289] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-10T22:37:47.151410] [DEBUG] [LOCAL ] EFX: Derivative data saved (1820 records). [2025-10-10T22:37:47.152577] [DEBUG] [LOCAL ] EG: Loaded 28194 existing records from primary storage. [2025-10-10T22:37:47.153272] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-10-10T22:37:47.153166] [INFO ] [MAIN ] EG: Loaded 28194 primary data records. [2025-10-10T22:37:47.168547] [INFO ] [MAIN ] Derivative Progress: 575/1823 symbols completed. EFX took 1.2s. Estimated remaining: 8m 1s. Rate: 155.6 symbols/min [2025-10-10T22:37:47.201600] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:47.271404] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1820 records). [2025-10-10T22:37:47.286365] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-10T22:37:47.289234] [INFO ] [MAIN ] Derivative Progress: 576/1823 symbols completed. EFXT took 1.1s. Estimated remaining: 8m 0s. Rate: 155.8 symbols/min [2025-10-10T22:37:47.290088] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:47.577398] [DEBUG] [LOCAL ] EGP: Loaded 31009 existing records from primary storage. [2025-10-10T22:37:47.578484] [INFO ] [MAIN ] EGP: Loaded 31009 primary data records. [2025-10-10T22:37:47.623583] [DEBUG] [LOCAL ] EGO: Loaded 52453 existing records from primary storage. [2025-10-10T22:37:47.653189] [INFO ] [MAIN ] EGO: Loaded 52453 primary data records. [2025-10-10T22:37:48.014045] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:48.036347] [INFO ] [MAIN ] EG: Generated 1820 derivative records from 28194 primary records. [2025-10-10T22:37:48.063215] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-10T22:37:48.416952] [DEBUG] [LOCAL ] EG: Derivative data saved (1820 records). [2025-10-10T22:37:48.417294] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-10T22:37:48.419457] [INFO ] [MAIN ] Derivative Progress: 577/1823 symbols completed. EG took 1.3s. Estimated remaining: 8m 2s. Rate: 155.3 symbols/min [2025-10-10T22:37:48.419611] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:48.444868] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:48.445706] [INFO ] [MAIN ] EGP: Generated 1820 derivative records from 31009 primary records. [2025-10-10T22:37:48.445784] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-10T22:37:48.469331] [DEBUG] [LOCAL ] EGP: Derivative data saved (1820 records). [2025-10-10T22:37:48.482903] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-10T22:37:48.485557] [INFO ] [MAIN ] Derivative Progress: 578/1823 symbols completed. EGP took 1.2s. Estimated remaining: 8m 0s. Rate: 155.5 symbols/min [2025-10-10T22:37:48.486142] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:48.487117] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:48.500627] [INFO ] [MAIN ] EGO: Generated 1820 derivative records from 52453 primary records. [2025-10-10T22:37:48.500943] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-10T22:37:48.530915] [DEBUG] [LOCAL ] EGO: Derivative data saved (1820 records). [2025-10-10T22:37:48.531191] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-10T22:37:48.533297] [INFO ] [MAIN ] Derivative Progress: 579/1823 symbols completed. EGO took 1.3s. Estimated remaining: 7m 59s. Rate: 155.7 symbols/min [2025-10-10T22:37:48.533687] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:48.542141] [DEBUG] [LOCAL ] EGY: Loaded 42345 existing records from primary storage. [2025-10-10T22:37:48.542313] [INFO ] [MAIN ] EGY: Loaded 42345 primary data records. [2025-10-10T22:37:48.656478] [DEBUG] [LOCAL ] EHAB: Loaded 29667 existing records from primary storage. [2025-10-10T22:37:48.667146] [INFO ] [MAIN ] EHAB: Loaded 29667 primary data records. [2025-10-10T22:37:49.059596] [DEBUG] [LOCAL ] EHC: Loaded 41702 existing records from primary storage. [2025-10-10T22:37:49.111469] [INFO ] [MAIN ] EHC: Loaded 41702 primary data records. [2025-10-10T22:37:49.613021] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:49.614028] [INFO ] [MAIN ] EGY: Generated 1820 derivative records from 42345 primary records. [2025-10-10T22:37:49.614218] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-10T22:37:49.651526] [DEBUG] [MAIN ] EHAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:49.653498] [INFO ] [MAIN ] EHAB: Generated 1820 derivative records from 29667 primary records. [2025-10-10T22:37:49.653900] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-10T22:37:49.653610] [DEBUG] [LOCAL ] EGY: Derivative data saved (1820 records). [2025-10-10T22:37:49.656603] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-10T22:37:49.659365] [INFO ] [MAIN ] Derivative Progress: 580/1823 symbols completed. EGY took 1.2s. Estimated remaining: 8m 1s. Rate: 155.2 symbols/min [2025-10-10T22:37:49.666547] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:49.679096] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1820 records). [2025-10-10T22:37:49.679740] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-10T22:37:49.681764] [INFO ] [MAIN ] Derivative Progress: 581/1823 symbols completed. EHAB took 1.2s. Estimated remaining: 7m 59s. Rate: 155.5 symbols/min [2025-10-10T22:37:49.682007] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:49.694547] [DEBUG] [LOCAL ] EHI: Loaded 10815 existing records from primary storage. [2025-10-10T22:37:49.695452] [INFO ] [MAIN ] EHI: Loaded 10815 primary data records. [2025-10-10T22:37:49.753109] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:49.775843] [INFO ] [MAIN ] EHC: Generated 1820 derivative records from 41702 primary records. [2025-10-10T22:37:49.804213] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-10T22:37:49.870956] [DEBUG] [LOCAL ] EIC: Loaded 23309 existing records from primary storage. [2025-10-10T22:37:49.872452] [DEBUG] [LOCAL ] EHC: Derivative data saved (1820 records). [2025-10-10T22:37:49.883192] [INFO ] [MAIN ] EIC: Loaded 23309 primary data records. [2025-10-10T22:37:49.883767] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-10T22:37:49.942532] [INFO ] [MAIN ] Derivative Progress: 582/1823 symbols completed. EHC took 1.4s. Estimated remaining: 7m 59s. Rate: 155.5 symbols/min [2025-10-10T22:37:49.981309] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:50.408581] [DEBUG] [LOCAL ] EIG: Loaded 20468 existing records from primary storage. [2025-10-10T22:37:50.409296] [INFO ] [MAIN ] EIG: Loaded 20468 primary data records. [2025-10-10T22:37:50.564557] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:50.587216] [INFO ] [MAIN ] EHI: Generated 1820 derivative records from 10815 primary records. [2025-10-10T22:37:50.593499] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-10T22:37:50.766624] [DEBUG] [LOCAL ] EHI: Derivative data saved (1820 records). [2025-10-10T22:37:50.766944] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-10T22:37:50.770518] [INFO ] [MAIN ] Derivative Progress: 583/1823 symbols completed. EHI took 1.1s. Estimated remaining: 7m 59s. Rate: 155.2 symbols/min [2025-10-10T22:37:50.788373] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:50.789299] [INFO ] [MAIN ] EIC: Generated 1820 derivative records from 23309 primary records. [2025-10-10T22:37:50.790314] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-10T22:37:50.810187] [DEBUG] [LOCAL ] EIC: Derivative data saved (1820 records). [2025-10-10T22:37:50.810544] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-10T22:37:50.812625] [INFO ] [MAIN ] Derivative Progress: 584/1823 symbols completed. EIC took 1.1s. Estimated remaining: 7m 58s. Rate: 155.5 symbols/min [2025-10-10T22:37:50.828776] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:50.829513] [INFO ] [MAIN ] EIG: Generated 1820 derivative records from 20468 primary records. [2025-10-10T22:37:50.829577] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-10T22:37:50.848312] [DEBUG] [LOCAL ] EIG: Derivative data saved (1820 records). [2025-10-10T22:37:50.848480] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-10T22:37:50.850563] [INFO ] [MAIN ] Derivative Progress: 585/1823 symbols completed. EIG took 0.9s. Estimated remaining: 7m 57s. Rate: 155.7 symbols/min [2025-10-10T22:37:50.851168] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:50.851093] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:50.851796] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:50.933424] [DEBUG] [LOCAL ] EL: Loaded 54147 existing records from primary storage. [2025-10-10T22:37:50.933604] [INFO ] [MAIN ] EL: Loaded 54147 primary data records. [2025-10-10T22:37:51.020587] [DEBUG] [LOCAL ] ELAN: Loaded 54069 existing records from primary storage. [2025-10-10T22:37:51.046113] [INFO ] [MAIN ] ELAN: Loaded 54069 primary data records. [2025-10-10T22:37:51.105358] [DEBUG] [LOCAL ] EIX: Loaded 54125 existing records from primary storage. [2025-10-10T22:37:51.134862] [INFO ] [MAIN ] EIX: Loaded 54125 primary data records. [2025-10-10T22:37:51.988540] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:51.988287] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:51.989920] [INFO ] [MAIN ] ELAN: Generated 1820 derivative records from 54069 primary records. [2025-10-10T22:37:51.990133] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-10T22:37:51.989309] [INFO ] [MAIN ] EL: Generated 1820 derivative records from 54147 primary records. [2025-10-10T22:37:51.991625] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-10T22:37:52.033456] [DEBUG] [MAIN ] EIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:52.036055] [INFO ] [MAIN ] EIX: Generated 1820 derivative records from 54125 primary records. [2025-10-10T22:37:52.036363] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-10T22:37:52.052330] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1820 records). [2025-10-10T22:37:52.052166] [DEBUG] [LOCAL ] EL: Derivative data saved (1820 records). [2025-10-10T22:37:52.052964] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-10T22:37:52.052730] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-10T22:37:52.055071] [INFO ] [MAIN ] Derivative Progress: 586/1823 symbols completed. ELAN took 1.2s. Estimated remaining: 7m 58s. Rate: 155.1 symbols/min [2025-10-10T22:37:52.059099] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:52.059349] [INFO ] [MAIN ] Derivative Progress: 587/1823 symbols completed. EL took 1.2s. Estimated remaining: 7m 57s. Rate: 155.4 symbols/min [2025-10-10T22:37:52.063099] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:52.064854] [DEBUG] [LOCAL ] EIX: Derivative data saved (1820 records). [2025-10-10T22:37:52.064937] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-10T22:37:52.067195] [INFO ] [MAIN ] Derivative Progress: 588/1823 symbols completed. EIX took 1.2s. Estimated remaining: 7m 56s. Rate: 155.7 symbols/min [2025-10-10T22:37:52.067563] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:52.073190] [DEBUG] [LOCAL ] ELC: Loaded 3552 existing records from primary storage. [2025-10-10T22:37:52.073368] [INFO ] [MAIN ] ELC: Loaded 3552 primary data records. [2025-10-10T22:37:52.234142] [DEBUG] [LOCAL ] ELP: Loaded 25987 existing records from primary storage. [2025-10-10T22:37:52.267204] [INFO ] [MAIN ] ELP: Loaded 25987 primary data records. [2025-10-10T22:37:52.547313] [DEBUG] [LOCAL ] ELF: Loaded 52787 existing records from primary storage. [2025-10-10T22:37:52.574026] [INFO ] [MAIN ] ELF: Loaded 52787 primary data records. [2025-10-10T22:37:53.138840] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:53.141215] [INFO ] [MAIN ] ELC: Generated 1820 derivative records from 3552 primary records. [2025-10-10T22:37:53.142013] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-10T22:37:53.181808] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:53.183238] [INFO ] [MAIN ] ELP: Generated 1820 derivative records from 25987 primary records. [2025-10-10T22:37:53.181919] [DEBUG] [LOCAL ] ELC: Derivative data saved (1820 records). [2025-10-10T22:37:53.183496] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-10T22:37:53.183718] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-10T22:37:53.187085] [INFO ] [MAIN ] Derivative Progress: 589/1823 symbols completed. ELC took 1.1s. Estimated remaining: 7m 57s. Rate: 155.2 symbols/min [2025-10-10T22:37:53.187321] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:53.209211] [DEBUG] [LOCAL ] ELP: Derivative data saved (1820 records). [2025-10-10T22:37:53.209412] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-10-10T22:37:53.211760] [INFO ] [MAIN ] Derivative Progress: 590/1823 symbols completed. ELP took 1.1s. Estimated remaining: 7m 56s. Rate: 155.4 symbols/min [2025-10-10T22:37:53.224950] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:53.226002] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:53.226877] [INFO ] [MAIN ] ELF: Generated 1820 derivative records from 52787 primary records. [2025-10-10T22:37:53.227284] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-10T22:37:53.244359] [DEBUG] [LOCAL ] ELF: Derivative data saved (1820 records). [2025-10-10T22:37:53.244872] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-10T22:37:53.248126] [INFO ] [MAIN ] Derivative Progress: 591/1823 symbols completed. ELF took 1.2s. Estimated remaining: 7m 55s. Rate: 155.7 symbols/min [2025-10-10T22:37:53.248627] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:53.302231] [DEBUG] [LOCAL ] ELS: Loaded 50519 existing records from primary storage. [2025-10-10T22:37:53.302531] [INFO ] [MAIN ] ELS: Loaded 50519 primary data records. [2025-10-10T22:37:53.432225] [DEBUG] [LOCAL ] EMD: Loaded 21449 existing records from primary storage. [2025-10-10T22:37:53.443521] [INFO ] [MAIN ] EMD: Loaded 21449 primary data records. [2025-10-10T22:37:53.460097] [DEBUG] [LOCAL ] ELV: Loaded 51348 existing records from primary storage. [2025-10-10T22:37:53.500014] [INFO ] [MAIN ] ELV: Loaded 51348 primary data records. [2025-10-10T22:37:54.341262] [DEBUG] [MAIN ] ELS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:54.342172] [INFO ] [MAIN ] ELS: Generated 1820 derivative records from 50519 primary records. [2025-10-10T22:37:54.342407] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-10T22:37:54.364309] [DEBUG] [LOCAL ] ELS: Derivative data saved (1820 records). [2025-10-10T22:37:54.390153] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:54.390252] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-10-10T22:37:54.392784] [INFO ] [MAIN ] Derivative Progress: 592/1823 symbols completed. ELS took 1.2s. Estimated remaining: 7m 56s. Rate: 155.1 symbols/min [2025-10-10T22:37:54.389895] [DEBUG] [MAIN ] ELV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:54.393572] [INFO ] [MAIN ] ELV: Generated 1820 derivative records from 51348 primary records. [2025-10-10T22:37:54.390987] [INFO ] [MAIN ] EMD: Generated 1820 derivative records from 21449 primary records. [2025-10-10T22:37:54.393962] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-10-10T22:37:54.393847] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-10-10T22:37:54.393718] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:54.423856] [DEBUG] [LOCAL ] ELV: Derivative data saved (1820 records). [2025-10-10T22:37:54.424211] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-10-10T22:37:54.427232] [DEBUG] [LOCAL ] EMF: Loaded 3314 existing records from primary storage. [2025-10-10T22:37:54.429376] [INFO ] [MAIN ] Derivative Progress: 593/1823 symbols completed. ELV took 1.2s. Estimated remaining: 7m 55s. Rate: 155.4 symbols/min [2025-10-10T22:37:54.429588] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:54.429501] [INFO ] [MAIN ] EMF: Loaded 3314 primary data records. [2025-10-10T22:37:54.501863] [DEBUG] [LOCAL ] EMD: Derivative data saved (1820 records). [2025-10-10T22:37:54.513539] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-10-10T22:37:54.515725] [INFO ] [MAIN ] Derivative Progress: 594/1823 symbols completed. EMD took 1.3s. Estimated remaining: 7m 54s. Rate: 155.6 symbols/min [2025-10-10T22:37:54.530738] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:54.769964] [DEBUG] [LOCAL ] EMO: Loaded 13185 existing records from primary storage. [2025-10-10T22:37:54.770686] [INFO ] [MAIN ] EMO: Loaded 13185 primary data records. [2025-10-10T22:37:54.891301] [DEBUG] [LOCAL ] EMN: Loaded 51344 existing records from primary storage. [2025-10-10T22:37:54.902318] [INFO ] [MAIN ] EMN: Loaded 51344 primary data records. [2025-10-10T22:37:55.444372] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:55.446025] [INFO ] [MAIN ] EMF: Generated 1820 derivative records from 3314 primary records. [2025-10-10T22:37:55.446409] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-10T22:37:55.465533] [DEBUG] [LOCAL ] EMF: Derivative data saved (1820 records). [2025-10-10T22:37:55.467412] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-10T22:37:55.469557] [INFO ] [MAIN ] Derivative Progress: 595/1823 symbols completed. EMF took 1.1s. Estimated remaining: 7m 55s. Rate: 155.2 symbols/min [2025-10-10T22:37:55.470062] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:55.484098] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:55.487350] [INFO ] [MAIN ] EMO: Generated 1820 derivative records from 13185 primary records. [2025-10-10T22:37:55.487607] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-10T22:37:55.501375] [DEBUG] [LOCAL ] EMP: Loaded 3112 existing records from primary storage. [2025-10-10T22:37:55.516110] [INFO ] [MAIN ] EMP: Loaded 3112 primary data records. [2025-10-10T22:37:55.529924] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:55.551054] [INFO ] [MAIN ] EMN: Generated 1820 derivative records from 51344 primary records. [2025-10-10T22:37:55.551390] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-10T22:37:55.624227] [DEBUG] [LOCAL ] EMO: Derivative data saved (1820 records). [2025-10-10T22:37:55.624388] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-10T22:37:55.633406] [INFO ] [MAIN ] Derivative Progress: 596/1823 symbols completed. EMO took 1.1s. Estimated remaining: 7m 54s. Rate: 155.3 symbols/min [2025-10-10T22:37:55.641402] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:55.702945] [DEBUG] [LOCAL ] EMN: Derivative data saved (1820 records). [2025-10-10T22:37:55.730694] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-10T22:37:55.834955] [INFO ] [MAIN ] Derivative Progress: 597/1823 symbols completed. EMN took 1.4s. Estimated remaining: 7m 53s. Rate: 155.5 symbols/min [2025-10-10T22:37:55.840440] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:55.892170] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:55.892873] [INFO ] [MAIN ] EMP: Generated 1820 derivative records from 3112 primary records. [2025-10-10T22:37:55.892935] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-10T22:37:55.923172] [DEBUG] [LOCAL ] EMR: Loaded 53997 existing records from primary storage. [2025-10-10T22:37:55.924416] [DEBUG] [LOCAL ] EMP: Derivative data saved (1820 records). [2025-10-10T22:37:55.924498] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-10T22:37:55.926883] [INFO ] [MAIN ] Derivative Progress: 598/1823 symbols completed. EMP took 0.5s. Estimated remaining: 7m 52s. Rate: 155.7 symbols/min [2025-10-10T22:37:55.924570] [INFO ] [MAIN ] EMR: Loaded 53997 primary data records. [2025-10-10T22:37:56.103669] [DEBUG] [LOCAL ] ENB: Loaded 54289 existing records from primary storage. [2025-10-10T22:37:56.115204] [INFO ] [MAIN ] ENB: Loaded 54289 primary data records. [2025-10-10T22:37:56.623873] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:56.625374] [INFO ] [MAIN ] EMR: Generated 1820 derivative records from 53997 primary records. [2025-10-10T22:37:56.625468] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-10T22:37:56.642053] [DEBUG] [LOCAL ] EMR: Derivative data saved (1820 records). [2025-10-10T22:37:56.642141] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-10-10T22:37:56.643949] [INFO ] [MAIN ] Derivative Progress: 599/1823 symbols completed. EMR took 1.0s. Estimated remaining: 7m 52s. Rate: 155.4 symbols/min [2025-10-10T22:37:56.660311] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:56.660945] [INFO ] [MAIN ] ENB: Generated 1820 derivative records from 54289 primary records. [2025-10-10T22:37:56.661007] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-10T22:37:56.676852] [DEBUG] [LOCAL ] ENB: Derivative data saved (1820 records). [2025-10-10T22:37:56.676944] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-10T22:37:56.679498] [INFO ] [MAIN ] Derivative Progress: 600/1823 symbols completed. ENB took 0.8s. Estimated remaining: 7m 51s. Rate: 155.7 symbols/min [2025-10-10T22:37:56.679914] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:56.680133] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:56.680065] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:56.686833] [DEBUG] [LOCAL ] ENO: Loaded 1913 existing records from primary storage. [2025-10-10T22:37:56.687128] [INFO ] [MAIN ] ENO: Loaded 1913 primary data records. [2025-10-10T22:37:56.689896] [DEBUG] [LOCAL ] ENFY: Loaded 3344 existing records from primary storage. [2025-10-10T22:37:56.690111] [INFO ] [MAIN ] ENFY: Loaded 3344 primary data records. [2025-10-10T22:37:57.021246] [DEBUG] [LOCAL ] ENIC: Loaded 36820 existing records from primary storage. [2025-10-10T22:37:57.159701] [INFO ] [MAIN ] ENIC: Loaded 36820 primary data records. [2025-10-10T22:37:57.751066] [DEBUG] [MAIN ] ENO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:57.752753] [INFO ] [MAIN ] ENO: Generated 1820 derivative records from 1913 primary records. [2025-10-10T22:37:57.753975] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-10T22:37:57.784542] [DEBUG] [MAIN ] ENFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:57.787174] [INFO ] [MAIN ] ENFY: Generated 1820 derivative records from 3344 primary records. [2025-10-10T22:37:57.787310] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-10-10T22:37:57.788797] [DEBUG] [LOCAL ] ENO: Derivative data saved (1820 records). [2025-10-10T22:37:57.789392] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-10-10T22:37:57.791802] [INFO ] [MAIN ] Derivative Progress: 601/1823 symbols completed. ENO took 1.1s. Estimated remaining: 7m 52s. Rate: 155.2 symbols/min [2025-10-10T22:37:57.792264] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:57.806634] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1820 records). [2025-10-10T22:37:57.806833] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-10-10T22:37:57.809087] [INFO ] [MAIN ] Derivative Progress: 602/1823 symbols completed. ENFY took 1.1s. Estimated remaining: 7m 51s. Rate: 155.4 symbols/min [2025-10-10T22:37:57.809431] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:57.831321] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:57.832172] [INFO ] [MAIN ] ENIC: Generated 1820 derivative records from 36820 primary records. [2025-10-10T22:37:57.832338] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-10T22:37:57.848255] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1820 records). [2025-10-10T22:37:57.848349] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-10T22:37:57.850611] [INFO ] [MAIN ] Derivative Progress: 603/1823 symbols completed. ENIC took 1.2s. Estimated remaining: 7m 50s. Rate: 155.7 symbols/min [2025-10-10T22:37:57.854781] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:57.925147] [DEBUG] [LOCAL ] ENS: Loaded 29670 existing records from primary storage. [2025-10-10T22:37:57.925305] [INFO ] [MAIN ] ENS: Loaded 29670 primary data records. [2025-10-10T22:37:58.040511] [DEBUG] [LOCAL ] ENR: Loaded 43873 existing records from primary storage. [2025-10-10T22:37:58.054570] [INFO ] [MAIN ] ENR: Loaded 43873 primary data records. [2025-10-10T22:37:58.127273] [DEBUG] [LOCAL ] ENOV: Loaded 45382 existing records from primary storage. [2025-10-10T22:37:58.182181] [INFO ] [MAIN ] ENOV: Loaded 45382 primary data records. [2025-10-10T22:37:58.889608] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:58.890759] [INFO ] [MAIN ] ENS: Generated 1820 derivative records from 29670 primary records. [2025-10-10T22:37:58.891013] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-10-10T22:37:58.912552] [DEBUG] [LOCAL ] ENS: Derivative data saved (1820 records). [2025-10-10T22:37:58.913002] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-10-10T22:37:58.915338] [INFO ] [MAIN ] Derivative Progress: 604/1823 symbols completed. ENS took 1.1s. Estimated remaining: 7m 51s. Rate: 155.2 symbols/min [2025-10-10T22:37:58.915786] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:58.937423] [DEBUG] [MAIN ] ENR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:58.938738] [INFO ] [MAIN ] ENR: Generated 1820 derivative records from 43873 primary records. [2025-10-10T22:37:58.951707] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-10T22:37:58.952121] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:58.954461] [INFO ] [MAIN ] ENOV: Generated 1820 derivative records from 45382 primary records. [2025-10-10T22:37:58.954626] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-10-10T22:37:58.993010] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1820 records). [2025-10-10T22:37:59.003636] [DEBUG] [LOCAL ] ENVA: Loaded 25677 existing records from primary storage. [2025-10-10T22:37:59.003865] [INFO ] [MAIN ] ENVA: Loaded 25677 primary data records. [2025-10-10T22:37:59.002967] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-10-10T22:37:59.004502] [DEBUG] [LOCAL ] ENR: Derivative data saved (1820 records). [2025-10-10T22:37:59.027485] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-10T22:37:59.006875] [INFO ] [MAIN ] Derivative Progress: 605/1823 symbols completed. ENOV took 1.2s. Estimated remaining: 7m 50s. Rate: 155.4 symbols/min [2025-10-10T22:37:59.073762] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:59.073999] [INFO ] [MAIN ] Derivative Progress: 606/1823 symbols completed. ENR took 1.2s. Estimated remaining: 7m 49s. Rate: 155.6 symbols/min [2025-10-10T22:37:59.100996] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:37:59.342343] [DEBUG] [LOCAL ] EOD: Loaded 15098 existing records from primary storage. [2025-10-10T22:37:59.342552] [INFO ] [MAIN ] EOD: Loaded 15098 primary data records. [2025-10-10T22:37:59.708986] [DEBUG] [LOCAL ] EOG: Loaded 54124 existing records from primary storage. [2025-10-10T22:37:59.709903] [INFO ] [MAIN ] EOG: Loaded 54124 primary data records. [2025-10-10T22:37:59.799938] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:37:59.834917] [INFO ] [MAIN ] ENVA: Generated 1820 derivative records from 25677 primary records. [2025-10-10T22:37:59.848092] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-10T22:38:00.088523] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1820 records). [2025-10-10T22:38:00.089031] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-10T22:38:00.090956] [INFO ] [MAIN ] Derivative Progress: 607/1823 symbols completed. ENVA took 1.2s. Estimated remaining: 7m 50s. Rate: 155.2 symbols/min [2025-10-10T22:38:00.091379] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:00.109533] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:00.111025] [INFO ] [MAIN ] EOD: Generated 1820 derivative records from 15098 primary records. [2025-10-10T22:38:00.111402] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-10-10T22:38:00.134834] [DEBUG] [LOCAL ] EOD: Derivative data saved (1820 records). [2025-10-10T22:38:00.135026] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-10-10T22:38:00.138279] [INFO ] [MAIN ] Derivative Progress: 608/1823 symbols completed. EOD took 1.1s. Estimated remaining: 7m 49s. Rate: 155.4 symbols/min [2025-10-10T22:38:00.139080] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:00.146181] [DEBUG] [LOCAL ] EOI: Loaded 10972 existing records from primary storage. [2025-10-10T22:38:00.146561] [INFO ] [MAIN ] EOI: Loaded 10972 primary data records. [2025-10-10T22:38:00.335470] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:00.371782] [DEBUG] [LOCAL ] EOS: Loaded 15639 existing records from primary storage. [2025-10-10T22:38:00.373120] [INFO ] [MAIN ] EOG: Generated 1820 derivative records from 54124 primary records. [2025-10-10T22:38:00.373522] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-10T22:38:00.373674] [INFO ] [MAIN ] EOS: Loaded 15639 primary data records. [2025-10-10T22:38:00.632486] [DEBUG] [LOCAL ] EOG: Derivative data saved (1820 records). [2025-10-10T22:38:00.646002] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-10T22:38:00.665626] [INFO ] [MAIN ] Derivative Progress: 609/1823 symbols completed. EOG took 1.6s. Estimated remaining: 7m 49s. Rate: 155.3 symbols/min [2025-10-10T22:38:00.691252] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:00.863175] [DEBUG] [LOCAL ] EOT: Loaded 6907 existing records from primary storage. [2025-10-10T22:38:00.863684] [INFO ] [MAIN ] EOT: Loaded 6907 primary data records. [2025-10-10T22:38:00.998786] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:01.011987] [INFO ] [MAIN ] EOI: Generated 1820 derivative records from 10972 primary records. [2025-10-10T22:38:01.023141] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-10T22:38:01.344801] [DEBUG] [LOCAL ] EOI: Derivative data saved (1820 records). [2025-10-10T22:38:01.342664] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:01.346077] [INFO ] [MAIN ] EOS: Generated 1820 derivative records from 15639 primary records. [2025-10-10T22:38:01.346284] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-10T22:38:01.349376] [INFO ] [MAIN ] Derivative Progress: 610/1823 symbols completed. EOI took 1.3s. Estimated remaining: 7m 49s. Rate: 155.1 symbols/min [2025-10-10T22:38:01.346925] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-10T22:38:01.349572] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:01.370424] [DEBUG] [LOCAL ] EOS: Derivative data saved (1820 records). [2025-10-10T22:38:01.371680] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-10T22:38:01.374183] [INFO ] [MAIN ] Derivative Progress: 611/1823 symbols completed. EOS took 1.2s. Estimated remaining: 7m 48s. Rate: 155.4 symbols/min [2025-10-10T22:38:01.374364] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:01.400419] [DEBUG] [LOCAL ] EPAC: Loaded 27074 existing records from primary storage. [2025-10-10T22:38:01.400906] [INFO ] [MAIN ] EPAC: Loaded 27074 primary data records. [2025-10-10T22:38:01.443021] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:01.449151] [INFO ] [MAIN ] EOT: Generated 1820 derivative records from 6907 primary records. [2025-10-10T22:38:01.478412] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-10T22:38:01.659618] [DEBUG] [LOCAL ] EOT: Derivative data saved (1820 records). [2025-10-10T22:38:01.663515] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-10T22:38:01.667099] [INFO ] [MAIN ] Derivative Progress: 612/1823 symbols completed. EOT took 1.0s. Estimated remaining: 7m 47s. Rate: 155.4 symbols/min [2025-10-10T22:38:01.668389] [DEBUG] [LOCAL ] EPAM: Loaded 39938 existing records from primary storage. [2025-10-10T22:38:01.792830] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:01.793314] [INFO ] [MAIN ] EPAM: Loaded 39938 primary data records. [2025-10-10T22:38:02.128549] [DEBUG] [LOCAL ] EPC: Loaded 40337 existing records from primary storage. [2025-10-10T22:38:02.133792] [INFO ] [MAIN ] EPC: Loaded 40337 primary data records. [2025-10-10T22:38:02.227934] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:02.258514] [INFO ] [MAIN ] EPAC: Generated 1820 derivative records from 27074 primary records. [2025-10-10T22:38:02.259163] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-10T22:38:02.359168] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1820 records). [2025-10-10T22:38:02.476736] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-10T22:38:02.481027] [INFO ] [MAIN ] Derivative Progress: 613/1823 symbols completed. EPAC took 1.1s. Estimated remaining: 7m 48s. Rate: 155.2 symbols/min [2025-10-10T22:38:02.499416] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:02.500554] [INFO ] [MAIN ] EPAM: Generated 1820 derivative records from 39938 primary records. [2025-10-10T22:38:02.500625] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-10T22:38:02.523971] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1820 records). [2025-10-10T22:38:02.524121] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-10-10T22:38:02.527154] [INFO ] [MAIN ] Derivative Progress: 614/1823 symbols completed. EPAM took 1.2s. Estimated remaining: 7m 47s. Rate: 155.4 symbols/min [2025-10-10T22:38:02.547309] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:02.548201] [INFO ] [MAIN ] EPC: Generated 1820 derivative records from 40337 primary records. [2025-10-10T22:38:02.548268] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-10T22:38:02.565195] [DEBUG] [LOCAL ] EPC: Derivative data saved (1820 records). [2025-10-10T22:38:02.565314] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-10-10T22:38:02.568422] [INFO ] [MAIN ] Derivative Progress: 615/1823 symbols completed. EPC took 0.8s. Estimated remaining: 7m 46s. Rate: 155.6 symbols/min [2025-10-10T22:38:02.569173] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:02.569309] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:02.569035] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:02.640886] [DEBUG] [LOCAL ] EPR: Loaded 44579 existing records from primary storage. [2025-10-10T22:38:02.641041] [INFO ] [MAIN ] EPR: Loaded 44579 primary data records. [2025-10-10T22:38:02.764090] [DEBUG] [LOCAL ] EQH: Loaded 53424 existing records from primary storage. [2025-10-10T22:38:02.776770] [INFO ] [MAIN ] EQH: Loaded 53424 primary data records. [2025-10-10T22:38:02.826265] [DEBUG] [LOCAL ] EPRT: Loaded 49155 existing records from primary storage. [2025-10-10T22:38:02.848110] [INFO ] [MAIN ] EPRT: Loaded 49155 primary data records. [2025-10-10T22:38:03.708689] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:03.711171] [INFO ] [MAIN ] EPR: Generated 1820 derivative records from 44579 primary records. [2025-10-10T22:38:03.711374] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-10T22:38:03.738005] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:03.739254] [INFO ] [MAIN ] EQH: Generated 1820 derivative records from 53424 primary records. [2025-10-10T22:38:03.740414] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-10T22:38:03.757200] [DEBUG] [LOCAL ] EPR: Derivative data saved (1820 records). [2025-10-10T22:38:03.757465] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-10T22:38:03.759336] [INFO ] [MAIN ] Derivative Progress: 616/1823 symbols completed. EPR took 1.2s. Estimated remaining: 7m 47s. Rate: 155.1 symbols/min [2025-10-10T22:38:03.759845] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:03.776271] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:03.777885] [INFO ] [MAIN ] EPRT: Generated 1820 derivative records from 49155 primary records. [2025-10-10T22:38:03.778024] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-10T22:38:03.789979] [DEBUG] [LOCAL ] EQH: Derivative data saved (1820 records). [2025-10-10T22:38:03.794404] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-10T22:38:03.799698] [INFO ] [MAIN ] Derivative Progress: 617/1823 symbols completed. EQH took 1.2s. Estimated remaining: 7m 46s. Rate: 155.3 symbols/min [2025-10-10T22:38:03.800481] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:03.808090] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1820 records). [2025-10-10T22:38:03.809839] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-10T22:38:03.812888] [INFO ] [MAIN ] Derivative Progress: 618/1823 symbols completed. EPRT took 1.2s. Estimated remaining: 7m 45s. Rate: 155.6 symbols/min [2025-10-10T22:38:03.813352] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:03.839497] [DEBUG] [LOCAL ] EQV: Loaded 2727 existing records from primary storage. [2025-10-10T22:38:03.840449] [INFO ] [MAIN ] EQV: Loaded 2727 primary data records. [2025-10-10T22:38:03.942301] [DEBUG] [LOCAL ] EQR: Loaded 52374 existing records from primary storage. [2025-10-10T22:38:03.981701] [INFO ] [MAIN ] EQR: Loaded 52374 primary data records. [2025-10-10T22:38:04.162586] [DEBUG] [LOCAL ] EQT: Loaded 54462 existing records from primary storage. [2025-10-10T22:38:04.206496] [INFO ] [MAIN ] EQT: Loaded 54462 primary data records. [2025-10-10T22:38:04.928828] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:04.930796] [INFO ] [MAIN ] EQV: Generated 1820 derivative records from 2727 primary records. [2025-10-10T22:38:04.931164] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-10T22:38:04.950293] [DEBUG] [LOCAL ] EQV: Derivative data saved (1820 records). [2025-10-10T22:38:04.951677] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-10T22:38:04.955150] [INFO ] [MAIN ] Derivative Progress: 619/1823 symbols completed. EQV took 1.1s. Estimated remaining: 7m 46s. Rate: 155.1 symbols/min [2025-10-10T22:38:04.955409] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:04.970528] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:04.971886] [INFO ] [MAIN ] EQR: Generated 1820 derivative records from 52374 primary records. [2025-10-10T22:38:04.971983] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-10T22:38:04.993161] [DEBUG] [LOCAL ] EQR: Derivative data saved (1820 records). [2025-10-10T22:38:05.001189] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-10T22:38:05.008394] [INFO ] [MAIN ] Derivative Progress: 620/1823 symbols completed. EQR took 1.2s. Estimated remaining: 7m 45s. Rate: 155.3 symbols/min [2025-10-10T22:38:05.009371] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:05.009729] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:05.010781] [INFO ] [MAIN ] EQT: Generated 1820 derivative records from 54462 primary records. [2025-10-10T22:38:05.011734] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-10T22:38:05.042482] [DEBUG] [LOCAL ] EQT: Derivative data saved (1820 records). [2025-10-10T22:38:05.042554] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-10T22:38:05.044886] [INFO ] [MAIN ] Derivative Progress: 621/1823 symbols completed. EQT took 1.2s. Estimated remaining: 7m 44s. Rate: 155.5 symbols/min [2025-10-10T22:38:05.045123] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:05.062509] [DEBUG] [LOCAL ] ERJ: Loaded 51129 existing records from primary storage. [2025-10-10T22:38:05.062707] [INFO ] [MAIN ] ERJ: Loaded 51129 primary data records. [2025-10-10T22:38:05.443697] [DEBUG] [LOCAL ] ERO: Loaded 42268 existing records from primary storage. [2025-10-10T22:38:05.444470] [INFO ] [MAIN ] ERO: Loaded 42268 primary data records. [2025-10-10T22:38:05.551788] [DEBUG] [LOCAL ] ES: Loaded 53386 existing records from primary storage. [2025-10-10T22:38:05.571150] [INFO ] [MAIN ] ES: Loaded 53386 primary data records. [2025-10-10T22:38:06.112143] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:06.115556] [INFO ] [MAIN ] ERJ: Generated 1820 derivative records from 51129 primary records. [2025-10-10T22:38:06.116007] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-10T22:38:06.137027] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1820 records). [2025-10-10T22:38:06.137758] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-10T22:38:06.140284] [INFO ] [MAIN ] Derivative Progress: 622/1823 symbols completed. ERJ took 1.2s. Estimated remaining: 7m 45s. Rate: 155.0 symbols/min [2025-10-10T22:38:06.142122] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:06.159494] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:06.160868] [INFO ] [MAIN ] ERO: Generated 1820 derivative records from 42268 primary records. [2025-10-10T22:38:06.161087] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-10T22:38:06.180565] [DEBUG] [LOCAL ] ERO: Derivative data saved (1820 records). [2025-10-10T22:38:06.180802] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-10T22:38:06.182919] [INFO ] [MAIN ] Derivative Progress: 623/1823 symbols completed. ERO took 1.2s. Estimated remaining: 7m 44s. Rate: 155.3 symbols/min [2025-10-10T22:38:06.196214] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:06.196569] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:06.198230] [INFO ] [MAIN ] ES: Generated 1820 derivative records from 53386 primary records. [2025-10-10T22:38:06.205487] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-10T22:38:06.222480] [DEBUG] [LOCAL ] ES: Derivative data saved (1820 records). [2025-10-10T22:38:06.223275] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-10T22:38:06.237530] [INFO ] [MAIN ] Derivative Progress: 624/1823 symbols completed. ES took 1.2s. Estimated remaining: 7m 43s. Rate: 155.5 symbols/min [2025-10-10T22:38:06.237872] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:06.238956] [DEBUG] [LOCAL ] ESAB: Loaded 26416 existing records from primary storage. [2025-10-10T22:38:06.239177] [INFO ] [MAIN ] ESAB: Loaded 26416 primary data records. [2025-10-10T22:38:06.289050] [DEBUG] [LOCAL ] ESE: Loaded 16766 existing records from primary storage. [2025-10-10T22:38:06.317179] [INFO ] [MAIN ] ESE: Loaded 16766 primary data records. [2025-10-10T22:38:06.885316] [DEBUG] [LOCAL ] ESI: Loaded 51434 existing records from primary storage. [2025-10-10T22:38:06.886945] [INFO ] [MAIN ] ESI: Loaded 51434 primary data records. [2025-10-10T22:38:07.229681] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:07.236012] [INFO ] [MAIN ] ESE: Generated 1820 derivative records from 16766 primary records. [2025-10-10T22:38:07.236279] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-10T22:38:07.236631] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:07.238233] [INFO ] [MAIN ] ESAB: Generated 1820 derivative records from 26416 primary records. [2025-10-10T22:38:07.238813] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-10T22:38:07.272809] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1820 records). [2025-10-10T22:38:07.273424] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-10T22:38:07.276620] [INFO ] [MAIN ] Derivative Progress: 625/1823 symbols completed. ESAB took 1.1s. Estimated remaining: 7m 44s. Rate: 155.1 symbols/min [2025-10-10T22:38:07.277484] [DEBUG] [LOCAL ] ESE: Derivative data saved (1820 records). [2025-10-10T22:38:07.277808] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-10T22:38:07.280387] [INFO ] [MAIN ] Derivative Progress: 626/1823 symbols completed. ESE took 1.1s. Estimated remaining: 7m 42s. Rate: 155.3 symbols/min [2025-10-10T22:38:07.277614] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:07.282260] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:07.299668] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:07.300620] [INFO ] [MAIN ] ESI: Generated 1820 derivative records from 51434 primary records. [2025-10-10T22:38:07.300742] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-10T22:38:07.319225] [DEBUG] [LOCAL ] ESI: Derivative data saved (1820 records). [2025-10-10T22:38:07.319500] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-10T22:38:07.322144] [INFO ] [MAIN ] Derivative Progress: 627/1823 symbols completed. ESI took 1.1s. Estimated remaining: 7m 41s. Rate: 155.5 symbols/min [2025-10-10T22:38:07.322440] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:07.364219] [DEBUG] [LOCAL ] ESNT: Loaded 38858 existing records from primary storage. [2025-10-10T22:38:07.364472] [INFO ] [MAIN ] ESNT: Loaded 38858 primary data records. [2025-10-10T22:38:07.480861] [DEBUG] [LOCAL ] ESRT: Loaded 46989 existing records from primary storage. [2025-10-10T22:38:07.498779] [INFO ] [MAIN ] ESRT: Loaded 46989 primary data records. [2025-10-10T22:38:07.643570] [DEBUG] [LOCAL ] ESS: Loaded 30192 existing records from primary storage. [2025-10-10T22:38:07.663824] [INFO ] [MAIN ] ESS: Loaded 30192 primary data records. [2025-10-10T22:38:08.382281] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:08.383084] [INFO ] [MAIN ] ESNT: Generated 1820 derivative records from 38858 primary records. [2025-10-10T22:38:08.383380] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-10T22:38:08.408906] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1820 records). [2025-10-10T22:38:08.409364] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-10T22:38:08.412734] [INFO ] [MAIN ] Derivative Progress: 628/1823 symbols completed. ESNT took 1.1s. Estimated remaining: 7m 42s. Rate: 155.1 symbols/min [2025-10-10T22:38:08.427588] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:08.428569] [INFO ] [MAIN ] ESRT: Generated 1820 derivative records from 46989 primary records. [2025-10-10T22:38:08.441254] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:08.442083] [INFO ] [MAIN ] ESS: Generated 1820 derivative records from 30192 primary records. [2025-10-10T22:38:08.441383] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-10T22:38:08.442205] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-10T22:38:08.471043] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1820 records). [2025-10-10T22:38:08.471138] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-10T22:38:08.475417] [INFO ] [MAIN ] Derivative Progress: 629/1823 symbols completed. ESRT took 1.2s. Estimated remaining: 7m 41s. Rate: 155.3 symbols/min [2025-10-10T22:38:08.476789] [DEBUG] [LOCAL ] ESS: Derivative data saved (1820 records). [2025-10-10T22:38:08.476872] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-10T22:38:08.479069] [INFO ] [MAIN ] Derivative Progress: 630/1823 symbols completed. ESS took 1.2s. Estimated remaining: 7m 40s. Rate: 155.5 symbols/min [2025-10-10T22:38:08.479614] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:08.479742] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:08.480286] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:08.497762] [DEBUG] [LOCAL ] ETB: Loaded 12334 existing records from primary storage. [2025-10-10T22:38:08.497965] [INFO ] [MAIN ] ETB: Loaded 12334 primary data records. [2025-10-10T22:38:08.683090] [DEBUG] [LOCAL ] ESTC: Loaded 50869 existing records from primary storage. [2025-10-10T22:38:08.707203] [INFO ] [MAIN ] ESTC: Loaded 50869 primary data records. [2025-10-10T22:38:09.008328] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-10-10T22:38:09.038786] [INFO ] [MAIN ] ET: Loaded 54569 primary data records. [2025-10-10T22:38:09.582059] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:09.583442] [INFO ] [MAIN ] ETB: Generated 1820 derivative records from 12334 primary records. [2025-10-10T22:38:09.583551] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-10T22:38:09.617593] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:09.618293] [DEBUG] [LOCAL ] ETB: Derivative data saved (1820 records). [2025-10-10T22:38:09.619290] [INFO ] [MAIN ] ESTC: Generated 1820 derivative records from 50869 primary records. [2025-10-10T22:38:09.619530] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-10T22:38:09.621818] [INFO ] [MAIN ] Derivative Progress: 631/1823 symbols completed. ETB took 1.1s. Estimated remaining: 7m 41s. Rate: 155.0 symbols/min [2025-10-10T22:38:09.621899] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-10T22:38:09.622130] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:09.659998] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:09.661439] [INFO ] [MAIN ] ET: Generated 1820 derivative records from 54569 primary records. [2025-10-10T22:38:09.662105] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-10T22:38:09.682473] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1820 records). [2025-10-10T22:38:09.687249] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-10T22:38:09.691097] [INFO ] [MAIN ] Derivative Progress: 632/1823 symbols completed. ESTC took 1.2s. Estimated remaining: 7m 40s. Rate: 155.2 symbols/min [2025-10-10T22:38:09.692677] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:09.705586] [DEBUG] [LOCAL ] ETD: Loaded 27732 existing records from primary storage. [2025-10-10T22:38:09.706410] [DEBUG] [LOCAL ] ET: Derivative data saved (1820 records). [2025-10-10T22:38:09.706712] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-10T22:38:09.709028] [INFO ] [MAIN ] Derivative Progress: 633/1823 symbols completed. ET took 1.2s. Estimated remaining: 7m 39s. Rate: 155.5 symbols/min [2025-10-10T22:38:09.709213] [INFO ] [MAIN ] ETD: Loaded 27732 primary data records. [2025-10-10T22:38:09.709477] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:09.824525] [DEBUG] [LOCAL ] ETG: Loaded 16762 existing records from primary storage. [2025-10-10T22:38:09.831402] [INFO ] [MAIN ] ETG: Loaded 16762 primary data records. [2025-10-10T22:38:09.892823] [DEBUG] [LOCAL ] ETJ: Loaded 17190 existing records from primary storage. [2025-10-10T22:38:09.945674] [INFO ] [MAIN ] ETJ: Loaded 17190 primary data records. [2025-10-10T22:38:10.681371] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:10.682503] [INFO ] [MAIN ] ETD: Generated 1820 derivative records from 27732 primary records. [2025-10-10T22:38:10.682827] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-10T22:38:10.696917] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:10.709171] [INFO ] [MAIN ] ETG: Generated 1820 derivative records from 16762 primary records. [2025-10-10T22:38:10.715863] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-10T22:38:10.715602] [DEBUG] [LOCAL ] ETD: Derivative data saved (1820 records). [2025-10-10T22:38:10.716939] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-10T22:38:10.719206] [INFO ] [MAIN ] Derivative Progress: 634/1823 symbols completed. ETD took 1.1s. Estimated remaining: 7m 40s. Rate: 155.1 symbols/min [2025-10-10T22:38:10.734151] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:10.743846] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:10.748539] [INFO ] [MAIN ] ETJ: Generated 1820 derivative records from 17190 primary records. [2025-10-10T22:38:10.748755] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-10T22:38:10.749112] [DEBUG] [LOCAL ] ETG: Derivative data saved (1820 records). [2025-10-10T22:38:10.749747] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-10T22:38:10.752377] [INFO ] [MAIN ] Derivative Progress: 635/1823 symbols completed. ETG took 1.1s. Estimated remaining: 7m 39s. Rate: 155.3 symbols/min [2025-10-10T22:38:10.752882] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:10.771432] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1820 records). [2025-10-10T22:38:10.775172] [DEBUG] [LOCAL ] ETO: Loaded 6988 existing records from primary storage. [2025-10-10T22:38:10.775406] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-10T22:38:10.777973] [INFO ] [MAIN ] ETO: Loaded 6988 primary data records. [2025-10-10T22:38:10.777854] [INFO ] [MAIN ] Derivative Progress: 636/1823 symbols completed. ETJ took 1.1s. Estimated remaining: 7m 38s. Rate: 155.5 symbols/min [2025-10-10T22:38:10.790140] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:11.120089] [DEBUG] [LOCAL ] ETN: Loaded 53462 existing records from primary storage. [2025-10-10T22:38:11.120370] [INFO ] [MAIN ] ETN: Loaded 53462 primary data records. [2025-10-10T22:38:11.331538] [DEBUG] [LOCAL ] ETR: Loaded 53997 existing records from primary storage. [2025-10-10T22:38:11.335756] [INFO ] [MAIN ] ETR: Loaded 53997 primary data records. [2025-10-10T22:38:11.697763] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:11.831076] [INFO ] [MAIN ] ETO: Generated 1820 derivative records from 6988 primary records. [2025-10-10T22:38:11.831576] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-10T22:38:11.849111] [DEBUG] [LOCAL ] ETO: Derivative data saved (1820 records). [2025-10-10T22:38:11.849766] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-10T22:38:11.852491] [INFO ] [MAIN ] Derivative Progress: 637/1823 symbols completed. ETO took 1.1s. Estimated remaining: 7m 39s. Rate: 155.1 symbols/min [2025-10-10T22:38:11.853082] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:11.888026] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:11.888988] [INFO ] [MAIN ] ETN: Generated 1820 derivative records from 53462 primary records. [2025-10-10T22:38:11.889328] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-10T22:38:11.913118] [DEBUG] [LOCAL ] ETV: Loaded 22566 existing records from primary storage. [2025-10-10T22:38:11.913980] [INFO ] [MAIN ] ETV: Loaded 22566 primary data records. [2025-10-10T22:38:11.941156] [DEBUG] [LOCAL ] ETN: Derivative data saved (1820 records). [2025-10-10T22:38:11.950906] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-10T22:38:11.961019] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:11.969606] [INFO ] [MAIN ] Derivative Progress: 638/1823 symbols completed. ETN took 1.2s. Estimated remaining: 7m 38s. Rate: 155.3 symbols/min [2025-10-10T22:38:12.002803] [INFO ] [MAIN ] ETR: Generated 1820 derivative records from 53997 primary records. [2025-10-10T22:38:12.009736] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-10T22:38:12.009611] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:12.071477] [DEBUG] [LOCAL ] ETR: Derivative data saved (1820 records). [2025-10-10T22:38:12.071687] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-10T22:38:12.079216] [INFO ] [MAIN ] Derivative Progress: 639/1823 symbols completed. ETR took 1.3s. Estimated remaining: 7m 37s. Rate: 155.4 symbols/min [2025-10-10T22:38:12.084504] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:12.266133] [DEBUG] [LOCAL ] ETX: Loaded 5251 existing records from primary storage. [2025-10-10T22:38:12.266335] [INFO ] [MAIN ] ETX: Loaded 5251 primary data records. [2025-10-10T22:38:12.340796] [DEBUG] [LOCAL ] ETW: Loaded 25898 existing records from primary storage. [2025-10-10T22:38:12.346527] [INFO ] [MAIN ] ETW: Loaded 25898 primary data records. [2025-10-10T22:38:12.916695] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:12.918006] [INFO ] [MAIN ] ETV: Generated 1820 derivative records from 22566 primary records. [2025-10-10T22:38:12.919405] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-10T22:38:12.939026] [DEBUG] [LOCAL ] ETV: Derivative data saved (1820 records). [2025-10-10T22:38:12.939320] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-10T22:38:12.941574] [INFO ] [MAIN ] Derivative Progress: 640/1823 symbols completed. ETV took 1.1s. Estimated remaining: 7m 38s. Rate: 155.1 symbols/min [2025-10-10T22:38:12.942058] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:12.959932] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-10T22:38:12.963280] [INFO ] [MAIN ] ETX: Generated 1818 derivative records from 5251 primary records. [2025-10-10T22:38:12.963488] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-10T22:38:12.996800] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:12.997570] [DEBUG] [LOCAL ] ETX: Derivative data saved (1818 records). [2025-10-10T22:38:12.998366] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-10T22:38:12.998296] [INFO ] [MAIN ] ETW: Generated 1820 derivative records from 25898 primary records. [2025-10-10T22:38:13.007325] [INFO ] [MAIN ] Derivative Progress: 641/1823 symbols completed. ETX took 0.9s. Estimated remaining: 7m 37s. Rate: 155.3 symbols/min [2025-10-10T22:38:13.007472] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-10T22:38:13.009336] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:13.010525] [DEBUG] [LOCAL ] ETY: Loaded 23411 existing records from primary storage. [2025-10-10T22:38:13.019813] [INFO ] [MAIN ] ETY: Loaded 23411 primary data records. [2025-10-10T22:38:13.063591] [DEBUG] [LOCAL ] ETW: Derivative data saved (1820 records). [2025-10-10T22:38:13.091123] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-10T22:38:13.110013] [INFO ] [MAIN ] Derivative Progress: 642/1823 symbols completed. ETW took 1.1s. Estimated remaining: 7m 36s. Rate: 155.5 symbols/min [2025-10-10T22:38:13.120149] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:13.192366] [DEBUG] [LOCAL ] EVC: Loaded 18400 existing records from primary storage. [2025-10-10T22:38:13.218120] [INFO ] [MAIN ] EVC: Loaded 18400 primary data records. [2025-10-10T22:38:13.539996] [DEBUG] [LOCAL ] EVEX: Loaded 32070 existing records from primary storage. [2025-10-10T22:38:13.573271] [INFO ] [MAIN ] EVEX: Loaded 32070 primary data records. [2025-10-10T22:38:14.023329] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:14.024207] [INFO ] [MAIN ] ETY: Generated 1820 derivative records from 23411 primary records. [2025-10-10T22:38:14.024422] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-10T22:38:14.044932] [DEBUG] [LOCAL ] ETY: Derivative data saved (1820 records). [2025-10-10T22:38:14.045424] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-10-10T22:38:14.047747] [INFO ] [MAIN ] Derivative Progress: 643/1823 symbols completed. ETY took 1.1s. Estimated remaining: 7m 36s. Rate: 155.2 symbols/min [2025-10-10T22:38:14.066942] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:14.068704] [INFO ] [MAIN ] EVC: Generated 1820 derivative records from 18400 primary records. [2025-10-10T22:38:14.068831] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-10T22:38:14.084810] [DEBUG] [LOCAL ] EVC: Derivative data saved (1820 records). [2025-10-10T22:38:14.085029] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-10T22:38:14.087504] [INFO ] [MAIN ] Derivative Progress: 644/1823 symbols completed. EVC took 1.1s. Estimated remaining: 7m 35s. Rate: 155.4 symbols/min [2025-10-10T22:38:14.103897] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:14.104502] [INFO ] [MAIN ] EVEX: Generated 1820 derivative records from 32070 primary records. [2025-10-10T22:38:14.104561] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-10T22:38:14.120068] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1820 records). [2025-10-10T22:38:14.120129] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-10T22:38:14.122521] [INFO ] [MAIN ] Derivative Progress: 645/1823 symbols completed. EVEX took 1.0s. Estimated remaining: 7m 34s. Rate: 155.6 symbols/min [2025-10-10T22:38:14.123137] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:14.123246] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:14.123043] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:14.136403] [DEBUG] [LOCAL ] EVG: Loaded 6047 existing records from primary storage. [2025-10-10T22:38:14.136581] [INFO ] [MAIN ] EVG: Loaded 6047 primary data records. [2025-10-10T22:38:14.176873] [DEBUG] [LOCAL ] EVF: Loaded 10057 existing records from primary storage. [2025-10-10T22:38:14.194554] [INFO ] [MAIN ] EVF: Loaded 10057 primary data records. [2025-10-10T22:38:14.504069] [DEBUG] [LOCAL ] EVH: Loaded 50292 existing records from primary storage. [2025-10-10T22:38:14.575688] [INFO ] [MAIN ] EVH: Loaded 50292 primary data records. [2025-10-10T22:38:15.172899] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:15.174237] [INFO ] [MAIN ] EVF: Generated 1820 derivative records from 10057 primary records. [2025-10-10T22:38:15.173427] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:15.174362] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-10T22:38:15.176188] [INFO ] [MAIN ] EVG: Generated 1820 derivative records from 6047 primary records. [2025-10-10T22:38:15.177078] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-10T22:38:15.201242] [DEBUG] [LOCAL ] EVF: Derivative data saved (1820 records). [2025-10-10T22:38:15.201533] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-10T22:38:15.206455] [INFO ] [MAIN ] Derivative Progress: 646/1823 symbols completed. EVF took 1.1s. Estimated remaining: 7m 35s. Rate: 155.2 symbols/min [2025-10-10T22:38:15.207055] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:15.212606] [DEBUG] [LOCAL ] EVG: Derivative data saved (1820 records). [2025-10-10T22:38:15.212938] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-10T22:38:15.215216] [INFO ] [MAIN ] Derivative Progress: 647/1823 symbols completed. EVG took 1.1s. Estimated remaining: 7m 34s. Rate: 155.4 symbols/min [2025-10-10T22:38:15.215637] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:15.229477] [DEBUG] [LOCAL ] EVN: Loaded 11233 existing records from primary storage. [2025-10-10T22:38:15.229804] [INFO ] [MAIN ] EVN: Loaded 11233 primary data records. [2025-10-10T22:38:15.279075] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:15.318715] [INFO ] [MAIN ] EVH: Generated 1820 derivative records from 50292 primary records. [2025-10-10T22:38:15.329319] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-10T22:38:15.442255] [DEBUG] [LOCAL ] EVH: Derivative data saved (1820 records). [2025-10-10T22:38:15.493564] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-10T22:38:15.609365] [INFO ] [MAIN ] Derivative Progress: 648/1823 symbols completed. EVH took 1.5s. Estimated remaining: 7m 34s. Rate: 155.4 symbols/min [2025-10-10T22:38:15.610064] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:15.612205] [DEBUG] [LOCAL ] EVR: Loaded 35113 existing records from primary storage. [2025-10-10T22:38:15.612426] [INFO ] [MAIN ] EVR: Loaded 35113 primary data records. [2025-10-10T22:38:15.770058] [DEBUG] [LOCAL ] EVT: Loaded 17083 existing records from primary storage. [2025-10-10T22:38:15.778766] [INFO ] [MAIN ] EVT: Loaded 17083 primary data records. [2025-10-10T22:38:16.242200] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:16.244526] [INFO ] [MAIN ] EVN: Generated 1820 derivative records from 11233 primary records. [2025-10-10T22:38:16.245112] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-10T22:38:16.278952] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:16.280812] [INFO ] [MAIN ] EVR: Generated 1820 derivative records from 35113 primary records. [2025-10-10T22:38:16.280019] [DEBUG] [LOCAL ] EVN: Derivative data saved (1820 records). [2025-10-10T22:38:16.281267] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-10T22:38:16.281032] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-10T22:38:16.283692] [INFO ] [MAIN ] Derivative Progress: 649/1823 symbols completed. EVN took 1.1s. Estimated remaining: 7m 34s. Rate: 155.2 symbols/min [2025-10-10T22:38:16.283936] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:16.304824] [DEBUG] [LOCAL ] EVR: Derivative data saved (1820 records). [2025-10-10T22:38:16.305081] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-10T22:38:16.307313] [INFO ] [MAIN ] Derivative Progress: 650/1823 symbols completed. EVR took 1.1s. Estimated remaining: 7m 33s. Rate: 155.5 symbols/min [2025-10-10T22:38:16.307623] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:16.322187] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:16.322910] [INFO ] [MAIN ] EVT: Generated 1820 derivative records from 17083 primary records. [2025-10-10T22:38:16.323000] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-10T22:38:16.353821] [DEBUG] [LOCAL ] EVTC: Loaded 26811 existing records from primary storage. [2025-10-10T22:38:16.355983] [INFO ] [MAIN ] EVTC: Loaded 26811 primary data records. [2025-10-10T22:38:16.378004] [DEBUG] [LOCAL ] EVT: Derivative data saved (1820 records). [2025-10-10T22:38:16.400515] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-10T22:38:16.414894] [INFO ] [MAIN ] Derivative Progress: 651/1823 symbols completed. EVT took 0.8s. Estimated remaining: 7m 32s. Rate: 155.6 symbols/min [2025-10-10T22:38:16.444806] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:16.484156] [DEBUG] [LOCAL ] EVTL: Loaded 40001 existing records from primary storage. [2025-10-10T22:38:16.505369] [INFO ] [MAIN ] EVTL: Loaded 40001 primary data records. [2025-10-10T22:38:16.856507] [DEBUG] [LOCAL ] EVTR: Loaded 24696 existing records from primary storage. [2025-10-10T22:38:16.991097] [INFO ] [MAIN ] EVTR: Loaded 24696 primary data records. [2025-10-10T22:38:17.360862] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:17.363596] [INFO ] [MAIN ] EVTC: Generated 1820 derivative records from 26811 primary records. [2025-10-10T22:38:17.364427] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-10T22:38:17.388898] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1820 records). [2025-10-10T22:38:17.402116] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-10T22:38:17.404829] [INFO ] [MAIN ] Derivative Progress: 652/1823 symbols completed. EVTC took 1.1s. Estimated remaining: 7m 33s. Rate: 155.3 symbols/min [2025-10-10T22:38:17.405544] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:17.405210] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:17.407242] [INFO ] [MAIN ] EVTL: Generated 1820 derivative records from 40001 primary records. [2025-10-10T22:38:17.407426] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-10T22:38:17.441521] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:38:17.442078] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1820 records). [2025-10-10T22:38:17.445330] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-10T22:38:17.448021] [INFO ] [MAIN ] Derivative Progress: 653/1823 symbols completed. EVTL took 1.1s. Estimated remaining: 7m 32s. Rate: 155.5 symbols/min [2025-10-10T22:38:17.449053] [INFO ] [MAIN ] EVTR: Generated 1819 derivative records from 24696 primary records. [2025-10-10T22:38:17.449342] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:17.449254] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-10T22:38:17.481423] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1819 records). [2025-10-10T22:38:17.481704] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-10T22:38:17.484572] [INFO ] [MAIN ] Derivative Progress: 654/1823 symbols completed. EVTR took 1.0s. Estimated remaining: 7m 31s. Rate: 155.7 symbols/min [2025-10-10T22:38:17.484992] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:17.519124] [DEBUG] [LOCAL ] EW: Loaded 54178 existing records from primary storage. [2025-10-10T22:38:17.519356] [INFO ] [MAIN ] EW: Loaded 54178 primary data records. [2025-10-10T22:38:17.654063] [DEBUG] [LOCAL ] EXG: Loaded 34701 existing records from primary storage. [2025-10-10T22:38:17.676468] [INFO ] [MAIN ] EXG: Loaded 34701 primary data records. [2025-10-10T22:38:18.003219] [DEBUG] [LOCAL ] EXK: Loaded 53922 existing records from primary storage. [2025-10-10T22:38:18.009081] [INFO ] [MAIN ] EXK: Loaded 53922 primary data records. [2025-10-10T22:38:18.590919] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:18.593174] [INFO ] [MAIN ] EW: Generated 1820 derivative records from 54178 primary records. [2025-10-10T22:38:18.593333] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-10T22:38:18.613858] [DEBUG] [LOCAL ] EW: Derivative data saved (1820 records). [2025-10-10T22:38:18.615883] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-10T22:38:18.618604] [INFO ] [MAIN ] Derivative Progress: 655/1823 symbols completed. EW took 1.2s. Estimated remaining: 7m 31s. Rate: 155.2 symbols/min [2025-10-10T22:38:18.619285] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:18.638456] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:18.640145] [INFO ] [MAIN ] EXG: Generated 1820 derivative records from 34701 primary records. [2025-10-10T22:38:18.640325] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-10T22:38:18.670639] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:18.682023] [INFO ] [MAIN ] EXK: Generated 1820 derivative records from 53922 primary records. [2025-10-10T22:38:18.682161] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-10T22:38:18.681088] [DEBUG] [LOCAL ] EXG: Derivative data saved (1820 records). [2025-10-10T22:38:18.682990] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-10T22:38:18.685419] [INFO ] [MAIN ] Derivative Progress: 656/1823 symbols completed. EXG took 1.2s. Estimated remaining: 7m 31s. Rate: 155.4 symbols/min [2025-10-10T22:38:18.700088] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:18.716072] [DEBUG] [LOCAL ] EXP: Loaded 30076 existing records from primary storage. [2025-10-10T22:38:18.716341] [INFO ] [MAIN ] EXP: Loaded 30076 primary data records. [2025-10-10T22:38:18.715378] [DEBUG] [LOCAL ] EXK: Derivative data saved (1820 records). [2025-10-10T22:38:18.716608] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-10T22:38:18.752201] [INFO ] [MAIN ] Derivative Progress: 657/1823 symbols completed. EXK took 1.3s. Estimated remaining: 7m 30s. Rate: 155.6 symbols/min [2025-10-10T22:38:18.785445] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:19.061391] [DEBUG] [LOCAL ] EXPD: Loaded 48593 existing records from primary storage. [2025-10-10T22:38:19.062746] [INFO ] [MAIN ] EXPD: Loaded 48593 primary data records. [2025-10-10T22:38:19.180428] [DEBUG] [LOCAL ] EXR: Loaded 45888 existing records from primary storage. [2025-10-10T22:38:19.197188] [INFO ] [MAIN ] EXR: Loaded 45888 primary data records. [2025-10-10T22:38:19.530881] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:19.537073] [INFO ] [MAIN ] EXP: Generated 1820 derivative records from 30076 primary records. [2025-10-10T22:38:19.557090] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-10T22:38:19.760831] [DEBUG] [LOCAL ] EXP: Derivative data saved (1820 records). [2025-10-10T22:38:19.761973] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-10T22:38:19.764975] [INFO ] [MAIN ] Derivative Progress: 658/1823 symbols completed. EXP took 1.1s. Estimated remaining: 7m 30s. Rate: 155.2 symbols/min [2025-10-10T22:38:19.796416] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:19.797537] [INFO ] [MAIN ] EXPD: Generated 1820 derivative records from 48593 primary records. [2025-10-10T22:38:19.797753] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-10T22:38:19.817707] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1820 records). [2025-10-10T22:38:19.817833] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-10T22:38:19.820017] [INFO ] [MAIN ] Derivative Progress: 659/1823 symbols completed. EXPD took 1.1s. Estimated remaining: 7m 29s. Rate: 155.4 symbols/min [2025-10-10T22:38:19.832546] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:19.833359] [INFO ] [MAIN ] EXR: Generated 1820 derivative records from 45888 primary records. [2025-10-10T22:38:19.833423] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-10T22:38:19.848806] [DEBUG] [LOCAL ] EXR: Derivative data saved (1820 records). [2025-10-10T22:38:19.848864] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-10T22:38:19.851292] [INFO ] [MAIN ] Derivative Progress: 660/1823 symbols completed. EXR took 1.1s. Estimated remaining: 7m 28s. Rate: 155.6 symbols/min [2025-10-10T22:38:19.851816] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:19.851748] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:19.852356] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:19.907629] [DEBUG] [LOCAL ] FAF: Loaded 42098 existing records from primary storage. [2025-10-10T22:38:19.926387] [INFO ] [MAIN ] FAF: Loaded 42098 primary data records. [2025-10-10T22:38:19.984232] [DEBUG] [LOCAL ] FBIN: Loaded 51053 existing records from primary storage. [2025-10-10T22:38:20.043326] [INFO ] [MAIN ] FBIN: Loaded 51053 primary data records. [2025-10-10T22:38:20.171830] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-10-10T22:38:20.183410] [INFO ] [MAIN ] F: Loaded 54600 primary data records. [2025-10-10T22:38:20.874214] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:20.875093] [INFO ] [MAIN ] FAF: Generated 1820 derivative records from 42098 primary records. [2025-10-10T22:38:20.875351] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-10T22:38:20.905871] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:20.907725] [INFO ] [MAIN ] FBIN: Generated 1820 derivative records from 51053 primary records. [2025-10-10T22:38:20.908353] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-10T22:38:20.929778] [DEBUG] [LOCAL ] FAF: Derivative data saved (1820 records). [2025-10-10T22:38:20.933484] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:20.934241] [INFO ] [MAIN ] F: Generated 1820 derivative records from 54600 primary records. [2025-10-10T22:38:20.934817] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-10T22:38:20.934725] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-10T22:38:20.940779] [INFO ] [MAIN ] Derivative Progress: 661/1823 symbols completed. FAF took 1.1s. Estimated remaining: 7m 29s. Rate: 155.2 symbols/min [2025-10-10T22:38:20.948746] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1820 records). [2025-10-10T22:38:20.949704] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:20.952454] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-10T22:38:20.957216] [INFO ] [MAIN ] Derivative Progress: 662/1823 symbols completed. FBIN took 1.1s. Estimated remaining: 7m 28s. Rate: 155.4 symbols/min [2025-10-10T22:38:20.957391] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:20.959797] [DEBUG] [LOCAL ] F: Derivative data saved (1820 records). [2025-10-10T22:38:20.959982] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-10T22:38:20.962597] [INFO ] [MAIN ] Derivative Progress: 663/1823 symbols completed. F took 1.1s. Estimated remaining: 7m 27s. Rate: 155.7 symbols/min [2025-10-10T22:38:20.963000] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:20.988230] [DEBUG] [LOCAL ] FBK: Loaded 27187 existing records from primary storage. [2025-10-10T22:38:20.988449] [INFO ] [MAIN ] FBK: Loaded 27187 primary data records. [2025-10-10T22:38:21.208891] [DEBUG] [LOCAL ] FBP: Loaded 46453 existing records from primary storage. [2025-10-10T22:38:21.209500] [DEBUG] [LOCAL ] FBRT: Loaded 35702 existing records from primary storage. [2025-10-10T22:38:21.342599] [INFO ] [MAIN ] FBP: Loaded 46453 primary data records. [2025-10-10T22:38:21.356260] [INFO ] [MAIN ] FBRT: Loaded 35702 primary data records. [2025-10-10T22:38:22.006863] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:22.008301] [INFO ] [MAIN ] FBK: Generated 1820 derivative records from 27187 primary records. [2025-10-10T22:38:22.008762] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-10T22:38:22.025382] [DEBUG] [LOCAL ] FBK: Derivative data saved (1820 records). [2025-10-10T22:38:22.026096] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-10T22:38:22.028150] [INFO ] [MAIN ] Derivative Progress: 664/1823 symbols completed. FBK took 1.1s. Estimated remaining: 7m 28s. Rate: 155.3 symbols/min [2025-10-10T22:38:22.028521] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:22.048390] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:22.054433] [INFO ] [MAIN ] FBRT: Generated 1820 derivative records from 35702 primary records. [2025-10-10T22:38:22.054603] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-10T22:38:22.084885] [DEBUG] [LOCAL ] FC: Loaded 15309 existing records from primary storage. [2025-10-10T22:38:22.086073] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:22.088411] [INFO ] [MAIN ] FBP: Generated 1820 derivative records from 46453 primary records. [2025-10-10T22:38:22.088771] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-10T22:38:22.088503] [INFO ] [MAIN ] FC: Loaded 15309 primary data records. [2025-10-10T22:38:22.090665] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1820 records). [2025-10-10T22:38:22.129394] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-10T22:38:22.145630] [INFO ] [MAIN ] Derivative Progress: 665/1823 symbols completed. FBRT took 1.2s. Estimated remaining: 7m 27s. Rate: 155.4 symbols/min [2025-10-10T22:38:22.157527] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:22.210917] [DEBUG] [LOCAL ] FBP: Derivative data saved (1820 records). [2025-10-10T22:38:22.211076] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-10T22:38:22.218689] [INFO ] [MAIN ] Derivative Progress: 666/1823 symbols completed. FBP took 1.3s. Estimated remaining: 7m 26s. Rate: 155.6 symbols/min [2025-10-10T22:38:22.224078] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:22.433963] [DEBUG] [LOCAL ] FCN: Loaded 26406 existing records from primary storage. [2025-10-10T22:38:22.434177] [INFO ] [MAIN ] FCN: Loaded 26406 primary data records. [2025-10-10T22:38:22.556060] [DEBUG] [LOCAL ] FCF: Loaded 39746 existing records from primary storage. [2025-10-10T22:38:22.560075] [INFO ] [MAIN ] FCF: Loaded 39746 primary data records. [2025-10-10T22:38:22.892582] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:22.905539] [INFO ] [MAIN ] FC: Generated 1820 derivative records from 15309 primary records. [2025-10-10T22:38:22.921749] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-10T22:38:23.124158] [DEBUG] [LOCAL ] FC: Derivative data saved (1820 records). [2025-10-10T22:38:23.125279] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-10T22:38:23.127486] [INFO ] [MAIN ] Derivative Progress: 667/1823 symbols completed. FC took 1.1s. Estimated remaining: 7m 27s. Rate: 155.3 symbols/min [2025-10-10T22:38:23.127669] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:23.150471] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:23.151352] [INFO ] [MAIN ] FCN: Generated 1820 derivative records from 26406 primary records. [2025-10-10T22:38:23.151568] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-10T22:38:23.172252] [DEBUG] [LOCAL ] FCN: Derivative data saved (1820 records). [2025-10-10T22:38:23.181562] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-10T22:38:23.183919] [INFO ] [MAIN ] Derivative Progress: 668/1823 symbols completed. FCN took 1.0s. Estimated remaining: 7m 26s. Rate: 155.5 symbols/min [2025-10-10T22:38:23.184186] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:23.197977] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:23.198771] [INFO ] [MAIN ] FCF: Generated 1820 derivative records from 39746 primary records. [2025-10-10T22:38:23.198947] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-10T22:38:23.230176] [DEBUG] [LOCAL ] FCF: Derivative data saved (1820 records). [2025-10-10T22:38:23.230032] [DEBUG] [LOCAL ] FCPT: Loaded 37878 existing records from primary storage. [2025-10-10T22:38:23.230327] [INFO ] [MAIN ] FCPT: Loaded 37878 primary data records. [2025-10-10T22:38:23.230446] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-10T22:38:23.232899] [INFO ] [MAIN ] Derivative Progress: 669/1823 symbols completed. FCF took 1.1s. Estimated remaining: 7m 25s. Rate: 155.7 symbols/min [2025-10-10T22:38:23.244625] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:23.269988] [DEBUG] [LOCAL ] FCT: Loaded 14947 existing records from primary storage. [2025-10-10T22:38:23.308397] [INFO ] [MAIN ] FCT: Loaded 14947 primary data records. [2025-10-10T22:38:23.901924] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-10-10T22:38:23.902279] [INFO ] [MAIN ] FCX: Loaded 54480 primary data records. [2025-10-10T22:38:24.232627] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:24.252497] [INFO ] [MAIN ] FCPT: Generated 1820 derivative records from 37878 primary records. [2025-10-10T22:38:24.255615] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-10T22:38:24.255494] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:24.257986] [INFO ] [MAIN ] FCT: Generated 1820 derivative records from 14947 primary records. [2025-10-10T22:38:24.258262] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-10T22:38:24.304367] [DEBUG] [LOCAL ] FCT: Derivative data saved (1820 records). [2025-10-10T22:38:24.305694] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-10T22:38:24.308841] [INFO ] [MAIN ] Derivative Progress: 670/1823 symbols completed. FCT took 1.1s. Estimated remaining: 7m 25s. Rate: 155.3 symbols/min [2025-10-10T22:38:24.305521] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1820 records). [2025-10-10T22:38:24.309343] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-10T22:38:24.309176] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:24.313704] [INFO ] [MAIN ] Derivative Progress: 671/1823 symbols completed. FCPT took 1.2s. Estimated remaining: 7m 24s. Rate: 155.5 symbols/min [2025-10-10T22:38:24.316509] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:24.332440] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:24.333321] [INFO ] [MAIN ] FCX: Generated 1820 derivative records from 54480 primary records. [2025-10-10T22:38:24.333430] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-10T22:38:24.358954] [DEBUG] [LOCAL ] FCX: Derivative data saved (1820 records). [2025-10-10T22:38:24.359220] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-10T22:38:24.361814] [INFO ] [MAIN ] Derivative Progress: 672/1823 symbols completed. FCX took 1.1s. Estimated remaining: 7m 23s. Rate: 155.7 symbols/min [2025-10-10T22:38:24.362154] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:24.382326] [DEBUG] [LOCAL ] FDS: Loaded 27620 existing records from primary storage. [2025-10-10T22:38:24.382475] [INFO ] [MAIN ] FDS: Loaded 27620 primary data records. [2025-10-10T22:38:24.482587] [DEBUG] [LOCAL ] FDP: Loaded 30435 existing records from primary storage. [2025-10-10T22:38:24.497424] [INFO ] [MAIN ] FDP: Loaded 30435 primary data records. [2025-10-10T22:38:25.039765] [DEBUG] [LOCAL ] FDX: Loaded 52203 existing records from primary storage. [2025-10-10T22:38:25.043190] [INFO ] [MAIN ] FDX: Loaded 52203 primary data records. [2025-10-10T22:38:25.269551] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:25.270901] [INFO ] [MAIN ] FDS: Generated 1820 derivative records from 27620 primary records. [2025-10-10T22:38:25.464374] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-10T22:38:25.503005] [DEBUG] [LOCAL ] FDS: Derivative data saved (1820 records). [2025-10-10T22:38:25.511016] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-10T22:38:25.513147] [INFO ] [MAIN ] Derivative Progress: 673/1823 symbols completed. FDS took 1.2s. Estimated remaining: 7m 24s. Rate: 155.3 symbols/min [2025-10-10T22:38:25.519404] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:25.520305] [INFO ] [MAIN ] FDP: Generated 1820 derivative records from 30435 primary records. [2025-10-10T22:38:25.520435] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-10T22:38:25.539308] [DEBUG] [LOCAL ] FDP: Derivative data saved (1820 records). [2025-10-10T22:38:25.539624] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-10T22:38:25.542061] [INFO ] [MAIN ] Derivative Progress: 674/1823 symbols completed. FDP took 1.2s. Estimated remaining: 7m 23s. Rate: 155.5 symbols/min [2025-10-10T22:38:25.557909] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:25.558504] [INFO ] [MAIN ] FDX: Generated 1820 derivative records from 52203 primary records. [2025-10-10T22:38:25.558567] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-10T22:38:25.574324] [DEBUG] [LOCAL ] FDX: Derivative data saved (1820 records). [2025-10-10T22:38:25.574393] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-10T22:38:25.576894] [INFO ] [MAIN ] Derivative Progress: 675/1823 symbols completed. FDX took 1.2s. Estimated remaining: 7m 22s. Rate: 155.7 symbols/min [2025-10-10T22:38:25.577382] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:25.577336] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:25.577485] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:25.593709] [DEBUG] [LOCAL ] FET: Loaded 12967 existing records from primary storage. [2025-10-10T22:38:25.593845] [INFO ] [MAIN ] FET: Loaded 12967 primary data records. [2025-10-10T22:38:25.947401] [DEBUG] [LOCAL ] FERG: Loaded 49475 existing records from primary storage. [2025-10-10T22:38:25.962835] [INFO ] [MAIN ] FERG: Loaded 49475 primary data records. [2025-10-10T22:38:25.976054] [DEBUG] [LOCAL ] FE: Loaded 54212 existing records from primary storage. [2025-10-10T22:38:26.001685] [INFO ] [MAIN ] FE: Loaded 54212 primary data records. [2025-10-10T22:38:26.596095] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:26.597239] [INFO ] [MAIN ] FET: Generated 1820 derivative records from 12967 primary records. [2025-10-10T22:38:26.597421] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-10T22:38:26.616857] [DEBUG] [LOCAL ] FET: Derivative data saved (1820 records). [2025-10-10T22:38:26.617530] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-10T22:38:26.620078] [INFO ] [MAIN ] Derivative Progress: 676/1823 symbols completed. FET took 1.0s. Estimated remaining: 7m 23s. Rate: 155.3 symbols/min [2025-10-10T22:38:26.620397] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:26.640241] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:26.640968] [INFO ] [MAIN ] FERG: Generated 1820 derivative records from 49475 primary records. [2025-10-10T22:38:26.641194] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-10T22:38:26.663575] [DEBUG] [LOCAL ] FERG: Derivative data saved (1820 records). [2025-10-10T22:38:26.663718] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-10T22:38:26.665449] [INFO ] [MAIN ] Derivative Progress: 677/1823 symbols completed. FERG took 1.1s. Estimated remaining: 7m 22s. Rate: 155.5 symbols/min [2025-10-10T22:38:26.665781] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:26.691882] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:26.692028] [DEBUG] [LOCAL ] FF: Loaded 24777 existing records from primary storage. [2025-10-10T22:38:26.692917] [INFO ] [MAIN ] FF: Loaded 24777 primary data records. [2025-10-10T22:38:26.692816] [INFO ] [MAIN ] FE: Generated 1820 derivative records from 54212 primary records. [2025-10-10T22:38:26.704399] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-10T22:38:26.727390] [DEBUG] [LOCAL ] FFA: Loaded 6187 existing records from primary storage. [2025-10-10T22:38:26.740061] [INFO ] [MAIN ] FFA: Loaded 6187 primary data records. [2025-10-10T22:38:27.004179] [DEBUG] [LOCAL ] FE: Derivative data saved (1820 records). [2025-10-10T22:38:27.014594] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-10T22:38:27.159290] [INFO ] [MAIN ] Derivative Progress: 678/1823 symbols completed. FE took 1.6s. Estimated remaining: 7m 22s. Rate: 155.4 symbols/min [2025-10-10T22:38:27.194878] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:27.382848] [DEBUG] [LOCAL ] FFC: Loaded 17022 existing records from primary storage. [2025-10-10T22:38:27.383339] [INFO ] [MAIN ] FFC: Loaded 17022 primary data records. [2025-10-10T22:38:27.576551] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:27.603531] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:27.611062] [INFO ] [MAIN ] FFA: Generated 1820 derivative records from 6187 primary records. [2025-10-10T22:38:27.604914] [INFO ] [MAIN ] FF: Generated 1820 derivative records from 24777 primary records. [2025-10-10T22:38:27.611205] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-10T22:38:27.727331] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-10T22:38:27.773733] [DEBUG] [LOCAL ] FF: Derivative data saved (1820 records). [2025-10-10T22:38:27.774498] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-10T22:38:27.774410] [DEBUG] [LOCAL ] FFA: Derivative data saved (1820 records). [2025-10-10T22:38:27.776618] [INFO ] [MAIN ] Derivative Progress: 679/1823 symbols completed. FF took 1.2s. Estimated remaining: 7m 22s. Rate: 155.3 symbols/min [2025-10-10T22:38:27.776757] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-10T22:38:27.777012] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:27.779682] [INFO ] [MAIN ] Derivative Progress: 680/1823 symbols completed. FFA took 1.1s. Estimated remaining: 7m 21s. Rate: 155.5 symbols/min [2025-10-10T22:38:27.781032] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:27.801985] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:27.802672] [INFO ] [MAIN ] FFC: Generated 1820 derivative records from 17022 primary records. [2025-10-10T22:38:27.802799] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-10T22:38:27.843280] [DEBUG] [LOCAL ] FFC: Derivative data saved (1820 records). [2025-10-10T22:38:27.843910] [DEBUG] [LOCAL ] FG: Loaded 23056 existing records from primary storage. [2025-10-10T22:38:27.844055] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-10T22:38:27.846156] [INFO ] [MAIN ] Derivative Progress: 681/1823 symbols completed. FFC took 0.7s. Estimated remaining: 7m 20s. Rate: 155.7 symbols/min [2025-10-10T22:38:27.846326] [INFO ] [MAIN ] FG: Loaded 23056 primary data records. [2025-10-10T22:38:27.846446] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:27.966422] [DEBUG] [LOCAL ] FFWM: Loaded 36288 existing records from primary storage. [2025-10-10T22:38:27.965957] [DEBUG] [LOCAL ] FGN: Loaded 3821 existing records from primary storage. [2025-10-10T22:38:27.970566] [INFO ] [MAIN ] FGN: Loaded 3821 primary data records. [2025-10-10T22:38:27.970481] [INFO ] [MAIN ] FFWM: Loaded 36288 primary data records. [2025-10-10T22:38:28.798827] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:28.812136] [INFO ] [MAIN ] FGN: Generated 1820 derivative records from 3821 primary records. [2025-10-10T22:38:28.812552] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:38:28.813444] [INFO ] [MAIN ] FG: Generated 1819 derivative records from 23056 primary records. [2025-10-10T22:38:28.812247] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-10T22:38:28.813943] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-10T22:38:28.846191] [DEBUG] [LOCAL ] FGN: Derivative data saved (1820 records). [2025-10-10T22:38:28.856400] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-10T22:38:28.861130] [DEBUG] [LOCAL ] FG: Derivative data saved (1819 records). [2025-10-10T22:38:28.861819] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-10T22:38:28.862194] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:28.865193] [INFO ] [MAIN ] FFWM: Generated 1820 derivative records from 36288 primary records. [2025-10-10T22:38:28.864708] [INFO ] [MAIN ] Derivative Progress: 682/1823 symbols completed. FG took 1.1s. Estimated remaining: 7m 21s. Rate: 155.3 symbols/min [2025-10-10T22:38:28.867506] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:28.867632] [INFO ] [MAIN ] Derivative Progress: 683/1823 symbols completed. FGN took 1.0s. Estimated remaining: 7m 20s. Rate: 155.6 symbols/min [2025-10-10T22:38:28.868145] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-10T22:38:28.868246] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:28.885070] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1820 records). [2025-10-10T22:38:28.885251] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-10T22:38:28.887442] [INFO ] [MAIN ] Derivative Progress: 684/1823 symbols completed. FFWM took 1.1s. Estimated remaining: 7m 19s. Rate: 155.8 symbols/min [2025-10-10T22:38:28.887842] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:28.934890] [DEBUG] [LOCAL ] FHI: Loaded 40451 existing records from primary storage. [2025-10-10T22:38:28.935046] [INFO ] [MAIN ] FHI: Loaded 40451 primary data records. [2025-10-10T22:38:29.116099] [DEBUG] [LOCAL ] FHN: Loaded 54153 existing records from primary storage. [2025-10-10T22:38:29.160096] [INFO ] [MAIN ] FHN: Loaded 54153 primary data records. [2025-10-10T22:38:29.317191] [DEBUG] [LOCAL ] FI: Loaded 54313 existing records from primary storage. [2025-10-10T22:38:29.348285] [INFO ] [MAIN ] FI: Loaded 54313 primary data records. [2025-10-10T22:38:29.948180] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:29.950375] [INFO ] [MAIN ] FHI: Generated 1820 derivative records from 40451 primary records. [2025-10-10T22:38:29.950757] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-10T22:38:29.984761] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:29.986742] [INFO ] [MAIN ] FHN: Generated 1820 derivative records from 54153 primary records. [2025-10-10T22:38:29.988556] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-10T22:38:29.989207] [DEBUG] [LOCAL ] FHI: Derivative data saved (1820 records). [2025-10-10T22:38:29.990268] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-10T22:38:29.992431] [INFO ] [MAIN ] Derivative Progress: 685/1823 symbols completed. FHI took 1.1s. Estimated remaining: 7m 20s. Rate: 155.4 symbols/min [2025-10-10T22:38:29.992578] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:30.014194] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:30.017622] [INFO ] [MAIN ] FI: Generated 1820 derivative records from 54313 primary records. [2025-10-10T22:38:30.019402] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-10T22:38:30.037137] [DEBUG] [LOCAL ] FHN: Derivative data saved (1820 records). [2025-10-10T22:38:30.037500] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-10T22:38:30.040310] [INFO ] [MAIN ] Derivative Progress: 686/1823 symbols completed. FHN took 1.2s. Estimated remaining: 7m 19s. Rate: 155.6 symbols/min [2025-10-10T22:38:30.041030] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:30.041292] [DEBUG] [LOCAL ] FI: Derivative data saved (1820 records). [2025-10-10T22:38:30.047146] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-10T22:38:30.050073] [INFO ] [MAIN ] Derivative Progress: 687/1823 symbols completed. FI took 1.2s. Estimated remaining: 7m 18s. Rate: 155.8 symbols/min [2025-10-10T22:38:30.050362] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:30.061347] [DEBUG] [LOCAL ] FICO: Loaded 21793 existing records from primary storage. [2025-10-10T22:38:30.061520] [INFO ] [MAIN ] FICO: Loaded 21793 primary data records. [2025-10-10T22:38:30.383884] [DEBUG] [LOCAL ] FIHL: Loaded 40181 existing records from primary storage. [2025-10-10T22:38:30.398960] [INFO ] [MAIN ] FIHL: Loaded 40181 primary data records. [2025-10-10T22:38:30.400319] [DEBUG] [LOCAL ] FIGS: Loaded 49411 existing records from primary storage. [2025-10-10T22:38:30.443502] [INFO ] [MAIN ] FIGS: Loaded 49411 primary data records. [2025-10-10T22:38:31.041744] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:31.052370] [INFO ] [MAIN ] FICO: Generated 1820 derivative records from 21793 primary records. [2025-10-10T22:38:31.056015] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-10T22:38:31.078149] [DEBUG] [LOCAL ] FICO: Derivative data saved (1820 records). [2025-10-10T22:38:31.078485] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-10T22:38:31.080859] [INFO ] [MAIN ] Derivative Progress: 688/1823 symbols completed. FICO took 1.1s. Estimated remaining: 7m 18s. Rate: 155.4 symbols/min [2025-10-10T22:38:31.104452] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:31.105313] [INFO ] [MAIN ] FIGS: Generated 1820 derivative records from 49411 primary records. [2025-10-10T22:38:31.116969] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-10T22:38:31.117910] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:31.118866] [INFO ] [MAIN ] FIHL: Generated 1820 derivative records from 40181 primary records. [2025-10-10T22:38:31.119121] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-10T22:38:31.142483] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1820 records). [2025-10-10T22:38:31.145064] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-10T22:38:31.147764] [INFO ] [MAIN ] Derivative Progress: 689/1823 symbols completed. FIGS took 1.1s. Estimated remaining: 7m 17s. Rate: 155.6 symbols/min [2025-10-10T22:38:31.151561] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1820 records). [2025-10-10T22:38:31.151698] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-10T22:38:31.153565] [INFO ] [MAIN ] Derivative Progress: 690/1823 symbols completed. FIHL took 1.1s. Estimated remaining: 7m 16s. Rate: 155.8 symbols/min [2025-10-10T22:38:31.153941] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:31.154008] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:31.154192] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:31.168757] [DEBUG] [LOCAL ] FINS: Loaded 8390 existing records from primary storage. [2025-10-10T22:38:31.169018] [INFO ] [MAIN ] FINS: Loaded 8390 primary data records. [2025-10-10T22:38:31.534384] [DEBUG] [LOCAL ] FINV: Loaded 45966 existing records from primary storage. [2025-10-10T22:38:31.548902] [INFO ] [MAIN ] FINV: Loaded 45966 primary data records. [2025-10-10T22:38:31.581265] [DEBUG] [LOCAL ] FIS: Loaded 54124 existing records from primary storage. [2025-10-10T22:38:31.587071] [INFO ] [MAIN ] FIS: Loaded 54124 primary data records. [2025-10-10T22:38:32.165996] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:32.167316] [INFO ] [MAIN ] FINS: Generated 1820 derivative records from 8390 primary records. [2025-10-10T22:38:32.167465] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-10T22:38:32.186102] [DEBUG] [LOCAL ] FINS: Derivative data saved (1820 records). [2025-10-10T22:38:32.186335] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-10T22:38:32.188814] [INFO ] [MAIN ] Derivative Progress: 691/1823 symbols completed. FINS took 1.0s. Estimated remaining: 7m 17s. Rate: 155.4 symbols/min [2025-10-10T22:38:32.189074] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:32.209527] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:32.212029] [INFO ] [MAIN ] FINV: Generated 1820 derivative records from 45966 primary records. [2025-10-10T22:38:32.212260] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-10T22:38:32.233120] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:32.242696] [INFO ] [MAIN ] FIS: Generated 1820 derivative records from 54124 primary records. [2025-10-10T22:38:32.247143] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-10T22:38:32.270695] [DEBUG] [LOCAL ] FINV: Derivative data saved (1820 records). [2025-10-10T22:38:32.271075] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-10T22:38:32.273010] [INFO ] [MAIN ] Derivative Progress: 692/1823 symbols completed. FINV took 1.1s. Estimated remaining: 7m 16s. Rate: 155.6 symbols/min [2025-10-10T22:38:32.273215] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:32.276602] [DEBUG] [LOCAL ] FIX: Loaded 29642 existing records from primary storage. [2025-10-10T22:38:32.277734] [DEBUG] [LOCAL ] FIS: Derivative data saved (1820 records). [2025-10-10T22:38:32.278213] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-10T22:38:32.278295] [INFO ] [MAIN ] FIX: Loaded 29642 primary data records. [2025-10-10T22:38:32.280948] [INFO ] [MAIN ] Derivative Progress: 693/1823 symbols completed. FIS took 1.1s. Estimated remaining: 7m 15s. Rate: 155.8 symbols/min [2025-10-10T22:38:32.292519] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:32.383596] [DEBUG] [LOCAL ] FLC: Loaded 5479 existing records from primary storage. [2025-10-10T22:38:32.387552] [INFO ] [MAIN ] FLC: Loaded 5479 primary data records. [2025-10-10T22:38:32.906409] [DEBUG] [LOCAL ] FLG: Loaded 54092 existing records from primary storage. [2025-10-10T22:38:32.906794] [INFO ] [MAIN ] FLG: Loaded 54092 primary data records. [2025-10-10T22:38:33.271499] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:33.273239] [INFO ] [MAIN ] FIX: Generated 1820 derivative records from 29642 primary records. [2025-10-10T22:38:33.274535] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-10T22:38:33.305981] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:33.307766] [INFO ] [MAIN ] FLC: Generated 1820 derivative records from 5479 primary records. [2025-10-10T22:38:33.308106] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-10T22:38:33.309251] [DEBUG] [LOCAL ] FIX: Derivative data saved (1820 records). [2025-10-10T22:38:33.309407] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-10T22:38:33.312371] [INFO ] [MAIN ] Derivative Progress: 694/1823 symbols completed. FIX took 1.1s. Estimated remaining: 7m 16s. Rate: 155.4 symbols/min [2025-10-10T22:38:33.319115] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:33.328286] [DEBUG] [LOCAL ] FLC: Derivative data saved (1820 records). [2025-10-10T22:38:33.328514] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-10T22:38:33.330956] [INFO ] [MAIN ] Derivative Progress: 695/1823 symbols completed. FLC took 1.1s. Estimated remaining: 7m 15s. Rate: 155.7 symbols/min [2025-10-10T22:38:33.331245] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:33.349476] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:33.350152] [INFO ] [MAIN ] FLG: Generated 1820 derivative records from 54092 primary records. [2025-10-10T22:38:33.350217] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-10T22:38:33.374576] [DEBUG] [LOCAL ] FLG: Derivative data saved (1820 records). [2025-10-10T22:38:33.374806] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-10T22:38:33.376980] [INFO ] [MAIN ] Derivative Progress: 696/1823 symbols completed. FLG took 1.1s. Estimated remaining: 7m 14s. Rate: 155.9 symbols/min [2025-10-10T22:38:33.377333] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:33.404036] [DEBUG] [LOCAL ] FLNG: Loaded 34064 existing records from primary storage. [2025-10-10T22:38:33.404221] [INFO ] [MAIN ] FLNG: Loaded 34064 primary data records. [2025-10-10T22:38:33.612454] [DEBUG] [LOCAL ] FLO: Loaded 52720 existing records from primary storage. [2025-10-10T22:38:33.719564] [INFO ] [MAIN ] FLO: Loaded 52720 primary data records. [2025-10-10T22:38:33.863067] [DEBUG] [LOCAL ] FLR: Loaded 53945 existing records from primary storage. [2025-10-10T22:38:33.872442] [INFO ] [MAIN ] FLR: Loaded 53945 primary data records. [2025-10-10T22:38:34.381913] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:34.383209] [INFO ] [MAIN ] FLNG: Generated 1820 derivative records from 34064 primary records. [2025-10-10T22:38:34.383488] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-10T22:38:34.404912] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1820 records). [2025-10-10T22:38:34.412689] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-10T22:38:34.420058] [INFO ] [MAIN ] Derivative Progress: 697/1823 symbols completed. FLNG took 1.1s. Estimated remaining: 7m 15s. Rate: 155.5 symbols/min [2025-10-10T22:38:34.420571] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:34.420689] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:34.421802] [INFO ] [MAIN ] FLO: Generated 1820 derivative records from 52720 primary records. [2025-10-10T22:38:34.422368] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-10T22:38:34.444284] [DEBUG] [LOCAL ] FLO: Derivative data saved (1820 records). [2025-10-10T22:38:34.445357] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-10T22:38:34.451149] [INFO ] [MAIN ] Derivative Progress: 698/1823 symbols completed. FLO took 1.1s. Estimated remaining: 7m 14s. Rate: 155.7 symbols/min [2025-10-10T22:38:34.451472] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:34.465661] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:34.466364] [INFO ] [MAIN ] FLR: Generated 1820 derivative records from 53945 primary records. [2025-10-10T22:38:34.466495] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-10T22:38:34.495632] [DEBUG] [LOCAL ] FLR: Derivative data saved (1820 records). [2025-10-10T22:38:34.495779] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-10T22:38:34.498022] [INFO ] [MAIN ] Derivative Progress: 699/1823 symbols completed. FLR took 1.1s. Estimated remaining: 7m 13s. Rate: 155.9 symbols/min [2025-10-10T22:38:34.498359] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:34.518433] [DEBUG] [LOCAL ] FLS: Loaded 51020 existing records from primary storage. [2025-10-10T22:38:34.518693] [INFO ] [MAIN ] FLS: Loaded 51020 primary data records. [2025-10-10T22:38:34.662387] [DEBUG] [LOCAL ] FLXR: Loaded 21118 existing records from primary storage. [2025-10-10T22:38:34.699170] [INFO ] [MAIN ] FLXR: Loaded 21118 primary data records. [2025-10-10T22:38:34.809457] [DEBUG] [LOCAL ] FLUT: Loaded 51543 existing records from primary storage. [2025-10-10T22:38:34.905142] [INFO ] [MAIN ] FLUT: Loaded 51543 primary data records. [2025-10-10T22:38:35.513190] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:35.514380] [INFO ] [MAIN ] FLS: Generated 1820 derivative records from 51020 primary records. [2025-10-10T22:38:35.514758] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-10T22:38:35.536532] [DEBUG] [LOCAL ] FLS: Derivative data saved (1820 records). [2025-10-10T22:38:35.537736] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-10T22:38:35.541246] [INFO ] [MAIN ] Derivative Progress: 700/1823 symbols completed. FLS took 1.1s. Estimated remaining: 7m 13s. Rate: 155.5 symbols/min [2025-10-10T22:38:35.553431] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:35.554134] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:35.555233] [INFO ] [MAIN ] FLUT: Generated 1820 derivative records from 51543 primary records. [2025-10-10T22:38:35.555302] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-10T22:38:35.580508] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:35.581904] [INFO ] [MAIN ] FLXR: Generated 1820 derivative records from 21118 primary records. [2025-10-10T22:38:35.582345] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-10T22:38:35.598438] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1820 records). [2025-10-10T22:38:35.598915] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-10T22:38:35.604988] [INFO ] [MAIN ] Derivative Progress: 701/1823 symbols completed. FLUT took 1.2s. Estimated remaining: 7m 12s. Rate: 155.7 symbols/min [2025-10-10T22:38:35.606454] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1820 records). [2025-10-10T22:38:35.605826] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:35.606962] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-10T22:38:35.609616] [INFO ] [MAIN ] Derivative Progress: 702/1823 symbols completed. FLXR took 1.1s. Estimated remaining: 7m 11s. Rate: 155.9 symbols/min [2025-10-10T22:38:35.609956] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:35.617560] [DEBUG] [LOCAL ] FMN: Loaded 5439 existing records from primary storage. [2025-10-10T22:38:35.617823] [INFO ] [MAIN ] FMN: Loaded 5439 primary data records. [2025-10-10T22:38:35.812305] [DEBUG] [LOCAL ] FMC: Loaded 52580 existing records from primary storage. [2025-10-10T22:38:35.820450] [INFO ] [MAIN ] FMC: Loaded 52580 primary data records. [2025-10-10T22:38:35.876532] [DEBUG] [LOCAL ] FMS: Loaded 30508 existing records from primary storage. [2025-10-10T22:38:35.888802] [INFO ] [MAIN ] FMS: Loaded 30508 primary data records. [2025-10-10T22:38:36.571192] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:36.572496] [INFO ] [MAIN ] FMN: Generated 1820 derivative records from 5439 primary records. [2025-10-10T22:38:36.572726] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-10T22:38:36.588992] [DEBUG] [LOCAL ] FMN: Derivative data saved (1820 records). [2025-10-10T22:38:36.590808] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-10T22:38:36.593554] [INFO ] [MAIN ] Derivative Progress: 703/1823 symbols completed. FMN took 1.0s. Estimated remaining: 7m 12s. Rate: 155.6 symbols/min [2025-10-10T22:38:36.607201] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:36.607924] [INFO ] [MAIN ] FMC: Generated 1820 derivative records from 52580 primary records. [2025-10-10T22:38:36.608059] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-10T22:38:36.637111] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:36.638843] [DEBUG] [LOCAL ] FMC: Derivative data saved (1820 records). [2025-10-10T22:38:36.639464] [INFO ] [MAIN ] FMS: Generated 1820 derivative records from 30508 primary records. [2025-10-10T22:38:36.639564] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-10T22:38:36.642151] [INFO ] [MAIN ] Derivative Progress: 704/1823 symbols completed. FMC took 1.1s. Estimated remaining: 7m 11s. Rate: 155.7 symbols/min [2025-10-10T22:38:36.642309] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-10T22:38:36.657791] [DEBUG] [LOCAL ] FMS: Derivative data saved (1820 records). [2025-10-10T22:38:36.657853] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-10T22:38:36.659948] [INFO ] [MAIN ] Derivative Progress: 705/1823 symbols completed. FMS took 1.0s. Estimated remaining: 7m 10s. Rate: 156.0 symbols/min [2025-10-10T22:38:36.660469] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:36.660565] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:36.660672] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:36.665271] [DEBUG] [LOCAL ] FMY: Loaded 1408 existing records from primary storage. [2025-10-10T22:38:36.665445] [INFO ] [MAIN ] FMY: Loaded 1408 primary data records. [2025-10-10T22:38:37.002033] [DEBUG] [LOCAL ] FMX: Loaded 41027 existing records from primary storage. [2025-10-10T22:38:37.002523] [INFO ] [MAIN ] FMX: Loaded 41027 primary data records. [2025-10-10T22:38:37.003483] [DEBUG] [LOCAL ] FN: Loaded 38595 existing records from primary storage. [2025-10-10T22:38:37.004238] [INFO ] [MAIN ] FN: Loaded 38595 primary data records. [2025-10-10T22:38:37.658565] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-10T22:38:37.659915] [INFO ] [MAIN ] FMY: Generated 1818 derivative records from 1408 primary records. [2025-10-10T22:38:37.660141] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-10T22:38:37.678531] [DEBUG] [LOCAL ] FMY: Derivative data saved (1818 records). [2025-10-10T22:38:37.678824] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-10T22:38:37.681860] [INFO ] [MAIN ] Derivative Progress: 706/1823 symbols completed. FMY took 1.0s. Estimated remaining: 7m 11s. Rate: 155.6 symbols/min [2025-10-10T22:38:37.694908] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:37.695044] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:37.696138] [INFO ] [MAIN ] FMX: Generated 1820 derivative records from 41027 primary records. [2025-10-10T22:38:37.696566] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-10T22:38:37.716771] [DEBUG] [LOCAL ] FMX: Derivative data saved (1820 records). [2025-10-10T22:38:37.716889] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-10T22:38:37.719087] [INFO ] [MAIN ] Derivative Progress: 707/1823 symbols completed. FMX took 1.1s. Estimated remaining: 7m 10s. Rate: 155.8 symbols/min [2025-10-10T22:38:37.731932] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:37.732568] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:37.733722] [INFO ] [MAIN ] FN: Generated 1820 derivative records from 38595 primary records. [2025-10-10T22:38:37.734012] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-10T22:38:37.750938] [DEBUG] [LOCAL ] FN: Derivative data saved (1820 records). [2025-10-10T22:38:37.751009] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-10T22:38:37.753220] [INFO ] [MAIN ] Derivative Progress: 708/1823 symbols completed. FN took 1.1s. Estimated remaining: 7m 9s. Rate: 156.0 symbols/min [2025-10-10T22:38:37.753521] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:37.794598] [DEBUG] [LOCAL ] FNB: Loaded 53309 existing records from primary storage. [2025-10-10T22:38:37.794878] [INFO ] [MAIN ] FNB: Loaded 53309 primary data records. [2025-10-10T22:38:37.971149] [DEBUG] [LOCAL ] FND: Loaded 52882 existing records from primary storage. [2025-10-10T22:38:38.006756] [INFO ] [MAIN ] FND: Loaded 52882 primary data records. [2025-10-10T22:38:38.078100] [DEBUG] [LOCAL ] FNF: Loaded 49668 existing records from primary storage. [2025-10-10T22:38:38.126998] [INFO ] [MAIN ] FNF: Loaded 49668 primary data records. [2025-10-10T22:38:38.807672] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:38.809078] [INFO ] [MAIN ] FNB: Generated 1820 derivative records from 53309 primary records. [2025-10-10T22:38:38.810179] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-10T22:38:38.833388] [DEBUG] [LOCAL ] FNB: Derivative data saved (1820 records). [2025-10-10T22:38:38.836289] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-10T22:38:38.838473] [INFO ] [MAIN ] Derivative Progress: 709/1823 symbols completed. FNB took 1.1s. Estimated remaining: 7m 10s. Rate: 155.6 symbols/min [2025-10-10T22:38:38.838667] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:38.871820] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:38.873404] [INFO ] [MAIN ] FNF: Generated 1820 derivative records from 49668 primary records. [2025-10-10T22:38:38.873946] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-10T22:38:38.873756] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:38.875555] [INFO ] [MAIN ] FND: Generated 1820 derivative records from 52882 primary records. [2025-10-10T22:38:38.875783] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-10T22:38:38.913592] [DEBUG] [LOCAL ] FNF: Derivative data saved (1820 records). [2025-10-10T22:38:38.913784] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-10T22:38:38.916244] [INFO ] [MAIN ] Derivative Progress: 710/1823 symbols completed. FNF took 1.2s. Estimated remaining: 7m 9s. Rate: 155.8 symbols/min [2025-10-10T22:38:38.916517] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:38.918273] [DEBUG] [LOCAL ] FND: Derivative data saved (1820 records). [2025-10-10T22:38:38.918408] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-10T22:38:38.921714] [INFO ] [MAIN ] Derivative Progress: 711/1823 symbols completed. FND took 1.2s. Estimated remaining: 7m 8s. Rate: 156.0 symbols/min [2025-10-10T22:38:38.922142] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:38.952756] [DEBUG] [LOCAL ] FOA: Loaded 13275 existing records from primary storage. [2025-10-10T22:38:38.953082] [DEBUG] [LOCAL ] FOF: Loaded 8672 existing records from primary storage. [2025-10-10T22:38:38.965682] [INFO ] [MAIN ] FOF: Loaded 8672 primary data records. [2025-10-10T22:38:38.965533] [INFO ] [MAIN ] FOA: Loaded 13275 primary data records. [2025-10-10T22:38:39.056082] [DEBUG] [LOCAL ] FNV: Loaded 46876 existing records from primary storage. [2025-10-10T22:38:39.120931] [INFO ] [MAIN ] FNV: Loaded 46876 primary data records. [2025-10-10T22:38:40.193973] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:40.195285] [INFO ] [MAIN ] FOA: Generated 1820 derivative records from 13275 primary records. [2025-10-10T22:38:40.195615] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-10T22:38:40.234028] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:40.248708] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:40.249550] [INFO ] [MAIN ] FOF: Generated 1820 derivative records from 8672 primary records. [2025-10-10T22:38:40.253041] [INFO ] [MAIN ] FNV: Generated 1820 derivative records from 46876 primary records. [2025-10-10T22:38:40.253443] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-10T22:38:40.253847] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-10T22:38:40.255082] [DEBUG] [LOCAL ] FOA: Derivative data saved (1820 records). [2025-10-10T22:38:40.255380] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-10T22:38:40.258857] [INFO ] [MAIN ] Derivative Progress: 712/1823 symbols completed. FOA took 1.3s. Estimated remaining: 7m 9s. Rate: 155.4 symbols/min [2025-10-10T22:38:40.259383] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:40.305534] [DEBUG] [LOCAL ] FNV: Derivative data saved (1820 records). [2025-10-10T22:38:40.305871] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-10T22:38:40.308935] [INFO ] [MAIN ] Derivative Progress: 713/1823 symbols completed. FNV took 1.5s. Estimated remaining: 7m 8s. Rate: 155.6 symbols/min [2025-10-10T22:38:40.305436] [DEBUG] [LOCAL ] FOF: Derivative data saved (1820 records). [2025-10-10T22:38:40.309275] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-10T22:38:40.309392] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:40.313586] [INFO ] [MAIN ] Derivative Progress: 714/1823 symbols completed. FOF took 1.4s. Estimated remaining: 7m 7s. Rate: 155.9 symbols/min [2025-10-10T22:38:40.320831] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:40.336512] [DEBUG] [LOCAL ] FOR: Loaded 19970 existing records from primary storage. [2025-10-10T22:38:40.336716] [INFO ] [MAIN ] FOR: Loaded 19970 primary data records. [2025-10-10T22:38:40.464300] [DEBUG] [LOCAL ] FPF: Loaded 18898 existing records from primary storage. [2025-10-10T22:38:40.499031] [INFO ] [MAIN ] FPF: Loaded 18898 primary data records. [2025-10-10T22:38:40.861701] [DEBUG] [LOCAL ] FOUR: Loaded 50337 existing records from primary storage. [2025-10-10T22:38:40.873841] [INFO ] [MAIN ] FOUR: Loaded 50337 primary data records. [2025-10-10T22:38:41.434083] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:41.435011] [INFO ] [MAIN ] FOR: Generated 1820 derivative records from 19970 primary records. [2025-10-10T22:38:41.435717] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-10T22:38:41.456151] [DEBUG] [LOCAL ] FOR: Derivative data saved (1820 records). [2025-10-10T22:38:41.456344] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-10T22:38:41.458611] [INFO ] [MAIN ] Derivative Progress: 715/1823 symbols completed. FOR took 1.2s. Estimated remaining: 7m 8s. Rate: 155.4 symbols/min [2025-10-10T22:38:41.459122] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:41.473134] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:41.473918] [INFO ] [MAIN ] FPF: Generated 1820 derivative records from 18898 primary records. [2025-10-10T22:38:41.474210] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-10T22:38:41.509891] [DEBUG] [LOCAL ] FPF: Derivative data saved (1820 records). [2025-10-10T22:38:41.510100] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-10T22:38:41.512178] [INFO ] [MAIN ] Derivative Progress: 716/1823 symbols completed. FPF took 1.2s. Estimated remaining: 7m 7s. Rate: 155.6 symbols/min [2025-10-10T22:38:41.512703] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:41.513598] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:41.513507] [INFO ] [MAIN ] FOUR: Generated 1820 derivative records from 50337 primary records. [2025-10-10T22:38:41.514300] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-10T22:38:41.529514] [DEBUG] [LOCAL ] FPH: Loaded 19617 existing records from primary storage. [2025-10-10T22:38:41.531165] [INFO ] [MAIN ] FPH: Loaded 19617 primary data records. [2025-10-10T22:38:41.581558] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1820 records). [2025-10-10T22:38:41.593315] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-10T22:38:41.595394] [INFO ] [MAIN ] Derivative Progress: 717/1823 symbols completed. FOUR took 1.3s. Estimated remaining: 7m 6s. Rate: 155.8 symbols/min [2025-10-10T22:38:41.604061] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:41.842621] [DEBUG] [LOCAL ] FPI: Loaded 31503 existing records from primary storage. [2025-10-10T22:38:41.850974] [INFO ] [MAIN ] FPI: Loaded 31503 primary data records. [2025-10-10T22:38:42.172686] [DEBUG] [LOCAL ] FR: Loaded 47016 existing records from primary storage. [2025-10-10T22:38:42.173681] [INFO ] [MAIN ] FR: Loaded 47016 primary data records. [2025-10-10T22:38:42.353784] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:42.482152] [INFO ] [MAIN ] FPH: Generated 1820 derivative records from 19617 primary records. [2025-10-10T22:38:42.490950] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-10T22:38:42.524298] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:42.526042] [INFO ] [MAIN ] FPI: Generated 1820 derivative records from 31503 primary records. [2025-10-10T22:38:42.526320] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-10T22:38:42.528409] [DEBUG] [LOCAL ] FPH: Derivative data saved (1820 records). [2025-10-10T22:38:42.536088] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-10T22:38:42.538476] [INFO ] [MAIN ] Derivative Progress: 718/1823 symbols completed. FPH took 1.1s. Estimated remaining: 7m 6s. Rate: 155.5 symbols/min [2025-10-10T22:38:42.550167] [DEBUG] [LOCAL ] FPI: Derivative data saved (1820 records). [2025-10-10T22:38:42.550373] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-10T22:38:42.552563] [INFO ] [MAIN ] Derivative Progress: 719/1823 symbols completed. FPI took 1.0s. Estimated remaining: 7m 6s. Rate: 155.7 symbols/min [2025-10-10T22:38:42.568659] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:42.569385] [INFO ] [MAIN ] FR: Generated 1820 derivative records from 47016 primary records. [2025-10-10T22:38:42.569443] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-10T22:38:42.584533] [DEBUG] [LOCAL ] FR: Derivative data saved (1820 records). [2025-10-10T22:38:42.584590] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-10T22:38:42.586544] [INFO ] [MAIN ] Derivative Progress: 720/1823 symbols completed. FR took 1.0s. Estimated remaining: 7m 5s. Rate: 155.9 symbols/min [2025-10-10T22:38:42.587086] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:42.587186] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:42.587276] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:42.609484] [DEBUG] [LOCAL ] FRA: Loaded 14769 existing records from primary storage. [2025-10-10T22:38:42.615365] [INFO ] [MAIN ] FRA: Loaded 14769 primary data records. [2025-10-10T22:38:42.615893] [DEBUG] [LOCAL ] FRGE: Loaded 17061 existing records from primary storage. [2025-10-10T22:38:42.616021] [INFO ] [MAIN ] FRGE: Loaded 17061 primary data records. [2025-10-10T22:38:43.118565] [DEBUG] [LOCAL ] FRO: Loaded 52446 existing records from primary storage. [2025-10-10T22:38:43.139194] [INFO ] [MAIN ] FRO: Loaded 52446 primary data records. [2025-10-10T22:38:43.615382] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:43.616521] [INFO ] [MAIN ] FRGE: Generated 1820 derivative records from 17061 primary records. [2025-10-10T22:38:43.617804] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-10T22:38:43.649289] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:43.651106] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1820 records). [2025-10-10T22:38:43.652001] [INFO ] [MAIN ] FRA: Generated 1820 derivative records from 14769 primary records. [2025-10-10T22:38:43.653066] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-10T22:38:43.653159] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-10T22:38:43.656097] [INFO ] [MAIN ] Derivative Progress: 721/1823 symbols completed. FRGE took 1.1s. Estimated remaining: 7m 5s. Rate: 155.5 symbols/min [2025-10-10T22:38:43.658107] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:43.681973] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:43.687894] [INFO ] [MAIN ] FRO: Generated 1820 derivative records from 52446 primary records. [2025-10-10T22:38:43.688538] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-10T22:38:43.707690] [DEBUG] [LOCAL ] FRA: Derivative data saved (1820 records). [2025-10-10T22:38:43.708164] [DEBUG] [LOCAL ] FRO: Derivative data saved (1820 records). [2025-10-10T22:38:43.708390] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-10T22:38:43.710705] [INFO ] [MAIN ] Derivative Progress: 722/1823 symbols completed. FRA took 1.1s. Estimated remaining: 7m 4s. Rate: 155.7 symbols/min [2025-10-10T22:38:43.710997] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:43.711516] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-10T22:38:43.714189] [INFO ] [MAIN ] Derivative Progress: 723/1823 symbols completed. FRO took 1.1s. Estimated remaining: 7m 3s. Rate: 155.9 symbols/min [2025-10-10T22:38:43.714546] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:43.746248] [DEBUG] [LOCAL ] FRT: Loaded 42422 existing records from primary storage. [2025-10-10T22:38:43.756731] [INFO ] [MAIN ] FRT: Loaded 42422 primary data records. [2025-10-10T22:38:43.882616] [DEBUG] [LOCAL ] FSCO: Loaded 38653 existing records from primary storage. [2025-10-10T22:38:43.882843] [INFO ] [MAIN ] FSCO: Loaded 38653 primary data records. [2025-10-10T22:38:44.188429] [DEBUG] [LOCAL ] FSK: Loaded 50179 existing records from primary storage. [2025-10-10T22:38:44.212717] [INFO ] [MAIN ] FSK: Loaded 50179 primary data records. [2025-10-10T22:38:44.749082] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:44.750151] [INFO ] [MAIN ] FRT: Generated 1820 derivative records from 42422 primary records. [2025-10-10T22:38:44.751022] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-10T22:38:44.783663] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:44.785242] [INFO ] [MAIN ] FSCO: Generated 1820 derivative records from 38653 primary records. [2025-10-10T22:38:44.785529] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-10T22:38:44.785443] [DEBUG] [LOCAL ] FRT: Derivative data saved (1820 records). [2025-10-10T22:38:44.785905] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-10T22:38:44.789352] [INFO ] [MAIN ] Derivative Progress: 724/1823 symbols completed. FRT took 1.1s. Estimated remaining: 7m 4s. Rate: 155.5 symbols/min [2025-10-10T22:38:44.801108] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:44.821493] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1820 records). [2025-10-10T22:38:44.821787] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-10T22:38:44.824054] [INFO ] [MAIN ] Derivative Progress: 725/1823 symbols completed. FSCO took 1.1s. Estimated remaining: 7m 3s. Rate: 155.7 symbols/min [2025-10-10T22:38:44.824385] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:44.824557] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:44.825612] [INFO ] [MAIN ] FSK: Generated 1820 derivative records from 50179 primary records. [2025-10-10T22:38:44.826037] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-10T22:38:44.842855] [DEBUG] [LOCAL ] FSK: Derivative data saved (1820 records). [2025-10-10T22:38:44.843607] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-10T22:38:44.845730] [INFO ] [MAIN ] Derivative Progress: 726/1823 symbols completed. FSK took 1.1s. Estimated remaining: 7m 2s. Rate: 155.9 symbols/min [2025-10-10T22:38:44.845925] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:44.906696] [DEBUG] [LOCAL ] FSLY: Loaded 52002 existing records from primary storage. [2025-10-10T22:38:44.915685] [INFO ] [MAIN ] FSLY: Loaded 52002 primary data records. [2025-10-10T22:38:45.062984] [DEBUG] [LOCAL ] FSM: Loaded 54076 existing records from primary storage. [2025-10-10T22:38:45.063751] [DEBUG] [LOCAL ] FSS: Loaded 34290 existing records from primary storage. [2025-10-10T22:38:45.063946] [INFO ] [MAIN ] FSM: Loaded 54076 primary data records. [2025-10-10T22:38:45.064158] [INFO ] [MAIN ] FSS: Loaded 34290 primary data records. [2025-10-10T22:38:45.973261] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:45.975610] [INFO ] [MAIN ] FSLY: Generated 1820 derivative records from 52002 primary records. [2025-10-10T22:38:45.975780] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-10T22:38:46.009161] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:46.007939] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1820 records). [2025-10-10T22:38:46.011606] [INFO ] [MAIN ] FSS: Generated 1820 derivative records from 34290 primary records. [2025-10-10T22:38:46.011863] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-10T22:38:46.010235] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-10T22:38:46.013851] [INFO ] [MAIN ] Derivative Progress: 727/1823 symbols completed. FSLY took 1.2s. Estimated remaining: 7m 3s. Rate: 155.5 symbols/min [2025-10-10T22:38:46.014177] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:46.028807] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:46.046485] [DEBUG] [LOCAL ] FSS: Derivative data saved (1820 records). [2025-10-10T22:38:46.046720] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-10T22:38:46.047479] [INFO ] [MAIN ] FSM: Generated 1820 derivative records from 54076 primary records. [2025-10-10T22:38:46.049978] [INFO ] [MAIN ] Derivative Progress: 728/1823 symbols completed. FSS took 1.2s. Estimated remaining: 7m 2s. Rate: 155.7 symbols/min [2025-10-10T22:38:46.047694] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-10T22:38:46.050205] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:46.055976] [DEBUG] [LOCAL ] FT: Loaded 6823 existing records from primary storage. [2025-10-10T22:38:46.063000] [INFO ] [MAIN ] FT: Loaded 6823 primary data records. [2025-10-10T22:38:46.171983] [DEBUG] [LOCAL ] FTHY: Loaded 12479 existing records from primary storage. [2025-10-10T22:38:46.183684] [INFO ] [MAIN ] FTHY: Loaded 12479 primary data records. [2025-10-10T22:38:46.216801] [DEBUG] [LOCAL ] FSM: Derivative data saved (1820 records). [2025-10-10T22:38:46.244033] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-10T22:38:46.258745] [INFO ] [MAIN ] Derivative Progress: 729/1823 symbols completed. FSM took 1.4s. Estimated remaining: 7m 1s. Rate: 155.8 symbols/min [2025-10-10T22:38:46.276885] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:46.756576] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:46.758459] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:46.759163] [INFO ] [MAIN ] FTHY: Generated 1820 derivative records from 12479 primary records. [2025-10-10T22:38:46.759981] [INFO ] [MAIN ] FT: Generated 1820 derivative records from 6823 primary records. [2025-10-10T22:38:46.759300] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-10T22:38:46.760118] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-10T22:38:46.761037] [DEBUG] [LOCAL ] FTI: Loaded 54071 existing records from primary storage. [2025-10-10T22:38:46.762123] [INFO ] [MAIN ] FTI: Loaded 54071 primary data records. [2025-10-10T22:38:46.838843] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1820 records). [2025-10-10T22:38:46.871687] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-10T22:38:46.884497] [INFO ] [MAIN ] Derivative Progress: 730/1823 symbols completed. FTHY took 0.8s. Estimated remaining: 7m 1s. Rate: 155.6 symbols/min [2025-10-10T22:38:46.871603] [DEBUG] [LOCAL ] FT: Derivative data saved (1820 records). [2025-10-10T22:38:46.892229] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-10T22:38:46.897722] [INFO ] [MAIN ] Derivative Progress: 731/1823 symbols completed. FT took 0.9s. Estimated remaining: 7m 0s. Rate: 155.8 symbols/min [2025-10-10T22:38:46.892374] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:46.898055] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:47.151538] [DEBUG] [LOCAL ] FTK: Loaded 33004 existing records from primary storage. [2025-10-10T22:38:47.152665] [DEBUG] [LOCAL ] FTS: Loaded 43045 existing records from primary storage. [2025-10-10T22:38:47.152915] [INFO ] [MAIN ] FTS: Loaded 43045 primary data records. [2025-10-10T22:38:47.152784] [INFO ] [MAIN ] FTK: Loaded 33004 primary data records. [2025-10-10T22:38:47.426493] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:47.462325] [INFO ] [MAIN ] FTI: Generated 1820 derivative records from 54071 primary records. [2025-10-10T22:38:47.528933] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-10T22:38:47.840222] [DEBUG] [LOCAL ] FTI: Derivative data saved (1820 records). [2025-10-10T22:38:47.840892] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-10T22:38:47.844107] [INFO ] [MAIN ] Derivative Progress: 732/1823 symbols completed. FTI took 1.6s. Estimated remaining: 7m 1s. Rate: 155.5 symbols/min [2025-10-10T22:38:47.845756] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:47.883078] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:47.885980] [INFO ] [MAIN ] FTS: Generated 1820 derivative records from 43045 primary records. [2025-10-10T22:38:47.888683] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-10T22:38:47.932871] [DEBUG] [LOCAL ] FTS: Derivative data saved (1820 records). [2025-10-10T22:38:47.933575] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:47.933802] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-10T22:38:47.937296] [INFO ] [MAIN ] FTK: Generated 1820 derivative records from 33004 primary records. [2025-10-10T22:38:47.936048] [INFO ] [MAIN ] Derivative Progress: 733/1823 symbols completed. FTS took 1.0s. Estimated remaining: 7m 0s. Rate: 155.7 symbols/min [2025-10-10T22:38:47.937761] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-10T22:38:47.976264] [DEBUG] [LOCAL ] FTK: Derivative data saved (1820 records). [2025-10-10T22:38:47.976154] [DEBUG] [LOCAL ] FTV: Loaded 53761 existing records from primary storage. [2025-10-10T22:38:47.976433] [INFO ] [MAIN ] FTV: Loaded 53761 primary data records. [2025-10-10T22:38:47.976678] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-10T22:38:48.047813] [INFO ] [MAIN ] Derivative Progress: 734/1823 symbols completed. FTK took 1.2s. Estimated remaining: 6m 59s. Rate: 155.8 symbols/min [2025-10-10T22:38:48.313804] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:48.314770] [INFO ] [MAIN ] FTV: Generated 1820 derivative records from 53761 primary records. [2025-10-10T22:38:48.314835] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-10T22:38:48.331023] [DEBUG] [LOCAL ] FTV: Derivative data saved (1820 records). [2025-10-10T22:38:48.331111] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-10T22:38:48.332978] [INFO ] [MAIN ] Derivative Progress: 735/1823 symbols completed. FTV took 0.5s. Estimated remaining: 6m 59s. Rate: 155.9 symbols/min [2025-10-10T22:38:48.333547] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:48.333452] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:48.334170] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:48.340866] [DEBUG] [LOCAL ] FTWO: Loaded 1910 existing records from primary storage. [2025-10-10T22:38:48.341138] [INFO ] [MAIN ] FTWO: Loaded 1910 primary data records. [2025-10-10T22:38:48.672987] [DEBUG] [LOCAL ] FUL: Loaded 33279 existing records from primary storage. [2025-10-10T22:38:48.673141] [INFO ] [MAIN ] FUL: Loaded 33279 primary data records. [2025-10-10T22:38:48.797563] [DEBUG] [LOCAL ] FUBO: Loaded 54485 existing records from primary storage. [2025-10-10T22:38:48.797894] [INFO ] [MAIN ] FUBO: Loaded 54485 primary data records. [2025-10-10T22:38:49.318341] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:38:49.384024] [INFO ] [MAIN ] FTWO: Generated 1819 derivative records from 1910 primary records. [2025-10-10T22:38:49.384901] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-10T22:38:49.401275] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1819 records). [2025-10-10T22:38:49.401728] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-10T22:38:49.404266] [INFO ] [MAIN ] Derivative Progress: 736/1823 symbols completed. FTWO took 1.1s. Estimated remaining: 6m 59s. Rate: 155.5 symbols/min [2025-10-10T22:38:49.404489] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:49.423818] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:49.424910] [INFO ] [MAIN ] FUL: Generated 1820 derivative records from 33279 primary records. [2025-10-10T22:38:49.425088] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-10T22:38:49.442448] [DEBUG] [LOCAL ] FUL: Derivative data saved (1820 records). [2025-10-10T22:38:49.442572] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-10T22:38:49.444411] [INFO ] [MAIN ] Derivative Progress: 737/1823 symbols completed. FUL took 1.1s. Estimated remaining: 6m 59s. Rate: 155.7 symbols/min [2025-10-10T22:38:49.444563] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:49.461045] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:49.461634] [INFO ] [MAIN ] FUBO: Generated 1820 derivative records from 54485 primary records. [2025-10-10T22:38:49.461723] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-10T22:38:49.491063] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1820 records). [2025-10-10T22:38:49.491352] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-10T22:38:49.493374] [INFO ] [MAIN ] Derivative Progress: 738/1823 symbols completed. FUBO took 1.2s. Estimated remaining: 6m 58s. Rate: 155.9 symbols/min [2025-10-10T22:38:49.493554] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:49.523364] [DEBUG] [LOCAL ] FVR: Loaded 21773 existing records from primary storage. [2025-10-10T22:38:49.523513] [INFO ] [MAIN ] FVR: Loaded 21773 primary data records. [2025-10-10T22:38:49.535744] [DEBUG] [LOCAL ] FUN: Loaded 52553 existing records from primary storage. [2025-10-10T22:38:49.556472] [INFO ] [MAIN ] FUN: Loaded 52553 primary data records. [2025-10-10T22:38:49.919950] [DEBUG] [LOCAL ] FVRR: Loaded 40837 existing records from primary storage. [2025-10-10T22:38:50.037215] [INFO ] [MAIN ] FVRR: Loaded 40837 primary data records. [2025-10-10T22:38:50.546582] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:50.548478] [INFO ] [MAIN ] FUN: Generated 1820 derivative records from 52553 primary records. [2025-10-10T22:38:50.549469] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:50.549621] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-10T22:38:50.551048] [INFO ] [MAIN ] FVR: Generated 1820 derivative records from 21773 primary records. [2025-10-10T22:38:50.551394] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-10T22:38:50.592259] [DEBUG] [LOCAL ] FUN: Derivative data saved (1820 records). [2025-10-10T22:38:50.592858] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-10T22:38:50.595264] [INFO ] [MAIN ] Derivative Progress: 739/1823 symbols completed. FUN took 1.2s. Estimated remaining: 6m 58s. Rate: 155.5 symbols/min [2025-10-10T22:38:50.596393] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:50.597725] [DEBUG] [LOCAL ] FVR: Derivative data saved (1820 records). [2025-10-10T22:38:50.597883] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-10T22:38:50.601846] [INFO ] [MAIN ] Derivative Progress: 740/1823 symbols completed. FVR took 1.2s. Estimated remaining: 6m 57s. Rate: 155.7 symbols/min [2025-10-10T22:38:50.602470] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:50.606196] [DEBUG] [LOCAL ] FXED: Loaded 1266 existing records from primary storage. [2025-10-10T22:38:50.606540] [INFO ] [MAIN ] FXED: Loaded 1266 primary data records. [2025-10-10T22:38:50.666418] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:50.688282] [INFO ] [MAIN ] FVRR: Generated 1820 derivative records from 40837 primary records. [2025-10-10T22:38:50.693577] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-10T22:38:50.768102] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1820 records). [2025-10-10T22:38:50.779416] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-10T22:38:50.781516] [INFO ] [MAIN ] Derivative Progress: 741/1823 symbols completed. FVRR took 1.3s. Estimated remaining: 6m 57s. Rate: 155.8 symbols/min [2025-10-10T22:38:50.781948] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:50.994626] [DEBUG] [LOCAL ] G: Loaded 50737 existing records from primary storage. [2025-10-10T22:38:51.003870] [INFO ] [MAIN ] G: Loaded 50737 primary data records. [2025-10-10T22:38:51.120378] [DEBUG] [LOCAL ] GAB: Loaded 28235 existing records from primary storage. [2025-10-10T22:38:51.159488] [INFO ] [MAIN ] GAB: Loaded 28235 primary data records. [2025-10-10T22:38:51.681206] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-10T22:38:51.682185] [INFO ] [MAIN ] FXED: Generated 1818 derivative records from 1266 primary records. [2025-10-10T22:38:51.682446] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-10T22:38:51.701985] [DEBUG] [LOCAL ] FXED: Derivative data saved (1818 records). [2025-10-10T22:38:51.702934] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-10T22:38:51.705399] [INFO ] [MAIN ] Derivative Progress: 742/1823 symbols completed. FXED took 1.1s. Estimated remaining: 6m 57s. Rate: 155.5 symbols/min [2025-10-10T22:38:51.706601] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:51.719962] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:51.720960] [INFO ] [MAIN ] G: Generated 1820 derivative records from 50737 primary records. [2025-10-10T22:38:51.721088] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-10T22:38:51.739179] [DEBUG] [LOCAL ] G: Derivative data saved (1820 records). [2025-10-10T22:38:51.740422] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-10T22:38:51.742820] [INFO ] [MAIN ] Derivative Progress: 743/1823 symbols completed. G took 1.1s. Estimated remaining: 6m 56s. Rate: 155.7 symbols/min [2025-10-10T22:38:51.743097] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:51.747385] [DEBUG] [LOCAL ] GAM: Loaded 4102 existing records from primary storage. [2025-10-10T22:38:51.747500] [INFO ] [MAIN ] GAM: Loaded 4102 primary data records. [2025-10-10T22:38:51.870384] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:51.871497] [INFO ] [MAIN ] GAB: Generated 1820 derivative records from 28235 primary records. [2025-10-10T22:38:51.899139] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-10T22:38:52.091801] [DEBUG] [LOCAL ] GAB: Derivative data saved (1820 records). [2025-10-10T22:38:52.092040] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-10T22:38:52.094731] [INFO ] [MAIN ] Derivative Progress: 744/1823 symbols completed. GAB took 1.3s. Estimated remaining: 6m 56s. Rate: 155.7 symbols/min [2025-10-10T22:38:52.096248] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:52.149901] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:52.151165] [DEBUG] [LOCAL ] GAP: Loaded 54432 existing records from primary storage. [2025-10-10T22:38:52.158393] [INFO ] [MAIN ] GAM: Generated 1820 derivative records from 4102 primary records. [2025-10-10T22:38:52.158918] [INFO ] [MAIN ] GAP: Loaded 54432 primary data records. [2025-10-10T22:38:52.158839] [DEBUG] [LOCAL ] GATX: Loaded 18334 existing records from primary storage. [2025-10-10T22:38:52.159119] [INFO ] [MAIN ] GATX: Loaded 18334 primary data records. [2025-10-10T22:38:52.159234] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-10T22:38:52.408548] [DEBUG] [LOCAL ] GAM: Derivative data saved (1820 records). [2025-10-10T22:38:52.419703] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-10T22:38:52.477536] [INFO ] [MAIN ] Derivative Progress: 745/1823 symbols completed. GAM took 0.8s. Estimated remaining: 6m 55s. Rate: 155.7 symbols/min [2025-10-10T22:38:52.486893] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:52.842117] [DEBUG] [LOCAL ] GBAB: Loaded 13161 existing records from primary storage. [2025-10-10T22:38:52.843452] [INFO ] [MAIN ] GBAB: Loaded 13161 primary data records. [2025-10-10T22:38:53.209250] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:53.211908] [INFO ] [MAIN ] GATX: Generated 1820 derivative records from 18334 primary records. [2025-10-10T22:38:53.212075] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-10T22:38:53.240840] [DEBUG] [LOCAL ] GATX: Derivative data saved (1820 records). [2025-10-10T22:38:53.245533] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-10T22:38:53.247692] [INFO ] [MAIN ] Derivative Progress: 746/1823 symbols completed. GATX took 1.2s. Estimated remaining: 6m 56s. Rate: 155.5 symbols/min [2025-10-10T22:38:53.248422] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:53.248981] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:53.250188] [INFO ] [MAIN ] GAP: Generated 1820 derivative records from 54432 primary records. [2025-10-10T22:38:53.250372] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-10T22:38:53.267788] [DEBUG] [LOCAL ] GAP: Derivative data saved (1820 records). [2025-10-10T22:38:53.268085] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-10T22:38:53.270239] [INFO ] [MAIN ] Derivative Progress: 747/1823 symbols completed. GAP took 1.5s. Estimated remaining: 6m 55s. Rate: 155.7 symbols/min [2025-10-10T22:38:53.270420] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:53.287340] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:53.288102] [INFO ] [MAIN ] GBAB: Generated 1820 derivative records from 13161 primary records. [2025-10-10T22:38:53.288305] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-10T22:38:53.314436] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1820 records). [2025-10-10T22:38:53.314607] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-10T22:38:53.317032] [INFO ] [MAIN ] Derivative Progress: 748/1823 symbols completed. GBAB took 0.8s. Estimated remaining: 6m 54s. Rate: 155.9 symbols/min [2025-10-10T22:38:53.339774] [DEBUG] [LOCAL ] GBCI: Loaded 41170 existing records from primary storage. [2025-10-10T22:38:53.339971] [INFO ] [MAIN ] GBCI: Loaded 41170 primary data records. [2025-10-10T22:38:53.454210] [DEBUG] [LOCAL ] GBTG: Loaded 40575 existing records from primary storage. [2025-10-10T22:38:53.459981] [INFO ] [MAIN ] GBTG: Loaded 40575 primary data records. [2025-10-10T22:38:53.990483] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:53.991511] [INFO ] [MAIN ] GBCI: Generated 1820 derivative records from 41170 primary records. [2025-10-10T22:38:53.991779] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-10T22:38:54.012070] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1820 records). [2025-10-10T22:38:54.012964] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-10T22:38:54.015491] [INFO ] [MAIN ] Derivative Progress: 749/1823 symbols completed. GBCI took 0.8s. Estimated remaining: 6m 54s. Rate: 155.7 symbols/min [2025-10-10T22:38:54.028730] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:54.029348] [INFO ] [MAIN ] GBTG: Generated 1820 derivative records from 40575 primary records. [2025-10-10T22:38:54.029412] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-10T22:38:54.044309] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1820 records). [2025-10-10T22:38:54.044379] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-10T22:38:54.046373] [INFO ] [MAIN ] Derivative Progress: 750/1823 symbols completed. GBTG took 0.8s. Estimated remaining: 6m 53s. Rate: 155.9 symbols/min [2025-10-10T22:38:54.046864] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:54.046789] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:54.047007] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:54.089013] [DEBUG] [LOCAL ] GCO: Loaded 24281 existing records from primary storage. [2025-10-10T22:38:54.089536] [DEBUG] [LOCAL ] GBX: Loaded 29532 existing records from primary storage. [2025-10-10T22:38:54.089915] [INFO ] [MAIN ] GCO: Loaded 24281 primary data records. [2025-10-10T22:38:54.110925] [INFO ] [MAIN ] GBX: Loaded 29532 primary data records. [2025-10-10T22:38:54.309475] [DEBUG] [LOCAL ] GCI: Loaded 44675 existing records from primary storage. [2025-10-10T22:38:54.333993] [INFO ] [MAIN ] GCI: Loaded 44675 primary data records. [2025-10-10T22:38:55.115970] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:55.129265] [INFO ] [MAIN ] GCO: Generated 1820 derivative records from 24281 primary records. [2025-10-10T22:38:55.130401] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-10T22:38:55.130593] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:55.132400] [INFO ] [MAIN ] GBX: Generated 1820 derivative records from 29532 primary records. [2025-10-10T22:38:55.132836] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-10T22:38:55.149548] [DEBUG] [LOCAL ] GCO: Derivative data saved (1820 records). [2025-10-10T22:38:55.156795] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-10T22:38:55.158781] [INFO ] [MAIN ] Derivative Progress: 751/1823 symbols completed. GCO took 1.1s. Estimated remaining: 6m 54s. Rate: 155.5 symbols/min [2025-10-10T22:38:55.159115] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:55.167949] [DEBUG] [LOCAL ] GBX: Derivative data saved (1820 records). [2025-10-10T22:38:55.168040] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-10T22:38:55.170068] [INFO ] [MAIN ] Derivative Progress: 752/1823 symbols completed. GBX took 1.1s. Estimated remaining: 6m 53s. Rate: 155.7 symbols/min [2025-10-10T22:38:55.170423] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:55.188635] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:55.189371] [INFO ] [MAIN ] GCI: Generated 1820 derivative records from 44675 primary records. [2025-10-10T22:38:55.189574] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-10T22:38:55.213487] [DEBUG] [LOCAL ] GCV: Loaded 7736 existing records from primary storage. [2025-10-10T22:38:55.215693] [INFO ] [MAIN ] GCV: Loaded 7736 primary data records. [2025-10-10T22:38:55.254746] [DEBUG] [LOCAL ] GCTS: Loaded 20601 existing records from primary storage. [2025-10-10T22:38:55.279166] [INFO ] [MAIN ] GCTS: Loaded 20601 primary data records. [2025-10-10T22:38:55.305725] [DEBUG] [LOCAL ] GCI: Derivative data saved (1820 records). [2025-10-10T22:38:55.312449] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-10T22:38:55.355504] [INFO ] [MAIN ] Derivative Progress: 753/1823 symbols completed. GCI took 1.3s. Estimated remaining: 6m 52s. Rate: 155.8 symbols/min [2025-10-10T22:38:55.383986] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:55.903619] [DEBUG] [LOCAL ] GD: Loaded 47478 existing records from primary storage. [2025-10-10T22:38:55.905489] [INFO ] [MAIN ] GD: Loaded 47478 primary data records. [2025-10-10T22:38:56.033058] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:56.055930] [INFO ] [MAIN ] GCV: Generated 1820 derivative records from 7736 primary records. [2025-10-10T22:38:56.068354] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-10T22:38:56.252268] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:56.253730] [INFO ] [MAIN ] GCTS: Generated 1820 derivative records from 20601 primary records. [2025-10-10T22:38:56.254127] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-10T22:38:56.257068] [DEBUG] [LOCAL ] GCV: Derivative data saved (1820 records). [2025-10-10T22:38:56.257729] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-10T22:38:56.260483] [INFO ] [MAIN ] Derivative Progress: 754/1823 symbols completed. GCV took 1.1s. Estimated remaining: 6m 52s. Rate: 155.6 symbols/min [2025-10-10T22:38:56.275146] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:56.280185] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1820 records). [2025-10-10T22:38:56.280329] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-10T22:38:56.282524] [INFO ] [MAIN ] Derivative Progress: 755/1823 symbols completed. GCTS took 1.1s. Estimated remaining: 6m 51s. Rate: 155.8 symbols/min [2025-10-10T22:38:56.282876] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:56.291454] [DEBUG] [LOCAL ] GDIV: Loaded 3659 existing records from primary storage. [2025-10-10T22:38:56.291844] [INFO ] [MAIN ] GDIV: Loaded 3659 primary data records. [2025-10-10T22:38:56.436763] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:56.448607] [INFO ] [MAIN ] GD: Generated 1820 derivative records from 47478 primary records. [2025-10-10T22:38:56.454674] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-10T22:38:56.548505] [DEBUG] [LOCAL ] GDDY: Loaded 50527 existing records from primary storage. [2025-10-10T22:38:56.552407] [INFO ] [MAIN ] GDDY: Loaded 50527 primary data records. [2025-10-10T22:38:56.556940] [DEBUG] [LOCAL ] GD: Derivative data saved (1820 records). [2025-10-10T22:38:56.662010] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-10T22:38:56.714943] [INFO ] [MAIN ] Derivative Progress: 756/1823 symbols completed. GD took 1.3s. Estimated remaining: 6m 51s. Rate: 155.7 symbols/min [2025-10-10T22:38:56.723864] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:56.835793] [DEBUG] [LOCAL ] GDL: Loaded 2585 existing records from primary storage. [2025-10-10T22:38:56.878156] [INFO ] [MAIN ] GDL: Loaded 2585 primary data records. [2025-10-10T22:38:57.359253] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-10-10T22:38:57.360146] [INFO ] [MAIN ] GDIV: Generated 1817 derivative records from 3659 primary records. [2025-10-10T22:38:57.360314] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-10T22:38:57.377594] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1817 records). [2025-10-10T22:38:57.377971] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-10T22:38:57.380011] [INFO ] [MAIN ] Derivative Progress: 757/1823 symbols completed. GDIV took 1.1s. Estimated remaining: 6m 51s. Rate: 155.6 symbols/min [2025-10-10T22:38:57.380593] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:57.403343] [DEBUG] [LOCAL ] GDO: Loaded 5982 existing records from primary storage. [2025-10-10T22:38:57.403145] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:57.403501] [INFO ] [MAIN ] GDO: Loaded 5982 primary data records. [2025-10-10T22:38:57.404262] [INFO ] [MAIN ] GDDY: Generated 1820 derivative records from 50527 primary records. [2025-10-10T22:38:57.426025] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-10T22:38:57.558601] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:57.587812] [INFO ] [MAIN ] GDL: Generated 1820 derivative records from 2585 primary records. [2025-10-10T22:38:57.624217] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1820 records). [2025-10-10T22:38:57.654799] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-10T22:38:57.720728] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-10T22:38:57.749761] [INFO ] [MAIN ] Derivative Progress: 758/1823 symbols completed. GDDY took 1.5s. Estimated remaining: 6m 51s. Rate: 155.6 symbols/min [2025-10-10T22:38:57.750981] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:57.771051] [DEBUG] [LOCAL ] GDL: Derivative data saved (1820 records). [2025-10-10T22:38:57.771439] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-10T22:38:57.773477] [INFO ] [MAIN ] Derivative Progress: 759/1823 symbols completed. GDL took 1.0s. Estimated remaining: 6m 50s. Rate: 155.8 symbols/min [2025-10-10T22:38:57.773696] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:57.809180] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:57.820365] [INFO ] [MAIN ] GDO: Generated 1820 derivative records from 5982 primary records. [2025-10-10T22:38:57.821399] [DEBUG] [LOCAL ] GDOT: Loaded 38316 existing records from primary storage. [2025-10-10T22:38:57.821523] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-10T22:38:57.827361] [INFO ] [MAIN ] GDOT: Loaded 38316 primary data records. [2025-10-10T22:38:57.857410] [DEBUG] [LOCAL ] GDV: Loaded 19886 existing records from primary storage. [2025-10-10T22:38:57.860350] [INFO ] [MAIN ] GDV: Loaded 19886 primary data records. [2025-10-10T22:38:57.918116] [DEBUG] [LOCAL ] GDO: Derivative data saved (1820 records). [2025-10-10T22:38:57.928392] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-10T22:38:57.980122] [INFO ] [MAIN ] Derivative Progress: 760/1823 symbols completed. GDO took 0.6s. Estimated remaining: 6m 49s. Rate: 155.9 symbols/min [2025-10-10T22:38:58.011506] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:58.515854] [DEBUG] [LOCAL ] GE: Loaded 54486 existing records from primary storage. [2025-10-10T22:38:58.516274] [INFO ] [MAIN ] GE: Loaded 54486 primary data records. [2025-10-10T22:38:58.627022] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:58.626561] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:58.653448] [INFO ] [MAIN ] GDOT: Generated 1820 derivative records from 38316 primary records. [2025-10-10T22:38:58.652599] [INFO ] [MAIN ] GDV: Generated 1820 derivative records from 19886 primary records. [2025-10-10T22:38:58.657049] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-10T22:38:58.657592] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-10T22:38:58.735859] [DEBUG] [LOCAL ] GDV: Derivative data saved (1820 records). [2025-10-10T22:38:58.735985] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-10T22:38:58.728184] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1820 records). [2025-10-10T22:38:58.753983] [INFO ] [MAIN ] Derivative Progress: 761/1823 symbols completed. GDV took 1.0s. Estimated remaining: 6m 49s. Rate: 155.7 symbols/min [2025-10-10T22:38:58.754073] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-10T22:38:58.774591] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:58.883283] [INFO ] [MAIN ] Derivative Progress: 762/1823 symbols completed. GDOT took 1.1s. Estimated remaining: 6m 49s. Rate: 155.8 symbols/min [2025-10-10T22:38:58.897450] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:58.934354] [DEBUG] [LOCAL ] GEF: Loaded 20991 existing records from primary storage. [2025-10-10T22:38:58.944695] [INFO ] [MAIN ] GEF: Loaded 20991 primary data records. [2025-10-10T22:38:58.950863] [DEBUG] [LOCAL ] GEL: Loaded 32658 existing records from primary storage. [2025-10-10T22:38:59.005709] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:59.021429] [INFO ] [MAIN ] GEL: Loaded 32658 primary data records. [2025-10-10T22:38:59.032200] [INFO ] [MAIN ] GE: Generated 1820 derivative records from 54486 primary records. [2025-10-10T22:38:59.037502] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-10T22:38:59.213262] [DEBUG] [LOCAL ] GE: Derivative data saved (1820 records). [2025-10-10T22:38:59.255528] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-10T22:38:59.454763] [INFO ] [MAIN ] Derivative Progress: 763/1823 symbols completed. GE took 1.4s. Estimated remaining: 6m 48s. Rate: 155.7 symbols/min [2025-10-10T22:38:59.734200] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:59.748999] [INFO ] [MAIN ] GEF: Generated 1820 derivative records from 20991 primary records. [2025-10-10T22:38:59.749858] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-10T22:38:59.749756] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:38:59.751485] [INFO ] [MAIN ] GEL: Generated 1820 derivative records from 32658 primary records. [2025-10-10T22:38:59.751589] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-10T22:38:59.785023] [DEBUG] [LOCAL ] GEL: Derivative data saved (1820 records). [2025-10-10T22:38:59.786376] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-10T22:38:59.788698] [INFO ] [MAIN ] Derivative Progress: 764/1823 symbols completed. GEL took 0.9s. Estimated remaining: 6m 48s. Rate: 155.7 symbols/min [2025-10-10T22:38:59.786493] [DEBUG] [LOCAL ] GEF: Derivative data saved (1820 records). [2025-10-10T22:38:59.789111] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-10T22:38:59.791945] [INFO ] [MAIN ] Derivative Progress: 765/1823 symbols completed. GEF took 1.0s. Estimated remaining: 6m 47s. Rate: 155.9 symbols/min [2025-10-10T22:38:59.792493] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:59.792615] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:59.793269] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:38:59.883798] [DEBUG] [LOCAL ] GES: Loaded 39210 existing records from primary storage. [2025-10-10T22:38:59.885568] [INFO ] [MAIN ] GES: Loaded 39210 primary data records. [2025-10-10T22:38:59.885177] [DEBUG] [LOCAL ] GENI: Loaded 53716 existing records from primary storage. [2025-10-10T22:38:59.904805] [INFO ] [MAIN ] GENI: Loaded 53716 primary data records. [2025-10-10T22:38:59.956229] [DEBUG] [LOCAL ] GEO: Loaded 52625 existing records from primary storage. [2025-10-10T22:39:00.038742] [INFO ] [MAIN ] GEO: Loaded 52625 primary data records. [2025-10-10T22:39:00.860070] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:00.861351] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:00.863061] [INFO ] [MAIN ] GENI: Generated 1820 derivative records from 53716 primary records. [2025-10-10T22:39:00.863177] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-10T22:39:00.863957] [INFO ] [MAIN ] GES: Generated 1820 derivative records from 39210 primary records. [2025-10-10T22:39:00.885123] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:00.865118] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-10T22:39:00.885922] [INFO ] [MAIN ] GEO: Generated 1820 derivative records from 52625 primary records. [2025-10-10T22:39:00.894717] [DEBUG] [LOCAL ] GENI: Derivative data saved (1820 records). [2025-10-10T22:39:00.889962] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-10T22:39:00.894898] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-10T22:39:00.897312] [INFO ] [MAIN ] Derivative Progress: 766/1823 symbols completed. GENI took 1.1s. Estimated remaining: 6m 48s. Rate: 155.6 symbols/min [2025-10-10T22:39:00.897668] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:00.929947] [DEBUG] [LOCAL ] GEO: Derivative data saved (1820 records). [2025-10-10T22:39:00.930404] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-10T22:39:00.930335] [DEBUG] [LOCAL ] GES: Derivative data saved (1820 records). [2025-10-10T22:39:00.932669] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-10T22:39:00.932567] [INFO ] [MAIN ] Derivative Progress: 767/1823 symbols completed. GEO took 1.1s. Estimated remaining: 6m 47s. Rate: 155.7 symbols/min [2025-10-10T22:39:00.932933] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:00.934748] [INFO ] [MAIN ] Derivative Progress: 768/1823 symbols completed. GES took 1.1s. Estimated remaining: 6m 46s. Rate: 155.9 symbols/min [2025-10-10T22:39:00.934981] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:00.951015] [DEBUG] [LOCAL ] GF: Loaded 2802 existing records from primary storage. [2025-10-10T22:39:00.951240] [INFO ] [MAIN ] GF: Loaded 2802 primary data records. [2025-10-10T22:39:01.077680] [DEBUG] [LOCAL ] GETY: Loaded 35855 existing records from primary storage. [2025-10-10T22:39:01.094974] [INFO ] [MAIN ] GETY: Loaded 35855 primary data records. [2025-10-10T22:39:01.479915] [DEBUG] [LOCAL ] GEV: Loaded 53780 existing records from primary storage. [2025-10-10T22:39:01.575371] [INFO ] [MAIN ] GEV: Loaded 53780 primary data records. [2025-10-10T22:39:01.974617] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:01.975414] [INFO ] [MAIN ] GF: Generated 1820 derivative records from 2802 primary records. [2025-10-10T22:39:01.975498] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-10T22:39:02.117866] [DEBUG] [LOCAL ] GF: Derivative data saved (1820 records). [2025-10-10T22:39:02.118117] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-10T22:39:02.120219] [INFO ] [MAIN ] Derivative Progress: 769/1823 symbols completed. GF took 1.2s. Estimated remaining: 6m 47s. Rate: 155.5 symbols/min [2025-10-10T22:39:02.121863] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:02.139741] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:02.140578] [INFO ] [MAIN ] GETY: Generated 1820 derivative records from 35855 primary records. [2025-10-10T22:39:02.140951] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-10T22:39:02.170436] [DEBUG] [LOCAL ] GETY: Derivative data saved (1820 records). [2025-10-10T22:39:02.183275] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-10T22:39:02.183707] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:02.186731] [INFO ] [MAIN ] GEV: Generated 1820 derivative records from 53780 primary records. [2025-10-10T22:39:02.185668] [INFO ] [MAIN ] Derivative Progress: 770/1823 symbols completed. GETY took 1.3s. Estimated remaining: 6m 46s. Rate: 155.7 symbols/min [2025-10-10T22:39:02.186988] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:02.187144] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-10T22:39:02.213355] [DEBUG] [LOCAL ] GFF: Loaded 30567 existing records from primary storage. [2025-10-10T22:39:02.214114] [INFO ] [MAIN ] GFF: Loaded 30567 primary data records. [2025-10-10T22:39:02.227320] [DEBUG] [LOCAL ] GEV: Derivative data saved (1820 records). [2025-10-10T22:39:02.247128] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-10T22:39:02.261429] [INFO ] [MAIN ] Derivative Progress: 771/1823 symbols completed. GEV took 1.3s. Estimated remaining: 6m 45s. Rate: 155.8 symbols/min [2025-10-10T22:39:02.299743] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:02.571443] [DEBUG] [LOCAL ] GFI: Loaded 53878 existing records from primary storage. [2025-10-10T22:39:02.572054] [INFO ] [MAIN ] GFI: Loaded 53878 primary data records. [2025-10-10T22:39:02.712050] [DEBUG] [LOCAL ] GFL: Loaded 48588 existing records from primary storage. [2025-10-10T22:39:02.723348] [INFO ] [MAIN ] GFL: Loaded 48588 primary data records. [2025-10-10T22:39:03.124287] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:03.132130] [INFO ] [MAIN ] GFF: Generated 1820 derivative records from 30567 primary records. [2025-10-10T22:39:03.132970] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-10T22:39:03.276960] [DEBUG] [LOCAL ] GFF: Derivative data saved (1820 records). [2025-10-10T22:39:03.279460] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-10T22:39:03.281730] [INFO ] [MAIN ] Derivative Progress: 772/1823 symbols completed. GFF took 1.2s. Estimated remaining: 6m 45s. Rate: 155.5 symbols/min [2025-10-10T22:39:03.283130] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:03.297464] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:03.298349] [INFO ] [MAIN ] GFI: Generated 1820 derivative records from 53878 primary records. [2025-10-10T22:39:03.298539] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-10T22:39:03.317492] [DEBUG] [LOCAL ] GFR: Loaded 8021 existing records from primary storage. [2025-10-10T22:39:03.318784] [INFO ] [MAIN ] GFR: Loaded 8021 primary data records. [2025-10-10T22:39:03.406170] [DEBUG] [LOCAL ] GFI: Derivative data saved (1820 records). [2025-10-10T22:39:03.425942] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-10T22:39:03.431323] [INFO ] [MAIN ] Derivative Progress: 773/1823 symbols completed. GFI took 1.2s. Estimated remaining: 6m 45s. Rate: 155.6 symbols/min [2025-10-10T22:39:03.431524] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:03.464014] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:03.490293] [INFO ] [MAIN ] GFL: Generated 1820 derivative records from 48588 primary records. [2025-10-10T22:39:03.531051] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-10T22:39:03.705400] [DEBUG] [LOCAL ] GFL: Derivative data saved (1820 records). [2025-10-10T22:39:03.705924] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-10T22:39:03.708151] [INFO ] [MAIN ] Derivative Progress: 774/1823 symbols completed. GFL took 1.4s. Estimated remaining: 6m 44s. Rate: 155.7 symbols/min [2025-10-10T22:39:03.708585] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:03.747999] [DEBUG] [LOCAL ] GGB: Loaded 51931 existing records from primary storage. [2025-10-10T22:39:03.755900] [INFO ] [MAIN ] GGB: Loaded 51931 primary data records. [2025-10-10T22:39:03.777112] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:03.794517] [INFO ] [MAIN ] GFR: Generated 1820 derivative records from 8021 primary records. [2025-10-10T22:39:03.817526] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-10T22:39:03.916671] [DEBUG] [LOCAL ] GGG: Loaded 41367 existing records from primary storage. [2025-10-10T22:39:03.936088] [INFO ] [MAIN ] GGG: Loaded 41367 primary data records. [2025-10-10T22:39:04.053350] [DEBUG] [LOCAL ] GFR: Derivative data saved (1820 records). [2025-10-10T22:39:04.196208] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-10T22:39:04.204154] [INFO ] [MAIN ] Derivative Progress: 775/1823 symbols completed. GFR took 0.9s. Estimated remaining: 6m 44s. Rate: 155.6 symbols/min [2025-10-10T22:39:04.213192] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:04.345532] [DEBUG] [LOCAL ] GGT: Loaded 14394 existing records from primary storage. [2025-10-10T22:39:04.345731] [INFO ] [MAIN ] GGT: Loaded 14394 primary data records. [2025-10-10T22:39:04.805720] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:04.807484] [INFO ] [MAIN ] GGB: Generated 1820 derivative records from 51931 primary records. [2025-10-10T22:39:04.807917] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-10T22:39:04.841764] [DEBUG] [LOCAL ] GGB: Derivative data saved (1820 records). [2025-10-10T22:39:04.842051] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:04.842938] [INFO ] [MAIN ] GGG: Generated 1820 derivative records from 41367 primary records. [2025-10-10T22:39:04.843171] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-10T22:39:04.842209] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-10T22:39:04.845543] [INFO ] [MAIN ] Derivative Progress: 776/1823 symbols completed. GGB took 1.4s. Estimated remaining: 6m 44s. Rate: 155.5 symbols/min [2025-10-10T22:39:04.845975] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:04.865045] [DEBUG] [LOCAL ] GGZ: Loaded 2465 existing records from primary storage. [2025-10-10T22:39:04.866282] [INFO ] [MAIN ] GGZ: Loaded 2465 primary data records. [2025-10-10T22:39:04.898880] [DEBUG] [LOCAL ] GGG: Derivative data saved (1820 records). [2025-10-10T22:39:04.911166] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-10T22:39:04.914351] [INFO ] [MAIN ] Derivative Progress: 777/1823 symbols completed. GGG took 1.2s. Estimated remaining: 6m 43s. Rate: 155.7 symbols/min [2025-10-10T22:39:04.935609] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:05.004345] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:05.003926] [DEBUG] [LOCAL ] GHC: Loaded 2905 existing records from primary storage. [2025-10-10T22:39:05.034041] [INFO ] [MAIN ] GGT: Generated 1820 derivative records from 14394 primary records. [2025-10-10T22:39:05.052686] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-10T22:39:05.019962] [INFO ] [MAIN ] GHC: Loaded 2905 primary data records. [2025-10-10T22:39:05.300467] [DEBUG] [LOCAL ] GGT: Derivative data saved (1820 records). [2025-10-10T22:39:05.311630] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-10T22:39:05.314209] [INFO ] [MAIN ] Derivative Progress: 778/1823 symbols completed. GGT took 1.1s. Estimated remaining: 6m 43s. Rate: 155.7 symbols/min [2025-10-10T22:39:05.566241] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:05.566950] [INFO ] [MAIN ] GGZ: Generated 1820 derivative records from 2465 primary records. [2025-10-10T22:39:05.567100] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-10T22:39:05.583493] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1820 records). [2025-10-10T22:39:05.583626] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-10T22:39:05.586093] [INFO ] [MAIN ] Derivative Progress: 779/1823 symbols completed. GGZ took 0.7s. Estimated remaining: 6m 42s. Rate: 155.7 symbols/min [2025-10-10T22:39:05.598688] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:05.599225] [INFO ] [MAIN ] GHC: Generated 1820 derivative records from 2905 primary records. [2025-10-10T22:39:05.599283] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-10T22:39:05.613250] [DEBUG] [LOCAL ] GHC: Derivative data saved (1820 records). [2025-10-10T22:39:05.613313] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-10T22:39:05.615446] [INFO ] [MAIN ] Derivative Progress: 780/1823 symbols completed. GHC took 0.7s. Estimated remaining: 6m 41s. Rate: 155.9 symbols/min [2025-10-10T22:39:05.616058] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:05.616151] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:05.616406] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:05.622270] [DEBUG] [LOCAL ] GHG: Loaded 3294 existing records from primary storage. [2025-10-10T22:39:05.622409] [INFO ] [MAIN ] GHG: Loaded 3294 primary data records. [2025-10-10T22:39:05.716311] [DEBUG] [LOCAL ] GHI: Loaded 7339 existing records from primary storage. [2025-10-10T22:39:05.732463] [INFO ] [MAIN ] GHI: Loaded 7339 primary data records. [2025-10-10T22:39:05.716541] [DEBUG] [LOCAL ] GHLD: Loaded 4263 existing records from primary storage. [2025-10-10T22:39:05.732912] [INFO ] [MAIN ] GHLD: Loaded 4263 primary data records. [2025-10-10T22:39:06.579203] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:39:06.580451] [INFO ] [MAIN ] GHG: Generated 1819 derivative records from 3294 primary records. [2025-10-10T22:39:06.580756] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-10T22:39:06.607672] [DEBUG] [LOCAL ] GHG: Derivative data saved (1819 records). [2025-10-10T22:39:06.612669] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-10T22:39:06.614930] [INFO ] [MAIN ] Derivative Progress: 781/1823 symbols completed. GHG took 1.0s. Estimated remaining: 6m 42s. Rate: 155.6 symbols/min [2025-10-10T22:39:06.615316] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:06.615664] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:06.616768] [INFO ] [MAIN ] GHLD: Generated 1820 derivative records from 4263 primary records. [2025-10-10T22:39:06.616834] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-10T22:39:06.640342] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:06.644936] [INFO ] [MAIN ] GHI: Generated 1820 derivative records from 7339 primary records. [2025-10-10T22:39:06.645029] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-10T22:39:06.644240] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1820 records). [2025-10-10T22:39:06.649939] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-10T22:39:06.652127] [INFO ] [MAIN ] Derivative Progress: 782/1823 symbols completed. GHLD took 1.0s. Estimated remaining: 6m 41s. Rate: 155.8 symbols/min [2025-10-10T22:39:06.652520] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:06.674216] [DEBUG] [LOCAL ] GHM: Loaded 14401 existing records from primary storage. [2025-10-10T22:39:06.675139] [INFO ] [MAIN ] GHM: Loaded 14401 primary data records. [2025-10-10T22:39:06.675507] [DEBUG] [LOCAL ] GHI: Derivative data saved (1820 records). [2025-10-10T22:39:06.707138] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-10T22:39:06.714482] [INFO ] [MAIN ] Derivative Progress: 783/1823 symbols completed. GHI took 1.1s. Estimated remaining: 6m 40s. Rate: 155.9 symbols/min [2025-10-10T22:39:06.721377] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:06.796406] [DEBUG] [LOCAL ] GHY: Loaded 21183 existing records from primary storage. [2025-10-10T22:39:06.823200] [INFO ] [MAIN ] GHY: Loaded 21183 primary data records. [2025-10-10T22:39:07.353940] [DEBUG] [LOCAL ] GIB: Loaded 32258 existing records from primary storage. [2025-10-10T22:39:07.354753] [INFO ] [MAIN ] GIB: Loaded 32258 primary data records. [2025-10-10T22:39:07.677199] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:07.678794] [INFO ] [MAIN ] GHM: Generated 1820 derivative records from 14401 primary records. [2025-10-10T22:39:07.679020] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-10T22:39:07.701783] [DEBUG] [LOCAL ] GHM: Derivative data saved (1820 records). [2025-10-10T22:39:07.702024] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-10T22:39:07.704736] [INFO ] [MAIN ] Derivative Progress: 784/1823 symbols completed. GHM took 1.1s. Estimated remaining: 6m 41s. Rate: 155.6 symbols/min [2025-10-10T22:39:07.704989] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:07.719392] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:07.720303] [INFO ] [MAIN ] GHY: Generated 1820 derivative records from 21183 primary records. [2025-10-10T22:39:07.720482] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-10T22:39:07.748871] [DEBUG] [LOCAL ] GIC: Loaded 13577 existing records from primary storage. [2025-10-10T22:39:07.748303] [DEBUG] [LOCAL ] GHY: Derivative data saved (1820 records). [2025-10-10T22:39:07.749169] [INFO ] [MAIN ] GIC: Loaded 13577 primary data records. [2025-10-10T22:39:07.749256] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-10T22:39:07.762752] [INFO ] [MAIN ] Derivative Progress: 785/1823 symbols completed. GHY took 1.1s. Estimated remaining: 6m 40s. Rate: 155.8 symbols/min [2025-10-10T22:39:07.783822] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:07.876126] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:07.877448] [INFO ] [MAIN ] GIB: Generated 1820 derivative records from 32258 primary records. [2025-10-10T22:39:07.882898] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-10T22:39:08.085336] [DEBUG] [LOCAL ] GIB: Derivative data saved (1820 records). [2025-10-10T22:39:08.092830] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-10T22:39:08.095102] [INFO ] [MAIN ] Derivative Progress: 786/1823 symbols completed. GIB took 1.4s. Estimated remaining: 6m 39s. Rate: 155.8 symbols/min [2025-10-10T22:39:08.095296] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:08.133975] [DEBUG] [LOCAL ] GIL: Loaded 44393 existing records from primary storage. [2025-10-10T22:39:08.134593] [INFO ] [MAIN ] GIL: Loaded 44393 primary data records. [2025-10-10T22:39:08.505861] [DEBUG] [LOCAL ] GIS: Loaded 54452 existing records from primary storage. [2025-10-10T22:39:08.506818] [INFO ] [MAIN ] GIS: Loaded 54452 primary data records. [2025-10-10T22:39:08.504458] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:08.508268] [INFO ] [MAIN ] GIC: Generated 1820 derivative records from 13577 primary records. [2025-10-10T22:39:08.508935] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-10T22:39:08.644541] [DEBUG] [LOCAL ] GIC: Derivative data saved (1820 records). [2025-10-10T22:39:08.650424] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-10T22:39:08.658083] [INFO ] [MAIN ] Derivative Progress: 787/1823 symbols completed. GIC took 1.0s. Estimated remaining: 6m 39s. Rate: 155.7 symbols/min [2025-10-10T22:39:08.663609] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:08.868735] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:08.870584] [INFO ] [MAIN ] GIL: Generated 1820 derivative records from 44393 primary records. [2025-10-10T22:39:08.870877] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-10T22:39:08.902708] [DEBUG] [LOCAL ] GIL: Derivative data saved (1820 records). [2025-10-10T22:39:08.902984] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-10T22:39:08.905350] [INFO ] [MAIN ] Derivative Progress: 788/1823 symbols completed. GIL took 1.1s. Estimated remaining: 6m 39s. Rate: 155.8 symbols/min [2025-10-10T22:39:08.907000] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:08.922668] [DEBUG] [LOCAL ] GKOS: Loaded 43125 existing records from primary storage. [2025-10-10T22:39:08.923119] [INFO ] [MAIN ] GKOS: Loaded 43125 primary data records. [2025-10-10T22:39:09.079268] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:09.131967] [INFO ] [MAIN ] GIS: Generated 1820 derivative records from 54452 primary records. [2025-10-10T22:39:09.150679] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-10T22:39:09.272668] [DEBUG] [LOCAL ] GL: Loaded 38358 existing records from primary storage. [2025-10-10T22:39:09.273052] [INFO ] [MAIN ] GL: Loaded 38358 primary data records. [2025-10-10T22:39:09.395975] [DEBUG] [LOCAL ] GIS: Derivative data saved (1820 records). [2025-10-10T22:39:09.450221] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-10T22:39:09.483587] [INFO ] [MAIN ] Derivative Progress: 789/1823 symbols completed. GIS took 1.4s. Estimated remaining: 6m 38s. Rate: 155.7 symbols/min [2025-10-10T22:39:09.613996] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:09.653801] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:09.655190] [INFO ] [MAIN ] GKOS: Generated 1820 derivative records from 43125 primary records. [2025-10-10T22:39:09.655295] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-10T22:39:09.685279] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1820 records). [2025-10-10T22:39:09.685500] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-10T22:39:09.687608] [INFO ] [MAIN ] Derivative Progress: 790/1823 symbols completed. GKOS took 1.0s. Estimated remaining: 6m 38s. Rate: 155.8 symbols/min [2025-10-10T22:39:09.688074] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:09.705199] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:09.708297] [INFO ] [MAIN ] GL: Generated 1820 derivative records from 38358 primary records. [2025-10-10T22:39:09.708490] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-10T22:39:09.743375] [DEBUG] [LOCAL ] GL: Derivative data saved (1820 records). [2025-10-10T22:39:09.739120] [DEBUG] [LOCAL ] GLP: Loaded 9370 existing records from primary storage. [2025-10-10T22:39:09.743494] [INFO ] [MAIN ] GLP: Loaded 9370 primary data records. [2025-10-10T22:39:09.744672] [DEBUG] [LOCAL ] GLOB: Loaded 48507 existing records from primary storage. [2025-10-10T22:39:09.744781] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-10T22:39:09.765738] [INFO ] [MAIN ] GLOB: Loaded 48507 primary data records. [2025-10-10T22:39:09.768033] [INFO ] [MAIN ] Derivative Progress: 791/1823 symbols completed. GL took 0.9s. Estimated remaining: 6m 37s. Rate: 155.9 symbols/min [2025-10-10T22:39:09.802168] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:10.398068] [DEBUG] [LOCAL ] GLW: Loaded 54416 existing records from primary storage. [2025-10-10T22:39:10.398711] [INFO ] [MAIN ] GLW: Loaded 54416 primary data records. [2025-10-10T22:39:10.533956] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:10.672118] [INFO ] [MAIN ] GLOB: Generated 1820 derivative records from 48507 primary records. [2025-10-10T22:39:10.734766] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-10T22:39:10.736192] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:10.737956] [INFO ] [MAIN ] GLP: Generated 1820 derivative records from 9370 primary records. [2025-10-10T22:39:10.738057] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-10T22:39:10.766158] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1820 records). [2025-10-10T22:39:10.774333] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-10T22:39:10.774544] [DEBUG] [LOCAL ] GLP: Derivative data saved (1820 records). [2025-10-10T22:39:10.777546] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-10T22:39:10.777354] [INFO ] [MAIN ] Derivative Progress: 792/1823 symbols completed. GLOB took 1.2s. Estimated remaining: 6m 37s. Rate: 155.6 symbols/min [2025-10-10T22:39:10.780026] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:10.780353] [INFO ] [MAIN ] Derivative Progress: 793/1823 symbols completed. GLP took 1.1s. Estimated remaining: 6m 37s. Rate: 155.8 symbols/min [2025-10-10T22:39:10.806833] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:10.807957] [INFO ] [MAIN ] GLW: Generated 1820 derivative records from 54416 primary records. [2025-10-10T22:39:10.808038] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-10T22:39:10.829336] [DEBUG] [LOCAL ] GLW: Derivative data saved (1820 records). [2025-10-10T22:39:10.829562] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-10T22:39:10.845369] [INFO ] [MAIN ] Derivative Progress: 794/1823 symbols completed. GLW took 1.0s. Estimated remaining: 6m 36s. Rate: 156.0 symbols/min [2025-10-10T22:39:10.866186] [DEBUG] [LOCAL ] GM: Loaded 54509 existing records from primary storage. [2025-10-10T22:39:10.866328] [INFO ] [MAIN ] GM: Loaded 54509 primary data records. [2025-10-10T22:39:11.202417] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:11.203037] [INFO ] [MAIN ] GM: Generated 1820 derivative records from 54509 primary records. [2025-10-10T22:39:11.203100] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-10T22:39:11.218122] [DEBUG] [LOCAL ] GM: Derivative data saved (1820 records). [2025-10-10T22:39:11.218183] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-10T22:39:11.220221] [INFO ] [MAIN ] Derivative Progress: 795/1823 symbols completed. GM took 0.4s. Estimated remaining: 6m 35s. Rate: 156.0 symbols/min [2025-10-10T22:39:11.220775] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:11.220712] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:11.220885] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:11.291142] [DEBUG] [LOCAL ] GME: Loaded 54563 existing records from primary storage. [2025-10-10T22:39:11.292069] [INFO ] [MAIN ] GME: Loaded 54563 primary data records. [2025-10-10T22:39:11.379505] [DEBUG] [LOCAL ] GMED: Loaded 49041 existing records from primary storage. [2025-10-10T22:39:11.396586] [DEBUG] [LOCAL ] GMRE: Loaded 37595 existing records from primary storage. [2025-10-10T22:39:11.417440] [INFO ] [MAIN ] GMED: Loaded 49041 primary data records. [2025-10-10T22:39:11.417304] [INFO ] [MAIN ] GMRE: Loaded 37595 primary data records. [2025-10-10T22:39:12.280423] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:12.282812] [INFO ] [MAIN ] GME: Generated 1820 derivative records from 54563 primary records. [2025-10-10T22:39:12.283051] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-10T22:39:12.310711] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:12.312715] [INFO ] [MAIN ] GMED: Generated 1820 derivative records from 49041 primary records. [2025-10-10T22:39:12.313121] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-10T22:39:12.339842] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:12.341440] [INFO ] [MAIN ] GMRE: Generated 1820 derivative records from 37595 primary records. [2025-10-10T22:39:12.342566] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-10T22:39:12.345171] [DEBUG] [LOCAL ] GME: Derivative data saved (1820 records). [2025-10-10T22:39:12.355198] [DEBUG] [LOCAL ] GMED: Derivative data saved (1820 records). [2025-10-10T22:39:12.361910] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-10T22:39:12.361799] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1820 records). [2025-10-10T22:39:12.364148] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-10T22:39:12.353332] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-10T22:39:12.364066] [INFO ] [MAIN ] Derivative Progress: 796/1823 symbols completed. GMED took 1.1s. Estimated remaining: 6m 36s. Rate: 155.6 symbols/min [2025-10-10T22:39:12.366566] [INFO ] [MAIN ] Derivative Progress: 797/1823 symbols completed. GMRE took 1.1s. Estimated remaining: 6m 35s. Rate: 155.8 symbols/min [2025-10-10T22:39:12.366503] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:12.368683] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:12.369349] [INFO ] [MAIN ] Derivative Progress: 798/1823 symbols completed. GME took 1.1s. Estimated remaining: 6m 34s. Rate: 156.0 symbols/min [2025-10-10T22:39:12.369628] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:12.390689] [DEBUG] [LOCAL ] GNE: Loaded 18049 existing records from primary storage. [2025-10-10T22:39:12.391119] [INFO ] [MAIN ] GNE: Loaded 18049 primary data records. [2025-10-10T22:39:12.595063] [DEBUG] [LOCAL ] GNK: Loaded 40846 existing records from primary storage. [2025-10-10T22:39:12.716399] [INFO ] [MAIN ] GNK: Loaded 40846 primary data records. [2025-10-10T22:39:12.725367] [DEBUG] [LOCAL ] GNL: Loaded 47438 existing records from primary storage. [2025-10-10T22:39:12.725817] [INFO ] [MAIN ] GNL: Loaded 47438 primary data records. [2025-10-10T22:39:13.407073] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:13.408957] [INFO ] [MAIN ] GNE: Generated 1820 derivative records from 18049 primary records. [2025-10-10T22:39:13.409061] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-10T22:39:13.427715] [DEBUG] [LOCAL ] GNE: Derivative data saved (1820 records). [2025-10-10T22:39:13.428916] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-10T22:39:13.430926] [INFO ] [MAIN ] Derivative Progress: 799/1823 symbols completed. GNE took 1.1s. Estimated remaining: 6m 35s. Rate: 155.7 symbols/min [2025-10-10T22:39:13.431915] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:13.448087] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:13.448823] [INFO ] [MAIN ] GNK: Generated 1820 derivative records from 40846 primary records. [2025-10-10T22:39:13.449059] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-10T22:39:13.478440] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:13.480392] [INFO ] [MAIN ] GNL: Generated 1820 derivative records from 47438 primary records. [2025-10-10T22:39:13.481328] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-10T22:39:13.495349] [DEBUG] [LOCAL ] GNK: Derivative data saved (1820 records). [2025-10-10T22:39:13.496567] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-10T22:39:13.500673] [INFO ] [MAIN ] Derivative Progress: 800/1823 symbols completed. GNK took 1.1s. Estimated remaining: 6m 34s. Rate: 155.8 symbols/min [2025-10-10T22:39:13.501174] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:13.503434] [DEBUG] [LOCAL ] GNL: Derivative data saved (1820 records). [2025-10-10T22:39:13.503632] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-10T22:39:13.505921] [INFO ] [MAIN ] Derivative Progress: 801/1823 symbols completed. GNL took 1.1s. Estimated remaining: 6m 33s. Rate: 156.0 symbols/min [2025-10-10T22:39:13.516551] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:13.525063] [DEBUG] [LOCAL ] GNT: Loaded 8428 existing records from primary storage. [2025-10-10T22:39:13.525192] [INFO ] [MAIN ] GNT: Loaded 8428 primary data records. [2025-10-10T22:39:13.644895] [DEBUG] [LOCAL ] GNRC: Loaded 45960 existing records from primary storage. [2025-10-10T22:39:13.650987] [INFO ] [MAIN ] GNRC: Loaded 45960 primary data records. [2025-10-10T22:39:14.074923] [DEBUG] [LOCAL ] GNW: Loaded 52114 existing records from primary storage. [2025-10-10T22:39:14.163720] [INFO ] [MAIN ] GNW: Loaded 52114 primary data records. [2025-10-10T22:39:14.495172] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:14.496323] [INFO ] [MAIN ] GNT: Generated 1820 derivative records from 8428 primary records. [2025-10-10T22:39:14.496591] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-10T22:39:14.517878] [DEBUG] [LOCAL ] GNT: Derivative data saved (1820 records). [2025-10-10T22:39:14.518114] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-10T22:39:14.520407] [INFO ] [MAIN ] Derivative Progress: 802/1823 symbols completed. GNT took 1.0s. Estimated remaining: 6m 33s. Rate: 155.7 symbols/min [2025-10-10T22:39:14.534289] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:14.534794] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:14.535704] [INFO ] [MAIN ] GNRC: Generated 1820 derivative records from 45960 primary records. [2025-10-10T22:39:14.536019] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-10T22:39:14.559490] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1820 records). [2025-10-10T22:39:14.559970] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-10T22:39:14.562418] [INFO ] [MAIN ] Derivative Progress: 803/1823 symbols completed. GNRC took 1.1s. Estimated remaining: 6m 33s. Rate: 155.9 symbols/min [2025-10-10T22:39:14.562619] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:14.576022] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:14.576766] [INFO ] [MAIN ] GNW: Generated 1820 derivative records from 52114 primary records. [2025-10-10T22:39:14.576867] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-10T22:39:14.602224] [DEBUG] [LOCAL ] GNW: Derivative data saved (1820 records). [2025-10-10T22:39:14.602352] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-10T22:39:14.604469] [INFO ] [MAIN ] Derivative Progress: 804/1823 symbols completed. GNW took 1.1s. Estimated remaining: 6m 32s. Rate: 156.0 symbols/min [2025-10-10T22:39:14.604763] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:14.630096] [DEBUG] [LOCAL ] GOF: Loaded 43182 existing records from primary storage. [2025-10-10T22:39:14.630819] [INFO ] [MAIN ] GOF: Loaded 43182 primary data records. [2025-10-10T22:39:14.675592] [DEBUG] [LOCAL ] GOLF: Loaded 31437 existing records from primary storage. [2025-10-10T22:39:14.675874] [INFO ] [MAIN ] GOLF: Loaded 31437 primary data records. [2025-10-10T22:39:15.105746] [DEBUG] [LOCAL ] GOOS: Loaded 45406 existing records from primary storage. [2025-10-10T22:39:15.140092] [INFO ] [MAIN ] GOOS: Loaded 45406 primary data records. [2025-10-10T22:39:15.617325] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:15.618320] [INFO ] [MAIN ] GOF: Generated 1820 derivative records from 43182 primary records. [2025-10-10T22:39:15.618435] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-10T22:39:15.644207] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:15.646513] [INFO ] [MAIN ] GOLF: Generated 1820 derivative records from 31437 primary records. [2025-10-10T22:39:15.647023] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-10T22:39:15.650726] [DEBUG] [LOCAL ] GOF: Derivative data saved (1820 records). [2025-10-10T22:39:15.651072] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-10T22:39:15.664003] [INFO ] [MAIN ] Derivative Progress: 805/1823 symbols completed. GOF took 1.1s. Estimated remaining: 6m 32s. Rate: 155.7 symbols/min [2025-10-10T22:39:15.664371] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:15.672069] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1820 records). [2025-10-10T22:39:15.679744] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-10T22:39:15.686553] [INFO ] [MAIN ] Derivative Progress: 806/1823 symbols completed. GOLF took 1.1s. Estimated remaining: 6m 31s. Rate: 155.9 symbols/min [2025-10-10T22:39:15.686843] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:15.687795] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:15.688556] [INFO ] [MAIN ] GOOS: Generated 1820 derivative records from 45406 primary records. [2025-10-10T22:39:15.688740] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-10T22:39:15.714817] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1820 records). [2025-10-10T22:39:15.716363] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-10T22:39:15.718897] [INFO ] [MAIN ] Derivative Progress: 807/1823 symbols completed. GOOS took 1.1s. Estimated remaining: 6m 31s. Rate: 156.1 symbols/min [2025-10-10T22:39:15.719198] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:15.733047] [DEBUG] [LOCAL ] GOTU: Loaded 38292 existing records from primary storage. [2025-10-10T22:39:15.733180] [INFO ] [MAIN ] GOTU: Loaded 38292 primary data records. [2025-10-10T22:39:15.854062] [DEBUG] [LOCAL ] GPI: Loaded 14872 existing records from primary storage. [2025-10-10T22:39:15.864985] [INFO ] [MAIN ] GPI: Loaded 14872 primary data records. [2025-10-10T22:39:15.972871] [DEBUG] [LOCAL ] GPC: Loaded 46854 existing records from primary storage. [2025-10-10T22:39:16.132390] [INFO ] [MAIN ] GPC: Loaded 46854 primary data records. [2025-10-10T22:39:16.684628] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:16.685740] [INFO ] [MAIN ] GOTU: Generated 1820 derivative records from 38292 primary records. [2025-10-10T22:39:16.686020] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-10T22:39:16.705751] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1820 records). [2025-10-10T22:39:16.705982] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-10T22:39:16.708031] [INFO ] [MAIN ] Derivative Progress: 808/1823 symbols completed. GOTU took 1.0s. Estimated remaining: 6m 31s. Rate: 155.7 symbols/min [2025-10-10T22:39:16.721624] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:39:16.722342] [INFO ] [MAIN ] GPI: Generated 1819 derivative records from 14872 primary records. [2025-10-10T22:39:16.722587] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-10T22:39:16.740892] [DEBUG] [LOCAL ] GPI: Derivative data saved (1819 records). [2025-10-10T22:39:16.753028] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-10T22:39:16.755613] [INFO ] [MAIN ] Derivative Progress: 809/1823 symbols completed. GPI took 1.0s. Estimated remaining: 6m 30s. Rate: 155.9 symbols/min [2025-10-10T22:39:16.753221] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:16.756398] [INFO ] [MAIN ] GPC: Generated 1820 derivative records from 46854 primary records. [2025-10-10T22:39:16.756579] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-10T22:39:16.772563] [DEBUG] [LOCAL ] GPC: Derivative data saved (1820 records). [2025-10-10T22:39:16.772621] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-10T22:39:16.774732] [INFO ] [MAIN ] Derivative Progress: 810/1823 symbols completed. GPC took 1.1s. Estimated remaining: 6m 29s. Rate: 156.1 symbols/min [2025-10-10T22:39:16.775347] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:16.775433] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:16.775287] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:16.782812] [DEBUG] [LOCAL ] GPJA: Loaded 4306 existing records from primary storage. [2025-10-10T22:39:16.782946] [INFO ] [MAIN ] GPJA: Loaded 4306 primary data records. [2025-10-10T22:39:16.974571] [DEBUG] [LOCAL ] GPMT: Loaded 26136 existing records from primary storage. [2025-10-10T22:39:16.980395] [INFO ] [MAIN ] GPMT: Loaded 26136 primary data records. [2025-10-10T22:39:17.314532] [DEBUG] [LOCAL ] GPK: Loaded 53446 existing records from primary storage. [2025-10-10T22:39:17.370719] [INFO ] [MAIN ] GPK: Loaded 53446 primary data records. [2025-10-10T22:39:17.785171] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:39:17.787262] [INFO ] [MAIN ] GPJA: Generated 1819 derivative records from 4306 primary records. [2025-10-10T22:39:17.787846] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-10T22:39:17.826950] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:17.827987] [INFO ] [MAIN ] GPMT: Generated 1820 derivative records from 26136 primary records. [2025-10-10T22:39:17.828233] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-10T22:39:17.826586] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1819 records). [2025-10-10T22:39:17.829220] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-10T22:39:17.831790] [INFO ] [MAIN ] Derivative Progress: 811/1823 symbols completed. GPJA took 1.1s. Estimated remaining: 6m 30s. Rate: 155.8 symbols/min [2025-10-10T22:39:17.845051] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:17.848061] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1820 records). [2025-10-10T22:39:17.849909] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-10T22:39:17.852936] [INFO ] [MAIN ] Derivative Progress: 812/1823 symbols completed. GPMT took 1.1s. Estimated remaining: 6m 29s. Rate: 155.9 symbols/min [2025-10-10T22:39:17.853389] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:17.867109] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:17.867816] [INFO ] [MAIN ] GPK: Generated 1820 derivative records from 53446 primary records. [2025-10-10T22:39:17.867879] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-10T22:39:17.885203] [DEBUG] [LOCAL ] GPK: Derivative data saved (1820 records). [2025-10-10T22:39:17.885290] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-10T22:39:17.887635] [INFO ] [MAIN ] Derivative Progress: 813/1823 symbols completed. GPK took 1.1s. Estimated remaining: 6m 28s. Rate: 156.1 symbols/min [2025-10-10T22:39:17.887944] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:17.918629] [DEBUG] [LOCAL ] GPOR: Loaded 23651 existing records from primary storage. [2025-10-10T22:39:17.919047] [INFO ] [MAIN ] GPOR: Loaded 23651 primary data records. [2025-10-10T22:39:18.045936] [DEBUG] [LOCAL ] GPN: Loaded 52784 existing records from primary storage. [2025-10-10T22:39:18.059520] [INFO ] [MAIN ] GPN: Loaded 52784 primary data records. [2025-10-10T22:39:18.083209] [DEBUG] [LOCAL ] GPRK: Loaded 40024 existing records from primary storage. [2025-10-10T22:39:18.131143] [INFO ] [MAIN ] GPRK: Loaded 40024 primary data records. [2025-10-10T22:39:18.868885] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:18.869833] [INFO ] [MAIN ] GPOR: Generated 1820 derivative records from 23651 primary records. [2025-10-10T22:39:18.870192] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-10T22:39:18.915014] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:18.916093] [INFO ] [MAIN ] GPRK: Generated 1820 derivative records from 40024 primary records. [2025-10-10T22:39:18.917158] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:18.917860] [INFO ] [MAIN ] GPN: Generated 1820 derivative records from 52784 primary records. [2025-10-10T22:39:18.916611] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-10T22:39:18.917268] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1820 records). [2025-10-10T22:39:18.917981] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-10T22:39:18.919168] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-10T22:39:18.921256] [INFO ] [MAIN ] Derivative Progress: 814/1823 symbols completed. GPOR took 1.1s. Estimated remaining: 6m 29s. Rate: 155.8 symbols/min [2025-10-10T22:39:18.928281] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:18.948725] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1820 records). [2025-10-10T22:39:18.949096] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-10T22:39:18.952048] [INFO ] [MAIN ] Derivative Progress: 815/1823 symbols completed. GPRK took 1.1s. Estimated remaining: 6m 28s. Rate: 156.0 symbols/min [2025-10-10T22:39:18.955820] [DEBUG] [LOCAL ] GPN: Derivative data saved (1820 records). [2025-10-10T22:39:18.955998] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-10T22:39:18.956102] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:18.958499] [INFO ] [MAIN ] Derivative Progress: 816/1823 symbols completed. GPN took 1.1s. Estimated remaining: 6m 27s. Rate: 156.2 symbols/min [2025-10-10T22:39:18.958708] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:18.988058] [DEBUG] [LOCAL ] GRBK: Loaded 27490 existing records from primary storage. [2025-10-10T22:39:18.987285] [DEBUG] [LOCAL ] GRC: Loaded 9381 existing records from primary storage. [2025-10-10T22:39:18.992157] [INFO ] [MAIN ] GRC: Loaded 9381 primary data records. [2025-10-10T22:39:18.992251] [INFO ] [MAIN ] GRBK: Loaded 27490 primary data records. [2025-10-10T22:39:19.176086] [DEBUG] [LOCAL ] GRDN: Loaded 21246 existing records from primary storage. [2025-10-10T22:39:19.206610] [INFO ] [MAIN ] GRDN: Loaded 21246 primary data records. [2025-10-10T22:39:19.980164] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:19.981619] [INFO ] [MAIN ] GRBK: Generated 1820 derivative records from 27490 primary records. [2025-10-10T22:39:19.981999] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-10T22:39:20.010942] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1820 records). [2025-10-10T22:39:20.027990] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-10T22:39:20.030092] [INFO ] [MAIN ] Derivative Progress: 817/1823 symbols completed. GRBK took 1.1s. Estimated remaining: 6m 27s. Rate: 155.8 symbols/min [2025-10-10T22:39:20.027913] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:20.030778] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:20.030341] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:20.031563] [INFO ] [MAIN ] GRDN: Generated 1820 derivative records from 21246 primary records. [2025-10-10T22:39:20.032180] [INFO ] [MAIN ] GRC: Generated 1820 derivative records from 9381 primary records. [2025-10-10T22:39:20.032275] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-10T22:39:20.033328] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-10T22:39:20.063928] [DEBUG] [LOCAL ] GRC: Derivative data saved (1820 records). [2025-10-10T22:39:20.064373] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1820 records). [2025-10-10T22:39:20.064456] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-10T22:39:20.064600] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-10T22:39:20.066966] [INFO ] [MAIN ] Derivative Progress: 818/1823 symbols completed. GRDN took 1.1s. Estimated remaining: 6m 27s. Rate: 156.0 symbols/min [2025-10-10T22:39:20.067293] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:20.069663] [INFO ] [MAIN ] Derivative Progress: 819/1823 symbols completed. GRC took 1.1s. Estimated remaining: 6m 26s. Rate: 156.2 symbols/min [2025-10-10T22:39:20.069895] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:20.112453] [DEBUG] [LOCAL ] GRMN: Loaded 41183 existing records from primary storage. [2025-10-10T22:39:20.112776] [INFO ] [MAIN ] GRMN: Loaded 41183 primary data records. [2025-10-10T22:39:20.229509] [DEBUG] [LOCAL ] GRNT: Loaded 34422 existing records from primary storage. [2025-10-10T22:39:20.246286] [INFO ] [MAIN ] GRNT: Loaded 34422 primary data records. [2025-10-10T22:39:20.350350] [DEBUG] [LOCAL ] GRND: Loaded 50718 existing records from primary storage. [2025-10-10T22:39:20.534628] [INFO ] [MAIN ] GRND: Loaded 50718 primary data records. [2025-10-10T22:39:21.164806] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:21.165744] [INFO ] [MAIN ] GRMN: Generated 1820 derivative records from 41183 primary records. [2025-10-10T22:39:21.166123] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-10T22:39:21.184620] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1820 records). [2025-10-10T22:39:21.186291] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-10T22:39:21.189264] [INFO ] [MAIN ] Derivative Progress: 820/1823 symbols completed. GRMN took 1.2s. Estimated remaining: 6m 26s. Rate: 155.8 symbols/min [2025-10-10T22:39:21.190715] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:21.204944] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:21.205883] [INFO ] [MAIN ] GRNT: Generated 1820 derivative records from 34422 primary records. [2025-10-10T22:39:21.206064] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-10T22:39:21.232446] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:21.236328] [INFO ] [MAIN ] GRND: Generated 1820 derivative records from 50718 primary records. [2025-10-10T22:39:21.237669] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-10T22:39:21.237598] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1820 records). [2025-10-10T22:39:21.241400] [DEBUG] [LOCAL ] GROV: Loaded 8934 existing records from primary storage. [2025-10-10T22:39:21.241909] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-10T22:39:21.244563] [INFO ] [MAIN ] GROV: Loaded 8934 primary data records. [2025-10-10T22:39:21.244492] [INFO ] [MAIN ] Derivative Progress: 821/1823 symbols completed. GRNT took 1.2s. Estimated remaining: 6m 25s. Rate: 156.0 symbols/min [2025-10-10T22:39:21.272817] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:21.364665] [DEBUG] [LOCAL ] GRND: Derivative data saved (1820 records). [2025-10-10T22:39:21.375311] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-10T22:39:21.363480] [DEBUG] [LOCAL ] GRX: Loaded 4825 existing records from primary storage. [2025-10-10T22:39:21.388283] [INFO ] [MAIN ] Derivative Progress: 822/1823 symbols completed. GRND took 1.3s. Estimated remaining: 6m 25s. Rate: 156.1 symbols/min [2025-10-10T22:39:21.388434] [INFO ] [MAIN ] GRX: Loaded 4825 primary data records. [2025-10-10T22:39:21.399524] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:21.912118] [DEBUG] [LOCAL ] GS: Loaded 52532 existing records from primary storage. [2025-10-10T22:39:21.912835] [INFO ] [MAIN ] GS: Loaded 52532 primary data records. [2025-10-10T22:39:22.088091] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:22.114534] [INFO ] [MAIN ] GROV: Generated 1820 derivative records from 8934 primary records. [2025-10-10T22:39:22.126067] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-10T22:39:22.283105] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:22.283364] [DEBUG] [LOCAL ] GROV: Derivative data saved (1820 records). [2025-10-10T22:39:22.283620] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-10T22:39:22.285971] [INFO ] [MAIN ] Derivative Progress: 823/1823 symbols completed. GROV took 1.1s. Estimated remaining: 6m 25s. Rate: 155.8 symbols/min [2025-10-10T22:39:22.286837] [INFO ] [MAIN ] GRX: Generated 1820 derivative records from 4825 primary records. [2025-10-10T22:39:22.287129] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-10T22:39:22.303537] [DEBUG] [LOCAL ] GRX: Derivative data saved (1820 records). [2025-10-10T22:39:22.303620] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-10T22:39:22.306268] [INFO ] [MAIN ] Derivative Progress: 824/1823 symbols completed. GRX took 1.0s. Estimated remaining: 6m 24s. Rate: 156.0 symbols/min [2025-10-10T22:39:22.330388] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:22.331085] [INFO ] [MAIN ] GS: Generated 1820 derivative records from 52532 primary records. [2025-10-10T22:39:22.331156] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-10T22:39:22.348727] [DEBUG] [LOCAL ] GS: Derivative data saved (1820 records). [2025-10-10T22:39:22.348791] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-10T22:39:22.351240] [INFO ] [MAIN ] Derivative Progress: 825/1823 symbols completed. GS took 1.0s. Estimated remaining: 6m 23s. Rate: 156.2 symbols/min [2025-10-10T22:39:22.351878] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:22.351968] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:22.351803] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:22.415402] [DEBUG] [LOCAL ] GSL: Loaded 33733 existing records from primary storage. [2025-10-10T22:39:22.415608] [INFO ] [MAIN ] GSL: Loaded 33733 primary data records. [2025-10-10T22:39:22.545047] [DEBUG] [LOCAL ] GSK: Loaded 54280 existing records from primary storage. [2025-10-10T22:39:22.544397] [DEBUG] [LOCAL ] GSBD: Loaded 40105 existing records from primary storage. [2025-10-10T22:39:22.545308] [INFO ] [MAIN ] GSBD: Loaded 40105 primary data records. [2025-10-10T22:39:22.545751] [INFO ] [MAIN ] GSK: Loaded 54280 primary data records. [2025-10-10T22:39:23.383467] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:23.384542] [INFO ] [MAIN ] GSL: Generated 1820 derivative records from 33733 primary records. [2025-10-10T22:39:23.384849] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-10T22:39:23.428954] [DEBUG] [LOCAL ] GSL: Derivative data saved (1820 records). [2025-10-10T22:39:23.434981] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:23.435112] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-10T22:39:23.436932] [INFO ] [MAIN ] Derivative Progress: 826/1823 symbols completed. GSL took 1.1s. Estimated remaining: 6m 24s. Rate: 155.8 symbols/min [2025-10-10T22:39:23.434668] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:23.437784] [INFO ] [MAIN ] GSK: Generated 1820 derivative records from 54280 primary records. [2025-10-10T22:39:23.437889] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:23.438775] [INFO ] [MAIN ] GSBD: Generated 1820 derivative records from 40105 primary records. [2025-10-10T22:39:23.438874] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-10T22:39:23.439058] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-10T22:39:23.471209] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1820 records). [2025-10-10T22:39:23.472421] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-10T22:39:23.474820] [INFO ] [MAIN ] Derivative Progress: 827/1823 symbols completed. GSBD took 1.1s. Estimated remaining: 6m 23s. Rate: 156.0 symbols/min [2025-10-10T22:39:23.475524] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:23.478145] [DEBUG] [LOCAL ] GSK: Derivative data saved (1820 records). [2025-10-10T22:39:23.478267] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-10T22:39:23.480706] [INFO ] [MAIN ] Derivative Progress: 828/1823 symbols completed. GSK took 1.1s. Estimated remaining: 6m 22s. Rate: 156.2 symbols/min [2025-10-10T22:39:23.480997] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:23.532403] [DEBUG] [LOCAL ] GTES: Loaded 51168 existing records from primary storage. [2025-10-10T22:39:23.532774] [INFO ] [MAIN ] GTES: Loaded 51168 primary data records. [2025-10-10T22:39:23.662830] [DEBUG] [LOCAL ] GTLS: Loaded 43640 existing records from primary storage. [2025-10-10T22:39:23.663674] [INFO ] [MAIN ] GTLS: Loaded 43640 primary data records. [2025-10-10T22:39:23.937602] [DEBUG] [LOCAL ] GTN: Loaded 45885 existing records from primary storage. [2025-10-10T22:39:23.964905] [INFO ] [MAIN ] GTN: Loaded 45885 primary data records. [2025-10-10T22:39:24.547384] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:24.548690] [INFO ] [MAIN ] GTES: Generated 1820 derivative records from 51168 primary records. [2025-10-10T22:39:24.548839] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-10T22:39:24.580103] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:24.581243] [INFO ] [MAIN ] GTLS: Generated 1820 derivative records from 43640 primary records. [2025-10-10T22:39:24.581683] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-10T22:39:24.605428] [DEBUG] [LOCAL ] GTES: Derivative data saved (1820 records). [2025-10-10T22:39:24.609260] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-10T22:39:24.611493] [INFO ] [MAIN ] Derivative Progress: 829/1823 symbols completed. GTES took 1.2s. Estimated remaining: 6m 23s. Rate: 155.8 symbols/min [2025-10-10T22:39:24.612830] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1820 records). [2025-10-10T22:39:24.613844] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-10T22:39:24.616037] [INFO ] [MAIN ] Derivative Progress: 830/1823 symbols completed. GTLS took 1.1s. Estimated remaining: 6m 22s. Rate: 156.0 symbols/min [2025-10-10T22:39:24.612706] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:24.616453] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:24.633628] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:24.634480] [INFO ] [MAIN ] GTN: Generated 1820 derivative records from 45885 primary records. [2025-10-10T22:39:24.634690] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-10T22:39:24.654940] [DEBUG] [LOCAL ] GTN: Derivative data saved (1820 records). [2025-10-10T22:39:24.655266] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-10T22:39:24.657573] [INFO ] [MAIN ] Derivative Progress: 831/1823 symbols completed. GTN took 1.2s. Estimated remaining: 6m 21s. Rate: 156.2 symbols/min [2025-10-10T22:39:24.662618] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:24.663054] [DEBUG] [LOCAL ] GUG: Loaded 12355 existing records from primary storage. [2025-10-10T22:39:24.663718] [INFO ] [MAIN ] GUG: Loaded 12355 primary data records. [2025-10-10T22:39:24.819691] [DEBUG] [LOCAL ] GTY: Loaded 30692 existing records from primary storage. [2025-10-10T22:39:24.872313] [INFO ] [MAIN ] GTY: Loaded 30692 primary data records. [2025-10-10T22:39:24.872203] [DEBUG] [LOCAL ] GUT: Loaded 15771 existing records from primary storage. [2025-10-10T22:39:24.878292] [INFO ] [MAIN ] GUT: Loaded 15771 primary data records. [2025-10-10T22:39:25.678972] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:25.680007] [INFO ] [MAIN ] GUG: Generated 1820 derivative records from 12355 primary records. [2025-10-10T22:39:25.680176] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-10T22:39:25.700808] [DEBUG] [LOCAL ] GUG: Derivative data saved (1820 records). [2025-10-10T22:39:25.702440] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-10T22:39:25.704527] [INFO ] [MAIN ] Derivative Progress: 832/1823 symbols completed. GUG took 1.1s. Estimated remaining: 6m 21s. Rate: 155.9 symbols/min [2025-10-10T22:39:25.712895] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:25.724563] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:25.725802] [INFO ] [MAIN ] GTY: Generated 1820 derivative records from 30692 primary records. [2025-10-10T22:39:25.725956] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-10T22:39:25.752724] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:25.755659] [INFO ] [MAIN ] GUT: Generated 1820 derivative records from 15771 primary records. [2025-10-10T22:39:25.756468] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-10T22:39:25.767084] [DEBUG] [LOCAL ] GTY: Derivative data saved (1820 records). [2025-10-10T22:39:25.767273] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-10T22:39:25.772506] [INFO ] [MAIN ] Derivative Progress: 833/1823 symbols completed. GTY took 1.2s. Estimated remaining: 6m 21s. Rate: 156.0 symbols/min [2025-10-10T22:39:25.773169] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:25.779123] [DEBUG] [LOCAL ] GUT: Derivative data saved (1820 records). [2025-10-10T22:39:25.779294] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-10T22:39:25.781842] [INFO ] [MAIN ] Derivative Progress: 834/1823 symbols completed. GUT took 1.1s. Estimated remaining: 6m 20s. Rate: 156.2 symbols/min [2025-10-10T22:39:25.782150] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:25.816300] [DEBUG] [LOCAL ] GWH: Loaded 17652 existing records from primary storage. [2025-10-10T22:39:25.817364] [DEBUG] [LOCAL ] GVA: Loaded 33295 existing records from primary storage. [2025-10-10T22:39:25.816688] [INFO ] [MAIN ] GWH: Loaded 17652 primary data records. [2025-10-10T22:39:25.817449] [INFO ] [MAIN ] GVA: Loaded 33295 primary data records. [2025-10-10T22:39:26.210378] [DEBUG] [LOCAL ] GWRE: Loaded 40700 existing records from primary storage. [2025-10-10T22:39:26.327686] [INFO ] [MAIN ] GWRE: Loaded 40700 primary data records. [2025-10-10T22:39:26.803030] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:26.816952] [INFO ] [MAIN ] GVA: Generated 1820 derivative records from 33295 primary records. [2025-10-10T22:39:26.818002] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-10T22:39:26.818348] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:26.827920] [INFO ] [MAIN ] GWH: Generated 1820 derivative records from 17652 primary records. [2025-10-10T22:39:26.833241] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-10T22:39:26.845173] [DEBUG] [LOCAL ] GVA: Derivative data saved (1820 records). [2025-10-10T22:39:26.849716] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-10T22:39:26.852027] [INFO ] [MAIN ] Derivative Progress: 835/1823 symbols completed. GVA took 1.1s. Estimated remaining: 6m 20s. Rate: 155.9 symbols/min [2025-10-10T22:39:26.856847] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:26.857517] [DEBUG] [LOCAL ] GWH: Derivative data saved (1820 records). [2025-10-10T22:39:26.858471] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-10T22:39:26.862137] [INFO ] [MAIN ] Derivative Progress: 836/1823 symbols completed. GWH took 1.1s. Estimated remaining: 6m 19s. Rate: 156.1 symbols/min [2025-10-10T22:39:26.863120] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:26.877482] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:26.878223] [INFO ] [MAIN ] GWRE: Generated 1820 derivative records from 40700 primary records. [2025-10-10T22:39:26.878328] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-10T22:39:26.900835] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1820 records). [2025-10-10T22:39:26.901173] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-10T22:39:26.903619] [INFO ] [MAIN ] Derivative Progress: 837/1823 symbols completed. GWRE took 1.1s. Estimated remaining: 6m 19s. Rate: 156.2 symbols/min [2025-10-10T22:39:26.903951] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:26.912893] [DEBUG] [LOCAL ] GWW: Loaded 19737 existing records from primary storage. [2025-10-10T22:39:26.913109] [INFO ] [MAIN ] GWW: Loaded 19737 primary data records. [2025-10-10T22:39:26.926608] [DEBUG] [LOCAL ] GYLD: Loaded 1575 existing records from primary storage. [2025-10-10T22:39:26.936018] [INFO ] [MAIN ] GYLD: Loaded 1575 primary data records. [2025-10-10T22:39:27.364408] [DEBUG] [LOCAL ] GXO: Loaded 47741 existing records from primary storage. [2025-10-10T22:39:27.397480] [INFO ] [MAIN ] GXO: Loaded 47741 primary data records. [2025-10-10T22:39:27.941374] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:39:27.942432] [INFO ] [MAIN ] GYLD: Generated 1819 derivative records from 1575 primary records. [2025-10-10T22:39:27.942773] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-10T22:39:27.955247] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:27.956858] [INFO ] [MAIN ] GWW: Generated 1820 derivative records from 19737 primary records. [2025-10-10T22:39:27.957308] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-10T22:39:27.989087] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1819 records). [2025-10-10T22:39:27.990101] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-10T22:39:27.992940] [INFO ] [MAIN ] Derivative Progress: 838/1823 symbols completed. GYLD took 1.1s. Estimated remaining: 6m 19s. Rate: 155.9 symbols/min [2025-10-10T22:39:27.999163] [DEBUG] [LOCAL ] GWW: Derivative data saved (1820 records). [2025-10-10T22:39:27.999590] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-10T22:39:28.001870] [INFO ] [MAIN ] Derivative Progress: 839/1823 symbols completed. GWW took 1.1s. Estimated remaining: 6m 18s. Rate: 156.1 symbols/min [2025-10-10T22:39:28.014426] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:28.015080] [INFO ] [MAIN ] GXO: Generated 1820 derivative records from 47741 primary records. [2025-10-10T22:39:28.015144] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-10T22:39:28.030663] [DEBUG] [LOCAL ] GXO: Derivative data saved (1820 records). [2025-10-10T22:39:28.030765] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-10T22:39:28.033069] [INFO ] [MAIN ] Derivative Progress: 840/1823 symbols completed. GXO took 1.2s. Estimated remaining: 6m 18s. Rate: 156.2 symbols/min [2025-10-10T22:39:28.033490] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:28.033732] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:28.033675] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:28.095082] [DEBUG] [LOCAL ] HAFN: Loaded 43736 existing records from primary storage. [2025-10-10T22:39:28.105906] [INFO ] [MAIN ] HAFN: Loaded 43736 primary data records. [2025-10-10T22:39:28.117751] [DEBUG] [LOCAL ] HAE: Loaded 40041 existing records from primary storage. [2025-10-10T22:39:28.141009] [INFO ] [MAIN ] HAE: Loaded 40041 primary data records. [2025-10-10T22:39:28.301963] [DEBUG] [LOCAL ] H: Loaded 45165 existing records from primary storage. [2025-10-10T22:39:28.328518] [INFO ] [MAIN ] H: Loaded 45165 primary data records. [2025-10-10T22:39:29.137861] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:29.139287] [INFO ] [MAIN ] HAFN: Generated 1820 derivative records from 43736 primary records. [2025-10-10T22:39:29.139477] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-10T22:39:29.156624] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1820 records). [2025-10-10T22:39:29.158754] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-10T22:39:29.160717] [INFO ] [MAIN ] Derivative Progress: 841/1823 symbols completed. HAFN took 1.1s. Estimated remaining: 6m 18s. Rate: 155.9 symbols/min [2025-10-10T22:39:29.161118] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:29.178617] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:29.179718] [INFO ] [MAIN ] HAE: Generated 1820 derivative records from 40041 primary records. [2025-10-10T22:39:29.180825] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-10T22:39:29.206854] [DEBUG] [LOCAL ] HAE: Derivative data saved (1820 records). [2025-10-10T22:39:29.214841] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-10T22:39:29.222198] [INFO ] [MAIN ] Derivative Progress: 842/1823 symbols completed. HAE took 1.2s. Estimated remaining: 6m 17s. Rate: 156.0 symbols/min [2025-10-10T22:39:29.222425] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:29.223137] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:29.224361] [INFO ] [MAIN ] H: Generated 1820 derivative records from 45165 primary records. [2025-10-10T22:39:29.224453] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-10T22:39:29.242239] [DEBUG] [LOCAL ] H: Derivative data saved (1820 records). [2025-10-10T22:39:29.242374] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-10T22:39:29.244530] [INFO ] [MAIN ] Derivative Progress: 843/1823 symbols completed. H took 1.2s. Estimated remaining: 6m 16s. Rate: 156.2 symbols/min [2025-10-10T22:39:29.244715] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:29.293576] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-10-10T22:39:29.293889] [INFO ] [MAIN ] HAL: Loaded 54498 primary data records. [2025-10-10T22:39:29.423219] [DEBUG] [LOCAL ] HASI: Loaded 47989 existing records from primary storage. [2025-10-10T22:39:29.436162] [INFO ] [MAIN ] HASI: Loaded 47989 primary data records. [2025-10-10T22:39:29.589040] [DEBUG] [LOCAL ] HAYW: Loaded 49473 existing records from primary storage. [2025-10-10T22:39:29.725190] [INFO ] [MAIN ] HAYW: Loaded 49473 primary data records. [2025-10-10T22:39:30.272025] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:30.274568] [INFO ] [MAIN ] HAL: Generated 1820 derivative records from 54498 primary records. [2025-10-10T22:39:30.274848] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-10T22:39:30.300921] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:30.302624] [INFO ] [MAIN ] HASI: Generated 1820 derivative records from 47989 primary records. [2025-10-10T22:39:30.303323] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-10T22:39:30.306328] [DEBUG] [LOCAL ] HAL: Derivative data saved (1820 records). [2025-10-10T22:39:30.307428] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-10T22:39:30.309342] [INFO ] [MAIN ] Derivative Progress: 844/1823 symbols completed. HAL took 1.1s. Estimated remaining: 6m 17s. Rate: 155.9 symbols/min [2025-10-10T22:39:30.310800] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:30.328840] [DEBUG] [LOCAL ] HASI: Derivative data saved (1820 records). [2025-10-10T22:39:30.329245] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-10T22:39:30.331531] [INFO ] [MAIN ] Derivative Progress: 845/1823 symbols completed. HASI took 1.1s. Estimated remaining: 6m 16s. Rate: 156.0 symbols/min [2025-10-10T22:39:30.346312] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:30.346747] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:30.347798] [INFO ] [MAIN ] HAYW: Generated 1820 derivative records from 49473 primary records. [2025-10-10T22:39:30.351840] [DEBUG] [LOCAL ] HBB: Loaded 6551 existing records from primary storage. [2025-10-10T22:39:30.351926] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-10T22:39:30.352676] [INFO ] [MAIN ] HBB: Loaded 6551 primary data records. [2025-10-10T22:39:30.448286] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1820 records). [2025-10-10T22:39:30.458818] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-10T22:39:30.471365] [INFO ] [MAIN ] Derivative Progress: 846/1823 symbols completed. HAYW took 1.2s. Estimated remaining: 6m 15s. Rate: 156.2 symbols/min [2025-10-10T22:39:30.471696] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:30.701108] [DEBUG] [LOCAL ] HBI: Loaded 53755 existing records from primary storage. [2025-10-10T22:39:30.702664] [INFO ] [MAIN ] HBI: Loaded 53755 primary data records. [2025-10-10T22:39:30.902033] [DEBUG] [LOCAL ] HBM: Loaded 53708 existing records from primary storage. [2025-10-10T22:39:30.973345] [INFO ] [MAIN ] HBM: Loaded 53708 primary data records. [2025-10-10T22:39:31.139573] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:31.178127] [INFO ] [MAIN ] HBB: Generated 1820 derivative records from 6551 primary records. [2025-10-10T22:39:31.190600] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-10T22:39:31.417159] [DEBUG] [LOCAL ] HBB: Derivative data saved (1820 records). [2025-10-10T22:39:31.417819] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-10T22:39:31.420179] [INFO ] [MAIN ] Derivative Progress: 847/1823 symbols completed. HBB took 1.1s. Estimated remaining: 6m 16s. Rate: 155.9 symbols/min [2025-10-10T22:39:31.420708] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:31.441420] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:31.442151] [INFO ] [MAIN ] HBI: Generated 1820 derivative records from 53755 primary records. [2025-10-10T22:39:31.442374] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-10T22:39:31.460284] [DEBUG] [LOCAL ] HBI: Derivative data saved (1820 records). [2025-10-10T22:39:31.460482] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-10T22:39:31.462707] [INFO ] [MAIN ] Derivative Progress: 848/1823 symbols completed. HBI took 1.1s. Estimated remaining: 6m 15s. Rate: 156.1 symbols/min [2025-10-10T22:39:31.462961] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:31.480355] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:31.481198] [INFO ] [MAIN ] HBM: Generated 1820 derivative records from 53708 primary records. [2025-10-10T22:39:31.481429] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-10T22:39:31.507804] [DEBUG] [LOCAL ] HBM: Derivative data saved (1820 records). [2025-10-10T22:39:31.508554] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-10T22:39:31.511016] [INFO ] [MAIN ] Derivative Progress: 849/1823 symbols completed. HBM took 1.0s. Estimated remaining: 6m 14s. Rate: 156.2 symbols/min [2025-10-10T22:39:31.524047] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:31.525201] [DEBUG] [LOCAL ] HCA: Loaded 47601 existing records from primary storage. [2025-10-10T22:39:31.525268] [INFO ] [MAIN ] HCA: Loaded 47601 primary data records. [2025-10-10T22:39:31.733070] [DEBUG] [LOCAL ] HCI: Loaded 14343 existing records from primary storage. [2025-10-10T22:39:31.734283] [DEBUG] [LOCAL ] HCC: Loaded 45904 existing records from primary storage. [2025-10-10T22:39:31.835300] [INFO ] [MAIN ] HCC: Loaded 45904 primary data records. [2025-10-10T22:39:31.804707] [INFO ] [MAIN ] HCI: Loaded 14343 primary data records. [2025-10-10T22:39:32.479912] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:32.481108] [INFO ] [MAIN ] HCA: Generated 1820 derivative records from 47601 primary records. [2025-10-10T22:39:32.481531] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-10T22:39:32.501787] [DEBUG] [LOCAL ] HCA: Derivative data saved (1820 records). [2025-10-10T22:39:32.501938] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-10T22:39:32.504317] [INFO ] [MAIN ] Derivative Progress: 850/1823 symbols completed. HCA took 1.1s. Estimated remaining: 6m 14s. Rate: 155.9 symbols/min [2025-10-10T22:39:32.504870] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:32.533289] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:32.534480] [INFO ] [MAIN ] HCC: Generated 1820 derivative records from 45904 primary records. [2025-10-10T22:39:32.534621] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-10T22:39:32.533722] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:32.535618] [INFO ] [MAIN ] HCI: Generated 1820 derivative records from 14343 primary records. [2025-10-10T22:39:32.536085] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-10T22:39:32.567360] [DEBUG] [LOCAL ] HCC: Derivative data saved (1820 records). [2025-10-10T22:39:32.570593] [DEBUG] [LOCAL ] HCI: Derivative data saved (1820 records). [2025-10-10T22:39:32.570712] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-10T22:39:32.570133] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-10T22:39:32.572973] [INFO ] [MAIN ] Derivative Progress: 851/1823 symbols completed. HCI took 1.0s. Estimated remaining: 6m 14s. Rate: 156.1 symbols/min [2025-10-10T22:39:32.575555] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:32.575612] [INFO ] [MAIN ] Derivative Progress: 852/1823 symbols completed. HCC took 1.1s. Estimated remaining: 6m 13s. Rate: 156.3 symbols/min [2025-10-10T22:39:32.576125] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:32.618002] [DEBUG] [LOCAL ] HD: Loaded 54268 existing records from primary storage. [2025-10-10T22:39:32.618376] [INFO ] [MAIN ] HD: Loaded 54268 primary data records. [2025-10-10T22:39:32.996292] [DEBUG] [LOCAL ] HDB: Loaded 52716 existing records from primary storage. [2025-10-10T22:39:32.996475] [INFO ] [MAIN ] HDB: Loaded 52716 primary data records. [2025-10-10T22:39:32.997699] [DEBUG] [LOCAL ] HE: Loaded 49673 existing records from primary storage. [2025-10-10T22:39:32.997967] [INFO ] [MAIN ] HE: Loaded 49673 primary data records. [2025-10-10T22:39:33.621080] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:33.622372] [INFO ] [MAIN ] HD: Generated 1820 derivative records from 54268 primary records. [2025-10-10T22:39:33.622820] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-10T22:39:33.642516] [DEBUG] [LOCAL ] HD: Derivative data saved (1820 records). [2025-10-10T22:39:33.642791] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-10T22:39:33.645342] [INFO ] [MAIN ] Derivative Progress: 853/1823 symbols completed. HD took 1.1s. Estimated remaining: 6m 13s. Rate: 155.9 symbols/min [2025-10-10T22:39:33.665446] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:33.667485] [INFO ] [MAIN ] HE: Generated 1820 derivative records from 49673 primary records. [2025-10-10T22:39:33.668321] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-10T22:39:33.688902] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:33.693344] [INFO ] [MAIN ] HDB: Generated 1820 derivative records from 52716 primary records. [2025-10-10T22:39:33.696260] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-10T22:39:33.698893] [DEBUG] [LOCAL ] HE: Derivative data saved (1820 records). [2025-10-10T22:39:33.699155] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-10T22:39:33.711617] [INFO ] [MAIN ] Derivative Progress: 854/1823 symbols completed. HE took 1.1s. Estimated remaining: 6m 12s. Rate: 156.1 symbols/min [2025-10-10T22:39:33.719589] [DEBUG] [LOCAL ] HDB: Derivative data saved (1820 records). [2025-10-10T22:39:33.719681] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-10T22:39:33.721574] [INFO ] [MAIN ] Derivative Progress: 855/1823 symbols completed. HDB took 1.1s. Estimated remaining: 6m 12s. Rate: 156.3 symbols/min [2025-10-10T22:39:33.722349] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:33.722442] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:33.722220] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:33.732616] [DEBUG] [LOCAL ] HEQ: Loaded 6748 existing records from primary storage. [2025-10-10T22:39:33.732828] [INFO ] [MAIN ] HEQ: Loaded 6748 primary data records. [2025-10-10T22:39:34.042091] [DEBUG] [LOCAL ] HEI: Loaded 32017 existing records from primary storage. [2025-10-10T22:39:34.099404] [INFO ] [MAIN ] HEI: Loaded 32017 primary data records. [2025-10-10T22:39:34.227914] [DEBUG] [LOCAL ] HESM: Loaded 49040 existing records from primary storage. [2025-10-10T22:39:34.228856] [INFO ] [MAIN ] HESM: Loaded 49040 primary data records. [2025-10-10T22:39:34.758904] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:34.760729] [INFO ] [MAIN ] HEQ: Generated 1820 derivative records from 6748 primary records. [2025-10-10T22:39:34.762130] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-10T22:39:34.783711] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1820 records). [2025-10-10T22:39:34.784136] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-10T22:39:34.786367] [INFO ] [MAIN ] Derivative Progress: 856/1823 symbols completed. HEQ took 1.1s. Estimated remaining: 6m 12s. Rate: 155.9 symbols/min [2025-10-10T22:39:34.786755] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:34.805306] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:34.806392] [INFO ] [MAIN ] HEI: Generated 1820 derivative records from 32017 primary records. [2025-10-10T22:39:34.806515] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-10T22:39:34.836132] [DEBUG] [LOCAL ] HFRO: Loaded 17645 existing records from primary storage. [2025-10-10T22:39:34.837821] [DEBUG] [LOCAL ] HEI: Derivative data saved (1820 records). [2025-10-10T22:39:34.845483] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-10T22:39:34.852308] [INFO ] [MAIN ] Derivative Progress: 857/1823 symbols completed. HEI took 1.1s. Estimated remaining: 6m 11s. Rate: 156.1 symbols/min [2025-10-10T22:39:34.852719] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:34.852494] [INFO ] [MAIN ] HFRO: Loaded 17645 primary data records. [2025-10-10T22:39:34.853176] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:34.885344] [INFO ] [MAIN ] HESM: Generated 1820 derivative records from 49040 primary records. [2025-10-10T22:39:34.898179] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-10T22:39:34.993246] [DEBUG] [LOCAL ] HGER: Loaded 14757 existing records from primary storage. [2025-10-10T22:39:35.036922] [DEBUG] [LOCAL ] HESM: Derivative data saved (1820 records). [2025-10-10T22:39:35.027067] [INFO ] [MAIN ] HGER: Loaded 14757 primary data records. [2025-10-10T22:39:35.037097] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-10T22:39:35.040754] [INFO ] [MAIN ] Derivative Progress: 858/1823 symbols completed. HESM took 1.3s. Estimated remaining: 6m 11s. Rate: 156.2 symbols/min [2025-10-10T22:39:35.062619] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:35.346755] [DEBUG] [LOCAL ] HGLB: Loaded 9807 existing records from primary storage. [2025-10-10T22:39:35.357634] [INFO ] [MAIN ] HGLB: Loaded 9807 primary data records. [2025-10-10T22:39:35.865926] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:35.867222] [INFO ] [MAIN ] HFRO: Generated 1820 derivative records from 17645 primary records. [2025-10-10T22:39:35.867596] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-10T22:39:35.885824] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1820 records). [2025-10-10T22:39:35.886792] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-10T22:39:35.888908] [INFO ] [MAIN ] Derivative Progress: 859/1823 symbols completed. HFRO took 1.1s. Estimated remaining: 6m 11s. Rate: 156.0 symbols/min [2025-10-10T22:39:35.889317] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:35.907686] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:35.912690] [INFO ] [MAIN ] HGER: Generated 1820 derivative records from 14757 primary records. [2025-10-10T22:39:35.913039] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-10T22:39:35.933621] [DEBUG] [LOCAL ] HGTY: Loaded 13389 existing records from primary storage. [2025-10-10T22:39:35.935474] [INFO ] [MAIN ] HGTY: Loaded 13389 primary data records. [2025-10-10T22:39:35.972397] [DEBUG] [LOCAL ] HGER: Derivative data saved (1820 records). [2025-10-10T22:39:35.984974] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-10T22:39:35.999844] [INFO ] [MAIN ] Derivative Progress: 860/1823 symbols completed. HGER took 1.1s. Estimated remaining: 6m 10s. Rate: 156.1 symbols/min [2025-10-10T22:39:36.017039] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:36.062467] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:36.074623] [INFO ] [MAIN ] HGLB: Generated 1820 derivative records from 9807 primary records. [2025-10-10T22:39:36.080029] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-10T22:39:36.273947] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1820 records). [2025-10-10T22:39:36.284584] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-10T22:39:36.286992] [INFO ] [MAIN ] Derivative Progress: 861/1823 symbols completed. HGLB took 1.2s. Estimated remaining: 6m 10s. Rate: 156.1 symbols/min [2025-10-10T22:39:36.287260] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:36.308793] [DEBUG] [LOCAL ] HGV: Loaded 46989 existing records from primary storage. [2025-10-10T22:39:36.309264] [INFO ] [MAIN ] HGV: Loaded 46989 primary data records. [2025-10-10T22:39:36.459010] [DEBUG] [LOCAL ] HHH: Loaded 33400 existing records from primary storage. [2025-10-10T22:39:36.458896] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:36.480135] [INFO ] [MAIN ] HHH: Loaded 33400 primary data records. [2025-10-10T22:39:36.515610] [INFO ] [MAIN ] HGTY: Generated 1820 derivative records from 13389 primary records. [2025-10-10T22:39:36.549761] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-10T22:39:36.766194] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1820 records). [2025-10-10T22:39:36.766365] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-10T22:39:36.778255] [INFO ] [MAIN ] Derivative Progress: 862/1823 symbols completed. HGTY took 0.9s. Estimated remaining: 6m 9s. Rate: 156.1 symbols/min [2025-10-10T22:39:36.778986] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:37.061394] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:37.062442] [INFO ] [MAIN ] HGV: Generated 1820 derivative records from 46989 primary records. [2025-10-10T22:39:37.064326] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-10T22:39:37.063543] [DEBUG] [LOCAL ] HI: Loaded 35881 existing records from primary storage. [2025-10-10T22:39:37.065620] [INFO ] [MAIN ] HI: Loaded 35881 primary data records. [2025-10-10T22:39:37.119039] [DEBUG] [LOCAL ] HGV: Derivative data saved (1820 records). [2025-10-10T22:39:37.138780] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-10T22:39:37.149754] [INFO ] [MAIN ] Derivative Progress: 863/1823 symbols completed. HGV took 1.1s. Estimated remaining: 6m 9s. Rate: 156.1 symbols/min [2025-10-10T22:39:37.182768] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:37.408324] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:37.409283] [INFO ] [MAIN ] HHH: Generated 1820 derivative records from 33400 primary records. [2025-10-10T22:39:37.409448] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-10T22:39:37.429143] [DEBUG] [LOCAL ] HHH: Derivative data saved (1820 records). [2025-10-10T22:39:37.429498] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-10T22:39:37.431914] [INFO ] [MAIN ] Derivative Progress: 864/1823 symbols completed. HHH took 1.1s. Estimated remaining: 6m 9s. Rate: 156.1 symbols/min [2025-10-10T22:39:37.432245] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:37.469938] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:37.470724] [INFO ] [MAIN ] HI: Generated 1820 derivative records from 35881 primary records. [2025-10-10T22:39:37.471504] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-10T22:39:37.498283] [DEBUG] [LOCAL ] HIG: Loaded 51891 existing records from primary storage. [2025-10-10T22:39:37.510839] [INFO ] [MAIN ] HIG: Loaded 51891 primary data records. [2025-10-10T22:39:37.511900] [DEBUG] [LOCAL ] HI: Derivative data saved (1820 records). [2025-10-10T22:39:37.523261] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-10T22:39:37.544793] [INFO ] [MAIN ] Derivative Progress: 865/1823 symbols completed. HI took 0.8s. Estimated remaining: 6m 8s. Rate: 156.3 symbols/min [2025-10-10T22:39:37.557503] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:37.599969] [DEBUG] [LOCAL ] HII: Loaded 34485 existing records from primary storage. [2025-10-10T22:39:37.610563] [INFO ] [MAIN ] HII: Loaded 34485 primary data records. [2025-10-10T22:39:38.168512] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-10-10T22:39:38.168974] [INFO ] [MAIN ] HIMS: Loaded 54597 primary data records. [2025-10-10T22:39:38.303398] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:38.319817] [INFO ] [MAIN ] HIG: Generated 1820 derivative records from 51891 primary records. [2025-10-10T22:39:38.347473] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-10T22:39:38.493792] [DEBUG] [LOCAL ] HIG: Derivative data saved (1820 records). [2025-10-10T22:39:38.503675] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-10T22:39:38.506019] [INFO ] [MAIN ] Derivative Progress: 866/1823 symbols completed. HIG took 1.3s. Estimated remaining: 6m 8s. Rate: 156.0 symbols/min [2025-10-10T22:39:38.507146] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:38.522575] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:38.523872] [INFO ] [MAIN ] HII: Generated 1820 derivative records from 34485 primary records. [2025-10-10T22:39:38.524146] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-10T22:39:38.550307] [DEBUG] [LOCAL ] HII: Derivative data saved (1820 records). [2025-10-10T22:39:38.550726] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-10T22:39:38.553068] [INFO ] [MAIN ] Derivative Progress: 867/1823 symbols completed. HII took 1.1s. Estimated remaining: 6m 7s. Rate: 156.2 symbols/min [2025-10-10T22:39:38.553344] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:38.566280] [DEBUG] [LOCAL ] HIO: Loaded 24411 existing records from primary storage. [2025-10-10T22:39:38.574895] [INFO ] [MAIN ] HIO: Loaded 24411 primary data records. [2025-10-10T22:39:38.591358] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:38.612017] [INFO ] [MAIN ] HIMS: Generated 1820 derivative records from 54597 primary records. [2025-10-10T22:39:38.664384] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-10T22:39:38.766148] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1820 records). [2025-10-10T22:39:38.791266] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-10T22:39:38.799571] [DEBUG] [LOCAL ] HIPO: Loaded 22218 existing records from primary storage. [2025-10-10T22:39:38.950269] [INFO ] [MAIN ] HIPO: Loaded 22218 primary data records. [2025-10-10T22:39:38.914789] [INFO ] [MAIN ] Derivative Progress: 868/1823 symbols completed. HIMS took 1.4s. Estimated remaining: 6m 7s. Rate: 156.2 symbols/min [2025-10-10T22:39:39.287404] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:39.288304] [INFO ] [MAIN ] HIO: Generated 1820 derivative records from 24411 primary records. [2025-10-10T22:39:39.289440] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-10T22:39:39.306131] [DEBUG] [LOCAL ] HIO: Derivative data saved (1820 records). [2025-10-10T22:39:39.306412] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-10T22:39:39.308706] [INFO ] [MAIN ] Derivative Progress: 869/1823 symbols completed. HIO took 0.8s. Estimated remaining: 6m 7s. Rate: 156.2 symbols/min [2025-10-10T22:39:39.324781] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:39.325358] [INFO ] [MAIN ] HIPO: Generated 1820 derivative records from 22218 primary records. [2025-10-10T22:39:39.325416] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-10T22:39:39.340470] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1820 records). [2025-10-10T22:39:39.340528] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-10T22:39:39.342618] [INFO ] [MAIN ] Derivative Progress: 870/1823 symbols completed. HIPO took 0.8s. Estimated remaining: 6m 6s. Rate: 156.3 symbols/min [2025-10-10T22:39:39.343066] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:39.343218] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:39.343395] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:39.370390] [DEBUG] [LOCAL ] HIX: Loaded 20859 existing records from primary storage. [2025-10-10T22:39:39.379738] [INFO ] [MAIN ] HIX: Loaded 20859 primary data records. [2025-10-10T22:39:39.380219] [DEBUG] [LOCAL ] HKD: Loaded 18878 existing records from primary storage. [2025-10-10T22:39:39.401292] [INFO ] [MAIN ] HKD: Loaded 18878 primary data records. [2025-10-10T22:39:39.716742] [DEBUG] [LOCAL ] HIW: Loaded 45116 existing records from primary storage. [2025-10-10T22:39:39.765440] [INFO ] [MAIN ] HIW: Loaded 45116 primary data records. [2025-10-10T22:39:40.340014] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:40.340735] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:40.341487] [INFO ] [MAIN ] HIX: Generated 1820 derivative records from 20859 primary records. [2025-10-10T22:39:40.342466] [INFO ] [MAIN ] HKD: Generated 1820 derivative records from 18878 primary records. [2025-10-10T22:39:40.343041] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-10T22:39:40.343002] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-10T22:39:40.374433] [DEBUG] [LOCAL ] HIX: Derivative data saved (1820 records). [2025-10-10T22:39:40.375365] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-10T22:39:40.380062] [INFO ] [MAIN ] Derivative Progress: 871/1823 symbols completed. HIX took 1.0s. Estimated remaining: 6m 6s. Rate: 156.0 symbols/min [2025-10-10T22:39:40.381222] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:40.383163] [DEBUG] [LOCAL ] HKD: Derivative data saved (1820 records). [2025-10-10T22:39:40.383336] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-10T22:39:40.397671] [INFO ] [MAIN ] Derivative Progress: 872/1823 symbols completed. HKD took 1.1s. Estimated remaining: 6m 5s. Rate: 156.2 symbols/min [2025-10-10T22:39:40.398621] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:40.399511] [INFO ] [MAIN ] HIW: Generated 1820 derivative records from 45116 primary records. [2025-10-10T22:39:40.399807] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-10T22:39:40.399614] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:40.421179] [DEBUG] [LOCAL ] HIW: Derivative data saved (1820 records). [2025-10-10T22:39:40.421574] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-10T22:39:40.424239] [INFO ] [MAIN ] Derivative Progress: 873/1823 symbols completed. HIW took 1.1s. Estimated remaining: 6m 5s. Rate: 156.4 symbols/min [2025-10-10T22:39:40.424574] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:40.492145] [DEBUG] [LOCAL ] HL: Loaded 54452 existing records from primary storage. [2025-10-10T22:39:40.492894] [INFO ] [MAIN ] HL: Loaded 54452 primary data records. [2025-10-10T22:39:40.588147] [DEBUG] [LOCAL ] HLF: Loaded 49122 existing records from primary storage. [2025-10-10T22:39:40.587518] [DEBUG] [LOCAL ] HLI: Loaded 31364 existing records from primary storage. [2025-10-10T22:39:40.601444] [INFO ] [MAIN ] HLI: Loaded 31364 primary data records. [2025-10-10T22:39:40.612391] [INFO ] [MAIN ] HLF: Loaded 49122 primary data records. [2025-10-10T22:39:41.466584] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:41.467947] [INFO ] [MAIN ] HL: Generated 1820 derivative records from 54452 primary records. [2025-10-10T22:39:41.468369] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-10T22:39:41.507590] [DEBUG] [LOCAL ] HL: Derivative data saved (1820 records). [2025-10-10T22:39:41.526317] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:41.525772] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-10T22:39:41.529223] [INFO ] [MAIN ] Derivative Progress: 874/1823 symbols completed. HL took 1.1s. Estimated remaining: 6m 5s. Rate: 156.0 symbols/min [2025-10-10T22:39:41.530467] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:41.530367] [INFO ] [MAIN ] HLI: Generated 1820 derivative records from 31364 primary records. [2025-10-10T22:39:41.531298] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:41.531517] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-10T22:39:41.532939] [INFO ] [MAIN ] HLF: Generated 1820 derivative records from 49122 primary records. [2025-10-10T22:39:41.533337] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-10T22:39:41.563726] [DEBUG] [LOCAL ] HLI: Derivative data saved (1820 records). [2025-10-10T22:39:41.564751] [DEBUG] [LOCAL ] HLF: Derivative data saved (1820 records). [2025-10-10T22:39:41.564920] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-10T22:39:41.565008] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-10T22:39:41.566933] [INFO ] [MAIN ] Derivative Progress: 875/1823 symbols completed. HLF took 1.2s. Estimated remaining: 6m 4s. Rate: 156.2 symbols/min [2025-10-10T22:39:41.569134] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:41.569738] [INFO ] [MAIN ] Derivative Progress: 876/1823 symbols completed. HLI took 1.1s. Estimated remaining: 6m 3s. Rate: 156.4 symbols/min [2025-10-10T22:39:41.569946] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:41.595125] [DEBUG] [LOCAL ] HLIO: Loaded 28206 existing records from primary storage. [2025-10-10T22:39:41.595279] [INFO ] [MAIN ] HLIO: Loaded 28206 primary data records. [2025-10-10T22:39:41.729740] [DEBUG] [LOCAL ] HLLY: Loaded 34004 existing records from primary storage. [2025-10-10T22:39:41.772920] [INFO ] [MAIN ] HLLY: Loaded 34004 primary data records. [2025-10-10T22:39:42.067435] [DEBUG] [LOCAL ] HLN: Loaded 53870 existing records from primary storage. [2025-10-10T22:39:42.078855] [INFO ] [MAIN ] HLN: Loaded 53870 primary data records. [2025-10-10T22:39:42.605750] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:42.608249] [INFO ] [MAIN ] HLIO: Generated 1820 derivative records from 28206 primary records. [2025-10-10T22:39:42.608488] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-10T22:39:42.641218] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:42.642937] [INFO ] [MAIN ] HLLY: Generated 1820 derivative records from 34004 primary records. [2025-10-10T22:39:42.643849] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-10T22:39:42.644695] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1820 records). [2025-10-10T22:39:42.645322] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-10T22:39:42.647881] [INFO ] [MAIN ] Derivative Progress: 877/1823 symbols completed. HLIO took 1.1s. Estimated remaining: 6m 4s. Rate: 156.0 symbols/min [2025-10-10T22:39:42.649232] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:42.678997] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:42.680415] [INFO ] [MAIN ] HLN: Generated 1820 derivative records from 53870 primary records. [2025-10-10T22:39:42.681016] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-10T22:39:42.681902] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1820 records). [2025-10-10T22:39:42.682357] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-10T22:39:42.691914] [INFO ] [MAIN ] Derivative Progress: 878/1823 symbols completed. HLLY took 1.1s. Estimated remaining: 6m 3s. Rate: 156.2 symbols/min [2025-10-10T22:39:42.693423] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:42.703740] [DEBUG] [LOCAL ] HLN: Derivative data saved (1820 records). [2025-10-10T22:39:42.704011] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-10T22:39:42.705921] [INFO ] [MAIN ] Derivative Progress: 879/1823 symbols completed. HLN took 1.1s. Estimated remaining: 6m 2s. Rate: 156.4 symbols/min [2025-10-10T22:39:42.706231] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:42.753374] [DEBUG] [LOCAL ] HLT: Loaded 51350 existing records from primary storage. [2025-10-10T22:39:42.753587] [INFO ] [MAIN ] HLT: Loaded 51350 primary data records. [2025-10-10T22:39:42.883836] [DEBUG] [LOCAL ] HLX: Loaded 48235 existing records from primary storage. [2025-10-10T22:39:42.902172] [INFO ] [MAIN ] HLX: Loaded 48235 primary data records. [2025-10-10T22:39:42.923637] [DEBUG] [LOCAL ] HMC: Loaded 47231 existing records from primary storage. [2025-10-10T22:39:42.946227] [INFO ] [MAIN ] HMC: Loaded 47231 primary data records. [2025-10-10T22:39:43.763201] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:43.764025] [INFO ] [MAIN ] HLT: Generated 1820 derivative records from 51350 primary records. [2025-10-10T22:39:43.764451] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-10T22:39:43.801364] [DEBUG] [LOCAL ] HLT: Derivative data saved (1820 records). [2025-10-10T22:39:43.815838] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-10T22:39:43.818448] [INFO ] [MAIN ] Derivative Progress: 880/1823 symbols completed. HLT took 1.2s. Estimated remaining: 6m 3s. Rate: 156.0 symbols/min [2025-10-10T22:39:43.801728] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:43.818636] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:43.819139] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:43.820079] [INFO ] [MAIN ] HMC: Generated 1820 derivative records from 47231 primary records. [2025-10-10T22:39:43.821357] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-10T22:39:43.821299] [INFO ] [MAIN ] HLX: Generated 1820 derivative records from 48235 primary records. [2025-10-10T22:39:43.822335] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-10T22:39:43.849807] [DEBUG] [LOCAL ] HMC: Derivative data saved (1820 records). [2025-10-10T22:39:43.850674] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-10T22:39:43.853157] [INFO ] [MAIN ] Derivative Progress: 881/1823 symbols completed. HMC took 1.1s. Estimated remaining: 6m 2s. Rate: 156.2 symbols/min [2025-10-10T22:39:43.854325] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:43.856773] [DEBUG] [LOCAL ] HLX: Derivative data saved (1820 records). [2025-10-10T22:39:43.856993] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-10T22:39:43.859121] [INFO ] [MAIN ] Derivative Progress: 882/1823 symbols completed. HLX took 1.2s. Estimated remaining: 6m 1s. Rate: 156.4 symbols/min [2025-10-10T22:39:43.859443] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:43.876202] [DEBUG] [LOCAL ] HMN: Loaded 23715 existing records from primary storage. [2025-10-10T22:39:43.876336] [INFO ] [MAIN ] HMN: Loaded 23715 primary data records. [2025-10-10T22:39:44.201956] [DEBUG] [LOCAL ] HNI: Loaded 29751 existing records from primary storage. [2025-10-10T22:39:44.202188] [INFO ] [MAIN ] HNI: Loaded 29751 primary data records. [2025-10-10T22:39:44.329087] [DEBUG] [LOCAL ] HMY: Loaded 53913 existing records from primary storage. [2025-10-10T22:39:44.335783] [INFO ] [MAIN ] HMY: Loaded 53913 primary data records. [2025-10-10T22:39:44.890448] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:44.892405] [INFO ] [MAIN ] HMN: Generated 1820 derivative records from 23715 primary records. [2025-10-10T22:39:44.893432] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-10T22:39:44.914474] [DEBUG] [LOCAL ] HMN: Derivative data saved (1820 records). [2025-10-10T22:39:44.914766] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-10T22:39:44.917498] [INFO ] [MAIN ] Derivative Progress: 883/1823 symbols completed. HMN took 1.1s. Estimated remaining: 6m 1s. Rate: 156.1 symbols/min [2025-10-10T22:39:44.937805] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:44.938838] [INFO ] [MAIN ] HNI: Generated 1820 derivative records from 29751 primary records. [2025-10-10T22:39:44.938923] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-10T22:39:44.971881] [DEBUG] [LOCAL ] HNI: Derivative data saved (1820 records). [2025-10-10T22:39:44.972329] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-10T22:39:44.972179] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:44.974385] [INFO ] [MAIN ] Derivative Progress: 884/1823 symbols completed. HNI took 1.1s. Estimated remaining: 6m 1s. Rate: 156.2 symbols/min [2025-10-10T22:39:44.975196] [INFO ] [MAIN ] HMY: Generated 1820 derivative records from 53913 primary records. [2025-10-10T22:39:44.975302] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-10T22:39:44.991266] [DEBUG] [LOCAL ] HMY: Derivative data saved (1820 records). [2025-10-10T22:39:44.991324] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-10T22:39:44.993254] [INFO ] [MAIN ] Derivative Progress: 885/1823 symbols completed. HMY took 1.1s. Estimated remaining: 5m 60s. Rate: 156.4 symbols/min [2025-10-10T22:39:44.993799] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:44.993674] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:44.993736] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:45.078769] [DEBUG] [LOCAL ] HOUS: Loaded 45606 existing records from primary storage. [2025-10-10T22:39:45.079502] [INFO ] [MAIN ] HOUS: Loaded 45606 primary data records. [2025-10-10T22:39:45.080150] [DEBUG] [LOCAL ] HOMB: Loaded 44074 existing records from primary storage. [2025-10-10T22:39:45.131885] [INFO ] [MAIN ] HOMB: Loaded 44074 primary data records. [2025-10-10T22:39:45.145045] [DEBUG] [LOCAL ] HOG: Loaded 51709 existing records from primary storage. [2025-10-10T22:39:45.223768] [INFO ] [MAIN ] HOG: Loaded 51709 primary data records. [2025-10-10T22:39:46.064376] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:46.065723] [INFO ] [MAIN ] HOUS: Generated 1820 derivative records from 45606 primary records. [2025-10-10T22:39:46.066997] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-10T22:39:46.097970] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1820 records). [2025-10-10T22:39:46.098285] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:46.100776] [INFO ] [MAIN ] HOMB: Generated 1820 derivative records from 44074 primary records. [2025-10-10T22:39:46.099260] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-10T22:39:46.101459] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-10T22:39:46.103797] [INFO ] [MAIN ] Derivative Progress: 886/1823 symbols completed. HOUS took 1.1s. Estimated remaining: 6m 0s. Rate: 156.0 symbols/min [2025-10-10T22:39:46.104404] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:46.135035] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:46.136584] [INFO ] [MAIN ] HOG: Generated 1820 derivative records from 51709 primary records. [2025-10-10T22:39:46.136755] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-10T22:39:46.147457] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1820 records). [2025-10-10T22:39:46.151549] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-10T22:39:46.154859] [INFO ] [MAIN ] Derivative Progress: 887/1823 symbols completed. HOMB took 1.2s. Estimated remaining: 5m 60s. Rate: 156.2 symbols/min [2025-10-10T22:39:46.160093] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:46.163314] [DEBUG] [LOCAL ] HOG: Derivative data saved (1820 records). [2025-10-10T22:39:46.163532] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-10T22:39:46.166310] [INFO ] [MAIN ] Derivative Progress: 888/1823 symbols completed. HOG took 1.2s. Estimated remaining: 5m 59s. Rate: 156.4 symbols/min [2025-10-10T22:39:46.166502] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:46.171921] [DEBUG] [LOCAL ] HOV: Loaded 14065 existing records from primary storage. [2025-10-10T22:39:46.172990] [INFO ] [MAIN ] HOV: Loaded 14065 primary data records. [2025-10-10T22:39:46.537818] [DEBUG] [LOCAL ] HP: Loaded 52330 existing records from primary storage. [2025-10-10T22:39:46.539184] [INFO ] [MAIN ] HP: Loaded 52330 primary data records. [2025-10-10T22:39:46.551477] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-10-10T22:39:46.578395] [INFO ] [MAIN ] HPE: Loaded 54477 primary data records. [2025-10-10T22:39:46.939635] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:46.996603] [INFO ] [MAIN ] HOV: Generated 1820 derivative records from 14065 primary records. [2025-10-10T22:39:47.002529] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-10T22:39:47.214621] [DEBUG] [LOCAL ] HOV: Derivative data saved (1820 records). [2025-10-10T22:39:47.214916] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-10T22:39:47.216892] [INFO ] [MAIN ] Derivative Progress: 889/1823 symbols completed. HOV took 1.1s. Estimated remaining: 5m 59s. Rate: 156.1 symbols/min [2025-10-10T22:39:47.218396] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:47.234799] [DEBUG] [LOCAL ] HPF: Loaded 7555 existing records from primary storage. [2025-10-10T22:39:47.235222] [INFO ] [MAIN ] HPF: Loaded 7555 primary data records. [2025-10-10T22:39:47.320976] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:47.328483] [INFO ] [MAIN ] HP: Generated 1820 derivative records from 52330 primary records. [2025-10-10T22:39:47.339046] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-10T22:39:47.378594] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:47.382612] [INFO ] [MAIN ] HPE: Generated 1820 derivative records from 54477 primary records. [2025-10-10T22:39:47.394574] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-10T22:39:47.479977] [DEBUG] [LOCAL ] HP: Derivative data saved (1820 records). [2025-10-10T22:39:47.485889] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-10T22:39:47.487118] [DEBUG] [LOCAL ] HPE: Derivative data saved (1820 records). [2025-10-10T22:39:47.612348] [INFO ] [MAIN ] Derivative Progress: 890/1823 symbols completed. HP took 1.5s. Estimated remaining: 5m 59s. Rate: 156.1 symbols/min [2025-10-10T22:39:47.612717] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:47.610485] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-10T22:39:47.615627] [INFO ] [MAIN ] Derivative Progress: 891/1823 symbols completed. HPE took 1.4s. Estimated remaining: 5m 58s. Rate: 156.2 symbols/min [2025-10-10T22:39:47.616086] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:47.629775] [DEBUG] [LOCAL ] HPI: Loaded 10713 existing records from primary storage. [2025-10-10T22:39:47.630923] [INFO ] [MAIN ] HPI: Loaded 10713 primary data records. [2025-10-10T22:39:47.959197] [DEBUG] [LOCAL ] HPP: Loaded 51811 existing records from primary storage. [2025-10-10T22:39:47.964571] [INFO ] [MAIN ] HPP: Loaded 51811 primary data records. [2025-10-10T22:39:48.029714] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:48.057609] [INFO ] [MAIN ] HPF: Generated 1820 derivative records from 7555 primary records. [2025-10-10T22:39:48.075958] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-10T22:39:48.314519] [DEBUG] [LOCAL ] HPF: Derivative data saved (1820 records). [2025-10-10T22:39:48.314807] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-10T22:39:48.316844] [INFO ] [MAIN ] Derivative Progress: 892/1823 symbols completed. HPF took 1.1s. Estimated remaining: 5m 58s. Rate: 156.1 symbols/min [2025-10-10T22:39:48.317185] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:48.335927] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:48.337291] [INFO ] [MAIN ] HPI: Generated 1820 derivative records from 10713 primary records. [2025-10-10T22:39:48.337730] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-10T22:39:48.354964] [DEBUG] [LOCAL ] HPI: Derivative data saved (1820 records). [2025-10-10T22:39:48.355096] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-10T22:39:48.357170] [INFO ] [MAIN ] Derivative Progress: 893/1823 symbols completed. HPI took 0.7s. Estimated remaining: 5m 57s. Rate: 156.2 symbols/min [2025-10-10T22:39:48.357353] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:48.385936] [DEBUG] [LOCAL ] HPS: Loaded 10421 existing records from primary storage. [2025-10-10T22:39:48.387085] [INFO ] [MAIN ] HPS: Loaded 10421 primary data records. [2025-10-10T22:39:48.479008] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:48.490450] [INFO ] [MAIN ] HPP: Generated 1820 derivative records from 51811 primary records. [2025-10-10T22:39:48.506334] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-10T22:39:48.524828] [DEBUG] [LOCAL ] HPQ: Loaded 54448 existing records from primary storage. [2025-10-10T22:39:48.531141] [INFO ] [MAIN ] HPQ: Loaded 54448 primary data records. [2025-10-10T22:39:48.892859] [DEBUG] [LOCAL ] HPP: Derivative data saved (1820 records). [2025-10-10T22:39:48.893583] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-10T22:39:48.895741] [INFO ] [MAIN ] Derivative Progress: 894/1823 symbols completed. HPP took 1.3s. Estimated remaining: 5m 57s. Rate: 156.2 symbols/min [2025-10-10T22:39:48.916941] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:49.143179] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:49.144963] [INFO ] [MAIN ] HPS: Generated 1820 derivative records from 10421 primary records. [2025-10-10T22:39:49.145840] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-10T22:39:49.159502] [DEBUG] [LOCAL ] HQH: Loaded 26049 existing records from primary storage. [2025-10-10T22:39:49.171788] [INFO ] [MAIN ] HQH: Loaded 26049 primary data records. [2025-10-10T22:39:49.313117] [DEBUG] [LOCAL ] HPS: Derivative data saved (1820 records). [2025-10-10T22:39:49.322071] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-10T22:39:49.324398] [INFO ] [MAIN ] Derivative Progress: 895/1823 symbols completed. HPS took 1.0s. Estimated remaining: 5m 57s. Rate: 156.2 symbols/min [2025-10-10T22:39:49.332941] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:49.434698] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:49.522602] [INFO ] [MAIN ] HPQ: Generated 1820 derivative records from 54448 primary records. [2025-10-10T22:39:49.608246] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-10T22:39:49.608103] [DEBUG] [LOCAL ] HQL: Loaded 17027 existing records from primary storage. [2025-10-10T22:39:49.611208] [INFO ] [MAIN ] HQL: Loaded 17027 primary data records. [2025-10-10T22:39:49.721459] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1820 records). [2025-10-10T22:39:49.744000] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-10T22:39:49.780677] [INFO ] [MAIN ] Derivative Progress: 896/1823 symbols completed. HPQ took 1.5s. Estimated remaining: 5m 56s. Rate: 156.1 symbols/min [2025-10-10T22:39:49.804186] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:50.116338] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:50.118211] [INFO ] [MAIN ] HQH: Generated 1820 derivative records from 26049 primary records. [2025-10-10T22:39:50.118367] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-10T22:39:50.160776] [DEBUG] [LOCAL ] HQH: Derivative data saved (1820 records). [2025-10-10T22:39:50.161969] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-10T22:39:50.164636] [INFO ] [MAIN ] Derivative Progress: 897/1823 symbols completed. HQH took 1.2s. Estimated remaining: 5m 56s. Rate: 156.1 symbols/min [2025-10-10T22:39:50.165426] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:50.192939] [DEBUG] [LOCAL ] HR: Loaded 52742 existing records from primary storage. [2025-10-10T22:39:50.193282] [INFO ] [MAIN ] HR: Loaded 52742 primary data records. [2025-10-10T22:39:50.286303] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:50.312268] [INFO ] [MAIN ] HQL: Generated 1820 derivative records from 17027 primary records. [2025-10-10T22:39:50.346985] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-10T22:39:50.587471] [DEBUG] [LOCAL ] HRB: Loaded 49060 existing records from primary storage. [2025-10-10T22:39:50.590562] [INFO ] [MAIN ] HRB: Loaded 49060 primary data records. [2025-10-10T22:39:50.663974] [DEBUG] [LOCAL ] HQL: Derivative data saved (1820 records). [2025-10-10T22:39:50.664124] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-10T22:39:50.666290] [INFO ] [MAIN ] Derivative Progress: 898/1823 symbols completed. HQL took 1.3s. Estimated remaining: 5m 56s. Rate: 156.1 symbols/min [2025-10-10T22:39:50.910704] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:50.912294] [INFO ] [MAIN ] HR: Generated 1820 derivative records from 52742 primary records. [2025-10-10T22:39:50.912527] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-10T22:39:50.932782] [DEBUG] [LOCAL ] HR: Derivative data saved (1820 records). [2025-10-10T22:39:50.933680] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-10T22:39:50.936103] [INFO ] [MAIN ] Derivative Progress: 899/1823 symbols completed. HR took 1.1s. Estimated remaining: 5m 55s. Rate: 156.1 symbols/min [2025-10-10T22:39:50.954065] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:50.954683] [INFO ] [MAIN ] HRB: Generated 1820 derivative records from 49060 primary records. [2025-10-10T22:39:50.954747] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-10T22:39:50.970255] [DEBUG] [LOCAL ] HRB: Derivative data saved (1820 records). [2025-10-10T22:39:50.970319] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-10T22:39:50.972959] [INFO ] [MAIN ] Derivative Progress: 900/1823 symbols completed. HRB took 0.8s. Estimated remaining: 5m 54s. Rate: 156.3 symbols/min [2025-10-10T22:39:50.973376] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:50.973457] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:50.973707] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:51.018109] [DEBUG] [LOCAL ] HRTG: Loaded 34334 existing records from primary storage. [2025-10-10T22:39:51.042174] [INFO ] [MAIN ] HRTG: Loaded 34334 primary data records. [2025-10-10T22:39:51.042721] [DEBUG] [LOCAL ] HRI: Loaded 32990 existing records from primary storage. [2025-10-10T22:39:51.042900] [INFO ] [MAIN ] HRI: Loaded 32990 primary data records. [2025-10-10T22:39:51.234392] [DEBUG] [LOCAL ] HRL: Loaded 53874 existing records from primary storage. [2025-10-10T22:39:51.239824] [INFO ] [MAIN ] HRL: Loaded 53874 primary data records. [2025-10-10T22:39:52.034915] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:52.038890] [INFO ] [MAIN ] HRTG: Generated 1820 derivative records from 34334 primary records. [2025-10-10T22:39:52.039899] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-10T22:39:52.056388] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:39:52.066382] [INFO ] [MAIN ] HRI: Generated 1819 derivative records from 32990 primary records. [2025-10-10T22:39:52.070615] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-10T22:39:52.100888] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:52.097180] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1820 records). [2025-10-10T22:39:52.103796] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-10T22:39:52.105896] [INFO ] [MAIN ] Derivative Progress: 901/1823 symbols completed. HRTG took 1.1s. Estimated remaining: 5m 55s. Rate: 155.9 symbols/min [2025-10-10T22:39:52.106051] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:52.103297] [INFO ] [MAIN ] HRL: Generated 1820 derivative records from 53874 primary records. [2025-10-10T22:39:52.106944] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-10T22:39:52.125720] [DEBUG] [LOCAL ] HRL: Derivative data saved (1820 records). [2025-10-10T22:39:52.121570] [DEBUG] [LOCAL ] HRI: Derivative data saved (1819 records). [2025-10-10T22:39:52.126029] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-10T22:39:52.125980] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-10T22:39:52.128092] [INFO ] [MAIN ] Derivative Progress: 902/1823 symbols completed. HRL took 1.2s. Estimated remaining: 5m 54s. Rate: 156.1 symbols/min [2025-10-10T22:39:52.130522] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:52.130722] [INFO ] [MAIN ] Derivative Progress: 903/1823 symbols completed. HRI took 1.2s. Estimated remaining: 5m 53s. Rate: 156.3 symbols/min [2025-10-10T22:39:52.131347] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:52.149256] [DEBUG] [LOCAL ] HSHP: Loaded 15260 existing records from primary storage. [2025-10-10T22:39:52.149465] [INFO ] [MAIN ] HSHP: Loaded 15260 primary data records. [2025-10-10T22:39:52.487773] [DEBUG] [LOCAL ] HSBC: Loaded 51725 existing records from primary storage. [2025-10-10T22:39:52.488031] [INFO ] [MAIN ] HSBC: Loaded 51725 primary data records. [2025-10-10T22:39:52.613885] [DEBUG] [LOCAL ] HSY: Loaded 51062 existing records from primary storage. [2025-10-10T22:39:52.654181] [INFO ] [MAIN ] HSY: Loaded 51062 primary data records. [2025-10-10T22:39:53.009254] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:53.011037] [INFO ] [MAIN ] HSHP: Generated 1820 derivative records from 15260 primary records. [2025-10-10T22:39:53.018247] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-10T22:39:53.195026] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1820 records). [2025-10-10T22:39:53.195397] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-10T22:39:53.197458] [INFO ] [MAIN ] Derivative Progress: 904/1823 symbols completed. HSHP took 1.1s. Estimated remaining: 5m 54s. Rate: 156.0 symbols/min [2025-10-10T22:39:53.197916] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:53.218008] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:53.218723] [INFO ] [MAIN ] HSBC: Generated 1820 derivative records from 51725 primary records. [2025-10-10T22:39:53.218882] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-10T22:39:53.239532] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1820 records). [2025-10-10T22:39:53.239790] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-10T22:39:53.241623] [INFO ] [MAIN ] Derivative Progress: 905/1823 symbols completed. HSBC took 1.1s. Estimated remaining: 5m 53s. Rate: 156.1 symbols/min [2025-10-10T22:39:53.241921] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:53.248235] [DEBUG] [LOCAL ] HTD: Loaded 14213 existing records from primary storage. [2025-10-10T22:39:53.249672] [INFO ] [MAIN ] HTD: Loaded 14213 primary data records. [2025-10-10T22:39:53.376108] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:53.380125] [INFO ] [MAIN ] HSY: Generated 1820 derivative records from 51062 primary records. [2025-10-10T22:39:53.386460] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-10T22:39:53.483737] [DEBUG] [LOCAL ] HSY: Derivative data saved (1820 records). [2025-10-10T22:39:53.483851] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-10T22:39:53.485946] [INFO ] [MAIN ] Derivative Progress: 906/1823 symbols completed. HSY took 1.4s. Estimated remaining: 5m 52s. Rate: 156.2 symbols/min [2025-10-10T22:39:53.486136] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:53.617498] [DEBUG] [LOCAL ] HTGC: Loaded 48240 existing records from primary storage. [2025-10-10T22:39:53.618986] [INFO ] [MAIN ] HTGC: Loaded 48240 primary data records. [2025-10-10T22:39:53.788047] [DEBUG] [LOCAL ] HTH: Loaded 32795 existing records from primary storage. [2025-10-10T22:39:53.817283] [INFO ] [MAIN ] HTH: Loaded 32795 primary data records. [2025-10-10T22:39:54.301047] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:54.302281] [INFO ] [MAIN ] HTD: Generated 1820 derivative records from 14213 primary records. [2025-10-10T22:39:54.302624] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-10T22:39:54.323659] [DEBUG] [LOCAL ] HTD: Derivative data saved (1820 records). [2025-10-10T22:39:54.324256] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-10T22:39:54.327426] [INFO ] [MAIN ] Derivative Progress: 907/1823 symbols completed. HTD took 1.1s. Estimated remaining: 5m 52s. Rate: 156.0 symbols/min [2025-10-10T22:39:54.328928] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:54.351092] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:54.352518] [INFO ] [MAIN ] HTGC: Generated 1820 derivative records from 48240 primary records. [2025-10-10T22:39:54.352740] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-10T22:39:54.395755] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:54.397156] [INFO ] [MAIN ] HTH: Generated 1820 derivative records from 32795 primary records. [2025-10-10T22:39:54.397898] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-10T22:39:54.407203] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1820 records). [2025-10-10T22:39:54.410917] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-10T22:39:54.415093] [DEBUG] [LOCAL ] HTH: Derivative data saved (1820 records). [2025-10-10T22:39:54.415891] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-10T22:39:54.427591] [INFO ] [MAIN ] Derivative Progress: 908/1823 symbols completed. HTGC took 1.2s. Estimated remaining: 5m 52s. Rate: 156.1 symbols/min [2025-10-10T22:39:54.432005] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:54.432181] [INFO ] [MAIN ] Derivative Progress: 909/1823 symbols completed. HTH took 0.9s. Estimated remaining: 5m 51s. Rate: 156.3 symbols/min [2025-10-10T22:39:54.433152] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:54.433043] [DEBUG] [LOCAL ] HUBB: Loaded 37087 existing records from primary storage. [2025-10-10T22:39:54.433530] [INFO ] [MAIN ] HUBB: Loaded 37087 primary data records. [2025-10-10T22:39:54.794599] [DEBUG] [LOCAL ] HUM: Loaded 49709 existing records from primary storage. [2025-10-10T22:39:54.795517] [DEBUG] [LOCAL ] HUBS: Loaded 40321 existing records from primary storage. [2025-10-10T22:39:54.796050] [INFO ] [MAIN ] HUM: Loaded 49709 primary data records. [2025-10-10T22:39:54.795898] [INFO ] [MAIN ] HUBS: Loaded 40321 primary data records. [2025-10-10T22:39:55.464810] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:55.480391] [INFO ] [MAIN ] HUBB: Generated 1820 derivative records from 37087 primary records. [2025-10-10T22:39:55.481406] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-10T22:39:55.500848] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1820 records). [2025-10-10T22:39:55.501682] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-10T22:39:55.504178] [INFO ] [MAIN ] Derivative Progress: 910/1823 symbols completed. HUBB took 1.2s. Estimated remaining: 5m 51s. Rate: 156.0 symbols/min [2025-10-10T22:39:55.504568] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:55.532773] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:55.545299] [INFO ] [MAIN ] HUM: Generated 1820 derivative records from 49709 primary records. [2025-10-10T22:39:55.545927] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:55.545623] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-10T22:39:55.546524] [INFO ] [MAIN ] HUBS: Generated 1820 derivative records from 40321 primary records. [2025-10-10T22:39:55.547276] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-10T22:39:55.591266] [DEBUG] [LOCAL ] HUM: Derivative data saved (1820 records). [2025-10-10T22:39:55.592763] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-10-10T22:39:55.593390] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1820 records). [2025-10-10T22:39:55.595542] [INFO ] [MAIN ] Derivative Progress: 911/1823 symbols completed. HUM took 1.2s. Estimated remaining: 5m 51s. Rate: 156.1 symbols/min [2025-10-10T22:39:55.595695] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-10T22:39:55.597708] [INFO ] [MAIN ] Derivative Progress: 912/1823 symbols completed. HUBS took 1.2s. Estimated remaining: 5m 50s. Rate: 156.3 symbols/min [2025-10-10T22:39:55.597627] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:55.598069] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:55.615185] [DEBUG] [LOCAL ] HUN: Loaded 53981 existing records from primary storage. [2025-10-10T22:39:55.615400] [INFO ] [MAIN ] HUN: Loaded 53981 primary data records. [2025-10-10T22:39:55.725162] [DEBUG] [LOCAL ] HVT: Loaded 15512 existing records from primary storage. [2025-10-10T22:39:55.728437] [INFO ] [MAIN ] HVT: Loaded 15512 primary data records. [2025-10-10T22:39:56.068893] [DEBUG] [LOCAL ] HUYA: Loaded 44619 existing records from primary storage. [2025-10-10T22:39:56.087494] [INFO ] [MAIN ] HUYA: Loaded 44619 primary data records. [2025-10-10T22:39:56.566821] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:56.568952] [INFO ] [MAIN ] HUN: Generated 1820 derivative records from 53981 primary records. [2025-10-10T22:39:56.569162] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-10T22:39:56.586003] [DEBUG] [LOCAL ] HUN: Derivative data saved (1820 records). [2025-10-10T22:39:56.586627] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-10T22:39:56.590202] [INFO ] [MAIN ] Derivative Progress: 913/1823 symbols completed. HUN took 1.1s. Estimated remaining: 5m 50s. Rate: 156.0 symbols/min [2025-10-10T22:39:56.605158] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:56.605926] [INFO ] [MAIN ] HVT: Generated 1820 derivative records from 15512 primary records. [2025-10-10T22:39:56.606193] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-10T22:39:56.637961] [DEBUG] [LOCAL ] HVT: Derivative data saved (1820 records). [2025-10-10T22:39:56.638063] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-10T22:39:56.639917] [INFO ] [MAIN ] Derivative Progress: 914/1823 symbols completed. HVT took 1.0s. Estimated remaining: 5m 49s. Rate: 156.1 symbols/min [2025-10-10T22:39:56.637900] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:56.640792] [INFO ] [MAIN ] HUYA: Generated 1820 derivative records from 44619 primary records. [2025-10-10T22:39:56.640964] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-10T22:39:56.656122] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1820 records). [2025-10-10T22:39:56.656178] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-10T22:39:56.658294] [INFO ] [MAIN ] Derivative Progress: 915/1823 symbols completed. HUYA took 1.1s. Estimated remaining: 5m 49s. Rate: 156.3 symbols/min [2025-10-10T22:39:56.658753] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:56.658819] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:56.658678] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:56.672430] [DEBUG] [LOCAL ] HY: Loaded 10112 existing records from primary storage. [2025-10-10T22:39:56.672632] [INFO ] [MAIN ] HY: Loaded 10112 primary data records. [2025-10-10T22:39:57.038212] [DEBUG] [LOCAL ] HXL: Loaded 46548 existing records from primary storage. [2025-10-10T22:39:57.046878] [INFO ] [MAIN ] HXL: Loaded 46548 primary data records. [2025-10-10T22:39:57.101262] [DEBUG] [LOCAL ] HWM: Loaded 53615 existing records from primary storage. [2025-10-10T22:39:57.129911] [INFO ] [MAIN ] HWM: Loaded 53615 primary data records. [2025-10-10T22:39:57.682850] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:57.684605] [INFO ] [MAIN ] HY: Generated 1820 derivative records from 10112 primary records. [2025-10-10T22:39:57.685216] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-10T22:39:57.703972] [DEBUG] [LOCAL ] HY: Derivative data saved (1820 records). [2025-10-10T22:39:57.704284] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-10T22:39:57.706432] [INFO ] [MAIN ] Derivative Progress: 916/1823 symbols completed. HY took 1.0s. Estimated remaining: 5m 49s. Rate: 156.0 symbols/min [2025-10-10T22:39:57.706963] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:57.724107] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:57.725095] [INFO ] [MAIN ] HXL: Generated 1820 derivative records from 46548 primary records. [2025-10-10T22:39:57.725341] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-10T22:39:57.747889] [DEBUG] [LOCAL ] HXL: Derivative data saved (1820 records). [2025-10-10T22:39:57.759430] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-10T22:39:57.759786] [DEBUG] [LOCAL ] HYI: Loaded 10069 existing records from primary storage. [2025-10-10T22:39:57.767102] [INFO ] [MAIN ] Derivative Progress: 917/1823 symbols completed. HXL took 1.1s. Estimated remaining: 5m 48s. Rate: 156.2 symbols/min [2025-10-10T22:39:57.767749] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:57.767978] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:57.768047] [INFO ] [MAIN ] HYI: Loaded 10069 primary data records. [2025-10-10T22:39:57.774748] [INFO ] [MAIN ] HWM: Generated 1820 derivative records from 53615 primary records. [2025-10-10T22:39:57.787699] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-10T22:39:57.915347] [DEBUG] [LOCAL ] HWM: Derivative data saved (1820 records). [2025-10-10T22:39:57.931101] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-10T22:39:57.933158] [INFO ] [MAIN ] Derivative Progress: 918/1823 symbols completed. HWM took 1.3s. Estimated remaining: 5m 48s. Rate: 156.3 symbols/min [2025-10-10T22:39:57.933318] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:58.119197] [DEBUG] [LOCAL ] HYTR: Loaded 3168 existing records from primary storage. [2025-10-10T22:39:58.119378] [INFO ] [MAIN ] HYTR: Loaded 3168 primary data records. [2025-10-10T22:39:58.132468] [DEBUG] [LOCAL ] HYT: Loaded 34001 existing records from primary storage. [2025-10-10T22:39:58.147702] [INFO ] [MAIN ] HYT: Loaded 34001 primary data records. [2025-10-10T22:39:58.802545] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:58.803994] [INFO ] [MAIN ] HYI: Generated 1820 derivative records from 10069 primary records. [2025-10-10T22:39:58.804371] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-10T22:39:58.821667] [DEBUG] [LOCAL ] HYI: Derivative data saved (1820 records). [2025-10-10T22:39:58.821912] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-10T22:39:58.824002] [INFO ] [MAIN ] Derivative Progress: 919/1823 symbols completed. HYI took 1.1s. Estimated remaining: 5m 48s. Rate: 156.0 symbols/min [2025-10-10T22:39:58.824412] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:58.842305] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:39:58.843334] [INFO ] [MAIN ] HYTR: Generated 1819 derivative records from 3168 primary records. [2025-10-10T22:39:58.843943] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-10T22:39:58.872966] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1819 records). [2025-10-10T22:39:58.873638] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-10T22:39:58.875760] [INFO ] [MAIN ] Derivative Progress: 920/1823 symbols completed. HYTR took 0.9s. Estimated remaining: 5m 47s. Rate: 156.2 symbols/min [2025-10-10T22:39:58.887665] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:58.888134] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:58.889678] [INFO ] [MAIN ] HYT: Generated 1820 derivative records from 34001 primary records. [2025-10-10T22:39:58.889755] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-10T22:39:58.918512] [DEBUG] [LOCAL ] HYT: Derivative data saved (1820 records). [2025-10-10T22:39:58.915270] [DEBUG] [LOCAL ] HZO: Loaded 29457 existing records from primary storage. [2025-10-10T22:39:58.918770] [INFO ] [MAIN ] HZO: Loaded 29457 primary data records. [2025-10-10T22:39:58.918928] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-10T22:39:58.936123] [DEBUG] [LOCAL ] IAE: Loaded 6312 existing records from primary storage. [2025-10-10T22:39:58.929476] [INFO ] [MAIN ] Derivative Progress: 921/1823 symbols completed. HYT took 1.2s. Estimated remaining: 5m 46s. Rate: 156.3 symbols/min [2025-10-10T22:39:58.958333] [INFO ] [MAIN ] IAE: Loaded 6312 primary data records. [2025-10-10T22:39:58.974944] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:59.566032] [DEBUG] [LOCAL ] IAG: Loaded 54253 existing records from primary storage. [2025-10-10T22:39:59.566627] [INFO ] [MAIN ] IAG: Loaded 54253 primary data records. [2025-10-10T22:39:59.805545] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:59.805273] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:39:59.807409] [INFO ] [MAIN ] IAE: Generated 1820 derivative records from 6312 primary records. [2025-10-10T22:39:59.806430] [INFO ] [MAIN ] HZO: Generated 1820 derivative records from 29457 primary records. [2025-10-10T22:39:59.930911] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-10T22:39:59.941999] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-10T22:39:59.975394] [DEBUG] [LOCAL ] IAE: Derivative data saved (1820 records). [2025-10-10T22:39:59.975764] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-10T22:39:59.979063] [INFO ] [MAIN ] Derivative Progress: 922/1823 symbols completed. IAE took 1.1s. Estimated remaining: 5m 46s. Rate: 156.0 symbols/min [2025-10-10T22:39:59.980036] [DEBUG] [LOCAL ] HZO: Derivative data saved (1820 records). [2025-10-10T22:39:59.979352] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:39:59.980599] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-10T22:39:59.982998] [INFO ] [MAIN ] Derivative Progress: 923/1823 symbols completed. HZO took 1.2s. Estimated remaining: 5m 46s. Rate: 156.2 symbols/min [2025-10-10T22:39:59.983516] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:00.005965] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:00.006814] [INFO ] [MAIN ] IAG: Generated 1820 derivative records from 54253 primary records. [2025-10-10T22:40:00.006995] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-10T22:40:00.027638] [DEBUG] [LOCAL ] IAG: Derivative data saved (1820 records). [2025-10-10T22:40:00.027792] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-10T22:40:00.030241] [INFO ] [MAIN ] Derivative Progress: 924/1823 symbols completed. IAG took 1.1s. Estimated remaining: 5m 45s. Rate: 156.3 symbols/min [2025-10-10T22:40:00.030413] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:00.089340] [DEBUG] [LOCAL ] IBN: Loaded 53629 existing records from primary storage. [2025-10-10T22:40:00.089671] [INFO ] [MAIN ] IBN: Loaded 53629 primary data records. [2025-10-10T22:40:00.168991] [DEBUG] [LOCAL ] IBM: Loaded 54410 existing records from primary storage. [2025-10-10T22:40:00.177981] [DEBUG] [LOCAL ] IBP: Loaded 29252 existing records from primary storage. [2025-10-10T22:40:00.199932] [INFO ] [MAIN ] IBM: Loaded 54410 primary data records. [2025-10-10T22:40:00.205696] [INFO ] [MAIN ] IBP: Loaded 29252 primary data records. [2025-10-10T22:40:01.079605] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:01.080569] [INFO ] [MAIN ] IBN: Generated 1820 derivative records from 53629 primary records. [2025-10-10T22:40:01.080847] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-10T22:40:01.112318] [DEBUG] [LOCAL ] IBN: Derivative data saved (1820 records). [2025-10-10T22:40:01.112962] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:01.112699] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-10T22:40:01.114754] [INFO ] [MAIN ] Derivative Progress: 925/1823 symbols completed. IBN took 1.1s. Estimated remaining: 5m 45s. Rate: 156.0 symbols/min [2025-10-10T22:40:01.115786] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:01.115538] [INFO ] [MAIN ] IBM: Generated 1820 derivative records from 54410 primary records. [2025-10-10T22:40:01.117161] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-10T22:40:01.147782] [DEBUG] [LOCAL ] IBM: Derivative data saved (1820 records). [2025-10-10T22:40:01.145864] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:01.147996] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-10T22:40:01.148675] [INFO ] [MAIN ] IBP: Generated 1820 derivative records from 29252 primary records. [2025-10-10T22:40:01.151841] [INFO ] [MAIN ] Derivative Progress: 926/1823 symbols completed. IBM took 1.2s. Estimated remaining: 5m 45s. Rate: 156.2 symbols/min [2025-10-10T22:40:01.152000] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-10T22:40:01.152601] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:01.169709] [DEBUG] [LOCAL ] IBP: Derivative data saved (1820 records). [2025-10-10T22:40:01.169838] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-10T22:40:01.172021] [INFO ] [MAIN ] Derivative Progress: 927/1823 symbols completed. IBP took 1.1s. Estimated remaining: 5m 44s. Rate: 156.4 symbols/min [2025-10-10T22:40:01.172289] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:01.203456] [DEBUG] [LOCAL ] IBTA: Loaded 37604 existing records from primary storage. [2025-10-10T22:40:01.203618] [INFO ] [MAIN ] IBTA: Loaded 37604 primary data records. [2025-10-10T22:40:01.401864] [DEBUG] [LOCAL ] ICL: Loaded 39002 existing records from primary storage. [2025-10-10T22:40:01.402130] [INFO ] [MAIN ] ICL: Loaded 39002 primary data records. [2025-10-10T22:40:01.619049] [DEBUG] [LOCAL ] ICE: Loaded 53792 existing records from primary storage. [2025-10-10T22:40:01.637694] [INFO ] [MAIN ] ICE: Loaded 53792 primary data records. [2025-10-10T22:40:02.217044] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:02.218276] [INFO ] [MAIN ] IBTA: Generated 1820 derivative records from 37604 primary records. [2025-10-10T22:40:02.218422] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-10T22:40:02.245300] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1820 records). [2025-10-10T22:40:02.246264] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-10T22:40:02.248408] [INFO ] [MAIN ] Derivative Progress: 928/1823 symbols completed. IBTA took 1.1s. Estimated remaining: 5m 44s. Rate: 156.0 symbols/min [2025-10-10T22:40:02.262633] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:02.263681] [INFO ] [MAIN ] ICL: Generated 1820 derivative records from 39002 primary records. [2025-10-10T22:40:02.263787] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-10T22:40:02.281566] [DEBUG] [LOCAL ] ICL: Derivative data saved (1820 records). [2025-10-10T22:40:02.281858] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-10T22:40:02.296616] [INFO ] [MAIN ] Derivative Progress: 929/1823 symbols completed. ICL took 1.1s. Estimated remaining: 5m 43s. Rate: 156.2 symbols/min [2025-10-10T22:40:02.297328] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:02.298327] [INFO ] [MAIN ] ICE: Generated 1820 derivative records from 53792 primary records. [2025-10-10T22:40:02.298391] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-10T22:40:02.315066] [DEBUG] [LOCAL ] ICE: Derivative data saved (1820 records). [2025-10-10T22:40:02.315210] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-10T22:40:02.317388] [INFO ] [MAIN ] Derivative Progress: 930/1823 symbols completed. ICE took 1.2s. Estimated remaining: 5m 43s. Rate: 156.4 symbols/min [2025-10-10T22:40:02.317857] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:02.317930] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:02.318098] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:02.334611] [DEBUG] [LOCAL ] IDE: Loaded 9136 existing records from primary storage. [2025-10-10T22:40:02.339591] [INFO ] [MAIN ] IDE: Loaded 9136 primary data records. [2025-10-10T22:40:02.430347] [DEBUG] [LOCAL ] IDT: Loaded 18518 existing records from primary storage. [2025-10-10T22:40:02.446595] [INFO ] [MAIN ] IDT: Loaded 18518 primary data records. [2025-10-10T22:40:02.534321] [DEBUG] [LOCAL ] IDA: Loaded 33044 existing records from primary storage. [2025-10-10T22:40:02.544353] [INFO ] [MAIN ] IDA: Loaded 33044 primary data records. [2025-10-10T22:40:03.371472] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:03.384190] [INFO ] [MAIN ] IDE: Generated 1820 derivative records from 9136 primary records. [2025-10-10T22:40:03.384795] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:03.385525] [INFO ] [MAIN ] IDT: Generated 1820 derivative records from 18518 primary records. [2025-10-10T22:40:03.384532] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-10T22:40:03.386433] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-10T22:40:03.428914] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:03.431126] [INFO ] [MAIN ] IDA: Generated 1820 derivative records from 33044 primary records. [2025-10-10T22:40:03.431678] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-10T22:40:03.434397] [DEBUG] [LOCAL ] IDE: Derivative data saved (1820 records). [2025-10-10T22:40:03.434493] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-10T22:40:03.434333] [DEBUG] [LOCAL ] IDT: Derivative data saved (1820 records). [2025-10-10T22:40:03.436750] [INFO ] [MAIN ] Derivative Progress: 931/1823 symbols completed. IDE took 1.1s. Estimated remaining: 5m 43s. Rate: 156.0 symbols/min [2025-10-10T22:40:03.437144] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:03.444537] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-10T22:40:03.447060] [INFO ] [MAIN ] Derivative Progress: 932/1823 symbols completed. IDT took 1.1s. Estimated remaining: 5m 42s. Rate: 156.2 symbols/min [2025-10-10T22:40:03.451398] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:03.456550] [DEBUG] [LOCAL ] IDA: Derivative data saved (1820 records). [2025-10-10T22:40:03.456869] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-10T22:40:03.459146] [INFO ] [MAIN ] Derivative Progress: 933/1823 symbols completed. IDA took 1.1s. Estimated remaining: 5m 42s. Rate: 156.4 symbols/min [2025-10-10T22:40:03.459328] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:03.489468] [DEBUG] [LOCAL ] IFN: Loaded 18563 existing records from primary storage. [2025-10-10T22:40:03.489665] [INFO ] [MAIN ] IFN: Loaded 18563 primary data records. [2025-10-10T22:40:03.620890] [DEBUG] [LOCAL ] IEX: Loaded 38845 existing records from primary storage. [2025-10-10T22:40:03.632227] [INFO ] [MAIN ] IEX: Loaded 38845 primary data records. [2025-10-10T22:40:03.891356] [DEBUG] [LOCAL ] IFF: Loaded 51808 existing records from primary storage. [2025-10-10T22:40:03.906769] [INFO ] [MAIN ] IFF: Loaded 51808 primary data records. [2025-10-10T22:40:04.478216] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:04.479899] [INFO ] [MAIN ] IFN: Generated 1820 derivative records from 18563 primary records. [2025-10-10T22:40:04.480564] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-10T22:40:04.500322] [DEBUG] [LOCAL ] IFN: Derivative data saved (1820 records). [2025-10-10T22:40:04.500536] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-10T22:40:04.505520] [INFO ] [MAIN ] Derivative Progress: 934/1823 symbols completed. IFN took 1.0s. Estimated remaining: 5m 42s. Rate: 156.1 symbols/min [2025-10-10T22:40:04.506146] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:04.522243] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:04.523815] [INFO ] [MAIN ] IEX: Generated 1820 derivative records from 38845 primary records. [2025-10-10T22:40:04.524067] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-10T22:40:04.553324] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:04.559082] [INFO ] [MAIN ] IFF: Generated 1820 derivative records from 51808 primary records. [2025-10-10T22:40:04.561209] [DEBUG] [LOCAL ] IEX: Derivative data saved (1820 records). [2025-10-10T22:40:04.568151] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-10T22:40:04.561013] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-10T22:40:04.571163] [INFO ] [MAIN ] Derivative Progress: 935/1823 symbols completed. IEX took 1.1s. Estimated remaining: 5m 41s. Rate: 156.2 symbols/min [2025-10-10T22:40:04.571304] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:04.572850] [DEBUG] [LOCAL ] IFS: Loaded 23218 existing records from primary storage. [2025-10-10T22:40:04.580403] [INFO ] [MAIN ] IFS: Loaded 23218 primary data records. [2025-10-10T22:40:04.619958] [DEBUG] [LOCAL ] IFF: Derivative data saved (1820 records). [2025-10-10T22:40:04.625230] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-10T22:40:04.627451] [INFO ] [MAIN ] Derivative Progress: 936/1823 symbols completed. IFF took 1.2s. Estimated remaining: 5m 40s. Rate: 156.4 symbols/min [2025-10-10T22:40:04.634537] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:04.729575] [DEBUG] [LOCAL ] IGA: Loaded 10174 existing records from primary storage. [2025-10-10T22:40:04.758745] [INFO ] [MAIN ] IGA: Loaded 10174 primary data records. [2025-10-10T22:40:05.000403] [DEBUG] [LOCAL ] IGD: Loaded 19633 existing records from primary storage. [2025-10-10T22:40:05.013069] [INFO ] [MAIN ] IGD: Loaded 19633 primary data records. [2025-10-10T22:40:05.568125] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:05.570638] [INFO ] [MAIN ] IFS: Generated 1820 derivative records from 23218 primary records. [2025-10-10T22:40:05.571583] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-10T22:40:05.592813] [DEBUG] [LOCAL ] IFS: Derivative data saved (1820 records). [2025-10-10T22:40:05.595226] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-10T22:40:05.597465] [INFO ] [MAIN ] Derivative Progress: 937/1823 symbols completed. IFS took 1.1s. Estimated remaining: 5m 41s. Rate: 156.1 symbols/min [2025-10-10T22:40:05.599293] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:05.613102] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:05.627616] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:05.627307] [INFO ] [MAIN ] IGA: Generated 1820 derivative records from 10174 primary records. [2025-10-10T22:40:05.628351] [INFO ] [MAIN ] IGD: Generated 1820 derivative records from 19633 primary records. [2025-10-10T22:40:05.628472] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-10T22:40:05.628552] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-10T22:40:05.631964] [DEBUG] [LOCAL ] IGI: Loaded 3893 existing records from primary storage. [2025-10-10T22:40:05.632080] [INFO ] [MAIN ] IGI: Loaded 3893 primary data records. [2025-10-10T22:40:05.690833] [DEBUG] [LOCAL ] IGA: Derivative data saved (1820 records). [2025-10-10T22:40:05.707114] [DEBUG] [LOCAL ] IGD: Derivative data saved (1820 records). [2025-10-10T22:40:05.727556] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-10T22:40:05.741092] [INFO ] [MAIN ] Derivative Progress: 938/1823 symbols completed. IGD took 1.1s. Estimated remaining: 5m 40s. Rate: 156.2 symbols/min [2025-10-10T22:40:05.756872] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:05.756766] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-10T22:40:05.769891] [INFO ] [MAIN ] Derivative Progress: 939/1823 symbols completed. IGA took 1.2s. Estimated remaining: 5m 39s. Rate: 156.4 symbols/min [2025-10-10T22:40:05.770949] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:05.964685] [DEBUG] [LOCAL ] IH: Loaded 2888 existing records from primary storage. [2025-10-10T22:40:05.964947] [INFO ] [MAIN ] IH: Loaded 2888 primary data records. [2025-10-10T22:40:06.097691] [DEBUG] [LOCAL ] IGR: Loaded 30825 existing records from primary storage. [2025-10-10T22:40:06.156020] [INFO ] [MAIN ] IGR: Loaded 30825 primary data records. [2025-10-10T22:40:06.664015] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:06.665004] [INFO ] [MAIN ] IGI: Generated 1820 derivative records from 3893 primary records. [2025-10-10T22:40:06.665800] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-10T22:40:06.685750] [DEBUG] [LOCAL ] IGI: Derivative data saved (1820 records). [2025-10-10T22:40:06.686402] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-10T22:40:06.700890] [INFO ] [MAIN ] Derivative Progress: 940/1823 symbols completed. IGI took 1.1s. Estimated remaining: 5m 39s. Rate: 156.1 symbols/min [2025-10-10T22:40:06.702994] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:06.702179] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:06.704370] [INFO ] [MAIN ] IH: Generated 1820 derivative records from 2888 primary records. [2025-10-10T22:40:06.705120] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-10T22:40:06.725564] [DEBUG] [LOCAL ] IH: Derivative data saved (1820 records). [2025-10-10T22:40:06.726098] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-10T22:40:06.725819] [DEBUG] [LOCAL ] IHD: Loaded 7240 existing records from primary storage. [2025-10-10T22:40:06.727241] [INFO ] [MAIN ] IHD: Loaded 7240 primary data records. [2025-10-10T22:40:06.730298] [INFO ] [MAIN ] Derivative Progress: 941/1823 symbols completed. IH took 1.0s. Estimated remaining: 5m 39s. Rate: 156.3 symbols/min [2025-10-10T22:40:06.742565] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:06.845833] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:06.850247] [INFO ] [MAIN ] IGR: Generated 1820 derivative records from 30825 primary records. [2025-10-10T22:40:06.866493] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-10T22:40:06.932049] [DEBUG] [LOCAL ] IGR: Derivative data saved (1820 records). [2025-10-10T22:40:06.961431] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-10T22:40:06.963798] [INFO ] [MAIN ] Derivative Progress: 942/1823 symbols completed. IGR took 1.2s. Estimated remaining: 5m 38s. Rate: 156.3 symbols/min [2025-10-10T22:40:07.077867] [DEBUG] [LOCAL ] IHG: Loaded 24505 existing records from primary storage. [2025-10-10T22:40:07.078014] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:07.086842] [INFO ] [MAIN ] IHG: Loaded 24505 primary data records. [2025-10-10T22:40:07.418252] [DEBUG] [LOCAL ] IHS: Loaded 38726 existing records from primary storage. [2025-10-10T22:40:07.421302] [INFO ] [MAIN ] IHS: Loaded 38726 primary data records. [2025-10-10T22:40:07.478367] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:07.518893] [INFO ] [MAIN ] IHD: Generated 1820 derivative records from 7240 primary records. [2025-10-10T22:40:07.531251] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-10T22:40:07.593666] [DEBUG] [LOCAL ] IHD: Derivative data saved (1820 records). [2025-10-10T22:40:07.625944] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-10T22:40:07.658996] [INFO ] [MAIN ] Derivative Progress: 943/1823 symbols completed. IHD took 1.0s. Estimated remaining: 5m 38s. Rate: 156.2 symbols/min [2025-10-10T22:40:07.787047] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:07.787724] [INFO ] [MAIN ] IHG: Generated 1820 derivative records from 24505 primary records. [2025-10-10T22:40:07.787787] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-10T22:40:07.805406] [DEBUG] [LOCAL ] IHG: Derivative data saved (1820 records). [2025-10-10T22:40:07.805631] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-10T22:40:07.807831] [INFO ] [MAIN ] Derivative Progress: 944/1823 symbols completed. IHG took 1.1s. Estimated remaining: 5m 37s. Rate: 156.3 symbols/min [2025-10-10T22:40:07.827233] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:07.827822] [INFO ] [MAIN ] IHS: Generated 1820 derivative records from 38726 primary records. [2025-10-10T22:40:07.827883] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-10T22:40:07.842355] [DEBUG] [LOCAL ] IHS: Derivative data saved (1820 records). [2025-10-10T22:40:07.842411] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-10T22:40:07.844437] [INFO ] [MAIN ] Derivative Progress: 945/1823 symbols completed. IHS took 0.8s. Estimated remaining: 5m 37s. Rate: 156.5 symbols/min [2025-10-10T22:40:07.844941] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:07.845084] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:07.845018] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:07.852467] [DEBUG] [LOCAL ] IIF: Loaded 5698 existing records from primary storage. [2025-10-10T22:40:07.852595] [INFO ] [MAIN ] IIF: Loaded 5698 primary data records. [2025-10-10T22:40:07.957062] [DEBUG] [LOCAL ] IIM: Loaded 16054 existing records from primary storage. [2025-10-10T22:40:07.979824] [DEBUG] [LOCAL ] IIIN: Loaded 16292 existing records from primary storage. [2025-10-10T22:40:07.979941] [INFO ] [MAIN ] IIM: Loaded 16054 primary data records. [2025-10-10T22:40:07.980025] [INFO ] [MAIN ] IIIN: Loaded 16292 primary data records. [2025-10-10T22:40:08.840059] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:08.841083] [INFO ] [MAIN ] IIF: Generated 1820 derivative records from 5698 primary records. [2025-10-10T22:40:08.841244] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-10T22:40:08.862966] [DEBUG] [LOCAL ] IIF: Derivative data saved (1820 records). [2025-10-10T22:40:08.864841] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-10T22:40:08.867158] [INFO ] [MAIN ] Derivative Progress: 946/1823 symbols completed. IIF took 1.0s. Estimated remaining: 5m 37s. Rate: 156.2 symbols/min [2025-10-10T22:40:08.867322] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:08.883061] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:08.891460] [INFO ] [MAIN ] IIIN: Generated 1820 derivative records from 16292 primary records. [2025-10-10T22:40:08.896362] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-10T22:40:08.896542] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:08.897978] [INFO ] [MAIN ] IIM: Generated 1820 derivative records from 16054 primary records. [2025-10-10T22:40:08.898101] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-10T22:40:08.928789] [DEBUG] [LOCAL ] IIM: Derivative data saved (1820 records). [2025-10-10T22:40:08.929765] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-10T22:40:08.932588] [INFO ] [MAIN ] Derivative Progress: 947/1823 symbols completed. IIM took 1.1s. Estimated remaining: 5m 36s. Rate: 156.3 symbols/min [2025-10-10T22:40:08.933410] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:08.934342] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1820 records). [2025-10-10T22:40:08.941814] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-10T22:40:08.944344] [INFO ] [MAIN ] Derivative Progress: 948/1823 symbols completed. IIIN took 1.1s. Estimated remaining: 5m 36s. Rate: 156.5 symbols/min [2025-10-10T22:40:08.944698] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:08.957170] [DEBUG] [LOCAL ] IIPR: Loaded 29852 existing records from primary storage. [2025-10-10T22:40:08.957301] [INFO ] [MAIN ] IIPR: Loaded 29852 primary data records. [2025-10-10T22:40:09.290014] [DEBUG] [LOCAL ] IMAX: Loaded 43577 existing records from primary storage. [2025-10-10T22:40:09.303935] [INFO ] [MAIN ] IMAX: Loaded 43577 primary data records. [2025-10-10T22:40:09.306358] [DEBUG] [LOCAL ] INFA: Loaded 49851 existing records from primary storage. [2025-10-10T22:40:09.312007] [INFO ] [MAIN ] INFA: Loaded 49851 primary data records. [2025-10-10T22:40:09.961956] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:09.964081] [INFO ] [MAIN ] IIPR: Generated 1820 derivative records from 29852 primary records. [2025-10-10T22:40:09.964188] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-10T22:40:09.984960] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1820 records). [2025-10-10T22:40:09.985122] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-10T22:40:09.987403] [INFO ] [MAIN ] Derivative Progress: 949/1823 symbols completed. IIPR took 1.1s. Estimated remaining: 5m 36s. Rate: 156.2 symbols/min [2025-10-10T22:40:09.988149] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:10.009509] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:10.017918] [INFO ] [MAIN ] IMAX: Generated 1820 derivative records from 43577 primary records. [2025-10-10T22:40:10.018050] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-10T22:40:10.023744] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:10.035948] [INFO ] [MAIN ] INFA: Generated 1820 derivative records from 49851 primary records. [2025-10-10T22:40:10.037901] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-10T22:40:10.042056] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1820 records). [2025-10-10T22:40:10.050272] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-10T22:40:10.055399] [INFO ] [MAIN ] Derivative Progress: 950/1823 symbols completed. IMAX took 1.1s. Estimated remaining: 5m 35s. Rate: 156.3 symbols/min [2025-10-10T22:40:10.059183] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:10.061053] [DEBUG] [LOCAL ] INFA: Derivative data saved (1820 records). [2025-10-10T22:40:10.061121] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-10T22:40:10.063150] [INFO ] [MAIN ] Derivative Progress: 951/1823 symbols completed. INFA took 1.1s. Estimated remaining: 5m 34s. Rate: 156.5 symbols/min [2025-10-10T22:40:10.063428] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:10.117126] [DEBUG] [LOCAL ] INFY: Loaded 54374 existing records from primary storage. [2025-10-10T22:40:10.117518] [INFO ] [MAIN ] INFY: Loaded 54374 primary data records. [2025-10-10T22:40:10.244282] [DEBUG] [LOCAL ] INGM: Loaded 29140 existing records from primary storage. [2025-10-10T22:40:10.256012] [INFO ] [MAIN ] INGM: Loaded 29140 primary data records. [2025-10-10T22:40:10.446096] [DEBUG] [LOCAL ] ING: Loaded 51465 existing records from primary storage. [2025-10-10T22:40:10.458015] [INFO ] [MAIN ] ING: Loaded 51465 primary data records. [2025-10-10T22:40:11.128348] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:11.129917] [INFO ] [MAIN ] INFY: Generated 1820 derivative records from 54374 primary records. [2025-10-10T22:40:11.130201] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-10T22:40:11.148144] [DEBUG] [LOCAL ] INFY: Derivative data saved (1820 records). [2025-10-10T22:40:11.148720] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-10T22:40:11.150780] [INFO ] [MAIN ] Derivative Progress: 952/1823 symbols completed. INFY took 1.2s. Estimated remaining: 5m 35s. Rate: 156.2 symbols/min [2025-10-10T22:40:11.151028] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:11.170188] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:11.171186] [INFO ] [MAIN ] INGM: Generated 1820 derivative records from 29140 primary records. [2025-10-10T22:40:11.172254] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-10T22:40:11.199866] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:11.201206] [INFO ] [MAIN ] ING: Generated 1820 derivative records from 51465 primary records. [2025-10-10T22:40:11.201587] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-10T22:40:11.205021] [DEBUG] [LOCAL ] INGM: Derivative data saved (1820 records). [2025-10-10T22:40:11.214054] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-10T22:40:11.224547] [INFO ] [MAIN ] Derivative Progress: 953/1823 symbols completed. INGM took 1.2s. Estimated remaining: 5m 34s. Rate: 156.3 symbols/min [2025-10-10T22:40:11.231516] [DEBUG] [LOCAL ] ING: Derivative data saved (1820 records). [2025-10-10T22:40:11.231766] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:11.232124] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-10T22:40:11.234405] [INFO ] [MAIN ] Derivative Progress: 954/1823 symbols completed. ING took 1.2s. Estimated remaining: 5m 33s. Rate: 156.5 symbols/min [2025-10-10T22:40:11.234764] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:11.247819] [DEBUG] [LOCAL ] INGR: Loaded 34205 existing records from primary storage. [2025-10-10T22:40:11.248147] [INFO ] [MAIN ] INGR: Loaded 34205 primary data records. [2025-10-10T22:40:11.602141] [DEBUG] [LOCAL ] INSP: Loaded 38337 existing records from primary storage. [2025-10-10T22:40:11.603332] [DEBUG] [LOCAL ] INN: Loaded 42347 existing records from primary storage. [2025-10-10T22:40:11.602780] [INFO ] [MAIN ] INSP: Loaded 38337 primary data records. [2025-10-10T22:40:11.603495] [INFO ] [MAIN ] INN: Loaded 42347 primary data records. [2025-10-10T22:40:12.248058] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:12.251437] [INFO ] [MAIN ] INGR: Generated 1820 derivative records from 34205 primary records. [2025-10-10T22:40:12.252175] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-10T22:40:12.270223] [DEBUG] [LOCAL ] INGR: Derivative data saved (1820 records). [2025-10-10T22:40:12.270380] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-10T22:40:12.272817] [INFO ] [MAIN ] Derivative Progress: 955/1823 symbols completed. INGR took 1.1s. Estimated remaining: 5m 33s. Rate: 156.2 symbols/min [2025-10-10T22:40:12.273126] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:12.294837] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:12.308092] [INFO ] [MAIN ] INSP: Generated 1820 derivative records from 38337 primary records. [2025-10-10T22:40:12.308450] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-10T22:40:12.308774] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:12.310475] [INFO ] [MAIN ] INN: Generated 1820 derivative records from 42347 primary records. [2025-10-10T22:40:12.310599] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-10T22:40:12.341360] [DEBUG] [LOCAL ] INN: Derivative data saved (1820 records). [2025-10-10T22:40:12.341543] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-10T22:40:12.344182] [INFO ] [MAIN ] Derivative Progress: 956/1823 symbols completed. INN took 1.1s. Estimated remaining: 5m 33s. Rate: 156.3 symbols/min [2025-10-10T22:40:12.344585] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:12.345954] [DEBUG] [LOCAL ] INSP: Derivative data saved (1820 records). [2025-10-10T22:40:12.355880] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-10T22:40:12.357927] [INFO ] [MAIN ] Derivative Progress: 957/1823 symbols completed. INSP took 1.1s. Estimated remaining: 5m 32s. Rate: 156.5 symbols/min [2025-10-10T22:40:12.358389] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:12.374573] [DEBUG] [LOCAL ] INSW: Loaded 40341 existing records from primary storage. [2025-10-10T22:40:12.374820] [INFO ] [MAIN ] INSW: Loaded 40341 primary data records. [2025-10-10T22:40:12.566889] [DEBUG] [LOCAL ] INVX: Loaded 29577 existing records from primary storage. [2025-10-10T22:40:12.587213] [INFO ] [MAIN ] INVX: Loaded 29577 primary data records. [2025-10-10T22:40:12.852454] [DEBUG] [LOCAL ] INVH: Loaded 53939 existing records from primary storage. [2025-10-10T22:40:12.864195] [INFO ] [MAIN ] INVH: Loaded 53939 primary data records. [2025-10-10T22:40:13.253136] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:13.358408] [INFO ] [MAIN ] INSW: Generated 1820 derivative records from 40341 primary records. [2025-10-10T22:40:13.363750] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-10T22:40:13.392182] [DEBUG] [LOCAL ] INSW: Derivative data saved (1820 records). [2025-10-10T22:40:13.392636] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-10T22:40:13.395353] [INFO ] [MAIN ] Derivative Progress: 958/1823 symbols completed. INSW took 1.1s. Estimated remaining: 5m 32s. Rate: 156.2 symbols/min [2025-10-10T22:40:13.411935] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:13.412668] [INFO ] [MAIN ] INVX: Generated 1820 derivative records from 29577 primary records. [2025-10-10T22:40:13.412770] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-10T22:40:13.429845] [DEBUG] [LOCAL ] INVX: Derivative data saved (1820 records). [2025-10-10T22:40:13.430044] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-10T22:40:13.431818] [INFO ] [MAIN ] Derivative Progress: 959/1823 symbols completed. INVX took 1.1s. Estimated remaining: 5m 32s. Rate: 156.4 symbols/min [2025-10-10T22:40:13.448175] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:13.448768] [INFO ] [MAIN ] INVH: Generated 1820 derivative records from 53939 primary records. [2025-10-10T22:40:13.448852] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-10T22:40:13.463910] [DEBUG] [LOCAL ] INVH: Derivative data saved (1820 records). [2025-10-10T22:40:13.463973] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-10T22:40:13.468753] [INFO ] [MAIN ] Derivative Progress: 960/1823 symbols completed. INVH took 1.1s. Estimated remaining: 5m 31s. Rate: 156.5 symbols/min [2025-10-10T22:40:13.469190] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:13.469365] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:13.469316] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:13.556808] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-10-10T22:40:13.557153] [INFO ] [MAIN ] IONQ: Loaded 54568 primary data records. [2025-10-10T22:40:13.655818] [DEBUG] [LOCAL ] IOT: Loaded 54252 existing records from primary storage. [2025-10-10T22:40:13.673894] [DEBUG] [LOCAL ] IP: Loaded 54090 existing records from primary storage. [2025-10-10T22:40:13.679251] [INFO ] [MAIN ] IP: Loaded 54090 primary data records. [2025-10-10T22:40:13.679116] [INFO ] [MAIN ] IOT: Loaded 54252 primary data records. [2025-10-10T22:40:14.579374] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:14.580467] [INFO ] [MAIN ] IONQ: Generated 1820 derivative records from 54568 primary records. [2025-10-10T22:40:14.580765] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-10T22:40:14.602852] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1820 records). [2025-10-10T22:40:14.603040] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-10T22:40:14.629820] [INFO ] [MAIN ] Derivative Progress: 961/1823 symbols completed. IONQ took 1.2s. Estimated remaining: 5m 31s. Rate: 156.2 symbols/min [2025-10-10T22:40:14.629999] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:14.631054] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:14.630567] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:14.632681] [INFO ] [MAIN ] IP: Generated 1820 derivative records from 54090 primary records. [2025-10-10T22:40:14.632087] [INFO ] [MAIN ] IOT: Generated 1820 derivative records from 54252 primary records. [2025-10-10T22:40:14.632954] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-10T22:40:14.633024] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-10T22:40:14.666350] [DEBUG] [LOCAL ] IP: Derivative data saved (1820 records). [2025-10-10T22:40:14.666514] [DEBUG] [LOCAL ] IOT: Derivative data saved (1820 records). [2025-10-10T22:40:14.666766] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-10T22:40:14.666704] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-10T22:40:14.669095] [INFO ] [MAIN ] Derivative Progress: 962/1823 symbols completed. IOT took 1.2s. Estimated remaining: 5m 30s. Rate: 156.3 symbols/min [2025-10-10T22:40:14.671846] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:14.672257] [INFO ] [MAIN ] Derivative Progress: 963/1823 symbols completed. IP took 1.2s. Estimated remaining: 5m 30s. Rate: 156.5 symbols/min [2025-10-10T22:40:14.672561] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:14.719195] [DEBUG] [LOCAL ] IPG: Loaded 54108 existing records from primary storage. [2025-10-10T22:40:14.719448] [INFO ] [MAIN ] IPG: Loaded 54108 primary data records. [2025-10-10T22:40:14.777469] [DEBUG] [LOCAL ] IQI: Loaded 18146 existing records from primary storage. [2025-10-10T22:40:14.777153] [DEBUG] [LOCAL ] IPI: Loaded 21875 existing records from primary storage. [2025-10-10T22:40:14.789614] [INFO ] [MAIN ] IQI: Loaded 18146 primary data records. [2025-10-10T22:40:14.798691] [INFO ] [MAIN ] IPI: Loaded 21875 primary data records. [2025-10-10T22:40:15.653993] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:40:15.655046] [INFO ] [MAIN ] IPG: Generated 1819 derivative records from 54108 primary records. [2025-10-10T22:40:15.656409] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-10T22:40:15.688920] [DEBUG] [LOCAL ] IPG: Derivative data saved (1819 records). [2025-10-10T22:40:15.689171] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-10T22:40:15.692109] [INFO ] [MAIN ] Derivative Progress: 964/1823 symbols completed. IPG took 1.1s. Estimated remaining: 5m 30s. Rate: 156.2 symbols/min [2025-10-10T22:40:15.692949] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:15.690309] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:15.694317] [INFO ] [MAIN ] IQI: Generated 1820 derivative records from 18146 primary records. [2025-10-10T22:40:15.694500] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-10T22:40:15.716732] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:15.720496] [INFO ] [MAIN ] IPI: Generated 1820 derivative records from 21875 primary records. [2025-10-10T22:40:15.721925] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-10T22:40:15.725149] [DEBUG] [LOCAL ] IQI: Derivative data saved (1820 records). [2025-10-10T22:40:15.725549] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-10T22:40:15.728018] [INFO ] [MAIN ] Derivative Progress: 965/1823 symbols completed. IQI took 1.1s. Estimated remaining: 5m 29s. Rate: 156.4 symbols/min [2025-10-10T22:40:15.739145] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:15.744040] [DEBUG] [LOCAL ] IPI: Derivative data saved (1820 records). [2025-10-10T22:40:15.744405] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-10T22:40:15.747270] [INFO ] [MAIN ] Derivative Progress: 966/1823 symbols completed. IPI took 1.1s. Estimated remaining: 5m 29s. Rate: 156.5 symbols/min [2025-10-10T22:40:15.747687] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:15.790437] [DEBUG] [LOCAL ] IQV: Loaded 50832 existing records from primary storage. [2025-10-10T22:40:15.790797] [INFO ] [MAIN ] IQV: Loaded 50832 primary data records. [2025-10-10T22:40:16.131858] [DEBUG] [LOCAL ] IR: Loaded 53520 existing records from primary storage. [2025-10-10T22:40:16.140944] [INFO ] [MAIN ] IR: Loaded 53520 primary data records. [2025-10-10T22:40:16.140851] [DEBUG] [LOCAL ] IRM: Loaded 49959 existing records from primary storage. [2025-10-10T22:40:16.149535] [INFO ] [MAIN ] IRM: Loaded 49959 primary data records. [2025-10-10T22:40:16.808557] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:40:16.811156] [INFO ] [MAIN ] IQV: Generated 1819 derivative records from 50832 primary records. [2025-10-10T22:40:16.812136] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-10T22:40:16.832888] [DEBUG] [LOCAL ] IQV: Derivative data saved (1819 records). [2025-10-10T22:40:16.833274] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-10T22:40:16.835438] [INFO ] [MAIN ] Derivative Progress: 967/1823 symbols completed. IQV took 1.1s. Estimated remaining: 5m 29s. Rate: 156.2 symbols/min [2025-10-10T22:40:16.835586] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:16.862898] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:16.868561] [INFO ] [MAIN ] IRM: Generated 1820 derivative records from 49959 primary records. [2025-10-10T22:40:16.869079] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-10T22:40:16.869013] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:16.870855] [INFO ] [MAIN ] IR: Generated 1820 derivative records from 53520 primary records. [2025-10-10T22:40:16.887555] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-10T22:40:16.915222] [DEBUG] [LOCAL ] IRS: Loaded 22978 existing records from primary storage. [2025-10-10T22:40:16.916084] [DEBUG] [LOCAL ] IRM: Derivative data saved (1820 records). [2025-10-10T22:40:16.915897] [DEBUG] [LOCAL ] IR: Derivative data saved (1820 records). [2025-10-10T22:40:16.916008] [INFO ] [MAIN ] IRS: Loaded 22978 primary data records. [2025-10-10T22:40:16.916311] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-10T22:40:16.919177] [INFO ] [MAIN ] Derivative Progress: 968/1823 symbols completed. IR took 1.2s. Estimated remaining: 5m 28s. Rate: 156.3 symbols/min [2025-10-10T22:40:16.919332] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-10T22:40:16.941446] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:16.963430] [INFO ] [MAIN ] Derivative Progress: 969/1823 symbols completed. IRM took 1.2s. Estimated remaining: 5m 27s. Rate: 156.5 symbols/min [2025-10-10T22:40:16.986104] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:17.221980] [DEBUG] [LOCAL ] ISD: Loaded 16060 existing records from primary storage. [2025-10-10T22:40:17.222138] [INFO ] [MAIN ] ISD: Loaded 16060 primary data records. [2025-10-10T22:40:17.435380] [DEBUG] [LOCAL ] IRT: Loaded 51183 existing records from primary storage. [2025-10-10T22:40:17.541282] [INFO ] [MAIN ] IRT: Loaded 51183 primary data records. [2025-10-10T22:40:17.865755] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:17.866634] [INFO ] [MAIN ] IRS: Generated 1820 derivative records from 22978 primary records. [2025-10-10T22:40:17.866951] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-10T22:40:17.888308] [DEBUG] [LOCAL ] IRS: Derivative data saved (1820 records). [2025-10-10T22:40:17.890195] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-10T22:40:17.892497] [INFO ] [MAIN ] Derivative Progress: 970/1823 symbols completed. IRS took 1.1s. Estimated remaining: 5m 28s. Rate: 156.3 symbols/min [2025-10-10T22:40:17.892996] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:17.907537] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:17.908310] [INFO ] [MAIN ] ISD: Generated 1820 derivative records from 16060 primary records. [2025-10-10T22:40:17.909127] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-10T22:40:17.932587] [DEBUG] [LOCAL ] ISD: Derivative data saved (1820 records). [2025-10-10T22:40:17.932967] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-10T22:40:17.947486] [INFO ] [MAIN ] Derivative Progress: 971/1823 symbols completed. ISD took 1.0s. Estimated remaining: 5m 27s. Rate: 156.4 symbols/min [2025-10-10T22:40:17.950946] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:17.952043] [INFO ] [MAIN ] IRT: Generated 1820 derivative records from 51183 primary records. [2025-10-10T22:40:17.951239] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:17.952409] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-10T22:40:17.980223] [DEBUG] [LOCAL ] IRT: Derivative data saved (1820 records). [2025-10-10T22:40:17.980478] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-10T22:40:17.982632] [INFO ] [MAIN ] Derivative Progress: 972/1823 symbols completed. IRT took 1.0s. Estimated remaining: 5m 26s. Rate: 156.5 symbols/min [2025-10-10T22:40:17.983053] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:17.999906] [DEBUG] [LOCAL ] IT: Loaded 42823 existing records from primary storage. [2025-10-10T22:40:18.007620] [INFO ] [MAIN ] IT: Loaded 42823 primary data records. [2025-10-10T22:40:18.135153] [DEBUG] [LOCAL ] ITGR: Loaded 31647 existing records from primary storage. [2025-10-10T22:40:18.151895] [INFO ] [MAIN ] ITGR: Loaded 31647 primary data records. [2025-10-10T22:40:18.354441] [DEBUG] [LOCAL ] ITT: Loaded 33112 existing records from primary storage. [2025-10-10T22:40:18.391324] [INFO ] [MAIN ] ITT: Loaded 33112 primary data records. [2025-10-10T22:40:19.026163] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:40:19.027215] [INFO ] [MAIN ] IT: Generated 1819 derivative records from 42823 primary records. [2025-10-10T22:40:19.027422] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-10T22:40:19.058757] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:19.059875] [INFO ] [MAIN ] ITGR: Generated 1820 derivative records from 31647 primary records. [2025-10-10T22:40:19.060059] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-10T22:40:19.092710] [DEBUG] [LOCAL ] IT: Derivative data saved (1819 records). [2025-10-10T22:40:19.093144] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1820 records). [2025-10-10T22:40:19.093494] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-10T22:40:19.096239] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:19.095635] [INFO ] [MAIN ] Derivative Progress: 973/1823 symbols completed. IT took 1.2s. Estimated remaining: 5m 26s. Rate: 156.2 symbols/min [2025-10-10T22:40:19.095935] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-10T22:40:19.098443] [INFO ] [MAIN ] Derivative Progress: 974/1823 symbols completed. ITGR took 1.1s. Estimated remaining: 5m 26s. Rate: 156.4 symbols/min [2025-10-10T22:40:19.099187] [INFO ] [MAIN ] ITT: Generated 1820 derivative records from 33112 primary records. [2025-10-10T22:40:19.099374] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-10T22:40:19.114676] [DEBUG] [LOCAL ] ITT: Derivative data saved (1820 records). [2025-10-10T22:40:19.114735] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-10T22:40:19.116791] [INFO ] [MAIN ] Derivative Progress: 975/1823 symbols completed. ITT took 1.1s. Estimated remaining: 5m 25s. Rate: 156.5 symbols/min [2025-10-10T22:40:19.117208] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:19.117270] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:19.117366] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:19.171304] [DEBUG] [LOCAL ] IVR: Loaded 48793 existing records from primary storage. [2025-10-10T22:40:19.171630] [INFO ] [MAIN ] IVR: Loaded 48793 primary data records. [2025-10-10T22:40:19.343894] [DEBUG] [LOCAL ] ITW: Loaded 46468 existing records from primary storage. [2025-10-10T22:40:19.344851] [DEBUG] [LOCAL ] ITUB: Loaded 54088 existing records from primary storage. [2025-10-10T22:40:19.350238] [INFO ] [MAIN ] ITW: Loaded 46468 primary data records. [2025-10-10T22:40:19.350162] [INFO ] [MAIN ] ITUB: Loaded 54088 primary data records. [2025-10-10T22:40:20.140731] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:20.142794] [INFO ] [MAIN ] IVR: Generated 1820 derivative records from 48793 primary records. [2025-10-10T22:40:20.143776] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-10T22:40:20.170994] [DEBUG] [LOCAL ] IVR: Derivative data saved (1820 records). [2025-10-10T22:40:20.176044] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:20.176161] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-10T22:40:20.178228] [INFO ] [MAIN ] Derivative Progress: 976/1823 symbols completed. IVR took 1.1s. Estimated remaining: 5m 25s. Rate: 156.3 symbols/min [2025-10-10T22:40:20.178989] [INFO ] [MAIN ] ITUB: Generated 1820 derivative records from 54088 primary records. [2025-10-10T22:40:20.179193] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-10T22:40:20.187297] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:20.201692] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:20.205531] [INFO ] [MAIN ] ITW: Generated 1820 derivative records from 46468 primary records. [2025-10-10T22:40:20.205944] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-10T22:40:20.224667] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1820 records). [2025-10-10T22:40:20.226663] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-10T22:40:20.229050] [INFO ] [MAIN ] Derivative Progress: 977/1823 symbols completed. ITUB took 1.1s. Estimated remaining: 5m 25s. Rate: 156.4 symbols/min [2025-10-10T22:40:20.230078] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:20.239919] [DEBUG] [LOCAL ] ITW: Derivative data saved (1820 records). [2025-10-10T22:40:20.240080] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-10T22:40:20.242385] [INFO ] [MAIN ] Derivative Progress: 978/1823 symbols completed. ITW took 1.1s. Estimated remaining: 5m 24s. Rate: 156.6 symbols/min [2025-10-10T22:40:20.242720] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:20.253433] [DEBUG] [LOCAL ] IVT: Loaded 31596 existing records from primary storage. [2025-10-10T22:40:20.253744] [INFO ] [MAIN ] IVT: Loaded 31596 primary data records. [2025-10-10T22:40:20.459883] [DEBUG] [LOCAL ] IX: Loaded 22586 existing records from primary storage. [2025-10-10T22:40:20.589082] [INFO ] [MAIN ] IX: Loaded 22586 primary data records. [2025-10-10T22:40:20.695969] [DEBUG] [LOCAL ] IVZ: Loaded 53881 existing records from primary storage. [2025-10-10T22:40:20.715161] [INFO ] [MAIN ] IVZ: Loaded 53881 primary data records. [2025-10-10T22:40:21.244206] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:21.245628] [INFO ] [MAIN ] IVT: Generated 1820 derivative records from 31596 primary records. [2025-10-10T22:40:21.245752] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-10T22:40:21.264008] [DEBUG] [LOCAL ] IVT: Derivative data saved (1820 records). [2025-10-10T22:40:21.265092] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-10T22:40:21.268445] [INFO ] [MAIN ] Derivative Progress: 979/1823 symbols completed. IVT took 1.1s. Estimated remaining: 5m 24s. Rate: 156.3 symbols/min [2025-10-10T22:40:21.269421] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:21.284068] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:21.284795] [INFO ] [MAIN ] IX: Generated 1820 derivative records from 22586 primary records. [2025-10-10T22:40:21.285027] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-10T22:40:21.318974] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:21.319486] [DEBUG] [LOCAL ] IX: Derivative data saved (1820 records). [2025-10-10T22:40:21.320540] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-10T22:40:21.320453] [INFO ] [MAIN ] IVZ: Generated 1820 derivative records from 53881 primary records. [2025-10-10T22:40:21.322615] [INFO ] [MAIN ] Derivative Progress: 980/1823 symbols completed. IX took 1.1s. Estimated remaining: 5m 23s. Rate: 156.4 symbols/min [2025-10-10T22:40:21.322904] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:21.322725] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-10T22:40:21.349227] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1820 records). [2025-10-10T22:40:21.349361] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-10T22:40:21.351524] [INFO ] [MAIN ] Derivative Progress: 981/1823 symbols completed. IVZ took 1.1s. Estimated remaining: 5m 23s. Rate: 156.6 symbols/min [2025-10-10T22:40:21.352446] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:21.364927] [DEBUG] [LOCAL ] J: Loaded 40817 existing records from primary storage. [2025-10-10T22:40:21.365062] [INFO ] [MAIN ] J: Loaded 40817 primary data records. [2025-10-10T22:40:21.569865] [DEBUG] [LOCAL ] JBGS: Loaded 42765 existing records from primary storage. [2025-10-10T22:40:21.691808] [INFO ] [MAIN ] JBGS: Loaded 42765 primary data records. [2025-10-10T22:40:21.824619] [DEBUG] [LOCAL ] JBI: Loaded 43912 existing records from primary storage. [2025-10-10T22:40:21.842960] [INFO ] [MAIN ] JBI: Loaded 43912 primary data records. [2025-10-10T22:40:22.176308] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:22.231071] [INFO ] [MAIN ] J: Generated 1820 derivative records from 40817 primary records. [2025-10-10T22:40:22.238356] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-10T22:40:22.431099] [DEBUG] [LOCAL ] J: Derivative data saved (1820 records). [2025-10-10T22:40:22.431405] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-10T22:40:22.433886] [INFO ] [MAIN ] Derivative Progress: 982/1823 symbols completed. J took 1.2s. Estimated remaining: 5m 23s. Rate: 156.3 symbols/min [2025-10-10T22:40:22.434324] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:22.454532] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:22.455425] [INFO ] [MAIN ] JBGS: Generated 1820 derivative records from 42765 primary records. [2025-10-10T22:40:22.455570] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-10T22:40:22.479748] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1820 records). [2025-10-10T22:40:22.481101] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-10T22:40:22.484046] [INFO ] [MAIN ] Derivative Progress: 983/1823 symbols completed. JBGS took 1.2s. Estimated remaining: 5m 22s. Rate: 156.4 symbols/min [2025-10-10T22:40:22.484957] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:22.509568] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:22.510361] [INFO ] [MAIN ] JBI: Generated 1820 derivative records from 43912 primary records. [2025-10-10T22:40:22.510483] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-10T22:40:22.547782] [DEBUG] [LOCAL ] JBI: Derivative data saved (1820 records). [2025-10-10T22:40:22.549492] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-10T22:40:22.552605] [INFO ] [MAIN ] Derivative Progress: 984/1823 symbols completed. JBI took 1.2s. Estimated remaining: 5m 22s. Rate: 156.6 symbols/min [2025-10-10T22:40:22.552797] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:22.555432] [DEBUG] [LOCAL ] JBL: Loaded 49115 existing records from primary storage. [2025-10-10T22:40:22.562843] [INFO ] [MAIN ] JBL: Loaded 49115 primary data records. [2025-10-10T22:40:22.585500] [DEBUG] [LOCAL ] JBND: Loaded 26996 existing records from primary storage. [2025-10-10T22:40:22.595745] [INFO ] [MAIN ] JBND: Loaded 26996 primary data records. [2025-10-10T22:40:22.799089] [DEBUG] [LOCAL ] JCE: Loaded 7358 existing records from primary storage. [2025-10-10T22:40:22.804536] [INFO ] [MAIN ] JCE: Loaded 7358 primary data records. [2025-10-10T22:40:23.551629] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:23.553295] [INFO ] [MAIN ] JBL: Generated 1820 derivative records from 49115 primary records. [2025-10-10T22:40:23.553416] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-10T22:40:23.552279] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:23.555104] [INFO ] [MAIN ] JBND: Generated 1820 derivative records from 26996 primary records. [2025-10-10T22:40:23.555324] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-10T22:40:23.587898] [DEBUG] [LOCAL ] JBND: Derivative data saved (1820 records). [2025-10-10T22:40:23.588372] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-10T22:40:23.591279] [INFO ] [MAIN ] Derivative Progress: 985/1823 symbols completed. JBND took 1.1s. Estimated remaining: 5m 22s. Rate: 156.3 symbols/min [2025-10-10T22:40:23.591629] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:23.600883] [DEBUG] [LOCAL ] JBL: Derivative data saved (1820 records). [2025-10-10T22:40:23.606431] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:23.607672] [INFO ] [MAIN ] JCE: Generated 1820 derivative records from 7358 primary records. [2025-10-10T22:40:23.607778] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-10T22:40:23.605839] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-10T22:40:23.610707] [INFO ] [MAIN ] Derivative Progress: 986/1823 symbols completed. JBL took 1.2s. Estimated remaining: 5m 21s. Rate: 156.4 symbols/min [2025-10-10T22:40:23.610900] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:23.628455] [DEBUG] [LOCAL ] JCE: Derivative data saved (1820 records). [2025-10-10T22:40:23.628693] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-10T22:40:23.630872] [INFO ] [MAIN ] Derivative Progress: 987/1823 symbols completed. JCE took 1.1s. Estimated remaining: 5m 20s. Rate: 156.6 symbols/min [2025-10-10T22:40:23.631116] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:23.678955] [DEBUG] [LOCAL ] JCI: Loaded 54312 existing records from primary storage. [2025-10-10T22:40:23.679176] [INFO ] [MAIN ] JCI: Loaded 54312 primary data records. [2025-10-10T22:40:23.833964] [DEBUG] [LOCAL ] JEF: Loaded 50909 existing records from primary storage. [2025-10-10T22:40:23.834169] [INFO ] [MAIN ] JEF: Loaded 50909 primary data records. [2025-10-10T22:40:23.888050] [DEBUG] [LOCAL ] JELD: Loaded 46759 existing records from primary storage. [2025-10-10T22:40:23.905350] [INFO ] [MAIN ] JELD: Loaded 46759 primary data records. [2025-10-10T22:40:24.738472] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:24.739895] [INFO ] [MAIN ] JCI: Generated 1820 derivative records from 54312 primary records. [2025-10-10T22:40:24.740368] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-10T22:40:24.773086] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:24.775346] [INFO ] [MAIN ] JEF: Generated 1820 derivative records from 50909 primary records. [2025-10-10T22:40:24.778477] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-10T22:40:24.780147] [DEBUG] [LOCAL ] JCI: Derivative data saved (1820 records). [2025-10-10T22:40:24.780780] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-10T22:40:24.783259] [INFO ] [MAIN ] Derivative Progress: 988/1823 symbols completed. JCI took 1.2s. Estimated remaining: 5m 21s. Rate: 156.3 symbols/min [2025-10-10T22:40:24.807756] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:24.809255] [INFO ] [MAIN ] JELD: Generated 1820 derivative records from 46759 primary records. [2025-10-10T22:40:24.809582] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-10T22:40:24.828251] [DEBUG] [LOCAL ] JEF: Derivative data saved (1820 records). [2025-10-10T22:40:24.829146] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-10T22:40:24.833303] [INFO ] [MAIN ] Derivative Progress: 989/1823 symbols completed. JEF took 1.2s. Estimated remaining: 5m 20s. Rate: 156.4 symbols/min [2025-10-10T22:40:24.830299] [DEBUG] [LOCAL ] JELD: Derivative data saved (1820 records). [2025-10-10T22:40:24.833777] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-10T22:40:24.836031] [INFO ] [MAIN ] Derivative Progress: 990/1823 symbols completed. JELD took 1.2s. Estimated remaining: 5m 19s. Rate: 156.6 symbols/min [2025-10-10T22:40:24.836606] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:24.836442] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:24.836510] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:24.853438] [DEBUG] [LOCAL ] JGH: Loaded 12013 existing records from primary storage. [2025-10-10T22:40:24.854029] [INFO ] [MAIN ] JGH: Loaded 12013 primary data records. [2025-10-10T22:40:24.870976] [DEBUG] [LOCAL ] JEQ: Loaded 8854 existing records from primary storage. [2025-10-10T22:40:24.895996] [INFO ] [MAIN ] JEQ: Loaded 8854 primary data records. [2025-10-10T22:40:25.234156] [DEBUG] [LOCAL ] JFR: Loaded 31454 existing records from primary storage. [2025-10-10T22:40:25.256020] [INFO ] [MAIN ] JFR: Loaded 31454 primary data records. [2025-10-10T22:40:25.946859] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:25.949921] [INFO ] [MAIN ] JGH: Generated 1820 derivative records from 12013 primary records. [2025-10-10T22:40:25.951671] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-10T22:40:25.967200] [DEBUG] [MAIN ] JEQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:25.977120] [INFO ] [MAIN ] JEQ: Generated 1820 derivative records from 8854 primary records. [2025-10-10T22:40:25.980202] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-10-10T22:40:25.993015] [DEBUG] [LOCAL ] JGH: Derivative data saved (1820 records). [2025-10-10T22:40:25.996816] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-10T22:40:25.999147] [INFO ] [MAIN ] Derivative Progress: 991/1823 symbols completed. JGH took 1.2s. Estimated remaining: 5m 20s. Rate: 156.2 symbols/min [2025-10-10T22:40:25.999601] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:26.005228] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1820 records). [2025-10-10T22:40:26.005498] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-10-10T22:40:26.008054] [INFO ] [MAIN ] Derivative Progress: 992/1823 symbols completed. JEQ took 1.2s. Estimated remaining: 5m 19s. Rate: 156.4 symbols/min [2025-10-10T22:40:26.008455] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:26.028159] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:26.029334] [INFO ] [MAIN ] JFR: Generated 1820 derivative records from 31454 primary records. [2025-10-10T22:40:26.029467] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-10T22:40:26.033792] [DEBUG] [LOCAL ] JHI: Loaded 3929 existing records from primary storage. [2025-10-10T22:40:26.034429] [INFO ] [MAIN ] JHI: Loaded 3929 primary data records. [2025-10-10T22:40:26.165334] [DEBUG] [LOCAL ] JFR: Derivative data saved (1820 records). [2025-10-10T22:40:26.169689] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-10T22:40:26.183556] [INFO ] [MAIN ] Derivative Progress: 993/1823 symbols completed. JFR took 1.3s. Estimated remaining: 5m 18s. Rate: 156.5 symbols/min [2025-10-10T22:40:26.199449] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:26.391702] [DEBUG] [LOCAL ] JHG: Loaded 48298 existing records from primary storage. [2025-10-10T22:40:26.393016] [INFO ] [MAIN ] JHG: Loaded 48298 primary data records. [2025-10-10T22:40:26.396000] [DEBUG] [LOCAL ] JHS: Loaded 2954 existing records from primary storage. [2025-10-10T22:40:26.421476] [INFO ] [MAIN ] JHS: Loaded 2954 primary data records. [2025-10-10T22:40:27.109319] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:27.111132] [INFO ] [MAIN ] JHI: Generated 1820 derivative records from 3929 primary records. [2025-10-10T22:40:27.112059] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-10T22:40:27.129481] [DEBUG] [LOCAL ] JHI: Derivative data saved (1820 records). [2025-10-10T22:40:27.129852] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-10T22:40:27.132044] [INFO ] [MAIN ] Derivative Progress: 994/1823 symbols completed. JHI took 1.1s. Estimated remaining: 5m 18s. Rate: 156.2 symbols/min [2025-10-10T22:40:27.132852] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:27.153633] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:27.154897] [INFO ] [MAIN ] JHS: Generated 1820 derivative records from 2954 primary records. [2025-10-10T22:40:27.155041] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-10T22:40:27.187622] [DEBUG] [LOCAL ] JHS: Derivative data saved (1820 records). [2025-10-10T22:40:27.188034] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:27.189228] [INFO ] [MAIN ] JHG: Generated 1820 derivative records from 48298 primary records. [2025-10-10T22:40:27.189328] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-10T22:40:27.189568] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-10T22:40:27.191745] [INFO ] [MAIN ] Derivative Progress: 995/1823 symbols completed. JHS took 1.0s. Estimated remaining: 5m 18s. Rate: 156.4 symbols/min [2025-10-10T22:40:27.207778] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:27.224831] [DEBUG] [LOCAL ] JHG: Derivative data saved (1820 records). [2025-10-10T22:40:27.225063] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-10T22:40:27.243473] [INFO ] [MAIN ] Derivative Progress: 996/1823 symbols completed. JHG took 1.2s. Estimated remaining: 5m 17s. Rate: 156.5 symbols/min [2025-10-10T22:40:27.243995] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:27.250427] [DEBUG] [LOCAL ] JHX: Loaded 53931 existing records from primary storage. [2025-10-10T22:40:27.250863] [INFO ] [MAIN ] JHX: Loaded 53931 primary data records. [2025-10-10T22:40:27.333914] [DEBUG] [LOCAL ] JILL: Loaded 16471 existing records from primary storage. [2025-10-10T22:40:27.372602] [INFO ] [MAIN ] JILL: Loaded 16471 primary data records. [2025-10-10T22:40:27.732614] [DEBUG] [LOCAL ] JKS: Loaded 40520 existing records from primary storage. [2025-10-10T22:40:27.733246] [INFO ] [MAIN ] JKS: Loaded 40520 primary data records. [2025-10-10T22:40:28.328708] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:28.331293] [INFO ] [MAIN ] JHX: Generated 1820 derivative records from 53931 primary records. [2025-10-10T22:40:28.331764] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-10T22:40:28.356331] [DEBUG] [LOCAL ] JHX: Derivative data saved (1820 records). [2025-10-10T22:40:28.356695] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-10T22:40:28.358819] [INFO ] [MAIN ] Derivative Progress: 997/1823 symbols completed. JHX took 1.2s. Estimated remaining: 5m 17s. Rate: 156.2 symbols/min [2025-10-10T22:40:28.359175] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:28.397044] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:28.406346] [INFO ] [MAIN ] JKS: Generated 1820 derivative records from 40520 primary records. [2025-10-10T22:40:28.406440] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-10T22:40:28.407169] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:28.408802] [INFO ] [MAIN ] JILL: Generated 1820 derivative records from 16471 primary records. [2025-10-10T22:40:28.408926] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-10T22:40:28.453860] [DEBUG] [LOCAL ] JKS: Derivative data saved (1820 records). [2025-10-10T22:40:28.454044] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-10T22:40:28.458202] [INFO ] [MAIN ] Derivative Progress: 998/1823 symbols completed. JKS took 1.2s. Estimated remaining: 5m 17s. Rate: 156.3 symbols/min [2025-10-10T22:40:28.458425] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:28.460919] [DEBUG] [LOCAL ] JLL: Loaded 31853 existing records from primary storage. [2025-10-10T22:40:28.456078] [DEBUG] [LOCAL ] JILL: Derivative data saved (1820 records). [2025-10-10T22:40:28.461812] [INFO ] [MAIN ] JLL: Loaded 31853 primary data records. [2025-10-10T22:40:28.461908] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-10T22:40:28.465802] [INFO ] [MAIN ] Derivative Progress: 999/1823 symbols completed. JILL took 1.3s. Estimated remaining: 5m 16s. Rate: 156.5 symbols/min [2025-10-10T22:40:28.466312] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:28.536703] [DEBUG] [LOCAL ] JLS: Loaded 4203 existing records from primary storage. [2025-10-10T22:40:28.555733] [INFO ] [MAIN ] JLS: Loaded 4203 primary data records. [2025-10-10T22:40:29.015415] [DEBUG] [LOCAL ] JMIA: Loaded 51623 existing records from primary storage. [2025-10-10T22:40:29.029632] [INFO ] [MAIN ] JMIA: Loaded 51623 primary data records. [2025-10-10T22:40:29.552320] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:29.555497] [INFO ] [MAIN ] JLL: Generated 1820 derivative records from 31853 primary records. [2025-10-10T22:40:29.555861] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-10T22:40:29.585823] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:29.591504] [INFO ] [MAIN ] JLS: Generated 1820 derivative records from 4203 primary records. [2025-10-10T22:40:29.593550] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-10T22:40:29.595071] [DEBUG] [LOCAL ] JLL: Derivative data saved (1820 records). [2025-10-10T22:40:29.597020] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-10T22:40:29.599458] [INFO ] [MAIN ] Derivative Progress: 1000/1823 symbols completed. JLL took 1.2s. Estimated remaining: 5m 16s. Rate: 156.2 symbols/min [2025-10-10T22:40:29.600366] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:29.618059] [DEBUG] [LOCAL ] JLS: Derivative data saved (1820 records). [2025-10-10T22:40:29.618317] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-10T22:40:29.621680] [INFO ] [MAIN ] Derivative Progress: 1001/1823 symbols completed. JLS took 1.2s. Estimated remaining: 5m 15s. Rate: 156.3 symbols/min [2025-10-10T22:40:29.622388] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:29.640023] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:29.641159] [INFO ] [MAIN ] JMIA: Generated 1820 derivative records from 51623 primary records. [2025-10-10T22:40:29.641431] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-10T22:40:29.663222] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1820 records). [2025-10-10T22:40:29.663960] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-10T22:40:29.666226] [INFO ] [MAIN ] Derivative Progress: 1002/1823 symbols completed. JMIA took 1.2s. Estimated remaining: 5m 15s. Rate: 156.5 symbols/min [2025-10-10T22:40:29.666590] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:29.737444] [DEBUG] [LOCAL ] JOE: Loaded 24247 existing records from primary storage. [2025-10-10T22:40:29.737777] [INFO ] [MAIN ] JOE: Loaded 24247 primary data records. [2025-10-10T22:40:29.738787] [DEBUG] [LOCAL ] JOBY: Loaded 54581 existing records from primary storage. [2025-10-10T22:40:29.760884] [INFO ] [MAIN ] JOBY: Loaded 54581 primary data records. [2025-10-10T22:40:29.807529] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-10-10T22:40:29.857048] [INFO ] [MAIN ] JNJ: Loaded 54533 primary data records. [2025-10-10T22:40:30.745756] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:30.745393] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:30.747195] [INFO ] [MAIN ] JOBY: Generated 1820 derivative records from 54581 primary records. [2025-10-10T22:40:30.747292] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-10T22:40:30.746568] [INFO ] [MAIN ] JOE: Generated 1820 derivative records from 24247 primary records. [2025-10-10T22:40:30.748385] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-10T22:40:30.778724] [DEBUG] [LOCAL ] JOE: Derivative data saved (1820 records). [2025-10-10T22:40:30.779980] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-10T22:40:30.782821] [INFO ] [MAIN ] Derivative Progress: 1003/1823 symbols completed. JOE took 1.1s. Estimated remaining: 5m 15s. Rate: 156.2 symbols/min [2025-10-10T22:40:30.796411] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1820 records). [2025-10-10T22:40:30.796788] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-10T22:40:30.796726] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:30.799528] [INFO ] [MAIN ] Derivative Progress: 1004/1823 symbols completed. JOBY took 1.2s. Estimated remaining: 5m 14s. Rate: 156.3 symbols/min [2025-10-10T22:40:30.797491] [INFO ] [MAIN ] JNJ: Generated 1820 derivative records from 54533 primary records. [2025-10-10T22:40:30.799771] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-10T22:40:30.815328] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1820 records). [2025-10-10T22:40:30.815387] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-10T22:40:30.818661] [INFO ] [MAIN ] Derivative Progress: 1005/1823 symbols completed. JNJ took 1.2s. Estimated remaining: 5m 14s. Rate: 156.5 symbols/min [2025-10-10T22:40:30.819056] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:30.819150] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:30.819525] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:30.828032] [DEBUG] [LOCAL ] JOF: Loaded 6991 existing records from primary storage. [2025-10-10T22:40:30.828260] [INFO ] [MAIN ] JOF: Loaded 6991 primary data records. [2025-10-10T22:40:31.144458] [DEBUG] [LOCAL ] JPC: Loaded 37827 existing records from primary storage. [2025-10-10T22:40:31.144766] [INFO ] [MAIN ] JPC: Loaded 37827 primary data records. [2025-10-10T22:40:31.305678] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-10-10T22:40:31.355609] [INFO ] [MAIN ] JPM: Loaded 54574 primary data records. [2025-10-10T22:40:31.788365] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:31.789932] [INFO ] [MAIN ] JOF: Generated 1820 derivative records from 6991 primary records. [2025-10-10T22:40:31.790551] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-10T22:40:31.806765] [DEBUG] [LOCAL ] JOF: Derivative data saved (1820 records). [2025-10-10T22:40:31.808279] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-10T22:40:31.810271] [INFO ] [MAIN ] Derivative Progress: 1006/1823 symbols completed. JOF took 1.0s. Estimated remaining: 5m 14s. Rate: 156.2 symbols/min [2025-10-10T22:40:31.810444] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:31.828076] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:31.828777] [INFO ] [MAIN ] JPC: Generated 1820 derivative records from 37827 primary records. [2025-10-10T22:40:31.829051] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-10T22:40:31.858120] [DEBUG] [LOCAL ] JPC: Derivative data saved (1820 records). [2025-10-10T22:40:31.858406] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-10T22:40:31.860584] [INFO ] [MAIN ] Derivative Progress: 1007/1823 symbols completed. JPC took 1.0s. Estimated remaining: 5m 13s. Rate: 156.4 symbols/min [2025-10-10T22:40:31.882834] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:31.883268] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:31.884270] [INFO ] [MAIN ] JPM: Generated 1820 derivative records from 54574 primary records. [2025-10-10T22:40:31.884429] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-10T22:40:31.885955] [DEBUG] [LOCAL ] JQC: Loaded 34731 existing records from primary storage. [2025-10-10T22:40:31.886290] [INFO ] [MAIN ] JQC: Loaded 34731 primary data records. [2025-10-10T22:40:32.015500] [DEBUG] [LOCAL ] JRI: Loaded 15506 existing records from primary storage. [2025-10-10T22:40:32.037148] [DEBUG] [LOCAL ] JPM: Derivative data saved (1820 records). [2025-10-10T22:40:32.049575] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-10T22:40:32.031968] [INFO ] [MAIN ] JRI: Loaded 15506 primary data records. [2025-10-10T22:40:32.052512] [INFO ] [MAIN ] Derivative Progress: 1008/1823 symbols completed. JPM took 1.2s. Estimated remaining: 5m 13s. Rate: 156.4 symbols/min [2025-10-10T22:40:32.084695] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:32.373788] [DEBUG] [LOCAL ] JRS: Loaded 11760 existing records from primary storage. [2025-10-10T22:40:32.437757] [INFO ] [MAIN ] JRS: Loaded 11760 primary data records. [2025-10-10T22:40:32.874483] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:32.875426] [INFO ] [MAIN ] JQC: Generated 1820 derivative records from 34731 primary records. [2025-10-10T22:40:32.875639] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-10T22:40:32.894280] [DEBUG] [LOCAL ] JQC: Derivative data saved (1820 records). [2025-10-10T22:40:32.895039] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-10T22:40:32.898105] [INFO ] [MAIN ] Derivative Progress: 1009/1823 symbols completed. JQC took 1.1s. Estimated remaining: 5m 13s. Rate: 156.2 symbols/min [2025-10-10T22:40:32.898914] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:32.915514] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:32.916511] [INFO ] [MAIN ] JRI: Generated 1820 derivative records from 15506 primary records. [2025-10-10T22:40:32.916828] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-10T22:40:32.935568] [DEBUG] [LOCAL ] JRI: Derivative data saved (1820 records). [2025-10-10T22:40:32.936876] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-10T22:40:32.940703] [INFO ] [MAIN ] Derivative Progress: 1010/1823 symbols completed. JRI took 1.1s. Estimated remaining: 5m 12s. Rate: 156.4 symbols/min [2025-10-10T22:40:32.941975] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:32.955995] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:32.956596] [INFO ] [MAIN ] JRS: Generated 1820 derivative records from 11760 primary records. [2025-10-10T22:40:32.956726] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-10T22:40:32.972101] [DEBUG] [LOCAL ] JRS: Derivative data saved (1820 records). [2025-10-10T22:40:32.972408] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-10T22:40:32.974399] [INFO ] [MAIN ] Derivative Progress: 1011/1823 symbols completed. JRS took 0.9s. Estimated remaining: 5m 11s. Rate: 156.5 symbols/min [2025-10-10T22:40:32.984140] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:33.006270] [DEBUG] [LOCAL ] JXN: Loaded 45676 existing records from primary storage. [2025-10-10T22:40:33.006517] [INFO ] [MAIN ] JXN: Loaded 45676 primary data records. [2025-10-10T22:40:33.053995] [DEBUG] [LOCAL ] KAI: Loaded 13601 existing records from primary storage. [2025-10-10T22:40:33.099534] [INFO ] [MAIN ] KAI: Loaded 13601 primary data records. [2025-10-10T22:40:33.258180] [DEBUG] [LOCAL ] K: Loaded 50837 existing records from primary storage. [2025-10-10T22:40:33.300768] [INFO ] [MAIN ] K: Loaded 50837 primary data records. [2025-10-10T22:40:33.950689] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:33.951693] [INFO ] [MAIN ] JXN: Generated 1820 derivative records from 45676 primary records. [2025-10-10T22:40:33.952036] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-10T22:40:33.985449] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:33.984462] [DEBUG] [LOCAL ] JXN: Derivative data saved (1820 records). [2025-10-10T22:40:33.987103] [INFO ] [MAIN ] KAI: Generated 1820 derivative records from 13601 primary records. [2025-10-10T22:40:33.987327] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-10T22:40:33.987262] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-10T22:40:33.989622] [INFO ] [MAIN ] Derivative Progress: 1012/1823 symbols completed. JXN took 1.1s. Estimated remaining: 5m 11s. Rate: 156.3 symbols/min [2025-10-10T22:40:33.991064] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:34.021761] [DEBUG] [LOCAL ] KAI: Derivative data saved (1820 records). [2025-10-10T22:40:34.022291] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:34.022695] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-10T22:40:34.025029] [INFO ] [MAIN ] Derivative Progress: 1013/1823 symbols completed. KAI took 1.0s. Estimated remaining: 5m 11s. Rate: 156.4 symbols/min [2025-10-10T22:40:34.026265] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:34.026061] [INFO ] [MAIN ] K: Generated 1820 derivative records from 50837 primary records. [2025-10-10T22:40:34.027191] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-10T22:40:34.046846] [DEBUG] [LOCAL ] K: Derivative data saved (1820 records). [2025-10-10T22:40:34.047125] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-10T22:40:34.049050] [INFO ] [MAIN ] Derivative Progress: 1014/1823 symbols completed. K took 1.1s. Estimated remaining: 5m 10s. Rate: 156.6 symbols/min [2025-10-10T22:40:34.049521] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:34.104838] [DEBUG] [LOCAL ] KB: Loaded 23980 existing records from primary storage. [2025-10-10T22:40:34.106130] [DEBUG] [LOCAL ] KAR: Loaded 40626 existing records from primary storage. [2025-10-10T22:40:34.105065] [INFO ] [MAIN ] KB: Loaded 23980 primary data records. [2025-10-10T22:40:34.106572] [DEBUG] [LOCAL ] KBDC: Loaded 22135 existing records from primary storage. [2025-10-10T22:40:34.118160] [INFO ] [MAIN ] KBDC: Loaded 22135 primary data records. [2025-10-10T22:40:34.118238] [INFO ] [MAIN ] KAR: Loaded 40626 primary data records. [2025-10-10T22:40:35.125066] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:35.126522] [INFO ] [MAIN ] KB: Generated 1820 derivative records from 23980 primary records. [2025-10-10T22:40:35.126622] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-10T22:40:35.156751] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:35.156884] [DEBUG] [LOCAL ] KB: Derivative data saved (1820 records). [2025-10-10T22:40:35.170077] [INFO ] [MAIN ] KBDC: Generated 1820 derivative records from 22135 primary records. [2025-10-10T22:40:35.170181] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-10T22:40:35.172215] [INFO ] [MAIN ] Derivative Progress: 1015/1823 symbols completed. KB took 1.1s. Estimated remaining: 5m 10s. Rate: 156.3 symbols/min [2025-10-10T22:40:35.172318] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-10T22:40:35.173578] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:35.172773] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:35.174582] [INFO ] [MAIN ] KAR: Generated 1820 derivative records from 40626 primary records. [2025-10-10T22:40:35.183101] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-10T22:40:35.204701] [DEBUG] [LOCAL ] KAR: Derivative data saved (1820 records). [2025-10-10T22:40:35.205355] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-10T22:40:35.207627] [INFO ] [MAIN ] Derivative Progress: 1016/1823 symbols completed. KAR took 1.2s. Estimated remaining: 5m 10s. Rate: 156.4 symbols/min [2025-10-10T22:40:35.208087] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:35.209179] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1820 records). [2025-10-10T22:40:35.209347] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-10T22:40:35.211504] [INFO ] [MAIN ] Derivative Progress: 1017/1823 symbols completed. KBDC took 1.2s. Estimated remaining: 5m 9s. Rate: 156.6 symbols/min [2025-10-10T22:40:35.212020] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:35.279270] [DEBUG] [LOCAL ] KBH: Loaded 49611 existing records from primary storage. [2025-10-10T22:40:35.279586] [INFO ] [MAIN ] KBH: Loaded 49611 primary data records. [2025-10-10T22:40:35.356852] [DEBUG] [LOCAL ] KD: Loaded 53097 existing records from primary storage. [2025-10-10T22:40:35.374463] [DEBUG] [LOCAL ] KBR: Loaded 48571 existing records from primary storage. [2025-10-10T22:40:35.373887] [INFO ] [MAIN ] KD: Loaded 53097 primary data records. [2025-10-10T22:40:35.386817] [INFO ] [MAIN ] KBR: Loaded 48571 primary data records. [2025-10-10T22:40:36.246703] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:36.249577] [INFO ] [MAIN ] KBH: Generated 1820 derivative records from 49611 primary records. [2025-10-10T22:40:36.251325] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-10T22:40:36.274992] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:36.278893] [INFO ] [MAIN ] KD: Generated 1820 derivative records from 53097 primary records. [2025-10-10T22:40:36.279434] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-10T22:40:36.294398] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:36.302976] [INFO ] [MAIN ] KBR: Generated 1820 derivative records from 48571 primary records. [2025-10-10T22:40:36.304363] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-10T22:40:36.320404] [DEBUG] [LOCAL ] KD: Derivative data saved (1820 records). [2025-10-10T22:40:36.324633] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-10T22:40:36.325056] [DEBUG] [LOCAL ] KBH: Derivative data saved (1820 records). [2025-10-10T22:40:36.331082] [INFO ] [MAIN ] Derivative Progress: 1018/1823 symbols completed. KD took 1.1s. Estimated remaining: 5m 9s. Rate: 156.3 symbols/min [2025-10-10T22:40:36.328601] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-10T22:40:36.331808] [DEBUG] [LOCAL ] KBR: Derivative data saved (1820 records). [2025-10-10T22:40:36.333820] [INFO ] [MAIN ] Derivative Progress: 1019/1823 symbols completed. KBH took 1.2s. Estimated remaining: 5m 8s. Rate: 156.4 symbols/min [2025-10-10T22:40:36.334009] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-10T22:40:36.336180] [INFO ] [MAIN ] Derivative Progress: 1020/1823 symbols completed. KBR took 1.1s. Estimated remaining: 5m 8s. Rate: 156.6 symbols/min [2025-10-10T22:40:36.336542] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:36.337074] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:36.336661] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:36.344565] [DEBUG] [LOCAL ] KEN: Loaded 4721 existing records from primary storage. [2025-10-10T22:40:36.344819] [INFO ] [MAIN ] KEN: Loaded 4721 primary data records. [2025-10-10T22:40:36.547182] [DEBUG] [LOCAL ] KEP: Loaded 31817 existing records from primary storage. [2025-10-10T22:40:36.548747] [DEBUG] [LOCAL ] KEX: Loaded 39119 existing records from primary storage. [2025-10-10T22:40:36.564498] [INFO ] [MAIN ] KEP: Loaded 31817 primary data records. [2025-10-10T22:40:36.564689] [INFO ] [MAIN ] KEX: Loaded 39119 primary data records. [2025-10-10T22:40:37.348666] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:37.349962] [INFO ] [MAIN ] KEN: Generated 1820 derivative records from 4721 primary records. [2025-10-10T22:40:37.350342] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-10T22:40:37.366214] [DEBUG] [LOCAL ] KEN: Derivative data saved (1820 records). [2025-10-10T22:40:37.366490] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-10T22:40:37.368997] [INFO ] [MAIN ] Derivative Progress: 1021/1823 symbols completed. KEN took 1.0s. Estimated remaining: 5m 8s. Rate: 156.3 symbols/min [2025-10-10T22:40:37.369607] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:37.386993] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:37.387906] [INFO ] [MAIN ] KEX: Generated 1820 derivative records from 39119 primary records. [2025-10-10T22:40:37.388076] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-10T22:40:37.408289] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:37.410042] [INFO ] [MAIN ] KEP: Generated 1820 derivative records from 31817 primary records. [2025-10-10T22:40:37.415604] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-10T22:40:37.417154] [DEBUG] [LOCAL ] KEX: Derivative data saved (1820 records). [2025-10-10T22:40:37.417730] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-10T22:40:37.427275] [INFO ] [MAIN ] Derivative Progress: 1022/1823 symbols completed. KEX took 1.1s. Estimated remaining: 5m 7s. Rate: 156.4 symbols/min [2025-10-10T22:40:37.427535] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:37.437519] [DEBUG] [LOCAL ] KEP: Derivative data saved (1820 records). [2025-10-10T22:40:37.437835] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-10T22:40:37.452254] [DEBUG] [LOCAL ] KF: Loaded 2400 existing records from primary storage. [2025-10-10T22:40:37.449976] [INFO ] [MAIN ] Derivative Progress: 1023/1823 symbols completed. KEP took 1.1s. Estimated remaining: 5m 7s. Rate: 156.6 symbols/min [2025-10-10T22:40:37.452601] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:37.452495] [INFO ] [MAIN ] KF: Loaded 2400 primary data records. [2025-10-10T22:40:37.569000] [DEBUG] [LOCAL ] KEYS: Loaded 43794 existing records from primary storage. [2025-10-10T22:40:37.574395] [INFO ] [MAIN ] KEYS: Loaded 43794 primary data records. [2025-10-10T22:40:37.691965] [DEBUG] [LOCAL ] KFRC: Loaded 20385 existing records from primary storage. [2025-10-10T22:40:37.736131] [INFO ] [MAIN ] KFRC: Loaded 20385 primary data records. [2025-10-10T22:40:38.446591] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:38.448344] [INFO ] [MAIN ] KF: Generated 1820 derivative records from 2400 primary records. [2025-10-10T22:40:38.448533] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-10T22:40:38.462832] [DEBUG] [LOCAL ] KF: Derivative data saved (1820 records). [2025-10-10T22:40:38.463038] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-10T22:40:38.464914] [INFO ] [MAIN ] Derivative Progress: 1024/1823 symbols completed. KF took 1.0s. Estimated remaining: 5m 7s. Rate: 156.3 symbols/min [2025-10-10T22:40:38.465166] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:38.482316] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:38.487518] [INFO ] [MAIN ] KEYS: Generated 1820 derivative records from 43794 primary records. [2025-10-10T22:40:38.487755] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-10T22:40:38.503930] [DEBUG] [LOCAL ] KFS: Loaded 8671 existing records from primary storage. [2025-10-10T22:40:38.504501] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:38.505204] [INFO ] [MAIN ] KFRC: Generated 1820 derivative records from 20385 primary records. [2025-10-10T22:40:38.504611] [INFO ] [MAIN ] KFS: Loaded 8671 primary data records. [2025-10-10T22:40:38.505338] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-10T22:40:38.583576] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1820 records). [2025-10-10T22:40:38.584541] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-10T22:40:38.597827] [INFO ] [MAIN ] Derivative Progress: 1025/1823 symbols completed. KEYS took 1.2s. Estimated remaining: 5m 6s. Rate: 156.4 symbols/min [2025-10-10T22:40:38.619029] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1820 records). [2025-10-10T22:40:38.618348] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:38.624749] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-10T22:40:38.641104] [INFO ] [MAIN ] Derivative Progress: 1026/1823 symbols completed. KFRC took 1.2s. Estimated remaining: 5m 5s. Rate: 156.6 symbols/min [2025-10-10T22:40:38.645302] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:38.866893] [DEBUG] [LOCAL ] KFY: Loaded 30330 existing records from primary storage. [2025-10-10T22:40:38.867210] [INFO ] [MAIN ] KFY: Loaded 30330 primary data records. [2025-10-10T22:40:39.171109] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:39.214942] [INFO ] [MAIN ] KFS: Generated 1820 derivative records from 8671 primary records. [2025-10-10T22:40:39.216772] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-10T22:40:39.216479] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-10-10T22:40:39.217861] [INFO ] [MAIN ] KGC: Loaded 54479 primary data records. [2025-10-10T22:40:39.317385] [DEBUG] [LOCAL ] KFS: Derivative data saved (1820 records). [2025-10-10T22:40:39.340046] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-10T22:40:39.342350] [INFO ] [MAIN ] Derivative Progress: 1027/1823 symbols completed. KFS took 0.9s. Estimated remaining: 5m 5s. Rate: 156.4 symbols/min [2025-10-10T22:40:39.342762] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:39.578326] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:39.590581] [INFO ] [MAIN ] KFY: Generated 1820 derivative records from 30330 primary records. [2025-10-10T22:40:39.590874] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-10T22:40:39.625889] [DEBUG] [LOCAL ] KFY: Derivative data saved (1820 records). [2025-10-10T22:40:39.626192] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-10T22:40:39.628438] [INFO ] [MAIN ] Derivative Progress: 1028/1823 symbols completed. KFY took 1.0s. Estimated remaining: 5m 5s. Rate: 156.5 symbols/min [2025-10-10T22:40:39.629996] [DEBUG] [LOCAL ] KGS: Loaded 46609 existing records from primary storage. [2025-10-10T22:40:39.629901] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:39.637801] [INFO ] [MAIN ] KGS: Loaded 46609 primary data records. [2025-10-10T22:40:39.648600] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:39.678352] [INFO ] [MAIN ] KGC: Generated 1820 derivative records from 54479 primary records. [2025-10-10T22:40:39.684990] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-10T22:40:39.770183] [DEBUG] [LOCAL ] KGC: Derivative data saved (1820 records). [2025-10-10T22:40:39.776074] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-10T22:40:39.788338] [INFO ] [MAIN ] Derivative Progress: 1029/1823 symbols completed. KGC took 1.1s. Estimated remaining: 5m 4s. Rate: 156.6 symbols/min [2025-10-10T22:40:39.793624] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:40.001188] [DEBUG] [LOCAL ] KIO: Loaded 21860 existing records from primary storage. [2025-10-10T22:40:40.016235] [INFO ] [MAIN ] KIO: Loaded 21860 primary data records. [2025-10-10T22:40:40.060487] [DEBUG] [LOCAL ] KIM: Loaded 53761 existing records from primary storage. [2025-10-10T22:40:40.087406] [INFO ] [MAIN ] KIM: Loaded 53761 primary data records. [2025-10-10T22:40:40.682337] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:40.683542] [INFO ] [MAIN ] KGS: Generated 1820 derivative records from 46609 primary records. [2025-10-10T22:40:40.683943] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-10T22:40:40.702258] [DEBUG] [LOCAL ] KGS: Derivative data saved (1820 records). [2025-10-10T22:40:40.703250] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-10T22:40:40.705500] [INFO ] [MAIN ] Derivative Progress: 1030/1823 symbols completed. KGS took 1.4s. Estimated remaining: 5m 4s. Rate: 156.3 symbols/min [2025-10-10T22:40:40.705721] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:40.741860] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:40.742363] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:40.743305] [INFO ] [MAIN ] KIO: Generated 1820 derivative records from 21860 primary records. [2025-10-10T22:40:40.744105] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-10T22:40:40.744022] [INFO ] [MAIN ] KIM: Generated 1820 derivative records from 53761 primary records. [2025-10-10T22:40:40.744576] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-10T22:40:40.778139] [DEBUG] [LOCAL ] KIO: Derivative data saved (1820 records). [2025-10-10T22:40:40.777744] [DEBUG] [LOCAL ] KIM: Derivative data saved (1820 records). [2025-10-10T22:40:40.778381] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-10T22:40:40.780466] [INFO ] [MAIN ] Derivative Progress: 1031/1823 symbols completed. KIM took 1.2s. Estimated remaining: 5m 4s. Rate: 156.5 symbols/min [2025-10-10T22:40:40.780570] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-10T22:40:40.795750] [INFO ] [MAIN ] Derivative Progress: 1032/1823 symbols completed. KIO took 1.0s. Estimated remaining: 5m 3s. Rate: 156.6 symbols/min [2025-10-10T22:40:40.795591] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:40.796128] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:40.819499] [DEBUG] [LOCAL ] KKR: Loaded 54282 existing records from primary storage. [2025-10-10T22:40:40.823489] [INFO ] [MAIN ] KKR: Loaded 54282 primary data records. [2025-10-10T22:40:40.823887] [DEBUG] [LOCAL ] KKRS: Loaded 5772 existing records from primary storage. [2025-10-10T22:40:40.835475] [INFO ] [MAIN ] KKRS: Loaded 5772 primary data records. [2025-10-10T22:40:41.171369] [DEBUG] [LOCAL ] KLC: Loaded 37317 existing records from primary storage. [2025-10-10T22:40:41.491964] [INFO ] [MAIN ] KLC: Loaded 37317 primary data records. [2025-10-10T22:40:41.967628] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:41.970022] [INFO ] [MAIN ] KKR: Generated 1820 derivative records from 54282 primary records. [2025-10-10T22:40:41.970280] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-10T22:40:42.005232] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:42.016834] [DEBUG] [LOCAL ] KKR: Derivative data saved (1820 records). [2025-10-10T22:40:42.017520] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-10T22:40:42.017207] [INFO ] [MAIN ] KKRS: Generated 1820 derivative records from 5772 primary records. [2025-10-10T22:40:42.023261] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-10T22:40:42.021573] [INFO ] [MAIN ] Derivative Progress: 1033/1823 symbols completed. KKR took 1.3s. Estimated remaining: 5m 3s. Rate: 156.3 symbols/min [2025-10-10T22:40:42.051445] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1820 records). [2025-10-10T22:40:42.052348] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-10T22:40:42.055081] [INFO ] [MAIN ] Derivative Progress: 1034/1823 symbols completed. KKRS took 1.3s. Estimated remaining: 5m 3s. Rate: 156.4 symbols/min [2025-10-10T22:40:42.083164] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:42.085117] [INFO ] [MAIN ] KLC: Generated 1820 derivative records from 37317 primary records. [2025-10-10T22:40:42.085229] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-10T22:40:42.111114] [DEBUG] [LOCAL ] KLC: Derivative data saved (1820 records). [2025-10-10T22:40:42.111292] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-10T22:40:42.113963] [INFO ] [MAIN ] Derivative Progress: 1035/1823 symbols completed. KLC took 1.3s. Estimated remaining: 5m 2s. Rate: 156.5 symbols/min [2025-10-10T22:40:42.114823] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:42.114946] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:42.115948] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:42.127353] [DEBUG] [LOCAL ] KMPB: Loaded 3854 existing records from primary storage. [2025-10-10T22:40:42.127764] [INFO ] [MAIN ] KMPB: Loaded 3854 primary data records. [2025-10-10T22:40:42.557433] [DEBUG] [LOCAL ] KMPR: Loaded 40015 existing records from primary storage. [2025-10-10T22:40:42.558389] [INFO ] [MAIN ] KMPR: Loaded 40015 primary data records. [2025-10-10T22:40:42.559998] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-10-10T22:40:42.572570] [INFO ] [MAIN ] KMI: Loaded 54473 primary data records. [2025-10-10T22:40:43.239524] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:43.242183] [INFO ] [MAIN ] KMPB: Generated 1820 derivative records from 3854 primary records. [2025-10-10T22:40:43.242791] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-10T22:40:43.261932] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1820 records). [2025-10-10T22:40:43.262429] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-10T22:40:43.265729] [INFO ] [MAIN ] Derivative Progress: 1036/1823 symbols completed. KMPB took 1.2s. Estimated remaining: 5m 2s. Rate: 156.2 symbols/min [2025-10-10T22:40:43.266245] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:43.285488] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:43.298831] [INFO ] [MAIN ] KMPR: Generated 1820 derivative records from 40015 primary records. [2025-10-10T22:40:43.299609] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:43.300405] [INFO ] [MAIN ] KMI: Generated 1820 derivative records from 54473 primary records. [2025-10-10T22:40:43.300571] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-10T22:40:43.300678] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-10T22:40:43.331971] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1820 records). [2025-10-10T22:40:43.332979] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-10T22:40:43.337323] [INFO ] [MAIN ] Derivative Progress: 1037/1823 symbols completed. KMPR took 1.2s. Estimated remaining: 5m 2s. Rate: 156.4 symbols/min [2025-10-10T22:40:43.335195] [DEBUG] [LOCAL ] KMI: Derivative data saved (1820 records). [2025-10-10T22:40:43.337574] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-10T22:40:43.340044] [INFO ] [MAIN ] Derivative Progress: 1038/1823 symbols completed. KMI took 1.2s. Estimated remaining: 5m 1s. Rate: 156.5 symbols/min [2025-10-10T22:40:43.337860] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:43.340369] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:43.381197] [DEBUG] [LOCAL ] KMT: Loaded 43511 existing records from primary storage. [2025-10-10T22:40:43.382929] [INFO ] [MAIN ] KMT: Loaded 43511 primary data records. [2025-10-10T22:40:43.472226] [DEBUG] [LOCAL ] KN: Loaded 39166 existing records from primary storage. [2025-10-10T22:40:43.495904] [INFO ] [MAIN ] KN: Loaded 39166 primary data records. [2025-10-10T22:40:43.883936] [DEBUG] [LOCAL ] KMX: Loaded 53995 existing records from primary storage. [2025-10-10T22:40:43.909257] [INFO ] [MAIN ] KMX: Loaded 53995 primary data records. [2025-10-10T22:40:44.349798] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:44.350942] [INFO ] [MAIN ] KMT: Generated 1820 derivative records from 43511 primary records. [2025-10-10T22:40:44.351119] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-10T22:40:44.382226] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:44.383705] [INFO ] [MAIN ] KN: Generated 1820 derivative records from 39166 primary records. [2025-10-10T22:40:44.385226] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-10T22:40:44.385967] [DEBUG] [LOCAL ] KMT: Derivative data saved (1820 records). [2025-10-10T22:40:44.386292] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-10T22:40:44.388439] [INFO ] [MAIN ] Derivative Progress: 1039/1823 symbols completed. KMT took 1.1s. Estimated remaining: 5m 1s. Rate: 156.3 symbols/min [2025-10-10T22:40:44.395734] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:44.405064] [DEBUG] [LOCAL ] KN: Derivative data saved (1820 records). [2025-10-10T22:40:44.405143] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-10T22:40:44.407465] [INFO ] [MAIN ] Derivative Progress: 1040/1823 symbols completed. KN took 1.1s. Estimated remaining: 5m 0s. Rate: 156.4 symbols/min [2025-10-10T22:40:44.407780] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:44.425001] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:44.425900] [INFO ] [MAIN ] KMX: Generated 1820 derivative records from 53995 primary records. [2025-10-10T22:40:44.426010] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-10T22:40:44.457815] [DEBUG] [LOCAL ] KMX: Derivative data saved (1820 records). [2025-10-10T22:40:44.458196] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-10T22:40:44.458072] [DEBUG] [LOCAL ] KNOP: Loaded 10627 existing records from primary storage. [2025-10-10T22:40:44.458286] [INFO ] [MAIN ] KNOP: Loaded 10627 primary data records. [2025-10-10T22:40:44.460333] [INFO ] [MAIN ] Derivative Progress: 1041/1823 symbols completed. KMX took 1.1s. Estimated remaining: 4m 60s. Rate: 156.5 symbols/min [2025-10-10T22:40:44.460567] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:44.562339] [DEBUG] [LOCAL ] KNF: Loaded 36854 existing records from primary storage. [2025-10-10T22:40:44.573097] [INFO ] [MAIN ] KNF: Loaded 36854 primary data records. [2025-10-10T22:40:44.741106] [DEBUG] [LOCAL ] KNSL: Loaded 18641 existing records from primary storage. [2025-10-10T22:40:44.899794] [INFO ] [MAIN ] KNSL: Loaded 18641 primary data records. [2025-10-10T22:40:45.422170] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:45.423029] [INFO ] [MAIN ] KNOP: Generated 1820 derivative records from 10627 primary records. [2025-10-10T22:40:45.423778] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-10T22:40:45.442934] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1820 records). [2025-10-10T22:40:45.443428] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-10T22:40:45.458412] [INFO ] [MAIN ] Derivative Progress: 1042/1823 symbols completed. KNOP took 1.1s. Estimated remaining: 4m 60s. Rate: 156.3 symbols/min [2025-10-10T22:40:45.458837] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:45.459845] [INFO ] [MAIN ] KNF: Generated 1820 derivative records from 36854 primary records. [2025-10-10T22:40:45.460100] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:45.460461] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-10T22:40:45.499597] [DEBUG] [LOCAL ] KNF: Derivative data saved (1820 records). [2025-10-10T22:40:45.500468] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-10T22:40:45.500382] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:45.503073] [INFO ] [MAIN ] Derivative Progress: 1043/1823 symbols completed. KNF took 1.1s. Estimated remaining: 4m 59s. Rate: 156.4 symbols/min [2025-10-10T22:40:45.503469] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:45.504770] [INFO ] [MAIN ] KNSL: Generated 1820 derivative records from 18641 primary records. [2025-10-10T22:40:45.505425] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-10T22:40:45.544551] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1820 records). [2025-10-10T22:40:45.544771] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-10T22:40:45.546817] [INFO ] [MAIN ] Derivative Progress: 1044/1823 symbols completed. KNSL took 1.1s. Estimated remaining: 4m 59s. Rate: 156.6 symbols/min [2025-10-10T22:40:45.547182] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:45.572713] [DEBUG] [LOCAL ] KNTK: Loaded 47300 existing records from primary storage. [2025-10-10T22:40:45.573073] [INFO ] [MAIN ] KNTK: Loaded 47300 primary data records. [2025-10-10T22:40:45.720937] [DEBUG] [LOCAL ] KODK: Loaded 44104 existing records from primary storage. [2025-10-10T22:40:45.722056] [INFO ] [MAIN ] KODK: Loaded 44104 primary data records. [2025-10-10T22:40:45.815432] [DEBUG] [LOCAL ] KNX: Loaded 53376 existing records from primary storage. [2025-10-10T22:40:45.855161] [INFO ] [MAIN ] KNX: Loaded 53376 primary data records. [2025-10-10T22:40:46.609434] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:46.610320] [INFO ] [MAIN ] KNTK: Generated 1820 derivative records from 47300 primary records. [2025-10-10T22:40:46.612507] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-10T22:40:46.632545] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1820 records). [2025-10-10T22:40:46.633996] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-10T22:40:46.637095] [INFO ] [MAIN ] Derivative Progress: 1045/1823 symbols completed. KNTK took 1.2s. Estimated remaining: 4m 59s. Rate: 156.3 symbols/min [2025-10-10T22:40:46.638982] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:46.654630] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:46.655690] [INFO ] [MAIN ] KODK: Generated 1820 derivative records from 44104 primary records. [2025-10-10T22:40:46.655904] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-10T22:40:46.677069] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:46.686231] [INFO ] [MAIN ] KNX: Generated 1820 derivative records from 53376 primary records. [2025-10-10T22:40:46.685296] [DEBUG] [LOCAL ] KODK: Derivative data saved (1820 records). [2025-10-10T22:40:46.686436] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-10T22:40:46.686511] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-10T22:40:46.688739] [INFO ] [MAIN ] Derivative Progress: 1046/1823 symbols completed. KODK took 1.1s. Estimated remaining: 4m 58s. Rate: 156.4 symbols/min [2025-10-10T22:40:46.688925] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:46.723715] [DEBUG] [LOCAL ] KNX: Derivative data saved (1820 records). [2025-10-10T22:40:46.731359] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-10T22:40:46.742181] [DEBUG] [LOCAL ] KOP: Loaded 17721 existing records from primary storage. [2025-10-10T22:40:46.741832] [DEBUG] [LOCAL ] KOF: Loaded 26841 existing records from primary storage. [2025-10-10T22:40:46.742437] [INFO ] [MAIN ] KOF: Loaded 26841 primary data records. [2025-10-10T22:40:46.735267] [INFO ] [MAIN ] Derivative Progress: 1047/1823 symbols completed. KNX took 1.2s. Estimated remaining: 4m 57s. Rate: 156.5 symbols/min [2025-10-10T22:40:46.742372] [INFO ] [MAIN ] KOP: Loaded 17721 primary data records. [2025-10-10T22:40:46.742754] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:46.923590] [DEBUG] [LOCAL ] KORE: Loaded 2158 existing records from primary storage. [2025-10-10T22:40:46.946713] [INFO ] [MAIN ] KORE: Loaded 2158 primary data records. [2025-10-10T22:40:47.679199] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:47.681198] [INFO ] [MAIN ] KOF: Generated 1820 derivative records from 26841 primary records. [2025-10-10T22:40:47.681385] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-10T22:40:47.696004] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:47.697366] [INFO ] [MAIN ] KOP: Generated 1820 derivative records from 17721 primary records. [2025-10-10T22:40:47.697545] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-10T22:40:47.730101] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:47.736736] [INFO ] [MAIN ] KORE: Generated 1820 derivative records from 2158 primary records. [2025-10-10T22:40:47.739550] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-10T22:40:47.739677] [DEBUG] [LOCAL ] KOP: Derivative data saved (1820 records). [2025-10-10T22:40:47.740701] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-10T22:40:47.743621] [INFO ] [MAIN ] Derivative Progress: 1048/1823 symbols completed. KOP took 1.1s. Estimated remaining: 4m 58s. Rate: 156.3 symbols/min [2025-10-10T22:40:47.756288] [DEBUG] [LOCAL ] KOF: Derivative data saved (1820 records). [2025-10-10T22:40:47.756385] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-10T22:40:47.758675] [INFO ] [MAIN ] Derivative Progress: 1049/1823 symbols completed. KOF took 1.1s. Estimated remaining: 4m 57s. Rate: 156.4 symbols/min [2025-10-10T22:40:47.762019] [DEBUG] [LOCAL ] KORE: Derivative data saved (1820 records). [2025-10-10T22:40:47.762079] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-10T22:40:47.764156] [INFO ] [MAIN ] Derivative Progress: 1050/1823 symbols completed. KORE took 1.0s. Estimated remaining: 4m 56s. Rate: 156.6 symbols/min [2025-10-10T22:40:47.764592] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:47.764520] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:47.764811] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:47.857007] [DEBUG] [LOCAL ] KRC: Loaded 49050 existing records from primary storage. [2025-10-10T22:40:47.856317] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-10-10T22:40:47.857186] [INFO ] [MAIN ] KRC: Loaded 49050 primary data records. [2025-10-10T22:40:47.857373] [INFO ] [MAIN ] KR: Loaded 54461 primary data records. [2025-10-10T22:40:47.979900] [DEBUG] [LOCAL ] KOS: Loaded 53851 existing records from primary storage. [2025-10-10T22:40:47.993428] [INFO ] [MAIN ] KOS: Loaded 53851 primary data records. [2025-10-10T22:40:48.840916] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:48.854956] [INFO ] [MAIN ] KRC: Generated 1820 derivative records from 49050 primary records. [2025-10-10T22:40:48.855421] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:48.856585] [INFO ] [MAIN ] KR: Generated 1820 derivative records from 54461 primary records. [2025-10-10T22:40:48.855170] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-10T22:40:48.856765] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-10T22:40:48.896403] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:48.901236] [DEBUG] [LOCAL ] KR: Derivative data saved (1820 records). [2025-10-10T22:40:48.901980] [INFO ] [MAIN ] KOS: Generated 1820 derivative records from 53851 primary records. [2025-10-10T22:40:48.902077] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-10T22:40:48.904958] [INFO ] [MAIN ] Derivative Progress: 1051/1823 symbols completed. KR took 1.1s. Estimated remaining: 4m 56s. Rate: 156.3 symbols/min [2025-10-10T22:40:48.905579] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:48.902993] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-10T22:40:48.909080] [DEBUG] [LOCAL ] KRC: Derivative data saved (1820 records). [2025-10-10T22:40:48.910263] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-10T22:40:48.923174] [INFO ] [MAIN ] Derivative Progress: 1052/1823 symbols completed. KRC took 1.2s. Estimated remaining: 4m 56s. Rate: 156.4 symbols/min [2025-10-10T22:40:48.924248] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:48.928633] [DEBUG] [LOCAL ] KOS: Derivative data saved (1820 records). [2025-10-10T22:40:48.928743] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-10T22:40:48.930875] [INFO ] [MAIN ] Derivative Progress: 1053/1823 symbols completed. KOS took 1.2s. Estimated remaining: 4m 55s. Rate: 156.6 symbols/min [2025-10-10T22:40:48.931047] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:48.974418] [DEBUG] [LOCAL ] KRO: Loaded 26592 existing records from primary storage. [2025-10-10T22:40:48.975366] [INFO ] [MAIN ] KRO: Loaded 26592 primary data records. [2025-10-10T22:40:48.975279] [DEBUG] [LOCAL ] KREF: Loaded 38383 existing records from primary storage. [2025-10-10T22:40:48.975480] [INFO ] [MAIN ] KREF: Loaded 38383 primary data records. [2025-10-10T22:40:49.238437] [DEBUG] [LOCAL ] KRG: Loaded 49891 existing records from primary storage. [2025-10-10T22:40:49.266349] [INFO ] [MAIN ] KRG: Loaded 49891 primary data records. [2025-10-10T22:40:49.926219] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:49.928295] [INFO ] [MAIN ] KREF: Generated 1820 derivative records from 38383 primary records. [2025-10-10T22:40:49.928533] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-10T22:40:49.958475] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:49.958095] [DEBUG] [LOCAL ] KREF: Derivative data saved (1820 records). [2025-10-10T22:40:49.959320] [INFO ] [MAIN ] KRO: Generated 1820 derivative records from 26592 primary records. [2025-10-10T22:40:49.959450] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-10T22:40:49.959509] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-10T22:40:49.961431] [INFO ] [MAIN ] Derivative Progress: 1054/1823 symbols completed. KREF took 1.1s. Estimated remaining: 4m 55s. Rate: 156.3 symbols/min [2025-10-10T22:40:49.962285] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:49.978487] [DEBUG] [LOCAL ] KRO: Derivative data saved (1820 records). [2025-10-10T22:40:49.978830] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-10T22:40:49.981126] [INFO ] [MAIN ] Derivative Progress: 1055/1823 symbols completed. KRO took 1.1s. Estimated remaining: 4m 54s. Rate: 156.5 symbols/min [2025-10-10T22:40:49.981317] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:49.998124] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:49.998886] [INFO ] [MAIN ] KRG: Generated 1820 derivative records from 49891 primary records. [2025-10-10T22:40:49.998988] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-10T22:40:50.023964] [DEBUG] [LOCAL ] KRG: Derivative data saved (1820 records). [2025-10-10T22:40:50.024110] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-10T22:40:50.026213] [INFO ] [MAIN ] Derivative Progress: 1056/1823 symbols completed. KRG took 1.1s. Estimated remaining: 4m 54s. Rate: 156.6 symbols/min [2025-10-10T22:40:50.026423] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:50.040480] [DEBUG] [LOCAL ] KRP: Loaded 37244 existing records from primary storage. [2025-10-10T22:40:50.040702] [INFO ] [MAIN ] KRP: Loaded 37244 primary data records. [2025-10-10T22:40:50.218703] [DEBUG] [LOCAL ] KSS: Loaded 54376 existing records from primary storage. [2025-10-10T22:40:50.232322] [INFO ] [MAIN ] KSS: Loaded 54376 primary data records. [2025-10-10T22:40:50.337045] [DEBUG] [LOCAL ] KT: Loaded 46155 existing records from primary storage. [2025-10-10T22:40:50.466998] [INFO ] [MAIN ] KT: Loaded 46155 primary data records. [2025-10-10T22:40:51.051766] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:51.052919] [INFO ] [MAIN ] KRP: Generated 1820 derivative records from 37244 primary records. [2025-10-10T22:40:51.053194] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-10T22:40:51.073160] [DEBUG] [LOCAL ] KRP: Derivative data saved (1820 records). [2025-10-10T22:40:51.073471] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-10T22:40:51.075853] [INFO ] [MAIN ] Derivative Progress: 1057/1823 symbols completed. KRP took 1.1s. Estimated remaining: 4m 54s. Rate: 156.3 symbols/min [2025-10-10T22:40:51.088403] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:51.089832] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:51.091194] [INFO ] [MAIN ] KSS: Generated 1820 derivative records from 54376 primary records. [2025-10-10T22:40:51.092470] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-10T22:40:51.105301] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:51.106508] [INFO ] [MAIN ] KT: Generated 1820 derivative records from 46155 primary records. [2025-10-10T22:40:51.118743] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-10T22:40:51.130953] [DEBUG] [LOCAL ] KSS: Derivative data saved (1820 records). [2025-10-10T22:40:51.131889] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-10T22:40:51.136784] [INFO ] [MAIN ] Derivative Progress: 1058/1823 symbols completed. KSS took 1.2s. Estimated remaining: 4m 53s. Rate: 156.5 symbols/min [2025-10-10T22:40:51.137221] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:51.142046] [DEBUG] [LOCAL ] KT: Derivative data saved (1820 records). [2025-10-10T22:40:51.142346] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-10T22:40:51.144438] [INFO ] [MAIN ] Derivative Progress: 1059/1823 symbols completed. KT took 1.1s. Estimated remaining: 4m 53s. Rate: 156.6 symbols/min [2025-10-10T22:40:51.144769] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:51.164441] [DEBUG] [LOCAL ] KTF: Loaded 12160 existing records from primary storage. [2025-10-10T22:40:51.164665] [INFO ] [MAIN ] KTF: Loaded 12160 primary data records. [2025-10-10T22:40:51.281467] [DEBUG] [LOCAL ] KTB: Loaded 41117 existing records from primary storage. [2025-10-10T22:40:51.307408] [INFO ] [MAIN ] KTB: Loaded 41117 primary data records. [2025-10-10T22:40:51.606205] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-10-10T22:40:51.644711] [INFO ] [MAIN ] KVUE: Loaded 54447 primary data records. [2025-10-10T22:40:52.121039] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:52.122231] [INFO ] [MAIN ] KTF: Generated 1820 derivative records from 12160 primary records. [2025-10-10T22:40:52.122384] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-10T22:40:52.140053] [DEBUG] [LOCAL ] KTF: Derivative data saved (1820 records). [2025-10-10T22:40:52.141235] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-10T22:40:52.143400] [INFO ] [MAIN ] Derivative Progress: 1060/1823 symbols completed. KTF took 1.0s. Estimated remaining: 4m 53s. Rate: 156.4 symbols/min [2025-10-10T22:40:52.143691] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:52.161424] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:52.162159] [INFO ] [MAIN ] KTB: Generated 1820 derivative records from 41117 primary records. [2025-10-10T22:40:52.162446] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-10T22:40:52.178724] [DEBUG] [LOCAL ] KTB: Derivative data saved (1820 records). [2025-10-10T22:40:52.178970] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-10T22:40:52.181384] [INFO ] [MAIN ] Derivative Progress: 1061/1823 symbols completed. KTB took 1.1s. Estimated remaining: 4m 52s. Rate: 156.5 symbols/min [2025-10-10T22:40:52.181973] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:52.198791] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:52.199516] [INFO ] [MAIN ] KVUE: Generated 1820 derivative records from 54447 primary records. [2025-10-10T22:40:52.199872] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-10T22:40:52.229247] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1820 records). [2025-10-10T22:40:52.229389] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-10T22:40:52.231485] [INFO ] [MAIN ] Derivative Progress: 1062/1823 symbols completed. KVUE took 1.1s. Estimated remaining: 4m 51s. Rate: 156.6 symbols/min [2025-10-10T22:40:52.231676] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:52.248299] [DEBUG] [LOCAL ] KVYO: Loaded 51205 existing records from primary storage. [2025-10-10T22:40:52.256514] [INFO ] [MAIN ] KVYO: Loaded 51205 primary data records. [2025-10-10T22:40:52.352558] [DEBUG] [LOCAL ] KWR: Loaded 16404 existing records from primary storage. [2025-10-10T22:40:52.365789] [INFO ] [MAIN ] KWR: Loaded 16404 primary data records. [2025-10-10T22:40:52.392121] [DEBUG] [LOCAL ] KW: Loaded 40951 existing records from primary storage. [2025-10-10T22:40:52.433028] [INFO ] [MAIN ] KW: Loaded 40951 primary data records. [2025-10-10T22:40:53.236886] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:53.237866] [INFO ] [MAIN ] KVYO: Generated 1820 derivative records from 51205 primary records. [2025-10-10T22:40:53.238182] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-10T22:40:53.258518] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1820 records). [2025-10-10T22:40:53.266486] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-10T22:40:53.274122] [INFO ] [MAIN ] Derivative Progress: 1063/1823 symbols completed. KVYO took 1.1s. Estimated remaining: 4m 52s. Rate: 156.4 symbols/min [2025-10-10T22:40:53.275487] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:53.276821] [INFO ] [MAIN ] KWR: Generated 1820 derivative records from 16404 primary records. [2025-10-10T22:40:53.277030] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-10T22:40:53.297521] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:53.301795] [INFO ] [MAIN ] KW: Generated 1820 derivative records from 40951 primary records. [2025-10-10T22:40:53.304892] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-10T22:40:53.305973] [DEBUG] [LOCAL ] KWR: Derivative data saved (1820 records). [2025-10-10T22:40:53.306545] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-10T22:40:53.309036] [INFO ] [MAIN ] Derivative Progress: 1064/1823 symbols completed. KWR took 1.1s. Estimated remaining: 4m 51s. Rate: 156.5 symbols/min [2025-10-10T22:40:53.323673] [DEBUG] [LOCAL ] KW: Derivative data saved (1820 records). [2025-10-10T22:40:53.323746] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-10T22:40:53.325775] [INFO ] [MAIN ] Derivative Progress: 1065/1823 symbols completed. KW took 1.1s. Estimated remaining: 4m 50s. Rate: 156.7 symbols/min [2025-10-10T22:40:53.326321] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:53.326416] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:53.326518] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:53.367937] [DEBUG] [LOCAL ] KYN: Loaded 30600 existing records from primary storage. [2025-10-10T22:40:53.380499] [INFO ] [MAIN ] KYN: Loaded 30600 primary data records. [2025-10-10T22:40:53.435252] [DEBUG] [LOCAL ] L: Loaded 41622 existing records from primary storage. [2025-10-10T22:40:53.468062] [INFO ] [MAIN ] L: Loaded 41622 primary data records. [2025-10-10T22:40:53.566456] [DEBUG] [LOCAL ] LAC: Loaded 53223 existing records from primary storage. [2025-10-10T22:40:53.641715] [INFO ] [MAIN ] LAC: Loaded 53223 primary data records. [2025-10-10T22:40:54.384941] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:54.385982] [INFO ] [MAIN ] KYN: Generated 1820 derivative records from 30600 primary records. [2025-10-10T22:40:54.386460] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-10T22:40:54.401139] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:54.413059] [INFO ] [MAIN ] L: Generated 1820 derivative records from 41622 primary records. [2025-10-10T22:40:54.413678] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-10T22:40:54.436398] [DEBUG] [LOCAL ] L: Derivative data saved (1820 records). [2025-10-10T22:40:54.436850] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-10T22:40:54.447320] [INFO ] [MAIN ] Derivative Progress: 1066/1823 symbols completed. L took 1.1s. Estimated remaining: 4m 50s. Rate: 156.4 symbols/min [2025-10-10T22:40:54.448282] [DEBUG] [LOCAL ] KYN: Derivative data saved (1820 records). [2025-10-10T22:40:54.448132] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:54.448410] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-10T22:40:54.453669] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:54.456989] [INFO ] [MAIN ] LAC: Generated 1820 derivative records from 53223 primary records. [2025-10-10T22:40:54.455886] [INFO ] [MAIN ] Derivative Progress: 1067/1823 symbols completed. KYN took 1.1s. Estimated remaining: 4m 50s. Rate: 156.5 symbols/min [2025-10-10T22:40:54.457254] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-10T22:40:54.457403] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:54.477065] [DEBUG] [LOCAL ] LAC: Derivative data saved (1820 records). [2025-10-10T22:40:54.477341] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-10T22:40:54.479865] [INFO ] [MAIN ] Derivative Progress: 1068/1823 symbols completed. LAC took 1.2s. Estimated remaining: 4m 49s. Rate: 156.7 symbols/min [2025-10-10T22:40:54.480118] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:54.490696] [DEBUG] [LOCAL ] LANV: Loaded 2845 existing records from primary storage. [2025-10-10T22:40:54.490954] [INFO ] [MAIN ] LANV: Loaded 2845 primary data records. [2025-10-10T22:40:54.624905] [DEBUG] [LOCAL ] LAD: Loaded 23862 existing records from primary storage. [2025-10-10T22:40:54.631139] [DEBUG] [LOCAL ] LADR: Loaded 39783 existing records from primary storage. [2025-10-10T22:40:54.641514] [INFO ] [MAIN ] LAD: Loaded 23862 primary data records. [2025-10-10T22:40:54.646746] [INFO ] [MAIN ] LADR: Loaded 39783 primary data records. [2025-10-10T22:40:55.433431] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-10T22:40:55.434418] [INFO ] [MAIN ] LANV: Generated 1818 derivative records from 2845 primary records. [2025-10-10T22:40:55.435434] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-10T22:40:55.461839] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:55.463387] [INFO ] [MAIN ] LADR: Generated 1820 derivative records from 39783 primary records. [2025-10-10T22:40:55.463658] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-10T22:40:55.464279] [DEBUG] [LOCAL ] LANV: Derivative data saved (1818 records). [2025-10-10T22:40:55.465054] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-10T22:40:55.466959] [INFO ] [MAIN ] Derivative Progress: 1069/1823 symbols completed. LANV took 1.0s. Estimated remaining: 4m 49s. Rate: 156.4 symbols/min [2025-10-10T22:40:55.468235] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:55.485510] [DEBUG] [LOCAL ] LADR: Derivative data saved (1820 records). [2025-10-10T22:40:55.485813] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-10T22:40:55.503686] [INFO ] [MAIN ] Derivative Progress: 1070/1823 symbols completed. LADR took 1.0s. Estimated remaining: 4m 49s. Rate: 156.6 symbols/min [2025-10-10T22:40:55.504215] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:40:55.504350] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:55.505073] [INFO ] [MAIN ] LAD: Generated 1819 derivative records from 23862 primary records. [2025-10-10T22:40:55.505267] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-10T22:40:55.512077] [DEBUG] [LOCAL ] LAW: Loaded 14516 existing records from primary storage. [2025-10-10T22:40:55.522743] [INFO ] [MAIN ] LAW: Loaded 14516 primary data records. [2025-10-10T22:40:55.655141] [DEBUG] [LOCAL ] LAD: Derivative data saved (1819 records). [2025-10-10T22:40:55.717428] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-10T22:40:55.826383] [INFO ] [MAIN ] Derivative Progress: 1071/1823 symbols completed. LAD took 1.4s. Estimated remaining: 4m 48s. Rate: 156.6 symbols/min [2025-10-10T22:40:55.840156] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:55.856548] [DEBUG] [LOCAL ] LAZ: Loaded 45361 existing records from primary storage. [2025-10-10T22:40:55.856727] [INFO ] [MAIN ] LAZ: Loaded 45361 primary data records. [2025-10-10T22:40:56.218682] [DEBUG] [LOCAL ] LB: Loaded 38235 existing records from primary storage. [2025-10-10T22:40:56.219117] [INFO ] [MAIN ] LB: Loaded 38235 primary data records. [2025-10-10T22:40:56.526762] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:56.527776] [INFO ] [MAIN ] LAW: Generated 1820 derivative records from 14516 primary records. [2025-10-10T22:40:56.528022] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-10T22:40:56.548352] [DEBUG] [LOCAL ] LAW: Derivative data saved (1820 records). [2025-10-10T22:40:56.548577] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-10T22:40:56.550910] [INFO ] [MAIN ] Derivative Progress: 1072/1823 symbols completed. LAW took 1.1s. Estimated remaining: 4m 48s. Rate: 156.5 symbols/min [2025-10-10T22:40:56.551215] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:56.565604] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:56.566292] [INFO ] [MAIN ] LAZ: Generated 1820 derivative records from 45361 primary records. [2025-10-10T22:40:56.566570] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-10T22:40:56.587248] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1820 records). [2025-10-10T22:40:56.587378] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-10T22:40:56.589786] [INFO ] [MAIN ] Derivative Progress: 1073/1823 symbols completed. LAZ took 1.1s. Estimated remaining: 4m 47s. Rate: 156.6 symbols/min [2025-10-10T22:40:56.597596] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:56.603180] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:56.603884] [INFO ] [MAIN ] LB: Generated 1820 derivative records from 38235 primary records. [2025-10-10T22:40:56.604191] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-10T22:40:56.630616] [DEBUG] [LOCAL ] LB: Derivative data saved (1820 records). [2025-10-10T22:40:56.630771] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-10T22:40:56.633016] [INFO ] [MAIN ] Derivative Progress: 1074/1823 symbols completed. LB took 0.8s. Estimated remaining: 4m 47s. Rate: 156.7 symbols/min [2025-10-10T22:40:56.633287] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:56.656034] [DEBUG] [LOCAL ] LC: Loaded 48680 existing records from primary storage. [2025-10-10T22:40:56.656269] [INFO ] [MAIN ] LC: Loaded 48680 primary data records. [2025-10-10T22:40:56.741084] [DEBUG] [LOCAL ] LCII: Loaded 27968 existing records from primary storage. [2025-10-10T22:40:56.751706] [INFO ] [MAIN ] LCII: Loaded 27968 primary data records. [2025-10-10T22:40:57.133267] [DEBUG] [LOCAL ] LDI: Loaded 45259 existing records from primary storage. [2025-10-10T22:40:57.266311] [INFO ] [MAIN ] LDI: Loaded 45259 primary data records. [2025-10-10T22:40:57.604182] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:57.616629] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:57.618393] [INFO ] [MAIN ] LCII: Generated 1820 derivative records from 27968 primary records. [2025-10-10T22:40:57.619011] [INFO ] [MAIN ] LC: Generated 1820 derivative records from 48680 primary records. [2025-10-10T22:40:57.619255] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-10T22:40:57.619108] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-10T22:40:57.651807] [DEBUG] [LOCAL ] LCII: Derivative data saved (1820 records). [2025-10-10T22:40:57.650672] [DEBUG] [LOCAL ] LC: Derivative data saved (1820 records). [2025-10-10T22:40:57.651987] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-10T22:40:57.652073] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-10T22:40:57.654562] [INFO ] [MAIN ] Derivative Progress: 1075/1823 symbols completed. LC took 1.1s. Estimated remaining: 4m 47s. Rate: 156.5 symbols/min [2025-10-10T22:40:57.657028] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:57.657093] [INFO ] [MAIN ] Derivative Progress: 1076/1823 symbols completed. LCII took 1.1s. Estimated remaining: 4m 46s. Rate: 156.6 symbols/min [2025-10-10T22:40:57.658771] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:57.674331] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:57.675032] [INFO ] [MAIN ] LDI: Generated 1820 derivative records from 45259 primary records. [2025-10-10T22:40:57.675159] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-10T22:40:57.694671] [DEBUG] [LOCAL ] LDI: Derivative data saved (1820 records). [2025-10-10T22:40:57.699780] [DEBUG] [LOCAL ] LDP: Loaded 13106 existing records from primary storage. [2025-10-10T22:40:57.700115] [INFO ] [MAIN ] LDP: Loaded 13106 primary data records. [2025-10-10T22:40:57.699503] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-10T22:40:57.703704] [INFO ] [MAIN ] Derivative Progress: 1077/1823 symbols completed. LDI took 1.1s. Estimated remaining: 4m 46s. Rate: 156.7 symbols/min [2025-10-10T22:40:57.724850] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:58.026136] [DEBUG] [LOCAL ] LDOS: Loaded 45881 existing records from primary storage. [2025-10-10T22:40:58.034566] [INFO ] [MAIN ] LDOS: Loaded 45881 primary data records. [2025-10-10T22:40:58.153721] [DEBUG] [LOCAL ] LEA: Loaded 42180 existing records from primary storage. [2025-10-10T22:40:58.170014] [INFO ] [MAIN ] LEA: Loaded 42180 primary data records. [2025-10-10T22:40:58.698308] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:58.699348] [INFO ] [MAIN ] LDP: Generated 1820 derivative records from 13106 primary records. [2025-10-10T22:40:58.700010] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-10T22:40:58.718624] [DEBUG] [LOCAL ] LDP: Derivative data saved (1820 records). [2025-10-10T22:40:58.719750] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-10T22:40:58.723383] [INFO ] [MAIN ] Derivative Progress: 1078/1823 symbols completed. LDP took 1.1s. Estimated remaining: 4m 46s. Rate: 156.5 symbols/min [2025-10-10T22:40:58.737498] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:58.738097] [INFO ] [MAIN ] LDOS: Generated 1820 derivative records from 45881 primary records. [2025-10-10T22:40:58.738240] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-10T22:40:58.756862] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1820 records). [2025-10-10T22:40:58.757015] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-10T22:40:58.759303] [INFO ] [MAIN ] Derivative Progress: 1079/1823 symbols completed. LDOS took 1.1s. Estimated remaining: 4m 45s. Rate: 156.6 symbols/min [2025-10-10T22:40:58.771535] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:58.772095] [INFO ] [MAIN ] LEA: Generated 1820 derivative records from 42180 primary records. [2025-10-10T22:40:58.772154] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-10T22:40:58.787183] [DEBUG] [LOCAL ] LEA: Derivative data saved (1820 records). [2025-10-10T22:40:58.787239] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-10T22:40:58.789782] [INFO ] [MAIN ] Derivative Progress: 1080/1823 symbols completed. LEA took 1.1s. Estimated remaining: 4m 44s. Rate: 156.8 symbols/min [2025-10-10T22:40:58.790194] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:58.790142] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:58.790248] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:58.808945] [DEBUG] [LOCAL ] LEO: Loaded 17099 existing records from primary storage. [2025-10-10T22:40:58.809077] [INFO ] [MAIN ] LEO: Loaded 17099 primary data records. [2025-10-10T22:40:59.141616] [DEBUG] [LOCAL ] LEN: Loaded 53950 existing records from primary storage. [2025-10-10T22:40:59.147133] [INFO ] [MAIN ] LEN: Loaded 53950 primary data records. [2025-10-10T22:40:59.214577] [DEBUG] [LOCAL ] LEG: Loaded 50914 existing records from primary storage. [2025-10-10T22:40:59.235985] [INFO ] [MAIN ] LEG: Loaded 50914 primary data records. [2025-10-10T22:40:59.796954] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:59.798299] [INFO ] [MAIN ] LEO: Generated 1820 derivative records from 17099 primary records. [2025-10-10T22:40:59.798788] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-10T22:40:59.831362] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:59.831920] [DEBUG] [LOCAL ] LEO: Derivative data saved (1820 records). [2025-10-10T22:40:59.833068] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-10T22:40:59.832850] [INFO ] [MAIN ] LEN: Generated 1820 derivative records from 53950 primary records. [2025-10-10T22:40:59.836025] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-10T22:40:59.835739] [INFO ] [MAIN ] Derivative Progress: 1081/1823 symbols completed. LEO took 1.0s. Estimated remaining: 4m 44s. Rate: 156.5 symbols/min [2025-10-10T22:40:59.837312] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:59.868082] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:40:59.869494] [DEBUG] [LOCAL ] LEN: Derivative data saved (1820 records). [2025-10-10T22:40:59.870273] [INFO ] [MAIN ] LEG: Generated 1820 derivative records from 50914 primary records. [2025-10-10T22:40:59.870480] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-10T22:40:59.870546] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-10T22:40:59.872538] [INFO ] [MAIN ] Derivative Progress: 1082/1823 symbols completed. LEN took 1.1s. Estimated remaining: 4m 44s. Rate: 156.6 symbols/min [2025-10-10T22:40:59.873474] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:59.890820] [DEBUG] [LOCAL ] LEG: Derivative data saved (1820 records). [2025-10-10T22:40:59.891038] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-10T22:40:59.893140] [INFO ] [MAIN ] Derivative Progress: 1083/1823 symbols completed. LEG took 1.1s. Estimated remaining: 4m 43s. Rate: 156.8 symbols/min [2025-10-10T22:40:59.898329] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:40:59.919999] [DEBUG] [LOCAL ] LFT: Loaded 18593 existing records from primary storage. [2025-10-10T22:40:59.920114] [INFO ] [MAIN ] LFT: Loaded 18593 primary data records. [2025-10-10T22:41:00.026869] [DEBUG] [LOCAL ] LGI: Loaded 10159 existing records from primary storage. [2025-10-10T22:41:00.043127] [INFO ] [MAIN ] LGI: Loaded 10159 primary data records. [2025-10-10T22:41:00.085605] [DEBUG] [LOCAL ] LEVI: Loaded 52452 existing records from primary storage. [2025-10-10T22:41:00.163011] [INFO ] [MAIN ] LEVI: Loaded 52452 primary data records. [2025-10-10T22:41:00.908919] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:00.910630] [INFO ] [MAIN ] LFT: Generated 1820 derivative records from 18593 primary records. [2025-10-10T22:41:00.910923] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-10T22:41:00.932118] [DEBUG] [LOCAL ] LFT: Derivative data saved (1820 records). [2025-10-10T22:41:00.932693] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-10T22:41:00.935048] [INFO ] [MAIN ] Derivative Progress: 1084/1823 symbols completed. LFT took 1.1s. Estimated remaining: 4m 43s. Rate: 156.5 symbols/min [2025-10-10T22:41:00.935491] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:00.953290] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:00.955328] [INFO ] [MAIN ] LGI: Generated 1820 derivative records from 10159 primary records. [2025-10-10T22:41:00.955613] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-10T22:41:00.978873] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:00.984349] [INFO ] [MAIN ] LEVI: Generated 1820 derivative records from 52452 primary records. [2025-10-10T22:41:00.985027] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-10T22:41:00.992428] [DEBUG] [LOCAL ] LGI: Derivative data saved (1820 records). [2025-10-10T22:41:01.000267] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-10T22:41:01.021555] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1820 records). [2025-10-10T22:41:01.008930] [INFO ] [MAIN ] Derivative Progress: 1085/1823 symbols completed. LGI took 1.1s. Estimated remaining: 4m 43s. Rate: 156.7 symbols/min [2025-10-10T22:41:01.021819] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-10T22:41:01.024239] [INFO ] [MAIN ] Derivative Progress: 1086/1823 symbols completed. LEVI took 1.2s. Estimated remaining: 4m 42s. Rate: 156.8 symbols/min [2025-10-10T22:41:01.024558] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:01.021976] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:01.040116] [DEBUG] [LOCAL ] LH: Loaded 38243 existing records from primary storage. [2025-10-10T22:41:01.040252] [INFO ] [MAIN ] LH: Loaded 38243 primary data records. [2025-10-10T22:41:01.224044] [DEBUG] [LOCAL ] LII: Loaded 28417 existing records from primary storage. [2025-10-10T22:41:01.252869] [INFO ] [MAIN ] LII: Loaded 28417 primary data records. [2025-10-10T22:41:01.515382] [DEBUG] [LOCAL ] LHX: Loaded 49289 existing records from primary storage. [2025-10-10T22:41:01.521897] [INFO ] [MAIN ] LHX: Loaded 49289 primary data records. [2025-10-10T22:41:02.166587] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:02.168308] [INFO ] [MAIN ] LH: Generated 1820 derivative records from 38243 primary records. [2025-10-10T22:41:02.168668] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-10T22:41:02.189019] [DEBUG] [LOCAL ] LH: Derivative data saved (1820 records). [2025-10-10T22:41:02.189486] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-10T22:41:02.191793] [INFO ] [MAIN ] Derivative Progress: 1087/1823 symbols completed. LH took 1.3s. Estimated remaining: 4m 42s. Rate: 156.5 symbols/min [2025-10-10T22:41:02.191970] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:02.210281] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:02.211041] [INFO ] [MAIN ] LII: Generated 1820 derivative records from 28417 primary records. [2025-10-10T22:41:02.211494] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-10T22:41:02.246234] [DEBUG] [LOCAL ] LII: Derivative data saved (1820 records). [2025-10-10T22:41:02.246547] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-10T22:41:02.248967] [INFO ] [MAIN ] Derivative Progress: 1088/1823 symbols completed. LII took 1.2s. Estimated remaining: 4m 42s. Rate: 156.6 symbols/min [2025-10-10T22:41:02.262427] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:02.263238] [INFO ] [MAIN ] LHX: Generated 1820 derivative records from 49289 primary records. [2025-10-10T22:41:02.263425] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-10T22:41:02.262127] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:02.281587] [DEBUG] [LOCAL ] LHX: Derivative data saved (1820 records). [2025-10-10T22:41:02.293553] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-10T22:41:02.297522] [DEBUG] [LOCAL ] LITB: Loaded 4305 existing records from primary storage. [2025-10-10T22:41:02.299922] [INFO ] [MAIN ] Derivative Progress: 1089/1823 symbols completed. LHX took 1.3s. Estimated remaining: 4m 41s. Rate: 156.7 symbols/min [2025-10-10T22:41:02.297716] [INFO ] [MAIN ] LITB: Loaded 4305 primary data records. [2025-10-10T22:41:02.300077] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:02.338167] [DEBUG] [LOCAL ] LION: Loaded 46182 existing records from primary storage. [2025-10-10T22:41:02.338283] [INFO ] [MAIN ] LION: Loaded 46182 primary data records. [2025-10-10T22:41:02.930247] [DEBUG] [LOCAL ] LLY: Loaded 54048 existing records from primary storage. [2025-10-10T22:41:02.930999] [INFO ] [MAIN ] LLY: Loaded 54048 primary data records. [2025-10-10T22:41:03.251049] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:03.253633] [INFO ] [MAIN ] LITB: Generated 1820 derivative records from 4305 primary records. [2025-10-10T22:41:03.254197] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-10T22:41:03.284468] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:03.287251] [INFO ] [MAIN ] LION: Generated 1820 derivative records from 46182 primary records. [2025-10-10T22:41:03.287510] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-10T22:41:03.289916] [DEBUG] [LOCAL ] LITB: Derivative data saved (1820 records). [2025-10-10T22:41:03.290306] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-10T22:41:03.292687] [INFO ] [MAIN ] Derivative Progress: 1090/1823 symbols completed. LITB took 1.0s. Estimated remaining: 4m 41s. Rate: 156.5 symbols/min [2025-10-10T22:41:03.299871] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:03.309963] [DEBUG] [LOCAL ] LION: Derivative data saved (1820 records). [2025-10-10T22:41:03.310139] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-10T22:41:03.313135] [INFO ] [MAIN ] Derivative Progress: 1091/1823 symbols completed. LION took 1.1s. Estimated remaining: 4m 40s. Rate: 156.6 symbols/min [2025-10-10T22:41:03.313476] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:03.330830] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:03.331775] [INFO ] [MAIN ] LLY: Generated 1820 derivative records from 54048 primary records. [2025-10-10T22:41:03.331907] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-10T22:41:03.348517] [DEBUG] [LOCAL ] LLY: Derivative data saved (1820 records). [2025-10-10T22:41:03.348613] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-10T22:41:03.350620] [INFO ] [MAIN ] Derivative Progress: 1092/1823 symbols completed. LLY took 1.1s. Estimated remaining: 4m 40s. Rate: 156.8 symbols/min [2025-10-10T22:41:03.350854] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:03.416355] [DEBUG] [LOCAL ] LMND: Loaded 52761 existing records from primary storage. [2025-10-10T22:41:03.416732] [INFO ] [MAIN ] LMND: Loaded 52761 primary data records. [2025-10-10T22:41:03.541492] [DEBUG] [LOCAL ] LMT: Loaded 50457 existing records from primary storage. [2025-10-10T22:41:03.540827] [DEBUG] [LOCAL ] LNC: Loaded 52341 existing records from primary storage. [2025-10-10T22:41:03.549450] [INFO ] [MAIN ] LMT: Loaded 50457 primary data records. [2025-10-10T22:41:03.552939] [INFO ] [MAIN ] LNC: Loaded 52341 primary data records. [2025-10-10T22:41:04.425054] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:04.427990] [INFO ] [MAIN ] LMND: Generated 1820 derivative records from 52761 primary records. [2025-10-10T22:41:04.429243] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-10T22:41:04.468540] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:04.463915] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:04.470791] [INFO ] [MAIN ] LMT: Generated 1820 derivative records from 50457 primary records. [2025-10-10T22:41:04.471510] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-10T22:41:04.472152] [INFO ] [MAIN ] LNC: Generated 1820 derivative records from 52341 primary records. [2025-10-10T22:41:04.474797] [DEBUG] [LOCAL ] LMND: Derivative data saved (1820 records). [2025-10-10T22:41:04.474964] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-10T22:41:04.475332] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-10T22:41:04.493351] [INFO ] [MAIN ] Derivative Progress: 1093/1823 symbols completed. LMND took 1.2s. Estimated remaining: 4m 40s. Rate: 156.5 symbols/min [2025-10-10T22:41:04.509133] [DEBUG] [LOCAL ] LMT: Derivative data saved (1820 records). [2025-10-10T22:41:04.508811] [DEBUG] [LOCAL ] LNC: Derivative data saved (1820 records). [2025-10-10T22:41:04.509251] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-10T22:41:04.511496] [INFO ] [MAIN ] Derivative Progress: 1094/1823 symbols completed. LMT took 1.2s. Estimated remaining: 4m 39s. Rate: 156.6 symbols/min [2025-10-10T22:41:04.511587] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-10T22:41:04.514006] [INFO ] [MAIN ] Derivative Progress: 1095/1823 symbols completed. LNC took 1.2s. Estimated remaining: 4m 39s. Rate: 156.8 symbols/min [2025-10-10T22:41:04.514504] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:04.514616] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:04.515112] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:04.523390] [DEBUG] [LOCAL ] LND: Loaded 5034 existing records from primary storage. [2025-10-10T22:41:04.523579] [INFO ] [MAIN ] LND: Loaded 5034 primary data records. [2025-10-10T22:41:04.619168] [DEBUG] [LOCAL ] LNN: Loaded 11409 existing records from primary storage. [2025-10-10T22:41:04.633109] [INFO ] [MAIN ] LNN: Loaded 11409 primary data records. [2025-10-10T22:41:04.989380] [DEBUG] [LOCAL ] LNG: Loaded 52045 existing records from primary storage. [2025-10-10T22:41:04.995198] [INFO ] [MAIN ] LNG: Loaded 52045 primary data records. [2025-10-10T22:41:05.495083] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:05.496138] [INFO ] [MAIN ] LND: Generated 1820 derivative records from 5034 primary records. [2025-10-10T22:41:05.496334] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-10T22:41:05.513506] [DEBUG] [LOCAL ] LND: Derivative data saved (1820 records). [2025-10-10T22:41:05.514044] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-10T22:41:05.524346] [INFO ] [MAIN ] Derivative Progress: 1096/1823 symbols completed. LND took 1.0s. Estimated remaining: 4m 39s. Rate: 156.5 symbols/min [2025-10-10T22:41:05.529305] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:05.530358] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:05.531615] [INFO ] [MAIN ] LNN: Generated 1820 derivative records from 11409 primary records. [2025-10-10T22:41:05.531782] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-10T22:41:05.548371] [DEBUG] [LOCAL ] LNN: Derivative data saved (1820 records). [2025-10-10T22:41:05.548513] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-10T22:41:05.550670] [INFO ] [MAIN ] Derivative Progress: 1097/1823 symbols completed. LNN took 1.0s. Estimated remaining: 4m 38s. Rate: 156.7 symbols/min [2025-10-10T22:41:05.551047] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:05.567980] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:05.568676] [INFO ] [MAIN ] LNG: Generated 1820 derivative records from 52045 primary records. [2025-10-10T22:41:05.568820] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-10T22:41:05.626028] [DEBUG] [LOCAL ] LOB: Loaded 27539 existing records from primary storage. [2025-10-10T22:41:05.612718] [DEBUG] [LOCAL ] LNG: Derivative data saved (1820 records). [2025-10-10T22:41:05.626388] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-10T22:41:05.627049] [DEBUG] [LOCAL ] LOAR: Loaded 42616 existing records from primary storage. [2025-10-10T22:41:05.629364] [INFO ] [MAIN ] Derivative Progress: 1098/1823 symbols completed. LNG took 1.1s. Estimated remaining: 4m 37s. Rate: 156.8 symbols/min [2025-10-10T22:41:05.629558] [INFO ] [MAIN ] LOB: Loaded 27539 primary data records. [2025-10-10T22:41:05.629695] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:05.629959] [INFO ] [MAIN ] LOAR: Loaded 42616 primary data records. [2025-10-10T22:41:05.818223] [DEBUG] [LOCAL ] LOCL: Loaded 3665 existing records from primary storage. [2025-10-10T22:41:05.861494] [INFO ] [MAIN ] LOCL: Loaded 3665 primary data records. [2025-10-10T22:41:06.622015] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:06.622470] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:06.623493] [INFO ] [MAIN ] LOAR: Generated 1820 derivative records from 42616 primary records. [2025-10-10T22:41:06.623601] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-10T22:41:06.625347] [INFO ] [MAIN ] LOB: Generated 1820 derivative records from 27539 primary records. [2025-10-10T22:41:06.626568] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-10T22:41:06.672002] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:06.673964] [INFO ] [MAIN ] LOCL: Generated 1820 derivative records from 3665 primary records. [2025-10-10T22:41:06.673219] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1820 records). [2025-10-10T22:41:06.674448] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-10T22:41:06.678329] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-10T22:41:06.680536] [INFO ] [MAIN ] Derivative Progress: 1099/1823 symbols completed. LOAR took 1.2s. Estimated remaining: 4m 38s. Rate: 156.5 symbols/min [2025-10-10T22:41:06.681359] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:06.678440] [DEBUG] [LOCAL ] LOB: Derivative data saved (1820 records). [2025-10-10T22:41:06.687994] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-10T22:41:06.690074] [INFO ] [MAIN ] Derivative Progress: 1100/1823 symbols completed. LOB took 1.1s. Estimated remaining: 4m 37s. Rate: 156.7 symbols/min [2025-10-10T22:41:06.696151] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:06.698979] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1820 records). [2025-10-10T22:41:06.699057] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-10T22:41:06.701476] [INFO ] [MAIN ] Derivative Progress: 1101/1823 symbols completed. LOCL took 1.1s. Estimated remaining: 4m 36s. Rate: 156.8 symbols/min [2025-10-10T22:41:06.701769] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:06.729328] [DEBUG] [LOCAL ] LOMA: Loaded 32810 existing records from primary storage. [2025-10-10T22:41:06.729465] [INFO ] [MAIN ] LOMA: Loaded 32810 primary data records. [2025-10-10T22:41:06.920970] [DEBUG] [LOCAL ] LPG: Loaded 40224 existing records from primary storage. [2025-10-10T22:41:06.951448] [INFO ] [MAIN ] LPG: Loaded 40224 primary data records. [2025-10-10T22:41:07.082697] [DEBUG] [LOCAL ] LOW: Loaded 53753 existing records from primary storage. [2025-10-10T22:41:07.108509] [INFO ] [MAIN ] LOW: Loaded 53753 primary data records. [2025-10-10T22:41:07.698527] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:07.700222] [INFO ] [MAIN ] LOMA: Generated 1820 derivative records from 32810 primary records. [2025-10-10T22:41:07.700867] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-10T22:41:07.742821] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:07.742906] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1820 records). [2025-10-10T22:41:07.744010] [INFO ] [MAIN ] LOW: Generated 1820 derivative records from 53753 primary records. [2025-10-10T22:41:07.744272] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-10T22:41:07.745205] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-10T22:41:07.760282] [INFO ] [MAIN ] Derivative Progress: 1102/1823 symbols completed. LOMA took 1.1s. Estimated remaining: 4m 36s. Rate: 156.6 symbols/min [2025-10-10T22:41:07.764755] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:07.768990] [DEBUG] [LOCAL ] LOW: Derivative data saved (1820 records). [2025-10-10T22:41:07.769135] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-10T22:41:07.772874] [INFO ] [MAIN ] Derivative Progress: 1103/1823 symbols completed. LOW took 1.1s. Estimated remaining: 4m 36s. Rate: 156.7 symbols/min [2025-10-10T22:41:07.773116] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:07.794458] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:07.795337] [INFO ] [MAIN ] LPG: Generated 1820 derivative records from 40224 primary records. [2025-10-10T22:41:07.795507] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-10T22:41:07.823857] [DEBUG] [LOCAL ] LPG: Derivative data saved (1820 records). [2025-10-10T22:41:07.832780] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-10T22:41:07.833269] [DEBUG] [LOCAL ] LPL: Loaded 28058 existing records from primary storage. [2025-10-10T22:41:07.835445] [INFO ] [MAIN ] Derivative Progress: 1104/1823 symbols completed. LPG took 1.1s. Estimated remaining: 4m 35s. Rate: 156.8 symbols/min [2025-10-10T22:41:07.835849] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:07.836112] [INFO ] [MAIN ] LPL: Loaded 28058 primary data records. [2025-10-10T22:41:07.978376] [DEBUG] [LOCAL ] LPX: Loaded 40508 existing records from primary storage. [2025-10-10T22:41:07.990687] [INFO ] [MAIN ] LPX: Loaded 40508 primary data records. [2025-10-10T22:41:08.324877] [DEBUG] [LOCAL ] LRN: Loaded 40180 existing records from primary storage. [2025-10-10T22:41:08.331138] [INFO ] [MAIN ] LRN: Loaded 40180 primary data records. [2025-10-10T22:41:08.848896] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:08.850814] [INFO ] [MAIN ] LPL: Generated 1820 derivative records from 28058 primary records. [2025-10-10T22:41:08.851514] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-10T22:41:08.890535] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:08.893292] [INFO ] [MAIN ] LPX: Generated 1820 derivative records from 40508 primary records. [2025-10-10T22:41:08.892445] [DEBUG] [LOCAL ] LPL: Derivative data saved (1820 records). [2025-10-10T22:41:08.893518] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-10T22:41:08.893786] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-10T22:41:08.896596] [INFO ] [MAIN ] Derivative Progress: 1105/1823 symbols completed. LPL took 1.1s. Estimated remaining: 4m 35s. Rate: 156.6 symbols/min [2025-10-10T22:41:08.897598] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:08.917494] [DEBUG] [LOCAL ] LPX: Derivative data saved (1820 records). [2025-10-10T22:41:08.917722] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-10T22:41:08.919979] [INFO ] [MAIN ] Derivative Progress: 1106/1823 symbols completed. LPX took 1.1s. Estimated remaining: 4m 35s. Rate: 156.7 symbols/min [2025-10-10T22:41:08.934294] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:08.933933] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:08.935188] [INFO ] [MAIN ] LRN: Generated 1820 derivative records from 40180 primary records. [2025-10-10T22:41:08.935614] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-10T22:41:08.956312] [DEBUG] [LOCAL ] LRN: Derivative data saved (1820 records). [2025-10-10T22:41:08.966405] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-10T22:41:08.968986] [INFO ] [MAIN ] Derivative Progress: 1107/1823 symbols completed. LRN took 1.1s. Estimated remaining: 4m 34s. Rate: 156.8 symbols/min [2025-10-10T22:41:08.969384] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:09.014578] [DEBUG] [LOCAL ] LSPD: Loaded 43440 existing records from primary storage. [2025-10-10T22:41:09.014996] [INFO ] [MAIN ] LSPD: Loaded 43440 primary data records. [2025-10-10T22:41:09.020915] [DEBUG] [LOCAL ] LTC: Loaded 30684 existing records from primary storage. [2025-10-10T22:41:09.045574] [INFO ] [MAIN ] LTC: Loaded 30684 primary data records. [2025-10-10T22:41:09.545231] [DEBUG] [LOCAL ] LTH: Loaded 52485 existing records from primary storage. [2025-10-10T22:41:09.585456] [INFO ] [MAIN ] LTH: Loaded 52485 primary data records. [2025-10-10T22:41:10.083534] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:10.097069] [INFO ] [MAIN ] LSPD: Generated 1820 derivative records from 43440 primary records. [2025-10-10T22:41:10.097970] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-10T22:41:10.098839] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:10.100048] [INFO ] [MAIN ] LTC: Generated 1820 derivative records from 30684 primary records. [2025-10-10T22:41:10.100324] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-10T22:41:10.133762] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1820 records). [2025-10-10T22:41:10.133990] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-10T22:41:10.130843] [DEBUG] [LOCAL ] LTC: Derivative data saved (1820 records). [2025-10-10T22:41:10.136544] [INFO ] [MAIN ] Derivative Progress: 1108/1823 symbols completed. LSPD took 1.2s. Estimated remaining: 4m 34s. Rate: 156.5 symbols/min [2025-10-10T22:41:10.134422] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-10T22:41:10.140435] [INFO ] [MAIN ] Derivative Progress: 1109/1823 symbols completed. LTC took 1.2s. Estimated remaining: 4m 33s. Rate: 156.7 symbols/min [2025-10-10T22:41:10.152969] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:10.153493] [INFO ] [MAIN ] LTH: Generated 1820 derivative records from 52485 primary records. [2025-10-10T22:41:10.153552] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-10T22:41:10.168832] [DEBUG] [LOCAL ] LTH: Derivative data saved (1820 records). [2025-10-10T22:41:10.168890] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-10T22:41:10.171282] [INFO ] [MAIN ] Derivative Progress: 1110/1823 symbols completed. LTH took 1.2s. Estimated remaining: 4m 33s. Rate: 156.8 symbols/min [2025-10-10T22:41:10.171693] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:10.171820] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:10.172222] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:10.212312] [DEBUG] [LOCAL ] LUCK: Loaded 24680 existing records from primary storage. [2025-10-10T22:41:10.212633] [INFO ] [MAIN ] LUCK: Loaded 24680 primary data records. [2025-10-10T22:41:10.356125] [DEBUG] [LOCAL ] LTM: Loaded 38625 existing records from primary storage. [2025-10-10T22:41:10.361564] [INFO ] [MAIN ] LTM: Loaded 38625 primary data records. [2025-10-10T22:41:10.355054] [DEBUG] [LOCAL ] LU: Loaded 49739 existing records from primary storage. [2025-10-10T22:41:10.377186] [INFO ] [MAIN ] LU: Loaded 49739 primary data records. [2025-10-10T22:41:11.177139] [DEBUG] [MAIN ] LUCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:11.178968] [INFO ] [MAIN ] LUCK: Generated 1820 derivative records from 24680 primary records. [2025-10-10T22:41:11.179224] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-10T22:41:11.198913] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1820 records). [2025-10-10T22:41:11.199041] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-10T22:41:11.200942] [INFO ] [MAIN ] Derivative Progress: 1111/1823 symbols completed. LUCK took 1.0s. Estimated remaining: 4m 33s. Rate: 156.6 symbols/min [2025-10-10T22:41:11.201190] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:11.234772] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:11.236694] [INFO ] [MAIN ] LU: Generated 1820 derivative records from 49739 primary records. [2025-10-10T22:41:11.235728] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:11.237589] [INFO ] [MAIN ] LTM: Generated 1820 derivative records from 38625 primary records. [2025-10-10T22:41:11.237702] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-10T22:41:11.237828] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-10T22:41:11.263791] [DEBUG] [LOCAL ] LU: Derivative data saved (1820 records). [2025-10-10T22:41:11.270627] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-10T22:41:11.273103] [DEBUG] [LOCAL ] LTM: Derivative data saved (1820 records). [2025-10-10T22:41:11.272777] [INFO ] [MAIN ] Derivative Progress: 1112/1823 symbols completed. LU took 1.1s. Estimated remaining: 4m 32s. Rate: 156.7 symbols/min [2025-10-10T22:41:11.273305] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-10T22:41:11.275971] [INFO ] [MAIN ] Derivative Progress: 1113/1823 symbols completed. LTM took 1.1s. Estimated remaining: 4m 32s. Rate: 156.8 symbols/min [2025-10-10T22:41:11.275896] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:11.276194] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:11.323402] [DEBUG] [LOCAL ] LUMN: Loaded 54420 existing records from primary storage. [2025-10-10T22:41:11.323792] [INFO ] [MAIN ] LUMN: Loaded 54420 primary data records. [2025-10-10T22:41:11.524669] [DEBUG] [LOCAL ] LVS: Loaded 54349 existing records from primary storage. [2025-10-10T22:41:11.554145] [INFO ] [MAIN ] LVS: Loaded 54349 primary data records. [2025-10-10T22:41:11.682498] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-10-10T22:41:11.715170] [INFO ] [MAIN ] LUV: Loaded 54469 primary data records. [2025-10-10T22:41:12.340115] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:12.341108] [INFO ] [MAIN ] LUMN: Generated 1820 derivative records from 54420 primary records. [2025-10-10T22:41:12.341279] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-10T22:41:12.358391] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1820 records). [2025-10-10T22:41:12.359366] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-10T22:41:12.362526] [INFO ] [MAIN ] Derivative Progress: 1114/1823 symbols completed. LUMN took 1.2s. Estimated remaining: 4m 32s. Rate: 156.6 symbols/min [2025-10-10T22:41:12.362717] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:12.378288] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:12.380436] [INFO ] [MAIN ] LVS: Generated 1820 derivative records from 54349 primary records. [2025-10-10T22:41:12.380680] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-10T22:41:12.399048] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:12.408212] [INFO ] [MAIN ] LUV: Generated 1820 derivative records from 54469 primary records. [2025-10-10T22:41:12.410949] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-10T22:41:12.419993] [DEBUG] [LOCAL ] LVWR: Loaded 18359 existing records from primary storage. [2025-10-10T22:41:12.428847] [INFO ] [MAIN ] LVWR: Loaded 18359 primary data records. [2025-10-10T22:41:12.465986] [DEBUG] [LOCAL ] LVS: Derivative data saved (1820 records). [2025-10-10T22:41:12.481671] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-10T22:41:12.481781] [DEBUG] [LOCAL ] LUV: Derivative data saved (1820 records). [2025-10-10T22:41:12.483746] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-10T22:41:12.483614] [INFO ] [MAIN ] Derivative Progress: 1115/1823 symbols completed. LVS took 1.2s. Estimated remaining: 4m 31s. Rate: 156.7 symbols/min [2025-10-10T22:41:12.514585] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:12.519891] [INFO ] [MAIN ] Derivative Progress: 1116/1823 symbols completed. LUV took 1.2s. Estimated remaining: 4m 31s. Rate: 156.8 symbols/min [2025-10-10T22:41:12.530499] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:12.758089] [DEBUG] [LOCAL ] LXFR: Loaded 16936 existing records from primary storage. [2025-10-10T22:41:12.758244] [INFO ] [MAIN ] LXFR: Loaded 16936 primary data records. [2025-10-10T22:41:13.091707] [DEBUG] [LOCAL ] LW: Loaded 51986 existing records from primary storage. [2025-10-10T22:41:13.092549] [INFO ] [MAIN ] LW: Loaded 51986 primary data records. [2025-10-10T22:41:13.423412] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:13.424698] [INFO ] [MAIN ] LVWR: Generated 1820 derivative records from 18359 primary records. [2025-10-10T22:41:13.424878] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-10T22:41:13.457600] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:13.459820] [INFO ] [MAIN ] LXFR: Generated 1820 derivative records from 16936 primary records. [2025-10-10T22:41:13.460402] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1820 records). [2025-10-10T22:41:13.460348] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-10T22:41:13.460815] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-10T22:41:13.462941] [INFO ] [MAIN ] Derivative Progress: 1117/1823 symbols completed. LVWR took 1.1s. Estimated remaining: 4m 31s. Rate: 156.6 symbols/min [2025-10-10T22:41:13.463889] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:13.481260] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1820 records). [2025-10-10T22:41:13.481767] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-10T22:41:13.483989] [INFO ] [MAIN ] Derivative Progress: 1118/1823 symbols completed. LXFR took 1.0s. Estimated remaining: 4m 30s. Rate: 156.7 symbols/min [2025-10-10T22:41:13.484200] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:13.503517] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:13.504469] [INFO ] [MAIN ] LW: Generated 1820 derivative records from 51986 primary records. [2025-10-10T22:41:13.504612] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-10T22:41:13.554765] [DEBUG] [LOCAL ] LW: Derivative data saved (1820 records). [2025-10-10T22:41:13.555019] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-10T22:41:13.557448] [INFO ] [MAIN ] Derivative Progress: 1119/1823 symbols completed. LW took 1.0s. Estimated remaining: 4m 29s. Rate: 156.8 symbols/min [2025-10-10T22:41:13.558741] [DEBUG] [LOCAL ] LXU: Loaded 32306 existing records from primary storage. [2025-10-10T22:41:13.557800] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:13.559239] [INFO ] [MAIN ] LXU: Loaded 32306 primary data records. [2025-10-10T22:41:13.673419] [DEBUG] [LOCAL ] LXP: Loaded 51488 existing records from primary storage. [2025-10-10T22:41:13.677014] [INFO ] [MAIN ] LXP: Loaded 51488 primary data records. [2025-10-10T22:41:14.234945] [DEBUG] [LOCAL ] LYB: Loaded 54389 existing records from primary storage. [2025-10-10T22:41:14.235842] [INFO ] [MAIN ] LYB: Loaded 54389 primary data records. [2025-10-10T22:41:14.488001] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:14.565529] [INFO ] [MAIN ] LXU: Generated 1820 derivative records from 32306 primary records. [2025-10-10T22:41:14.566022] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-10T22:41:14.580771] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:14.595316] [INFO ] [MAIN ] LXP: Generated 1820 derivative records from 51488 primary records. [2025-10-10T22:41:14.596753] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-10T22:41:14.614995] [DEBUG] [LOCAL ] LXU: Derivative data saved (1820 records). [2025-10-10T22:41:14.615271] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-10T22:41:14.618081] [INFO ] [MAIN ] Derivative Progress: 1120/1823 symbols completed. LXU took 1.1s. Estimated remaining: 4m 29s. Rate: 156.6 symbols/min [2025-10-10T22:41:14.618842] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:14.626375] [DEBUG] [LOCAL ] LXP: Derivative data saved (1820 records). [2025-10-10T22:41:14.626558] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-10T22:41:14.628978] [INFO ] [MAIN ] Derivative Progress: 1121/1823 symbols completed. LXP took 1.2s. Estimated remaining: 4m 29s. Rate: 156.7 symbols/min [2025-10-10T22:41:14.629221] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:14.650078] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:14.651636] [INFO ] [MAIN ] LYB: Generated 1820 derivative records from 54389 primary records. [2025-10-10T22:41:14.651812] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-10T22:41:14.669085] [DEBUG] [LOCAL ] LYB: Derivative data saved (1820 records). [2025-10-10T22:41:14.669229] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-10T22:41:14.671364] [INFO ] [MAIN ] Derivative Progress: 1122/1823 symbols completed. LYB took 1.1s. Estimated remaining: 4m 28s. Rate: 156.8 symbols/min [2025-10-10T22:41:14.671613] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:14.724938] [DEBUG] [LOCAL ] LYV: Loaded 51877 existing records from primary storage. [2025-10-10T22:41:14.740868] [INFO ] [MAIN ] LYV: Loaded 51877 primary data records. [2025-10-10T22:41:14.789768] [DEBUG] [LOCAL ] LYG: Loaded 53540 existing records from primary storage. [2025-10-10T22:41:14.822454] [INFO ] [MAIN ] LYG: Loaded 53540 primary data records. [2025-10-10T22:41:15.043089] [DEBUG] [LOCAL ] LZB: Loaded 35516 existing records from primary storage. [2025-10-10T22:41:15.209387] [INFO ] [MAIN ] LZB: Loaded 35516 primary data records. [2025-10-10T22:41:15.785341] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:15.787420] [INFO ] [MAIN ] LYV: Generated 1820 derivative records from 51877 primary records. [2025-10-10T22:41:15.787833] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-10T22:41:15.809626] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:15.814260] [INFO ] [MAIN ] LYG: Generated 1820 derivative records from 53540 primary records. [2025-10-10T22:41:15.814665] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-10T22:41:15.829020] [DEBUG] [LOCAL ] LYV: Derivative data saved (1820 records). [2025-10-10T22:41:15.832891] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-10T22:41:15.836533] [INFO ] [MAIN ] Derivative Progress: 1123/1823 symbols completed. LYV took 1.2s. Estimated remaining: 4m 28s. Rate: 156.6 symbols/min [2025-10-10T22:41:15.839811] [DEBUG] [LOCAL ] LYG: Derivative data saved (1820 records). [2025-10-10T22:41:15.840082] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-10T22:41:15.842155] [INFO ] [MAIN ] Derivative Progress: 1124/1823 symbols completed. LYG took 1.2s. Estimated remaining: 4m 28s. Rate: 156.7 symbols/min [2025-10-10T22:41:15.862422] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:15.863532] [INFO ] [MAIN ] LZB: Generated 1820 derivative records from 35516 primary records. [2025-10-10T22:41:15.863671] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-10T22:41:15.883213] [DEBUG] [LOCAL ] LZB: Derivative data saved (1820 records). [2025-10-10T22:41:15.883310] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-10T22:41:15.885473] [INFO ] [MAIN ] Derivative Progress: 1125/1823 symbols completed. LZB took 1.2s. Estimated remaining: 4m 27s. Rate: 156.8 symbols/min [2025-10-10T22:41:15.886195] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:15.886312] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:15.886825] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:15.902910] [DEBUG] [LOCAL ] LZM: Loaded 14676 existing records from primary storage. [2025-10-10T22:41:15.903275] [INFO ] [MAIN ] LZM: Loaded 14676 primary data records. [2025-10-10T22:41:16.311133] [DEBUG] [LOCAL ] M: Loaded 54320 existing records from primary storage. [2025-10-10T22:41:16.311282] [DEBUG] [LOCAL ] MA: Loaded 53267 existing records from primary storage. [2025-10-10T22:41:16.311680] [INFO ] [MAIN ] MA: Loaded 53267 primary data records. [2025-10-10T22:41:16.311759] [INFO ] [MAIN ] M: Loaded 54320 primary data records. [2025-10-10T22:41:16.668250] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:16.794931] [INFO ] [MAIN ] LZM: Generated 1820 derivative records from 14676 primary records. [2025-10-10T22:41:16.831710] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-10T22:41:16.990497] [DEBUG] [LOCAL ] LZM: Derivative data saved (1820 records). [2025-10-10T22:41:16.991105] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-10T22:41:16.993362] [INFO ] [MAIN ] Derivative Progress: 1126/1823 symbols completed. LZM took 1.1s. Estimated remaining: 4m 27s. Rate: 156.5 symbols/min [2025-10-10T22:41:16.994515] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:17.030344] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:17.031293] [INFO ] [MAIN ] M: Generated 1820 derivative records from 54320 primary records. [2025-10-10T22:41:17.043527] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-10T22:41:17.057607] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:17.065862] [INFO ] [MAIN ] MA: Generated 1820 derivative records from 53267 primary records. [2025-10-10T22:41:17.070428] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-10T22:41:17.103337] [DEBUG] [LOCAL ] MAA: Loaded 43220 existing records from primary storage. [2025-10-10T22:41:17.102227] [DEBUG] [LOCAL ] M: Derivative data saved (1820 records). [2025-10-10T22:41:17.103885] [INFO ] [MAIN ] MAA: Loaded 43220 primary data records. [2025-10-10T22:41:17.103819] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-10T22:41:17.119159] [DEBUG] [LOCAL ] MA: Derivative data saved (1820 records). [2025-10-10T22:41:17.118060] [INFO ] [MAIN ] Derivative Progress: 1127/1823 symbols completed. M took 1.2s. Estimated remaining: 4m 27s. Rate: 156.6 symbols/min [2025-10-10T22:41:17.119282] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-10T22:41:17.152299] [INFO ] [MAIN ] Derivative Progress: 1128/1823 symbols completed. MA took 1.3s. Estimated remaining: 4m 26s. Rate: 156.8 symbols/min [2025-10-10T22:41:17.147118] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:17.166053] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:17.437306] [DEBUG] [LOCAL ] MAGN: Loaded 36255 existing records from primary storage. [2025-10-10T22:41:17.449354] [INFO ] [MAIN ] MAGN: Loaded 36255 primary data records. [2025-10-10T22:41:17.461043] [DEBUG] [LOCAL ] MAIN: Loaded 42110 existing records from primary storage. [2025-10-10T22:41:17.485778] [INFO ] [MAIN ] MAIN: Loaded 42110 primary data records. [2025-10-10T22:41:18.101292] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:18.102101] [INFO ] [MAIN ] MAA: Generated 1820 derivative records from 43220 primary records. [2025-10-10T22:41:18.102546] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-10T22:41:18.124564] [DEBUG] [LOCAL ] MAA: Derivative data saved (1820 records). [2025-10-10T22:41:18.124961] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-10T22:41:18.127301] [INFO ] [MAIN ] Derivative Progress: 1129/1823 symbols completed. MAA took 1.1s. Estimated remaining: 4m 26s. Rate: 156.6 symbols/min [2025-10-10T22:41:18.127838] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:18.146191] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:18.148928] [INFO ] [MAIN ] MAGN: Generated 1820 derivative records from 36255 primary records. [2025-10-10T22:41:18.149836] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-10T22:41:18.177244] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:18.178548] [INFO ] [MAIN ] MAIN: Generated 1820 derivative records from 42110 primary records. [2025-10-10T22:41:18.178637] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-10T22:41:18.187231] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1820 records). [2025-10-10T22:41:18.187326] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-10T22:41:18.189215] [INFO ] [MAIN ] Derivative Progress: 1130/1823 symbols completed. MAGN took 1.0s. Estimated remaining: 4m 25s. Rate: 156.7 symbols/min [2025-10-10T22:41:18.189473] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:18.197617] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1820 records). [2025-10-10T22:41:18.207825] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-10T22:41:18.210164] [INFO ] [MAIN ] Derivative Progress: 1131/1823 symbols completed. MAIN took 1.0s. Estimated remaining: 4m 25s. Rate: 156.8 symbols/min [2025-10-10T22:41:18.210374] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:18.230910] [DEBUG] [LOCAL ] MAN: Loaded 44317 existing records from primary storage. [2025-10-10T22:41:18.231224] [INFO ] [MAIN ] MAN: Loaded 44317 primary data records. [2025-10-10T22:41:18.359331] [DEBUG] [LOCAL ] MANU: Loaded 27241 existing records from primary storage. [2025-10-10T22:41:18.359687] [INFO ] [MAIN ] MANU: Loaded 27241 primary data records. [2025-10-10T22:41:18.735566] [DEBUG] [LOCAL ] MAS: Loaded 53015 existing records from primary storage. [2025-10-10T22:41:18.756166] [INFO ] [MAIN ] MAS: Loaded 53015 primary data records. [2025-10-10T22:41:19.199241] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:19.200711] [INFO ] [MAIN ] MAN: Generated 1820 derivative records from 44317 primary records. [2025-10-10T22:41:19.201579] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-10T22:41:19.235255] [DEBUG] [LOCAL ] MAN: Derivative data saved (1820 records). [2025-10-10T22:41:19.234935] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:19.235417] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-10T22:41:19.238596] [INFO ] [MAIN ] MANU: Generated 1820 derivative records from 27241 primary records. [2025-10-10T22:41:19.237804] [INFO ] [MAIN ] Derivative Progress: 1132/1823 symbols completed. MAN took 1.1s. Estimated remaining: 4m 25s. Rate: 156.6 symbols/min [2025-10-10T22:41:19.238897] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-10T22:41:19.239064] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:19.258482] [DEBUG] [LOCAL ] MANU: Derivative data saved (1820 records). [2025-10-10T22:41:19.270751] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-10T22:41:19.271234] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:19.273158] [INFO ] [MAIN ] Derivative Progress: 1133/1823 symbols completed. MANU took 1.1s. Estimated remaining: 4m 24s. Rate: 156.7 symbols/min [2025-10-10T22:41:19.273978] [INFO ] [MAIN ] MAS: Generated 1820 derivative records from 53015 primary records. [2025-10-10T22:41:19.274088] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:19.274243] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-10T22:41:19.300085] [DEBUG] [LOCAL ] MAS: Derivative data saved (1820 records). [2025-10-10T22:41:19.300276] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-10T22:41:19.303247] [INFO ] [MAIN ] Derivative Progress: 1134/1823 symbols completed. MAS took 1.1s. Estimated remaining: 4m 24s. Rate: 156.8 symbols/min [2025-10-10T22:41:19.303473] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:19.325374] [DEBUG] [LOCAL ] MATV: Loaded 36348 existing records from primary storage. [2025-10-10T22:41:19.325594] [INFO ] [MAIN ] MATV: Loaded 36348 primary data records. [2025-10-10T22:41:19.422607] [DEBUG] [LOCAL ] MATX: Loaded 31897 existing records from primary storage. [2025-10-10T22:41:19.446591] [INFO ] [MAIN ] MATX: Loaded 31897 primary data records. [2025-10-10T22:41:19.537389] [DEBUG] [LOCAL ] MAX: Loaded 31469 existing records from primary storage. [2025-10-10T22:41:19.616609] [INFO ] [MAIN ] MAX: Loaded 31469 primary data records. [2025-10-10T22:41:20.340269] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:41:20.342363] [INFO ] [MAIN ] MATV: Generated 1819 derivative records from 36348 primary records. [2025-10-10T22:41:20.343578] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-10T22:41:20.376083] [DEBUG] [LOCAL ] MATV: Derivative data saved (1819 records). [2025-10-10T22:41:20.374141] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:20.380295] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-10T22:41:20.381133] [INFO ] [MAIN ] MATX: Generated 1820 derivative records from 31897 primary records. [2025-10-10T22:41:20.381293] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-10T22:41:20.383470] [INFO ] [MAIN ] Derivative Progress: 1135/1823 symbols completed. MATV took 1.1s. Estimated remaining: 4m 24s. Rate: 156.6 symbols/min [2025-10-10T22:41:20.384588] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:20.415667] [DEBUG] [LOCAL ] MATX: Derivative data saved (1820 records). [2025-10-10T22:41:20.416174] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-10T22:41:20.415989] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:20.418522] [INFO ] [MAIN ] Derivative Progress: 1136/1823 symbols completed. MATX took 1.1s. Estimated remaining: 4m 23s. Rate: 156.7 symbols/min [2025-10-10T22:41:20.418878] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:20.419663] [INFO ] [MAIN ] MAX: Generated 1820 derivative records from 31469 primary records. [2025-10-10T22:41:20.420146] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-10T22:41:20.436777] [DEBUG] [LOCAL ] MAX: Derivative data saved (1820 records). [2025-10-10T22:41:20.436960] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-10T22:41:20.439232] [INFO ] [MAIN ] Derivative Progress: 1137/1823 symbols completed. MAX took 1.1s. Estimated remaining: 4m 22s. Rate: 156.8 symbols/min [2025-10-10T22:41:20.439568] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:20.469532] [DEBUG] [LOCAL ] MBI: Loaded 24626 existing records from primary storage. [2025-10-10T22:41:20.470404] [INFO ] [MAIN ] MBI: Loaded 24626 primary data records. [2025-10-10T22:41:20.528165] [DEBUG] [LOCAL ] MBC: Loaded 44294 existing records from primary storage. [2025-10-10T22:41:20.562191] [INFO ] [MAIN ] MBC: Loaded 44294 primary data records. [2025-10-10T22:41:20.774118] [DEBUG] [LOCAL ] MC: Loaded 44518 existing records from primary storage. [2025-10-10T22:41:20.806181] [INFO ] [MAIN ] MC: Loaded 44518 primary data records. [2025-10-10T22:41:21.475331] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:21.476423] [INFO ] [MAIN ] MBI: Generated 1820 derivative records from 24626 primary records. [2025-10-10T22:41:21.476679] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-10T22:41:21.498133] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:41:21.507083] [DEBUG] [LOCAL ] MBI: Derivative data saved (1820 records). [2025-10-10T22:41:21.508125] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-10T22:41:21.509600] [INFO ] [MAIN ] MBC: Generated 1819 derivative records from 44294 primary records. [2025-10-10T22:41:21.512396] [INFO ] [MAIN ] Derivative Progress: 1138/1823 symbols completed. MBI took 1.1s. Estimated remaining: 4m 22s. Rate: 156.6 symbols/min [2025-10-10T22:41:21.512959] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-10T22:41:21.533477] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:21.538504] [INFO ] [MAIN ] MC: Generated 1820 derivative records from 44518 primary records. [2025-10-10T22:41:21.539354] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-10T22:41:21.550872] [DEBUG] [LOCAL ] MBC: Derivative data saved (1819 records). [2025-10-10T22:41:21.554877] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-10T22:41:21.557206] [INFO ] [MAIN ] Derivative Progress: 1139/1823 symbols completed. MBC took 1.2s. Estimated remaining: 4m 22s. Rate: 156.7 symbols/min [2025-10-10T22:41:21.561283] [DEBUG] [LOCAL ] MC: Derivative data saved (1820 records). [2025-10-10T22:41:21.561345] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-10T22:41:21.563620] [INFO ] [MAIN ] Derivative Progress: 1140/1823 symbols completed. MC took 1.1s. Estimated remaining: 4m 21s. Rate: 156.8 symbols/min [2025-10-10T22:41:21.564026] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:21.564168] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:21.564256] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:21.580231] [DEBUG] [LOCAL ] MCI: Loaded 6589 existing records from primary storage. [2025-10-10T22:41:21.580466] [INFO ] [MAIN ] MCI: Loaded 6589 primary data records. [2025-10-10T22:41:21.650557] [DEBUG] [LOCAL ] MCB: Loaded 11456 existing records from primary storage. [2025-10-10T22:41:21.667500] [INFO ] [MAIN ] MCB: Loaded 11456 primary data records. [2025-10-10T22:41:22.032838] [DEBUG] [LOCAL ] MCK: Loaded 39349 existing records from primary storage. [2025-10-10T22:41:22.085326] [INFO ] [MAIN ] MCK: Loaded 39349 primary data records. [2025-10-10T22:41:22.563695] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:22.566614] [INFO ] [MAIN ] MCI: Generated 1820 derivative records from 6589 primary records. [2025-10-10T22:41:22.567294] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-10T22:41:22.596175] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:22.598177] [DEBUG] [LOCAL ] MCI: Derivative data saved (1820 records). [2025-10-10T22:41:22.598546] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-10T22:41:22.599321] [INFO ] [MAIN ] MCB: Generated 1820 derivative records from 11456 primary records. [2025-10-10T22:41:22.601984] [INFO ] [MAIN ] Derivative Progress: 1141/1823 symbols completed. MCI took 1.0s. Estimated remaining: 4m 21s. Rate: 156.6 symbols/min [2025-10-10T22:41:22.602151] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:22.602323] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-10T22:41:22.623374] [DEBUG] [LOCAL ] MCB: Derivative data saved (1820 records). [2025-10-10T22:41:22.623739] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-10T22:41:22.625853] [INFO ] [MAIN ] Derivative Progress: 1142/1823 symbols completed. MCB took 1.1s. Estimated remaining: 4m 21s. Rate: 156.7 symbols/min [2025-10-10T22:41:22.626055] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:22.631168] [DEBUG] [LOCAL ] MCN: Loaded 8270 existing records from primary storage. [2025-10-10T22:41:22.633249] [INFO ] [MAIN ] MCN: Loaded 8270 primary data records. [2025-10-10T22:41:22.736770] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:22.755156] [INFO ] [MAIN ] MCK: Generated 1820 derivative records from 39349 primary records. [2025-10-10T22:41:22.755402] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-10T22:41:23.009216] [DEBUG] [LOCAL ] MCO: Loaded 39893 existing records from primary storage. [2025-10-10T22:41:23.010895] [INFO ] [MAIN ] MCO: Loaded 39893 primary data records. [2025-10-10T22:41:23.033041] [DEBUG] [LOCAL ] MCK: Derivative data saved (1820 records). [2025-10-10T22:41:23.043310] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-10T22:41:23.045591] [INFO ] [MAIN ] Derivative Progress: 1143/1823 symbols completed. MCK took 1.5s. Estimated remaining: 4m 20s. Rate: 156.7 symbols/min [2025-10-10T22:41:23.057737] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:23.150226] [DEBUG] [LOCAL ] MCR: Loaded 8990 existing records from primary storage. [2025-10-10T22:41:23.150430] [INFO ] [MAIN ] MCR: Loaded 8990 primary data records. [2025-10-10T22:41:23.474042] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:23.517094] [INFO ] [MAIN ] MCN: Generated 1820 derivative records from 8270 primary records. [2025-10-10T22:41:23.526936] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-10T22:41:23.704361] [DEBUG] [LOCAL ] MCN: Derivative data saved (1820 records). [2025-10-10T22:41:23.704770] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-10T22:41:23.706830] [INFO ] [MAIN ] Derivative Progress: 1144/1823 symbols completed. MCN took 1.1s. Estimated remaining: 4m 20s. Rate: 156.6 symbols/min [2025-10-10T22:41:23.707234] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:23.729088] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:23.730094] [INFO ] [MAIN ] MCO: Generated 1820 derivative records from 39893 primary records. [2025-10-10T22:41:23.730240] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-10T22:41:23.760888] [DEBUG] [LOCAL ] MCO: Derivative data saved (1820 records). [2025-10-10T22:41:23.761406] [DEBUG] [LOCAL ] MCS: Loaded 21277 existing records from primary storage. [2025-10-10T22:41:23.762333] [INFO ] [MAIN ] MCS: Loaded 21277 primary data records. [2025-10-10T22:41:23.761046] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-10T22:41:23.765132] [INFO ] [MAIN ] Derivative Progress: 1145/1823 symbols completed. MCO took 1.1s. Estimated remaining: 4m 20s. Rate: 156.7 symbols/min [2025-10-10T22:41:23.798395] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:23.884876] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:23.907752] [INFO ] [MAIN ] MCR: Generated 1820 derivative records from 8990 primary records. [2025-10-10T22:41:23.926917] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-10T22:41:24.154094] [DEBUG] [LOCAL ] MCR: Derivative data saved (1820 records). [2025-10-10T22:41:24.155458] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-10T22:41:24.158845] [INFO ] [MAIN ] Derivative Progress: 1146/1823 symbols completed. MCR took 1.1s. Estimated remaining: 4m 19s. Rate: 156.7 symbols/min [2025-10-10T22:41:24.159195] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:24.159767] [DEBUG] [LOCAL ] MCY: Loaded 24282 existing records from primary storage. [2025-10-10T22:41:24.161865] [INFO ] [MAIN ] MCY: Loaded 24282 primary data records. [2025-10-10T22:41:24.499104] [DEBUG] [LOCAL ] MD: Loaded 39070 existing records from primary storage. [2025-10-10T22:41:24.500313] [INFO ] [MAIN ] MD: Loaded 39070 primary data records. [2025-10-10T22:41:24.590639] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:24.604406] [INFO ] [MAIN ] MCS: Generated 1820 derivative records from 21277 primary records. [2025-10-10T22:41:24.627585] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-10T22:41:24.845193] [DEBUG] [LOCAL ] MCS: Derivative data saved (1820 records). [2025-10-10T22:41:24.846389] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-10T22:41:24.862453] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:24.865080] [INFO ] [MAIN ] Derivative Progress: 1147/1823 symbols completed. MCS took 1.2s. Estimated remaining: 4m 19s. Rate: 156.6 symbols/min [2025-10-10T22:41:24.865805] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:24.866501] [INFO ] [MAIN ] MCY: Generated 1820 derivative records from 24282 primary records. [2025-10-10T22:41:24.866986] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-10T22:41:24.890935] [DEBUG] [LOCAL ] MCY: Derivative data saved (1820 records). [2025-10-10T22:41:24.890312] [DEBUG] [LOCAL ] MDST: Loaded 5946 existing records from primary storage. [2025-10-10T22:41:24.891209] [INFO ] [MAIN ] MDST: Loaded 5946 primary data records. [2025-10-10T22:41:24.891285] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-10T22:41:24.906041] [INFO ] [MAIN ] Derivative Progress: 1148/1823 symbols completed. MCY took 1.1s. Estimated remaining: 4m 18s. Rate: 156.7 symbols/min [2025-10-10T22:41:24.933219] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:25.079454] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:25.097072] [INFO ] [MAIN ] MD: Generated 1820 derivative records from 39070 primary records. [2025-10-10T22:41:25.099669] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-10T22:41:25.239005] [DEBUG] [LOCAL ] MD: Derivative data saved (1820 records). [2025-10-10T22:41:25.253003] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-10T22:41:25.255389] [INFO ] [MAIN ] Derivative Progress: 1149/1823 symbols completed. MD took 1.1s. Estimated remaining: 4m 18s. Rate: 156.7 symbols/min [2025-10-10T22:41:25.255751] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:25.278090] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-10-10T22:41:25.279231] [INFO ] [MAIN ] MDT: Loaded 54458 primary data records. [2025-10-10T22:41:25.468114] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:25.512347] [INFO ] [MAIN ] MDST: Generated 1820 derivative records from 5946 primary records. [2025-10-10T22:41:25.615259] [DEBUG] [LOCAL ] MDU: Loaded 48734 existing records from primary storage. [2025-10-10T22:41:25.628956] [INFO ] [MAIN ] MDU: Loaded 48734 primary data records. [2025-10-10T22:41:25.620569] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-10T22:41:25.837268] [DEBUG] [LOCAL ] MDST: Derivative data saved (1820 records). [2025-10-10T22:41:25.988555] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-10T22:41:26.004420] [INFO ] [MAIN ] Derivative Progress: 1150/1823 symbols completed. MDST took 1.1s. Estimated remaining: 4m 18s. Rate: 156.6 symbols/min [2025-10-10T22:41:26.005678] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:26.032866] [DEBUG] [LOCAL ] MDV: Loaded 8643 existing records from primary storage. [2025-10-10T22:41:26.033271] [INFO ] [MAIN ] MDV: Loaded 8643 primary data records. [2025-10-10T22:41:26.028963] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:26.034404] [INFO ] [MAIN ] MDT: Generated 1820 derivative records from 54458 primary records. [2025-10-10T22:41:26.071014] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-10T22:41:26.362197] [DEBUG] [LOCAL ] MDT: Derivative data saved (1820 records). [2025-10-10T22:41:26.362390] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-10T22:41:26.364555] [INFO ] [MAIN ] Derivative Progress: 1151/1823 symbols completed. MDT took 1.4s. Estimated remaining: 4m 17s. Rate: 156.6 symbols/min [2025-10-10T22:41:26.365786] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:26.382847] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:26.383970] [INFO ] [MAIN ] MDU: Generated 1820 derivative records from 48734 primary records. [2025-10-10T22:41:26.384123] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-10T22:41:26.412255] [DEBUG] [LOCAL ] MDU: Derivative data saved (1820 records). [2025-10-10T22:41:26.412537] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-10T22:41:26.411131] [DEBUG] [LOCAL ] MEC: Loaded 16527 existing records from primary storage. [2025-10-10T22:41:26.414594] [INFO ] [MAIN ] Derivative Progress: 1152/1823 symbols completed. MDU took 1.2s. Estimated remaining: 4m 17s. Rate: 156.7 symbols/min [2025-10-10T22:41:26.414997] [INFO ] [MAIN ] MEC: Loaded 16527 primary data records. [2025-10-10T22:41:26.415202] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:26.619714] [DEBUG] [LOCAL ] MED: Loaded 21627 existing records from primary storage. [2025-10-10T22:41:26.620604] [INFO ] [MAIN ] MED: Loaded 21627 primary data records. [2025-10-10T22:41:26.809474] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:26.828625] [INFO ] [MAIN ] MDV: Generated 1820 derivative records from 8643 primary records. [2025-10-10T22:41:26.843547] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-10T22:41:27.088692] [DEBUG] [LOCAL ] MDV: Derivative data saved (1820 records). [2025-10-10T22:41:27.089417] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-10T22:41:27.091683] [INFO ] [MAIN ] Derivative Progress: 1153/1823 symbols completed. MDV took 1.1s. Estimated remaining: 4m 17s. Rate: 156.6 symbols/min [2025-10-10T22:41:27.111659] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:27.112394] [INFO ] [MAIN ] MEC: Generated 1820 derivative records from 16527 primary records. [2025-10-10T22:41:27.112494] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-10T22:41:27.129365] [DEBUG] [LOCAL ] MEC: Derivative data saved (1820 records). [2025-10-10T22:41:27.129494] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-10T22:41:27.131558] [INFO ] [MAIN ] Derivative Progress: 1154/1823 symbols completed. MEC took 0.8s. Estimated remaining: 4m 16s. Rate: 156.8 symbols/min [2025-10-10T22:41:27.148824] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:27.149387] [INFO ] [MAIN ] MED: Generated 1820 derivative records from 21627 primary records. [2025-10-10T22:41:27.149446] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-10T22:41:27.165304] [DEBUG] [LOCAL ] MED: Derivative data saved (1820 records). [2025-10-10T22:41:27.165369] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-10T22:41:27.167603] [INFO ] [MAIN ] Derivative Progress: 1155/1823 symbols completed. MED took 0.8s. Estimated remaining: 4m 15s. Rate: 156.9 symbols/min [2025-10-10T22:41:27.168011] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:27.168212] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:27.168153] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:27.205996] [DEBUG] [LOCAL ] MEGI: Loaded 20167 existing records from primary storage. [2025-10-10T22:41:27.206134] [INFO ] [MAIN ] MEGI: Loaded 20167 primary data records. [2025-10-10T22:41:27.280906] [DEBUG] [LOCAL ] MEG: Loaded 31917 existing records from primary storage. [2025-10-10T22:41:27.306429] [INFO ] [MAIN ] MEG: Loaded 31917 primary data records. [2025-10-10T22:41:27.307086] [DEBUG] [LOCAL ] MEI: Loaded 32205 existing records from primary storage. [2025-10-10T22:41:27.328351] [INFO ] [MAIN ] MEI: Loaded 32205 primary data records. [2025-10-10T22:41:28.188883] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:28.190010] [INFO ] [MAIN ] MEGI: Generated 1820 derivative records from 20167 primary records. [2025-10-10T22:41:28.190379] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-10T22:41:28.234942] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:28.237399] [INFO ] [MAIN ] MEI: Generated 1820 derivative records from 32205 primary records. [2025-10-10T22:41:28.238500] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-10T22:41:28.238973] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1820 records). [2025-10-10T22:41:28.239267] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:28.240482] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-10T22:41:28.242783] [INFO ] [MAIN ] Derivative Progress: 1156/1823 symbols completed. MEGI took 1.1s. Estimated remaining: 4m 15s. Rate: 156.6 symbols/min [2025-10-10T22:41:28.240429] [INFO ] [MAIN ] MEG: Generated 1820 derivative records from 31917 primary records. [2025-10-10T22:41:28.242997] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:28.243467] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-10T22:41:28.276075] [DEBUG] [LOCAL ] MEI: Derivative data saved (1820 records). [2025-10-10T22:41:28.275024] [DEBUG] [LOCAL ] MEG: Derivative data saved (1820 records). [2025-10-10T22:41:28.276316] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-10T22:41:28.278637] [INFO ] [MAIN ] Derivative Progress: 1157/1823 symbols completed. MEG took 1.1s. Estimated remaining: 4m 15s. Rate: 156.8 symbols/min [2025-10-10T22:41:28.278838] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-10T22:41:28.278965] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:28.282202] [INFO ] [MAIN ] Derivative Progress: 1158/1823 symbols completed. MEI took 1.1s. Estimated remaining: 4m 14s. Rate: 156.9 symbols/min [2025-10-10T22:41:28.282703] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:28.291520] [DEBUG] [LOCAL ] MFAN: Loaded 4428 existing records from primary storage. [2025-10-10T22:41:28.291781] [INFO ] [MAIN ] MFAN: Loaded 4428 primary data records. [2025-10-10T22:41:28.659321] [DEBUG] [LOCAL ] MET: Loaded 54096 existing records from primary storage. [2025-10-10T22:41:28.659677] [INFO ] [MAIN ] MET: Loaded 54096 primary data records. [2025-10-10T22:41:28.681163] [DEBUG] [LOCAL ] MFA: Loaded 46366 existing records from primary storage. [2025-10-10T22:41:28.715759] [INFO ] [MAIN ] MFA: Loaded 46366 primary data records. [2025-10-10T22:41:29.291554] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:41:29.292759] [INFO ] [MAIN ] MFAN: Generated 1819 derivative records from 4428 primary records. [2025-10-10T22:41:29.293265] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-10T22:41:29.309945] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1819 records). [2025-10-10T22:41:29.310951] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-10T22:41:29.315211] [INFO ] [MAIN ] Derivative Progress: 1159/1823 symbols completed. MFAN took 1.0s. Estimated remaining: 4m 14s. Rate: 156.7 symbols/min [2025-10-10T22:41:29.316130] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:29.331501] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:29.332315] [INFO ] [MAIN ] MET: Generated 1820 derivative records from 54096 primary records. [2025-10-10T22:41:29.333577] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-10T22:41:29.348805] [DEBUG] [LOCAL ] MFAO: Loaded 4008 existing records from primary storage. [2025-10-10T22:41:29.353426] [INFO ] [MAIN ] MFAO: Loaded 4008 primary data records. [2025-10-10T22:41:29.353531] [DEBUG] [LOCAL ] MET: Derivative data saved (1820 records). [2025-10-10T22:41:29.365017] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-10T22:41:29.366987] [INFO ] [MAIN ] Derivative Progress: 1160/1823 symbols completed. MET took 1.1s. Estimated remaining: 4m 14s. Rate: 156.8 symbols/min [2025-10-10T22:41:29.391548] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:29.499028] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:29.545389] [INFO ] [MAIN ] MFA: Generated 1820 derivative records from 46366 primary records. [2025-10-10T22:41:29.545520] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-10T22:41:29.678545] [DEBUG] [LOCAL ] MFA: Derivative data saved (1820 records). [2025-10-10T22:41:29.679332] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-10T22:41:29.683080] [INFO ] [MAIN ] Derivative Progress: 1161/1823 symbols completed. MFA took 1.4s. Estimated remaining: 4m 13s. Rate: 156.8 symbols/min [2025-10-10T22:41:29.684443] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:29.734858] [DEBUG] [LOCAL ] MFC: Loaded 51842 existing records from primary storage. [2025-10-10T22:41:29.735804] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7800 incomplete bins [2025-10-10T22:41:29.735963] [INFO ] [MAIN ] MFC: Loaded 51842 primary data records. [2025-10-10T22:41:29.736726] [INFO ] [MAIN ] MFAO: Generated 1814 derivative records from 4008 primary records. [2025-10-10T22:41:29.736974] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-10T22:41:29.862069] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1814 records). [2025-10-10T22:41:29.865463] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-10T22:41:29.867689] [INFO ] [MAIN ] Derivative Progress: 1162/1823 symbols completed. MFAO took 0.6s. Estimated remaining: 4m 13s. Rate: 156.9 symbols/min [2025-10-10T22:41:29.878589] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:29.936988] [DEBUG] [LOCAL ] MFG: Loaded 50100 existing records from primary storage. [2025-10-10T22:41:29.955794] [INFO ] [MAIN ] MFG: Loaded 50100 primary data records. [2025-10-10T22:41:30.203577] [DEBUG] [LOCAL ] MFM: Loaded 14970 existing records from primary storage. [2025-10-10T22:41:30.215421] [INFO ] [MAIN ] MFM: Loaded 14970 primary data records. [2025-10-10T22:41:30.767370] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:30.768239] [INFO ] [MAIN ] MFC: Generated 1820 derivative records from 51842 primary records. [2025-10-10T22:41:30.768329] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-10T22:41:30.790261] [DEBUG] [LOCAL ] MFC: Derivative data saved (1820 records). [2025-10-10T22:41:30.790424] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-10T22:41:30.792522] [INFO ] [MAIN ] Derivative Progress: 1163/1823 symbols completed. MFC took 1.4s. Estimated remaining: 4m 13s. Rate: 156.7 symbols/min [2025-10-10T22:41:30.792923] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:30.806830] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:30.807547] [INFO ] [MAIN ] MFG: Generated 1820 derivative records from 50100 primary records. [2025-10-10T22:41:30.807671] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-10T22:41:30.831006] [DEBUG] [LOCAL ] MFG: Derivative data saved (1820 records). [2025-10-10T22:41:30.829958] [DEBUG] [LOCAL ] MFSG: Loaded 5694 existing records from primary storage. [2025-10-10T22:41:30.831243] [INFO ] [MAIN ] MFSG: Loaded 5694 primary data records. [2025-10-10T22:41:30.831130] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-10T22:41:30.834200] [INFO ] [MAIN ] Derivative Progress: 1164/1823 symbols completed. MFG took 1.1s. Estimated remaining: 4m 12s. Rate: 156.8 symbols/min [2025-10-10T22:41:30.847090] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:30.953863] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:30.958863] [INFO ] [MAIN ] MFM: Generated 1820 derivative records from 14970 primary records. [2025-10-10T22:41:30.972373] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-10T22:41:31.177961] [DEBUG] [LOCAL ] MFSI: Loaded 11975 existing records from primary storage. [2025-10-10T22:41:31.180904] [INFO ] [MAIN ] MFSI: Loaded 11975 primary data records. [2025-10-10T22:41:31.180234] [DEBUG] [LOCAL ] MFM: Derivative data saved (1820 records). [2025-10-10T22:41:31.181266] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-10T22:41:31.194959] [INFO ] [MAIN ] Derivative Progress: 1165/1823 symbols completed. MFM took 1.3s. Estimated remaining: 4m 12s. Rate: 156.8 symbols/min [2025-10-10T22:41:31.204521] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:31.293594] [DEBUG] [LOCAL ] MFSV: Loaded 2755 existing records from primary storage. [2025-10-10T22:41:31.332673] [INFO ] [MAIN ] MFSV: Loaded 2755 primary data records. [2025-10-10T22:41:31.822118] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:41:31.862875] [INFO ] [MAIN ] MFSG: Generated 1819 derivative records from 5694 primary records. [2025-10-10T22:41:31.863756] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-10T22:41:31.881704] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1819 records). [2025-10-10T22:41:31.882461] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-10T22:41:31.885094] [INFO ] [MAIN ] Derivative Progress: 1166/1823 symbols completed. MFSG took 1.1s. Estimated remaining: 4m 12s. Rate: 156.7 symbols/min [2025-10-10T22:41:31.885570] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:31.905834] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:41:31.911135] [INFO ] [MAIN ] MFSI: Generated 1819 derivative records from 11975 primary records. [2025-10-10T22:41:31.911628] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-10T22:41:31.930885] [DEBUG] [LOCAL ] MG: Loaded 16369 existing records from primary storage. [2025-10-10T22:41:31.934745] [INFO ] [MAIN ] MG: Loaded 16369 primary data records. [2025-10-10T22:41:31.935977] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1819 records). [2025-10-10T22:41:31.948251] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-10T22:41:32.008515] [INFO ] [MAIN ] Derivative Progress: 1167/1823 symbols completed. MFSI took 1.2s. Estimated remaining: 4m 11s. Rate: 156.8 symbols/min [2025-10-10T22:41:32.025829] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:32.072840] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-10T22:41:32.084297] [INFO ] [MAIN ] MFSV: Generated 1818 derivative records from 2755 primary records. [2025-10-10T22:41:32.134349] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-10T22:41:32.282759] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1818 records). [2025-10-10T22:41:32.296506] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-10T22:41:32.298831] [INFO ] [MAIN ] Derivative Progress: 1168/1823 symbols completed. MFSV took 1.1s. Estimated remaining: 4m 11s. Rate: 156.8 symbols/min [2025-10-10T22:41:32.319736] [DEBUG] [LOCAL ] MGA: Loaded 51404 existing records from primary storage. [2025-10-10T22:41:32.320017] [INFO ] [MAIN ] MGA: Loaded 51404 primary data records. [2025-10-10T22:41:32.455981] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:32.483304] [INFO ] [MAIN ] MG: Generated 1820 derivative records from 16369 primary records. [2025-10-10T22:41:32.492389] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-10T22:41:32.643667] [DEBUG] [LOCAL ] MG: Derivative data saved (1820 records). [2025-10-10T22:41:32.644264] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-10T22:41:32.646925] [INFO ] [MAIN ] Derivative Progress: 1169/1823 symbols completed. MG took 0.8s. Estimated remaining: 4m 10s. Rate: 156.8 symbols/min [2025-10-10T22:41:32.667155] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:32.667809] [INFO ] [MAIN ] MGA: Generated 1820 derivative records from 51404 primary records. [2025-10-10T22:41:32.667870] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-10T22:41:32.682762] [DEBUG] [LOCAL ] MGA: Derivative data saved (1820 records). [2025-10-10T22:41:32.682819] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-10T22:41:32.685216] [INFO ] [MAIN ] Derivative Progress: 1170/1823 symbols completed. MGA took 0.7s. Estimated remaining: 4m 10s. Rate: 157.0 symbols/min [2025-10-10T22:41:32.685628] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:32.685797] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:32.686197] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:32.695522] [DEBUG] [LOCAL ] MGF: Loaded 4333 existing records from primary storage. [2025-10-10T22:41:32.698245] [DEBUG] [LOCAL ] MGR: Loaded 5704 existing records from primary storage. [2025-10-10T22:41:32.698476] [INFO ] [MAIN ] MGR: Loaded 5704 primary data records. [2025-10-10T22:41:32.728719] [INFO ] [MAIN ] MGF: Loaded 4333 primary data records. [2025-10-10T22:41:33.317098] [DEBUG] [LOCAL ] MGM: Loaded 54387 existing records from primary storage. [2025-10-10T22:41:33.317430] [INFO ] [MAIN ] MGM: Loaded 54387 primary data records. [2025-10-10T22:41:33.703055] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:33.704266] [INFO ] [MAIN ] MGR: Generated 1820 derivative records from 5704 primary records. [2025-10-10T22:41:33.712444] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-10T22:41:33.719021] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:41:33.721110] [INFO ] [MAIN ] MGF: Generated 1819 derivative records from 4333 primary records. [2025-10-10T22:41:33.728324] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-10T22:41:33.754717] [DEBUG] [LOCAL ] MGF: Derivative data saved (1819 records). [2025-10-10T22:41:33.755191] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-10T22:41:33.758380] [INFO ] [MAIN ] Derivative Progress: 1171/1823 symbols completed. MGF took 1.1s. Estimated remaining: 4m 10s. Rate: 156.7 symbols/min [2025-10-10T22:41:33.758949] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:33.760020] [DEBUG] [LOCAL ] MGR: Derivative data saved (1820 records). [2025-10-10T22:41:33.760319] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-10T22:41:33.763510] [INFO ] [MAIN ] Derivative Progress: 1172/1823 symbols completed. MGR took 1.1s. Estimated remaining: 4m 9s. Rate: 156.8 symbols/min [2025-10-10T22:41:33.764005] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:33.773639] [DEBUG] [LOCAL ] MGRD: Loaded 2282 existing records from primary storage. [2025-10-10T22:41:33.786879] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:33.790468] [INFO ] [MAIN ] MGM: Generated 1820 derivative records from 54387 primary records. [2025-10-10T22:41:33.787094] [INFO ] [MAIN ] MGRD: Loaded 2282 primary data records. [2025-10-10T22:41:33.790764] [DEBUG] [LOCAL ] MGRB: Loaded 4095 existing records from primary storage. [2025-10-10T22:41:33.796118] [INFO ] [MAIN ] MGRB: Loaded 4095 primary data records. [2025-10-10T22:41:33.796235] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-10T22:41:34.359927] [DEBUG] [LOCAL ] MGM: Derivative data saved (1820 records). [2025-10-10T22:41:34.445371] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-10T22:41:34.447916] [INFO ] [MAIN ] Derivative Progress: 1173/1823 symbols completed. MGM took 1.8s. Estimated remaining: 4m 9s. Rate: 156.7 symbols/min [2025-10-10T22:41:34.448339] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:34.631813] [DEBUG] [LOCAL ] MGRE: Loaded 6773 existing records from primary storage. [2025-10-10T22:41:34.632130] [INFO ] [MAIN ] MGRE: Loaded 6773 primary data records. [2025-10-10T22:41:34.989237] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:34.990905] [INFO ] [MAIN ] MGRD: Generated 1820 derivative records from 2282 primary records. [2025-10-10T22:41:34.991118] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-10T22:41:35.013024] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:35.019803] [INFO ] [MAIN ] MGRB: Generated 1820 derivative records from 4095 primary records. [2025-10-10T22:41:35.020191] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1820 records). [2025-10-10T22:41:35.020319] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-10T22:41:35.020745] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-10T22:41:35.023093] [INFO ] [MAIN ] Derivative Progress: 1174/1823 symbols completed. MGRD took 1.3s. Estimated remaining: 4m 9s. Rate: 156.7 symbols/min [2025-10-10T22:41:35.024617] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:35.048872] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1820 records). [2025-10-10T22:41:35.049264] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-10T22:41:35.052826] [INFO ] [MAIN ] Derivative Progress: 1175/1823 symbols completed. MGRB took 1.3s. Estimated remaining: 4m 8s. Rate: 156.8 symbols/min [2025-10-10T22:41:35.054945] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:35.071912] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:35.072762] [INFO ] [MAIN ] MGRE: Generated 1820 derivative records from 6773 primary records. [2025-10-10T22:41:35.072826] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-10T22:41:35.105047] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1820 records). [2025-10-10T22:41:35.105295] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-10T22:41:35.107631] [INFO ] [MAIN ] Derivative Progress: 1176/1823 symbols completed. MGRE took 0.7s. Estimated remaining: 4m 7s. Rate: 156.9 symbols/min [2025-10-10T22:41:35.107921] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:35.113816] [DEBUG] [LOCAL ] MHD: Loaded 12585 existing records from primary storage. [2025-10-10T22:41:35.113950] [INFO ] [MAIN ] MHD: Loaded 12585 primary data records. [2025-10-10T22:41:35.249552] [DEBUG] [LOCAL ] MGY: Loaded 53170 existing records from primary storage. [2025-10-10T22:41:35.279310] [INFO ] [MAIN ] MGY: Loaded 53170 primary data records. [2025-10-10T22:41:35.293898] [DEBUG] [LOCAL ] MHF: Loaded 8952 existing records from primary storage. [2025-10-10T22:41:35.361324] [INFO ] [MAIN ] MHF: Loaded 8952 primary data records. [2025-10-10T22:41:36.151870] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:36.153015] [INFO ] [MAIN ] MHD: Generated 1820 derivative records from 12585 primary records. [2025-10-10T22:41:36.153260] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-10T22:41:36.170670] [DEBUG] [LOCAL ] MHD: Derivative data saved (1820 records). [2025-10-10T22:41:36.170746] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-10T22:41:36.172793] [INFO ] [MAIN ] Derivative Progress: 1177/1823 symbols completed. MHD took 1.1s. Estimated remaining: 4m 7s. Rate: 156.7 symbols/min [2025-10-10T22:41:36.173410] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:36.191389] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:36.193769] [INFO ] [MAIN ] MGY: Generated 1820 derivative records from 53170 primary records. [2025-10-10T22:41:36.193977] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-10T22:41:36.215496] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:36.220546] [INFO ] [MAIN ] MHF: Generated 1820 derivative records from 8952 primary records. [2025-10-10T22:41:36.221181] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-10T22:41:36.249748] [DEBUG] [LOCAL ] MHF: Derivative data saved (1820 records). [2025-10-10T22:41:36.249821] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-10T22:41:36.252347] [INFO ] [MAIN ] Derivative Progress: 1178/1823 symbols completed. MHF took 1.1s. Estimated remaining: 4m 7s. Rate: 156.8 symbols/min [2025-10-10T22:41:36.249355] [DEBUG] [LOCAL ] MGY: Derivative data saved (1820 records). [2025-10-10T22:41:36.252673] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-10T22:41:36.255830] [INFO ] [MAIN ] Derivative Progress: 1179/1823 symbols completed. MGY took 1.2s. Estimated remaining: 4m 6s. Rate: 156.9 symbols/min [2025-10-10T22:41:36.255176] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:36.256002] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:36.269619] [DEBUG] [LOCAL ] MHK: Loaded 42752 existing records from primary storage. [2025-10-10T22:41:36.269870] [INFO ] [MAIN ] MHK: Loaded 42752 primary data records. [2025-10-10T22:41:36.370336] [DEBUG] [LOCAL ] MHN: Loaded 7667 existing records from primary storage. [2025-10-10T22:41:36.387006] [INFO ] [MAIN ] MHN: Loaded 7667 primary data records. [2025-10-10T22:41:36.546463] [DEBUG] [LOCAL ] MHO: Loaded 24089 existing records from primary storage. [2025-10-10T22:41:36.581161] [INFO ] [MAIN ] MHO: Loaded 24089 primary data records. [2025-10-10T22:41:37.228993] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:37.232260] [INFO ] [MAIN ] MHK: Generated 1820 derivative records from 42752 primary records. [2025-10-10T22:41:37.232957] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-10T22:41:37.260678] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:37.267854] [INFO ] [MAIN ] MHN: Generated 1820 derivative records from 7667 primary records. [2025-10-10T22:41:37.282222] [DEBUG] [LOCAL ] MHK: Derivative data saved (1820 records). [2025-10-10T22:41:37.282534] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:37.282832] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-10T22:41:37.282754] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-10T22:41:37.285848] [INFO ] [MAIN ] Derivative Progress: 1180/1823 symbols completed. MHK took 1.1s. Estimated remaining: 4m 6s. Rate: 156.7 symbols/min [2025-10-10T22:41:37.283636] [INFO ] [MAIN ] MHO: Generated 1820 derivative records from 24089 primary records. [2025-10-10T22:41:37.287455] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:37.287341] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-10T22:41:37.320091] [DEBUG] [LOCAL ] MHN: Derivative data saved (1820 records). [2025-10-10T22:41:37.324538] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-10T22:41:37.327428] [INFO ] [MAIN ] Derivative Progress: 1181/1823 symbols completed. MHN took 1.1s. Estimated remaining: 4m 6s. Rate: 156.8 symbols/min [2025-10-10T22:41:37.327918] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:37.330872] [DEBUG] [LOCAL ] MHO: Derivative data saved (1820 records). [2025-10-10T22:41:37.331039] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-10T22:41:37.339471] [DEBUG] [LOCAL ] MIN: Loaded 13950 existing records from primary storage. [2025-10-10T22:41:37.339676] [INFO ] [MAIN ] MIN: Loaded 13950 primary data records. [2025-10-10T22:41:37.339058] [INFO ] [MAIN ] Derivative Progress: 1182/1823 symbols completed. MHO took 1.1s. Estimated remaining: 4m 5s. Rate: 156.9 symbols/min [2025-10-10T22:41:37.340041] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:37.378459] [DEBUG] [LOCAL ] MITP: Loaded 2369 existing records from primary storage. [2025-10-10T22:41:37.397629] [INFO ] [MAIN ] MITP: Loaded 2369 primary data records. [2025-10-10T22:41:37.662753] [DEBUG] [LOCAL ] MITT: Loaded 23128 existing records from primary storage. [2025-10-10T22:41:37.675093] [INFO ] [MAIN ] MITT: Loaded 23128 primary data records. [2025-10-10T22:41:38.302029] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:38.302962] [INFO ] [MAIN ] MIN: Generated 1820 derivative records from 13950 primary records. [2025-10-10T22:41:38.316750] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-10T22:41:38.316501] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:41:38.317379] [INFO ] [MAIN ] MITP: Generated 1819 derivative records from 2369 primary records. [2025-10-10T22:41:38.318211] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-10T22:41:38.338689] [DEBUG] [LOCAL ] MIN: Derivative data saved (1820 records). [2025-10-10T22:41:38.345343] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-10T22:41:38.345291] [DEBUG] [LOCAL ] MITP: Derivative data saved (1819 records). [2025-10-10T22:41:38.347448] [INFO ] [MAIN ] Derivative Progress: 1183/1823 symbols completed. MIN took 1.1s. Estimated remaining: 4m 5s. Rate: 156.7 symbols/min [2025-10-10T22:41:38.348065] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-10T22:41:38.350859] [INFO ] [MAIN ] Derivative Progress: 1184/1823 symbols completed. MITP took 1.0s. Estimated remaining: 4m 4s. Rate: 156.9 symbols/min [2025-10-10T22:41:38.366677] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:38.367277] [INFO ] [MAIN ] MITT: Generated 1820 derivative records from 23128 primary records. [2025-10-10T22:41:38.367339] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-10T22:41:38.381987] [DEBUG] [LOCAL ] MITT: Derivative data saved (1820 records). [2025-10-10T22:41:38.382045] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-10T22:41:38.384312] [INFO ] [MAIN ] Derivative Progress: 1185/1823 symbols completed. MITT took 1.0s. Estimated remaining: 4m 4s. Rate: 157.0 symbols/min [2025-10-10T22:41:38.384725] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:38.384819] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:38.385390] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:38.393186] [DEBUG] [LOCAL ] MIY: Loaded 6272 existing records from primary storage. [2025-10-10T22:41:38.393371] [INFO ] [MAIN ] MIY: Loaded 6272 primary data records. [2025-10-10T22:41:38.584550] [DEBUG] [LOCAL ] MKL: Loaded 34596 existing records from primary storage. [2025-10-10T22:41:38.706013] [INFO ] [MAIN ] MKL: Loaded 34596 primary data records. [2025-10-10T22:41:38.825711] [DEBUG] [LOCAL ] MKC: Loaded 53297 existing records from primary storage. [2025-10-10T22:41:38.859365] [INFO ] [MAIN ] MKC: Loaded 53297 primary data records. [2025-10-10T22:41:39.367746] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:39.369386] [INFO ] [MAIN ] MIY: Generated 1820 derivative records from 6272 primary records. [2025-10-10T22:41:39.370167] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-10T22:41:39.389332] [DEBUG] [LOCAL ] MIY: Derivative data saved (1820 records). [2025-10-10T22:41:39.389565] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-10T22:41:39.392373] [INFO ] [MAIN ] Derivative Progress: 1186/1823 symbols completed. MIY took 1.0s. Estimated remaining: 4m 4s. Rate: 156.8 symbols/min [2025-10-10T22:41:39.392728] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:39.411677] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:39.412396] [INFO ] [MAIN ] MKL: Generated 1820 derivative records from 34596 primary records. [2025-10-10T22:41:39.412673] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-10T22:41:39.430386] [DEBUG] [LOCAL ] MKL: Derivative data saved (1820 records). [2025-10-10T22:41:39.432978] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-10T22:41:39.444661] [INFO ] [MAIN ] Derivative Progress: 1187/1823 symbols completed. MKL took 1.1s. Estimated remaining: 4m 3s. Rate: 156.9 symbols/min [2025-10-10T22:41:39.445027] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:39.459436] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:39.460247] [INFO ] [MAIN ] MKC: Generated 1820 derivative records from 53297 primary records. [2025-10-10T22:41:39.460401] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-10T22:41:39.488865] [DEBUG] [LOCAL ] MLI: Loaded 44093 existing records from primary storage. [2025-10-10T22:41:39.490094] [DEBUG] [LOCAL ] MKC: Derivative data saved (1820 records). [2025-10-10T22:41:39.490207] [INFO ] [MAIN ] MLI: Loaded 44093 primary data records. [2025-10-10T22:41:39.497186] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-10T22:41:39.501264] [INFO ] [MAIN ] Derivative Progress: 1188/1823 symbols completed. MKC took 1.1s. Estimated remaining: 4m 3s. Rate: 157.0 symbols/min [2025-10-10T22:41:39.539249] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:39.621973] [DEBUG] [LOCAL ] MLM: Loaded 29814 existing records from primary storage. [2025-10-10T22:41:39.638598] [INFO ] [MAIN ] MLM: Loaded 29814 primary data records. [2025-10-10T22:41:39.914302] [DEBUG] [LOCAL ] MLNK: Loaded 26322 existing records from primary storage. [2025-10-10T22:41:39.942513] [INFO ] [MAIN ] MLNK: Loaded 26322 primary data records. [2025-10-10T22:41:40.489974] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:40.490906] [INFO ] [MAIN ] MLI: Generated 1820 derivative records from 44093 primary records. [2025-10-10T22:41:40.491542] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-10T22:41:40.510942] [DEBUG] [LOCAL ] MLI: Derivative data saved (1820 records). [2025-10-10T22:41:40.511248] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-10T22:41:40.513500] [INFO ] [MAIN ] Derivative Progress: 1189/1823 symbols completed. MLI took 1.1s. Estimated remaining: 4m 3s. Rate: 156.8 symbols/min [2025-10-10T22:41:40.513735] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:40.530585] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:40.534071] [INFO ] [MAIN ] MLM: Generated 1820 derivative records from 29814 primary records. [2025-10-10T22:41:40.534268] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-10T22:41:40.535612] [DEBUG] [LOCAL ] MLP: Loaded 3045 existing records from primary storage. [2025-10-10T22:41:40.536880] [INFO ] [MAIN ] MLP: Loaded 3045 primary data records. [2025-10-10T22:41:40.663105] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:40.663985] [INFO ] [MAIN ] MLNK: Generated 1820 derivative records from 26322 primary records. [2025-10-10T22:41:40.662756] [DEBUG] [LOCAL ] MLM: Derivative data saved (1820 records). [2025-10-10T22:41:40.669219] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-10T22:41:40.677354] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-10T22:41:40.683951] [INFO ] [MAIN ] Derivative Progress: 1190/1823 symbols completed. MLM took 1.2s. Estimated remaining: 4m 2s. Rate: 156.8 symbols/min [2025-10-10T22:41:40.711620] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:40.720958] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1820 records). [2025-10-10T22:41:40.726191] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-10T22:41:40.734019] [INFO ] [MAIN ] Derivative Progress: 1191/1823 symbols completed. MLNK took 1.2s. Estimated remaining: 4m 2s. Rate: 157.0 symbols/min [2025-10-10T22:41:40.746121] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:40.929502] [DEBUG] [LOCAL ] MLR: Loaded 12698 existing records from primary storage. [2025-10-10T22:41:40.930458] [INFO ] [MAIN ] MLR: Loaded 12698 primary data records. [2025-10-10T22:41:41.270283] [DEBUG] [LOCAL ] MMC: Loaded 52646 existing records from primary storage. [2025-10-10T22:41:41.270772] [INFO ] [MAIN ] MMC: Loaded 52646 primary data records. [2025-10-10T22:41:41.357851] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:41.381797] [INFO ] [MAIN ] MLP: Generated 1820 derivative records from 3045 primary records. [2025-10-10T22:41:41.392676] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-10T22:41:41.423479] [DEBUG] [LOCAL ] MLP: Derivative data saved (1820 records). [2025-10-10T22:41:41.428944] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-10T22:41:41.431028] [INFO ] [MAIN ] Derivative Progress: 1192/1823 symbols completed. MLP took 0.9s. Estimated remaining: 4m 1s. Rate: 156.8 symbols/min [2025-10-10T22:41:41.449343] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:41.663725] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:41.671857] [INFO ] [MAIN ] MLR: Generated 1820 derivative records from 12698 primary records. [2025-10-10T22:41:41.671977] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-10T22:41:41.674312] [DEBUG] [LOCAL ] MMD: Loaded 11341 existing records from primary storage. [2025-10-10T22:41:41.682196] [INFO ] [MAIN ] MMD: Loaded 11341 primary data records. [2025-10-10T22:41:41.750253] [DEBUG] [LOCAL ] MLR: Derivative data saved (1820 records). [2025-10-10T22:41:41.770731] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-10T22:41:41.800386] [INFO ] [MAIN ] Derivative Progress: 1193/1823 symbols completed. MLR took 1.1s. Estimated remaining: 4m 1s. Rate: 156.8 symbols/min [2025-10-10T22:41:41.801070] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:42.015011] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:42.016014] [INFO ] [MAIN ] MMC: Generated 1820 derivative records from 52646 primary records. [2025-10-10T22:41:42.024508] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-10T22:41:42.041865] [DEBUG] [LOCAL ] MMI: Loaded 15496 existing records from primary storage. [2025-10-10T22:41:42.050803] [DEBUG] [LOCAL ] MMC: Derivative data saved (1820 records). [2025-10-10T22:41:42.051620] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-10T22:41:42.054272] [INFO ] [MAIN ] Derivative Progress: 1194/1823 symbols completed. MMC took 1.3s. Estimated remaining: 4m 1s. Rate: 156.9 symbols/min [2025-10-10T22:41:42.051714] [INFO ] [MAIN ] MMI: Loaded 15496 primary data records. [2025-10-10T22:41:42.054847] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:42.281042] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:42.401319] [INFO ] [MAIN ] MMD: Generated 1820 derivative records from 11341 primary records. [2025-10-10T22:41:42.402105] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-10T22:41:42.433747] [DEBUG] [LOCAL ] MMD: Derivative data saved (1820 records). [2025-10-10T22:41:42.433951] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-10T22:41:42.436138] [INFO ] [MAIN ] Derivative Progress: 1195/1823 symbols completed. MMD took 1.0s. Estimated remaining: 4m 0s. Rate: 156.9 symbols/min [2025-10-10T22:41:42.437363] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:42.457805] [DEBUG] [LOCAL ] MMM: Loaded 53899 existing records from primary storage. [2025-10-10T22:41:42.459101] [INFO ] [MAIN ] MMM: Loaded 53899 primary data records. [2025-10-10T22:41:42.586165] [DEBUG] [LOCAL ] MMS: Loaded 34358 existing records from primary storage. [2025-10-10T22:41:42.592058] [INFO ] [MAIN ] MMS: Loaded 34358 primary data records. [2025-10-10T22:41:42.907919] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:42.925367] [INFO ] [MAIN ] MMI: Generated 1820 derivative records from 15496 primary records. [2025-10-10T22:41:42.959096] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-10T22:41:43.128713] [DEBUG] [LOCAL ] MMI: Derivative data saved (1820 records). [2025-10-10T22:41:43.130187] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-10T22:41:43.132636] [INFO ] [MAIN ] Derivative Progress: 1196/1823 symbols completed. MMI took 1.3s. Estimated remaining: 3m 60s. Rate: 156.8 symbols/min [2025-10-10T22:41:43.133385] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:43.149628] [DEBUG] [LOCAL ] MMT: Loaded 10630 existing records from primary storage. [2025-10-10T22:41:43.157854] [INFO ] [MAIN ] MMT: Loaded 10630 primary data records. [2025-10-10T22:41:43.175285] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:43.201993] [INFO ] [MAIN ] MMM: Generated 1820 derivative records from 53899 primary records. [2025-10-10T22:41:43.221424] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-10T22:41:43.290244] [DEBUG] [LOCAL ] MMM: Derivative data saved (1820 records). [2025-10-10T22:41:43.317059] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-10T22:41:43.324718] [INFO ] [MAIN ] Derivative Progress: 1197/1823 symbols completed. MMM took 1.3s. Estimated remaining: 3m 59s. Rate: 156.8 symbols/min [2025-10-10T22:41:43.325027] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:43.349516] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:43.388471] [INFO ] [MAIN ] MMS: Generated 1820 derivative records from 34358 primary records. [2025-10-10T22:41:43.487754] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-10T22:41:43.524382] [DEBUG] [LOCAL ] MMS: Derivative data saved (1820 records). [2025-10-10T22:41:43.524936] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-10T22:41:43.533124] [INFO ] [MAIN ] Derivative Progress: 1198/1823 symbols completed. MMS took 1.1s. Estimated remaining: 3m 59s. Rate: 156.9 symbols/min [2025-10-10T22:41:43.534814] [DEBUG] [LOCAL ] MMU: Loaded 17024 existing records from primary storage. [2025-10-10T22:41:43.534995] [INFO ] [MAIN ] MMU: Loaded 17024 primary data records. [2025-10-10T22:41:43.886442] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:43.887621] [INFO ] [MAIN ] MMT: Generated 1820 derivative records from 10630 primary records. [2025-10-10T22:41:43.888000] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-10T22:41:43.904077] [DEBUG] [LOCAL ] MMT: Derivative data saved (1820 records). [2025-10-10T22:41:43.904189] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-10T22:41:43.906399] [INFO ] [MAIN ] Derivative Progress: 1199/1823 symbols completed. MMT took 0.8s. Estimated remaining: 3m 59s. Rate: 156.9 symbols/min [2025-10-10T22:41:43.924272] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:43.924840] [INFO ] [MAIN ] MMU: Generated 1820 derivative records from 17024 primary records. [2025-10-10T22:41:43.924900] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-10T22:41:43.939820] [DEBUG] [LOCAL ] MMU: Derivative data saved (1820 records). [2025-10-10T22:41:43.939882] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-10T22:41:43.942334] [INFO ] [MAIN ] Derivative Progress: 1200/1823 symbols completed. MMU took 0.6s. Estimated remaining: 3m 58s. Rate: 157.0 symbols/min [2025-10-10T22:41:43.942808] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:43.942877] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:43.943065] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:43.993293] [DEBUG] [LOCAL ] MNR: Loaded 24984 existing records from primary storage. [2025-10-10T22:41:43.993554] [INFO ] [MAIN ] MNR: Loaded 24984 primary data records. [2025-10-10T22:41:44.061120] [DEBUG] [LOCAL ] MOD: Loaded 45599 existing records from primary storage. [2025-10-10T22:41:44.099076] [INFO ] [MAIN ] MOD: Loaded 45599 primary data records. [2025-10-10T22:41:44.197797] [DEBUG] [LOCAL ] MNSO: Loaded 44943 existing records from primary storage. [2025-10-10T22:41:44.236060] [INFO ] [MAIN ] MNSO: Loaded 44943 primary data records. [2025-10-10T22:41:44.976282] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:44.978971] [INFO ] [MAIN ] MNR: Generated 1820 derivative records from 24984 primary records. [2025-10-10T22:41:44.979331] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-10T22:41:45.010344] [DEBUG] [LOCAL ] MNR: Derivative data saved (1820 records). [2025-10-10T22:41:45.010499] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-10T22:41:45.005094] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:45.013343] [INFO ] [MAIN ] Derivative Progress: 1201/1823 symbols completed. MNR took 1.1s. Estimated remaining: 3m 58s. Rate: 156.8 symbols/min [2025-10-10T22:41:45.014277] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:45.015108] [INFO ] [MAIN ] MOD: Generated 1820 derivative records from 45599 primary records. [2025-10-10T22:41:45.016093] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-10T22:41:45.030093] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:45.031263] [INFO ] [MAIN ] MNSO: Generated 1820 derivative records from 44943 primary records. [2025-10-10T22:41:45.038619] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-10T22:41:45.058934] [DEBUG] [LOCAL ] MOD: Derivative data saved (1820 records). [2025-10-10T22:41:45.059110] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-10T22:41:45.061264] [INFO ] [MAIN ] Derivative Progress: 1202/1823 symbols completed. MOD took 1.1s. Estimated remaining: 3m 57s. Rate: 156.9 symbols/min [2025-10-10T22:41:45.062778] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:45.066158] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1820 records). [2025-10-10T22:41:45.067106] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-10T22:41:45.069470] [INFO ] [MAIN ] Derivative Progress: 1203/1823 symbols completed. MNSO took 1.1s. Estimated remaining: 3m 57s. Rate: 157.0 symbols/min [2025-10-10T22:41:45.069736] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:45.104687] [DEBUG] [LOCAL ] MOV: Loaded 22106 existing records from primary storage. [2025-10-10T22:41:45.105042] [INFO ] [MAIN ] MOV: Loaded 22106 primary data records. [2025-10-10T22:41:45.140895] [DEBUG] [LOCAL ] MODG: Loaded 52294 existing records from primary storage. [2025-10-10T22:41:45.165419] [INFO ] [MAIN ] MODG: Loaded 52294 primary data records. [2025-10-10T22:41:45.344084] [DEBUG] [LOCAL ] MOS: Loaded 54284 existing records from primary storage. [2025-10-10T22:41:45.371164] [INFO ] [MAIN ] MOS: Loaded 54284 primary data records. [2025-10-10T22:41:46.114786] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:46.123318] [INFO ] [MAIN ] MOV: Generated 1820 derivative records from 22106 primary records. [2025-10-10T22:41:46.128981] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:46.128698] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-10T22:41:46.130671] [INFO ] [MAIN ] MODG: Generated 1820 derivative records from 52294 primary records. [2025-10-10T22:41:46.130766] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-10T22:41:46.147973] [DEBUG] [LOCAL ] MOV: Derivative data saved (1820 records). [2025-10-10T22:41:46.154976] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-10T22:41:46.161199] [INFO ] [MAIN ] Derivative Progress: 1204/1823 symbols completed. MOV took 1.1s. Estimated remaining: 3m 57s. Rate: 156.8 symbols/min [2025-10-10T22:41:46.161596] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:46.166868] [DEBUG] [LOCAL ] MODG: Derivative data saved (1820 records). [2025-10-10T22:41:46.167898] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-10T22:41:46.171069] [INFO ] [MAIN ] Derivative Progress: 1205/1823 symbols completed. MODG took 1.2s. Estimated remaining: 3m 56s. Rate: 156.9 symbols/min [2025-10-10T22:41:46.171281] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:46.184594] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:46.185326] [INFO ] [MAIN ] MOS: Generated 1820 derivative records from 54284 primary records. [2025-10-10T22:41:46.185473] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-10T22:41:46.203226] [DEBUG] [LOCAL ] MOS: Derivative data saved (1820 records). [2025-10-10T22:41:46.206459] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-10T22:41:46.208985] [INFO ] [MAIN ] Derivative Progress: 1206/1823 symbols completed. MOS took 1.1s. Estimated remaining: 3m 56s. Rate: 157.0 symbols/min [2025-10-10T22:41:46.206722] [DEBUG] [LOCAL ] MPA: Loaded 5365 existing records from primary storage. [2025-10-10T22:41:46.209255] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:46.209431] [INFO ] [MAIN ] MPA: Loaded 5365 primary data records. [2025-10-10T22:41:46.331951] [DEBUG] [LOCAL ] MPV: Loaded 4937 existing records from primary storage. [2025-10-10T22:41:46.335581] [INFO ] [MAIN ] MPV: Loaded 4937 primary data records. [2025-10-10T22:41:46.657938] [DEBUG] [LOCAL ] MP: Loaded 54471 existing records from primary storage. [2025-10-10T22:41:46.674046] [INFO ] [MAIN ] MP: Loaded 54471 primary data records. [2025-10-10T22:41:47.166314] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:47.167827] [INFO ] [MAIN ] MPA: Generated 1820 derivative records from 5365 primary records. [2025-10-10T22:41:47.168415] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-10T22:41:47.200082] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:47.200975] [INFO ] [MAIN ] MPV: Generated 1820 derivative records from 4937 primary records. [2025-10-10T22:41:47.201252] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-10T22:41:47.199824] [DEBUG] [LOCAL ] MPA: Derivative data saved (1820 records). [2025-10-10T22:41:47.202082] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-10T22:41:47.204319] [INFO ] [MAIN ] Derivative Progress: 1207/1823 symbols completed. MPA took 1.0s. Estimated remaining: 3m 56s. Rate: 156.8 symbols/min [2025-10-10T22:41:47.204607] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:47.220255] [DEBUG] [LOCAL ] MPV: Derivative data saved (1820 records). [2025-10-10T22:41:47.220580] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-10T22:41:47.222748] [INFO ] [MAIN ] Derivative Progress: 1208/1823 symbols completed. MPV took 1.0s. Estimated remaining: 3m 55s. Rate: 157.0 symbols/min [2025-10-10T22:41:47.222952] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:47.241892] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:47.242596] [INFO ] [MAIN ] MP: Generated 1820 derivative records from 54471 primary records. [2025-10-10T22:41:47.242783] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-10T22:41:47.245573] [DEBUG] [LOCAL ] MPX: Loaded 4084 existing records from primary storage. [2025-10-10T22:41:47.246128] [INFO ] [MAIN ] MPX: Loaded 4084 primary data records. [2025-10-10T22:41:47.365524] [DEBUG] [LOCAL ] MP: Derivative data saved (1820 records). [2025-10-10T22:41:47.366030] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-10-10T22:41:47.368841] [INFO ] [MAIN ] Derivative Progress: 1209/1823 symbols completed. MP took 1.2s. Estimated remaining: 3m 55s. Rate: 157.0 symbols/min [2025-10-10T22:41:47.387868] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:47.625027] [DEBUG] [LOCAL ] MQT: Loaded 8745 existing records from primary storage. [2025-10-10T22:41:47.625219] [INFO ] [MAIN ] MQT: Loaded 8745 primary data records. [2025-10-10T22:41:47.638337] [DEBUG] [LOCAL ] MPW: Loaded 54273 existing records from primary storage. [2025-10-10T22:41:47.647936] [INFO ] [MAIN ] MPW: Loaded 54273 primary data records. [2025-10-10T22:41:48.240797] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:48.242803] [INFO ] [MAIN ] MPX: Generated 1820 derivative records from 4084 primary records. [2025-10-10T22:41:48.243092] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-10T22:41:48.259320] [DEBUG] [LOCAL ] MPX: Derivative data saved (1820 records). [2025-10-10T22:41:48.259502] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-10-10T22:41:48.261889] [INFO ] [MAIN ] Derivative Progress: 1210/1823 symbols completed. MPX took 1.0s. Estimated remaining: 3m 54s. Rate: 156.9 symbols/min [2025-10-10T22:41:48.262512] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:48.283577] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:48.296728] [INFO ] [MAIN ] MQT: Generated 1820 derivative records from 8745 primary records. [2025-10-10T22:41:48.300926] [DEBUG] [LOCAL ] MSB: Loaded 7881 existing records from primary storage. [2025-10-10T22:41:48.301019] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-10T22:41:48.301488] [INFO ] [MAIN ] MSB: Loaded 7881 primary data records. [2025-10-10T22:41:48.300708] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:48.331395] [INFO ] [MAIN ] MPW: Generated 1820 derivative records from 54273 primary records. [2025-10-10T22:41:48.358853] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-10T22:41:48.373015] [DEBUG] [LOCAL ] MQT: Derivative data saved (1820 records). [2025-10-10T22:41:48.381732] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-10T22:41:48.389126] [INFO ] [MAIN ] Derivative Progress: 1211/1823 symbols completed. MQT took 1.0s. Estimated remaining: 3m 54s. Rate: 156.9 symbols/min [2025-10-10T22:41:48.389262] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:48.638052] [DEBUG] [LOCAL ] MPW: Derivative data saved (1820 records). [2025-10-10T22:41:48.638735] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-10-10T22:41:48.641183] [INFO ] [MAIN ] Derivative Progress: 1212/1823 symbols completed. MPW took 1.4s. Estimated remaining: 3m 54s. Rate: 157.0 symbols/min [2025-10-10T22:41:48.647161] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:48.648380] [DEBUG] [LOCAL ] MSD: Loaded 16643 existing records from primary storage. [2025-10-10T22:41:48.649067] [INFO ] [MAIN ] MSD: Loaded 16643 primary data records. [2025-10-10T22:41:48.765148] [DEBUG] [LOCAL ] MTD: Loaded 15526 existing records from primary storage. [2025-10-10T22:41:48.766359] [INFO ] [MAIN ] MTD: Loaded 15526 primary data records. [2025-10-10T22:41:49.169250] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:49.327065] [INFO ] [MAIN ] MSB: Generated 1820 derivative records from 7881 primary records. [2025-10-10T22:41:49.335787] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-10T22:41:49.355389] [DEBUG] [LOCAL ] MSB: Derivative data saved (1820 records). [2025-10-10T22:41:49.356120] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-10-10T22:41:49.358567] [INFO ] [MAIN ] Derivative Progress: 1213/1823 symbols completed. MSB took 1.1s. Estimated remaining: 3m 53s. Rate: 156.9 symbols/min [2025-10-10T22:41:49.379220] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:49.379932] [INFO ] [MAIN ] MSD: Generated 1820 derivative records from 16643 primary records. [2025-10-10T22:41:49.380114] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-10T22:41:49.411737] [DEBUG] [LOCAL ] MSD: Derivative data saved (1820 records). [2025-10-10T22:41:49.412268] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-10T22:41:49.414523] [INFO ] [MAIN ] Derivative Progress: 1214/1823 symbols completed. MSD took 1.0s. Estimated remaining: 3m 53s. Rate: 157.0 symbols/min [2025-10-10T22:41:49.414885] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:49.415723] [INFO ] [MAIN ] MTD: Generated 1820 derivative records from 15526 primary records. [2025-10-10T22:41:49.415789] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-10-10T22:41:49.431488] [DEBUG] [LOCAL ] MTD: Derivative data saved (1820 records). [2025-10-10T22:41:49.431609] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-10-10T22:41:49.434049] [INFO ] [MAIN ] Derivative Progress: 1215/1823 symbols completed. MTD took 0.8s. Estimated remaining: 3m 52s. Rate: 157.1 symbols/min [2025-10-10T22:41:49.434494] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:49.434442] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:49.434944] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:49.459054] [DEBUG] [LOCAL ] MUE: Loaded 12230 existing records from primary storage. [2025-10-10T22:41:49.458814] [DEBUG] [LOCAL ] MUA: Loaded 11966 existing records from primary storage. [2025-10-10T22:41:49.464129] [INFO ] [MAIN ] MUE: Loaded 12230 primary data records. [2025-10-10T22:41:49.464345] [INFO ] [MAIN ] MUA: Loaded 11966 primary data records. [2025-10-10T22:41:49.490867] [DEBUG] [LOCAL ] MVF: Loaded 13305 existing records from primary storage. [2025-10-10T22:41:49.500956] [INFO ] [MAIN ] MVF: Loaded 13305 primary data records. [2025-10-10T22:41:50.414207] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:50.413849] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:50.415127] [INFO ] [MAIN ] MVF: Generated 1820 derivative records from 13305 primary records. [2025-10-10T22:41:50.415870] [INFO ] [MAIN ] MUA: Generated 1820 derivative records from 11966 primary records. [2025-10-10T22:41:50.416185] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-10T22:41:50.416239] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-10T22:41:50.445452] [DEBUG] [LOCAL ] MVF: Derivative data saved (1820 records). [2025-10-10T22:41:50.445953] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-10T22:41:50.448604] [INFO ] [MAIN ] Derivative Progress: 1216/1823 symbols completed. MVF took 1.0s. Estimated remaining: 3m 52s. Rate: 156.9 symbols/min [2025-10-10T22:41:50.457244] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:50.463843] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:50.465202] [INFO ] [MAIN ] MUE: Generated 1820 derivative records from 12230 primary records. [2025-10-10T22:41:50.465851] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-10T22:41:50.479173] [DEBUG] [LOCAL ] MUA: Derivative data saved (1820 records). [2025-10-10T22:41:50.487851] [DEBUG] [LOCAL ] MVT: Loaded 10278 existing records from primary storage. [2025-10-10T22:41:50.482853] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-10T22:41:50.490424] [INFO ] [MAIN ] MVT: Loaded 10278 primary data records. [2025-10-10T22:41:50.491238] [DEBUG] [LOCAL ] MUE: Derivative data saved (1820 records). [2025-10-10T22:41:50.496531] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-10T22:41:50.498804] [INFO ] [MAIN ] Derivative Progress: 1217/1823 symbols completed. MUE took 1.1s. Estimated remaining: 3m 52s. Rate: 157.0 symbols/min [2025-10-10T22:41:50.541522] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:50.546857] [INFO ] [MAIN ] Derivative Progress: 1218/1823 symbols completed. MUA took 1.1s. Estimated remaining: 3m 51s. Rate: 157.1 symbols/min [2025-10-10T22:41:50.547095] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:50.633741] [DEBUG] [LOCAL ] MXF: Loaded 5767 existing records from primary storage. [2025-10-10T22:41:50.646078] [INFO ] [MAIN ] MXF: Loaded 5767 primary data records. [2025-10-10T22:41:50.907169] [DEBUG] [LOCAL ] MX: Loaded 22681 existing records from primary storage. [2025-10-10T22:41:50.914875] [INFO ] [MAIN ] MX: Loaded 22681 primary data records. [2025-10-10T22:41:51.499874] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:51.501528] [INFO ] [MAIN ] MVT: Generated 1820 derivative records from 10278 primary records. [2025-10-10T22:41:51.501657] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-10T22:41:51.519593] [DEBUG] [LOCAL ] MVT: Derivative data saved (1820 records). [2025-10-10T22:41:51.519817] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-10T22:41:51.522762] [INFO ] [MAIN ] Derivative Progress: 1219/1823 symbols completed. MVT took 1.1s. Estimated remaining: 3m 51s. Rate: 156.9 symbols/min [2025-10-10T22:41:51.525314] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:51.539610] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:51.540402] [INFO ] [MAIN ] MXF: Generated 1820 derivative records from 5767 primary records. [2025-10-10T22:41:51.543134] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-10T22:41:51.561488] [DEBUG] [LOCAL ] MYN: Loaded 9975 existing records from primary storage. [2025-10-10T22:41:51.562372] [INFO ] [MAIN ] MYN: Loaded 9975 primary data records. [2025-10-10T22:41:51.606920] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:51.631319] [INFO ] [MAIN ] MX: Generated 1820 derivative records from 22681 primary records. [2025-10-10T22:41:51.645745] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-10T22:41:51.685933] [DEBUG] [LOCAL ] MXF: Derivative data saved (1820 records). [2025-10-10T22:41:51.690564] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-10T22:41:51.695531] [INFO ] [MAIN ] Derivative Progress: 1220/1823 symbols completed. MXF took 1.1s. Estimated remaining: 3m 50s. Rate: 157.0 symbols/min [2025-10-10T22:41:51.696325] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:51.721960] [DEBUG] [LOCAL ] MX: Derivative data saved (1820 records). [2025-10-10T22:41:51.740254] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-10-10T22:41:51.743017] [INFO ] [MAIN ] Derivative Progress: 1221/1823 symbols completed. MX took 1.2s. Estimated remaining: 3m 50s. Rate: 157.1 symbols/min [2025-10-10T22:41:51.882429] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:51.902987] [DEBUG] [LOCAL ] NAZ: Loaded 2677 existing records from primary storage. [2025-10-10T22:41:51.904390] [INFO ] [MAIN ] NAZ: Loaded 2677 primary data records. [2025-10-10T22:41:52.231122] [DEBUG] [LOCAL ] NAT: Loaded 49886 existing records from primary storage. [2025-10-10T22:41:52.232340] [INFO ] [MAIN ] NAT: Loaded 49886 primary data records. [2025-10-10T22:41:52.371364] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:52.412059] [INFO ] [MAIN ] MYN: Generated 1820 derivative records from 9975 primary records. [2025-10-10T22:41:52.418530] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-10T22:41:52.582158] [DEBUG] [LOCAL ] MYN: Derivative data saved (1820 records). [2025-10-10T22:41:52.582705] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-10T22:41:52.585247] [INFO ] [MAIN ] Derivative Progress: 1222/1823 symbols completed. MYN took 1.1s. Estimated remaining: 3m 50s. Rate: 157.0 symbols/min [2025-10-10T22:41:52.585611] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:52.600538] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:52.601758] [INFO ] [MAIN ] NAZ: Generated 1820 derivative records from 2677 primary records. [2025-10-10T22:41:52.601856] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-10T22:41:52.623262] [DEBUG] [LOCAL ] NBB: Loaded 9169 existing records from primary storage. [2025-10-10T22:41:52.624704] [INFO ] [MAIN ] NBB: Loaded 9169 primary data records. [2025-10-10T22:41:52.663747] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1820 records). [2025-10-10T22:41:52.696593] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-10T22:41:52.733219] [INFO ] [MAIN ] Derivative Progress: 1223/1823 symbols completed. NAZ took 0.9s. Estimated remaining: 3m 49s. Rate: 157.0 symbols/min [2025-10-10T22:41:52.733412] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:52.796310] [DEBUG] [LOCAL ] NC: Loaded 1965 existing records from primary storage. [2025-10-10T22:41:52.818583] [INFO ] [MAIN ] NC: Loaded 1965 primary data records. [2025-10-10T22:41:53.059588] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:53.061719] [INFO ] [MAIN ] NAT: Generated 1820 derivative records from 49886 primary records. [2025-10-10T22:41:53.067215] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-10T22:41:53.156850] [DEBUG] [LOCAL ] NAT: Derivative data saved (1820 records). [2025-10-10T22:41:53.157135] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-10-10T22:41:53.241388] [INFO ] [MAIN ] Derivative Progress: 1224/1823 symbols completed. NAT took 1.5s. Estimated remaining: 3m 49s. Rate: 157.0 symbols/min [2025-10-10T22:41:53.321894] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:53.335902] [DEBUG] [LOCAL ] NCA: Loaded 10086 existing records from primary storage. [2025-10-10T22:41:53.338729] [INFO ] [MAIN ] NCA: Loaded 10086 primary data records. [2025-10-10T22:41:53.418421] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:53.442377] [INFO ] [MAIN ] NBB: Generated 1820 derivative records from 9169 primary records. [2025-10-10T22:41:53.460836] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-10T22:41:53.694509] [DEBUG] [LOCAL ] NBB: Derivative data saved (1820 records). [2025-10-10T22:41:53.695574] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-10T22:41:53.695035] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:53.696708] [INFO ] [MAIN ] NC: Generated 1820 derivative records from 1965 primary records. [2025-10-10T22:41:53.696859] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-10T22:41:53.699045] [INFO ] [MAIN ] Derivative Progress: 1225/1823 symbols completed. NBB took 1.1s. Estimated remaining: 3m 49s. Rate: 157.0 symbols/min [2025-10-10T22:41:53.699379] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:53.717636] [DEBUG] [LOCAL ] NC: Derivative data saved (1820 records). [2025-10-10T22:41:53.717861] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-10-10T22:41:53.720291] [INFO ] [MAIN ] Derivative Progress: 1226/1823 symbols completed. NC took 1.0s. Estimated remaining: 3m 48s. Rate: 157.1 symbols/min [2025-10-10T22:41:53.721594] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:53.733316] [DEBUG] [LOCAL ] NCV: Loaded 14204 existing records from primary storage. [2025-10-10T22:41:53.733524] [INFO ] [MAIN ] NCV: Loaded 14204 primary data records. [2025-10-10T22:41:53.845046] [DEBUG] [LOCAL ] NCZ: Loaded 12549 existing records from primary storage. [2025-10-10T22:41:53.849973] [INFO ] [MAIN ] NCZ: Loaded 12549 primary data records. [2025-10-10T22:41:54.006993] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:54.109692] [INFO ] [MAIN ] NCA: Generated 1820 derivative records from 10086 primary records. [2025-10-10T22:41:54.130533] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-10T22:41:54.232551] [DEBUG] [LOCAL ] NCA: Derivative data saved (1820 records). [2025-10-10T22:41:54.251421] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-10T22:41:54.257542] [INFO ] [MAIN ] Derivative Progress: 1227/1823 symbols completed. NCA took 0.9s. Estimated remaining: 3m 48s. Rate: 157.0 symbols/min [2025-10-10T22:41:54.365440] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:54.385800] [DEBUG] [LOCAL ] NEXA: Loaded 4821 existing records from primary storage. [2025-10-10T22:41:54.386925] [INFO ] [MAIN ] NEXA: Loaded 4821 primary data records. [2025-10-10T22:41:54.576368] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:54.698415] [INFO ] [MAIN ] NCV: Generated 1820 derivative records from 14204 primary records. [2025-10-10T22:41:54.698888] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-10T22:41:54.731319] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:54.735264] [INFO ] [MAIN ] NCZ: Generated 1820 derivative records from 12549 primary records. [2025-10-10T22:41:54.736603] [DEBUG] [LOCAL ] NCV: Derivative data saved (1820 records). [2025-10-10T22:41:54.737373] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-10T22:41:54.737291] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-10T22:41:54.740725] [INFO ] [MAIN ] Derivative Progress: 1228/1823 symbols completed. NCV took 1.0s. Estimated remaining: 3m 47s. Rate: 157.0 symbols/min [2025-10-10T22:41:54.759733] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1820 records). [2025-10-10T22:41:54.760052] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-10T22:41:54.762228] [INFO ] [MAIN ] Derivative Progress: 1229/1823 symbols completed. NCZ took 1.0s. Estimated remaining: 3m 47s. Rate: 157.1 symbols/min [2025-10-10T22:41:54.778108] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:54.778811] [INFO ] [MAIN ] NEXA: Generated 1820 derivative records from 4821 primary records. [2025-10-10T22:41:54.778875] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-10-10T22:41:54.792764] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1820 records). [2025-10-10T22:41:54.792862] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-10-10T22:41:54.795358] [INFO ] [MAIN ] Derivative Progress: 1230/1823 symbols completed. NEXA took 0.4s. Estimated remaining: 3m 46s. Rate: 157.2 symbols/min [2025-10-10T22:41:54.796265] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:54.796069] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:54.796190] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:54.821013] [DEBUG] [LOCAL ] NGS: Loaded 11435 existing records from primary storage. [2025-10-10T22:41:54.828432] [INFO ] [MAIN ] NGS: Loaded 11435 primary data records. [2025-10-10T22:41:54.840346] [DEBUG] [LOCAL ] NIE: Loaded 12219 existing records from primary storage. [2025-10-10T22:41:54.860135] [INFO ] [MAIN ] NIE: Loaded 12219 primary data records. [2025-10-10T22:41:54.997996] [DEBUG] [LOCAL ] NGL: Loaded 30298 existing records from primary storage. [2025-10-10T22:41:55.011978] [INFO ] [MAIN ] NGL: Loaded 30298 primary data records. [2025-10-10T22:41:55.822495] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:55.823732] [INFO ] [MAIN ] NGS: Generated 1820 derivative records from 11435 primary records. [2025-10-10T22:41:55.838041] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-10T22:41:55.838438] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:55.840611] [INFO ] [MAIN ] NIE: Generated 1820 derivative records from 12219 primary records. [2025-10-10T22:41:55.848209] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-10T22:41:55.873556] [DEBUG] [LOCAL ] NGS: Derivative data saved (1820 records). [2025-10-10T22:41:55.882529] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-10-10T22:41:55.891783] [INFO ] [MAIN ] Derivative Progress: 1231/1823 symbols completed. NGS took 1.1s. Estimated remaining: 3m 46s. Rate: 157.0 symbols/min [2025-10-10T22:41:55.892924] [DEBUG] [LOCAL ] NIE: Derivative data saved (1820 records). [2025-10-10T22:41:55.893110] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:55.894040] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-10T22:41:55.896623] [INFO ] [MAIN ] Derivative Progress: 1232/1823 symbols completed. NIE took 1.1s. Estimated remaining: 3m 46s. Rate: 157.1 symbols/min [2025-10-10T22:41:55.893633] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:55.897880] [INFO ] [MAIN ] NGL: Generated 1820 derivative records from 30298 primary records. [2025-10-10T22:41:55.897778] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:55.898059] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-10T22:41:55.911990] [DEBUG] [LOCAL ] NIM: Loaded 3923 existing records from primary storage. [2025-10-10T22:41:55.915976] [INFO ] [MAIN ] NIM: Loaded 3923 primary data records. [2025-10-10T22:41:55.962064] [DEBUG] [LOCAL ] NGL: Derivative data saved (1820 records). [2025-10-10T22:41:55.973983] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-10-10T22:41:55.990171] [INFO ] [MAIN ] Derivative Progress: 1233/1823 symbols completed. NGL took 1.2s. Estimated remaining: 3m 45s. Rate: 157.2 symbols/min [2025-10-10T22:41:55.990361] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:56.101136] [DEBUG] [LOCAL ] NINE: Loaded 28496 existing records from primary storage. [2025-10-10T22:41:56.125125] [INFO ] [MAIN ] NINE: Loaded 28496 primary data records. [2025-10-10T22:41:56.584752] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-10-10T22:41:56.585272] [INFO ] [MAIN ] NIO: Loaded 54582 primary data records. [2025-10-10T22:41:56.747260] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:56.765594] [INFO ] [MAIN ] NIM: Generated 1820 derivative records from 3923 primary records. [2025-10-10T22:41:56.781854] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-10T22:41:56.966755] [DEBUG] [LOCAL ] NIM: Derivative data saved (1820 records). [2025-10-10T22:41:56.969460] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-10T22:41:56.972909] [INFO ] [MAIN ] Derivative Progress: 1234/1823 symbols completed. NIM took 1.1s. Estimated remaining: 3m 45s. Rate: 157.0 symbols/min [2025-10-10T22:41:56.973831] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:56.988247] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:56.989576] [INFO ] [MAIN ] NINE: Generated 1820 derivative records from 28496 primary records. [2025-10-10T22:41:56.989794] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-10T22:41:57.007254] [DEBUG] [LOCAL ] NINE: Derivative data saved (1820 records). [2025-10-10T22:41:57.007498] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-10-10T22:41:57.009739] [INFO ] [MAIN ] Derivative Progress: 1235/1823 symbols completed. NINE took 1.1s. Estimated remaining: 3m 45s. Rate: 157.1 symbols/min [2025-10-10T22:41:57.010112] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:57.043565] [DEBUG] [LOCAL ] NKX: Loaded 13828 existing records from primary storage. [2025-10-10T22:41:57.044285] [INFO ] [MAIN ] NKX: Loaded 13828 primary data records. [2025-10-10T22:41:57.044168] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:57.109754] [DEBUG] [LOCAL ] NMAI: Loaded 13086 existing records from primary storage. [2025-10-10T22:41:57.068234] [INFO ] [MAIN ] NIO: Generated 1820 derivative records from 54582 primary records. [2025-10-10T22:41:57.119098] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-10T22:41:57.119020] [INFO ] [MAIN ] NMAI: Loaded 13086 primary data records. [2025-10-10T22:41:57.308267] [DEBUG] [LOCAL ] NIO: Derivative data saved (1820 records). [2025-10-10T22:41:57.321491] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-10-10T22:41:57.346240] [INFO ] [MAIN ] Derivative Progress: 1236/1823 symbols completed. NIO took 1.4s. Estimated remaining: 3m 44s. Rate: 157.1 symbols/min [2025-10-10T22:41:57.372566] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:57.679881] [DEBUG] [LOCAL ] NMG: Loaded 9690 existing records from primary storage. [2025-10-10T22:41:57.681570] [INFO ] [MAIN ] NMG: Loaded 9690 primary data records. [2025-10-10T22:41:58.011081] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:58.012617] [INFO ] [MAIN ] NKX: Generated 1820 derivative records from 13828 primary records. [2025-10-10T22:41:58.014178] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-10T22:41:58.045604] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:58.051261] [DEBUG] [LOCAL ] NKX: Derivative data saved (1820 records). [2025-10-10T22:41:58.049169] [INFO ] [MAIN ] NMAI: Generated 1820 derivative records from 13086 primary records. [2025-10-10T22:41:58.051599] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-10T22:41:58.053850] [INFO ] [MAIN ] Derivative Progress: 1237/1823 symbols completed. NKX took 1.1s. Estimated remaining: 3m 44s. Rate: 157.0 symbols/min [2025-10-10T22:41:58.051786] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-10T22:41:58.054208] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:58.080777] [DEBUG] [LOCAL ] NMI: Loaded 4095 existing records from primary storage. [2025-10-10T22:41:58.080560] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1820 records). [2025-10-10T22:41:58.082008] [INFO ] [MAIN ] NMI: Loaded 4095 primary data records. [2025-10-10T22:41:58.088120] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-10-10T22:41:58.091037] [INFO ] [MAIN ] Derivative Progress: 1238/1823 symbols completed. NMAI took 1.1s. Estimated remaining: 3m 43s. Rate: 157.2 symbols/min [2025-10-10T22:41:58.117964] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:58.182946] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:58.207519] [INFO ] [MAIN ] NMG: Generated 1820 derivative records from 9690 primary records. [2025-10-10T22:41:58.207754] [DEBUG] [LOCAL ] NMS: Loaded 2908 existing records from primary storage. [2025-10-10T22:41:58.207944] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-10T22:41:58.208923] [INFO ] [MAIN ] NMS: Loaded 2908 primary data records. [2025-10-10T22:41:58.373979] [DEBUG] [LOCAL ] NMG: Derivative data saved (1820 records). [2025-10-10T22:41:58.403788] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-10-10T22:41:58.524412] [INFO ] [MAIN ] Derivative Progress: 1239/1823 symbols completed. NMG took 1.2s. Estimated remaining: 3m 43s. Rate: 157.1 symbols/min [2025-10-10T22:41:58.528991] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:58.724122] [DEBUG] [LOCAL ] NMT: Loaded 2879 existing records from primary storage. [2025-10-10T22:41:58.734123] [INFO ] [MAIN ] NMT: Loaded 2879 primary data records. [2025-10-10T22:41:59.114542] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:59.116017] [INFO ] [MAIN ] NMI: Generated 1820 derivative records from 4095 primary records. [2025-10-10T22:41:59.116214] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-10T22:41:59.116482] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-10T22:41:59.117710] [INFO ] [MAIN ] NMS: Generated 1818 derivative records from 2908 primary records. [2025-10-10T22:41:59.117802] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-10T22:41:59.144004] [DEBUG] [LOCAL ] NMI: Derivative data saved (1820 records). [2025-10-10T22:41:59.146315] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-10T22:41:59.147501] [DEBUG] [LOCAL ] NMS: Derivative data saved (1818 records). [2025-10-10T22:41:59.149996] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-10T22:41:59.149875] [INFO ] [MAIN ] Derivative Progress: 1240/1823 symbols completed. NMI took 1.1s. Estimated remaining: 3m 43s. Rate: 157.1 symbols/min [2025-10-10T22:41:59.152522] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:59.152599] [INFO ] [MAIN ] Derivative Progress: 1241/1823 symbols completed. NMS took 1.0s. Estimated remaining: 3m 42s. Rate: 157.2 symbols/min [2025-10-10T22:41:59.153599] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:59.181025] [DEBUG] [LOCAL ] NNY: Loaded 5676 existing records from primary storage. [2025-10-10T22:41:59.185190] [INFO ] [MAIN ] NNY: Loaded 5676 primary data records. [2025-10-10T22:41:59.185058] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:59.207207] [INFO ] [MAIN ] NMT: Generated 1820 derivative records from 2879 primary records. [2025-10-10T22:41:59.217870] [DEBUG] [LOCAL ] NNI: Loaded 10443 existing records from primary storage. [2025-10-10T22:41:59.237593] [INFO ] [MAIN ] NNI: Loaded 10443 primary data records. [2025-10-10T22:41:59.232362] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-10T22:41:59.530204] [DEBUG] [LOCAL ] NMT: Derivative data saved (1820 records). [2025-10-10T22:41:59.652094] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-10T22:41:59.694923] [INFO ] [MAIN ] Derivative Progress: 1242/1823 symbols completed. NMT took 1.2s. Estimated remaining: 3m 42s. Rate: 157.1 symbols/min [2025-10-10T22:41:59.712086] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:41:59.891408] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:59.892402] [INFO ] [MAIN ] NNY: Generated 1820 derivative records from 5676 primary records. [2025-10-10T22:41:59.892630] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-10T22:41:59.926699] [DEBUG] [LOCAL ] NNY: Derivative data saved (1820 records). [2025-10-10T22:41:59.927013] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-10T22:41:59.929340] [INFO ] [MAIN ] Derivative Progress: 1243/1823 symbols completed. NNY took 0.8s. Estimated remaining: 3m 41s. Rate: 157.2 symbols/min [2025-10-10T22:41:59.959361] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:41:59.960399] [DEBUG] [LOCAL ] NOK: Loaded 54402 existing records from primary storage. [2025-10-10T22:41:59.960495] [INFO ] [MAIN ] NOK: Loaded 54402 primary data records. [2025-10-10T22:41:59.961270] [INFO ] [MAIN ] NNI: Generated 1820 derivative records from 10443 primary records. [2025-10-10T22:42:00.003024] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-10T22:42:00.135164] [DEBUG] [LOCAL ] NNI: Derivative data saved (1820 records). [2025-10-10T22:42:00.151676] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-10-10T22:42:00.157449] [INFO ] [MAIN ] Derivative Progress: 1244/1823 symbols completed. NNI took 1.0s. Estimated remaining: 3m 41s. Rate: 157.2 symbols/min [2025-10-10T22:42:00.290940] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:00.291567] [INFO ] [MAIN ] NOK: Generated 1820 derivative records from 54402 primary records. [2025-10-10T22:42:00.291630] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-10-10T22:42:00.306842] [DEBUG] [LOCAL ] NOK: Derivative data saved (1820 records). [2025-10-10T22:42:00.306933] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-10-10T22:42:00.309266] [INFO ] [MAIN ] Derivative Progress: 1245/1823 symbols completed. NOK took 0.6s. Estimated remaining: 3m 40s. Rate: 157.3 symbols/min [2025-10-10T22:42:00.309967] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:00.309810] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:00.309896] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:00.325681] [DEBUG] [LOCAL ] NPK: Loaded 8253 existing records from primary storage. [2025-10-10T22:42:00.330260] [DEBUG] [LOCAL ] NPFD: Loaded 10119 existing records from primary storage. [2025-10-10T22:42:00.330392] [INFO ] [MAIN ] NPK: Loaded 8253 primary data records. [2025-10-10T22:42:00.350896] [INFO ] [MAIN ] NPFD: Loaded 10119 primary data records. [2025-10-10T22:42:00.692040] [DEBUG] [LOCAL ] NOTE: Loaded 41512 existing records from primary storage. [2025-10-10T22:42:00.807394] [INFO ] [MAIN ] NOTE: Loaded 41512 primary data records. [2025-10-10T22:42:01.318811] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:01.320266] [INFO ] [MAIN ] NPK: Generated 1820 derivative records from 8253 primary records. [2025-10-10T22:42:01.320508] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-10T22:42:01.352978] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:01.353795] [DEBUG] [LOCAL ] NPK: Derivative data saved (1820 records). [2025-10-10T22:42:01.354482] [INFO ] [MAIN ] NPFD: Generated 1820 derivative records from 10119 primary records. [2025-10-10T22:42:01.354804] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-10-10T22:42:01.354960] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-10T22:42:01.357405] [INFO ] [MAIN ] Derivative Progress: 1246/1823 symbols completed. NPK took 1.0s. Estimated remaining: 3m 40s. Rate: 157.1 symbols/min [2025-10-10T22:42:01.357701] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:01.376938] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1820 records). [2025-10-10T22:42:01.378613] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-10-10T22:42:01.383758] [INFO ] [MAIN ] Derivative Progress: 1247/1823 symbols completed. NPFD took 1.1s. Estimated remaining: 3m 40s. Rate: 157.2 symbols/min [2025-10-10T22:42:01.384070] [DEBUG] [LOCAL ] NPV: Loaded 5337 existing records from primary storage. [2025-10-10T22:42:01.384262] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:01.384558] [INFO ] [MAIN ] NPV: Loaded 5337 primary data records. [2025-10-10T22:42:01.409030] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:01.434621] [INFO ] [MAIN ] NOTE: Generated 1820 derivative records from 41512 primary records. [2025-10-10T22:42:01.461420] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-10T22:42:01.565752] [DEBUG] [LOCAL ] NQP: Loaded 9329 existing records from primary storage. [2025-10-10T22:42:01.589436] [INFO ] [MAIN ] NQP: Loaded 9329 primary data records. [2025-10-10T22:42:01.787523] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1820 records). [2025-10-10T22:42:01.805413] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-10-10T22:42:01.826059] [INFO ] [MAIN ] Derivative Progress: 1248/1823 symbols completed. NOTE took 1.5s. Estimated remaining: 3m 39s. Rate: 157.2 symbols/min [2025-10-10T22:42:01.867350] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:02.059409] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:02.060574] [INFO ] [MAIN ] NPV: Generated 1820 derivative records from 5337 primary records. [2025-10-10T22:42:02.060808] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-10T22:42:02.086928] [DEBUG] [LOCAL ] NPV: Derivative data saved (1820 records). [2025-10-10T22:42:02.088799] [DEBUG] [LOCAL ] NRDY: Loaded 33215 existing records from primary storage. [2025-10-10T22:42:02.087745] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-10T22:42:02.088966] [INFO ] [MAIN ] NRDY: Loaded 33215 primary data records. [2025-10-10T22:42:02.091009] [INFO ] [MAIN ] Derivative Progress: 1249/1823 symbols completed. NPV took 0.7s. Estimated remaining: 3m 39s. Rate: 157.2 symbols/min [2025-10-10T22:42:02.104269] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:02.189726] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:02.202141] [INFO ] [MAIN ] NQP: Generated 1820 derivative records from 9329 primary records. [2025-10-10T22:42:02.213388] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-10T22:42:02.280976] [DEBUG] [LOCAL ] NREF: Loaded 8112 existing records from primary storage. [2025-10-10T22:42:02.285240] [INFO ] [MAIN ] NREF: Loaded 8112 primary data records. [2025-10-10T22:42:02.518291] [DEBUG] [LOCAL ] NQP: Derivative data saved (1820 records). [2025-10-10T22:42:02.530254] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-10T22:42:02.532329] [INFO ] [MAIN ] Derivative Progress: 1250/1823 symbols completed. NQP took 1.1s. Estimated remaining: 3m 39s. Rate: 157.2 symbols/min [2025-10-10T22:42:02.565499] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:02.831297] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:02.843669] [INFO ] [MAIN ] NRDY: Generated 1820 derivative records from 33215 primary records. [2025-10-10T22:42:02.845049] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-10T22:42:02.845780] [DEBUG] [LOCAL ] NRGV: Loaded 44207 existing records from primary storage. [2025-10-10T22:42:02.847441] [INFO ] [MAIN ] NRGV: Loaded 44207 primary data records. [2025-10-10T22:42:02.900241] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1820 records). [2025-10-10T22:42:02.924989] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-10-10T22:42:02.927468] [INFO ] [MAIN ] Derivative Progress: 1251/1823 symbols completed. NRDY took 1.1s. Estimated remaining: 3m 38s. Rate: 157.2 symbols/min [2025-10-10T22:42:02.966231] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:02.972042] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:02.979181] [INFO ] [MAIN ] NREF: Generated 1820 derivative records from 8112 primary records. [2025-10-10T22:42:02.987029] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-10T22:42:03.110659] [DEBUG] [LOCAL ] NREF: Derivative data saved (1820 records). [2025-10-10T22:42:03.199947] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-10-10T22:42:03.202122] [INFO ] [MAIN ] Derivative Progress: 1252/1823 symbols completed. NREF took 1.1s. Estimated remaining: 3m 38s. Rate: 157.2 symbols/min [2025-10-10T22:42:03.199848] [DEBUG] [LOCAL ] NRP: Loaded 4136 existing records from primary storage. [2025-10-10T22:42:03.210476] [INFO ] [MAIN ] NRP: Loaded 4136 primary data records. [2025-10-10T22:42:03.211093] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:03.302311] [DEBUG] [LOCAL ] NRT: Loaded 4934 existing records from primary storage. [2025-10-10T22:42:03.314476] [INFO ] [MAIN ] NRT: Loaded 4934 primary data records. [2025-10-10T22:42:03.854497] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:03.857026] [INFO ] [MAIN ] NRGV: Generated 1820 derivative records from 44207 primary records. [2025-10-10T22:42:03.857320] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-10T22:42:03.876744] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1820 records). [2025-10-10T22:42:03.876930] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-10-10T22:42:03.879535] [INFO ] [MAIN ] Derivative Progress: 1253/1823 symbols completed. NRGV took 1.3s. Estimated remaining: 3m 38s. Rate: 157.1 symbols/min [2025-10-10T22:42:03.879921] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:03.899339] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:03.901152] [INFO ] [MAIN ] NRP: Generated 1820 derivative records from 4136 primary records. [2025-10-10T22:42:03.901410] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-10T22:42:03.927665] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:03.933775] [INFO ] [MAIN ] NRT: Generated 1820 derivative records from 4934 primary records. [2025-10-10T22:42:03.943713] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-10T22:42:03.944579] [DEBUG] [LOCAL ] NUV: Loaded 24018 existing records from primary storage. [2025-10-10T22:42:03.944118] [DEBUG] [LOCAL ] NRP: Derivative data saved (1820 records). [2025-10-10T22:42:03.945183] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-10-10T22:42:03.944746] [INFO ] [MAIN ] NUV: Loaded 24018 primary data records. [2025-10-10T22:42:03.958997] [INFO ] [MAIN ] Derivative Progress: 1254/1823 symbols completed. NRP took 1.0s. Estimated remaining: 3m 37s. Rate: 157.2 symbols/min [2025-10-10T22:42:03.996442] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:04.104783] [DEBUG] [LOCAL ] NRT: Derivative data saved (1820 records). [2025-10-10T22:42:04.137497] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-10-10T22:42:04.144330] [INFO ] [MAIN ] Derivative Progress: 1255/1823 symbols completed. NRT took 0.9s. Estimated remaining: 3m 37s. Rate: 157.3 symbols/min [2025-10-10T22:42:04.245458] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:04.285380] [DEBUG] [LOCAL ] NUW: Loaded 7200 existing records from primary storage. [2025-10-10T22:42:04.285915] [INFO ] [MAIN ] NUW: Loaded 7200 primary data records. [2025-10-10T22:42:04.389443] [DEBUG] [LOCAL ] NUVB: Loaded 52137 existing records from primary storage. [2025-10-10T22:42:04.402476] [INFO ] [MAIN ] NUVB: Loaded 52137 primary data records. [2025-10-10T22:42:04.821495] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:04.973637] [INFO ] [MAIN ] NUV: Generated 1820 derivative records from 24018 primary records. [2025-10-10T22:42:04.974672] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-10T22:42:04.997613] [DEBUG] [LOCAL ] NUV: Derivative data saved (1820 records). [2025-10-10T22:42:04.997842] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-10T22:42:05.000015] [INFO ] [MAIN ] Derivative Progress: 1256/1823 symbols completed. NUV took 1.1s. Estimated remaining: 3m 36s. Rate: 157.1 symbols/min [2025-10-10T22:42:05.001879] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:05.050670] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:05.050525] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:05.051968] [INFO ] [MAIN ] NUW: Generated 1820 derivative records from 7200 primary records. [2025-10-10T22:42:05.053163] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-10T22:42:05.052999] [INFO ] [MAIN ] NUVB: Generated 1820 derivative records from 52137 primary records. [2025-10-10T22:42:05.054335] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-10-10T22:42:05.073802] [DEBUG] [LOCAL ] NVR: Loaded 18768 existing records from primary storage. [2025-10-10T22:42:05.081840] [INFO ] [MAIN ] NVR: Loaded 18768 primary data records. [2025-10-10T22:42:05.191867] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1820 records). [2025-10-10T22:42:05.196178] [DEBUG] [LOCAL ] NUW: Derivative data saved (1820 records). [2025-10-10T22:42:05.196431] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-10-10T22:42:05.199457] [INFO ] [MAIN ] Derivative Progress: 1257/1823 symbols completed. NUVB took 1.2s. Estimated remaining: 3m 36s. Rate: 157.2 symbols/min [2025-10-10T22:42:05.199707] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:05.205259] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-10T22:42:05.223765] [INFO ] [MAIN ] Derivative Progress: 1258/1823 symbols completed. NUW took 1.0s. Estimated remaining: 3m 35s. Rate: 157.3 symbols/min [2025-10-10T22:42:05.396160] [DEBUG] [LOCAL ] NXC: Loaded 4152 existing records from primary storage. [2025-10-10T22:42:05.396349] [INFO ] [MAIN ] NXC: Loaded 4152 primary data records. [2025-10-10T22:42:05.740547] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:42:05.741597] [INFO ] [MAIN ] NVR: Generated 1819 derivative records from 18768 primary records. [2025-10-10T22:42:05.742154] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-10-10T22:42:05.759899] [DEBUG] [LOCAL ] NVR: Derivative data saved (1819 records). [2025-10-10T22:42:05.760075] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-10-10T22:42:05.762260] [INFO ] [MAIN ] Derivative Progress: 1259/1823 symbols completed. NVR took 0.8s. Estimated remaining: 3m 35s. Rate: 157.3 symbols/min [2025-10-10T22:42:05.779670] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:05.780358] [INFO ] [MAIN ] NXC: Generated 1820 derivative records from 4152 primary records. [2025-10-10T22:42:05.780429] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-10T22:42:05.795193] [DEBUG] [LOCAL ] NXC: Derivative data saved (1820 records). [2025-10-10T22:42:05.795282] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-10T22:42:05.797340] [INFO ] [MAIN ] Derivative Progress: 1260/1823 symbols completed. NXC took 0.6s. Estimated remaining: 3m 35s. Rate: 157.4 symbols/min [2025-10-10T22:42:05.797843] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:05.798017] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:05.797907] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:05.816732] [DEBUG] [LOCAL ] NXG: Loaded 10588 existing records from primary storage. [2025-10-10T22:42:05.822307] [INFO ] [MAIN ] NXG: Loaded 10588 primary data records. [2025-10-10T22:42:05.822635] [DEBUG] [LOCAL ] NXDT: Loaded 15274 existing records from primary storage. [2025-10-10T22:42:05.828123] [INFO ] [MAIN ] NXDT: Loaded 15274 primary data records. [2025-10-10T22:42:06.219222] [DEBUG] [LOCAL ] NXE: Loaded 53783 existing records from primary storage. [2025-10-10T22:42:06.333176] [INFO ] [MAIN ] NXE: Loaded 53783 primary data records. [2025-10-10T22:42:06.835909] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:06.837757] [INFO ] [MAIN ] NXG: Generated 1820 derivative records from 10588 primary records. [2025-10-10T22:42:06.837946] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-10-10T22:42:06.860026] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:06.864991] [INFO ] [MAIN ] NXDT: Generated 1820 derivative records from 15274 primary records. [2025-10-10T22:42:06.866667] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-10T22:42:06.868403] [DEBUG] [LOCAL ] NXG: Derivative data saved (1820 records). [2025-10-10T22:42:06.868796] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-10-10T22:42:06.870860] [INFO ] [MAIN ] Derivative Progress: 1261/1823 symbols completed. NXG took 1.1s. Estimated remaining: 3m 35s. Rate: 157.2 symbols/min [2025-10-10T22:42:06.871140] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:06.890202] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1820 records). [2025-10-10T22:42:06.890423] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-10-10T22:42:06.898840] [DEBUG] [LOCAL ] NXN: Loaded 2354 existing records from primary storage. [2025-10-10T22:42:06.896589] [INFO ] [MAIN ] Derivative Progress: 1262/1823 symbols completed. NXDT took 1.1s. Estimated remaining: 3m 34s. Rate: 157.3 symbols/min [2025-10-10T22:42:06.898987] [INFO ] [MAIN ] NXN: Loaded 2354 primary data records. [2025-10-10T22:42:06.918899] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:06.918568] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:06.919970] [INFO ] [MAIN ] NXE: Generated 1820 derivative records from 53783 primary records. [2025-10-10T22:42:06.929388] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-10-10T22:42:07.052741] [DEBUG] [LOCAL ] NXP: Loaded 12605 existing records from primary storage. [2025-10-10T22:42:07.090268] [INFO ] [MAIN ] NXP: Loaded 12605 primary data records. [2025-10-10T22:42:07.267515] [DEBUG] [LOCAL ] NXE: Derivative data saved (1820 records). [2025-10-10T22:42:07.286810] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-10-10T22:42:07.298700] [INFO ] [MAIN ] Derivative Progress: 1263/1823 symbols completed. NXE took 1.5s. Estimated remaining: 3m 34s. Rate: 157.3 symbols/min [2025-10-10T22:42:07.311023] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:07.426442] [DEBUG] [LOCAL ] OCFT: Loaded 7771 existing records from primary storage. [2025-10-10T22:42:07.540402] [INFO ] [MAIN ] OCFT: Loaded 7771 primary data records. [2025-10-10T22:42:07.733033] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:07.739362] [INFO ] [MAIN ] NXN: Generated 1820 derivative records from 2354 primary records. [2025-10-10T22:42:07.853682] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-10T22:42:07.873822] [DEBUG] [LOCAL ] NXN: Derivative data saved (1820 records). [2025-10-10T22:42:07.874037] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-10T22:42:07.876241] [INFO ] [MAIN ] Derivative Progress: 1264/1823 symbols completed. NXN took 1.0s. Estimated remaining: 3m 33s. Rate: 157.2 symbols/min [2025-10-10T22:42:07.876520] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:07.890823] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:07.891873] [INFO ] [MAIN ] NXP: Generated 1820 derivative records from 12605 primary records. [2025-10-10T22:42:07.892057] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-10T22:42:07.917617] [DEBUG] [LOCAL ] ODC: Loaded 8491 existing records from primary storage. [2025-10-10T22:42:07.920149] [DEBUG] [LOCAL ] NXP: Derivative data saved (1820 records). [2025-10-10T22:42:07.920415] [INFO ] [MAIN ] ODC: Loaded 8491 primary data records. [2025-10-10T22:42:07.920351] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-10T22:42:07.923012] [INFO ] [MAIN ] Derivative Progress: 1265/1823 symbols completed. NXP took 1.0s. Estimated remaining: 3m 33s. Rate: 157.3 symbols/min [2025-10-10T22:42:07.934533] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:08.114036] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:08.127502] [INFO ] [MAIN ] OCFT: Generated 1820 derivative records from 7771 primary records. [2025-10-10T22:42:08.240439] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-10T22:42:08.258301] [DEBUG] [LOCAL ] ODV: Loaded 28529 existing records from primary storage. [2025-10-10T22:42:08.263120] [INFO ] [MAIN ] ODV: Loaded 28529 primary data records. [2025-10-10T22:42:08.359319] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1820 records). [2025-10-10T22:42:08.369885] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-10-10T22:42:08.372085] [INFO ] [MAIN ] Derivative Progress: 1266/1823 symbols completed. OCFT took 1.1s. Estimated remaining: 3m 32s. Rate: 157.3 symbols/min [2025-10-10T22:42:08.384617] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:08.616544] [DEBUG] [LOCAL ] OIA: Loaded 13690 existing records from primary storage. [2025-10-10T22:42:08.618998] [INFO ] [MAIN ] OIA: Loaded 13690 primary data records. [2025-10-10T22:42:08.725586] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:08.737559] [INFO ] [MAIN ] ODC: Generated 1820 derivative records from 8491 primary records. [2025-10-10T22:42:08.759356] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-10T22:42:08.957717] [DEBUG] [LOCAL ] ODC: Derivative data saved (1820 records). [2025-10-10T22:42:08.959795] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-10-10T22:42:08.963558] [INFO ] [MAIN ] Derivative Progress: 1267/1823 symbols completed. ODC took 1.1s. Estimated remaining: 3m 32s. Rate: 157.2 symbols/min [2025-10-10T22:42:08.965240] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:08.980137] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:08.981181] [INFO ] [MAIN ] ODV: Generated 1820 derivative records from 28529 primary records. [2025-10-10T22:42:08.981712] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-10T22:42:09.002033] [DEBUG] [LOCAL ] ODV: Derivative data saved (1820 records). [2025-10-10T22:42:09.002220] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-10-10T22:42:09.004582] [INFO ] [MAIN ] Derivative Progress: 1268/1823 symbols completed. ODV took 1.1s. Estimated remaining: 3m 32s. Rate: 157.3 symbols/min [2025-10-10T22:42:09.012514] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:09.017828] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:09.019090] [INFO ] [MAIN ] OIA: Generated 1820 derivative records from 13690 primary records. [2025-10-10T22:42:09.019284] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-10T22:42:09.046370] [DEBUG] [LOCAL ] OIA: Derivative data saved (1820 records). [2025-10-10T22:42:09.046523] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-10T22:42:09.049680] [INFO ] [MAIN ] Derivative Progress: 1269/1823 symbols completed. OIA took 0.7s. Estimated remaining: 3m 31s. Rate: 157.4 symbols/min [2025-10-10T22:42:09.053927] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:09.054461] [DEBUG] [LOCAL ] OLP: Loaded 10232 existing records from primary storage. [2025-10-10T22:42:09.068088] [INFO ] [MAIN ] OLP: Loaded 10232 primary data records. [2025-10-10T22:42:09.139754] [DEBUG] [LOCAL ] OIS: Loaded 40743 existing records from primary storage. [2025-10-10T22:42:09.165254] [INFO ] [MAIN ] OIS: Loaded 40743 primary data records. [2025-10-10T22:42:09.173250] [DEBUG] [LOCAL ] ONIT: Loaded 7690 existing records from primary storage. [2025-10-10T22:42:09.176727] [INFO ] [MAIN ] ONIT: Loaded 7690 primary data records. [2025-10-10T22:42:10.012802] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:10.026062] [INFO ] [MAIN ] OLP: Generated 1820 derivative records from 10232 primary records. [2025-10-10T22:42:10.026961] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-10-10T22:42:10.029623] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:10.039193] [INFO ] [MAIN ] OIS: Generated 1820 derivative records from 40743 primary records. [2025-10-10T22:42:10.049346] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-10T22:42:10.055269] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:10.056772] [INFO ] [MAIN ] ONIT: Generated 1820 derivative records from 7690 primary records. [2025-10-10T22:42:10.057325] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-10-10T22:42:10.089383] [DEBUG] [LOCAL ] OLP: Derivative data saved (1820 records). [2025-10-10T22:42:10.091266] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1820 records). [2025-10-10T22:42:10.091361] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-10-10T22:42:10.091516] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-10-10T22:42:10.095813] [DEBUG] [LOCAL ] OIS: Derivative data saved (1820 records). [2025-10-10T22:42:10.093615] [INFO ] [MAIN ] Derivative Progress: 1270/1823 symbols completed. OLP took 1.1s. Estimated remaining: 3m 31s. Rate: 157.2 symbols/min [2025-10-10T22:42:10.095931] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-10-10T22:42:10.098565] [INFO ] [MAIN ] Derivative Progress: 1271/1823 symbols completed. ONIT took 1.0s. Estimated remaining: 3m 30s. Rate: 157.3 symbols/min [2025-10-10T22:42:10.098482] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:10.098930] [INFO ] [MAIN ] Derivative Progress: 1272/1823 symbols completed. OIS took 1.1s. Estimated remaining: 3m 30s. Rate: 157.5 symbols/min [2025-10-10T22:42:10.098893] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:10.099887] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:10.142234] [DEBUG] [LOCAL ] ONTF: Loaded 22763 existing records from primary storage. [2025-10-10T22:42:10.142417] [INFO ] [MAIN ] ONTF: Loaded 22763 primary data records. [2025-10-10T22:42:10.188995] [DEBUG] [LOCAL ] OPAD: Loaded 24192 existing records from primary storage. [2025-10-10T22:42:10.215851] [DEBUG] [LOCAL ] ONL: Loaded 30363 existing records from primary storage. [2025-10-10T22:42:10.236106] [INFO ] [MAIN ] OPAD: Loaded 24192 primary data records. [2025-10-10T22:42:10.236204] [INFO ] [MAIN ] ONL: Loaded 30363 primary data records. [2025-10-10T22:42:11.103449] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:11.104318] [INFO ] [MAIN ] ONTF: Generated 1820 derivative records from 22763 primary records. [2025-10-10T22:42:11.105074] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-10T22:42:11.126030] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1820 records). [2025-10-10T22:42:11.126287] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-10-10T22:42:11.153779] [INFO ] [MAIN ] Derivative Progress: 1273/1823 symbols completed. ONTF took 1.1s. Estimated remaining: 3m 30s. Rate: 157.3 symbols/min [2025-10-10T22:42:11.154879] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:11.155753] [INFO ] [MAIN ] OPAD: Generated 1820 derivative records from 24192 primary records. [2025-10-10T22:42:11.154445] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:11.155866] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-10T22:42:11.156442] [INFO ] [MAIN ] ONL: Generated 1820 derivative records from 30363 primary records. [2025-10-10T22:42:11.157119] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-10T22:42:11.184593] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1820 records). [2025-10-10T22:42:11.184899] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-10-10T22:42:11.187547] [INFO ] [MAIN ] Derivative Progress: 1274/1823 symbols completed. OPAD took 1.1s. Estimated remaining: 3m 29s. Rate: 157.4 symbols/min [2025-10-10T22:42:11.189680] [DEBUG] [LOCAL ] ONL: Derivative data saved (1820 records). [2025-10-10T22:42:11.189742] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-10-10T22:42:11.191727] [INFO ] [MAIN ] Derivative Progress: 1275/1823 symbols completed. ONL took 1.1s. Estimated remaining: 3m 29s. Rate: 157.5 symbols/min [2025-10-10T22:42:11.192181] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:11.192131] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:11.192617] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:11.206564] [DEBUG] [LOCAL ] OPP: Loaded 12307 existing records from primary storage. [2025-10-10T22:42:11.206729] [INFO ] [MAIN ] OPP: Loaded 12307 primary data records. [2025-10-10T22:42:11.316918] [DEBUG] [LOCAL ] ORN: Loaded 31322 existing records from primary storage. [2025-10-10T22:42:11.327778] [INFO ] [MAIN ] ORN: Loaded 31322 primary data records. [2025-10-10T22:42:11.856282] [DEBUG] [LOCAL ] ORC: Loaded 53224 existing records from primary storage. [2025-10-10T22:42:11.857890] [INFO ] [MAIN ] ORC: Loaded 53224 primary data records. [2025-10-10T22:42:12.218243] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:12.219716] [INFO ] [MAIN ] OPP: Generated 1820 derivative records from 12307 primary records. [2025-10-10T22:42:12.220363] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-10T22:42:12.253035] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:12.255554] [INFO ] [MAIN ] ORN: Generated 1820 derivative records from 31322 primary records. [2025-10-10T22:42:12.256745] [DEBUG] [LOCAL ] OPP: Derivative data saved (1820 records). [2025-10-10T22:42:12.257056] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-10T22:42:12.257129] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-10T22:42:12.259151] [INFO ] [MAIN ] Derivative Progress: 1276/1823 symbols completed. OPP took 1.1s. Estimated remaining: 3m 29s. Rate: 157.3 symbols/min [2025-10-10T22:42:12.259975] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:12.279089] [DEBUG] [LOCAL ] ORN: Derivative data saved (1820 records). [2025-10-10T22:42:12.279390] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-10-10T22:42:12.281702] [INFO ] [MAIN ] Derivative Progress: 1277/1823 symbols completed. ORN took 1.1s. Estimated remaining: 3m 28s. Rate: 157.4 symbols/min [2025-10-10T22:42:12.284711] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:12.292978] [DEBUG] [LOCAL ] OWLT: Loaded 9274 existing records from primary storage. [2025-10-10T22:42:12.293254] [INFO ] [MAIN ] OWLT: Loaded 9274 primary data records. [2025-10-10T22:42:12.344898] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:12.400993] [INFO ] [MAIN ] ORC: Generated 1820 derivative records from 53224 primary records. [2025-10-10T22:42:12.415414] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-10-10T22:42:12.448488] [DEBUG] [LOCAL ] PAC: Loaded 11728 existing records from primary storage. [2025-10-10T22:42:12.468251] [DEBUG] [LOCAL ] ORC: Derivative data saved (1820 records). [2025-10-10T22:42:12.468542] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-10-10T22:42:12.493195] [INFO ] [MAIN ] Derivative Progress: 1278/1823 symbols completed. ORC took 1.3s. Estimated remaining: 3m 28s. Rate: 157.4 symbols/min [2025-10-10T22:42:12.501509] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:12.468457] [INFO ] [MAIN ] PAC: Loaded 11728 primary data records. [2025-10-10T22:42:12.951991] [DEBUG] [LOCAL ] PACK: Loaded 32336 existing records from primary storage. [2025-10-10T22:42:12.952436] [INFO ] [MAIN ] PACK: Loaded 32336 primary data records. [2025-10-10T22:42:13.264830] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:13.266751] [INFO ] [MAIN ] OWLT: Generated 1820 derivative records from 9274 primary records. [2025-10-10T22:42:13.266889] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-10T22:42:13.290511] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1820 records). [2025-10-10T22:42:13.290851] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-10-10T22:42:13.293396] [INFO ] [MAIN ] Derivative Progress: 1279/1823 symbols completed. OWLT took 1.0s. Estimated remaining: 3m 28s. Rate: 157.3 symbols/min [2025-10-10T22:42:13.306452] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:13.308516] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:13.309811] [INFO ] [MAIN ] PAC: Generated 1820 derivative records from 11728 primary records. [2025-10-10T22:42:13.309910] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-10-10T22:42:13.327359] [DEBUG] [LOCAL ] PAI: Loaded 2718 existing records from primary storage. [2025-10-10T22:42:13.328338] [INFO ] [MAIN ] PAI: Loaded 2718 primary data records. [2025-10-10T22:42:13.420197] [DEBUG] [LOCAL ] PAC: Derivative data saved (1820 records). [2025-10-10T22:42:13.454905] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-10-10T22:42:13.455587] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:42:13.464134] [INFO ] [MAIN ] Derivative Progress: 1280/1823 symbols completed. PAC took 1.2s. Estimated remaining: 3m 27s. Rate: 157.4 symbols/min [2025-10-10T22:42:13.470248] [INFO ] [MAIN ] PACK: Generated 1819 derivative records from 32336 primary records. [2025-10-10T22:42:13.470487] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:13.485957] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-10T22:42:13.677929] [DEBUG] [LOCAL ] PCF: Loaded 9140 existing records from primary storage. [2025-10-10T22:42:13.678573] [INFO ] [MAIN ] PCF: Loaded 9140 primary data records. [2025-10-10T22:42:13.754795] [DEBUG] [LOCAL ] PACK: Derivative data saved (1819 records). [2025-10-10T22:42:13.767254] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-10-10T22:42:13.792685] [INFO ] [MAIN ] Derivative Progress: 1281/1823 symbols completed. PACK took 1.3s. Estimated remaining: 3m 27s. Rate: 157.4 symbols/min [2025-10-10T22:42:13.798989] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:13.997155] [DEBUG] [LOCAL ] PCM: Loaded 6856 existing records from primary storage. [2025-10-10T22:42:13.997350] [INFO ] [MAIN ] PCM: Loaded 6856 primary data records. [2025-10-10T22:42:14.151795] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:14.185583] [INFO ] [MAIN ] PAI: Generated 1820 derivative records from 2718 primary records. [2025-10-10T22:42:14.185746] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-10T22:42:14.388731] [DEBUG] [LOCAL ] PAI: Derivative data saved (1820 records). [2025-10-10T22:42:14.391232] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-10T22:42:14.393668] [INFO ] [MAIN ] Derivative Progress: 1282/1823 symbols completed. PAI took 1.1s. Estimated remaining: 3m 26s. Rate: 157.3 symbols/min [2025-10-10T22:42:14.394336] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:14.410172] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:14.411190] [INFO ] [MAIN ] PCF: Generated 1820 derivative records from 9140 primary records. [2025-10-10T22:42:14.411524] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-10T22:42:14.437787] [DEBUG] [LOCAL ] PCQ: Loaded 12219 existing records from primary storage. [2025-10-10T22:42:14.441208] [INFO ] [MAIN ] PCQ: Loaded 12219 primary data records. [2025-10-10T22:42:14.454224] [DEBUG] [LOCAL ] PCF: Derivative data saved (1820 records). [2025-10-10T22:42:14.475553] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-10T22:42:14.477779] [INFO ] [MAIN ] Derivative Progress: 1283/1823 symbols completed. PCF took 1.0s. Estimated remaining: 3m 26s. Rate: 157.4 symbols/min [2025-10-10T22:42:14.498322] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:14.510038] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:14.540090] [INFO ] [MAIN ] PCM: Generated 1820 derivative records from 6856 primary records. [2025-10-10T22:42:14.571612] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-10T22:42:14.636815] [DEBUG] [LOCAL ] PDS: Loaded 17700 existing records from primary storage. [2025-10-10T22:42:14.671507] [INFO ] [MAIN ] PDS: Loaded 17700 primary data records. [2025-10-10T22:42:14.835012] [DEBUG] [LOCAL ] PCM: Derivative data saved (1820 records). [2025-10-10T22:42:14.855876] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-10T22:42:14.870887] [INFO ] [MAIN ] Derivative Progress: 1284/1823 symbols completed. PCM took 1.1s. Estimated remaining: 3m 25s. Rate: 157.4 symbols/min [2025-10-10T22:42:14.895435] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:15.111247] [DEBUG] [LOCAL ] PDT: Loaded 17761 existing records from primary storage. [2025-10-10T22:42:15.111528] [INFO ] [MAIN ] PDT: Loaded 17761 primary data records. [2025-10-10T22:42:15.434279] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:15.435299] [INFO ] [MAIN ] PCQ: Generated 1820 derivative records from 12219 primary records. [2025-10-10T22:42:15.435386] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-10T22:42:15.470305] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:15.472325] [INFO ] [MAIN ] PDS: Generated 1820 derivative records from 17700 primary records. [2025-10-10T22:42:15.474134] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-10T22:42:15.473992] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1820 records). [2025-10-10T22:42:15.475583] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-10T22:42:15.485713] [INFO ] [MAIN ] Derivative Progress: 1285/1823 symbols completed. PCQ took 1.1s. Estimated remaining: 3m 25s. Rate: 157.3 symbols/min [2025-10-10T22:42:15.485902] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:15.496070] [DEBUG] [LOCAL ] PDS: Derivative data saved (1820 records). [2025-10-10T22:42:15.496263] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-10-10T22:42:15.498548] [INFO ] [MAIN ] Derivative Progress: 1286/1823 symbols completed. PDS took 1.0s. Estimated remaining: 3m 25s. Rate: 157.4 symbols/min [2025-10-10T22:42:15.498939] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:15.509145] [DEBUG] [LOCAL ] PEO: Loaded 11325 existing records from primary storage. [2025-10-10T22:42:15.509498] [INFO ] [MAIN ] PEO: Loaded 11325 primary data records. [2025-10-10T22:42:15.614589] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:15.638562] [INFO ] [MAIN ] PDT: Generated 1820 derivative records from 17761 primary records. [2025-10-10T22:42:15.641860] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-10T22:42:15.642175] [DEBUG] [LOCAL ] PERF: Loaded 14504 existing records from primary storage. [2025-10-10T22:42:15.661510] [INFO ] [MAIN ] PERF: Loaded 14504 primary data records. [2025-10-10T22:42:15.983439] [DEBUG] [LOCAL ] PDT: Derivative data saved (1820 records). [2025-10-10T22:42:15.989782] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-10T22:42:16.008514] [INFO ] [MAIN ] Derivative Progress: 1287/1823 symbols completed. PDT took 1.1s. Estimated remaining: 3m 24s. Rate: 157.4 symbols/min [2025-10-10T22:42:16.014296] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:16.237581] [DEBUG] [LOCAL ] PFD: Loaded 5461 existing records from primary storage. [2025-10-10T22:42:16.238449] [INFO ] [MAIN ] PFD: Loaded 5461 primary data records. [2025-10-10T22:42:16.569831] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:16.570896] [INFO ] [MAIN ] PEO: Generated 1820 derivative records from 11325 primary records. [2025-10-10T22:42:16.571550] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-10T22:42:16.606777] [DEBUG] [LOCAL ] PEO: Derivative data saved (1820 records). [2025-10-10T22:42:16.607554] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:16.608705] [INFO ] [MAIN ] PERF: Generated 1820 derivative records from 14504 primary records. [2025-10-10T22:42:16.607636] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-10T22:42:16.608979] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-10T22:42:16.611444] [INFO ] [MAIN ] Derivative Progress: 1288/1823 symbols completed. PEO took 1.1s. Estimated remaining: 3m 24s. Rate: 157.3 symbols/min [2025-10-10T22:42:16.631393] [DEBUG] [LOCAL ] PERF: Derivative data saved (1820 records). [2025-10-10T22:42:16.643893] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-10-10T22:42:16.646278] [INFO ] [MAIN ] Derivative Progress: 1289/1823 symbols completed. PERF took 1.1s. Estimated remaining: 3m 23s. Rate: 157.4 symbols/min [2025-10-10T22:42:16.646597] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:16.647379] [INFO ] [MAIN ] PFD: Generated 1820 derivative records from 5461 primary records. [2025-10-10T22:42:16.647445] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-10T22:42:16.662021] [DEBUG] [LOCAL ] PFD: Derivative data saved (1820 records). [2025-10-10T22:42:16.662105] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-10T22:42:16.664309] [INFO ] [MAIN ] Derivative Progress: 1290/1823 symbols completed. PFD took 0.7s. Estimated remaining: 3m 23s. Rate: 157.6 symbols/min [2025-10-10T22:42:16.664764] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:16.664974] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:16.664833] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:16.683830] [DEBUG] [LOCAL ] PFH: Loaded 6837 existing records from primary storage. [2025-10-10T22:42:16.683966] [INFO ] [MAIN ] PFH: Loaded 6837 primary data records. [2025-10-10T22:42:16.737152] [DEBUG] [LOCAL ] PFL: Loaded 14264 existing records from primary storage. [2025-10-10T22:42:16.757371] [INFO ] [MAIN ] PFL: Loaded 14264 primary data records. [2025-10-10T22:42:16.905750] [DEBUG] [LOCAL ] PFN: Loaded 22464 existing records from primary storage. [2025-10-10T22:42:16.947796] [INFO ] [MAIN ] PFN: Loaded 22464 primary data records. [2025-10-10T22:42:17.641727] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:17.643202] [INFO ] [MAIN ] PFH: Generated 1820 derivative records from 6837 primary records. [2025-10-10T22:42:17.643424] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-10-10T22:42:17.657428] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:17.666686] [INFO ] [MAIN ] PFL: Generated 1820 derivative records from 14264 primary records. [2025-10-10T22:42:17.667142] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-10T22:42:17.692102] [DEBUG] [LOCAL ] PFL: Derivative data saved (1820 records). [2025-10-10T22:42:17.687978] [DEBUG] [LOCAL ] PFH: Derivative data saved (1820 records). [2025-10-10T22:42:17.692367] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-10T22:42:17.692298] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-10-10T22:42:17.694824] [INFO ] [MAIN ] Derivative Progress: 1291/1823 symbols completed. PFL took 1.0s. Estimated remaining: 3m 23s. Rate: 157.4 symbols/min [2025-10-10T22:42:17.697476] [INFO ] [MAIN ] Derivative Progress: 1292/1823 symbols completed. PFH took 1.0s. Estimated remaining: 3m 22s. Rate: 157.5 symbols/min [2025-10-10T22:42:17.695179] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:17.698178] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:17.711884] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:17.714163] [INFO ] [MAIN ] PFN: Generated 1820 derivative records from 22464 primary records. [2025-10-10T22:42:17.714326] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-10T22:42:17.734946] [DEBUG] [LOCAL ] PFO: Loaded 6137 existing records from primary storage. [2025-10-10T22:42:17.727090] [DEBUG] [LOCAL ] PGP: Loaded 5760 existing records from primary storage. [2025-10-10T22:42:17.735754] [INFO ] [MAIN ] PFO: Loaded 6137 primary data records. [2025-10-10T22:42:17.772985] [INFO ] [MAIN ] PGP: Loaded 5760 primary data records. [2025-10-10T22:42:17.872706] [DEBUG] [LOCAL ] PFN: Derivative data saved (1820 records). [2025-10-10T22:42:17.920189] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-10T22:42:17.943761] [INFO ] [MAIN ] Derivative Progress: 1293/1823 symbols completed. PFN took 1.3s. Estimated remaining: 3m 22s. Rate: 157.5 symbols/min [2025-10-10T22:42:17.949258] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:18.400739] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:18.403059] [INFO ] [MAIN ] PFO: Generated 1820 derivative records from 6137 primary records. [2025-10-10T22:42:18.404086] [DEBUG] [LOCAL ] PGRE: Loaded 47465 existing records from primary storage. [2025-10-10T22:42:18.403365] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-10T22:42:18.404381] [INFO ] [MAIN ] PGRE: Loaded 47465 primary data records. [2025-10-10T22:42:18.440226] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:18.469501] [INFO ] [MAIN ] PGP: Generated 1820 derivative records from 5760 primary records. [2025-10-10T22:42:18.511562] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-10T22:42:18.555979] [DEBUG] [LOCAL ] PGP: Derivative data saved (1820 records). [2025-10-10T22:42:18.556546] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-10T22:42:18.576757] [INFO ] [MAIN ] Derivative Progress: 1294/1823 symbols completed. PGP took 0.9s. Estimated remaining: 3m 22s. Rate: 157.4 symbols/min [2025-10-10T22:42:18.595530] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:18.595743] [DEBUG] [LOCAL ] PFO: Derivative data saved (1820 records). [2025-10-10T22:42:18.613361] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-10T22:42:18.616483] [INFO ] [MAIN ] Derivative Progress: 1295/1823 symbols completed. PFO took 0.9s. Estimated remaining: 3m 21s. Rate: 157.5 symbols/min [2025-10-10T22:42:18.631485] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:18.758380] [DEBUG] [LOCAL ] PGZ: Loaded 5545 existing records from primary storage. [2025-10-10T22:42:18.758588] [INFO ] [MAIN ] PGZ: Loaded 5545 primary data records. [2025-10-10T22:42:18.842877] [DEBUG] [LOCAL ] PHD: Loaded 11252 existing records from primary storage. [2025-10-10T22:42:18.856277] [INFO ] [MAIN ] PHD: Loaded 11252 primary data records. [2025-10-10T22:42:19.384563] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:19.386212] [INFO ] [MAIN ] PGRE: Generated 1820 derivative records from 47465 primary records. [2025-10-10T22:42:19.386757] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-10T22:42:19.409169] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1820 records). [2025-10-10T22:42:19.410317] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-10-10T22:42:19.412990] [INFO ] [MAIN ] Derivative Progress: 1296/1823 symbols completed. PGRE took 1.5s. Estimated remaining: 3m 21s. Rate: 157.4 symbols/min [2025-10-10T22:42:19.413323] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:19.427941] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:19.430498] [INFO ] [MAIN ] PGZ: Generated 1820 derivative records from 5545 primary records. [2025-10-10T22:42:19.430724] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-10T22:42:19.456424] [DEBUG] [MAIN ] PHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:19.463322] [INFO ] [MAIN ] PHD: Generated 1820 derivative records from 11252 primary records. [2025-10-10T22:42:19.470015] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-10-10T22:42:19.470779] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1820 records). [2025-10-10T22:42:19.471609] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-10T22:42:19.474609] [INFO ] [MAIN ] Derivative Progress: 1297/1823 symbols completed. PGZ took 0.9s. Estimated remaining: 3m 20s. Rate: 157.5 symbols/min [2025-10-10T22:42:19.471985] [DEBUG] [LOCAL ] PHI: Loaded 15249 existing records from primary storage. [2025-10-10T22:42:19.481531] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:19.482981] [INFO ] [MAIN ] PHI: Loaded 15249 primary data records. [2025-10-10T22:42:19.534324] [DEBUG] [LOCAL ] PHD: Derivative data saved (1820 records). [2025-10-10T22:42:19.547367] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-10-10T22:42:19.564149] [INFO ] [MAIN ] Derivative Progress: 1298/1823 symbols completed. PHD took 0.9s. Estimated remaining: 3m 20s. Rate: 157.6 symbols/min [2025-10-10T22:42:19.570933] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:19.691973] [DEBUG] [LOCAL ] PHK: Loaded 27005 existing records from primary storage. [2025-10-10T22:42:19.701173] [INFO ] [MAIN ] PHK: Loaded 27005 primary data records. [2025-10-10T22:42:19.701058] [DEBUG] [LOCAL ] PIM: Loaded 4859 existing records from primary storage. [2025-10-10T22:42:19.701578] [INFO ] [MAIN ] PIM: Loaded 4859 primary data records. [2025-10-10T22:42:20.454719] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:20.455672] [INFO ] [MAIN ] PHI: Generated 1820 derivative records from 15249 primary records. [2025-10-10T22:42:20.456507] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-10-10T22:42:20.478041] [DEBUG] [LOCAL ] PHI: Derivative data saved (1820 records). [2025-10-10T22:42:20.478185] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-10-10T22:42:20.481407] [INFO ] [MAIN ] Derivative Progress: 1299/1823 symbols completed. PHI took 1.1s. Estimated remaining: 3m 20s. Rate: 157.4 symbols/min [2025-10-10T22:42:20.482323] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:20.497000] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:20.497747] [INFO ] [MAIN ] PIM: Generated 1820 derivative records from 4859 primary records. [2025-10-10T22:42:20.497897] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-10T22:42:20.530769] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:20.532030] [INFO ] [MAIN ] PHK: Generated 1820 derivative records from 27005 primary records. [2025-10-10T22:42:20.532687] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-10T22:42:20.532592] [DEBUG] [LOCAL ] PIM: Derivative data saved (1820 records). [2025-10-10T22:42:20.533406] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-10T22:42:20.547262] [INFO ] [MAIN ] Derivative Progress: 1300/1823 symbols completed. PIM took 1.0s. Estimated remaining: 3m 19s. Rate: 157.5 symbols/min [2025-10-10T22:42:20.538426] [DEBUG] [LOCAL ] PINE: Loaded 14423 existing records from primary storage. [2025-10-10T22:42:20.547400] [INFO ] [MAIN ] PINE: Loaded 14423 primary data records. [2025-10-10T22:42:20.568293] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:20.688404] [DEBUG] [LOCAL ] PHK: Derivative data saved (1820 records). [2025-10-10T22:42:20.709534] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-10T22:42:20.714156] [INFO ] [MAIN ] Derivative Progress: 1301/1823 symbols completed. PHK took 1.2s. Estimated remaining: 3m 19s. Rate: 157.6 symbols/min [2025-10-10T22:42:20.735489] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:20.859006] [DEBUG] [LOCAL ] PKE: Loaded 13854 existing records from primary storage. [2025-10-10T22:42:20.859160] [INFO ] [MAIN ] PKE: Loaded 13854 primary data records. [2025-10-10T22:42:21.048058] [DEBUG] [LOCAL ] PML: Loaded 21832 existing records from primary storage. [2025-10-10T22:42:21.152679] [INFO ] [MAIN ] PML: Loaded 21832 primary data records. [2025-10-10T22:42:21.338428] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:21.358530] [INFO ] [MAIN ] PINE: Generated 1820 derivative records from 14423 primary records. [2025-10-10T22:42:21.485783] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-10T22:42:21.520489] [DEBUG] [LOCAL ] PINE: Derivative data saved (1820 records). [2025-10-10T22:42:21.521060] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-10-10T22:42:21.536722] [INFO ] [MAIN ] Derivative Progress: 1302/1823 symbols completed. PINE took 1.1s. Estimated remaining: 3m 19s. Rate: 157.5 symbols/min [2025-10-10T22:42:21.537851] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:21.541161] [INFO ] [MAIN ] PKE: Generated 1820 derivative records from 13854 primary records. [2025-10-10T22:42:21.539788] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:21.541537] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-10T22:42:21.570473] [DEBUG] [LOCAL ] PKE: Derivative data saved (1820 records). [2025-10-10T22:42:21.577367] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-10-10T22:42:21.577718] [DEBUG] [LOCAL ] PMM: Loaded 10748 existing records from primary storage. [2025-10-10T22:42:21.580571] [INFO ] [MAIN ] Derivative Progress: 1303/1823 symbols completed. PKE took 1.0s. Estimated remaining: 3m 18s. Rate: 157.6 symbols/min [2025-10-10T22:42:21.580723] [INFO ] [MAIN ] PMM: Loaded 10748 primary data records. [2025-10-10T22:42:21.676182] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:21.697082] [INFO ] [MAIN ] PML: Generated 1820 derivative records from 21832 primary records. [2025-10-10T22:42:21.700171] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-10T22:42:21.948786] [DEBUG] [LOCAL ] PML: Derivative data saved (1820 records). [2025-10-10T22:42:21.948919] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-10T22:42:21.951222] [INFO ] [MAIN ] Derivative Progress: 1304/1823 symbols completed. PML took 1.2s. Estimated remaining: 3m 18s. Rate: 157.6 symbols/min [2025-10-10T22:42:21.973204] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:21.973841] [INFO ] [MAIN ] PMM: Generated 1820 derivative records from 10748 primary records. [2025-10-10T22:42:21.973905] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-10T22:42:21.988354] [DEBUG] [LOCAL ] PMM: Derivative data saved (1820 records). [2025-10-10T22:42:21.988417] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-10T22:42:21.991012] [INFO ] [MAIN ] Derivative Progress: 1305/1823 symbols completed. PMM took 0.5s. Estimated remaining: 3m 17s. Rate: 157.7 symbols/min [2025-10-10T22:42:21.991470] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:21.991413] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:21.991626] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:22.002911] [DEBUG] [LOCAL ] PNI: Loaded 6871 existing records from primary storage. [2025-10-10T22:42:22.003132] [INFO ] [MAIN ] PNI: Loaded 6871 primary data records. [2025-10-10T22:42:22.120508] [DEBUG] [LOCAL ] PMO: Loaded 10158 existing records from primary storage. [2025-10-10T22:42:22.121070] [INFO ] [MAIN ] PMO: Loaded 10158 primary data records. [2025-10-10T22:42:22.213231] [DEBUG] [LOCAL ] PNNT: Loaded 33721 existing records from primary storage. [2025-10-10T22:42:22.272743] [INFO ] [MAIN ] PNNT: Loaded 33721 primary data records. [2025-10-10T22:42:22.952457] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:22.953463] [INFO ] [MAIN ] PNI: Generated 1820 derivative records from 6871 primary records. [2025-10-10T22:42:22.953874] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-10T22:42:22.984460] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:22.986582] [DEBUG] [LOCAL ] PNI: Derivative data saved (1820 records). [2025-10-10T22:42:22.985739] [INFO ] [MAIN ] PMO: Generated 1820 derivative records from 10158 primary records. [2025-10-10T22:42:22.988195] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-10T22:42:22.988247] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-10T22:42:22.990600] [INFO ] [MAIN ] Derivative Progress: 1306/1823 symbols completed. PNI took 1.0s. Estimated remaining: 3m 17s. Rate: 157.5 symbols/min [2025-10-10T22:42:22.991709] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:23.016822] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:23.019879] [INFO ] [MAIN ] PNNT: Generated 1820 derivative records from 33721 primary records. [2025-10-10T22:42:23.020191] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-10T22:42:23.028692] [DEBUG] [LOCAL ] PMO: Derivative data saved (1820 records). [2025-10-10T22:42:23.032130] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-10T22:42:23.034780] [INFO ] [MAIN ] Derivative Progress: 1307/1823 symbols completed. PMO took 1.0s. Estimated remaining: 3m 16s. Rate: 157.6 symbols/min [2025-10-10T22:42:23.040781] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:23.050031] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1820 records). [2025-10-10T22:42:23.050219] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-10-10T22:42:23.053693] [INFO ] [MAIN ] Derivative Progress: 1308/1823 symbols completed. PNNT took 1.1s. Estimated remaining: 3m 16s. Rate: 157.7 symbols/min [2025-10-10T22:42:23.053862] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:23.054470] [DEBUG] [LOCAL ] PPT: Loaded 20141 existing records from primary storage. [2025-10-10T22:42:23.054837] [INFO ] [MAIN ] PPT: Loaded 20141 primary data records. [2025-10-10T22:42:23.068179] [DEBUG] [LOCAL ] PRCS: Loaded 2790 existing records from primary storage. [2025-10-10T22:42:23.077840] [INFO ] [MAIN ] PRCS: Loaded 2790 primary data records. [2025-10-10T22:42:23.263381] [DEBUG] [LOCAL ] PRH: Loaded 4848 existing records from primary storage. [2025-10-10T22:42:23.305491] [INFO ] [MAIN ] PRH: Loaded 4848 primary data records. [2025-10-10T22:42:24.047256] [DEBUG] [MAIN ] PRCS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:42:24.047018] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:24.048190] [INFO ] [MAIN ] PPT: Generated 1820 derivative records from 20141 primary records. [2025-10-10T22:42:24.049038] [INFO ] [MAIN ] PRCS: Generated 1819 derivative records from 2790 primary records. [2025-10-10T22:42:24.049158] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-10T22:42:24.049229] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-10T22:42:24.079811] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1819 records). [2025-10-10T22:42:24.080876] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-10T22:42:24.083341] [INFO ] [MAIN ] Derivative Progress: 1309/1823 symbols completed. PRCS took 1.0s. Estimated remaining: 3m 16s. Rate: 157.5 symbols/min [2025-10-10T22:42:24.091196] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:24.096727] [DEBUG] [LOCAL ] PPT: Derivative data saved (1820 records). [2025-10-10T22:42:24.096968] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-10T22:42:24.097249] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:24.098229] [INFO ] [MAIN ] PRH: Generated 1820 derivative records from 4848 primary records. [2025-10-10T22:42:24.100809] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-10T22:42:24.100484] [INFO ] [MAIN ] Derivative Progress: 1310/1823 symbols completed. PPT took 1.1s. Estimated remaining: 3m 15s. Rate: 157.6 symbols/min [2025-10-10T22:42:24.101791] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:24.119833] [DEBUG] [LOCAL ] PRH: Derivative data saved (1820 records). [2025-10-10T22:42:24.120157] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-10-10T22:42:24.122373] [INFO ] [MAIN ] Derivative Progress: 1311/1823 symbols completed. PRH took 1.1s. Estimated remaining: 3m 15s. Rate: 157.7 symbols/min [2025-10-10T22:42:24.122584] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:24.125985] [DEBUG] [LOCAL ] PRT: Loaded 5280 existing records from primary storage. [2025-10-10T22:42:24.129425] [INFO ] [MAIN ] PRT: Loaded 5280 primary data records. [2025-10-10T22:42:24.140929] [DEBUG] [LOCAL ] PSBD: Loaded 7654 existing records from primary storage. [2025-10-10T22:42:24.172612] [INFO ] [MAIN ] PSBD: Loaded 7654 primary data records. [2025-10-10T22:42:24.324482] [DEBUG] [LOCAL ] PSF: Loaded 7034 existing records from primary storage. [2025-10-10T22:42:24.340300] [INFO ] [MAIN ] PSF: Loaded 7034 primary data records. [2025-10-10T22:42:25.090913] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:25.096936] [INFO ] [MAIN ] PRT: Generated 1820 derivative records from 5280 primary records. [2025-10-10T22:42:25.097264] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:25.097497] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-10-10T22:42:25.099363] [INFO ] [MAIN ] PSBD: Generated 1820 derivative records from 7654 primary records. [2025-10-10T22:42:25.100336] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-10T22:42:25.117244] [DEBUG] [LOCAL ] PRT: Derivative data saved (1820 records). [2025-10-10T22:42:25.124315] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-10-10T22:42:25.130937] [INFO ] [MAIN ] Derivative Progress: 1312/1823 symbols completed. PRT took 1.0s. Estimated remaining: 3m 15s. Rate: 157.5 symbols/min [2025-10-10T22:42:25.140399] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:25.147715] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:25.149516] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1820 records). [2025-10-10T22:42:25.149728] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-10-10T22:42:25.150543] [INFO ] [MAIN ] PSF: Generated 1820 derivative records from 7034 primary records. [2025-10-10T22:42:25.153202] [INFO ] [MAIN ] Derivative Progress: 1313/1823 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 14s. Rate: 157.6 symbols/min [2025-10-10T22:42:25.153453] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:25.150693] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-10T22:42:25.177616] [DEBUG] [LOCAL ] PVL: Loaded 4749 existing records from primary storage. [2025-10-10T22:42:25.178243] [INFO ] [MAIN ] PVL: Loaded 4749 primary data records. [2025-10-10T22:42:25.217999] [DEBUG] [LOCAL ] PSF: Derivative data saved (1820 records). [2025-10-10T22:42:25.241720] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-10T22:42:25.279464] [INFO ] [MAIN ] Derivative Progress: 1314/1823 symbols completed. PSF took 1.2s. Estimated remaining: 3m 14s. Rate: 157.7 symbols/min [2025-10-10T22:42:25.290603] [DEBUG] [LOCAL ] PSQH: Loaded 35671 existing records from primary storage. [2025-10-10T22:42:25.298358] [INFO ] [MAIN ] PSQH: Loaded 35671 primary data records. [2025-10-10T22:42:25.290765] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:25.864854] [DEBUG] [LOCAL ] QD: Loaded 28119 existing records from primary storage. [2025-10-10T22:42:25.865730] [INFO ] [MAIN ] QD: Loaded 28119 primary data records. [2025-10-10T22:42:26.253088] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:26.255732] [INFO ] [MAIN ] PVL: Generated 1820 derivative records from 4749 primary records. [2025-10-10T22:42:26.256129] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-10T22:42:26.282759] [DEBUG] [LOCAL ] PVL: Derivative data saved (1820 records). [2025-10-10T22:42:26.282920] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-10-10T22:42:26.286032] [INFO ] [MAIN ] Derivative Progress: 1315/1823 symbols completed. PVL took 1.1s. Estimated remaining: 3m 13s. Rate: 157.5 symbols/min [2025-10-10T22:42:26.286629] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:26.309220] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:26.310308] [INFO ] [MAIN ] PSQH: Generated 1820 derivative records from 35671 primary records. [2025-10-10T22:42:26.310538] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-10T22:42:26.345382] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1820 records). [2025-10-10T22:42:26.345803] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-10-10T22:42:26.349694] [INFO ] [MAIN ] Derivative Progress: 1316/1823 symbols completed. PSQH took 1.2s. Estimated remaining: 3m 13s. Rate: 157.6 symbols/min [2025-10-10T22:42:26.350566] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:26.385245] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:26.386157] [DEBUG] [LOCAL ] QUAD: Loaded 23714 existing records from primary storage. [2025-10-10T22:42:26.387130] [INFO ] [MAIN ] QD: Generated 1820 derivative records from 28119 primary records. [2025-10-10T22:42:26.387233] [INFO ] [MAIN ] QUAD: Loaded 23714 primary data records. [2025-10-10T22:42:26.390111] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-10T22:42:26.390367] [DEBUG] [LOCAL ] QVCD: Loaded 4791 existing records from primary storage. [2025-10-10T22:42:26.390572] [INFO ] [MAIN ] QVCD: Loaded 4791 primary data records. [2025-10-10T22:42:26.665952] [DEBUG] [LOCAL ] QD: Derivative data saved (1820 records). [2025-10-10T22:42:26.694020] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-10-10T22:42:26.713272] [INFO ] [MAIN ] Derivative Progress: 1317/1823 symbols completed. QD took 1.4s. Estimated remaining: 3m 13s. Rate: 157.6 symbols/min [2025-10-10T22:42:26.713609] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:26.875713] [DEBUG] [LOCAL ] RBOT: Loaded 6007 existing records from primary storage. [2025-10-10T22:42:26.933481] [INFO ] [MAIN ] RBOT: Loaded 6007 primary data records. [2025-10-10T22:42:27.669727] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:27.671827] [INFO ] [MAIN ] QUAD: Generated 1820 derivative records from 23714 primary records. [2025-10-10T22:42:27.673689] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-10T22:42:27.700162] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:27.701977] [INFO ] [MAIN ] QVCD: Generated 1820 derivative records from 4791 primary records. [2025-10-10T22:42:27.702417] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-10T22:42:27.719239] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1820 records). [2025-10-10T22:42:27.719515] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-10-10T22:42:27.735922] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:27.735286] [INFO ] [MAIN ] Derivative Progress: 1318/1823 symbols completed. QUAD took 1.4s. Estimated remaining: 3m 12s. Rate: 157.4 symbols/min [2025-10-10T22:42:27.738372] [INFO ] [MAIN ] RBOT: Generated 1820 derivative records from 6007 primary records. [2025-10-10T22:42:27.740117] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1820 records). [2025-10-10T22:42:27.740197] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-10-10T22:42:27.742564] [INFO ] [MAIN ] Derivative Progress: 1319/1823 symbols completed. QVCD took 1.4s. Estimated remaining: 3m 12s. Rate: 157.6 symbols/min [2025-10-10T22:42:27.742704] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-10T22:42:27.756844] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1820 records). [2025-10-10T22:42:27.756957] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-10-10T22:42:27.759194] [INFO ] [MAIN ] Derivative Progress: 1320/1823 symbols completed. RBOT took 1.0s. Estimated remaining: 3m 11s. Rate: 157.7 symbols/min [2025-10-10T22:42:27.759747] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:27.759636] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:27.759866] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:27.777076] [DEBUG] [LOCAL ] RCS: Loaded 12263 existing records from primary storage. [2025-10-10T22:42:27.777393] [INFO ] [MAIN ] RCS: Loaded 12263 primary data records. [2025-10-10T22:42:28.093269] [DEBUG] [LOCAL ] RERE: Loaded 41850 existing records from primary storage. [2025-10-10T22:42:28.106712] [INFO ] [MAIN ] RERE: Loaded 41850 primary data records. [2025-10-10T22:42:28.164639] [DEBUG] [LOCAL ] RC: Loaded 49637 existing records from primary storage. [2025-10-10T22:42:28.178205] [INFO ] [MAIN ] RC: Loaded 49637 primary data records. [2025-10-10T22:42:28.729312] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:28.731010] [INFO ] [MAIN ] RCS: Generated 1820 derivative records from 12263 primary records. [2025-10-10T22:42:28.731278] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-10T22:42:28.747313] [DEBUG] [LOCAL ] RCS: Derivative data saved (1820 records). [2025-10-10T22:42:28.747582] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-10T22:42:28.751011] [INFO ] [MAIN ] Derivative Progress: 1321/1823 symbols completed. RCS took 1.0s. Estimated remaining: 3m 11s. Rate: 157.5 symbols/min [2025-10-10T22:42:28.751266] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:28.766935] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:28.769367] [INFO ] [MAIN ] RERE: Generated 1820 derivative records from 41850 primary records. [2025-10-10T22:42:28.770225] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-10T22:42:28.791622] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:28.794884] [INFO ] [MAIN ] RC: Generated 1820 derivative records from 49637 primary records. [2025-10-10T22:42:28.795040] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-10-10T22:42:28.813281] [DEBUG] [LOCAL ] RERE: Derivative data saved (1820 records). [2025-10-10T22:42:28.813879] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-10-10T22:42:28.815985] [INFO ] [MAIN ] Derivative Progress: 1322/1823 symbols completed. RERE took 1.1s. Estimated remaining: 3m 11s. Rate: 157.6 symbols/min [2025-10-10T22:42:28.816385] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:28.818590] [DEBUG] [LOCAL ] RC: Derivative data saved (1820 records). [2025-10-10T22:42:28.818711] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-10-10T22:42:28.820726] [INFO ] [MAIN ] Derivative Progress: 1323/1823 symbols completed. RC took 1.1s. Estimated remaining: 3m 10s. Rate: 157.7 symbols/min [2025-10-10T22:42:28.820958] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:28.841084] [DEBUG] [LOCAL ] RFI: Loaded 10606 existing records from primary storage. [2025-10-10T22:42:28.843858] [INFO ] [MAIN ] RFI: Loaded 10606 primary data records. [2025-10-10T22:42:28.959722] [DEBUG] [LOCAL ] RES: Loaded 47720 existing records from primary storage. [2025-10-10T22:42:28.951367] [DEBUG] [LOCAL ] RFL: Loaded 11446 existing records from primary storage. [2025-10-10T22:42:28.963254] [INFO ] [MAIN ] RES: Loaded 47720 primary data records. [2025-10-10T22:42:28.963309] [INFO ] [MAIN ] RFL: Loaded 11446 primary data records. [2025-10-10T22:42:29.823320] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:29.824555] [INFO ] [MAIN ] RFI: Generated 1820 derivative records from 10606 primary records. [2025-10-10T22:42:29.827702] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-10T22:42:29.850687] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:29.857835] [INFO ] [MAIN ] RFL: Generated 1820 derivative records from 11446 primary records. [2025-10-10T22:42:29.858255] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-10T22:42:29.884710] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:29.885875] [INFO ] [MAIN ] RES: Generated 1820 derivative records from 47720 primary records. [2025-10-10T22:42:29.887330] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-10-10T22:42:29.888107] [DEBUG] [LOCAL ] RFI: Derivative data saved (1820 records). [2025-10-10T22:42:29.890166] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-10T22:42:29.899433] [INFO ] [MAIN ] Derivative Progress: 1324/1823 symbols completed. RFI took 1.1s. Estimated remaining: 3m 10s. Rate: 157.5 symbols/min [2025-10-10T22:42:29.903957] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:29.905625] [DEBUG] [LOCAL ] RFL: Derivative data saved (1820 records). [2025-10-10T22:42:29.910496] [DEBUG] [LOCAL ] RES: Derivative data saved (1820 records). [2025-10-10T22:42:29.910717] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-10-10T22:42:29.910785] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-10-10T22:42:29.912895] [INFO ] [MAIN ] Derivative Progress: 1325/1823 symbols completed. RES took 1.2s. Estimated remaining: 3m 10s. Rate: 157.6 symbols/min [2025-10-10T22:42:29.915229] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:29.915282] [INFO ] [MAIN ] Derivative Progress: 1326/1823 symbols completed. RFL took 1.1s. Estimated remaining: 3m 9s. Rate: 157.7 symbols/min [2025-10-10T22:42:29.915815] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:29.921072] [DEBUG] [LOCAL ] RFM: Loaded 4203 existing records from primary storage. [2025-10-10T22:42:29.921318] [INFO ] [MAIN ] RFM: Loaded 4203 primary data records. [2025-10-10T22:42:30.017172] [DEBUG] [LOCAL ] RGT: Loaded 2744 existing records from primary storage. [2025-10-10T22:42:30.033623] [DEBUG] [LOCAL ] RFMZ: Loaded 8849 existing records from primary storage. [2025-10-10T22:42:30.033371] [INFO ] [MAIN ] RGT: Loaded 2744 primary data records. [2025-10-10T22:42:30.053690] [INFO ] [MAIN ] RFMZ: Loaded 8849 primary data records. [2025-10-10T22:42:30.856623] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:30.858535] [INFO ] [MAIN ] RFM: Generated 1820 derivative records from 4203 primary records. [2025-10-10T22:42:30.858871] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-10T22:42:30.872430] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:30.880679] [INFO ] [MAIN ] RGT: Generated 1820 derivative records from 2744 primary records. [2025-10-10T22:42:30.886146] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-10T22:42:30.909064] [DEBUG] [LOCAL ] RFM: Derivative data saved (1820 records). [2025-10-10T22:42:30.910927] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-10-10T22:42:30.909501] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:30.915859] [INFO ] [MAIN ] Derivative Progress: 1327/1823 symbols completed. RFM took 1.0s. Estimated remaining: 3m 9s. Rate: 157.5 symbols/min [2025-10-10T22:42:30.916843] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:30.920145] [INFO ] [MAIN ] RFMZ: Generated 1820 derivative records from 8849 primary records. [2025-10-10T22:42:30.920917] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-10T22:42:30.922392] [DEBUG] [LOCAL ] RGT: Derivative data saved (1820 records). [2025-10-10T22:42:30.922630] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-10T22:42:30.931926] [INFO ] [MAIN ] Derivative Progress: 1328/1823 symbols completed. RGT took 1.0s. Estimated remaining: 3m 8s. Rate: 157.6 symbols/min [2025-10-10T22:42:30.935916] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:30.940038] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1820 records). [2025-10-10T22:42:30.940144] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-10-10T22:42:30.942315] [INFO ] [MAIN ] Derivative Progress: 1329/1823 symbols completed. RFMZ took 1.0s. Estimated remaining: 3m 8s. Rate: 157.7 symbols/min [2025-10-10T22:42:30.942802] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:30.963573] [DEBUG] [LOCAL ] RLTY: Loaded 11311 existing records from primary storage. [2025-10-10T22:42:30.964070] [INFO ] [MAIN ] RLTY: Loaded 11311 primary data records. [2025-10-10T22:42:31.158453] [DEBUG] [LOCAL ] RIG: Loaded 54450 existing records from primary storage. [2025-10-10T22:42:31.189742] [INFO ] [MAIN ] RIG: Loaded 54450 primary data records. [2025-10-10T22:42:31.369421] [DEBUG] [LOCAL ] RLX: Loaded 48848 existing records from primary storage. [2025-10-10T22:42:31.407314] [INFO ] [MAIN ] RLX: Loaded 48848 primary data records. [2025-10-10T22:42:31.991929] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:31.992780] [INFO ] [MAIN ] RLTY: Generated 1820 derivative records from 11311 primary records. [2025-10-10T22:42:31.993372] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-10T22:42:32.011010] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1820 records). [2025-10-10T22:42:32.011463] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-10-10T22:42:32.013676] [INFO ] [MAIN ] Derivative Progress: 1330/1823 symbols completed. RLTY took 1.1s. Estimated remaining: 3m 8s. Rate: 157.5 symbols/min [2025-10-10T22:42:32.013934] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:32.034731] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:32.036554] [INFO ] [MAIN ] RIG: Generated 1820 derivative records from 54450 primary records. [2025-10-10T22:42:32.036750] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-10T22:42:32.053724] [DEBUG] [LOCAL ] RM: Loaded 7610 existing records from primary storage. [2025-10-10T22:42:32.053159] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:32.054839] [INFO ] [MAIN ] RM: Loaded 7610 primary data records. [2025-10-10T22:42:32.054771] [INFO ] [MAIN ] RLX: Generated 1820 derivative records from 48848 primary records. [2025-10-10T22:42:32.096720] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-10T22:42:32.191229] [DEBUG] [LOCAL ] RLX: Derivative data saved (1820 records). [2025-10-10T22:42:32.191502] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-10-10T22:42:32.204045] [INFO ] [MAIN ] Derivative Progress: 1331/1823 symbols completed. RLX took 1.3s. Estimated remaining: 3m 7s. Rate: 157.6 symbols/min [2025-10-10T22:42:32.209357] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:32.191329] [DEBUG] [LOCAL ] RIG: Derivative data saved (1820 records). [2025-10-10T22:42:32.220041] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-10-10T22:42:32.252473] [INFO ] [MAIN ] Derivative Progress: 1332/1823 symbols completed. RIG took 1.3s. Estimated remaining: 3m 7s. Rate: 157.7 symbols/min [2025-10-10T22:42:32.273151] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:32.393106] [DEBUG] [LOCAL ] RMMZ: Loaded 4879 existing records from primary storage. [2025-10-10T22:42:32.393275] [INFO ] [MAIN ] RMMZ: Loaded 4879 primary data records. [2025-10-10T22:42:32.512424] [DEBUG] [LOCAL ] RMT: Loaded 17653 existing records from primary storage. [2025-10-10T22:42:32.512585] [INFO ] [MAIN ] RMT: Loaded 17653 primary data records. [2025-10-10T22:42:33.044581] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:33.047889] [INFO ] [MAIN ] RM: Generated 1820 derivative records from 7610 primary records. [2025-10-10T22:42:33.048075] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-10T22:42:33.069234] [DEBUG] [LOCAL ] RM: Derivative data saved (1820 records). [2025-10-10T22:42:33.069442] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-10-10T22:42:33.072474] [INFO ] [MAIN ] Derivative Progress: 1333/1823 symbols completed. RM took 1.1s. Estimated remaining: 3m 7s. Rate: 157.6 symbols/min [2025-10-10T22:42:33.101978] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:33.104374] [INFO ] [MAIN ] RMMZ: Generated 1820 derivative records from 4879 primary records. [2025-10-10T22:42:33.105166] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-10-10T22:42:33.120277] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:33.134717] [INFO ] [MAIN ] RMT: Generated 1820 derivative records from 17653 primary records. [2025-10-10T22:42:33.135827] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-10T22:42:33.158065] [DEBUG] [LOCAL ] RMT: Derivative data saved (1820 records). [2025-10-10T22:42:33.158161] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-10T22:42:33.161830] [INFO ] [MAIN ] Derivative Progress: 1334/1823 symbols completed. RMT took 0.9s. Estimated remaining: 3m 6s. Rate: 157.6 symbols/min [2025-10-10T22:42:33.161957] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1820 records). [2025-10-10T22:42:33.162491] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-10-10T22:42:33.166979] [INFO ] [MAIN ] Derivative Progress: 1335/1823 symbols completed. RMMZ took 1.0s. Estimated remaining: 3m 6s. Rate: 157.8 symbols/min [2025-10-10T22:42:33.167844] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:33.167706] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:33.167947] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:33.180600] [DEBUG] [LOCAL ] RSF: Loaded 4383 existing records from primary storage. [2025-10-10T22:42:33.181070] [INFO ] [MAIN ] RSF: Loaded 4383 primary data records. [2025-10-10T22:42:33.283507] [DEBUG] [LOCAL ] RNP: Loaded 16376 existing records from primary storage. [2025-10-10T22:42:33.297035] [INFO ] [MAIN ] RNP: Loaded 16376 primary data records. [2025-10-10T22:42:33.302760] [DEBUG] [LOCAL ] RPT: Loaded 19290 existing records from primary storage. [2025-10-10T22:42:33.308301] [INFO ] [MAIN ] RPT: Loaded 19290 primary data records. [2025-10-10T22:42:34.224770] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:34.230335] [INFO ] [MAIN ] RSF: Generated 1820 derivative records from 4383 primary records. [2025-10-10T22:42:34.230622] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:34.243132] [INFO ] [MAIN ] RPT: Generated 1820 derivative records from 19290 primary records. [2025-10-10T22:42:34.230733] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-10T22:42:34.243893] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-10T22:42:34.244985] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:34.251907] [INFO ] [MAIN ] RNP: Generated 1820 derivative records from 16376 primary records. [2025-10-10T22:42:34.268529] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-10T22:42:34.271228] [DEBUG] [LOCAL ] RPT: Derivative data saved (1820 records). [2025-10-10T22:42:34.271328] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-10-10T22:42:34.281272] [INFO ] [MAIN ] Derivative Progress: 1336/1823 symbols completed. RPT took 1.1s. Estimated remaining: 3m 5s. Rate: 157.5 symbols/min [2025-10-10T22:42:34.281449] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:34.288944] [DEBUG] [LOCAL ] RSF: Derivative data saved (1820 records). [2025-10-10T22:42:34.289189] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-10T22:42:34.292057] [INFO ] [MAIN ] Derivative Progress: 1337/1823 symbols completed. RSF took 1.1s. Estimated remaining: 3m 5s. Rate: 157.6 symbols/min [2025-10-10T22:42:34.292935] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:34.297783] [DEBUG] [LOCAL ] RNP: Derivative data saved (1820 records). [2025-10-10T22:42:34.297937] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-10T22:42:34.300117] [INFO ] [MAIN ] Derivative Progress: 1338/1823 symbols completed. RNP took 1.1s. Estimated remaining: 3m 4s. Rate: 157.8 symbols/min [2025-10-10T22:42:34.300391] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:34.328569] [DEBUG] [LOCAL ] RSKD: Loaded 33861 existing records from primary storage. [2025-10-10T22:42:34.328782] [INFO ] [MAIN ] RSKD: Loaded 33861 primary data records. [2025-10-10T22:42:34.459626] [DEBUG] [LOCAL ] RWT: Loaded 41423 existing records from primary storage. [2025-10-10T22:42:34.469373] [INFO ] [MAIN ] RWT: Loaded 41423 primary data records. [2025-10-10T22:42:34.783563] [DEBUG] [LOCAL ] RXO: Loaded 48815 existing records from primary storage. [2025-10-10T22:42:34.783851] [INFO ] [MAIN ] RXO: Loaded 48815 primary data records. [2025-10-10T22:42:35.435706] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:35.436953] [INFO ] [MAIN ] RSKD: Generated 1820 derivative records from 33861 primary records. [2025-10-10T22:42:35.437741] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-10T22:42:35.458358] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1820 records). [2025-10-10T22:42:35.458667] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-10-10T22:42:35.461327] [INFO ] [MAIN ] Derivative Progress: 1339/1823 symbols completed. RSKD took 1.2s. Estimated remaining: 3m 4s. Rate: 157.5 symbols/min [2025-10-10T22:42:35.461614] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:35.504708] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:35.505130] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:35.506483] [INFO ] [MAIN ] RXO: Generated 1820 derivative records from 48815 primary records. [2025-10-10T22:42:35.508411] [INFO ] [MAIN ] RWT: Generated 1820 derivative records from 41423 primary records. [2025-10-10T22:42:35.508199] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-10-10T22:42:35.509162] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-10T22:42:35.541478] [DEBUG] [LOCAL ] RXO: Derivative data saved (1820 records). [2025-10-10T22:42:35.544755] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-10-10T22:42:35.548770] [INFO ] [MAIN ] Derivative Progress: 1340/1823 symbols completed. RXO took 1.2s. Estimated remaining: 3m 4s. Rate: 157.6 symbols/min [2025-10-10T22:42:35.561128] [DEBUG] [LOCAL ] RWT: Derivative data saved (1820 records). [2025-10-10T22:42:35.561854] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-10-10T22:42:35.564116] [INFO ] [MAIN ] Derivative Progress: 1341/1823 symbols completed. RWT took 1.3s. Estimated remaining: 3m 3s. Rate: 157.7 symbols/min [2025-10-10T22:42:35.561728] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:35.564382] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:35.595620] [DEBUG] [LOCAL ] RY: Loaded 48560 existing records from primary storage. [2025-10-10T22:42:35.606848] [INFO ] [MAIN ] RY: Loaded 48560 primary data records. [2025-10-10T22:42:35.748628] [DEBUG] [LOCAL ] RYAM: Loaded 35637 existing records from primary storage. [2025-10-10T22:42:35.749048] [INFO ] [MAIN ] RYAM: Loaded 35637 primary data records. [2025-10-10T22:42:35.856050] [DEBUG] [LOCAL ] RYAN: Loaded 45390 existing records from primary storage. [2025-10-10T22:42:35.871221] [INFO ] [MAIN ] RYAN: Loaded 45390 primary data records. [2025-10-10T22:42:36.639867] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:36.641490] [INFO ] [MAIN ] RY: Generated 1820 derivative records from 48560 primary records. [2025-10-10T22:42:36.641690] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-10-10T22:42:36.661424] [DEBUG] [LOCAL ] RY: Derivative data saved (1820 records). [2025-10-10T22:42:36.663275] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-10-10T22:42:36.666587] [INFO ] [MAIN ] Derivative Progress: 1342/1823 symbols completed. RY took 1.2s. Estimated remaining: 3m 3s. Rate: 157.5 symbols/min [2025-10-10T22:42:36.668348] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:36.693907] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:36.695071] [INFO ] [MAIN ] RYAM: Generated 1820 derivative records from 35637 primary records. [2025-10-10T22:42:36.695596] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-10-10T22:42:36.695361] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:36.696805] [INFO ] [MAIN ] RYAN: Generated 1820 derivative records from 45390 primary records. [2025-10-10T22:42:36.703904] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-10-10T22:42:36.737595] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1820 records). [2025-10-10T22:42:36.737977] [DEBUG] [LOCAL ] RYI: Loaded 21850 existing records from primary storage. [2025-10-10T22:42:36.738137] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-10-10T22:42:36.741085] [INFO ] [MAIN ] Derivative Progress: 1343/1823 symbols completed. RYAN took 1.2s. Estimated remaining: 3m 3s. Rate: 157.6 symbols/min [2025-10-10T22:42:36.738723] [INFO ] [MAIN ] RYI: Loaded 21850 primary data records. [2025-10-10T22:42:36.753392] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1820 records). [2025-10-10T22:42:36.741590] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:36.763318] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-10-10T22:42:36.782422] [INFO ] [MAIN ] Derivative Progress: 1344/1823 symbols completed. RYAM took 1.2s. Estimated remaining: 3m 2s. Rate: 157.7 symbols/min [2025-10-10T22:42:36.800722] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:36.924166] [DEBUG] [LOCAL ] RZB: Loaded 6096 existing records from primary storage. [2025-10-10T22:42:36.945757] [INFO ] [MAIN ] RZB: Loaded 6096 primary data records. [2025-10-10T22:42:37.280614] [DEBUG] [LOCAL ] RYN: Loaded 46093 existing records from primary storage. [2025-10-10T22:42:37.365747] [INFO ] [MAIN ] RYN: Loaded 46093 primary data records. [2025-10-10T22:42:37.727759] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:37.728713] [INFO ] [MAIN ] RYI: Generated 1820 derivative records from 21850 primary records. [2025-10-10T22:42:37.728960] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-10T22:42:37.746971] [DEBUG] [LOCAL ] RYI: Derivative data saved (1820 records). [2025-10-10T22:42:37.748331] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-10T22:42:37.751448] [INFO ] [MAIN ] Derivative Progress: 1345/1823 symbols completed. RYI took 1.1s. Estimated remaining: 3m 2s. Rate: 157.5 symbols/min [2025-10-10T22:42:37.752530] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:37.766996] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:37.768780] [INFO ] [MAIN ] RZB: Generated 1820 derivative records from 6096 primary records. [2025-10-10T22:42:37.768985] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-10T22:42:37.787074] [DEBUG] [LOCAL ] RZC: Loaded 6854 existing records from primary storage. [2025-10-10T22:42:37.787742] [INFO ] [MAIN ] RZC: Loaded 6854 primary data records. [2025-10-10T22:42:37.846078] [DEBUG] [LOCAL ] RZB: Derivative data saved (1820 records). [2025-10-10T22:42:37.855073] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-10-10T22:42:37.879340] [INFO ] [MAIN ] Derivative Progress: 1346/1823 symbols completed. RZB took 1.1s. Estimated remaining: 3m 2s. Rate: 157.6 symbols/min [2025-10-10T22:42:37.897869] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:37.969387] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:38.105728] [INFO ] [MAIN ] RYN: Generated 1820 derivative records from 46093 primary records. [2025-10-10T22:42:38.105990] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-10T22:42:38.127436] [DEBUG] [LOCAL ] RYN: Derivative data saved (1820 records). [2025-10-10T22:42:38.127761] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-10T22:42:38.130324] [INFO ] [MAIN ] Derivative Progress: 1347/1823 symbols completed. RYN took 1.4s. Estimated remaining: 3m 1s. Rate: 157.6 symbols/min [2025-10-10T22:42:38.130851] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:38.166036] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:38.166811] [INFO ] [MAIN ] RZC: Generated 1820 derivative records from 6854 primary records. [2025-10-10T22:42:38.166872] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-10T22:42:38.197970] [DEBUG] [LOCAL ] RZC: Derivative data saved (1820 records). [2025-10-10T22:42:38.198305] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-10T22:42:38.200452] [INFO ] [MAIN ] Derivative Progress: 1348/1823 symbols completed. RZC took 0.4s. Estimated remaining: 3m 1s. Rate: 157.7 symbols/min [2025-10-10T22:42:38.201508] [DEBUG] [LOCAL ] S: Loaded 54310 existing records from primary storage. [2025-10-10T22:42:38.201835] [INFO ] [MAIN ] S: Loaded 54310 primary data records. [2025-10-10T22:42:38.363789] [DEBUG] [LOCAL ] SA: Loaded 44639 existing records from primary storage. [2025-10-10T22:42:38.395507] [INFO ] [MAIN ] SA: Loaded 44639 primary data records. [2025-10-10T22:42:38.834631] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:38.836271] [INFO ] [MAIN ] S: Generated 1820 derivative records from 54310 primary records. [2025-10-10T22:42:38.836465] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-10T22:42:38.853432] [DEBUG] [LOCAL ] S: Derivative data saved (1820 records). [2025-10-10T22:42:38.853674] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-10T22:42:38.855667] [INFO ] [MAIN ] Derivative Progress: 1349/1823 symbols completed. S took 1.0s. Estimated remaining: 3m 0s. Rate: 157.6 symbols/min [2025-10-10T22:42:38.871925] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:38.872521] [INFO ] [MAIN ] SA: Generated 1820 derivative records from 44639 primary records. [2025-10-10T22:42:38.872579] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-10T22:42:38.888084] [DEBUG] [LOCAL ] SA: Derivative data saved (1820 records). [2025-10-10T22:42:38.888188] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-10T22:42:38.890039] [INFO ] [MAIN ] Derivative Progress: 1350/1823 symbols completed. SA took 0.8s. Estimated remaining: 2m 60s. Rate: 157.8 symbols/min [2025-10-10T22:42:38.890433] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:38.890553] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:38.890623] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:38.901453] [DEBUG] [LOCAL ] SABA: Loaded 9412 existing records from primary storage. [2025-10-10T22:42:38.901681] [INFO ] [MAIN ] SABA: Loaded 9412 primary data records. [2025-10-10T22:42:39.030269] [DEBUG] [LOCAL ] SAH: Loaded 21834 existing records from primary storage. [2025-10-10T22:42:39.054845] [INFO ] [MAIN ] SAH: Loaded 21834 primary data records. [2025-10-10T22:42:39.102090] [DEBUG] [LOCAL ] SAFE: Loaded 30699 existing records from primary storage. [2025-10-10T22:42:39.155935] [INFO ] [MAIN ] SAFE: Loaded 30699 primary data records. [2025-10-10T22:42:39.953204] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:39.954156] [INFO ] [MAIN ] SABA: Generated 1820 derivative records from 9412 primary records. [2025-10-10T22:42:39.954665] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-10T22:42:39.976099] [DEBUG] [LOCAL ] SABA: Derivative data saved (1820 records). [2025-10-10T22:42:39.976258] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-10T22:42:39.978445] [INFO ] [MAIN ] Derivative Progress: 1351/1823 symbols completed. SABA took 1.1s. Estimated remaining: 2m 60s. Rate: 157.5 symbols/min [2025-10-10T22:42:39.978956] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:39.993778] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:39.995837] [INFO ] [MAIN ] SAH: Generated 1820 derivative records from 21834 primary records. [2025-10-10T22:42:39.996004] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-10T22:42:40.027537] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:40.030834] [INFO ] [MAIN ] SAFE: Generated 1820 derivative records from 30699 primary records. [2025-10-10T22:42:40.032012] [DEBUG] [LOCAL ] SAH: Derivative data saved (1820 records). [2025-10-10T22:42:40.032065] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-10T22:42:40.032620] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-10T22:42:40.049443] [INFO ] [MAIN ] Derivative Progress: 1352/1823 symbols completed. SAH took 1.2s. Estimated remaining: 2m 59s. Rate: 157.6 symbols/min [2025-10-10T22:42:40.055988] [DEBUG] [LOCAL ] SAM: Loaded 21699 existing records from primary storage. [2025-10-10T22:42:40.058264] [INFO ] [MAIN ] SAM: Loaded 21699 primary data records. [2025-10-10T22:42:40.056736] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:40.058427] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1820 records). [2025-10-10T22:42:40.069831] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-10T22:42:40.081247] [INFO ] [MAIN ] Derivative Progress: 1353/1823 symbols completed. SAFE took 1.2s. Estimated remaining: 2m 59s. Rate: 157.7 symbols/min [2025-10-10T22:42:40.081528] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:40.404101] [DEBUG] [LOCAL ] SAN: Loaded 53743 existing records from primary storage. [2025-10-10T22:42:40.405068] [INFO ] [MAIN ] SAN: Loaded 53743 primary data records. [2025-10-10T22:42:40.490336] [DEBUG] [LOCAL ] SAND: Loaded 52596 existing records from primary storage. [2025-10-10T22:42:40.508773] [INFO ] [MAIN ] SAND: Loaded 52596 primary data records. [2025-10-10T22:42:40.622770] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:40.628638] [INFO ] [MAIN ] SAM: Generated 1820 derivative records from 21699 primary records. [2025-10-10T22:42:40.634468] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-10T22:42:41.052628] [DEBUG] [LOCAL ] SAM: Derivative data saved (1820 records). [2025-10-10T22:42:41.053292] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-10T22:42:41.055402] [INFO ] [MAIN ] Derivative Progress: 1354/1823 symbols completed. SAM took 1.1s. Estimated remaining: 2m 59s. Rate: 157.6 symbols/min [2025-10-10T22:42:41.055994] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:41.083948] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:41.086635] [INFO ] [MAIN ] SAN: Generated 1820 derivative records from 53743 primary records. [2025-10-10T22:42:41.087775] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-10T22:42:41.118769] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:41.121246] [DEBUG] [LOCAL ] SAN: Derivative data saved (1820 records). [2025-10-10T22:42:41.122439] [INFO ] [MAIN ] SAND: Generated 1820 derivative records from 52596 primary records. [2025-10-10T22:42:41.122548] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-10T22:42:41.122747] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-10-10T22:42:41.137827] [INFO ] [MAIN ] Derivative Progress: 1355/1823 symbols completed. SAN took 1.1s. Estimated remaining: 2m 58s. Rate: 157.6 symbols/min [2025-10-10T22:42:41.138685] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:41.169140] [DEBUG] [LOCAL ] SAP: Loaded 50626 existing records from primary storage. [2025-10-10T22:42:41.174692] [INFO ] [MAIN ] SAP: Loaded 50626 primary data records. [2025-10-10T22:42:41.197066] [DEBUG] [LOCAL ] SAND: Derivative data saved (1820 records). [2025-10-10T22:42:41.245606] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-10-10T22:42:41.265581] [INFO ] [MAIN ] Derivative Progress: 1356/1823 symbols completed. SAND took 1.2s. Estimated remaining: 2m 58s. Rate: 157.7 symbols/min [2025-10-10T22:42:41.270948] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:41.257573] [DEBUG] [LOCAL ] SAR: Loaded 17332 existing records from primary storage. [2025-10-10T22:42:41.286939] [INFO ] [MAIN ] SAR: Loaded 17332 primary data records. [2025-10-10T22:42:41.853583] [DEBUG] [LOCAL ] SARO: Loaded 49125 existing records from primary storage. [2025-10-10T22:42:41.855691] [INFO ] [MAIN ] SARO: Loaded 49125 primary data records. [2025-10-10T22:42:42.190865] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:42.192198] [INFO ] [MAIN ] SAP: Generated 1820 derivative records from 50626 primary records. [2025-10-10T22:42:42.192298] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-10T22:42:42.217912] [DEBUG] [LOCAL ] SAP: Derivative data saved (1820 records). [2025-10-10T22:42:42.218142] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-10T22:42:42.236705] [INFO ] [MAIN ] Derivative Progress: 1357/1823 symbols completed. SAP took 1.2s. Estimated remaining: 2m 57s. Rate: 157.5 symbols/min [2025-10-10T22:42:42.237487] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:42.240338] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:42.241988] [INFO ] [MAIN ] SAR: Generated 1820 derivative records from 17332 primary records. [2025-10-10T22:42:42.242231] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-10T22:42:42.260542] [DEBUG] [LOCAL ] SAR: Derivative data saved (1820 records). [2025-10-10T22:42:42.260710] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-10T22:42:42.262824] [INFO ] [MAIN ] Derivative Progress: 1358/1823 symbols completed. SAR took 1.1s. Estimated remaining: 2m 57s. Rate: 157.7 symbols/min [2025-10-10T22:42:42.263192] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:42.295907] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:42.297129] [INFO ] [MAIN ] SARO: Generated 1820 derivative records from 49125 primary records. [2025-10-10T22:42:42.297282] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-10T22:42:42.325845] [DEBUG] [LOCAL ] SB: Loaded 33523 existing records from primary storage. [2025-10-10T22:42:42.327011] [INFO ] [MAIN ] SB: Loaded 33523 primary data records. [2025-10-10T22:42:42.473568] [DEBUG] [LOCAL ] SARO: Derivative data saved (1820 records). [2025-10-10T22:42:42.492957] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-10T22:42:42.487472] [DEBUG] [LOCAL ] SBH: Loaded 50548 existing records from primary storage. [2025-10-10T22:42:42.506165] [INFO ] [MAIN ] Derivative Progress: 1359/1823 symbols completed. SARO took 1.2s. Estimated remaining: 2m 57s. Rate: 157.7 symbols/min [2025-10-10T22:42:42.511755] [INFO ] [MAIN ] SBH: Loaded 50548 primary data records. [2025-10-10T22:42:42.512106] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:42.819140] [DEBUG] [LOCAL ] SBI: Loaded 7485 existing records from primary storage. [2025-10-10T22:42:42.830778] [INFO ] [MAIN ] SBI: Loaded 7485 primary data records. [2025-10-10T22:42:43.371141] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:43.371988] [INFO ] [MAIN ] SB: Generated 1820 derivative records from 33523 primary records. [2025-10-10T22:42:43.372435] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-10T22:42:43.411303] [DEBUG] [LOCAL ] SB: Derivative data saved (1820 records). [2025-10-10T22:42:43.411705] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-10T22:42:43.413686] [INFO ] [MAIN ] Derivative Progress: 1360/1823 symbols completed. SB took 1.2s. Estimated remaining: 2m 56s. Rate: 157.5 symbols/min [2025-10-10T22:42:43.414175] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:43.414275] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:43.416688] [INFO ] [MAIN ] SBH: Generated 1820 derivative records from 50548 primary records. [2025-10-10T22:42:43.418358] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-10T22:42:43.450034] [DEBUG] [LOCAL ] SBH: Derivative data saved (1820 records). [2025-10-10T22:42:43.450515] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:43.450177] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-10T22:42:43.451373] [INFO ] [MAIN ] SBI: Generated 1820 derivative records from 7485 primary records. [2025-10-10T22:42:43.456387] [INFO ] [MAIN ] Derivative Progress: 1361/1823 symbols completed. SBH took 1.2s. Estimated remaining: 2m 56s. Rate: 157.6 symbols/min [2025-10-10T22:42:43.456830] [DEBUG] [LOCAL ] SBR: Loaded 7784 existing records from primary storage. [2025-10-10T22:42:43.456470] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-10T22:42:43.457176] [INFO ] [MAIN ] SBR: Loaded 7784 primary data records. [2025-10-10T22:42:43.456953] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:43.596866] [DEBUG] [LOCAL ] SBI: Derivative data saved (1820 records). [2025-10-10T22:42:43.647266] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-10T22:42:43.759951] [INFO ] [MAIN ] Derivative Progress: 1362/1823 symbols completed. SBI took 1.2s. Estimated remaining: 2m 55s. Rate: 157.7 symbols/min [2025-10-10T22:42:43.772971] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:43.802678] [DEBUG] [LOCAL ] SBSI: Loaded 15034 existing records from primary storage. [2025-10-10T22:42:43.817040] [INFO ] [MAIN ] SBSI: Loaded 15034 primary data records. [2025-10-10T22:42:43.851632] [DEBUG] [LOCAL ] SBS: Loaded 50102 existing records from primary storage. [2025-10-10T22:42:43.857091] [INFO ] [MAIN ] SBS: Loaded 50102 primary data records. [2025-10-10T22:42:44.269995] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:44.322885] [INFO ] [MAIN ] SBR: Generated 1820 derivative records from 7784 primary records. [2025-10-10T22:42:44.451099] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-10T22:42:44.473848] [DEBUG] [LOCAL ] SBR: Derivative data saved (1820 records). [2025-10-10T22:42:44.474547] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-10T22:42:44.477284] [INFO ] [MAIN ] Derivative Progress: 1363/1823 symbols completed. SBR took 1.1s. Estimated remaining: 2m 55s. Rate: 157.6 symbols/min [2025-10-10T22:42:44.498350] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:44.500016] [INFO ] [MAIN ] SBSI: Generated 1820 derivative records from 15034 primary records. [2025-10-10T22:42:44.500096] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-10T22:42:44.530939] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1820 records). [2025-10-10T22:42:44.528599] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:44.531133] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-10T22:42:44.534163] [INFO ] [MAIN ] SBS: Generated 1820 derivative records from 50102 primary records. [2025-10-10T22:42:44.534051] [INFO ] [MAIN ] Derivative Progress: 1364/1823 symbols completed. SBSI took 0.8s. Estimated remaining: 2m 55s. Rate: 157.7 symbols/min [2025-10-10T22:42:44.534429] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-10T22:42:44.551184] [DEBUG] [LOCAL ] SBS: Derivative data saved (1820 records). [2025-10-10T22:42:44.551248] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-10T22:42:44.553226] [INFO ] [MAIN ] Derivative Progress: 1365/1823 symbols completed. SBS took 1.1s. Estimated remaining: 2m 54s. Rate: 157.8 symbols/min [2025-10-10T22:42:44.553568] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:44.553621] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:44.553762] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:44.569399] [DEBUG] [LOCAL ] SCD: Loaded 13228 existing records from primary storage. [2025-10-10T22:42:44.569685] [INFO ] [MAIN ] SCD: Loaded 13228 primary data records. [2025-10-10T22:42:44.934498] [DEBUG] [LOCAL ] SCCO: Loaded 50367 existing records from primary storage. [2025-10-10T22:42:44.934921] [INFO ] [MAIN ] SCCO: Loaded 50367 primary data records. [2025-10-10T22:42:44.935895] [DEBUG] [LOCAL ] SBSW: Loaded 53859 existing records from primary storage. [2025-10-10T22:42:44.968070] [INFO ] [MAIN ] SBSW: Loaded 53859 primary data records. [2025-10-10T22:42:45.620070] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:45.622358] [INFO ] [MAIN ] SCD: Generated 1820 derivative records from 13228 primary records. [2025-10-10T22:42:45.622928] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-10T22:42:45.640450] [DEBUG] [LOCAL ] SCD: Derivative data saved (1820 records). [2025-10-10T22:42:45.640907] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-10T22:42:45.643629] [INFO ] [MAIN ] Derivative Progress: 1366/1823 symbols completed. SCD took 1.1s. Estimated remaining: 2m 54s. Rate: 157.6 symbols/min [2025-10-10T22:42:45.644678] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:45.666359] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:45.668767] [INFO ] [MAIN ] SCCO: Generated 1820 derivative records from 50367 primary records. [2025-10-10T22:42:45.668962] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-10T22:42:45.698571] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:45.700574] [INFO ] [MAIN ] SBSW: Generated 1820 derivative records from 53859 primary records. [2025-10-10T22:42:45.701070] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1820 records). [2025-10-10T22:42:45.700720] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-10T22:42:45.701285] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-10T22:42:45.703859] [INFO ] [MAIN ] Derivative Progress: 1367/1823 symbols completed. SCCO took 1.2s. Estimated remaining: 2m 54s. Rate: 157.6 symbols/min [2025-10-10T22:42:45.704036] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:45.733894] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1820 records). [2025-10-10T22:42:45.734023] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-10T22:42:45.736200] [INFO ] [MAIN ] Derivative Progress: 1368/1823 symbols completed. SBSW took 1.2s. Estimated remaining: 2m 53s. Rate: 157.8 symbols/min [2025-10-10T22:42:45.736494] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:45.752853] [DEBUG] [LOCAL ] SCL: Loaded 14996 existing records from primary storage. [2025-10-10T22:42:45.753120] [INFO ] [MAIN ] SCL: Loaded 14996 primary data records. [2025-10-10T22:42:45.865732] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-10-10T22:42:45.879476] [INFO ] [MAIN ] SCHW: Loaded 54465 primary data records. [2025-10-10T22:42:46.117458] [DEBUG] [LOCAL ] SCI: Loaded 47192 existing records from primary storage. [2025-10-10T22:42:46.148700] [INFO ] [MAIN ] SCI: Loaded 47192 primary data records. [2025-10-10T22:42:46.728526] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:46.729768] [INFO ] [MAIN ] SCL: Generated 1820 derivative records from 14996 primary records. [2025-10-10T22:42:46.731166] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-10T22:42:46.761520] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:46.764137] [INFO ] [MAIN ] SCHW: Generated 1820 derivative records from 54465 primary records. [2025-10-10T22:42:46.766192] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-10T22:42:46.769725] [DEBUG] [LOCAL ] SCL: Derivative data saved (1820 records). [2025-10-10T22:42:46.769835] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-10T22:42:46.771694] [INFO ] [MAIN ] Derivative Progress: 1369/1823 symbols completed. SCL took 1.0s. Estimated remaining: 2m 53s. Rate: 157.6 symbols/min [2025-10-10T22:42:46.784805] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:46.806886] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1820 records). [2025-10-10T22:42:46.807198] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:46.807511] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-10T22:42:46.808284] [INFO ] [MAIN ] SCI: Generated 1820 derivative records from 47192 primary records. [2025-10-10T22:42:46.810352] [INFO ] [MAIN ] Derivative Progress: 1370/1823 symbols completed. SCHW took 1.2s. Estimated remaining: 2m 52s. Rate: 157.7 symbols/min [2025-10-10T22:42:46.810539] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-10T22:42:46.810738] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:46.841777] [DEBUG] [LOCAL ] SCI: Derivative data saved (1820 records). [2025-10-10T22:42:46.842212] [DEBUG] [LOCAL ] SCM: Loaded 20313 existing records from primary storage. [2025-10-10T22:42:46.843562] [INFO ] [MAIN ] SCM: Loaded 20313 primary data records. [2025-10-10T22:42:46.844017] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-10T22:42:46.846340] [INFO ] [MAIN ] Derivative Progress: 1371/1823 symbols completed. SCI took 1.1s. Estimated remaining: 2m 52s. Rate: 157.8 symbols/min [2025-10-10T22:42:46.851830] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:47.177686] [DEBUG] [LOCAL ] SCS: Loaded 44139 existing records from primary storage. [2025-10-10T22:42:47.186498] [INFO ] [MAIN ] SCS: Loaded 44139 primary data records. [2025-10-10T22:42:47.187108] [DEBUG] [LOCAL ] SD: Loaded 29127 existing records from primary storage. [2025-10-10T22:42:47.198407] [INFO ] [MAIN ] SD: Loaded 29127 primary data records. [2025-10-10T22:42:47.854077] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:47.855920] [INFO ] [MAIN ] SCM: Generated 1820 derivative records from 20313 primary records. [2025-10-10T22:42:47.856072] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-10T22:42:47.878981] [DEBUG] [LOCAL ] SCM: Derivative data saved (1820 records). [2025-10-10T22:42:47.879291] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-10T22:42:47.881454] [INFO ] [MAIN ] Derivative Progress: 1372/1823 symbols completed. SCM took 1.1s. Estimated remaining: 2m 52s. Rate: 157.6 symbols/min [2025-10-10T22:42:47.881791] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:47.895553] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:47.896710] [INFO ] [MAIN ] SD: Generated 1820 derivative records from 29127 primary records. [2025-10-10T22:42:47.896952] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-10T22:42:47.919275] [DEBUG] [LOCAL ] SD: Derivative data saved (1820 records). [2025-10-10T22:42:47.931100] [DEBUG] [LOCAL ] SDHC: Loaded 10511 existing records from primary storage. [2025-10-10T22:42:47.931291] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-10T22:42:47.931212] [INFO ] [MAIN ] SDHC: Loaded 10511 primary data records. [2025-10-10T22:42:47.949207] [INFO ] [MAIN ] Derivative Progress: 1373/1823 symbols completed. SD took 1.1s. Estimated remaining: 2m 51s. Rate: 157.7 symbols/min [2025-10-10T22:42:47.955202] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:47.979826] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:47.986099] [INFO ] [MAIN ] SCS: Generated 1820 derivative records from 44139 primary records. [2025-10-10T22:42:48.007586] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-10T22:42:48.130250] [DEBUG] [LOCAL ] SDHY: Loaded 11075 existing records from primary storage. [2025-10-10T22:42:48.163009] [INFO ] [MAIN ] SDHY: Loaded 11075 primary data records. [2025-10-10T22:42:48.320218] [DEBUG] [LOCAL ] SCS: Derivative data saved (1820 records). [2025-10-10T22:42:48.327423] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-10T22:42:48.362152] [INFO ] [MAIN ] Derivative Progress: 1374/1823 symbols completed. SCS took 1.6s. Estimated remaining: 2m 51s. Rate: 157.7 symbols/min [2025-10-10T22:42:48.379183] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:48.638741] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:48.640538] [INFO ] [MAIN ] SDHC: Generated 1820 derivative records from 10511 primary records. [2025-10-10T22:42:48.641207] [DEBUG] [LOCAL ] SDRL: Loaded 42101 existing records from primary storage. [2025-10-10T22:42:48.641403] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-10T22:42:48.641685] [INFO ] [MAIN ] SDRL: Loaded 42101 primary data records. [2025-10-10T22:42:48.788430] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1820 records). [2025-10-10T22:42:48.801948] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-10T22:42:48.812773] [INFO ] [MAIN ] Derivative Progress: 1375/1823 symbols completed. SDHC took 0.9s. Estimated remaining: 2m 51s. Rate: 157.6 symbols/min [2025-10-10T22:42:48.853614] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:48.959193] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:48.969125] [INFO ] [MAIN ] SDHY: Generated 1820 derivative records from 11075 primary records. [2025-10-10T22:42:48.969391] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-10T22:42:48.988141] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1820 records). [2025-10-10T22:42:48.989111] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-10T22:42:48.991455] [INFO ] [MAIN ] Derivative Progress: 1376/1823 symbols completed. SDHY took 1.0s. Estimated remaining: 2m 50s. Rate: 157.7 symbols/min [2025-10-10T22:42:48.992300] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:49.014682] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:49.015433] [INFO ] [MAIN ] SDRL: Generated 1820 derivative records from 42101 primary records. [2025-10-10T22:42:49.015672] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-10T22:42:49.046416] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1820 records). [2025-10-10T22:42:49.046551] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-10T22:42:49.048805] [INFO ] [MAIN ] Derivative Progress: 1377/1823 symbols completed. SDRL took 0.7s. Estimated remaining: 2m 50s. Rate: 157.8 symbols/min [2025-10-10T22:42:49.049271] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:49.085383] [DEBUG] [LOCAL ] SE: Loaded 54109 existing records from primary storage. [2025-10-10T22:42:49.085714] [INFO ] [MAIN ] SE: Loaded 54109 primary data records. [2025-10-10T22:42:49.113692] [DEBUG] [LOCAL ] SEG: Loaded 13415 existing records from primary storage. [2025-10-10T22:42:49.156207] [INFO ] [MAIN ] SEG: Loaded 13415 primary data records. [2025-10-10T22:42:49.281155] [DEBUG] [LOCAL ] SEE: Loaded 48909 existing records from primary storage. [2025-10-10T22:42:49.314498] [INFO ] [MAIN ] SEE: Loaded 48909 primary data records. [2025-10-10T22:42:50.074323] [DEBUG] [MAIN ] SE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:50.076064] [INFO ] [MAIN ] SE: Generated 1820 derivative records from 54109 primary records. [2025-10-10T22:42:50.076174] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-10T22:42:50.112547] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:50.114855] [INFO ] [MAIN ] SEG: Generated 1820 derivative records from 13415 primary records. [2025-10-10T22:42:50.114994] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-10T22:42:50.113557] [DEBUG] [LOCAL ] SE: Derivative data saved (1820 records). [2025-10-10T22:42:50.116296] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-10-10T22:42:50.119226] [INFO ] [MAIN ] Derivative Progress: 1378/1823 symbols completed. SE took 1.3s. Estimated remaining: 2m 49s. Rate: 157.6 symbols/min [2025-10-10T22:42:50.152148] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:50.154363] [INFO ] [MAIN ] SEE: Generated 1820 derivative records from 48909 primary records. [2025-10-10T22:42:50.155348] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-10T22:42:50.155894] [DEBUG] [LOCAL ] SEG: Derivative data saved (1820 records). [2025-10-10T22:42:50.156851] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-10T22:42:50.159989] [INFO ] [MAIN ] Derivative Progress: 1379/1823 symbols completed. SEG took 1.1s. Estimated remaining: 2m 49s. Rate: 157.7 symbols/min [2025-10-10T22:42:50.176627] [DEBUG] [LOCAL ] SEE: Derivative data saved (1820 records). [2025-10-10T22:42:50.176987] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-10T22:42:50.179627] [INFO ] [MAIN ] Derivative Progress: 1380/1823 symbols completed. SEE took 1.2s. Estimated remaining: 2m 48s. Rate: 157.8 symbols/min [2025-10-10T22:42:50.180287] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:50.180206] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:50.180126] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:50.249847] [DEBUG] [LOCAL ] SEMR: Loaded 42445 existing records from primary storage. [2025-10-10T22:42:50.250685] [INFO ] [MAIN ] SEMR: Loaded 42445 primary data records. [2025-10-10T22:42:50.315910] [DEBUG] [LOCAL ] SEM: Loaded 43588 existing records from primary storage. [2025-10-10T22:42:50.330439] [INFO ] [MAIN ] SEM: Loaded 43588 primary data records. [2025-10-10T22:42:50.460171] [DEBUG] [LOCAL ] SEI: Loaded 50532 existing records from primary storage. [2025-10-10T22:42:50.488056] [INFO ] [MAIN ] SEI: Loaded 50532 primary data records. [2025-10-10T22:42:51.365208] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:51.364798] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:51.366294] [INFO ] [MAIN ] SEM: Generated 1820 derivative records from 43588 primary records. [2025-10-10T22:42:51.366674] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-10T22:42:51.367497] [INFO ] [MAIN ] SEMR: Generated 1820 derivative records from 42445 primary records. [2025-10-10T22:42:51.367754] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-10T22:42:51.409818] [DEBUG] [LOCAL ] SEM: Derivative data saved (1820 records). [2025-10-10T22:42:51.411062] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1820 records). [2025-10-10T22:42:51.419821] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-10T22:42:51.428223] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:51.427756] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-10T22:42:51.431971] [INFO ] [MAIN ] SEI: Generated 1820 derivative records from 50532 primary records. [2025-10-10T22:42:51.427618] [INFO ] [MAIN ] Derivative Progress: 1381/1823 symbols completed. SEMR took 1.2s. Estimated remaining: 2m 48s. Rate: 157.5 symbols/min [2025-10-10T22:42:51.432217] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:51.432109] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-10T22:42:51.432480] [INFO ] [MAIN ] Derivative Progress: 1382/1823 symbols completed. SEM took 1.3s. Estimated remaining: 2m 48s. Rate: 157.6 symbols/min [2025-10-10T22:42:51.434041] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:51.453447] [DEBUG] [LOCAL ] SEI: Derivative data saved (1820 records). [2025-10-10T22:42:51.453677] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-10T22:42:51.457083] [INFO ] [MAIN ] Derivative Progress: 1383/1823 symbols completed. SEI took 1.3s. Estimated remaining: 2m 47s. Rate: 157.7 symbols/min [2025-10-10T22:42:51.457421] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:51.478431] [DEBUG] [LOCAL ] SFB: Loaded 4239 existing records from primary storage. [2025-10-10T22:42:51.479133] [INFO ] [MAIN ] SFB: Loaded 4239 primary data records. [2025-10-10T22:42:51.597841] [DEBUG] [LOCAL ] SF: Loaded 42272 existing records from primary storage. [2025-10-10T22:42:51.621166] [INFO ] [MAIN ] SF: Loaded 42272 primary data records. [2025-10-10T22:42:51.977162] [DEBUG] [LOCAL ] SES: Loaded 52349 existing records from primary storage. [2025-10-10T22:42:51.989117] [INFO ] [MAIN ] SES: Loaded 52349 primary data records. [2025-10-10T22:42:52.504835] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:52.507012] [INFO ] [MAIN ] SFB: Generated 1820 derivative records from 4239 primary records. [2025-10-10T22:42:52.507221] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-10T22:42:52.529166] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:52.532800] [INFO ] [MAIN ] SF: Generated 1820 derivative records from 42272 primary records. [2025-10-10T22:42:52.533499] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-10T22:42:52.538226] [DEBUG] [LOCAL ] SFB: Derivative data saved (1820 records). [2025-10-10T22:42:52.538695] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-10T22:42:52.548259] [INFO ] [MAIN ] Derivative Progress: 1384/1823 symbols completed. SFB took 1.1s. Estimated remaining: 2m 47s. Rate: 157.5 symbols/min [2025-10-10T22:42:52.549760] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:52.572990] [DEBUG] [LOCAL ] SF: Derivative data saved (1820 records). [2025-10-10T22:42:52.573535] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-10T22:42:52.573459] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:52.575754] [INFO ] [MAIN ] Derivative Progress: 1385/1823 symbols completed. SF took 1.1s. Estimated remaining: 2m 47s. Rate: 157.6 symbols/min [2025-10-10T22:42:52.581694] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:52.576543] [INFO ] [MAIN ] SES: Generated 1820 derivative records from 52349 primary records. [2025-10-10T22:42:52.582213] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-10T22:42:52.612297] [DEBUG] [LOCAL ] SES: Derivative data saved (1820 records). [2025-10-10T22:42:52.613129] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-10T22:42:52.612956] [DEBUG] [LOCAL ] SFBS: Loaded 21351 existing records from primary storage. [2025-10-10T22:42:52.615606] [INFO ] [MAIN ] SFBS: Loaded 21351 primary data records. [2025-10-10T22:42:52.615404] [INFO ] [MAIN ] Derivative Progress: 1386/1823 symbols completed. SES took 1.2s. Estimated remaining: 2m 46s. Rate: 157.7 symbols/min [2025-10-10T22:42:52.627570] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:52.961144] [DEBUG] [LOCAL ] SFL: Loaded 45894 existing records from primary storage. [2025-10-10T22:42:52.961548] [INFO ] [MAIN ] SFL: Loaded 45894 primary data records. [2025-10-10T22:42:53.083087] [DEBUG] [LOCAL ] SG: Loaded 54245 existing records from primary storage. [2025-10-10T22:42:53.083752] [INFO ] [MAIN ] SG: Loaded 54245 primary data records. [2025-10-10T22:42:53.643989] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:53.645232] [INFO ] [MAIN ] SFBS: Generated 1820 derivative records from 21351 primary records. [2025-10-10T22:42:53.645573] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-10T22:42:53.666919] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1820 records). [2025-10-10T22:42:53.668228] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-10T22:42:53.670960] [INFO ] [MAIN ] Derivative Progress: 1387/1823 symbols completed. SFBS took 1.1s. Estimated remaining: 2m 46s. Rate: 157.5 symbols/min [2025-10-10T22:42:53.679046] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:53.685216] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:53.686281] [INFO ] [MAIN ] SFL: Generated 1820 derivative records from 45894 primary records. [2025-10-10T22:42:53.686486] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-10T22:42:53.703408] [DEBUG] [LOCAL ] SFL: Derivative data saved (1820 records). [2025-10-10T22:42:53.705774] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-10T22:42:53.707587] [INFO ] [MAIN ] Derivative Progress: 1388/1823 symbols completed. SFL took 1.1s. Estimated remaining: 2m 46s. Rate: 157.6 symbols/min [2025-10-10T22:42:53.707788] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:53.728994] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:53.729792] [INFO ] [MAIN ] SG: Generated 1820 derivative records from 54245 primary records. [2025-10-10T22:42:53.733375] [DEBUG] [LOCAL ] SGU: Loaded 6661 existing records from primary storage. [2025-10-10T22:42:53.729896] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-10T22:42:53.733465] [INFO ] [MAIN ] SGU: Loaded 6661 primary data records. [2025-10-10T22:42:53.929907] [DEBUG] [LOCAL ] SG: Derivative data saved (1820 records). [2025-10-10T22:42:53.930776] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-10T22:42:53.956467] [INFO ] [MAIN ] Derivative Progress: 1389/1823 symbols completed. SG took 1.3s. Estimated remaining: 2m 45s. Rate: 157.7 symbols/min [2025-10-10T22:42:53.929816] [DEBUG] [LOCAL ] SGHC: Loaded 47289 existing records from primary storage. [2025-10-10T22:42:54.060418] [INFO ] [MAIN ] SGHC: Loaded 47289 primary data records. [2025-10-10T22:42:54.095183] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:54.429283] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:54.431491] [INFO ] [MAIN ] SGU: Generated 1820 derivative records from 6661 primary records. [2025-10-10T22:42:54.445281] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-10T22:42:54.454225] [DEBUG] [LOCAL ] SHAK: Loaded 49551 existing records from primary storage. [2025-10-10T22:42:54.458985] [INFO ] [MAIN ] SHAK: Loaded 49551 primary data records. [2025-10-10T22:42:54.533520] [DEBUG] [LOCAL ] SGU: Derivative data saved (1820 records). [2025-10-10T22:42:54.552947] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-10T22:42:54.560469] [INFO ] [MAIN ] Derivative Progress: 1390/1823 symbols completed. SGU took 0.9s. Estimated remaining: 2m 45s. Rate: 157.6 symbols/min [2025-10-10T22:42:54.560788] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:54.593521] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:54.604907] [INFO ] [MAIN ] SGHC: Generated 1820 derivative records from 47289 primary records. [2025-10-10T22:42:54.621349] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-10T22:42:54.823977] [DEBUG] [LOCAL ] SHCO: Loaded 25780 existing records from primary storage. [2025-10-10T22:42:54.824989] [INFO ] [MAIN ] SHCO: Loaded 25780 primary data records. [2025-10-10T22:42:54.872774] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1820 records). [2025-10-10T22:42:54.886705] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-10T22:42:54.889446] [INFO ] [MAIN ] Derivative Progress: 1391/1823 symbols completed. SGHC took 1.2s. Estimated remaining: 2m 44s. Rate: 157.6 symbols/min [2025-10-10T22:42:54.902887] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:55.167156] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:55.168516] [INFO ] [MAIN ] SHAK: Generated 1820 derivative records from 49551 primary records. [2025-10-10T22:42:55.168890] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-10T22:42:55.204431] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1820 records). [2025-10-10T22:42:55.205589] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-10T22:42:55.208403] [INFO ] [MAIN ] Derivative Progress: 1392/1823 symbols completed. SHAK took 1.1s. Estimated remaining: 2m 44s. Rate: 157.7 symbols/min [2025-10-10T22:42:55.205475] [DEBUG] [LOCAL ] SHEL: Loaded 54452 existing records from primary storage. [2025-10-10T22:42:55.208765] [INFO ] [MAIN ] SHEL: Loaded 54452 primary data records. [2025-10-10T22:42:55.209727] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:55.313994] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:55.325069] [INFO ] [MAIN ] SHCO: Generated 1820 derivative records from 25780 primary records. [2025-10-10T22:42:55.325185] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-10T22:42:55.579978] [DEBUG] [LOCAL ] SHG: Loaded 26806 existing records from primary storage. [2025-10-10T22:42:55.581944] [INFO ] [MAIN ] SHG: Loaded 26806 primary data records. [2025-10-10T22:42:55.582396] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1820 records). [2025-10-10T22:42:55.587930] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-10T22:42:55.606365] [INFO ] [MAIN ] Derivative Progress: 1393/1823 symbols completed. SHCO took 1.0s. Estimated remaining: 2m 44s. Rate: 157.6 symbols/min [2025-10-10T22:42:55.900539] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:55.902590] [INFO ] [MAIN ] SHEL: Generated 1820 derivative records from 54452 primary records. [2025-10-10T22:42:55.903162] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-10T22:42:55.921686] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1820 records). [2025-10-10T22:42:55.922028] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-10T22:42:55.924200] [INFO ] [MAIN ] Derivative Progress: 1394/1823 symbols completed. SHEL took 1.0s. Estimated remaining: 2m 43s. Rate: 157.7 symbols/min [2025-10-10T22:42:55.942148] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:55.942879] [INFO ] [MAIN ] SHG: Generated 1820 derivative records from 26806 primary records. [2025-10-10T22:42:55.942948] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-10T22:42:55.959349] [DEBUG] [LOCAL ] SHG: Derivative data saved (1820 records). [2025-10-10T22:42:55.959498] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-10T22:42:55.961586] [INFO ] [MAIN ] Derivative Progress: 1395/1823 symbols completed. SHG took 0.8s. Estimated remaining: 2m 43s. Rate: 157.8 symbols/min [2025-10-10T22:42:55.962203] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:55.962316] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:55.962620] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:55.968398] [DEBUG] [LOCAL ] SHOC: Loaded 3425 existing records from primary storage. [2025-10-10T22:42:55.968571] [INFO ] [MAIN ] SHOC: Loaded 3425 primary data records. [2025-10-10T22:42:56.329570] [DEBUG] [LOCAL ] SHO: Loaded 50269 existing records from primary storage. [2025-10-10T22:42:56.330952] [INFO ] [MAIN ] SHO: Loaded 50269 primary data records. [2025-10-10T22:42:56.330533] [DEBUG] [LOCAL ] SHW: Loaded 51079 existing records from primary storage. [2025-10-10T22:42:56.351682] [INFO ] [MAIN ] SHW: Loaded 51079 primary data records. [2025-10-10T22:42:56.945586] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:42:56.946797] [INFO ] [MAIN ] SHOC: Generated 1819 derivative records from 3425 primary records. [2025-10-10T22:42:56.947466] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-10T22:42:56.965906] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1819 records). [2025-10-10T22:42:56.966214] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-10T22:42:56.968485] [INFO ] [MAIN ] Derivative Progress: 1396/1823 symbols completed. SHOC took 1.0s. Estimated remaining: 2m 43s. Rate: 157.6 symbols/min [2025-10-10T22:42:56.968851] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:56.990930] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:56.991739] [INFO ] [MAIN ] SHO: Generated 1820 derivative records from 50269 primary records. [2025-10-10T22:42:56.991821] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-10T22:42:57.033895] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:57.036084] [INFO ] [MAIN ] SHW: Generated 1820 derivative records from 51079 primary records. [2025-10-10T22:42:57.036211] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-10T22:42:57.035266] [DEBUG] [LOCAL ] SHO: Derivative data saved (1820 records). [2025-10-10T22:42:57.036817] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-10T22:42:57.039211] [INFO ] [MAIN ] Derivative Progress: 1397/1823 symbols completed. SHO took 1.1s. Estimated remaining: 2m 42s. Rate: 157.7 symbols/min [2025-10-10T22:42:57.046998] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:57.066454] [DEBUG] [LOCAL ] SID: Loaded 43228 existing records from primary storage. [2025-10-10T22:42:57.067851] [INFO ] [MAIN ] SID: Loaded 43228 primary data records. [2025-10-10T22:42:57.089943] [DEBUG] [LOCAL ] SHW: Derivative data saved (1820 records). [2025-10-10T22:42:57.106175] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-10T22:42:57.109136] [INFO ] [MAIN ] Derivative Progress: 1398/1823 symbols completed. SHW took 1.1s. Estimated remaining: 2m 42s. Rate: 157.8 symbols/min [2025-10-10T22:42:57.115068] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:57.415237] [DEBUG] [LOCAL ] SII: Loaded 24196 existing records from primary storage. [2025-10-10T22:42:57.429470] [INFO ] [MAIN ] SII: Loaded 24196 primary data records. [2025-10-10T22:42:57.444505] [DEBUG] [LOCAL ] SIG: Loaded 46469 existing records from primary storage. [2025-10-10T22:42:57.489836] [INFO ] [MAIN ] SIG: Loaded 46469 primary data records. [2025-10-10T22:42:58.055830] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:58.058092] [INFO ] [MAIN ] SID: Generated 1820 derivative records from 43228 primary records. [2025-10-10T22:42:58.058929] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-10T22:42:58.077364] [DEBUG] [LOCAL ] SID: Derivative data saved (1820 records). [2025-10-10T22:42:58.077600] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-10T22:42:58.079772] [INFO ] [MAIN ] Derivative Progress: 1399/1823 symbols completed. SID took 1.1s. Estimated remaining: 2m 41s. Rate: 157.6 symbols/min [2025-10-10T22:42:58.080041] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:58.099390] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:58.100296] [INFO ] [MAIN ] SII: Generated 1820 derivative records from 24196 primary records. [2025-10-10T22:42:58.100525] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-10T22:42:58.116387] [DEBUG] [LOCAL ] SII: Derivative data saved (1820 records). [2025-10-10T22:42:58.116868] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-10T22:42:58.118824] [INFO ] [MAIN ] Derivative Progress: 1400/1823 symbols completed. SII took 1.0s. Estimated remaining: 2m 41s. Rate: 157.7 symbols/min [2025-10-10T22:42:58.118964] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:58.143221] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:58.143978] [INFO ] [MAIN ] SIG: Generated 1820 derivative records from 46469 primary records. [2025-10-10T22:42:58.144117] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-10T22:42:58.167780] [DEBUG] [LOCAL ] SILA: Loaded 31008 existing records from primary storage. [2025-10-10T22:42:58.170000] [DEBUG] [LOCAL ] SIG: Derivative data saved (1820 records). [2025-10-10T22:42:58.169935] [INFO ] [MAIN ] SILA: Loaded 31008 primary data records. [2025-10-10T22:42:58.170117] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-10T22:42:58.172267] [INFO ] [MAIN ] Derivative Progress: 1401/1823 symbols completed. SIG took 1.1s. Estimated remaining: 2m 40s. Rate: 157.8 symbols/min [2025-10-10T22:42:58.172417] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:58.344946] [DEBUG] [LOCAL ] SITC: Loaded 42127 existing records from primary storage. [2025-10-10T22:42:58.372950] [INFO ] [MAIN ] SITC: Loaded 42127 primary data records. [2025-10-10T22:42:58.625444] [DEBUG] [LOCAL ] SITE: Loaded 35824 existing records from primary storage. [2025-10-10T22:42:58.657021] [INFO ] [MAIN ] SITE: Loaded 35824 primary data records. [2025-10-10T22:42:59.161080] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:59.161908] [INFO ] [MAIN ] SILA: Generated 1820 derivative records from 31008 primary records. [2025-10-10T22:42:59.162528] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-10T22:42:59.196417] [DEBUG] [LOCAL ] SILA: Derivative data saved (1820 records). [2025-10-10T22:42:59.194980] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:59.196581] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-10T22:42:59.197348] [INFO ] [MAIN ] SITC: Generated 1820 derivative records from 42127 primary records. [2025-10-10T22:42:59.200409] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-10T22:42:59.199370] [INFO ] [MAIN ] Derivative Progress: 1402/1823 symbols completed. SILA took 1.1s. Estimated remaining: 2m 40s. Rate: 157.6 symbols/min [2025-10-10T22:42:59.200814] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:59.218178] [DEBUG] [LOCAL ] SITC: Derivative data saved (1820 records). [2025-10-10T22:42:59.218468] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-10T22:42:59.220370] [INFO ] [MAIN ] Derivative Progress: 1403/1823 symbols completed. SITC took 1.1s. Estimated remaining: 2m 40s. Rate: 157.7 symbols/min [2025-10-10T22:42:59.220511] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:59.236677] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:42:59.237387] [INFO ] [MAIN ] SITE: Generated 1820 derivative records from 35824 primary records. [2025-10-10T22:42:59.237555] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-10T22:42:59.259014] [DEBUG] [LOCAL ] SITE: Derivative data saved (1820 records). [2025-10-10T22:42:59.259098] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-10T22:42:59.261167] [INFO ] [MAIN ] Derivative Progress: 1404/1823 symbols completed. SITE took 1.1s. Estimated remaining: 2m 39s. Rate: 157.8 symbols/min [2025-10-10T22:42:59.261393] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:42:59.282797] [DEBUG] [LOCAL ] SJT: Loaded 22810 existing records from primary storage. [2025-10-10T22:42:59.283039] [INFO ] [MAIN ] SJT: Loaded 22810 primary data records. [2025-10-10T22:42:59.414274] [DEBUG] [LOCAL ] SJM: Loaded 50766 existing records from primary storage. [2025-10-10T22:42:59.430072] [INFO ] [MAIN ] SJM: Loaded 50766 primary data records. [2025-10-10T22:42:59.700571] [DEBUG] [LOCAL ] SKE: Loaded 37016 existing records from primary storage. [2025-10-10T22:42:59.708957] [INFO ] [MAIN ] SKE: Loaded 37016 primary data records. [2025-10-10T22:43:00.252265] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:00.253127] [INFO ] [MAIN ] SJT: Generated 1820 derivative records from 22810 primary records. [2025-10-10T22:43:00.253410] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-10T22:43:00.271040] [DEBUG] [LOCAL ] SJT: Derivative data saved (1820 records). [2025-10-10T22:43:00.271262] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-10T22:43:00.273320] [INFO ] [MAIN ] Derivative Progress: 1405/1823 symbols completed. SJT took 1.1s. Estimated remaining: 2m 39s. Rate: 157.6 symbols/min [2025-10-10T22:43:00.273586] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:00.294384] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:00.295396] [INFO ] [MAIN ] SJM: Generated 1820 derivative records from 50766 primary records. [2025-10-10T22:43:00.295556] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-10T22:43:00.309615] [DEBUG] [LOCAL ] SKIL: Loaded 6671 existing records from primary storage. [2025-10-10T22:43:00.317048] [INFO ] [MAIN ] SKIL: Loaded 6671 primary data records. [2025-10-10T22:43:00.364824] [DEBUG] [LOCAL ] SJM: Derivative data saved (1820 records). [2025-10-10T22:43:00.389382] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-10T22:43:00.400135] [INFO ] [MAIN ] Derivative Progress: 1406/1823 symbols completed. SJM took 1.2s. Estimated remaining: 2m 39s. Rate: 157.7 symbols/min [2025-10-10T22:43:00.405473] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:00.421442] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:00.439105] [INFO ] [MAIN ] SKE: Generated 1820 derivative records from 37016 primary records. [2025-10-10T22:43:00.439745] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-10T22:43:00.534153] [DEBUG] [LOCAL ] SKE: Derivative data saved (1820 records). [2025-10-10T22:43:00.534280] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-10T22:43:00.536462] [INFO ] [MAIN ] Derivative Progress: 1407/1823 symbols completed. SKE took 1.3s. Estimated remaining: 2m 38s. Rate: 157.8 symbols/min [2025-10-10T22:43:00.536614] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:00.542564] [DEBUG] [LOCAL ] SKLZ: Loaded 11724 existing records from primary storage. [2025-10-10T22:43:00.654940] [INFO ] [MAIN ] SKLZ: Loaded 11724 primary data records. [2025-10-10T22:43:00.872203] [DEBUG] [LOCAL ] SKM: Loaded 35508 existing records from primary storage. [2025-10-10T22:43:00.986865] [INFO ] [MAIN ] SKM: Loaded 35508 primary data records. [2025-10-10T22:43:01.086167] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:01.105276] [INFO ] [MAIN ] SKIL: Generated 1820 derivative records from 6671 primary records. [2025-10-10T22:43:01.108709] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-10T22:43:01.172543] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1820 records). [2025-10-10T22:43:01.181223] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-10T22:43:01.205359] [INFO ] [MAIN ] Derivative Progress: 1408/1823 symbols completed. SKIL took 0.9s. Estimated remaining: 2m 38s. Rate: 157.7 symbols/min [2025-10-10T22:43:01.370530] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:01.371632] [INFO ] [MAIN ] SKLZ: Generated 1820 derivative records from 11724 primary records. [2025-10-10T22:43:01.371759] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-10T22:43:01.388037] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1820 records). [2025-10-10T22:43:01.388223] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-10T22:43:01.390195] [INFO ] [MAIN ] Derivative Progress: 1409/1823 symbols completed. SKLZ took 1.0s. Estimated remaining: 2m 37s. Rate: 157.7 symbols/min [2025-10-10T22:43:01.406269] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:01.406820] [INFO ] [MAIN ] SKM: Generated 1820 derivative records from 35508 primary records. [2025-10-10T22:43:01.406882] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-10T22:43:01.422412] [DEBUG] [LOCAL ] SKM: Derivative data saved (1820 records). [2025-10-10T22:43:01.422477] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-10T22:43:01.424599] [INFO ] [MAIN ] Derivative Progress: 1410/1823 symbols completed. SKM took 0.9s. Estimated remaining: 2m 37s. Rate: 157.8 symbols/min [2025-10-10T22:43:01.425094] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:01.425285] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:01.425353] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:01.448510] [DEBUG] [LOCAL ] SKYH: Loaded 16809 existing records from primary storage. [2025-10-10T22:43:01.456781] [INFO ] [MAIN ] SKYH: Loaded 16809 primary data records. [2025-10-10T22:43:01.615279] [DEBUG] [LOCAL ] SKT: Loaded 43020 existing records from primary storage. [2025-10-10T22:43:01.627786] [INFO ] [MAIN ] SKT: Loaded 43020 primary data records. [2025-10-10T22:43:01.667291] [DEBUG] [LOCAL ] SKY: Loaded 38636 existing records from primary storage. [2025-10-10T22:43:01.707058] [INFO ] [MAIN ] SKY: Loaded 38636 primary data records. [2025-10-10T22:43:02.435124] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:02.436402] [INFO ] [MAIN ] SKYH: Generated 1820 derivative records from 16809 primary records. [2025-10-10T22:43:02.436800] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-10T22:43:02.453761] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1820 records). [2025-10-10T22:43:02.453887] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-10T22:43:02.456052] [INFO ] [MAIN ] Derivative Progress: 1411/1823 symbols completed. SKYH took 1.0s. Estimated remaining: 2m 37s. Rate: 157.6 symbols/min [2025-10-10T22:43:02.456747] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:02.474148] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:02.474977] [INFO ] [MAIN ] SKT: Generated 1820 derivative records from 43020 primary records. [2025-10-10T22:43:02.475123] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-10T22:43:02.492051] [DEBUG] [LOCAL ] SKT: Derivative data saved (1820 records). [2025-10-10T22:43:02.492210] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-10T22:43:02.494899] [INFO ] [MAIN ] Derivative Progress: 1412/1823 symbols completed. SKT took 1.1s. Estimated remaining: 2m 36s. Rate: 157.7 symbols/min [2025-10-10T22:43:02.495980] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:02.510663] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:02.511341] [INFO ] [MAIN ] SKY: Generated 1820 derivative records from 38636 primary records. [2025-10-10T22:43:02.511439] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-10T22:43:02.537428] [DEBUG] [LOCAL ] SKY: Derivative data saved (1820 records). [2025-10-10T22:43:02.537666] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-10T22:43:02.541024] [INFO ] [MAIN ] Derivative Progress: 1413/1823 symbols completed. SKY took 1.1s. Estimated remaining: 2m 36s. Rate: 157.8 symbols/min [2025-10-10T22:43:02.541431] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:02.566476] [DEBUG] [LOCAL ] SLF: Loaded 39332 existing records from primary storage. [2025-10-10T22:43:02.566794] [INFO ] [MAIN ] SLF: Loaded 39332 primary data records. [2025-10-10T22:43:02.711118] [DEBUG] [LOCAL ] SLG: Loaded 45846 existing records from primary storage. [2025-10-10T22:43:02.732950] [INFO ] [MAIN ] SLG: Loaded 45846 primary data records. [2025-10-10T22:43:02.895796] [DEBUG] [LOCAL ] SLGN: Loaded 41331 existing records from primary storage. [2025-10-10T22:43:02.906767] [INFO ] [MAIN ] SLGN: Loaded 41331 primary data records. [2025-10-10T22:43:03.613243] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:03.614183] [INFO ] [MAIN ] SLF: Generated 1820 derivative records from 39332 primary records. [2025-10-10T22:43:03.614440] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-10T22:43:03.632921] [DEBUG] [LOCAL ] SLF: Derivative data saved (1820 records). [2025-10-10T22:43:03.633139] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-10T22:43:03.635284] [INFO ] [MAIN ] Derivative Progress: 1414/1823 symbols completed. SLF took 1.2s. Estimated remaining: 2m 36s. Rate: 157.6 symbols/min [2025-10-10T22:43:03.643435] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:03.649115] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:03.649776] [INFO ] [MAIN ] SLG: Generated 1820 derivative records from 45846 primary records. [2025-10-10T22:43:03.650005] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-10T22:43:03.666335] [DEBUG] [LOCAL ] SLG: Derivative data saved (1820 records). [2025-10-10T22:43:03.666605] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-10T22:43:03.669788] [INFO ] [MAIN ] Derivative Progress: 1415/1823 symbols completed. SLG took 1.2s. Estimated remaining: 2m 35s. Rate: 157.7 symbols/min [2025-10-10T22:43:03.670935] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:03.685626] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:03.686364] [INFO ] [MAIN ] SLGN: Generated 1820 derivative records from 41331 primary records. [2025-10-10T22:43:03.686478] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-10T22:43:03.732608] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1820 records). [2025-10-10T22:43:03.732826] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-10T22:43:03.734988] [INFO ] [MAIN ] Derivative Progress: 1416/1823 symbols completed. SLGN took 1.2s. Estimated remaining: 2m 35s. Rate: 157.8 symbols/min [2025-10-10T22:43:03.736467] [DEBUG] [LOCAL ] SLQT: Loaded 44094 existing records from primary storage. [2025-10-10T22:43:03.735140] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:03.736692] [INFO ] [MAIN ] SLQT: Loaded 44094 primary data records. [2025-10-10T22:43:03.787829] [DEBUG] [LOCAL ] SLVM: Loaded 28268 existing records from primary storage. [2025-10-10T22:43:03.814074] [INFO ] [MAIN ] SLVM: Loaded 28268 primary data records. [2025-10-10T22:43:04.398487] [DEBUG] [LOCAL ] SM: Loaded 53093 existing records from primary storage. [2025-10-10T22:43:04.399070] [INFO ] [MAIN ] SM: Loaded 53093 primary data records. [2025-10-10T22:43:04.722394] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:04.723446] [INFO ] [MAIN ] SLQT: Generated 1820 derivative records from 44094 primary records. [2025-10-10T22:43:04.724396] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-10T22:43:04.758624] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:04.761115] [INFO ] [MAIN ] SLVM: Generated 1820 derivative records from 28268 primary records. [2025-10-10T22:43:04.761871] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-10T22:43:04.763583] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1820 records). [2025-10-10T22:43:04.764288] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-10T22:43:04.773684] [INFO ] [MAIN ] Derivative Progress: 1417/1823 symbols completed. SLQT took 1.1s. Estimated remaining: 2m 35s. Rate: 157.6 symbols/min [2025-10-10T22:43:04.775381] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:04.782609] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1820 records). [2025-10-10T22:43:04.782852] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-10T22:43:04.785461] [INFO ] [MAIN ] Derivative Progress: 1418/1823 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 34s. Rate: 157.7 symbols/min [2025-10-10T22:43:04.785980] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:04.798536] [DEBUG] [LOCAL ] SMBK: Loaded 8292 existing records from primary storage. [2025-10-10T22:43:04.798745] [INFO ] [MAIN ] SMBK: Loaded 8292 primary data records. [2025-10-10T22:43:04.866525] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:04.901449] [INFO ] [MAIN ] SM: Generated 1820 derivative records from 53093 primary records. [2025-10-10T22:43:04.907025] [DEBUG] [LOCAL ] SMC: Loaded 11462 existing records from primary storage. [2025-10-10T22:43:04.907169] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-10T22:43:04.907263] [INFO ] [MAIN ] SMC: Loaded 11462 primary data records. [2025-10-10T22:43:05.014611] [DEBUG] [LOCAL ] SM: Derivative data saved (1820 records). [2025-10-10T22:43:05.106170] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-10T22:43:05.127598] [INFO ] [MAIN ] Derivative Progress: 1419/1823 symbols completed. SM took 1.4s. Estimated remaining: 2m 34s. Rate: 157.8 symbols/min [2025-10-10T22:43:05.128030] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:05.500855] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:05.501541] [INFO ] [MAIN ] SMBK: Generated 1820 derivative records from 8292 primary records. [2025-10-10T22:43:05.501762] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-10T22:43:05.533036] [DEBUG] [LOCAL ] SMFG: Loaded 48900 existing records from primary storage. [2025-10-10T22:43:05.534054] [INFO ] [MAIN ] SMFG: Loaded 48900 primary data records. [2025-10-10T22:43:05.535013] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1820 records). [2025-10-10T22:43:05.550405] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-10T22:43:05.552618] [INFO ] [MAIN ] Derivative Progress: 1420/1823 symbols completed. SMBK took 0.8s. Estimated remaining: 2m 33s. Rate: 157.7 symbols/min [2025-10-10T22:43:05.563268] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:05.636752] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:05.652132] [INFO ] [MAIN ] SMC: Generated 1820 derivative records from 11462 primary records. [2025-10-10T22:43:05.663224] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-10T22:43:05.756449] [DEBUG] [LOCAL ] SMC: Derivative data saved (1820 records). [2025-10-10T22:43:05.884502] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-10T22:43:05.887366] [INFO ] [MAIN ] Derivative Progress: 1421/1823 symbols completed. SMC took 1.1s. Estimated remaining: 2m 33s. Rate: 157.8 symbols/min [2025-10-10T22:43:05.887629] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:05.910241] [DEBUG] [LOCAL ] SMG: Loaded 44210 existing records from primary storage. [2025-10-10T22:43:05.910843] [INFO ] [MAIN ] SMG: Loaded 44210 primary data records. [2025-10-10T22:43:05.996309] [DEBUG] [LOCAL ] SMHI: Loaded 13253 existing records from primary storage. [2025-10-10T22:43:06.019411] [INFO ] [MAIN ] SMHI: Loaded 13253 primary data records. [2025-10-10T22:43:06.529948] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:06.530998] [INFO ] [MAIN ] SMFG: Generated 1820 derivative records from 48900 primary records. [2025-10-10T22:43:06.532310] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-10T22:43:06.551117] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1820 records). [2025-10-10T22:43:06.552113] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-10T22:43:06.554375] [INFO ] [MAIN ] Derivative Progress: 1422/1823 symbols completed. SMFG took 1.4s. Estimated remaining: 2m 33s. Rate: 157.7 symbols/min [2025-10-10T22:43:06.555013] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:06.599991] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:06.600991] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:06.601896] [INFO ] [MAIN ] SMG: Generated 1820 derivative records from 44210 primary records. [2025-10-10T22:43:06.602214] [DEBUG] [LOCAL ] SMP: Loaded 19271 existing records from primary storage. [2025-10-10T22:43:06.602379] [INFO ] [MAIN ] SMP: Loaded 19271 primary data records. [2025-10-10T22:43:06.602537] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-10T22:43:06.624592] [INFO ] [MAIN ] SMHI: Generated 1820 derivative records from 13253 primary records. [2025-10-10T22:43:06.657958] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-10T22:43:06.734322] [DEBUG] [LOCAL ] SMG: Derivative data saved (1820 records). [2025-10-10T22:43:06.746374] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-10T22:43:06.762000] [INFO ] [MAIN ] Derivative Progress: 1423/1823 symbols completed. SMG took 1.2s. Estimated remaining: 2m 32s. Rate: 157.7 symbols/min [2025-10-10T22:43:06.961363] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1820 records). [2025-10-10T22:43:06.974634] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-10T22:43:06.977913] [INFO ] [MAIN ] Derivative Progress: 1424/1823 symbols completed. SMHI took 1.1s. Estimated remaining: 2m 32s. Rate: 157.8 symbols/min [2025-10-10T22:43:07.002897] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:07.003531] [INFO ] [MAIN ] SMP: Generated 1820 derivative records from 19271 primary records. [2025-10-10T22:43:07.003593] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-10T22:43:07.019059] [DEBUG] [LOCAL ] SMP: Derivative data saved (1820 records). [2025-10-10T22:43:07.019121] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-10T22:43:07.021336] [INFO ] [MAIN ] Derivative Progress: 1425/1823 symbols completed. SMP took 0.5s. Estimated remaining: 2m 31s. Rate: 157.9 symbols/min [2025-10-10T22:43:07.022086] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:07.022167] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:07.022505] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:07.067529] [DEBUG] [LOCAL ] SMWB: Loaded 32747 existing records from primary storage. [2025-10-10T22:43:07.080223] [INFO ] [MAIN ] SMWB: Loaded 32747 primary data records. [2025-10-10T22:43:07.209899] [DEBUG] [LOCAL ] SMRT: Loaded 44671 existing records from primary storage. [2025-10-10T22:43:07.220848] [DEBUG] [LOCAL ] SMR: Loaded 54578 existing records from primary storage. [2025-10-10T22:43:07.219903] [INFO ] [MAIN ] SMRT: Loaded 44671 primary data records. [2025-10-10T22:43:07.274719] [INFO ] [MAIN ] SMR: Loaded 54578 primary data records. [2025-10-10T22:43:08.067818] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:08.068934] [INFO ] [MAIN ] SMWB: Generated 1820 derivative records from 32747 primary records. [2025-10-10T22:43:08.069447] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-10T22:43:08.105441] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1820 records). [2025-10-10T22:43:08.106538] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:08.106819] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-10T22:43:08.109179] [INFO ] [MAIN ] Derivative Progress: 1426/1823 symbols completed. SMWB took 1.1s. Estimated remaining: 2m 31s. Rate: 157.7 symbols/min [2025-10-10T22:43:08.117042] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:08.122863] [INFO ] [MAIN ] SMRT: Generated 1820 derivative records from 44671 primary records. [2025-10-10T22:43:08.123192] [DEBUG] [MAIN ] SMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:08.123257] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-10T22:43:08.124249] [INFO ] [MAIN ] SMR: Generated 1820 derivative records from 54578 primary records. [2025-10-10T22:43:08.124670] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-10T22:43:08.148870] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1820 records). [2025-10-10T22:43:08.149892] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-10T22:43:08.155087] [INFO ] [MAIN ] Derivative Progress: 1427/1823 symbols completed. SMRT took 1.1s. Estimated remaining: 2m 31s. Rate: 157.8 symbols/min [2025-10-10T22:43:08.155751] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:08.160952] [DEBUG] [LOCAL ] SMR: Derivative data saved (1820 records). [2025-10-10T22:43:08.161025] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-10-10T22:43:08.163396] [INFO ] [MAIN ] Derivative Progress: 1428/1823 symbols completed. SMR took 1.1s. Estimated remaining: 2m 30s. Rate: 157.9 symbols/min [2025-10-10T22:43:08.163599] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:08.200245] [DEBUG] [LOCAL ] SNA: Loaded 25978 existing records from primary storage. [2025-10-10T22:43:08.200523] [INFO ] [MAIN ] SNA: Loaded 25978 primary data records. [2025-10-10T22:43:08.301701] [DEBUG] [LOCAL ] SN: Loaded 50672 existing records from primary storage. [2025-10-10T22:43:08.318791] [INFO ] [MAIN ] SN: Loaded 50672 primary data records. [2025-10-10T22:43:08.727521] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-10-10T22:43:08.844809] [INFO ] [MAIN ] SNAP: Loaded 54576 primary data records. [2025-10-10T22:43:09.266062] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:09.268595] [INFO ] [MAIN ] SNA: Generated 1820 derivative records from 25978 primary records. [2025-10-10T22:43:09.269610] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-10T22:43:09.298778] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:09.300599] [INFO ] [MAIN ] SN: Generated 1820 derivative records from 50672 primary records. [2025-10-10T22:43:09.301308] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-10T22:43:09.320361] [DEBUG] [LOCAL ] SNA: Derivative data saved (1820 records). [2025-10-10T22:43:09.322230] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-10T22:43:09.323376] [DEBUG] [LOCAL ] SN: Derivative data saved (1820 records). [2025-10-10T22:43:09.326413] [INFO ] [MAIN ] Derivative Progress: 1429/1823 symbols completed. SNA took 1.2s. Estimated remaining: 2m 30s. Rate: 157.6 symbols/min [2025-10-10T22:43:09.327346] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:09.328121] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-10T22:43:09.330580] [INFO ] [MAIN ] Derivative Progress: 1430/1823 symbols completed. SN took 1.2s. Estimated remaining: 2m 29s. Rate: 157.8 symbols/min [2025-10-10T22:43:09.338592] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:09.344413] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:09.346882] [INFO ] [MAIN ] SNAP: Generated 1820 derivative records from 54576 primary records. [2025-10-10T22:43:09.347148] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-10T22:43:09.361040] [DEBUG] [LOCAL ] SNDA: Loaded 4512 existing records from primary storage. [2025-10-10T22:43:09.364252] [INFO ] [MAIN ] SNDA: Loaded 4512 primary data records. [2025-10-10T22:43:09.490163] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1820 records). [2025-10-10T22:43:09.512170] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-10T22:43:09.550494] [INFO ] [MAIN ] Derivative Progress: 1431/1823 symbols completed. SNAP took 1.4s. Estimated remaining: 2m 29s. Rate: 157.8 symbols/min [2025-10-10T22:43:09.582970] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:09.688340] [DEBUG] [LOCAL ] SNDR: Loaded 41828 existing records from primary storage. [2025-10-10T22:43:09.702794] [INFO ] [MAIN ] SNDR: Loaded 41828 primary data records. [2025-10-10T22:43:10.050859] [DEBUG] [LOCAL ] SNN: Loaded 44855 existing records from primary storage. [2025-10-10T22:43:10.053276] [INFO ] [MAIN ] SNN: Loaded 44855 primary data records. [2025-10-10T22:43:10.209069] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:10.231902] [INFO ] [MAIN ] SNDA: Generated 1820 derivative records from 4512 primary records. [2025-10-10T22:43:10.251078] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-10T22:43:10.427164] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1820 records). [2025-10-10T22:43:10.436420] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-10T22:43:10.444406] [INFO ] [MAIN ] Derivative Progress: 1432/1823 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 29s. Rate: 157.6 symbols/min [2025-10-10T22:43:10.445372] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:10.445477] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:10.446597] [INFO ] [MAIN ] SNDR: Generated 1820 derivative records from 41828 primary records. [2025-10-10T22:43:10.446743] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-10T22:43:10.465201] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1820 records). [2025-10-10T22:43:10.465431] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-10T22:43:10.467747] [INFO ] [MAIN ] Derivative Progress: 1433/1823 symbols completed. SNDR took 1.1s. Estimated remaining: 2m 28s. Rate: 157.8 symbols/min [2025-10-10T22:43:10.468185] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:10.488218] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:10.489065] [INFO ] [MAIN ] SNN: Generated 1820 derivative records from 44855 primary records. [2025-10-10T22:43:10.489287] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-10T22:43:10.506708] [DEBUG] [LOCAL ] SNN: Derivative data saved (1820 records). [2025-10-10T22:43:10.506969] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-10T22:43:10.509133] [INFO ] [MAIN ] Derivative Progress: 1434/1823 symbols completed. SNN took 0.9s. Estimated remaining: 2m 28s. Rate: 157.8 symbols/min [2025-10-10T22:43:10.509314] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:10.555801] [DEBUG] [LOCAL ] SNV: Loaded 49619 existing records from primary storage. [2025-10-10T22:43:10.559891] [INFO ] [MAIN ] SNV: Loaded 49619 primary data records. [2025-10-10T22:43:10.684514] [DEBUG] [LOCAL ] SNOW: Loaded 54373 existing records from primary storage. [2025-10-10T22:43:10.688789] [INFO ] [MAIN ] SNOW: Loaded 54373 primary data records. [2025-10-10T22:43:10.838802] [DEBUG] [LOCAL ] SNX: Loaded 40527 existing records from primary storage. [2025-10-10T22:43:11.019277] [INFO ] [MAIN ] SNX: Loaded 40527 primary data records. [2025-10-10T22:43:11.560313] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:11.562101] [INFO ] [MAIN ] SNV: Generated 1820 derivative records from 49619 primary records. [2025-10-10T22:43:11.562898] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-10T22:43:11.586575] [DEBUG] [LOCAL ] SNV: Derivative data saved (1820 records). [2025-10-10T22:43:11.587162] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-10T22:43:11.589627] [INFO ] [MAIN ] Derivative Progress: 1435/1823 symbols completed. SNV took 1.1s. Estimated remaining: 2m 28s. Rate: 157.6 symbols/min [2025-10-10T22:43:11.589921] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:11.604079] [DEBUG] [MAIN ] SNOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:11.604882] [INFO ] [MAIN ] SNOW: Generated 1820 derivative records from 54373 primary records. [2025-10-10T22:43:11.605155] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-10-10T22:43:11.623270] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1820 records). [2025-10-10T22:43:11.623375] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-10-10T22:43:11.625971] [INFO ] [MAIN ] Derivative Progress: 1436/1823 symbols completed. SNOW took 1.2s. Estimated remaining: 2m 27s. Rate: 157.7 symbols/min [2025-10-10T22:43:11.627065] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:11.642364] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:11.643095] [INFO ] [MAIN ] SNX: Generated 1820 derivative records from 40527 primary records. [2025-10-10T22:43:11.643274] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-10T22:43:11.660537] [DEBUG] [LOCAL ] SNX: Derivative data saved (1820 records). [2025-10-10T22:43:11.660730] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-10T22:43:11.663364] [INFO ] [MAIN ] Derivative Progress: 1437/1823 symbols completed. SNX took 1.2s. Estimated remaining: 2m 27s. Rate: 157.8 symbols/min [2025-10-10T22:43:11.663606] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:11.722562] [DEBUG] [LOCAL ] SOBO: Loaded 39909 existing records from primary storage. [2025-10-10T22:43:11.722791] [INFO ] [MAIN ] SOBO: Loaded 39909 primary data records. [2025-10-10T22:43:11.735024] [DEBUG] [LOCAL ] SO: Loaded 54389 existing records from primary storage. [2025-10-10T22:43:11.766936] [INFO ] [MAIN ] SO: Loaded 54389 primary data records. [2025-10-10T22:43:12.033780] [DEBUG] [LOCAL ] SOC: Loaded 51406 existing records from primary storage. [2025-10-10T22:43:12.073337] [INFO ] [MAIN ] SOC: Loaded 51406 primary data records. [2025-10-10T22:43:12.715400] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:12.729212] [INFO ] [MAIN ] SOBO: Generated 1820 derivative records from 39909 primary records. [2025-10-10T22:43:12.729699] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-10T22:43:12.729590] [DEBUG] [MAIN ] SO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:12.731556] [INFO ] [MAIN ] SO: Generated 1820 derivative records from 54389 primary records. [2025-10-10T22:43:12.731908] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-10T22:43:12.748687] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1820 records). [2025-10-10T22:43:12.748959] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-10T22:43:12.751710] [INFO ] [MAIN ] Derivative Progress: 1438/1823 symbols completed. SOBO took 1.1s. Estimated remaining: 2m 27s. Rate: 157.6 symbols/min [2025-10-10T22:43:12.767680] [DEBUG] [LOCAL ] SO: Derivative data saved (1820 records). [2025-10-10T22:43:12.767754] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-10T22:43:12.770020] [INFO ] [MAIN ] Derivative Progress: 1439/1823 symbols completed. SO took 1.2s. Estimated remaining: 2m 26s. Rate: 157.7 symbols/min [2025-10-10T22:43:12.784907] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:12.785504] [INFO ] [MAIN ] SOC: Generated 1820 derivative records from 51406 primary records. [2025-10-10T22:43:12.785565] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-10T22:43:12.801058] [DEBUG] [LOCAL ] SOC: Derivative data saved (1820 records). [2025-10-10T22:43:12.801120] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-10T22:43:12.803419] [INFO ] [MAIN ] Derivative Progress: 1440/1823 symbols completed. SOC took 1.1s. Estimated remaining: 2m 26s. Rate: 157.8 symbols/min [2025-10-10T22:43:12.804165] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:12.804096] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:12.803987] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:12.820805] [DEBUG] [LOCAL ] SOJC: Loaded 5037 existing records from primary storage. [2025-10-10T22:43:12.821056] [INFO ] [MAIN ] SOJC: Loaded 5037 primary data records. [2025-10-10T22:43:12.879146] [DEBUG] [LOCAL ] SOJD: Loaded 13182 existing records from primary storage. [2025-10-10T22:43:12.874229] [DEBUG] [LOCAL ] SOJE: Loaded 9165 existing records from primary storage. [2025-10-10T22:43:12.895745] [INFO ] [MAIN ] SOJD: Loaded 13182 primary data records. [2025-10-10T22:43:12.912228] [INFO ] [MAIN ] SOJE: Loaded 9165 primary data records. [2025-10-10T22:43:13.807072] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:43:13.816678] [INFO ] [MAIN ] SOJC: Generated 1819 derivative records from 5037 primary records. [2025-10-10T22:43:13.822394] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-10T22:43:13.831319] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:13.843616] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:13.844465] [INFO ] [MAIN ] SOJE: Generated 1820 derivative records from 9165 primary records. [2025-10-10T22:43:13.845394] [INFO ] [MAIN ] SOJD: Generated 1820 derivative records from 13182 primary records. [2025-10-10T22:43:13.846703] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-10T22:43:13.849441] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-10T22:43:13.884408] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1820 records). [2025-10-10T22:43:13.885089] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1819 records). [2025-10-10T22:43:13.885254] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-10T22:43:13.885573] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-10T22:43:13.888156] [INFO ] [MAIN ] Derivative Progress: 1441/1823 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 25s. Rate: 157.6 symbols/min [2025-10-10T22:43:13.891310] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1820 records). [2025-10-10T22:43:13.891443] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:13.891592] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-10T22:43:13.891685] [INFO ] [MAIN ] Derivative Progress: 1442/1823 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 25s. Rate: 157.8 symbols/min [2025-10-10T22:43:13.895069] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:13.895135] [INFO ] [MAIN ] Derivative Progress: 1443/1823 symbols completed. SOJE took 1.1s. Estimated remaining: 2m 24s. Rate: 157.9 symbols/min [2025-10-10T22:43:13.895777] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:13.911068] [DEBUG] [LOCAL ] SOL: Loaded 13271 existing records from primary storage. [2025-10-10T22:43:13.911203] [INFO ] [MAIN ] SOL: Loaded 13271 primary data records. [2025-10-10T22:43:14.241270] [DEBUG] [LOCAL ] SOLV: Loaded 44502 existing records from primary storage. [2025-10-10T22:43:14.246684] [INFO ] [MAIN ] SOLV: Loaded 44502 primary data records. [2025-10-10T22:43:14.256267] [DEBUG] [LOCAL ] SON: Loaded 43771 existing records from primary storage. [2025-10-10T22:43:14.267833] [INFO ] [MAIN ] SON: Loaded 43771 primary data records. [2025-10-10T22:43:14.922011] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:14.923973] [INFO ] [MAIN ] SOL: Generated 1820 derivative records from 13271 primary records. [2025-10-10T22:43:14.924179] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-10T22:43:14.942913] [DEBUG] [LOCAL ] SOL: Derivative data saved (1820 records). [2025-10-10T22:43:14.943189] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-10T22:43:14.945419] [INFO ] [MAIN ] Derivative Progress: 1444/1823 symbols completed. SOL took 1.1s. Estimated remaining: 2m 24s. Rate: 157.7 symbols/min [2025-10-10T22:43:14.945980] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:14.981542] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:14.981908] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:14.982984] [INFO ] [MAIN ] SOLV: Generated 1820 derivative records from 44502 primary records. [2025-10-10T22:43:14.983856] [INFO ] [MAIN ] SON: Generated 1820 derivative records from 43771 primary records. [2025-10-10T22:43:14.984018] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-10T22:43:14.984195] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-10T22:43:15.013216] [DEBUG] [LOCAL ] SON: Derivative data saved (1820 records). [2025-10-10T22:43:15.013787] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-10T22:43:15.016430] [INFO ] [MAIN ] Derivative Progress: 1445/1823 symbols completed. SON took 1.1s. Estimated remaining: 2m 24s. Rate: 157.8 symbols/min [2025-10-10T22:43:15.017797] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:15.023041] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1820 records). [2025-10-10T22:43:15.037834] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-10T22:43:15.040167] [INFO ] [MAIN ] Derivative Progress: 1446/1823 symbols completed. SOLV took 1.1s. Estimated remaining: 2m 23s. Rate: 157.9 symbols/min [2025-10-10T22:43:15.042841] [DEBUG] [LOCAL ] SOR: Loaded 2933 existing records from primary storage. [2025-10-10T22:43:15.042958] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:15.043604] [INFO ] [MAIN ] SOR: Loaded 2933 primary data records. [2025-10-10T22:43:15.168593] [DEBUG] [LOCAL ] SOS: Loaded 9331 existing records from primary storage. [2025-10-10T22:43:15.172699] [INFO ] [MAIN ] SOS: Loaded 9331 primary data records. [2025-10-10T22:43:15.194974] [DEBUG] [LOCAL ] SONY: Loaded 54146 existing records from primary storage. [2025-10-10T22:43:15.226778] [INFO ] [MAIN ] SONY: Loaded 54146 primary data records. [2025-10-10T22:43:16.018821] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:16.021036] [INFO ] [MAIN ] SOR: Generated 1820 derivative records from 2933 primary records. [2025-10-10T22:43:16.021217] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-10T22:43:16.039024] [DEBUG] [LOCAL ] SOR: Derivative data saved (1820 records). [2025-10-10T22:43:16.039450] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-10T22:43:16.041397] [INFO ] [MAIN ] Derivative Progress: 1447/1823 symbols completed. SOR took 1.0s. Estimated remaining: 2m 23s. Rate: 157.7 symbols/min [2025-10-10T22:43:16.041830] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:16.062253] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:43:16.074609] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:16.075282] [INFO ] [MAIN ] SOS: Generated 1819 derivative records from 9331 primary records. [2025-10-10T22:43:16.075521] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-10T22:43:16.076073] [INFO ] [MAIN ] SONY: Generated 1820 derivative records from 54146 primary records. [2025-10-10T22:43:16.076161] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-10T22:43:16.102441] [DEBUG] [LOCAL ] SOS: Derivative data saved (1819 records). [2025-10-10T22:43:16.102835] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-10T22:43:16.113843] [INFO ] [MAIN ] Derivative Progress: 1448/1823 symbols completed. SOS took 1.1s. Estimated remaining: 2m 23s. Rate: 157.8 symbols/min [2025-10-10T22:43:16.114272] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:16.130371] [DEBUG] [LOCAL ] SPB: Loaded 34631 existing records from primary storage. [2025-10-10T22:43:16.131209] [INFO ] [MAIN ] SPB: Loaded 34631 primary data records. [2025-10-10T22:43:16.131108] [DEBUG] [LOCAL ] SONY: Derivative data saved (1820 records). [2025-10-10T22:43:16.142531] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-10T22:43:16.169296] [INFO ] [MAIN ] Derivative Progress: 1449/1823 symbols completed. SONY took 1.2s. Estimated remaining: 2m 22s. Rate: 157.9 symbols/min [2025-10-10T22:43:16.176241] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:16.269155] [DEBUG] [LOCAL ] SPE: Loaded 6369 existing records from primary storage. [2025-10-10T22:43:16.310928] [INFO ] [MAIN ] SPE: Loaded 6369 primary data records. [2025-10-10T22:43:16.567496] [DEBUG] [LOCAL ] SPCE: Loaded 50706 existing records from primary storage. [2025-10-10T22:43:16.579209] [INFO ] [MAIN ] SPCE: Loaded 50706 primary data records. [2025-10-10T22:43:17.127586] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:17.129535] [INFO ] [MAIN ] SPB: Generated 1820 derivative records from 34631 primary records. [2025-10-10T22:43:17.130040] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-10T22:43:17.158893] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:43:17.160246] [INFO ] [MAIN ] SPE: Generated 1819 derivative records from 6369 primary records. [2025-10-10T22:43:17.161156] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-10T22:43:17.180227] [DEBUG] [LOCAL ] SPB: Derivative data saved (1820 records). [2025-10-10T22:43:17.182047] [DEBUG] [LOCAL ] SPE: Derivative data saved (1819 records). [2025-10-10T22:43:17.182177] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-10T22:43:17.184280] [INFO ] [MAIN ] Derivative Progress: 1450/1823 symbols completed. SPE took 1.0s. Estimated remaining: 2m 22s. Rate: 157.7 symbols/min [2025-10-10T22:43:17.181763] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-10T22:43:17.184627] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:17.194619] [INFO ] [MAIN ] Derivative Progress: 1451/1823 symbols completed. SPB took 1.2s. Estimated remaining: 2m 21s. Rate: 157.8 symbols/min [2025-10-10T22:43:17.200288] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:17.200399] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:17.201610] [INFO ] [MAIN ] SPCE: Generated 1820 derivative records from 50706 primary records. [2025-10-10T22:43:17.201809] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-10T22:43:17.219243] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1820 records). [2025-10-10T22:43:17.219394] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-10T22:43:17.221910] [INFO ] [MAIN ] Derivative Progress: 1452/1823 symbols completed. SPCE took 1.1s. Estimated remaining: 2m 21s. Rate: 157.9 symbols/min [2025-10-10T22:43:17.222287] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:17.253266] [DEBUG] [LOCAL ] SPH: Loaded 17100 existing records from primary storage. [2025-10-10T22:43:17.253461] [INFO ] [MAIN ] SPH: Loaded 17100 primary data records. [2025-10-10T22:43:17.378679] [DEBUG] [LOCAL ] SPG: Loaded 50962 existing records from primary storage. [2025-10-10T22:43:17.411113] [INFO ] [MAIN ] SPG: Loaded 50962 primary data records. [2025-10-10T22:43:17.496262] [DEBUG] [LOCAL ] SPGI: Loaded 46517 existing records from primary storage. [2025-10-10T22:43:17.606697] [INFO ] [MAIN ] SPGI: Loaded 46517 primary data records. [2025-10-10T22:43:18.254586] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:18.255547] [INFO ] [MAIN ] SPH: Generated 1820 derivative records from 17100 primary records. [2025-10-10T22:43:18.255844] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-10T22:43:18.277889] [DEBUG] [LOCAL ] SPH: Derivative data saved (1820 records). [2025-10-10T22:43:18.278001] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-10T22:43:18.280487] [INFO ] [MAIN ] Derivative Progress: 1453/1823 symbols completed. SPH took 1.1s. Estimated remaining: 2m 21s. Rate: 157.7 symbols/min [2025-10-10T22:43:18.294451] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:18.295560] [INFO ] [MAIN ] SPG: Generated 1820 derivative records from 50962 primary records. [2025-10-10T22:43:18.295810] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-10T22:43:18.326410] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:18.328329] [INFO ] [MAIN ] SPGI: Generated 1820 derivative records from 46517 primary records. [2025-10-10T22:43:18.329668] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-10T22:43:18.330050] [DEBUG] [LOCAL ] SPG: Derivative data saved (1820 records). [2025-10-10T22:43:18.330809] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-10T22:43:18.333552] [INFO ] [MAIN ] Derivative Progress: 1454/1823 symbols completed. SPG took 1.1s. Estimated remaining: 2m 20s. Rate: 157.8 symbols/min [2025-10-10T22:43:18.348593] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1820 records). [2025-10-10T22:43:18.348684] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-10T22:43:18.350939] [INFO ] [MAIN ] Derivative Progress: 1455/1823 symbols completed. SPGI took 1.2s. Estimated remaining: 2m 20s. Rate: 157.9 symbols/min [2025-10-10T22:43:18.351545] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:18.351688] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:18.351776] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:18.362439] [DEBUG] [LOCAL ] SPMC: Loaded 5393 existing records from primary storage. [2025-10-10T22:43:18.362587] [INFO ] [MAIN ] SPMC: Loaded 5393 primary data records. [2025-10-10T22:43:18.685689] [DEBUG] [LOCAL ] SPHR: Loaded 41016 existing records from primary storage. [2025-10-10T22:43:18.694937] [INFO ] [MAIN ] SPHR: Loaded 41016 primary data records. [2025-10-10T22:43:18.694351] [DEBUG] [LOCAL ] SPIR: Loaded 37959 existing records from primary storage. [2025-10-10T22:43:18.695135] [INFO ] [MAIN ] SPIR: Loaded 37959 primary data records. [2025-10-10T22:43:19.349824] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:19.351210] [INFO ] [MAIN ] SPMC: Generated 1820 derivative records from 5393 primary records. [2025-10-10T22:43:19.351400] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-10T22:43:19.370781] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1820 records). [2025-10-10T22:43:19.370924] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-10T22:43:19.373308] [INFO ] [MAIN ] Derivative Progress: 1456/1823 symbols completed. SPMC took 1.0s. Estimated remaining: 2m 20s. Rate: 157.7 symbols/min [2025-10-10T22:43:19.374068] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:19.393278] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:19.401537] [INFO ] [MAIN ] SPHR: Generated 1820 derivative records from 41016 primary records. [2025-10-10T22:43:19.406517] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:19.407292] [INFO ] [MAIN ] SPIR: Generated 1820 derivative records from 37959 primary records. [2025-10-10T22:43:19.406632] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-10T22:43:19.408012] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-10T22:43:19.447247] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1820 records). [2025-10-10T22:43:19.447422] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-10T22:43:19.448061] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1820 records). [2025-10-10T22:43:19.450279] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-10T22:43:19.450199] [INFO ] [MAIN ] Derivative Progress: 1457/1823 symbols completed. SPHR took 1.1s. Estimated remaining: 2m 19s. Rate: 157.8 symbols/min [2025-10-10T22:43:19.452762] [INFO ] [MAIN ] Derivative Progress: 1458/1823 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 19s. Rate: 157.9 symbols/min [2025-10-10T22:43:19.452980] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:19.450460] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:19.465171] [DEBUG] [LOCAL ] SPNT: Loaded 35122 existing records from primary storage. [2025-10-10T22:43:19.465387] [INFO ] [MAIN ] SPNT: Loaded 35122 primary data records. [2025-10-10T22:43:19.674552] [DEBUG] [LOCAL ] SPR: Loaded 41702 existing records from primary storage. [2025-10-10T22:43:19.798196] [INFO ] [MAIN ] SPR: Loaded 41702 primary data records. [2025-10-10T22:43:19.945622] [DEBUG] [LOCAL ] SPOT: Loaded 51195 existing records from primary storage. [2025-10-10T22:43:19.961510] [INFO ] [MAIN ] SPOT: Loaded 51195 primary data records. [2025-10-10T22:43:20.519384] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:20.521675] [INFO ] [MAIN ] SPNT: Generated 1820 derivative records from 35122 primary records. [2025-10-10T22:43:20.522745] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-10T22:43:20.548885] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1820 records). [2025-10-10T22:43:20.549473] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-10T22:43:20.552487] [INFO ] [MAIN ] Derivative Progress: 1459/1823 symbols completed. SPNT took 1.2s. Estimated remaining: 2m 18s. Rate: 157.7 symbols/min [2025-10-10T22:43:20.560719] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:20.567015] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:20.568299] [INFO ] [MAIN ] SPR: Generated 1820 derivative records from 41702 primary records. [2025-10-10T22:43:20.568387] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-10T22:43:20.591779] [DEBUG] [LOCAL ] SPR: Derivative data saved (1820 records). [2025-10-10T22:43:20.592015] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-10T22:43:20.594454] [INFO ] [MAIN ] Derivative Progress: 1460/1823 symbols completed. SPR took 1.1s. Estimated remaining: 2m 18s. Rate: 157.8 symbols/min [2025-10-10T22:43:20.607234] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:20.612782] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:20.613175] [DEBUG] [LOCAL ] SPRU: Loaded 9717 existing records from primary storage. [2025-10-10T22:43:20.613712] [INFO ] [MAIN ] SPRU: Loaded 9717 primary data records. [2025-10-10T22:43:20.619895] [INFO ] [MAIN ] SPOT: Generated 1820 derivative records from 51195 primary records. [2025-10-10T22:43:20.626963] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-10T22:43:20.725278] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1820 records). [2025-10-10T22:43:20.731397] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-10-10T22:43:20.747609] [DEBUG] [LOCAL ] SPXX: Loaded 9640 existing records from primary storage. [2025-10-10T22:43:20.750144] [INFO ] [MAIN ] Derivative Progress: 1461/1823 symbols completed. SPOT took 1.3s. Estimated remaining: 2m 18s. Rate: 157.9 symbols/min [2025-10-10T22:43:20.750822] [INFO ] [MAIN ] SPXX: Loaded 9640 primary data records. [2025-10-10T22:43:20.756312] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:21.337534] [DEBUG] [LOCAL ] SQM: Loaded 49402 existing records from primary storage. [2025-10-10T22:43:21.338357] [INFO ] [MAIN ] SQM: Loaded 49402 primary data records. [2025-10-10T22:43:21.457320] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:21.458433] [INFO ] [MAIN ] SPRU: Generated 1820 derivative records from 9717 primary records. [2025-10-10T22:43:21.463960] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-10T22:43:21.686120] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:21.688568] [INFO ] [MAIN ] SPXX: Generated 1820 derivative records from 9640 primary records. [2025-10-10T22:43:21.691242] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-10T22:43:21.693620] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1820 records). [2025-10-10T22:43:21.694924] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-10T22:43:21.697197] [INFO ] [MAIN ] Derivative Progress: 1462/1823 symbols completed. SPRU took 1.1s. Estimated remaining: 2m 17s. Rate: 157.7 symbols/min [2025-10-10T22:43:21.708179] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:21.714808] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1820 records). [2025-10-10T22:43:21.715093] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-10T22:43:21.717550] [INFO ] [MAIN ] Derivative Progress: 1463/1823 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 17s. Rate: 157.8 symbols/min [2025-10-10T22:43:21.717722] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:21.735127] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:21.736256] [INFO ] [MAIN ] SQM: Generated 1820 derivative records from 49402 primary records. [2025-10-10T22:43:21.744381] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-10T22:43:21.770001] [DEBUG] [LOCAL ] SQNS: Loaded 27421 existing records from primary storage. [2025-10-10T22:43:21.770593] [INFO ] [MAIN ] SQNS: Loaded 27421 primary data records. [2025-10-10T22:43:21.801190] [DEBUG] [LOCAL ] SQM: Derivative data saved (1820 records). [2025-10-10T22:43:21.811352] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-10T22:43:21.825293] [INFO ] [MAIN ] Derivative Progress: 1464/1823 symbols completed. SQM took 1.1s. Estimated remaining: 2m 16s. Rate: 157.9 symbols/min [2025-10-10T22:43:21.851176] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:21.911013] [DEBUG] [LOCAL ] SR: Loaded 33009 existing records from primary storage. [2025-10-10T22:43:21.921474] [INFO ] [MAIN ] SR: Loaded 33009 primary data records. [2025-10-10T22:43:22.421938] [DEBUG] [LOCAL ] SRE: Loaded 54194 existing records from primary storage. [2025-10-10T22:43:22.423225] [INFO ] [MAIN ] SRE: Loaded 54194 primary data records. [2025-10-10T22:43:22.553246] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:22.582137] [INFO ] [MAIN ] SQNS: Generated 1820 derivative records from 27421 primary records. [2025-10-10T22:43:22.614322] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-10T22:43:22.798744] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1820 records). [2025-10-10T22:43:22.799712] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-10T22:43:22.803477] [INFO ] [MAIN ] Derivative Progress: 1465/1823 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 16s. Rate: 157.7 symbols/min [2025-10-10T22:43:22.804684] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:22.819990] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:22.821031] [INFO ] [MAIN ] SR: Generated 1820 derivative records from 33009 primary records. [2025-10-10T22:43:22.821200] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-10T22:43:22.844035] [DEBUG] [LOCAL ] SREA: Loaded 10327 existing records from primary storage. [2025-10-10T22:43:22.844899] [INFO ] [MAIN ] SREA: Loaded 10327 primary data records. [2025-10-10T22:43:22.912623] [DEBUG] [LOCAL ] SR: Derivative data saved (1820 records). [2025-10-10T22:43:22.924265] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-10T22:43:22.942524] [INFO ] [MAIN ] Derivative Progress: 1466/1823 symbols completed. SR took 1.2s. Estimated remaining: 2m 16s. Rate: 157.8 symbols/min [2025-10-10T22:43:22.950357] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:22.978071] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:22.989145] [INFO ] [MAIN ] SRE: Generated 1820 derivative records from 54194 primary records. [2025-10-10T22:43:23.007998] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-10T22:43:23.190397] [DEBUG] [LOCAL ] SRE: Derivative data saved (1820 records). [2025-10-10T22:43:23.190860] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-10T22:43:23.193005] [INFO ] [MAIN ] Derivative Progress: 1467/1823 symbols completed. SRE took 1.3s. Estimated remaining: 2m 15s. Rate: 157.8 symbols/min [2025-10-10T22:43:23.193262] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:23.206431] [DEBUG] [LOCAL ] SRFM: Loaded 38604 existing records from primary storage. [2025-10-10T22:43:23.206755] [INFO ] [MAIN ] SRFM: Loaded 38604 primary data records. [2025-10-10T22:43:23.333629] [DEBUG] [LOCAL ] SRG: Loaded 15543 existing records from primary storage. [2025-10-10T22:43:23.397851] [INFO ] [MAIN ] SRG: Loaded 15543 primary data records. [2025-10-10T22:43:23.611423] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:23.633760] [INFO ] [MAIN ] SREA: Generated 1820 derivative records from 10327 primary records. [2025-10-10T22:43:23.634091] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-10T22:43:23.840944] [DEBUG] [LOCAL ] SREA: Derivative data saved (1820 records). [2025-10-10T22:43:23.841807] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-10T22:43:23.844058] [INFO ] [MAIN ] Derivative Progress: 1468/1823 symbols completed. SREA took 1.0s. Estimated remaining: 2m 15s. Rate: 157.7 symbols/min [2025-10-10T22:43:23.864445] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:23.865247] [INFO ] [MAIN ] SRFM: Generated 1820 derivative records from 38604 primary records. [2025-10-10T22:43:23.865388] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-10T22:43:23.894487] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:23.895863] [INFO ] [MAIN ] SRG: Generated 1820 derivative records from 15543 primary records. [2025-10-10T22:43:23.896153] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-10T22:43:23.896841] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1820 records). [2025-10-10T22:43:23.897298] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-10T22:43:23.899864] [INFO ] [MAIN ] Derivative Progress: 1469/1823 symbols completed. SRFM took 0.9s. Estimated remaining: 2m 15s. Rate: 157.8 symbols/min [2025-10-10T22:43:23.914237] [DEBUG] [LOCAL ] SRG: Derivative data saved (1820 records). [2025-10-10T22:43:23.914319] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-10T22:43:23.916576] [INFO ] [MAIN ] Derivative Progress: 1470/1823 symbols completed. SRG took 0.7s. Estimated remaining: 2m 14s. Rate: 157.9 symbols/min [2025-10-10T22:43:23.917019] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:23.917162] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:23.917108] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:23.930445] [DEBUG] [LOCAL ] SRV: Loaded 7459 existing records from primary storage. [2025-10-10T22:43:23.930545] [INFO ] [MAIN ] SRV: Loaded 7459 primary data records. [2025-10-10T22:43:24.049519] [DEBUG] [LOCAL ] SRI: Loaded 26976 existing records from primary storage. [2025-10-10T22:43:24.055378] [INFO ] [MAIN ] SRI: Loaded 26976 primary data records. [2025-10-10T22:43:24.390368] [DEBUG] [LOCAL ] SSB: Loaded 43219 existing records from primary storage. [2025-10-10T22:43:24.417232] [INFO ] [MAIN ] SSB: Loaded 43219 primary data records. [2025-10-10T22:43:24.918311] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:24.919143] [INFO ] [MAIN ] SRV: Generated 1820 derivative records from 7459 primary records. [2025-10-10T22:43:24.919611] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-10T22:43:24.948593] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:24.950410] [INFO ] [MAIN ] SRI: Generated 1820 derivative records from 26976 primary records. [2025-10-10T22:43:24.950948] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-10T22:43:24.970701] [DEBUG] [LOCAL ] SRV: Derivative data saved (1820 records). [2025-10-10T22:43:24.973891] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-10T22:43:24.976185] [INFO ] [MAIN ] Derivative Progress: 1471/1823 symbols completed. SRV took 1.1s. Estimated remaining: 2m 14s. Rate: 157.7 symbols/min [2025-10-10T22:43:24.972030] [DEBUG] [LOCAL ] SRI: Derivative data saved (1820 records). [2025-10-10T22:43:24.976593] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:24.976497] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-10T22:43:24.992321] [INFO ] [MAIN ] Derivative Progress: 1472/1823 symbols completed. SRI took 1.1s. Estimated remaining: 2m 13s. Rate: 157.8 symbols/min [2025-10-10T22:43:24.992854] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:24.993808] [INFO ] [MAIN ] SSB: Generated 1820 derivative records from 43219 primary records. [2025-10-10T22:43:24.993093] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:24.994342] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-10T22:43:25.011305] [DEBUG] [LOCAL ] SSB: Derivative data saved (1820 records). [2025-10-10T22:43:25.011487] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-10T22:43:25.013876] [INFO ] [MAIN ] Derivative Progress: 1473/1823 symbols completed. SSB took 1.1s. Estimated remaining: 2m 13s. Rate: 157.9 symbols/min [2025-10-10T22:43:25.019505] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:25.037961] [DEBUG] [LOCAL ] SSD: Loaded 22766 existing records from primary storage. [2025-10-10T22:43:25.038177] [INFO ] [MAIN ] SSD: Loaded 22766 primary data records. [2025-10-10T22:43:25.109774] [DEBUG] [LOCAL ] SST: Loaded 11805 existing records from primary storage. [2025-10-10T22:43:25.124412] [INFO ] [MAIN ] SST: Loaded 11805 primary data records. [2025-10-10T22:43:25.350238] [DEBUG] [LOCAL ] SSL: Loaded 41966 existing records from primary storage. [2025-10-10T22:43:25.375277] [INFO ] [MAIN ] SSL: Loaded 41966 primary data records. [2025-10-10T22:43:25.999514] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:26.003063] [INFO ] [MAIN ] SSD: Generated 1820 derivative records from 22766 primary records. [2025-10-10T22:43:26.003426] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-10T22:43:26.029505] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:26.034084] [DEBUG] [LOCAL ] SSD: Derivative data saved (1820 records). [2025-10-10T22:43:26.034901] [INFO ] [MAIN ] SST: Generated 1820 derivative records from 11805 primary records. [2025-10-10T22:43:26.035099] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-10T22:43:26.038018] [INFO ] [MAIN ] Derivative Progress: 1474/1823 symbols completed. SSD took 1.1s. Estimated remaining: 2m 13s. Rate: 157.8 symbols/min [2025-10-10T22:43:26.035259] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-10T22:43:26.039909] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:26.070093] [DEBUG] [LOCAL ] SST: Derivative data saved (1820 records). [2025-10-10T22:43:26.070479] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:26.071356] [INFO ] [MAIN ] SSL: Generated 1820 derivative records from 41966 primary records. [2025-10-10T22:43:26.070681] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-10T22:43:26.073811] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-10T22:43:26.073738] [INFO ] [MAIN ] Derivative Progress: 1475/1823 symbols completed. SST took 1.1s. Estimated remaining: 2m 12s. Rate: 157.9 symbols/min [2025-10-10T22:43:26.073999] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:26.098025] [DEBUG] [LOCAL ] SSL: Derivative data saved (1820 records). [2025-10-10T22:43:26.098148] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-10T22:43:26.100472] [INFO ] [MAIN ] Derivative Progress: 1476/1823 symbols completed. SSL took 1.1s. Estimated remaining: 2m 12s. Rate: 158.0 symbols/min [2025-10-10T22:43:26.100819] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:26.112470] [DEBUG] [LOCAL ] SSTK: Loaded 25879 existing records from primary storage. [2025-10-10T22:43:26.112687] [INFO ] [MAIN ] SSTK: Loaded 25879 primary data records. [2025-10-10T22:43:26.465538] [DEBUG] [LOCAL ] ST: Loaded 50558 existing records from primary storage. [2025-10-10T22:43:26.465874] [INFO ] [MAIN ] ST: Loaded 50558 primary data records. [2025-10-10T22:43:26.586076] [DEBUG] [LOCAL ] STAG: Loaded 50819 existing records from primary storage. [2025-10-10T22:43:26.589595] [INFO ] [MAIN ] STAG: Loaded 50819 primary data records. [2025-10-10T22:43:27.174584] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:27.176556] [INFO ] [MAIN ] SSTK: Generated 1820 derivative records from 25879 primary records. [2025-10-10T22:43:27.177127] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-10T22:43:27.199095] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1820 records). [2025-10-10T22:43:27.200091] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-10T22:43:27.202911] [INFO ] [MAIN ] Derivative Progress: 1477/1823 symbols completed. SSTK took 1.2s. Estimated remaining: 2m 12s. Rate: 157.8 symbols/min [2025-10-10T22:43:27.203280] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:27.218011] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:27.219060] [INFO ] [MAIN ] ST: Generated 1820 derivative records from 50558 primary records. [2025-10-10T22:43:27.219661] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-10T22:43:27.243368] [DEBUG] [LOCAL ] ST: Derivative data saved (1820 records). [2025-10-10T22:43:27.243777] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-10T22:43:27.245900] [INFO ] [MAIN ] Derivative Progress: 1478/1823 symbols completed. ST took 1.2s. Estimated remaining: 2m 11s. Rate: 157.8 symbols/min [2025-10-10T22:43:27.246327] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:27.260467] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:27.267480] [DEBUG] [LOCAL ] STC: Loaded 17551 existing records from primary storage. [2025-10-10T22:43:27.267181] [INFO ] [MAIN ] STAG: Generated 1820 derivative records from 50819 primary records. [2025-10-10T22:43:27.267739] [INFO ] [MAIN ] STC: Loaded 17551 primary data records. [2025-10-10T22:43:27.267797] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-10T22:43:27.389514] [DEBUG] [LOCAL ] STAG: Derivative data saved (1820 records). [2025-10-10T22:43:27.395496] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-10T22:43:27.402981] [INFO ] [MAIN ] Derivative Progress: 1479/1823 symbols completed. STAG took 1.3s. Estimated remaining: 2m 11s. Rate: 157.9 symbols/min [2025-10-10T22:43:27.408313] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:27.611218] [DEBUG] [LOCAL ] STE: Loaded 35898 existing records from primary storage. [2025-10-10T22:43:27.611588] [INFO ] [MAIN ] STE: Loaded 35898 primary data records. [2025-10-10T22:43:27.679795] [DEBUG] [LOCAL ] STEL: Loaded 23115 existing records from primary storage. [2025-10-10T22:43:27.718430] [INFO ] [MAIN ] STEL: Loaded 23115 primary data records. [2025-10-10T22:43:28.261131] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:28.263172] [INFO ] [MAIN ] STC: Generated 1820 derivative records from 17551 primary records. [2025-10-10T22:43:28.263858] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-10T22:43:28.300108] [DEBUG] [LOCAL ] STC: Derivative data saved (1820 records). [2025-10-10T22:43:28.300725] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-10T22:43:28.301092] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:28.304451] [INFO ] [MAIN ] STE: Generated 1820 derivative records from 35898 primary records. [2025-10-10T22:43:28.303391] [INFO ] [MAIN ] Derivative Progress: 1480/1823 symbols completed. STC took 1.1s. Estimated remaining: 2m 10s. Rate: 157.8 symbols/min [2025-10-10T22:43:28.304768] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-10T22:43:28.305573] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:28.329260] [DEBUG] [LOCAL ] STE: Derivative data saved (1820 records). [2025-10-10T22:43:28.329671] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-10T22:43:28.332021] [INFO ] [MAIN ] Derivative Progress: 1481/1823 symbols completed. STE took 1.1s. Estimated remaining: 2m 10s. Rate: 157.9 symbols/min [2025-10-10T22:43:28.345094] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:28.345614] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:28.347531] [INFO ] [MAIN ] STEL: Generated 1820 derivative records from 23115 primary records. [2025-10-10T22:43:28.347867] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-10T22:43:28.377425] [DEBUG] [LOCAL ] STEL: Derivative data saved (1820 records). [2025-10-10T22:43:28.377613] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-10T22:43:28.379874] [INFO ] [MAIN ] Derivative Progress: 1482/1823 symbols completed. STEL took 1.0s. Estimated remaining: 2m 10s. Rate: 158.0 symbols/min [2025-10-10T22:43:28.380187] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:28.388529] [DEBUG] [LOCAL ] STEW: Loaded 16339 existing records from primary storage. [2025-10-10T22:43:28.388709] [INFO ] [MAIN ] STEW: Loaded 16339 primary data records. [2025-10-10T22:43:28.485775] [DEBUG] [LOCAL ] STK: Loaded 9737 existing records from primary storage. [2025-10-10T22:43:28.491083] [INFO ] [MAIN ] STK: Loaded 9737 primary data records. [2025-10-10T22:43:28.503080] [DEBUG] [LOCAL ] STEM: Loaded 39568 existing records from primary storage. [2025-10-10T22:43:28.513902] [INFO ] [MAIN ] STEM: Loaded 39568 primary data records. [2025-10-10T22:43:29.397133] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:29.405620] [INFO ] [MAIN ] STEM: Generated 1820 derivative records from 39568 primary records. [2025-10-10T22:43:29.410442] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-10T22:43:29.412123] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:29.433756] [INFO ] [MAIN ] STEW: Generated 1820 derivative records from 16339 primary records. [2025-10-10T22:43:29.436840] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-10T22:43:29.437910] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:29.439126] [INFO ] [MAIN ] STK: Generated 1820 derivative records from 9737 primary records. [2025-10-10T22:43:29.439428] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-10T22:43:29.464316] [DEBUG] [LOCAL ] STEW: Derivative data saved (1820 records). [2025-10-10T22:43:29.464690] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-10T22:43:29.471308] [INFO ] [MAIN ] Derivative Progress: 1483/1823 symbols completed. STEW took 1.1s. Estimated remaining: 2m 9s. Rate: 157.8 symbols/min [2025-10-10T22:43:29.476199] [DEBUG] [LOCAL ] STEM: Derivative data saved (1820 records). [2025-10-10T22:43:29.476682] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-10T22:43:29.479282] [INFO ] [MAIN ] Derivative Progress: 1484/1823 symbols completed. STEM took 1.2s. Estimated remaining: 2m 9s. Rate: 157.9 symbols/min [2025-10-10T22:43:29.480976] [DEBUG] [LOCAL ] STK: Derivative data saved (1820 records). [2025-10-10T22:43:29.481039] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-10T22:43:29.483113] [INFO ] [MAIN ] Derivative Progress: 1485/1823 symbols completed. STK took 1.1s. Estimated remaining: 2m 8s. Rate: 158.0 symbols/min [2025-10-10T22:43:29.483728] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:29.483846] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:29.484041] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:29.512333] [DEBUG] [LOCAL ] STN: Loaded 23156 existing records from primary storage. [2025-10-10T22:43:29.512571] [INFO ] [MAIN ] STN: Loaded 23156 primary data records. [2025-10-10T22:43:29.833991] [DEBUG] [LOCAL ] STLA: Loaded 54331 existing records from primary storage. [2025-10-10T22:43:29.861404] [INFO ] [MAIN ] STLA: Loaded 54331 primary data records. [2025-10-10T22:43:29.883509] [DEBUG] [LOCAL ] STM: Loaded 54350 existing records from primary storage. [2025-10-10T22:43:29.918780] [INFO ] [MAIN ] STM: Loaded 54350 primary data records. [2025-10-10T22:43:30.569373] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:30.572100] [INFO ] [MAIN ] STN: Generated 1820 derivative records from 23156 primary records. [2025-10-10T22:43:30.574425] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-10T22:43:30.609367] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:30.613998] [INFO ] [MAIN ] STLA: Generated 1820 derivative records from 54331 primary records. [2025-10-10T22:43:30.618482] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-10T22:43:30.633833] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:30.647458] [INFO ] [MAIN ] STM: Generated 1820 derivative records from 54350 primary records. [2025-10-10T22:43:30.647610] [DEBUG] [LOCAL ] STN: Derivative data saved (1820 records). [2025-10-10T22:43:30.647789] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-10T22:43:30.662268] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-10T22:43:30.672730] [INFO ] [MAIN ] Derivative Progress: 1486/1823 symbols completed. STN took 1.2s. Estimated remaining: 2m 8s. Rate: 157.7 symbols/min [2025-10-10T22:43:30.674020] [DEBUG] [LOCAL ] STLA: Derivative data saved (1820 records). [2025-10-10T22:43:30.674885] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:30.678667] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-10T22:43:30.681618] [INFO ] [MAIN ] Derivative Progress: 1487/1823 symbols completed. STLA took 1.2s. Estimated remaining: 2m 8s. Rate: 157.8 symbols/min [2025-10-10T22:43:30.681829] [DEBUG] [LOCAL ] STM: Derivative data saved (1820 records). [2025-10-10T22:43:30.682081] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-10T22:43:30.682251] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:30.684610] [INFO ] [MAIN ] Derivative Progress: 1488/1823 symbols completed. STM took 1.2s. Estimated remaining: 2m 7s. Rate: 157.9 symbols/min [2025-10-10T22:43:30.685504] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:30.704232] [DEBUG] [LOCAL ] STRV: Loaded 11460 existing records from primary storage. [2025-10-10T22:43:30.704993] [INFO ] [MAIN ] STRV: Loaded 11460 primary data records. [2025-10-10T22:43:30.918814] [DEBUG] [LOCAL ] STT: Loaded 51696 existing records from primary storage. [2025-10-10T22:43:30.918034] [DEBUG] [LOCAL ] STNG: Loaded 44349 existing records from primary storage. [2025-10-10T22:43:30.927667] [INFO ] [MAIN ] STT: Loaded 51696 primary data records. [2025-10-10T22:43:30.982036] [INFO ] [MAIN ] STNG: Loaded 44349 primary data records. [2025-10-10T22:43:31.737539] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:31.738593] [INFO ] [MAIN ] STRV: Generated 1820 derivative records from 11460 primary records. [2025-10-10T22:43:31.740133] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-10T22:43:31.758806] [DEBUG] [LOCAL ] STRV: Derivative data saved (1820 records). [2025-10-10T22:43:31.759452] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-10T22:43:31.762019] [INFO ] [MAIN ] Derivative Progress: 1489/1823 symbols completed. STRV took 1.1s. Estimated remaining: 2m 7s. Rate: 157.8 symbols/min [2025-10-10T22:43:31.762559] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:31.791233] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:31.797400] [INFO ] [MAIN ] STT: Generated 1820 derivative records from 51696 primary records. [2025-10-10T22:43:31.797850] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-10T22:43:31.797637] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:31.799521] [INFO ] [MAIN ] STNG: Generated 1820 derivative records from 44349 primary records. [2025-10-10T22:43:31.799798] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-10T22:43:31.849220] [DEBUG] [LOCAL ] STVN: Loaded 26967 existing records from primary storage. [2025-10-10T22:43:31.851079] [INFO ] [MAIN ] STVN: Loaded 26967 primary data records. [2025-10-10T22:43:31.857574] [DEBUG] [LOCAL ] STNG: Derivative data saved (1820 records). [2025-10-10T22:43:31.864908] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-10T22:43:31.867532] [INFO ] [MAIN ] Derivative Progress: 1490/1823 symbols completed. STNG took 1.2s. Estimated remaining: 2m 7s. Rate: 157.8 symbols/min [2025-10-10T22:43:31.878520] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:31.904780] [DEBUG] [LOCAL ] STT: Derivative data saved (1820 records). [2025-10-10T22:43:31.918677] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-10T22:43:31.952256] [INFO ] [MAIN ] Derivative Progress: 1491/1823 symbols completed. STT took 1.3s. Estimated remaining: 2m 6s. Rate: 157.9 symbols/min [2025-10-10T22:43:31.969216] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:32.024673] [DEBUG] [LOCAL ] STXD: Loaded 1250 existing records from primary storage. [2025-10-10T22:43:32.024937] [INFO ] [MAIN ] STXD: Loaded 1250 primary data records. [2025-10-10T22:43:32.563912] [DEBUG] [LOCAL ] STWD: Loaded 52712 existing records from primary storage. [2025-10-10T22:43:32.573348] [INFO ] [MAIN ] STWD: Loaded 52712 primary data records. [2025-10-10T22:43:32.904952] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:32.906355] [INFO ] [MAIN ] STVN: Generated 1820 derivative records from 26967 primary records. [2025-10-10T22:43:32.906734] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-10T22:43:32.928972] [DEBUG] [LOCAL ] STVN: Derivative data saved (1820 records). [2025-10-10T22:43:32.929934] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-10T22:43:32.932050] [INFO ] [MAIN ] Derivative Progress: 1492/1823 symbols completed. STVN took 1.2s. Estimated remaining: 2m 6s. Rate: 157.7 symbols/min [2025-10-10T22:43:32.932419] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:32.947922] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:43:32.948965] [INFO ] [MAIN ] STXD: Generated 1819 derivative records from 1250 primary records. [2025-10-10T22:43:32.949980] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-10T22:43:32.959532] [DEBUG] [LOCAL ] STXE: Loaded 2120 existing records from primary storage. [2025-10-10T22:43:32.964306] [INFO ] [MAIN ] STXE: Loaded 2120 primary data records. [2025-10-10T22:43:33.016377] [DEBUG] [LOCAL ] STXD: Derivative data saved (1819 records). [2025-10-10T22:43:33.023832] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-10T22:43:33.026382] [INFO ] [MAIN ] Derivative Progress: 1493/1823 symbols completed. STXD took 1.1s. Estimated remaining: 2m 5s. Rate: 157.8 symbols/min [2025-10-10T22:43:33.052939] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:33.156308] [DEBUG] [LOCAL ] STXG: Loaded 2487 existing records from primary storage. [2025-10-10T22:43:33.168345] [INFO ] [MAIN ] STXG: Loaded 2487 primary data records. [2025-10-10T22:43:33.165095] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:33.365608] [INFO ] [MAIN ] STWD: Generated 1820 derivative records from 52712 primary records. [2025-10-10T22:43:33.384296] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-10T22:43:33.628803] [DEBUG] [LOCAL ] STWD: Derivative data saved (1820 records). [2025-10-10T22:43:33.642432] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-10T22:43:33.644927] [INFO ] [MAIN ] Derivative Progress: 1494/1823 symbols completed. STWD took 1.8s. Estimated remaining: 2m 5s. Rate: 157.8 symbols/min [2025-10-10T22:43:33.645666] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:33.651838] [DEBUG] [LOCAL ] STXK: Loaded 1545 existing records from primary storage. [2025-10-10T22:43:33.652101] [INFO ] [MAIN ] STXK: Loaded 1545 primary data records. [2025-10-10T22:43:33.813095] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:43:33.968527] [INFO ] [MAIN ] STXE: Generated 1819 derivative records from 2120 primary records. [2025-10-10T22:43:33.969397] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-10T22:43:34.000010] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:43:34.001330] [INFO ] [MAIN ] STXG: Generated 1819 derivative records from 2487 primary records. [2025-10-10T22:43:34.001797] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-10T22:43:34.014693] [DEBUG] [LOCAL ] STXE: Derivative data saved (1819 records). [2025-10-10T22:43:34.016231] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-10T22:43:34.018465] [INFO ] [MAIN ] Derivative Progress: 1495/1823 symbols completed. STXE took 1.1s. Estimated remaining: 2m 5s. Rate: 157.8 symbols/min [2025-10-10T22:43:34.018764] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:34.024233] [DEBUG] [LOCAL ] STXG: Derivative data saved (1819 records). [2025-10-10T22:43:34.026868] [DEBUG] [LOCAL ] STXT: Loaded 2534 existing records from primary storage. [2025-10-10T22:43:34.026947] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-10T22:43:34.030026] [INFO ] [MAIN ] Derivative Progress: 1496/1823 symbols completed. STXG took 1.0s. Estimated remaining: 2m 4s. Rate: 157.9 symbols/min [2025-10-10T22:43:34.030162] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:34.027087] [INFO ] [MAIN ] STXT: Loaded 2534 primary data records. [2025-10-10T22:43:34.109070] [DEBUG] [LOCAL ] STXV: Loaded 1561 existing records from primary storage. [2025-10-10T22:43:34.124710] [INFO ] [MAIN ] STXV: Loaded 1561 primary data records. [2025-10-10T22:43:34.170638] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:43:34.244979] [INFO ] [MAIN ] STXK: Generated 1819 derivative records from 1545 primary records. [2025-10-10T22:43:34.323938] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-10T22:43:34.808304] [DEBUG] [LOCAL ] STXK: Derivative data saved (1819 records). [2025-10-10T22:43:34.810063] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-10T22:43:34.812607] [INFO ] [MAIN ] Derivative Progress: 1497/1823 symbols completed. STXK took 1.2s. Estimated remaining: 2m 4s. Rate: 157.8 symbols/min [2025-10-10T22:43:34.813427] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:34.850610] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-10T22:43:34.851995] [INFO ] [MAIN ] STXT: Generated 1818 derivative records from 2534 primary records. [2025-10-10T22:43:34.852179] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-10T22:43:34.878324] [DEBUG] [LOCAL ] STXT: Derivative data saved (1818 records). [2025-10-10T22:43:34.893820] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-10T22:43:34.894704] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7798 incomplete bins [2025-10-10T22:43:34.897986] [INFO ] [MAIN ] Derivative Progress: 1498/1823 symbols completed. STXT took 0.9s. Estimated remaining: 2m 4s. Rate: 157.8 symbols/min [2025-10-10T22:43:34.899559] [INFO ] [MAIN ] STXV: Generated 1816 derivative records from 1561 primary records. [2025-10-10T22:43:34.899737] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-10T22:43:34.941554] [DEBUG] [LOCAL ] STXV: Derivative data saved (1816 records). [2025-10-10T22:43:34.941759] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-10T22:43:34.945122] [INFO ] [MAIN ] Derivative Progress: 1499/1823 symbols completed. STXV took 0.9s. Estimated remaining: 2m 3s. Rate: 157.9 symbols/min [2025-10-10T22:43:34.973060] [DEBUG] [LOCAL ] STZ: Loaded 53107 existing records from primary storage. [2025-10-10T22:43:34.973251] [INFO ] [MAIN ] STZ: Loaded 53107 primary data records. [2025-10-10T22:43:35.350628] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:35.351267] [INFO ] [MAIN ] STZ: Generated 1820 derivative records from 53107 primary records. [2025-10-10T22:43:35.351328] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-10T22:43:35.367109] [DEBUG] [LOCAL ] STZ: Derivative data saved (1820 records). [2025-10-10T22:43:35.367225] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-10T22:43:35.369693] [INFO ] [MAIN ] Derivative Progress: 1500/1823 symbols completed. STZ took 0.6s. Estimated remaining: 2m 3s. Rate: 157.9 symbols/min [2025-10-10T22:43:35.370368] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:35.370480] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:35.370629] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:35.421946] [DEBUG] [LOCAL ] SUN: Loaded 38533 existing records from primary storage. [2025-10-10T22:43:35.422126] [INFO ] [MAIN ] SUN: Loaded 38533 primary data records. [2025-10-10T22:43:35.555013] [DEBUG] [LOCAL ] SUI: Loaded 42380 existing records from primary storage. [2025-10-10T22:43:35.573664] [INFO ] [MAIN ] SUI: Loaded 42380 primary data records. [2025-10-10T22:43:35.689556] [DEBUG] [LOCAL ] SU: Loaded 54213 existing records from primary storage. [2025-10-10T22:43:35.742771] [INFO ] [MAIN ] SU: Loaded 54213 primary data records. [2025-10-10T22:43:36.436446] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:36.438279] [INFO ] [MAIN ] SUN: Generated 1820 derivative records from 38533 primary records. [2025-10-10T22:43:36.439089] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-10T22:43:36.469563] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:36.470803] [DEBUG] [LOCAL ] SUN: Derivative data saved (1820 records). [2025-10-10T22:43:36.471753] [INFO ] [MAIN ] SUI: Generated 1820 derivative records from 42380 primary records. [2025-10-10T22:43:36.471817] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-10T22:43:36.473881] [INFO ] [MAIN ] Derivative Progress: 1501/1823 symbols completed. SUN took 1.1s. Estimated remaining: 2m 3s. Rate: 157.7 symbols/min [2025-10-10T22:43:36.471913] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-10T22:43:36.474164] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:36.507494] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:36.508124] [DEBUG] [LOCAL ] SUI: Derivative data saved (1820 records). [2025-10-10T22:43:36.508956] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-10T22:43:36.508889] [INFO ] [MAIN ] SU: Generated 1820 derivative records from 54213 primary records. [2025-10-10T22:43:36.511302] [INFO ] [MAIN ] Derivative Progress: 1502/1823 symbols completed. SUI took 1.1s. Estimated remaining: 2m 2s. Rate: 157.8 symbols/min [2025-10-10T22:43:36.511435] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-10T22:43:36.512616] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:36.528761] [DEBUG] [LOCAL ] SU: Derivative data saved (1820 records). [2025-10-10T22:43:36.528874] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-10T22:43:36.531451] [INFO ] [MAIN ] Derivative Progress: 1503/1823 symbols completed. SU took 1.2s. Estimated remaining: 2m 2s. Rate: 157.9 symbols/min [2025-10-10T22:43:36.531686] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:36.566426] [DEBUG] [LOCAL ] SUPV: Loaded 48230 existing records from primary storage. [2025-10-10T22:43:36.575822] [INFO ] [MAIN ] SUPV: Loaded 48230 primary data records. [2025-10-10T22:43:36.738353] [DEBUG] [LOCAL ] SVV: Loaded 40570 existing records from primary storage. [2025-10-10T22:43:36.727596] [DEBUG] [LOCAL ] SUZ: Loaded 46265 existing records from primary storage. [2025-10-10T22:43:36.751240] [INFO ] [MAIN ] SVV: Loaded 40570 primary data records. [2025-10-10T22:43:36.751174] [INFO ] [MAIN ] SUZ: Loaded 46265 primary data records. [2025-10-10T22:43:37.642045] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:37.643092] [INFO ] [MAIN ] SUPV: Generated 1820 derivative records from 48230 primary records. [2025-10-10T22:43:37.643200] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-10T22:43:37.682196] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1820 records). [2025-10-10T22:43:37.681318] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:37.682389] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-10T22:43:37.684298] [INFO ] [MAIN ] SVV: Generated 1820 derivative records from 40570 primary records. [2025-10-10T22:43:37.686767] [INFO ] [MAIN ] Derivative Progress: 1504/1823 symbols completed. SUPV took 1.2s. Estimated remaining: 2m 1s. Rate: 157.7 symbols/min [2025-10-10T22:43:37.687019] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:37.689699] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-10T22:43:37.713072] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:37.718712] [INFO ] [MAIN ] SUZ: Generated 1820 derivative records from 46265 primary records. [2025-10-10T22:43:37.718858] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-10T22:43:37.741636] [DEBUG] [LOCAL ] SVV: Derivative data saved (1820 records). [2025-10-10T22:43:37.742701] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-10T22:43:37.745240] [INFO ] [MAIN ] Derivative Progress: 1505/1823 symbols completed. SVV took 1.2s. Estimated remaining: 2m 1s. Rate: 157.8 symbols/min [2025-10-10T22:43:37.746279] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:37.747475] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1820 records). [2025-10-10T22:43:37.747799] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-10T22:43:37.751826] [INFO ] [MAIN ] Derivative Progress: 1506/1823 symbols completed. SUZ took 1.2s. Estimated remaining: 2m 0s. Rate: 157.9 symbols/min [2025-10-10T22:43:37.754100] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:37.798226] [DEBUG] [LOCAL ] SW: Loaded 53963 existing records from primary storage. [2025-10-10T22:43:37.798738] [INFO ] [MAIN ] SW: Loaded 53963 primary data records. [2025-10-10T22:43:37.978717] [DEBUG] [LOCAL ] SWK: Loaded 53204 existing records from primary storage. [2025-10-10T22:43:37.988170] [INFO ] [MAIN ] SWK: Loaded 53204 primary data records. [2025-10-10T22:43:37.988031] [DEBUG] [LOCAL ] SWX: Loaded 31622 existing records from primary storage. [2025-10-10T22:43:38.006039] [INFO ] [MAIN ] SWX: Loaded 31622 primary data records. [2025-10-10T22:43:38.958457] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:38.959398] [INFO ] [MAIN ] SW: Generated 1820 derivative records from 53963 primary records. [2025-10-10T22:43:38.959587] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-10T22:43:38.994123] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:38.997735] [INFO ] [MAIN ] SWK: Generated 1820 derivative records from 53204 primary records. [2025-10-10T22:43:38.998049] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-10T22:43:38.996190] [DEBUG] [LOCAL ] SW: Derivative data saved (1820 records). [2025-10-10T22:43:38.999298] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-10T22:43:39.010007] [INFO ] [MAIN ] Derivative Progress: 1507/1823 symbols completed. SW took 1.3s. Estimated remaining: 2m 0s. Rate: 157.6 symbols/min [2025-10-10T22:43:39.029955] [DEBUG] [LOCAL ] SWK: Derivative data saved (1820 records). [2025-10-10T22:43:39.030545] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-10T22:43:39.030164] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:39.031179] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:39.033575] [INFO ] [MAIN ] Derivative Progress: 1508/1823 symbols completed. SWK took 1.3s. Estimated remaining: 1m 60s. Rate: 157.7 symbols/min [2025-10-10T22:43:39.035235] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:39.034534] [INFO ] [MAIN ] SWX: Generated 1820 derivative records from 31622 primary records. [2025-10-10T22:43:39.035956] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-10T22:43:39.059586] [DEBUG] [LOCAL ] SWX: Derivative data saved (1820 records). [2025-10-10T22:43:39.060034] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-10T22:43:39.059801] [DEBUG] [LOCAL ] SWZ: Loaded 6168 existing records from primary storage. [2025-10-10T22:43:39.063100] [INFO ] [MAIN ] SWZ: Loaded 6168 primary data records. [2025-10-10T22:43:39.062939] [INFO ] [MAIN ] Derivative Progress: 1509/1823 symbols completed. SWX took 1.3s. Estimated remaining: 1m 59s. Rate: 157.8 symbols/min [2025-10-10T22:43:39.063228] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:39.269037] [DEBUG] [LOCAL ] SXI: Loaded 11909 existing records from primary storage. [2025-10-10T22:43:39.269236] [INFO ] [MAIN ] SXI: Loaded 11909 primary data records. [2025-10-10T22:43:39.483204] [DEBUG] [LOCAL ] SXC: Loaded 42061 existing records from primary storage. [2025-10-10T22:43:39.518887] [INFO ] [MAIN ] SXC: Loaded 42061 primary data records. [2025-10-10T22:43:40.056737] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:40.057808] [INFO ] [MAIN ] SWZ: Generated 1820 derivative records from 6168 primary records. [2025-10-10T22:43:40.058524] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-10T22:43:40.078376] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1820 records). [2025-10-10T22:43:40.078802] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-10T22:43:40.081325] [INFO ] [MAIN ] Derivative Progress: 1510/1823 symbols completed. SWZ took 1.1s. Estimated remaining: 1m 59s. Rate: 157.7 symbols/min [2025-10-10T22:43:40.081550] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:40.102333] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:40.103247] [INFO ] [MAIN ] SXI: Generated 1820 derivative records from 11909 primary records. [2025-10-10T22:43:40.103344] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-10T22:43:40.123291] [DEBUG] [LOCAL ] SXI: Derivative data saved (1820 records). [2025-10-10T22:43:40.124407] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-10T22:43:40.127034] [INFO ] [MAIN ] Derivative Progress: 1511/1823 symbols completed. SXI took 1.1s. Estimated remaining: 1m 59s. Rate: 157.8 symbols/min [2025-10-10T22:43:40.135774] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:40.149464] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:40.150304] [INFO ] [MAIN ] SXC: Generated 1820 derivative records from 42061 primary records. [2025-10-10T22:43:40.150583] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-10T22:43:40.175267] [DEBUG] [LOCAL ] SXT: Loaded 30290 existing records from primary storage. [2025-10-10T22:43:40.177128] [INFO ] [MAIN ] SXT: Loaded 30290 primary data records. [2025-10-10T22:43:40.177003] [DEBUG] [LOCAL ] SXC: Derivative data saved (1820 records). [2025-10-10T22:43:40.182455] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-10T22:43:40.191316] [INFO ] [MAIN ] Derivative Progress: 1512/1823 symbols completed. SXC took 1.2s. Estimated remaining: 1m 58s. Rate: 157.8 symbols/min [2025-10-10T22:43:40.191515] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:40.512162] [DEBUG] [LOCAL ] SYF: Loaded 54226 existing records from primary storage. [2025-10-10T22:43:40.513097] [INFO ] [MAIN ] SYF: Loaded 54226 primary data records. [2025-10-10T22:43:40.641112] [DEBUG] [LOCAL ] SYK: Loaded 47599 existing records from primary storage. [2025-10-10T22:43:40.668475] [INFO ] [MAIN ] SYK: Loaded 47599 primary data records. [2025-10-10T22:43:41.088851] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:41.204271] [INFO ] [MAIN ] SXT: Generated 1820 derivative records from 30290 primary records. [2025-10-10T22:43:41.204469] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-10T22:43:41.227813] [DEBUG] [LOCAL ] SXT: Derivative data saved (1820 records). [2025-10-10T22:43:41.228156] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-10T22:43:41.230812] [INFO ] [MAIN ] Derivative Progress: 1513/1823 symbols completed. SXT took 1.1s. Estimated remaining: 1m 58s. Rate: 157.7 symbols/min [2025-10-10T22:43:41.245343] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:41.246344] [INFO ] [MAIN ] SYF: Generated 1820 derivative records from 54226 primary records. [2025-10-10T22:43:41.246541] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-10T22:43:41.266969] [DEBUG] [LOCAL ] SYF: Derivative data saved (1820 records). [2025-10-10T22:43:41.279210] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-10T22:43:41.282742] [INFO ] [MAIN ] Derivative Progress: 1514/1823 symbols completed. SYF took 1.1s. Estimated remaining: 1m 58s. Rate: 157.7 symbols/min [2025-10-10T22:43:41.283197] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:41.283940] [INFO ] [MAIN ] SYK: Generated 1820 derivative records from 47599 primary records. [2025-10-10T22:43:41.284005] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-10T22:43:41.299997] [DEBUG] [LOCAL ] SYK: Derivative data saved (1820 records). [2025-10-10T22:43:41.300053] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-10T22:43:41.302398] [INFO ] [MAIN ] Derivative Progress: 1515/1823 symbols completed. SYK took 1.1s. Estimated remaining: 1m 57s. Rate: 157.8 symbols/min [2025-10-10T22:43:41.302854] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:41.303033] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:41.303707] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:41.387800] [DEBUG] [LOCAL ] TAC: Loaded 43404 existing records from primary storage. [2025-10-10T22:43:41.388729] [INFO ] [MAIN ] TAC: Loaded 43404 primary data records. [2025-10-10T22:43:41.389431] [DEBUG] [LOCAL ] SYY: Loaded 54009 existing records from primary storage. [2025-10-10T22:43:41.414553] [INFO ] [MAIN ] SYY: Loaded 54009 primary data records. [2025-10-10T22:43:41.492339] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-10-10T22:43:41.507082] [INFO ] [MAIN ] T: Loaded 54578 primary data records. [2025-10-10T22:43:42.381288] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:42.383961] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:42.385311] [INFO ] [MAIN ] SYY: Generated 1820 derivative records from 54009 primary records. [2025-10-10T22:43:42.384633] [INFO ] [MAIN ] TAC: Generated 1820 derivative records from 43404 primary records. [2025-10-10T22:43:42.385603] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-10T22:43:42.385474] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-10T22:43:42.399176] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:42.399977] [INFO ] [MAIN ] T: Generated 1820 derivative records from 54578 primary records. [2025-10-10T22:43:42.407439] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-10T22:43:42.441102] [DEBUG] [LOCAL ] T: Derivative data saved (1820 records). [2025-10-10T22:43:42.442051] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-10T22:43:42.445540] [INFO ] [MAIN ] Derivative Progress: 1516/1823 symbols completed. T took 1.1s. Estimated remaining: 1m 57s. Rate: 157.6 symbols/min [2025-10-10T22:43:42.446170] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:42.450244] [DEBUG] [LOCAL ] SYY: Derivative data saved (1820 records). [2025-10-10T22:43:42.449960] [DEBUG] [LOCAL ] TAC: Derivative data saved (1820 records). [2025-10-10T22:43:42.450508] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-10T22:43:42.452972] [INFO ] [MAIN ] Derivative Progress: 1517/1823 symbols completed. SYY took 1.2s. Estimated remaining: 1m 56s. Rate: 157.7 symbols/min [2025-10-10T22:43:42.450617] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-10T22:43:42.453197] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:42.455477] [INFO ] [MAIN ] Derivative Progress: 1518/1823 symbols completed. TAC took 1.2s. Estimated remaining: 1m 56s. Rate: 157.8 symbols/min [2025-10-10T22:43:42.455712] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:42.542257] [DEBUG] [LOCAL ] TALO: Loaded 51598 existing records from primary storage. [2025-10-10T22:43:42.542982] [INFO ] [MAIN ] TALO: Loaded 51598 primary data records. [2025-10-10T22:43:42.652343] [DEBUG] [LOCAL ] TAK: Loaded 50719 existing records from primary storage. [2025-10-10T22:43:42.653062] [DEBUG] [LOCAL ] TAL: Loaded 52579 existing records from primary storage. [2025-10-10T22:43:42.664389] [INFO ] [MAIN ] TAK: Loaded 50719 primary data records. [2025-10-10T22:43:42.675294] [INFO ] [MAIN ] TAL: Loaded 52579 primary data records. [2025-10-10T22:43:43.511742] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:43.512455] [INFO ] [MAIN ] TALO: Generated 1820 derivative records from 51598 primary records. [2025-10-10T22:43:43.512712] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-10T22:43:43.545714] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:43.547137] [INFO ] [MAIN ] TAL: Generated 1820 derivative records from 52579 primary records. [2025-10-10T22:43:43.547352] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-10T22:43:43.555096] [DEBUG] [LOCAL ] TALO: Derivative data saved (1820 records). [2025-10-10T22:43:43.560111] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-10T22:43:43.560767] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:43.561596] [INFO ] [MAIN ] TAK: Generated 1820 derivative records from 50719 primary records. [2025-10-10T22:43:43.568906] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-10T22:43:43.570612] [INFO ] [MAIN ] Derivative Progress: 1519/1823 symbols completed. TALO took 1.1s. Estimated remaining: 1m 56s. Rate: 157.6 symbols/min [2025-10-10T22:43:43.574770] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:43.595190] [DEBUG] [LOCAL ] TAK: Derivative data saved (1820 records). [2025-10-10T22:43:43.596011] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-10T22:43:43.596124] [DEBUG] [LOCAL ] TAL: Derivative data saved (1820 records). [2025-10-10T22:43:43.599034] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-10T22:43:43.598897] [INFO ] [MAIN ] Derivative Progress: 1520/1823 symbols completed. TAK took 1.2s. Estimated remaining: 1m 55s. Rate: 157.7 symbols/min [2025-10-10T22:43:43.601983] [INFO ] [MAIN ] Derivative Progress: 1521/1823 symbols completed. TAL took 1.1s. Estimated remaining: 1m 55s. Rate: 157.8 symbols/min [2025-10-10T22:43:43.601938] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:43.602238] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:43.619192] [DEBUG] [LOCAL ] TBB: Loaded 11799 existing records from primary storage. [2025-10-10T22:43:43.619423] [INFO ] [MAIN ] TBB: Loaded 11799 primary data records. [2025-10-10T22:43:43.855628] [DEBUG] [LOCAL ] TBBB: Loaded 36241 existing records from primary storage. [2025-10-10T22:43:43.965934] [INFO ] [MAIN ] TBBB: Loaded 36241 primary data records. [2025-10-10T22:43:43.975065] [DEBUG] [LOCAL ] TAP: Loaded 53692 existing records from primary storage. [2025-10-10T22:43:43.976104] [INFO ] [MAIN ] TAP: Loaded 53692 primary data records. [2025-10-10T22:43:44.609622] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:44.611431] [INFO ] [MAIN ] TBB: Generated 1820 derivative records from 11799 primary records. [2025-10-10T22:43:44.611823] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-10T22:43:44.630570] [DEBUG] [LOCAL ] TBB: Derivative data saved (1820 records). [2025-10-10T22:43:44.631058] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-10T22:43:44.633171] [INFO ] [MAIN ] Derivative Progress: 1522/1823 symbols completed. TBB took 1.0s. Estimated remaining: 1m 55s. Rate: 157.7 symbols/min [2025-10-10T22:43:44.633506] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:44.657242] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:44.664894] [INFO ] [MAIN ] TBBB: Generated 1820 derivative records from 36241 primary records. [2025-10-10T22:43:44.665190] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-10T22:43:44.686492] [DEBUG] [LOCAL ] TBI: Loaded 22719 existing records from primary storage. [2025-10-10T22:43:44.697674] [INFO ] [MAIN ] TBI: Loaded 22719 primary data records. [2025-10-10T22:43:44.694949] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:44.709889] [INFO ] [MAIN ] TAP: Generated 1820 derivative records from 53692 primary records. [2025-10-10T22:43:44.710252] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-10T22:43:44.790797] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1820 records). [2025-10-10T22:43:44.791120] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-10T22:43:44.799419] [INFO ] [MAIN ] Derivative Progress: 1523/1823 symbols completed. TBBB took 1.2s. Estimated remaining: 1m 54s. Rate: 157.7 symbols/min [2025-10-10T22:43:44.799786] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:44.842029] [DEBUG] [LOCAL ] TAP: Derivative data saved (1820 records). [2025-10-10T22:43:44.874030] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-10T22:43:44.873952] [DEBUG] [LOCAL ] TBN: Loaded 3943 existing records from primary storage. [2025-10-10T22:43:44.884567] [INFO ] [MAIN ] Derivative Progress: 1524/1823 symbols completed. TAP took 1.3s. Estimated remaining: 1m 54s. Rate: 157.8 symbols/min [2025-10-10T22:43:44.909024] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:44.913285] [INFO ] [MAIN ] TBN: Loaded 3943 primary data records. [2025-10-10T22:43:45.168867] [DEBUG] [LOCAL ] TCBX: Loaded 10298 existing records from primary storage. [2025-10-10T22:43:45.181517] [INFO ] [MAIN ] TCBX: Loaded 10298 primary data records. [2025-10-10T22:43:45.699733] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:45.701409] [INFO ] [MAIN ] TBI: Generated 1820 derivative records from 22719 primary records. [2025-10-10T22:43:45.701856] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-10T22:43:45.722442] [DEBUG] [LOCAL ] TBI: Derivative data saved (1820 records). [2025-10-10T22:43:45.723277] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-10T22:43:45.725287] [INFO ] [MAIN ] Derivative Progress: 1525/1823 symbols completed. TBI took 1.1s. Estimated remaining: 1m 53s. Rate: 157.7 symbols/min [2025-10-10T22:43:45.726435] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:45.741270] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-10T22:43:45.742153] [INFO ] [MAIN ] TBN: Generated 1818 derivative records from 3943 primary records. [2025-10-10T22:43:45.742350] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-10T22:43:45.760425] [DEBUG] [LOCAL ] TBN: Derivative data saved (1818 records). [2025-10-10T22:43:45.760801] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-10T22:43:45.763316] [INFO ] [MAIN ] Derivative Progress: 1526/1823 symbols completed. TBN took 1.0s. Estimated remaining: 1m 53s. Rate: 157.8 symbols/min [2025-10-10T22:43:45.775955] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:45.777319] [DEBUG] [MAIN ] TCBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:45.778334] [INFO ] [MAIN ] TCBX: Generated 1820 derivative records from 10298 primary records. [2025-10-10T22:43:45.778489] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-10T22:43:45.810183] [DEBUG] [LOCAL ] TCBX: Derivative data saved (1820 records). [2025-10-10T22:43:45.810341] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-10T22:43:45.812938] [INFO ] [MAIN ] Derivative Progress: 1527/1823 symbols completed. TCBX took 0.9s. Estimated remaining: 1m 53s. Rate: 157.9 symbols/min [2025-10-10T22:43:45.813183] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:45.829615] [DEBUG] [LOCAL ] TD: Loaded 53114 existing records from primary storage. [2025-10-10T22:43:45.830015] [INFO ] [MAIN ] TD: Loaded 53114 primary data records. [2025-10-10T22:43:45.911135] [DEBUG] [LOCAL ] TDF: Loaded 6355 existing records from primary storage. [2025-10-10T22:43:45.947711] [INFO ] [MAIN ] TDF: Loaded 6355 primary data records. [2025-10-10T22:43:46.264291] [DEBUG] [LOCAL ] TDC: Loaded 47272 existing records from primary storage. [2025-10-10T22:43:46.287941] [INFO ] [MAIN ] TDC: Loaded 47272 primary data records. [2025-10-10T22:43:46.837236] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:46.850389] [INFO ] [MAIN ] TD: Generated 1820 derivative records from 53114 primary records. [2025-10-10T22:43:46.851234] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:46.852823] [INFO ] [MAIN ] TDF: Generated 1820 derivative records from 6355 primary records. [2025-10-10T22:43:46.852095] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-10T22:43:46.853625] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-10T22:43:46.882431] [DEBUG] [LOCAL ] TDF: Derivative data saved (1820 records). [2025-10-10T22:43:46.883514] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-10T22:43:46.887362] [INFO ] [MAIN ] Derivative Progress: 1528/1823 symbols completed. TDF took 1.1s. Estimated remaining: 1m 52s. Rate: 157.7 symbols/min [2025-10-10T22:43:46.888759] [DEBUG] [LOCAL ] TD: Derivative data saved (1820 records). [2025-10-10T22:43:46.888848] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-10T22:43:46.890802] [INFO ] [MAIN ] Derivative Progress: 1529/1823 symbols completed. TD took 1.2s. Estimated remaining: 1m 52s. Rate: 157.8 symbols/min [2025-10-10T22:43:46.906488] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:46.907170] [INFO ] [MAIN ] TDC: Generated 1820 derivative records from 47272 primary records. [2025-10-10T22:43:46.907230] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-10T22:43:46.922758] [DEBUG] [LOCAL ] TDC: Derivative data saved (1820 records). [2025-10-10T22:43:46.922820] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-10T22:43:46.925423] [INFO ] [MAIN ] Derivative Progress: 1530/1823 symbols completed. TDC took 1.1s. Estimated remaining: 1m 51s. Rate: 157.9 symbols/min [2025-10-10T22:43:46.925896] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:46.925839] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:46.926298] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:46.951625] [DEBUG] [LOCAL ] TDG: Loaded 22311 existing records from primary storage. [2025-10-10T22:43:46.951875] [INFO ] [MAIN ] TDG: Loaded 22311 primary data records. [2025-10-10T22:43:47.313355] [DEBUG] [LOCAL ] TDOC: Loaded 54129 existing records from primary storage. [2025-10-10T22:43:47.312582] [DEBUG] [LOCAL ] TDS: Loaded 43218 existing records from primary storage. [2025-10-10T22:43:47.313712] [INFO ] [MAIN ] TDS: Loaded 43218 primary data records. [2025-10-10T22:43:47.313621] [INFO ] [MAIN ] TDOC: Loaded 54129 primary data records. [2025-10-10T22:43:47.926561] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:47.928183] [INFO ] [MAIN ] TDG: Generated 1820 derivative records from 22311 primary records. [2025-10-10T22:43:47.929541] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-10T22:43:47.949338] [DEBUG] [LOCAL ] TDG: Derivative data saved (1820 records). [2025-10-10T22:43:47.949874] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-10T22:43:47.952065] [INFO ] [MAIN ] Derivative Progress: 1531/1823 symbols completed. TDG took 1.0s. Estimated remaining: 1m 51s. Rate: 157.7 symbols/min [2025-10-10T22:43:47.952390] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:47.971947] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:47.974458] [INFO ] [MAIN ] TDOC: Generated 1820 derivative records from 54129 primary records. [2025-10-10T22:43:47.974856] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-10T22:43:47.999614] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:48.002801] [INFO ] [MAIN ] TDS: Generated 1820 derivative records from 43218 primary records. [2025-10-10T22:43:48.002978] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-10T22:43:48.030666] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1820 records). [2025-10-10T22:43:48.031065] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-10T22:43:48.033525] [INFO ] [MAIN ] Derivative Progress: 1532/1823 symbols completed. TDOC took 1.1s. Estimated remaining: 1m 51s. Rate: 157.8 symbols/min [2025-10-10T22:43:48.034013] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:48.034985] [DEBUG] [LOCAL ] TDS: Derivative data saved (1820 records). [2025-10-10T22:43:48.035354] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-10T22:43:48.037463] [INFO ] [MAIN ] Derivative Progress: 1533/1823 symbols completed. TDS took 1.1s. Estimated remaining: 1m 50s. Rate: 157.9 symbols/min [2025-10-10T22:43:48.038358] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:48.052392] [DEBUG] [LOCAL ] TDW: Loaded 45772 existing records from primary storage. [2025-10-10T22:43:48.052516] [INFO ] [MAIN ] TDW: Loaded 45772 primary data records. [2025-10-10T22:43:48.176221] [DEBUG] [LOCAL ] TEAF: Loaded 7606 existing records from primary storage. [2025-10-10T22:43:48.177609] [DEBUG] [LOCAL ] TDY: Loaded 22699 existing records from primary storage. [2025-10-10T22:43:48.183072] [INFO ] [MAIN ] TDY: Loaded 22699 primary data records. [2025-10-10T22:43:48.188301] [INFO ] [MAIN ] TEAF: Loaded 7606 primary data records. [2025-10-10T22:43:49.040970] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:49.041873] [INFO ] [MAIN ] TDW: Generated 1820 derivative records from 45772 primary records. [2025-10-10T22:43:49.042269] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-10T22:43:49.063089] [DEBUG] [LOCAL ] TDW: Derivative data saved (1820 records). [2025-10-10T22:43:49.064607] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-10T22:43:49.066871] [INFO ] [MAIN ] Derivative Progress: 1534/1823 symbols completed. TDW took 1.1s. Estimated remaining: 1m 50s. Rate: 157.7 symbols/min [2025-10-10T22:43:49.067165] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:49.092755] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:49.093232] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:49.094688] [INFO ] [MAIN ] TDY: Generated 1820 derivative records from 22699 primary records. [2025-10-10T22:43:49.094119] [INFO ] [MAIN ] TEAF: Generated 1820 derivative records from 7606 primary records. [2025-10-10T22:43:49.094866] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-10T22:43:49.094816] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-10T22:43:49.127061] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1820 records). [2025-10-10T22:43:49.126575] [DEBUG] [LOCAL ] TDY: Derivative data saved (1820 records). [2025-10-10T22:43:49.127267] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-10T22:43:49.127174] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-10T22:43:49.129368] [INFO ] [MAIN ] Derivative Progress: 1535/1823 symbols completed. TDY took 1.1s. Estimated remaining: 1m 50s. Rate: 157.8 symbols/min [2025-10-10T22:43:49.131910] [INFO ] [MAIN ] Derivative Progress: 1536/1823 symbols completed. TEAF took 1.1s. Estimated remaining: 1m 49s. Rate: 157.9 symbols/min [2025-10-10T22:43:49.131772] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:49.132101] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:49.189126] [DEBUG] [LOCAL ] TEI: Loaded 21784 existing records from primary storage. [2025-10-10T22:43:49.189357] [INFO ] [MAIN ] TEI: Loaded 21784 primary data records. [2025-10-10T22:43:49.288130] [DEBUG] [LOCAL ] TEF: Loaded 37625 existing records from primary storage. [2025-10-10T22:43:49.325018] [INFO ] [MAIN ] TEF: Loaded 37625 primary data records. [2025-10-10T22:43:49.351558] [DEBUG] [LOCAL ] TECK: Loaded 54219 existing records from primary storage. [2025-10-10T22:43:49.361961] [INFO ] [MAIN ] TECK: Loaded 54219 primary data records. [2025-10-10T22:43:50.138760] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:50.139448] [INFO ] [MAIN ] TEI: Generated 1820 derivative records from 21784 primary records. [2025-10-10T22:43:50.139702] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-10T22:43:50.156435] [DEBUG] [LOCAL ] TEI: Derivative data saved (1820 records). [2025-10-10T22:43:50.158942] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-10T22:43:50.161477] [INFO ] [MAIN ] Derivative Progress: 1537/1823 symbols completed. TEI took 1.0s. Estimated remaining: 1m 49s. Rate: 157.7 symbols/min [2025-10-10T22:43:50.161687] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:50.189699] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:50.190016] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:50.191042] [INFO ] [MAIN ] TECK: Generated 1820 derivative records from 54219 primary records. [2025-10-10T22:43:50.191714] [INFO ] [MAIN ] TEF: Generated 1820 derivative records from 37625 primary records. [2025-10-10T22:43:50.191867] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-10T22:43:50.191139] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-10T22:43:50.221833] [DEBUG] [LOCAL ] TEF: Derivative data saved (1820 records). [2025-10-10T22:43:50.223019] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-10T22:43:50.222950] [DEBUG] [LOCAL ] TECK: Derivative data saved (1820 records). [2025-10-10T22:43:50.223204] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-10T22:43:50.225289] [INFO ] [MAIN ] Derivative Progress: 1538/1823 symbols completed. TEF took 1.1s. Estimated remaining: 1m 48s. Rate: 157.8 symbols/min [2025-10-10T22:43:50.228061] [INFO ] [MAIN ] Derivative Progress: 1539/1823 symbols completed. TECK took 1.2s. Estimated remaining: 1m 48s. Rate: 157.9 symbols/min [2025-10-10T22:43:50.228020] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:50.228268] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:50.271255] [DEBUG] [LOCAL ] TEO: Loaded 22786 existing records from primary storage. [2025-10-10T22:43:50.271433] [INFO ] [MAIN ] TEO: Loaded 22786 primary data records. [2025-10-10T22:43:50.398173] [DEBUG] [LOCAL ] TEL: Loaded 51770 existing records from primary storage. [2025-10-10T22:43:50.403960] [INFO ] [MAIN ] TEL: Loaded 51770 primary data records. [2025-10-10T22:43:50.397325] [DEBUG] [LOCAL ] TEN: Loaded 30810 existing records from primary storage. [2025-10-10T22:43:50.419453] [INFO ] [MAIN ] TEN: Loaded 30810 primary data records. [2025-10-10T22:43:51.275428] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:51.277760] [INFO ] [MAIN ] TEO: Generated 1820 derivative records from 22786 primary records. [2025-10-10T22:43:51.278104] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-10T22:43:51.296829] [DEBUG] [LOCAL ] TEO: Derivative data saved (1820 records). [2025-10-10T22:43:51.297121] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-10T22:43:51.300739] [INFO ] [MAIN ] Derivative Progress: 1540/1823 symbols completed. TEO took 1.1s. Estimated remaining: 1m 48s. Rate: 157.7 symbols/min [2025-10-10T22:43:51.302546] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:51.321819] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:51.322593] [INFO ] [MAIN ] TEL: Generated 1820 derivative records from 51770 primary records. [2025-10-10T22:43:51.335990] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:51.322891] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-10T22:43:51.337201] [INFO ] [MAIN ] TEN: Generated 1820 derivative records from 30810 primary records. [2025-10-10T22:43:51.337308] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-10T22:43:51.370936] [DEBUG] [LOCAL ] TEN: Derivative data saved (1820 records). [2025-10-10T22:43:51.371571] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-10T22:43:51.374005] [INFO ] [MAIN ] Derivative Progress: 1541/1823 symbols completed. TEN took 1.1s. Estimated remaining: 1m 47s. Rate: 157.8 symbols/min [2025-10-10T22:43:51.375712] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:51.377477] [DEBUG] [LOCAL ] TEL: Derivative data saved (1820 records). [2025-10-10T22:43:51.377627] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-10T22:43:51.379822] [INFO ] [MAIN ] Derivative Progress: 1542/1823 symbols completed. TEL took 1.2s. Estimated remaining: 1m 47s. Rate: 157.9 symbols/min [2025-10-10T22:43:51.380073] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:51.420668] [DEBUG] [LOCAL ] TEVA: Loaded 54410 existing records from primary storage. [2025-10-10T22:43:51.420911] [INFO ] [MAIN ] TEVA: Loaded 54410 primary data records. [2025-10-10T22:43:51.598467] [DEBUG] [LOCAL ] TEX: Loaded 44641 existing records from primary storage. [2025-10-10T22:43:51.614747] [INFO ] [MAIN ] TEX: Loaded 44641 primary data records. [2025-10-10T22:43:51.829423] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-10-10T22:43:51.850852] [INFO ] [MAIN ] TFC: Loaded 54447 primary data records. [2025-10-10T22:43:52.395370] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:52.397601] [INFO ] [MAIN ] TEVA: Generated 1820 derivative records from 54410 primary records. [2025-10-10T22:43:52.397736] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-10T22:43:52.416406] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1820 records). [2025-10-10T22:43:52.416800] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-10T22:43:52.419309] [INFO ] [MAIN ] Derivative Progress: 1543/1823 symbols completed. TEVA took 1.1s. Estimated remaining: 1m 47s. Rate: 157.7 symbols/min [2025-10-10T22:43:52.438984] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:52.452250] [INFO ] [MAIN ] TEX: Generated 1820 derivative records from 44641 primary records. [2025-10-10T22:43:52.452571] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:52.452714] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-10T22:43:52.454189] [INFO ] [MAIN ] TFC: Generated 1820 derivative records from 54447 primary records. [2025-10-10T22:43:52.454285] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-10T22:43:52.484374] [DEBUG] [LOCAL ] TEX: Derivative data saved (1820 records). [2025-10-10T22:43:52.484929] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-10T22:43:52.487457] [INFO ] [MAIN ] Derivative Progress: 1544/1823 symbols completed. TEX took 1.1s. Estimated remaining: 1m 46s. Rate: 157.8 symbols/min [2025-10-10T22:43:52.488559] [DEBUG] [LOCAL ] TFC: Derivative data saved (1820 records). [2025-10-10T22:43:52.488741] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-10T22:43:52.490732] [INFO ] [MAIN ] Derivative Progress: 1545/1823 symbols completed. TFC took 1.1s. Estimated remaining: 1m 46s. Rate: 157.9 symbols/min [2025-10-10T22:43:52.491219] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:52.491853] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:52.491355] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:52.546171] [DEBUG] [LOCAL ] TFIN: Loaded 23854 existing records from primary storage. [2025-10-10T22:43:52.546814] [DEBUG] [LOCAL ] TFII: Loaded 33845 existing records from primary storage. [2025-10-10T22:43:52.547085] [INFO ] [MAIN ] TFIN: Loaded 23854 primary data records. [2025-10-10T22:43:52.547194] [INFO ] [MAIN ] TFII: Loaded 33845 primary data records. [2025-10-10T22:43:52.768336] [DEBUG] [LOCAL ] TFPM: Loaded 39256 existing records from primary storage. [2025-10-10T22:43:52.800524] [INFO ] [MAIN ] TFPM: Loaded 39256 primary data records. [2025-10-10T22:43:53.521445] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:53.522719] [INFO ] [MAIN ] TFIN: Generated 1820 derivative records from 23854 primary records. [2025-10-10T22:43:53.537086] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:53.536630] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-10T22:43:53.538574] [INFO ] [MAIN ] TFII: Generated 1820 derivative records from 33845 primary records. [2025-10-10T22:43:53.539073] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-10T22:43:53.556087] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1820 records). [2025-10-10T22:43:53.557372] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-10T22:43:53.568379] [INFO ] [MAIN ] Derivative Progress: 1546/1823 symbols completed. TFIN took 1.1s. Estimated remaining: 1m 45s. Rate: 157.7 symbols/min [2025-10-10T22:43:53.572755] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:53.587952] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:53.589533] [INFO ] [MAIN ] TFPM: Generated 1820 derivative records from 39256 primary records. [2025-10-10T22:43:53.589911] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-10T22:43:53.592167] [DEBUG] [LOCAL ] TFII: Derivative data saved (1820 records). [2025-10-10T22:43:53.599713] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-10T22:43:53.602204] [INFO ] [MAIN ] Derivative Progress: 1547/1823 symbols completed. TFII took 1.1s. Estimated remaining: 1m 45s. Rate: 157.8 symbols/min [2025-10-10T22:43:53.606276] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:53.611209] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1820 records). [2025-10-10T22:43:53.611309] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-10T22:43:53.613573] [INFO ] [MAIN ] Derivative Progress: 1548/1823 symbols completed. TFPM took 1.1s. Estimated remaining: 1m 44s. Rate: 157.9 symbols/min [2025-10-10T22:43:53.613796] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:53.625463] [DEBUG] [LOCAL ] TG: Loaded 10536 existing records from primary storage. [2025-10-10T22:43:53.625662] [INFO ] [MAIN ] TG: Loaded 10536 primary data records. [2025-10-10T22:43:53.848321] [DEBUG] [LOCAL ] TFX: Loaded 37279 existing records from primary storage. [2025-10-10T22:43:53.848638] [INFO ] [MAIN ] TFX: Loaded 37279 primary data records. [2025-10-10T22:43:53.987022] [DEBUG] [LOCAL ] TGLS: Loaded 27913 existing records from primary storage. [2025-10-10T22:43:54.013597] [INFO ] [MAIN ] TGLS: Loaded 27913 primary data records. [2025-10-10T22:43:54.670296] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:54.671510] [INFO ] [MAIN ] TG: Generated 1820 derivative records from 10536 primary records. [2025-10-10T22:43:54.671983] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-10T22:43:54.689533] [DEBUG] [LOCAL ] TG: Derivative data saved (1820 records). [2025-10-10T22:43:54.690384] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-10T22:43:54.692440] [INFO ] [MAIN ] Derivative Progress: 1549/1823 symbols completed. TG took 1.1s. Estimated remaining: 1m 44s. Rate: 157.7 symbols/min [2025-10-10T22:43:54.692816] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:54.711771] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:54.712904] [INFO ] [MAIN ] TFX: Generated 1820 derivative records from 37279 primary records. [2025-10-10T22:43:54.713088] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-10T22:43:54.733258] [DEBUG] [LOCAL ] TFX: Derivative data saved (1820 records). [2025-10-10T22:43:54.733591] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-10T22:43:54.735792] [INFO ] [MAIN ] Derivative Progress: 1550/1823 symbols completed. TFX took 1.2s. Estimated remaining: 1m 44s. Rate: 157.8 symbols/min [2025-10-10T22:43:54.749037] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:54.749396] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:54.750938] [INFO ] [MAIN ] TGLS: Generated 1820 derivative records from 27913 primary records. [2025-10-10T22:43:54.751019] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-10T22:43:54.780927] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1820 records). [2025-10-10T22:43:54.793343] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-10T22:43:54.796911] [INFO ] [MAIN ] Derivative Progress: 1551/1823 symbols completed. TGLS took 1.2s. Estimated remaining: 1m 43s. Rate: 157.9 symbols/min [2025-10-10T22:43:54.798570] [DEBUG] [LOCAL ] TGNA: Loaded 49361 existing records from primary storage. [2025-10-10T22:43:54.798891] [INFO ] [MAIN ] TGNA: Loaded 49361 primary data records. [2025-10-10T22:43:54.797275] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:54.966774] [DEBUG] [LOCAL ] TGS: Loaded 33559 existing records from primary storage. [2025-10-10T22:43:55.047853] [INFO ] [MAIN ] TGS: Loaded 33559 primary data records. [2025-10-10T22:43:55.299943] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-10-10T22:43:55.313499] [INFO ] [MAIN ] TGT: Loaded 54558 primary data records. [2025-10-10T22:43:55.811941] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:55.813111] [INFO ] [MAIN ] TGNA: Generated 1820 derivative records from 49361 primary records. [2025-10-10T22:43:55.813361] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-10T22:43:55.836137] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1820 records). [2025-10-10T22:43:55.838897] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-10T22:43:55.841567] [INFO ] [MAIN ] Derivative Progress: 1552/1823 symbols completed. TGNA took 1.1s. Estimated remaining: 1m 43s. Rate: 157.7 symbols/min [2025-10-10T22:43:55.855736] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:55.857769] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:55.859035] [INFO ] [MAIN ] TGS: Generated 1820 derivative records from 33559 primary records. [2025-10-10T22:43:55.859390] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-10T22:43:55.882034] [DEBUG] [LOCAL ] TGS: Derivative data saved (1820 records). [2025-10-10T22:43:55.890248] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-10T22:43:55.898076] [INFO ] [MAIN ] Derivative Progress: 1553/1823 symbols completed. TGS took 1.1s. Estimated remaining: 1m 43s. Rate: 157.8 symbols/min [2025-10-10T22:43:55.898348] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:55.899607] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:55.900714] [INFO ] [MAIN ] TGT: Generated 1820 derivative records from 54558 primary records. [2025-10-10T22:43:55.900785] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-10T22:43:55.919094] [DEBUG] [LOCAL ] TGT: Derivative data saved (1820 records). [2025-10-10T22:43:55.919202] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-10T22:43:55.921452] [INFO ] [MAIN ] Derivative Progress: 1554/1823 symbols completed. TGT took 1.1s. Estimated remaining: 1m 42s. Rate: 157.9 symbols/min [2025-10-10T22:43:55.938889] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:55.943572] [DEBUG] [LOCAL ] THIR: Loaded 2341 existing records from primary storage. [2025-10-10T22:43:55.943862] [INFO ] [MAIN ] THIR: Loaded 2341 primary data records. [2025-10-10T22:43:56.010404] [DEBUG] [LOCAL ] THG: Loaded 21827 existing records from primary storage. [2025-10-10T22:43:56.048722] [INFO ] [MAIN ] THG: Loaded 21827 primary data records. [2025-10-10T22:43:56.066406] [DEBUG] [LOCAL ] THC: Loaded 47996 existing records from primary storage. [2025-10-10T22:43:56.088391] [INFO ] [MAIN ] THC: Loaded 47996 primary data records. [2025-10-10T22:43:57.019202] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7803 incomplete bins [2025-10-10T22:43:57.039379] [INFO ] [MAIN ] THIR: Generated 1811 derivative records from 2341 primary records. [2025-10-10T22:43:57.025834] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:57.039585] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-10T22:43:57.041633] [INFO ] [MAIN ] THG: Generated 1820 derivative records from 21827 primary records. [2025-10-10T22:43:57.042182] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-10T22:43:57.042671] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:57.058418] [DEBUG] [LOCAL ] THIR: Derivative data saved (1811 records). [2025-10-10T22:43:57.054253] [INFO ] [MAIN ] THC: Generated 1820 derivative records from 47996 primary records. [2025-10-10T22:43:57.058530] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-10T22:43:57.060739] [INFO ] [MAIN ] Derivative Progress: 1555/1823 symbols completed. THIR took 1.1s. Estimated remaining: 1m 42s. Rate: 157.7 symbols/min [2025-10-10T22:43:57.058631] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-10T22:43:57.062284] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:57.095693] [DEBUG] [LOCAL ] THC: Derivative data saved (1820 records). [2025-10-10T22:43:57.095517] [DEBUG] [LOCAL ] THG: Derivative data saved (1820 records). [2025-10-10T22:43:57.095960] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-10T22:43:57.099287] [INFO ] [MAIN ] Derivative Progress: 1556/1823 symbols completed. THG took 1.2s. Estimated remaining: 1m 42s. Rate: 157.8 symbols/min [2025-10-10T22:43:57.099636] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:57.099470] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-10T22:43:57.102353] [INFO ] [MAIN ] Derivative Progress: 1557/1823 symbols completed. THC took 1.2s. Estimated remaining: 1m 41s. Rate: 157.9 symbols/min [2025-10-10T22:43:57.103855] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:57.107056] [DEBUG] [LOCAL ] THLV: Loaded 1560 existing records from primary storage. [2025-10-10T22:43:57.107394] [INFO ] [MAIN ] THLV: Loaded 1560 primary data records. [2025-10-10T22:43:57.437571] [DEBUG] [LOCAL ] THQ: Loaded 25525 existing records from primary storage. [2025-10-10T22:43:57.439234] [INFO ] [MAIN ] THQ: Loaded 25525 primary data records. [2025-10-10T22:43:57.514052] [DEBUG] [LOCAL ] THO: Loaded 42217 existing records from primary storage. [2025-10-10T22:43:57.541689] [INFO ] [MAIN ] THO: Loaded 42217 primary data records. [2025-10-10T22:43:58.139275] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:43:58.141380] [INFO ] [MAIN ] THLV: Generated 1819 derivative records from 1560 primary records. [2025-10-10T22:43:58.143220] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-10T22:43:58.159603] [DEBUG] [LOCAL ] THLV: Derivative data saved (1819 records). [2025-10-10T22:43:58.160069] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-10T22:43:58.162309] [INFO ] [MAIN ] Derivative Progress: 1558/1823 symbols completed. THLV took 1.1s. Estimated remaining: 1m 41s. Rate: 157.7 symbols/min [2025-10-10T22:43:58.179725] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:58.180442] [INFO ] [MAIN ] THQ: Generated 1820 derivative records from 25525 primary records. [2025-10-10T22:43:58.180584] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-10T22:43:58.199984] [DEBUG] [LOCAL ] THQ: Derivative data saved (1820 records). [2025-10-10T22:43:58.200856] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-10T22:43:58.202903] [INFO ] [MAIN ] Derivative Progress: 1559/1823 symbols completed. THQ took 1.1s. Estimated remaining: 1m 40s. Rate: 157.8 symbols/min [2025-10-10T22:43:58.215836] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:58.216477] [INFO ] [MAIN ] THO: Generated 1820 derivative records from 42217 primary records. [2025-10-10T22:43:58.216538] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-10T22:43:58.232109] [DEBUG] [LOCAL ] THO: Derivative data saved (1820 records). [2025-10-10T22:43:58.232173] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-10T22:43:58.234176] [INFO ] [MAIN ] Derivative Progress: 1560/1823 symbols completed. THO took 1.1s. Estimated remaining: 1m 40s. Rate: 157.9 symbols/min [2025-10-10T22:43:58.234674] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:58.235195] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:58.234853] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:58.272048] [DEBUG] [LOCAL ] THR: Loaded 20063 existing records from primary storage. [2025-10-10T22:43:58.273038] [DEBUG] [LOCAL ] THW: Loaded 19931 existing records from primary storage. [2025-10-10T22:43:58.273133] [INFO ] [MAIN ] THR: Loaded 20063 primary data records. [2025-10-10T22:43:58.273306] [INFO ] [MAIN ] THW: Loaded 19931 primary data records. [2025-10-10T22:43:58.532989] [DEBUG] [LOCAL ] THS: Loaded 38977 existing records from primary storage. [2025-10-10T22:43:58.598739] [INFO ] [MAIN ] THS: Loaded 38977 primary data records. [2025-10-10T22:43:59.315340] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:59.317449] [INFO ] [MAIN ] THW: Generated 1820 derivative records from 19931 primary records. [2025-10-10T22:43:59.318528] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-10T22:43:59.335848] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:59.345241] [INFO ] [MAIN ] THR: Generated 1820 derivative records from 20063 primary records. [2025-10-10T22:43:59.345842] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-10T22:43:59.376429] [DEBUG] [LOCAL ] THW: Derivative data saved (1820 records). [2025-10-10T22:43:59.374522] [DEBUG] [LOCAL ] THR: Derivative data saved (1820 records). [2025-10-10T22:43:59.377876] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-10T22:43:59.381083] [INFO ] [MAIN ] Derivative Progress: 1561/1823 symbols completed. THW took 1.1s. Estimated remaining: 1m 40s. Rate: 157.7 symbols/min [2025-10-10T22:43:59.378006] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-10T22:43:59.381288] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:59.384240] [INFO ] [MAIN ] Derivative Progress: 1562/1823 symbols completed. THR took 1.1s. Estimated remaining: 1m 39s. Rate: 157.8 symbols/min [2025-10-10T22:43:59.384684] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:59.403815] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:43:59.405062] [INFO ] [MAIN ] THS: Generated 1820 derivative records from 38977 primary records. [2025-10-10T22:43:59.405256] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-10T22:43:59.412134] [DEBUG] [LOCAL ] TISI: Loaded 3496 existing records from primary storage. [2025-10-10T22:43:59.412595] [INFO ] [MAIN ] TISI: Loaded 3496 primary data records. [2025-10-10T22:43:59.551117] [DEBUG] [LOCAL ] THS: Derivative data saved (1820 records). [2025-10-10T22:43:59.557393] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-10T22:43:59.576554] [INFO ] [MAIN ] Derivative Progress: 1563/1823 symbols completed. THS took 1.3s. Estimated remaining: 1m 39s. Rate: 157.8 symbols/min [2025-10-10T22:43:59.582050] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:43:59.761045] [DEBUG] [LOCAL ] TIMB: Loaded 36068 existing records from primary storage. [2025-10-10T22:43:59.774515] [INFO ] [MAIN ] TIMB: Loaded 36068 primary data records. [2025-10-10T22:43:59.977614] [DEBUG] [LOCAL ] TIXT: Loaded 32473 existing records from primary storage. [2025-10-10T22:44:00.097190] [INFO ] [MAIN ] TIXT: Loaded 32473 primary data records. [2025-10-10T22:44:00.415928] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:00.416836] [INFO ] [MAIN ] TISI: Generated 1820 derivative records from 3496 primary records. [2025-10-10T22:44:00.418121] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-10T22:44:00.434877] [DEBUG] [LOCAL ] TISI: Derivative data saved (1820 records). [2025-10-10T22:44:00.435351] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-10T22:44:00.437489] [INFO ] [MAIN ] Derivative Progress: 1564/1823 symbols completed. TISI took 1.1s. Estimated remaining: 1m 39s. Rate: 157.7 symbols/min [2025-10-10T22:44:00.437963] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:00.460400] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:00.461605] [INFO ] [MAIN ] TIMB: Generated 1820 derivative records from 36068 primary records. [2025-10-10T22:44:00.461779] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-10T22:44:00.481876] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1820 records). [2025-10-10T22:44:00.482161] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-10T22:44:00.484624] [INFO ] [MAIN ] Derivative Progress: 1565/1823 symbols completed. TIMB took 1.1s. Estimated remaining: 1m 38s. Rate: 157.8 symbols/min [2025-10-10T22:44:00.484948] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:00.501681] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:00.502490] [INFO ] [MAIN ] TIXT: Generated 1820 derivative records from 32473 primary records. [2025-10-10T22:44:00.502703] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-10T22:44:00.533856] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1820 records). [2025-10-10T22:44:00.534068] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-10T22:44:00.536201] [INFO ] [MAIN ] Derivative Progress: 1566/1823 symbols completed. TIXT took 1.0s. Estimated remaining: 1m 38s. Rate: 157.9 symbols/min [2025-10-10T22:44:00.544188] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:00.561949] [DEBUG] [LOCAL ] TJX: Loaded 54447 existing records from primary storage. [2025-10-10T22:44:00.562104] [INFO ] [MAIN ] TJX: Loaded 54447 primary data records. [2025-10-10T22:44:00.628795] [DEBUG] [LOCAL ] TK: Loaded 39728 existing records from primary storage. [2025-10-10T22:44:00.664345] [INFO ] [MAIN ] TK: Loaded 39728 primary data records. [2025-10-10T22:44:01.034858] [DEBUG] [LOCAL ] TKC: Loaded 39807 existing records from primary storage. [2025-10-10T22:44:01.066023] [INFO ] [MAIN ] TKC: Loaded 39807 primary data records. [2025-10-10T22:44:01.542316] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:01.543724] [INFO ] [MAIN ] TJX: Generated 1820 derivative records from 54447 primary records. [2025-10-10T22:44:01.545164] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-10T22:44:01.562665] [DEBUG] [LOCAL ] TJX: Derivative data saved (1820 records). [2025-10-10T22:44:01.564014] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-10T22:44:01.566074] [INFO ] [MAIN ] Derivative Progress: 1567/1823 symbols completed. TJX took 1.1s. Estimated remaining: 1m 37s. Rate: 157.7 symbols/min [2025-10-10T22:44:01.566409] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:01.588701] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:01.589636] [INFO ] [MAIN ] TK: Generated 1820 derivative records from 39728 primary records. [2025-10-10T22:44:01.589983] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-10T22:44:01.621433] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:01.623460] [INFO ] [MAIN ] TKC: Generated 1820 derivative records from 39807 primary records. [2025-10-10T22:44:01.623915] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-10T22:44:01.643324] [DEBUG] [LOCAL ] TK: Derivative data saved (1820 records). [2025-10-10T22:44:01.647890] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-10T22:44:01.651951] [INFO ] [MAIN ] Derivative Progress: 1568/1823 symbols completed. TK took 1.2s. Estimated remaining: 1m 37s. Rate: 157.8 symbols/min [2025-10-10T22:44:01.653693] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:01.654810] [DEBUG] [LOCAL ] TKC: Derivative data saved (1820 records). [2025-10-10T22:44:01.655054] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-10T22:44:01.670863] [INFO ] [MAIN ] Derivative Progress: 1569/1823 symbols completed. TKC took 1.1s. Estimated remaining: 1m 37s. Rate: 157.9 symbols/min [2025-10-10T22:44:01.671130] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:01.672365] [DEBUG] [LOCAL ] TKO: Loaded 44571 existing records from primary storage. [2025-10-10T22:44:01.672782] [INFO ] [MAIN ] TKO: Loaded 44571 primary data records. [2025-10-10T22:44:02.053608] [DEBUG] [LOCAL ] TKR: Loaded 40474 existing records from primary storage. [2025-10-10T22:44:02.054506] [INFO ] [MAIN ] TKR: Loaded 40474 primary data records. [2025-10-10T22:44:02.054360] [DEBUG] [LOCAL ] TLK: Loaded 39321 existing records from primary storage. [2025-10-10T22:44:02.066158] [INFO ] [MAIN ] TLK: Loaded 39321 primary data records. [2025-10-10T22:44:02.748867] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:02.750312] [INFO ] [MAIN ] TKO: Generated 1820 derivative records from 44571 primary records. [2025-10-10T22:44:02.750536] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-10T22:44:02.773786] [DEBUG] [LOCAL ] TKO: Derivative data saved (1820 records). [2025-10-10T22:44:02.781673] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-10T22:44:02.788351] [INFO ] [MAIN ] Derivative Progress: 1570/1823 symbols completed. TKO took 1.2s. Estimated remaining: 1m 36s. Rate: 157.7 symbols/min [2025-10-10T22:44:02.790302] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:02.791814] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:02.793675] [INFO ] [MAIN ] TLK: Generated 1820 derivative records from 39321 primary records. [2025-10-10T22:44:02.793839] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-10T22:44:02.823485] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:02.825014] [INFO ] [MAIN ] TKR: Generated 1820 derivative records from 40474 primary records. [2025-10-10T22:44:02.825247] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-10T22:44:02.827805] [DEBUG] [LOCAL ] TLK: Derivative data saved (1820 records). [2025-10-10T22:44:02.833682] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-10T22:44:02.835827] [INFO ] [MAIN ] Derivative Progress: 1571/1823 symbols completed. TLK took 1.2s. Estimated remaining: 1m 36s. Rate: 157.8 symbols/min [2025-10-10T22:44:02.851543] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:02.861610] [DEBUG] [LOCAL ] TKR: Derivative data saved (1820 records). [2025-10-10T22:44:02.862731] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-10T22:44:02.865017] [INFO ] [MAIN ] Derivative Progress: 1572/1823 symbols completed. TKR took 1.2s. Estimated remaining: 1m 35s. Rate: 157.9 symbols/min [2025-10-10T22:44:02.862391] [DEBUG] [LOCAL ] TLYS: Loaded 16650 existing records from primary storage. [2025-10-10T22:44:02.865177] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:02.865506] [INFO ] [MAIN ] TLYS: Loaded 16650 primary data records. [2025-10-10T22:44:03.205507] [DEBUG] [LOCAL ] TM: Loaded 36916 existing records from primary storage. [2025-10-10T22:44:03.206361] [INFO ] [MAIN ] TM: Loaded 36916 primary data records. [2025-10-10T22:44:03.325140] [DEBUG] [LOCAL ] TME: Loaded 53957 existing records from primary storage. [2025-10-10T22:44:03.334221] [INFO ] [MAIN ] TME: Loaded 53957 primary data records. [2025-10-10T22:44:03.865629] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:03.866810] [INFO ] [MAIN ] TLYS: Generated 1820 derivative records from 16650 primary records. [2025-10-10T22:44:03.866994] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-10T22:44:03.889468] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1820 records). [2025-10-10T22:44:03.890304] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-10T22:44:03.892607] [INFO ] [MAIN ] Derivative Progress: 1573/1823 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 35s. Rate: 157.7 symbols/min [2025-10-10T22:44:03.907014] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:03.907807] [INFO ] [MAIN ] TM: Generated 1820 derivative records from 36916 primary records. [2025-10-10T22:44:03.907951] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-10T22:44:03.925580] [DEBUG] [LOCAL ] TM: Derivative data saved (1820 records). [2025-10-10T22:44:03.926104] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-10T22:44:03.928275] [INFO ] [MAIN ] Derivative Progress: 1574/1823 symbols completed. TM took 1.1s. Estimated remaining: 1m 35s. Rate: 157.8 symbols/min [2025-10-10T22:44:03.941589] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:03.942210] [INFO ] [MAIN ] TME: Generated 1820 derivative records from 53957 primary records. [2025-10-10T22:44:03.942269] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-10T22:44:03.957745] [DEBUG] [LOCAL ] TME: Derivative data saved (1820 records). [2025-10-10T22:44:03.957802] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-10T22:44:03.960049] [INFO ] [MAIN ] Derivative Progress: 1575/1823 symbols completed. TME took 1.1s. Estimated remaining: 1m 34s. Rate: 157.9 symbols/min [2025-10-10T22:44:03.960781] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:03.960698] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:03.960633] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:03.978472] [DEBUG] [LOCAL ] TNC: Loaded 14744 existing records from primary storage. [2025-10-10T22:44:03.978795] [INFO ] [MAIN ] TNC: Loaded 14744 primary data records. [2025-10-10T22:44:04.235813] [DEBUG] [LOCAL ] TMHC: Loaded 45999 existing records from primary storage. [2025-10-10T22:44:04.353262] [INFO ] [MAIN ] TMHC: Loaded 45999 primary data records. [2025-10-10T22:44:04.391989] [DEBUG] [LOCAL ] TMO: Loaded 53169 existing records from primary storage. [2025-10-10T22:44:04.397899] [INFO ] [MAIN ] TMO: Loaded 53169 primary data records. [2025-10-10T22:44:05.011405] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:05.012723] [INFO ] [MAIN ] TNC: Generated 1820 derivative records from 14744 primary records. [2025-10-10T22:44:05.013431] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-10T22:44:05.034532] [DEBUG] [LOCAL ] TNC: Derivative data saved (1820 records). [2025-10-10T22:44:05.034846] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-10T22:44:05.037477] [INFO ] [MAIN ] Derivative Progress: 1576/1823 symbols completed. TNC took 1.1s. Estimated remaining: 1m 34s. Rate: 157.7 symbols/min [2025-10-10T22:44:05.037847] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:05.056117] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:05.069020] [INFO ] [MAIN ] TMHC: Generated 1820 derivative records from 45999 primary records. [2025-10-10T22:44:05.069525] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:05.070176] [INFO ] [MAIN ] TMO: Generated 1820 derivative records from 53169 primary records. [2025-10-10T22:44:05.069292] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-10T22:44:05.070282] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-10T22:44:05.098042] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1820 records). [2025-10-10T22:44:05.098798] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-10T22:44:05.101111] [INFO ] [MAIN ] Derivative Progress: 1577/1823 symbols completed. TMHC took 1.1s. Estimated remaining: 1m 34s. Rate: 157.8 symbols/min [2025-10-10T22:44:05.109215] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:05.113385] [DEBUG] [LOCAL ] TMO: Derivative data saved (1820 records). [2025-10-10T22:44:05.113611] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-10T22:44:05.115906] [INFO ] [MAIN ] Derivative Progress: 1578/1823 symbols completed. TMO took 1.2s. Estimated remaining: 1m 33s. Rate: 157.9 symbols/min [2025-10-10T22:44:05.116119] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:05.126696] [DEBUG] [LOCAL ] TNET: Loaded 28679 existing records from primary storage. [2025-10-10T22:44:05.127052] [INFO ] [MAIN ] TNET: Loaded 28679 primary data records. [2025-10-10T22:44:05.342604] [DEBUG] [LOCAL ] TNK: Loaded 35697 existing records from primary storage. [2025-10-10T22:44:05.445158] [INFO ] [MAIN ] TNK: Loaded 35697 primary data records. [2025-10-10T22:44:05.571707] [DEBUG] [LOCAL ] TNL: Loaded 42370 existing records from primary storage. [2025-10-10T22:44:05.572520] [INFO ] [MAIN ] TNL: Loaded 42370 primary data records. [2025-10-10T22:44:06.186093] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:06.188412] [INFO ] [MAIN ] TNET: Generated 1820 derivative records from 28679 primary records. [2025-10-10T22:44:06.188558] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-10T22:44:06.209857] [DEBUG] [LOCAL ] TNET: Derivative data saved (1820 records). [2025-10-10T22:44:06.210091] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-10T22:44:06.212751] [INFO ] [MAIN ] Derivative Progress: 1579/1823 symbols completed. TNET took 1.2s. Estimated remaining: 1m 33s. Rate: 157.7 symbols/min [2025-10-10T22:44:06.215114] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:06.231823] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:06.232983] [INFO ] [MAIN ] TNK: Generated 1820 derivative records from 35697 primary records. [2025-10-10T22:44:06.234164] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-10T22:44:06.266042] [DEBUG] [LOCAL ] TNK: Derivative data saved (1820 records). [2025-10-10T22:44:06.266953] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-10T22:44:06.266366] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:06.270167] [INFO ] [MAIN ] Derivative Progress: 1580/1823 symbols completed. TNK took 1.2s. Estimated remaining: 1m 32s. Rate: 157.8 symbols/min [2025-10-10T22:44:06.270416] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:06.271469] [INFO ] [MAIN ] TNL: Generated 1820 derivative records from 42370 primary records. [2025-10-10T22:44:06.272051] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-10T22:44:06.294562] [DEBUG] [LOCAL ] TNL: Derivative data saved (1820 records). [2025-10-10T22:44:06.294850] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-10T22:44:06.298968] [INFO ] [MAIN ] Derivative Progress: 1581/1823 symbols completed. TNL took 1.2s. Estimated remaining: 1m 32s. Rate: 157.9 symbols/min [2025-10-10T22:44:06.299319] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:06.345252] [DEBUG] [LOCAL ] TOL: Loaded 51509 existing records from primary storage. [2025-10-10T22:44:06.345592] [INFO ] [MAIN ] TOL: Loaded 51509 primary data records. [2025-10-10T22:44:06.443443] [DEBUG] [LOCAL ] TPB: Loaded 26064 existing records from primary storage. [2025-10-10T22:44:06.449262] [INFO ] [MAIN ] TPB: Loaded 26064 primary data records. [2025-10-10T22:44:06.694267] [DEBUG] [LOCAL ] TOST: Loaded 54463 existing records from primary storage. [2025-10-10T22:44:06.694870] [INFO ] [MAIN ] TOST: Loaded 54463 primary data records. [2025-10-10T22:44:07.411406] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:07.412689] [INFO ] [MAIN ] TOL: Generated 1820 derivative records from 51509 primary records. [2025-10-10T22:44:07.412882] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-10T22:44:07.426542] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:07.439427] [INFO ] [MAIN ] TPB: Generated 1820 derivative records from 26064 primary records. [2025-10-10T22:44:07.443881] [DEBUG] [LOCAL ] TOL: Derivative data saved (1820 records). [2025-10-10T22:44:07.444144] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-10T22:44:07.444084] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-10T22:44:07.448270] [INFO ] [MAIN ] Derivative Progress: 1582/1823 symbols completed. TOL took 1.2s. Estimated remaining: 1m 32s. Rate: 157.7 symbols/min [2025-10-10T22:44:07.450036] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:07.482448] [DEBUG] [LOCAL ] TPB: Derivative data saved (1820 records). [2025-10-10T22:44:07.480609] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:07.482568] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-10T22:44:07.485723] [INFO ] [MAIN ] TOST: Generated 1820 derivative records from 54463 primary records. [2025-10-10T22:44:07.484939] [INFO ] [MAIN ] Derivative Progress: 1583/1823 symbols completed. TPB took 1.2s. Estimated remaining: 1m 31s. Rate: 157.8 symbols/min [2025-10-10T22:44:07.485913] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-10T22:44:07.486082] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:07.504761] [DEBUG] [LOCAL ] TOST: Derivative data saved (1820 records). [2025-10-10T22:44:07.505108] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-10T22:44:07.507941] [INFO ] [MAIN ] Derivative Progress: 1584/1823 symbols completed. TOST took 1.2s. Estimated remaining: 1m 31s. Rate: 157.9 symbols/min [2025-10-10T22:44:07.508154] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:07.541594] [DEBUG] [LOCAL ] TPC: Loaded 39503 existing records from primary storage. [2025-10-10T22:44:07.541798] [INFO ] [MAIN ] TPC: Loaded 39503 primary data records. [2025-10-10T22:44:07.595969] [DEBUG] [LOCAL ] TPL: Loaded 12460 existing records from primary storage. [2025-10-10T22:44:07.663639] [INFO ] [MAIN ] TPL: Loaded 12460 primary data records. [2025-10-10T22:44:07.795405] [DEBUG] [LOCAL ] TPH: Loaded 45574 existing records from primary storage. [2025-10-10T22:44:07.844739] [INFO ] [MAIN ] TPH: Loaded 45574 primary data records. [2025-10-10T22:44:08.569599] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:08.572329] [INFO ] [MAIN ] TPC: Generated 1820 derivative records from 39503 primary records. [2025-10-10T22:44:08.572532] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-10T22:44:08.594221] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:08.599868] [INFO ] [MAIN ] TPL: Generated 1820 derivative records from 12460 primary records. [2025-10-10T22:44:08.599979] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-10T22:44:08.621728] [DEBUG] [LOCAL ] TPC: Derivative data saved (1820 records). [2025-10-10T22:44:08.631453] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-10T22:44:08.639326] [INFO ] [MAIN ] Derivative Progress: 1585/1823 symbols completed. TPC took 1.2s. Estimated remaining: 1m 31s. Rate: 157.7 symbols/min [2025-10-10T22:44:08.640381] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:08.639984] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:08.641640] [INFO ] [MAIN ] TPH: Generated 1820 derivative records from 45574 primary records. [2025-10-10T22:44:08.641834] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-10T22:44:08.644360] [DEBUG] [LOCAL ] TPL: Derivative data saved (1820 records). [2025-10-10T22:44:08.652884] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-10T22:44:08.655639] [INFO ] [MAIN ] Derivative Progress: 1586/1823 symbols completed. TPL took 1.1s. Estimated remaining: 1m 30s. Rate: 157.8 symbols/min [2025-10-10T22:44:08.657520] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:08.665853] [DEBUG] [LOCAL ] TPH: Derivative data saved (1820 records). [2025-10-10T22:44:08.666118] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-10T22:44:08.668536] [INFO ] [MAIN ] Derivative Progress: 1587/1823 symbols completed. TPH took 1.2s. Estimated remaining: 1m 30s. Rate: 157.8 symbols/min [2025-10-10T22:44:08.668834] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:08.683263] [DEBUG] [LOCAL ] TPYP: Loaded 8020 existing records from primary storage. [2025-10-10T22:44:08.683579] [INFO ] [MAIN ] TPYP: Loaded 8020 primary data records. [2025-10-10T22:44:08.864772] [DEBUG] [LOCAL ] TPR: Loaded 54214 existing records from primary storage. [2025-10-10T22:44:08.863831] [DEBUG] [LOCAL ] TPVG: Loaded 27522 existing records from primary storage. [2025-10-10T22:44:08.865318] [INFO ] [MAIN ] TPVG: Loaded 27522 primary data records. [2025-10-10T22:44:08.907123] [INFO ] [MAIN ] TPR: Loaded 54214 primary data records. [2025-10-10T22:44:09.788814] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:09.789959] [INFO ] [MAIN ] TPYP: Generated 1820 derivative records from 8020 primary records. [2025-10-10T22:44:09.790087] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-10T22:44:09.811482] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1820 records). [2025-10-10T22:44:09.825241] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-10T22:44:09.828140] [INFO ] [MAIN ] Derivative Progress: 1588/1823 symbols completed. TPYP took 1.2s. Estimated remaining: 1m 29s. Rate: 157.6 symbols/min [2025-10-10T22:44:09.825856] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:09.829124] [INFO ] [MAIN ] TPVG: Generated 1820 derivative records from 27522 primary records. [2025-10-10T22:44:09.837054] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-10T22:44:09.850146] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:09.855243] [INFO ] [MAIN ] TPR: Generated 1820 derivative records from 54214 primary records. [2025-10-10T22:44:09.857421] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-10T22:44:09.860060] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1820 records). [2025-10-10T22:44:09.860431] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-10T22:44:09.862491] [INFO ] [MAIN ] Derivative Progress: 1589/1823 symbols completed. TPVG took 1.2s. Estimated remaining: 1m 29s. Rate: 157.7 symbols/min [2025-10-10T22:44:09.878323] [DEBUG] [LOCAL ] TPR: Derivative data saved (1820 records). [2025-10-10T22:44:09.878401] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-10T22:44:09.880219] [INFO ] [MAIN ] Derivative Progress: 1590/1823 symbols completed. TPR took 1.2s. Estimated remaining: 1m 29s. Rate: 157.8 symbols/min [2025-10-10T22:44:09.880675] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:09.880791] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:09.880908] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:09.892180] [DEBUG] [LOCAL ] TPZ: Loaded 4896 existing records from primary storage. [2025-10-10T22:44:09.892345] [INFO ] [MAIN ] TPZ: Loaded 4896 primary data records. [2025-10-10T22:44:10.007747] [DEBUG] [LOCAL ] TRAK: Loaded 9733 existing records from primary storage. [2025-10-10T22:44:10.007972] [INFO ] [MAIN ] TRAK: Loaded 9733 primary data records. [2025-10-10T22:44:10.121414] [DEBUG] [LOCAL ] TR: Loaded 19014 existing records from primary storage. [2025-10-10T22:44:10.136300] [INFO ] [MAIN ] TR: Loaded 19014 primary data records. [2025-10-10T22:44:10.895540] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:44:10.910822] [INFO ] [MAIN ] TPZ: Generated 1819 derivative records from 4896 primary records. [2025-10-10T22:44:10.911927] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-10T22:44:10.911405] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:10.913986] [INFO ] [MAIN ] TRAK: Generated 1820 derivative records from 9733 primary records. [2025-10-10T22:44:10.924020] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-10T22:44:10.961423] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1820 records). [2025-10-10T22:44:10.961939] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:10.962439] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-10T22:44:10.965480] [INFO ] [MAIN ] Derivative Progress: 1591/1823 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 28s. Rate: 157.6 symbols/min [2025-10-10T22:44:10.963281] [INFO ] [MAIN ] TR: Generated 1820 derivative records from 19014 primary records. [2025-10-10T22:44:10.966291] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-10T22:44:10.967567] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1819 records). [2025-10-10T22:44:10.968622] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-10T22:44:10.967954] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:10.972138] [INFO ] [MAIN ] Derivative Progress: 1592/1823 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 28s. Rate: 157.7 symbols/min [2025-10-10T22:44:10.981397] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:10.994954] [DEBUG] [LOCAL ] TR: Derivative data saved (1820 records). [2025-10-10T22:44:10.995145] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-10T22:44:10.997239] [INFO ] [MAIN ] Derivative Progress: 1593/1823 symbols completed. TR took 1.1s. Estimated remaining: 1m 27s. Rate: 157.8 symbols/min [2025-10-10T22:44:10.997591] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:11.007806] [DEBUG] [LOCAL ] TRC: Loaded 15818 existing records from primary storage. [2025-10-10T22:44:11.008366] [INFO ] [MAIN ] TRC: Loaded 15818 primary data records. [2025-10-10T22:44:11.375404] [DEBUG] [LOCAL ] TREX: Loaded 50610 existing records from primary storage. [2025-10-10T22:44:11.376733] [INFO ] [MAIN ] TREX: Loaded 50610 primary data records. [2025-10-10T22:44:11.469773] [DEBUG] [LOCAL ] TRGP: Loaded 51543 existing records from primary storage. [2025-10-10T22:44:11.475807] [INFO ] [MAIN ] TRGP: Loaded 51543 primary data records. [2025-10-10T22:44:12.074107] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:12.076851] [INFO ] [MAIN ] TRC: Generated 1820 derivative records from 15818 primary records. [2025-10-10T22:44:12.077973] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-10T22:44:12.097679] [DEBUG] [LOCAL ] TRC: Derivative data saved (1820 records). [2025-10-10T22:44:12.098339] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-10T22:44:12.100763] [INFO ] [MAIN ] Derivative Progress: 1594/1823 symbols completed. TRC took 1.1s. Estimated remaining: 1m 27s. Rate: 157.6 symbols/min [2025-10-10T22:44:12.100931] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:12.122556] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:12.123553] [INFO ] [MAIN ] TREX: Generated 1820 derivative records from 50610 primary records. [2025-10-10T22:44:12.123974] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-10T22:44:12.154284] [DEBUG] [LOCAL ] TREX: Derivative data saved (1820 records). [2025-10-10T22:44:12.154619] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-10T22:44:12.157364] [INFO ] [MAIN ] Derivative Progress: 1595/1823 symbols completed. TREX took 1.2s. Estimated remaining: 1m 27s. Rate: 157.7 symbols/min [2025-10-10T22:44:12.157745] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:12.182788] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:12.183629] [DEBUG] [LOCAL ] TRN: Loaded 37274 existing records from primary storage. [2025-10-10T22:44:12.184395] [INFO ] [MAIN ] TRGP: Generated 1820 derivative records from 51543 primary records. [2025-10-10T22:44:12.184631] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-10T22:44:12.183758] [INFO ] [MAIN ] TRN: Loaded 37274 primary data records. [2025-10-10T22:44:12.393341] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1820 records). [2025-10-10T22:44:12.409860] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-10T22:44:12.435924] [INFO ] [MAIN ] Derivative Progress: 1596/1823 symbols completed. TRGP took 1.4s. Estimated remaining: 1m 26s. Rate: 157.8 symbols/min [2025-10-10T22:44:12.547194] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:12.550075] [DEBUG] [LOCAL ] TRNO: Loaded 44485 existing records from primary storage. [2025-10-10T22:44:12.551005] [INFO ] [MAIN ] TRNO: Loaded 44485 primary data records. [2025-10-10T22:44:12.916795] [DEBUG] [LOCAL ] TROX: Loaded 52739 existing records from primary storage. [2025-10-10T22:44:12.918860] [INFO ] [MAIN ] TROX: Loaded 52739 primary data records. [2025-10-10T22:44:12.925230] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:12.964164] [INFO ] [MAIN ] TRN: Generated 1820 derivative records from 37274 primary records. [2025-10-10T22:44:12.986394] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-10T22:44:13.057797] [DEBUG] [LOCAL ] TRN: Derivative data saved (1820 records). [2025-10-10T22:44:13.058290] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-10T22:44:13.060665] [INFO ] [MAIN ] Derivative Progress: 1597/1823 symbols completed. TRN took 1.0s. Estimated remaining: 1m 26s. Rate: 157.7 symbols/min [2025-10-10T22:44:13.072321] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:13.307169] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:13.308874] [INFO ] [MAIN ] TRNO: Generated 1820 derivative records from 44485 primary records. [2025-10-10T22:44:13.309168] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-10T22:44:13.343153] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1820 records). [2025-10-10T22:44:13.343399] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-10T22:44:13.345320] [INFO ] [MAIN ] Derivative Progress: 1598/1823 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 26s. Rate: 157.7 symbols/min [2025-10-10T22:44:13.346523] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:13.364016] [DEBUG] [LOCAL ] TRP: Loaded 52912 existing records from primary storage. [2025-10-10T22:44:13.364353] [INFO ] [MAIN ] TRP: Loaded 52912 primary data records. [2025-10-10T22:44:13.486573] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:13.518461] [INFO ] [MAIN ] TROX: Generated 1820 derivative records from 52739 primary records. [2025-10-10T22:44:13.580440] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-10T22:44:13.706214] [DEBUG] [LOCAL ] TRTX: Loaded 37988 existing records from primary storage. [2025-10-10T22:44:13.707204] [INFO ] [MAIN ] TRTX: Loaded 37988 primary data records. [2025-10-10T22:44:13.831424] [DEBUG] [LOCAL ] TROX: Derivative data saved (1820 records). [2025-10-10T22:44:13.837385] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-10T22:44:13.852442] [INFO ] [MAIN ] Derivative Progress: 1599/1823 symbols completed. TROX took 1.3s. Estimated remaining: 1m 25s. Rate: 157.7 symbols/min [2025-10-10T22:44:13.878984] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:14.069443] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:14.071169] [INFO ] [MAIN ] TRP: Generated 1820 derivative records from 52912 primary records. [2025-10-10T22:44:14.071395] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-10T22:44:14.109438] [DEBUG] [LOCAL ] TRP: Derivative data saved (1820 records). [2025-10-10T22:44:14.109879] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-10T22:44:14.116288] [INFO ] [MAIN ] Derivative Progress: 1600/1823 symbols completed. TRP took 1.0s. Estimated remaining: 1m 25s. Rate: 157.7 symbols/min [2025-10-10T22:44:14.131217] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:14.147348] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:14.149802] [INFO ] [MAIN ] TRTX: Generated 1820 derivative records from 37988 primary records. [2025-10-10T22:44:14.150045] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-10T22:44:14.148921] [DEBUG] [LOCAL ] TRU: Loaded 52113 existing records from primary storage. [2025-10-10T22:44:14.151049] [INFO ] [MAIN ] TRU: Loaded 52113 primary data records. [2025-10-10T22:44:14.285352] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1820 records). [2025-10-10T22:44:14.339197] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-10T22:44:14.364835] [INFO ] [MAIN ] Derivative Progress: 1601/1823 symbols completed. TRTX took 1.0s. Estimated remaining: 1m 24s. Rate: 157.8 symbols/min [2025-10-10T22:44:14.378081] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:14.524801] [DEBUG] [LOCAL ] TRV: Loaded 48195 existing records from primary storage. [2025-10-10T22:44:14.525488] [INFO ] [MAIN ] TRV: Loaded 48195 primary data records. [2025-10-10T22:44:14.921817] [DEBUG] [LOCAL ] TS: Loaded 52435 existing records from primary storage. [2025-10-10T22:44:14.922553] [INFO ] [MAIN ] TS: Loaded 52435 primary data records. [2025-10-10T22:44:14.923227] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:14.937159] [INFO ] [MAIN ] TRU: Generated 1820 derivative records from 52113 primary records. [2025-10-10T22:44:14.995603] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-10T22:44:15.112631] [DEBUG] [LOCAL ] TRU: Derivative data saved (1820 records). [2025-10-10T22:44:15.130548] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-10T22:44:15.140500] [INFO ] [MAIN ] Derivative Progress: 1602/1823 symbols completed. TRU took 1.3s. Estimated remaining: 1m 24s. Rate: 157.6 symbols/min [2025-10-10T22:44:15.141296] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:15.345486] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:15.348529] [INFO ] [MAIN ] TRV: Generated 1820 derivative records from 48195 primary records. [2025-10-10T22:44:15.349037] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-10T22:44:15.380455] [DEBUG] [LOCAL ] TRV: Derivative data saved (1820 records). [2025-10-10T22:44:15.381008] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-10T22:44:15.384081] [INFO ] [MAIN ] Derivative Progress: 1603/1823 symbols completed. TRV took 1.3s. Estimated remaining: 1m 24s. Rate: 157.7 symbols/min [2025-10-10T22:44:15.394954] [DEBUG] [LOCAL ] TSE: Loaded 28282 existing records from primary storage. [2025-10-10T22:44:15.395400] [INFO ] [MAIN ] TSE: Loaded 28282 primary data records. [2025-10-10T22:44:15.583357] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:15.599848] [INFO ] [MAIN ] TS: Generated 1820 derivative records from 52435 primary records. [2025-10-10T22:44:15.601776] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-10T22:44:15.745519] [DEBUG] [LOCAL ] TS: Derivative data saved (1820 records). [2025-10-10T22:44:15.746152] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-10T22:44:15.749358] [INFO ] [MAIN ] Derivative Progress: 1604/1823 symbols completed. TS took 1.4s. Estimated remaining: 1m 23s. Rate: 157.7 symbols/min [2025-10-10T22:44:15.774456] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:15.775380] [INFO ] [MAIN ] TSE: Generated 1820 derivative records from 28282 primary records. [2025-10-10T22:44:15.775449] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-10T22:44:15.791855] [DEBUG] [LOCAL ] TSE: Derivative data saved (1820 records). [2025-10-10T22:44:15.791957] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-10T22:44:15.794530] [INFO ] [MAIN ] Derivative Progress: 1605/1823 symbols completed. TSE took 0.7s. Estimated remaining: 1m 23s. Rate: 157.8 symbols/min [2025-10-10T22:44:15.795495] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:15.795351] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:15.795702] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:15.842261] [DEBUG] [LOCAL ] TSLX: Loaded 36037 existing records from primary storage. [2025-10-10T22:44:15.842696] [INFO ] [MAIN ] TSLX: Loaded 36037 primary data records. [2025-10-10T22:44:16.006942] [DEBUG] [LOCAL ] TSN: Loaded 53734 existing records from primary storage. [2025-10-10T22:44:16.021310] [INFO ] [MAIN ] TSN: Loaded 53734 primary data records. [2025-10-10T22:44:16.445407] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-10-10T22:44:16.562355] [INFO ] [MAIN ] TSM: Loaded 54599 primary data records. [2025-10-10T22:44:16.905326] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:16.906978] [INFO ] [MAIN ] TSLX: Generated 1820 derivative records from 36037 primary records. [2025-10-10T22:44:16.907207] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-10T22:44:16.943710] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:16.945340] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1820 records). [2025-10-10T22:44:16.945971] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-10T22:44:16.946957] [INFO ] [MAIN ] TSN: Generated 1820 derivative records from 53734 primary records. [2025-10-10T22:44:16.950090] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-10T22:44:16.949909] [INFO ] [MAIN ] Derivative Progress: 1606/1823 symbols completed. TSLX took 1.2s. Estimated remaining: 1m 23s. Rate: 157.6 symbols/min [2025-10-10T22:44:16.950504] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:16.970042] [DEBUG] [LOCAL ] TSN: Derivative data saved (1820 records). [2025-10-10T22:44:16.970342] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-10T22:44:16.974040] [INFO ] [MAIN ] Derivative Progress: 1607/1823 symbols completed. TSN took 1.2s. Estimated remaining: 1m 22s. Rate: 157.7 symbols/min [2025-10-10T22:44:16.974313] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:17.002340] [DEBUG] [LOCAL ] TSQ: Loaded 11863 existing records from primary storage. [2025-10-10T22:44:17.002829] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:17.003154] [INFO ] [MAIN ] TSQ: Loaded 11863 primary data records. [2025-10-10T22:44:17.004042] [INFO ] [MAIN ] TSM: Generated 1820 derivative records from 54599 primary records. [2025-10-10T22:44:17.004163] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-10T22:44:17.133613] [DEBUG] [LOCAL ] TSM: Derivative data saved (1820 records). [2025-10-10T22:44:17.145194] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-10T22:44:17.166579] [INFO ] [MAIN ] Derivative Progress: 1608/1823 symbols completed. TSM took 1.4s. Estimated remaining: 1m 22s. Rate: 157.7 symbols/min [2025-10-10T22:44:17.206021] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:17.373433] [DEBUG] [LOCAL ] TT: Loaded 48155 existing records from primary storage. [2025-10-10T22:44:17.420749] [INFO ] [MAIN ] TT: Loaded 48155 primary data records. [2025-10-10T22:44:17.780427] [DEBUG] [LOCAL ] TTC: Loaded 42672 existing records from primary storage. [2025-10-10T22:44:17.781136] [INFO ] [MAIN ] TTC: Loaded 42672 primary data records. [2025-10-10T22:44:17.970112] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:17.993617] [INFO ] [MAIN ] TSQ: Generated 1820 derivative records from 11863 primary records. [2025-10-10T22:44:17.993931] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-10T22:44:18.135091] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1820 records). [2025-10-10T22:44:18.135742] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-10T22:44:18.138595] [INFO ] [MAIN ] Derivative Progress: 1609/1823 symbols completed. TSQ took 1.2s. Estimated remaining: 1m 21s. Rate: 157.6 symbols/min [2025-10-10T22:44:18.139335] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:18.160550] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:44:18.161766] [INFO ] [MAIN ] TT: Generated 1819 derivative records from 48155 primary records. [2025-10-10T22:44:18.162094] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-10T22:44:18.184051] [DEBUG] [LOCAL ] TT: Derivative data saved (1819 records). [2025-10-10T22:44:18.184286] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-10T22:44:18.187376] [INFO ] [MAIN ] Derivative Progress: 1610/1823 symbols completed. TT took 1.2s. Estimated remaining: 1m 21s. Rate: 157.6 symbols/min [2025-10-10T22:44:18.187631] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:18.206379] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:18.207426] [INFO ] [MAIN ] TTC: Generated 1820 derivative records from 42672 primary records. [2025-10-10T22:44:18.207588] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-10T22:44:18.241439] [DEBUG] [LOCAL ] TTC: Derivative data saved (1820 records). [2025-10-10T22:44:18.241738] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-10T22:44:18.245023] [INFO ] [MAIN ] Derivative Progress: 1611/1823 symbols completed. TTC took 1.0s. Estimated remaining: 1m 21s. Rate: 157.7 symbols/min [2025-10-10T22:44:18.245961] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:18.263117] [DEBUG] [LOCAL ] TTE: Loaded 52365 existing records from primary storage. [2025-10-10T22:44:18.263628] [INFO ] [MAIN ] TTE: Loaded 52365 primary data records. [2025-10-10T22:44:18.448940] [DEBUG] [LOCAL ] TTI: Loaded 46673 existing records from primary storage. [2025-10-10T22:44:18.449275] [INFO ] [MAIN ] TTI: Loaded 46673 primary data records. [2025-10-10T22:44:18.765596] [DEBUG] [LOCAL ] TU: Loaded 50567 existing records from primary storage. [2025-10-10T22:44:18.777082] [INFO ] [MAIN ] TU: Loaded 50567 primary data records. [2025-10-10T22:44:19.401197] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:19.402320] [INFO ] [MAIN ] TTE: Generated 1820 derivative records from 52365 primary records. [2025-10-10T22:44:19.402539] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-10T22:44:19.426077] [DEBUG] [LOCAL ] TTE: Derivative data saved (1820 records). [2025-10-10T22:44:19.434310] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-10T22:44:19.437674] [INFO ] [MAIN ] Derivative Progress: 1612/1823 symbols completed. TTE took 1.3s. Estimated remaining: 1m 20s. Rate: 157.5 symbols/min [2025-10-10T22:44:19.437853] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:19.444477] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:19.445469] [INFO ] [MAIN ] TTI: Generated 1820 derivative records from 46673 primary records. [2025-10-10T22:44:19.445697] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-10T22:44:19.479087] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:19.481465] [INFO ] [MAIN ] TU: Generated 1820 derivative records from 50567 primary records. [2025-10-10T22:44:19.481857] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-10T22:44:19.484605] [DEBUG] [LOCAL ] TTI: Derivative data saved (1820 records). [2025-10-10T22:44:19.492434] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-10T22:44:19.495488] [INFO ] [MAIN ] Derivative Progress: 1613/1823 symbols completed. TTI took 1.3s. Estimated remaining: 1m 20s. Rate: 157.6 symbols/min [2025-10-10T22:44:19.501100] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:19.528152] [DEBUG] [LOCAL ] TU: Derivative data saved (1820 records). [2025-10-10T22:44:19.528414] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-10T22:44:19.531396] [INFO ] [MAIN ] Derivative Progress: 1614/1823 symbols completed. TU took 1.3s. Estimated remaining: 1m 20s. Rate: 157.7 symbols/min [2025-10-10T22:44:19.531683] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:19.551231] [DEBUG] [LOCAL ] TUYA: Loaded 46611 existing records from primary storage. [2025-10-10T22:44:19.552396] [INFO ] [MAIN ] TUYA: Loaded 46611 primary data records. [2025-10-10T22:44:19.593118] [DEBUG] [LOCAL ] TVC: Loaded 3358 existing records from primary storage. [2025-10-10T22:44:19.613727] [INFO ] [MAIN ] TVC: Loaded 3358 primary data records. [2025-10-10T22:44:19.836256] [DEBUG] [LOCAL ] TV: Loaded 42533 existing records from primary storage. [2025-10-10T22:44:19.855531] [INFO ] [MAIN ] TV: Loaded 42533 primary data records. [2025-10-10T22:44:20.620628] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:20.624623] [INFO ] [MAIN ] TUYA: Generated 1820 derivative records from 46611 primary records. [2025-10-10T22:44:20.625766] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-10T22:44:20.656946] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:20.659943] [INFO ] [MAIN ] TVC: Generated 1820 derivative records from 3358 primary records. [2025-10-10T22:44:20.660041] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-10T22:44:20.661439] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1820 records). [2025-10-10T22:44:20.661726] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-10T22:44:20.665346] [INFO ] [MAIN ] Derivative Progress: 1615/1823 symbols completed. TUYA took 1.2s. Estimated remaining: 1m 19s. Rate: 157.5 symbols/min [2025-10-10T22:44:20.682600] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:20.684016] [DEBUG] [LOCAL ] TVC: Derivative data saved (1820 records). [2025-10-10T22:44:20.684403] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-10T22:44:20.688139] [INFO ] [MAIN ] Derivative Progress: 1616/1823 symbols completed. TVC took 1.2s. Estimated remaining: 1m 19s. Rate: 157.6 symbols/min [2025-10-10T22:44:20.688476] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:20.702698] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:20.703523] [INFO ] [MAIN ] TV: Generated 1820 derivative records from 42533 primary records. [2025-10-10T22:44:20.703602] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-10T22:44:20.721053] [DEBUG] [LOCAL ] TVE: Loaded 2793 existing records from primary storage. [2025-10-10T22:44:20.721579] [INFO ] [MAIN ] TVE: Loaded 2793 primary data records. [2025-10-10T22:44:20.846619] [DEBUG] [LOCAL ] TV: Derivative data saved (1820 records). [2025-10-10T22:44:20.861538] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-10T22:44:20.876636] [INFO ] [MAIN ] Derivative Progress: 1617/1823 symbols completed. TV took 1.4s. Estimated remaining: 1m 18s. Rate: 157.6 symbols/min [2025-10-10T22:44:20.922766] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:20.949456] [DEBUG] [LOCAL ] TWI: Loaded 34575 existing records from primary storage. [2025-10-10T22:44:21.053596] [INFO ] [MAIN ] TWI: Loaded 34575 primary data records. [2025-10-10T22:44:21.429432] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:21.431183] [INFO ] [MAIN ] TVE: Generated 1820 derivative records from 2793 primary records. [2025-10-10T22:44:21.431413] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-10T22:44:21.449955] [DEBUG] [LOCAL ] TWLO: Loaded 53536 existing records from primary storage. [2025-10-10T22:44:21.450145] [INFO ] [MAIN ] TWLO: Loaded 53536 primary data records. [2025-10-10T22:44:21.552802] [DEBUG] [LOCAL ] TVE: Derivative data saved (1820 records). [2025-10-10T22:44:21.558303] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-10T22:44:21.566324] [INFO ] [MAIN ] Derivative Progress: 1618/1823 symbols completed. TVE took 0.9s. Estimated remaining: 1m 18s. Rate: 157.6 symbols/min [2025-10-10T22:44:21.755310] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:21.810403] [INFO ] [MAIN ] TWI: Generated 1820 derivative records from 34575 primary records. [2025-10-10T22:44:21.833327] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-10T22:44:21.902978] [DEBUG] [LOCAL ] TWI: Derivative data saved (1820 records). [2025-10-10T22:44:21.903358] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-10T22:44:21.906299] [INFO ] [MAIN ] Derivative Progress: 1619/1823 symbols completed. TWI took 1.2s. Estimated remaining: 1m 18s. Rate: 157.6 symbols/min [2025-10-10T22:44:21.929528] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:21.930342] [INFO ] [MAIN ] TWLO: Generated 1820 derivative records from 53536 primary records. [2025-10-10T22:44:21.930410] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-10T22:44:21.948197] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1820 records). [2025-10-10T22:44:21.948323] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-10T22:44:21.950970] [INFO ] [MAIN ] Derivative Progress: 1620/1823 symbols completed. TWLO took 1.0s. Estimated remaining: 1m 17s. Rate: 157.7 symbols/min [2025-10-10T22:44:21.951765] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:21.951693] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:21.952410] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:21.963728] [DEBUG] [LOCAL ] TWN: Loaded 3242 existing records from primary storage. [2025-10-10T22:44:21.963947] [INFO ] [MAIN ] TWN: Loaded 3242 primary data records. [2025-10-10T22:44:22.310459] [DEBUG] [LOCAL ] TX: Loaded 23640 existing records from primary storage. [2025-10-10T22:44:22.324582] [INFO ] [MAIN ] TX: Loaded 23640 primary data records. [2025-10-10T22:44:22.453460] [DEBUG] [LOCAL ] TWO: Loaded 49240 existing records from primary storage. [2025-10-10T22:44:22.462237] [INFO ] [MAIN ] TWO: Loaded 49240 primary data records. [2025-10-10T22:44:23.028160] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:23.029165] [INFO ] [MAIN ] TWN: Generated 1820 derivative records from 3242 primary records. [2025-10-10T22:44:23.029384] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-10T22:44:23.048212] [DEBUG] [LOCAL ] TWN: Derivative data saved (1820 records). [2025-10-10T22:44:23.051138] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-10T22:44:23.053731] [INFO ] [MAIN ] Derivative Progress: 1621/1823 symbols completed. TWN took 1.1s. Estimated remaining: 1m 17s. Rate: 157.5 symbols/min [2025-10-10T22:44:23.067062] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:23.069810] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:23.070899] [INFO ] [MAIN ] TX: Generated 1820 derivative records from 23640 primary records. [2025-10-10T22:44:23.071175] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-10T22:44:23.089704] [DEBUG] [LOCAL ] TX: Derivative data saved (1820 records). [2025-10-10T22:44:23.089779] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-10T22:44:23.091863] [INFO ] [MAIN ] Derivative Progress: 1622/1823 symbols completed. TX took 1.1s. Estimated remaining: 1m 17s. Rate: 157.6 symbols/min [2025-10-10T22:44:23.092194] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:23.119345] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:23.120291] [INFO ] [MAIN ] TWO: Generated 1820 derivative records from 49240 primary records. [2025-10-10T22:44:23.120391] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-10T22:44:23.150324] [DEBUG] [LOCAL ] TWO: Derivative data saved (1820 records). [2025-10-10T22:44:23.150533] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-10T22:44:23.152919] [INFO ] [MAIN ] Derivative Progress: 1623/1823 symbols completed. TWO took 1.2s. Estimated remaining: 1m 16s. Rate: 157.6 symbols/min [2025-10-10T22:44:23.158135] [DEBUG] [LOCAL ] TXNM: Loaded 44121 existing records from primary storage. [2025-10-10T22:44:23.158472] [INFO ] [MAIN ] TXNM: Loaded 44121 primary data records. [2025-10-10T22:44:23.158308] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:23.253103] [DEBUG] [LOCAL ] TXO: Loaded 19726 existing records from primary storage. [2025-10-10T22:44:23.270197] [INFO ] [MAIN ] TXO: Loaded 19726 primary data records. [2025-10-10T22:44:23.641670] [DEBUG] [LOCAL ] TXT: Loaded 50440 existing records from primary storage. [2025-10-10T22:44:23.750672] [INFO ] [MAIN ] TXT: Loaded 50440 primary data records. [2025-10-10T22:44:24.175293] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:24.176830] [INFO ] [MAIN ] TXNM: Generated 1820 derivative records from 44121 primary records. [2025-10-10T22:44:24.189069] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-10T22:44:24.190916] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:24.199719] [INFO ] [MAIN ] TXO: Generated 1820 derivative records from 19726 primary records. [2025-10-10T22:44:24.201093] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-10T22:44:24.208908] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1820 records). [2025-10-10T22:44:24.217682] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-10T22:44:24.220232] [INFO ] [MAIN ] Derivative Progress: 1624/1823 symbols completed. TXNM took 1.2s. Estimated remaining: 1m 16s. Rate: 157.5 symbols/min [2025-10-10T22:44:24.224588] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:24.230577] [DEBUG] [LOCAL ] TXO: Derivative data saved (1820 records). [2025-10-10T22:44:24.230790] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-10T22:44:24.232920] [INFO ] [MAIN ] Derivative Progress: 1625/1823 symbols completed. TXO took 1.1s. Estimated remaining: 1m 15s. Rate: 157.6 symbols/min [2025-10-10T22:44:24.233148] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:24.255298] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:24.256097] [INFO ] [MAIN ] TXT: Generated 1820 derivative records from 50440 primary records. [2025-10-10T22:44:24.256206] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-10T22:44:24.269762] [DEBUG] [LOCAL ] TYG: Loaded 14076 existing records from primary storage. [2025-10-10T22:44:24.273629] [INFO ] [MAIN ] TYG: Loaded 14076 primary data records. [2025-10-10T22:44:24.375739] [DEBUG] [LOCAL ] TYL: Loaded 22651 existing records from primary storage. [2025-10-10T22:44:24.382201] [INFO ] [MAIN ] TYL: Loaded 22651 primary data records. [2025-10-10T22:44:24.382103] [DEBUG] [LOCAL ] TXT: Derivative data saved (1820 records). [2025-10-10T22:44:24.395090] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-10T22:44:24.407786] [INFO ] [MAIN ] Derivative Progress: 1626/1823 symbols completed. TXT took 1.2s. Estimated remaining: 1m 15s. Rate: 157.6 symbols/min [2025-10-10T22:44:24.441966] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:24.943327] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-10-10T22:44:24.944074] [INFO ] [MAIN ] U: Loaded 54579 primary data records. [2025-10-10T22:44:25.095535] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:25.098119] [INFO ] [MAIN ] TYG: Generated 1820 derivative records from 14076 primary records. [2025-10-10T22:44:25.123220] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-10T22:44:25.290719] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:25.302102] [INFO ] [MAIN ] TYL: Generated 1820 derivative records from 22651 primary records. [2025-10-10T22:44:25.302949] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-10T22:44:25.320886] [DEBUG] [LOCAL ] TYG: Derivative data saved (1820 records). [2025-10-10T22:44:25.321841] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-10T22:44:25.324450] [INFO ] [MAIN ] Derivative Progress: 1627/1823 symbols completed. TYG took 1.1s. Estimated remaining: 1m 15s. Rate: 157.5 symbols/min [2025-10-10T22:44:25.325710] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:25.335629] [DEBUG] [LOCAL ] TYL: Derivative data saved (1820 records). [2025-10-10T22:44:25.335800] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-10T22:44:25.338094] [INFO ] [MAIN ] Derivative Progress: 1628/1823 symbols completed. TYL took 1.1s. Estimated remaining: 1m 14s. Rate: 157.6 symbols/min [2025-10-10T22:44:25.338524] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:25.358244] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:25.359046] [INFO ] [MAIN ] U: Generated 1820 derivative records from 54579 primary records. [2025-10-10T22:44:25.359215] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-10T22:44:25.379073] [DEBUG] [LOCAL ] U: Derivative data saved (1820 records). [2025-10-10T22:44:25.379463] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-10T22:44:25.382239] [INFO ] [MAIN ] Derivative Progress: 1629/1823 symbols completed. U took 0.9s. Estimated remaining: 1m 14s. Rate: 157.7 symbols/min [2025-10-10T22:44:25.382534] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:25.404338] [DEBUG] [LOCAL ] UAN: Loaded 5484 existing records from primary storage. [2025-10-10T22:44:25.404633] [INFO ] [MAIN ] UAN: Loaded 5484 primary data records. [2025-10-10T22:44:25.522316] [DEBUG] [LOCAL ] UA: Loaded 51194 existing records from primary storage. [2025-10-10T22:44:25.540965] [INFO ] [MAIN ] UA: Loaded 51194 primary data records. [2025-10-10T22:44:25.600390] [DEBUG] [LOCAL ] UAA: Loaded 54287 existing records from primary storage. [2025-10-10T22:44:25.611421] [INFO ] [MAIN ] UAA: Loaded 54287 primary data records. [2025-10-10T22:44:26.466154] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:26.472457] [INFO ] [MAIN ] UAN: Generated 1820 derivative records from 5484 primary records. [2025-10-10T22:44:26.471690] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:26.472695] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-10T22:44:26.474051] [INFO ] [MAIN ] UA: Generated 1820 derivative records from 51194 primary records. [2025-10-10T22:44:26.474573] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-10T22:44:26.517384] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:26.521324] [DEBUG] [LOCAL ] UA: Derivative data saved (1820 records). [2025-10-10T22:44:26.521469] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-10T22:44:26.520590] [INFO ] [MAIN ] UAA: Generated 1820 derivative records from 54287 primary records. [2025-10-10T22:44:26.521885] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-10T22:44:26.524528] [INFO ] [MAIN ] Derivative Progress: 1630/1823 symbols completed. UA took 1.2s. Estimated remaining: 1m 14s. Rate: 157.5 symbols/min [2025-10-10T22:44:26.524900] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:26.538637] [DEBUG] [LOCAL ] UAN: Derivative data saved (1820 records). [2025-10-10T22:44:26.539332] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-10T22:44:26.541858] [INFO ] [MAIN ] Derivative Progress: 1631/1823 symbols completed. UAN took 1.2s. Estimated remaining: 1m 13s. Rate: 157.6 symbols/min [2025-10-10T22:44:26.542711] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:26.545813] [DEBUG] [LOCAL ] UAA: Derivative data saved (1820 records). [2025-10-10T22:44:26.546343] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-10T22:44:26.549317] [INFO ] [MAIN ] Derivative Progress: 1632/1823 symbols completed. UAA took 1.2s. Estimated remaining: 1m 13s. Rate: 157.7 symbols/min [2025-10-10T22:44:26.549671] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:26.634710] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-10-10T22:44:26.649418] [INFO ] [MAIN ] UBER: Loaded 54586 primary data records. [2025-10-10T22:44:26.731816] [DEBUG] [LOCAL ] UCB: Loaded 38322 existing records from primary storage. [2025-10-10T22:44:26.762216] [INFO ] [MAIN ] UCB: Loaded 38322 primary data records. [2025-10-10T22:44:26.825327] [DEBUG] [LOCAL ] UBS: Loaded 53101 existing records from primary storage. [2025-10-10T22:44:26.830699] [INFO ] [MAIN ] UBS: Loaded 53101 primary data records. [2025-10-10T22:44:27.805065] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:27.806628] [INFO ] [MAIN ] UBER: Generated 1820 derivative records from 54586 primary records. [2025-10-10T22:44:27.805865] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:27.808613] [INFO ] [MAIN ] UBS: Generated 1820 derivative records from 53101 primary records. [2025-10-10T22:44:27.806941] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-10T22:44:27.811724] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-10T22:44:27.878913] [DEBUG] [LOCAL ] UBS: Derivative data saved (1820 records). [2025-10-10T22:44:27.879085] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-10T22:44:27.877391] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:27.881035] [INFO ] [MAIN ] UCB: Generated 1820 derivative records from 38322 primary records. [2025-10-10T22:44:27.881514] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-10T22:44:27.886830] [INFO ] [MAIN ] Derivative Progress: 1633/1823 symbols completed. UBS took 1.3s. Estimated remaining: 1m 12s. Rate: 157.4 symbols/min [2025-10-10T22:44:27.899617] [DEBUG] [LOCAL ] UBER: Derivative data saved (1820 records). [2025-10-10T22:44:27.904540] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-10T22:44:27.907678] [INFO ] [MAIN ] Derivative Progress: 1634/1823 symbols completed. UBER took 1.4s. Estimated remaining: 1m 12s. Rate: 157.5 symbols/min [2025-10-10T22:44:27.914487] [DEBUG] [LOCAL ] UCB: Derivative data saved (1820 records). [2025-10-10T22:44:27.914639] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-10-10T22:44:27.917225] [INFO ] [MAIN ] Derivative Progress: 1635/1823 symbols completed. UCB took 1.4s. Estimated remaining: 1m 12s. Rate: 157.6 symbols/min [2025-10-10T22:44:27.917926] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:27.918524] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:27.918726] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:28.045029] [DEBUG] [LOCAL ] UDR: Loaded 52669 existing records from primary storage. [2025-10-10T22:44:28.045437] [INFO ] [MAIN ] UDR: Loaded 52669 primary data records. [2025-10-10T22:44:28.063427] [DEBUG] [LOCAL ] UGI: Loaded 51300 existing records from primary storage. [2025-10-10T22:44:28.065323] [INFO ] [MAIN ] UGI: Loaded 51300 primary data records. [2025-10-10T22:44:28.071395] [DEBUG] [LOCAL ] UE: Loaded 43173 existing records from primary storage. [2025-10-10T22:44:28.113327] [INFO ] [MAIN ] UE: Loaded 43173 primary data records. [2025-10-10T22:44:29.077043] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:29.086016] [INFO ] [MAIN ] UDR: Generated 1820 derivative records from 52669 primary records. [2025-10-10T22:44:29.091203] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-10T22:44:29.092524] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:29.094005] [INFO ] [MAIN ] UGI: Generated 1820 derivative records from 51300 primary records. [2025-10-10T22:44:29.116719] [DEBUG] [LOCAL ] UDR: Derivative data saved (1820 records). [2025-10-10T22:44:29.121259] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-10T22:44:29.121724] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-10T22:44:29.124852] [INFO ] [MAIN ] Derivative Progress: 1636/1823 symbols completed. UDR took 1.2s. Estimated remaining: 1m 11s. Rate: 157.4 symbols/min [2025-10-10T22:44:29.122608] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:29.125295] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:29.126119] [INFO ] [MAIN ] UE: Generated 1820 derivative records from 43173 primary records. [2025-10-10T22:44:29.126220] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-10T22:44:29.154611] [DEBUG] [LOCAL ] UGI: Derivative data saved (1820 records). [2025-10-10T22:44:29.155227] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-10T22:44:29.157538] [INFO ] [MAIN ] Derivative Progress: 1637/1823 symbols completed. UGI took 1.2s. Estimated remaining: 1m 11s. Rate: 157.5 symbols/min [2025-10-10T22:44:29.157950] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:29.161242] [DEBUG] [LOCAL ] UE: Derivative data saved (1820 records). [2025-10-10T22:44:29.161318] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-10T22:44:29.163375] [INFO ] [MAIN ] Derivative Progress: 1638/1823 symbols completed. UE took 1.2s. Estimated remaining: 1m 10s. Rate: 157.6 symbols/min [2025-10-10T22:44:29.163606] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:29.188798] [DEBUG] [LOCAL ] UHAL: Loaded 17006 existing records from primary storage. [2025-10-10T22:44:29.188943] [INFO ] [MAIN ] UHAL: Loaded 17006 primary data records. [2025-10-10T22:44:29.390088] [DEBUG] [LOCAL ] UGP: Loaded 43561 existing records from primary storage. [2025-10-10T22:44:29.461710] [INFO ] [MAIN ] UGP: Loaded 43561 primary data records. [2025-10-10T22:44:29.620512] [DEBUG] [LOCAL ] UHS: Loaded 41138 existing records from primary storage. [2025-10-10T22:44:29.639323] [INFO ] [MAIN ] UHS: Loaded 41138 primary data records. [2025-10-10T22:44:30.193671] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:30.194824] [INFO ] [MAIN ] UHAL: Generated 1820 derivative records from 17006 primary records. [2025-10-10T22:44:30.195020] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-10T22:44:30.227896] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1820 records). [2025-10-10T22:44:30.228573] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:30.228636] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-10T22:44:30.229419] [INFO ] [MAIN ] UGP: Generated 1820 derivative records from 43561 primary records. [2025-10-10T22:44:30.231355] [INFO ] [MAIN ] Derivative Progress: 1639/1823 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 10s. Rate: 157.4 symbols/min [2025-10-10T22:44:30.231781] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:30.231699] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-10T22:44:30.266993] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:30.272431] [DEBUG] [LOCAL ] UHT: Loaded 10186 existing records from primary storage. [2025-10-10T22:44:30.267785] [INFO ] [MAIN ] UHS: Generated 1820 derivative records from 41138 primary records. [2025-10-10T22:44:30.272920] [DEBUG] [LOCAL ] UGP: Derivative data saved (1820 records). [2025-10-10T22:44:30.273128] [INFO ] [MAIN ] UHT: Loaded 10186 primary data records. [2025-10-10T22:44:30.273266] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-10T22:44:30.286908] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-10T22:44:30.286790] [INFO ] [MAIN ] Derivative Progress: 1640/1823 symbols completed. UGP took 1.2s. Estimated remaining: 1m 10s. Rate: 157.5 symbols/min [2025-10-10T22:44:30.327743] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:30.359662] [DEBUG] [LOCAL ] UHS: Derivative data saved (1820 records). [2025-10-10T22:44:30.359863] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-10T22:44:30.370171] [INFO ] [MAIN ] Derivative Progress: 1641/1823 symbols completed. UHS took 1.2s. Estimated remaining: 1m 9s. Rate: 157.6 symbols/min [2025-10-10T22:44:30.370333] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:30.623549] [DEBUG] [LOCAL ] UI: Loaded 13680 existing records from primary storage. [2025-10-10T22:44:30.633184] [INFO ] [MAIN ] UI: Loaded 13680 primary data records. [2025-10-10T22:44:30.761017] [DEBUG] [LOCAL ] UIS: Loaded 37519 existing records from primary storage. [2025-10-10T22:44:30.767446] [INFO ] [MAIN ] UIS: Loaded 37519 primary data records. [2025-10-10T22:44:31.306581] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:31.308855] [INFO ] [MAIN ] UHT: Generated 1820 derivative records from 10186 primary records. [2025-10-10T22:44:31.310416] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-10T22:44:31.330363] [DEBUG] [LOCAL ] UHT: Derivative data saved (1820 records). [2025-10-10T22:44:31.330831] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-10T22:44:31.332752] [INFO ] [MAIN ] Derivative Progress: 1642/1823 symbols completed. UHT took 1.1s. Estimated remaining: 1m 9s. Rate: 157.4 symbols/min [2025-10-10T22:44:31.333096] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:31.350147] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:31.351398] [INFO ] [MAIN ] UI: Generated 1820 derivative records from 13680 primary records. [2025-10-10T22:44:31.351622] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-10T22:44:31.385237] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:31.384946] [DEBUG] [LOCAL ] UI: Derivative data saved (1820 records). [2025-10-10T22:44:31.386092] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-10T22:44:31.385984] [INFO ] [MAIN ] UIS: Generated 1820 derivative records from 37519 primary records. [2025-10-10T22:44:31.388162] [INFO ] [MAIN ] Derivative Progress: 1643/1823 symbols completed. UI took 1.1s. Estimated remaining: 1m 9s. Rate: 157.5 symbols/min [2025-10-10T22:44:31.388415] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-10T22:44:31.388321] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:31.406579] [DEBUG] [LOCAL ] UIS: Derivative data saved (1820 records). [2025-10-10T22:44:31.406819] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-10T22:44:31.409090] [INFO ] [MAIN ] Derivative Progress: 1644/1823 symbols completed. UIS took 1.0s. Estimated remaining: 1m 8s. Rate: 157.6 symbols/min [2025-10-10T22:44:31.409272] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:31.462996] [DEBUG] [LOCAL ] UL: Loaded 53848 existing records from primary storage. [2025-10-10T22:44:31.463636] [INFO ] [MAIN ] UL: Loaded 53848 primary data records. [2025-10-10T22:44:31.533403] [DEBUG] [LOCAL ] ULS: Loaded 39884 existing records from primary storage. [2025-10-10T22:44:31.547975] [INFO ] [MAIN ] ULS: Loaded 39884 primary data records. [2025-10-10T22:44:31.830031] [DEBUG] [LOCAL ] UMC: Loaded 53453 existing records from primary storage. [2025-10-10T22:44:31.928232] [INFO ] [MAIN ] UMC: Loaded 53453 primary data records. [2025-10-10T22:44:32.494781] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:32.496031] [INFO ] [MAIN ] UL: Generated 1820 derivative records from 53848 primary records. [2025-10-10T22:44:32.497259] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-10T22:44:32.531861] [DEBUG] [LOCAL ] UL: Derivative data saved (1820 records). [2025-10-10T22:44:32.532407] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-10T22:44:32.534310] [INFO ] [MAIN ] Derivative Progress: 1645/1823 symbols completed. UL took 1.2s. Estimated remaining: 1m 8s. Rate: 157.4 symbols/min [2025-10-10T22:44:32.532219] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:32.546423] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:32.547501] [INFO ] [MAIN ] ULS: Generated 1820 derivative records from 39884 primary records. [2025-10-10T22:44:32.547743] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-10T22:44:32.556541] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:32.561212] [INFO ] [MAIN ] UMC: Generated 1820 derivative records from 53453 primary records. [2025-10-10T22:44:32.563802] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-10T22:44:32.566187] [DEBUG] [LOCAL ] ULS: Derivative data saved (1820 records). [2025-10-10T22:44:32.566481] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-10T22:44:32.569017] [INFO ] [MAIN ] Derivative Progress: 1646/1823 symbols completed. ULS took 1.2s. Estimated remaining: 1m 7s. Rate: 157.5 symbols/min [2025-10-10T22:44:32.576014] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:32.590400] [DEBUG] [LOCAL ] UMC: Derivative data saved (1820 records). [2025-10-10T22:44:32.590518] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-10T22:44:32.592627] [INFO ] [MAIN ] Derivative Progress: 1647/1823 symbols completed. UMC took 1.2s. Estimated remaining: 1m 7s. Rate: 157.6 symbols/min [2025-10-10T22:44:32.592968] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:32.608029] [DEBUG] [LOCAL ] UNF: Loaded 12272 existing records from primary storage. [2025-10-10T22:44:32.608213] [INFO ] [MAIN ] UNF: Loaded 12272 primary data records. [2025-10-10T22:44:32.739431] [DEBUG] [LOCAL ] UMH: Loaded 34385 existing records from primary storage. [2025-10-10T22:44:32.749924] [INFO ] [MAIN ] UMH: Loaded 34385 primary data records. [2025-10-10T22:44:33.076128] [DEBUG] [LOCAL ] UNFI: Loaded 42999 existing records from primary storage. [2025-10-10T22:44:33.082245] [INFO ] [MAIN ] UNFI: Loaded 42999 primary data records. [2025-10-10T22:44:33.593663] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:33.594331] [INFO ] [MAIN ] UNF: Generated 1820 derivative records from 12272 primary records. [2025-10-10T22:44:33.595293] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-10T22:44:33.623039] [DEBUG] [LOCAL ] UNF: Derivative data saved (1820 records). [2025-10-10T22:44:33.623221] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-10T22:44:33.625537] [INFO ] [MAIN ] Derivative Progress: 1648/1823 symbols completed. UNF took 1.0s. Estimated remaining: 1m 7s. Rate: 157.4 symbols/min [2025-10-10T22:44:33.658612] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:33.658967] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:33.659944] [INFO ] [MAIN ] UMH: Generated 1820 derivative records from 34385 primary records. [2025-10-10T22:44:33.660141] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-10T22:44:33.660939] [INFO ] [MAIN ] UNFI: Generated 1820 derivative records from 42999 primary records. [2025-10-10T22:44:33.661524] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-10T22:44:33.695215] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1820 records). [2025-10-10T22:44:33.695991] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-10T22:44:33.699286] [INFO ] [MAIN ] Derivative Progress: 1649/1823 symbols completed. UNFI took 1.1s. Estimated remaining: 1m 6s. Rate: 157.5 symbols/min [2025-10-10T22:44:33.701108] [DEBUG] [LOCAL ] UMH: Derivative data saved (1820 records). [2025-10-10T22:44:33.701418] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-10T22:44:33.703798] [INFO ] [MAIN ] Derivative Progress: 1650/1823 symbols completed. UMH took 1.2s. Estimated remaining: 1m 6s. Rate: 157.6 symbols/min [2025-10-10T22:44:33.704222] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:33.704370] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:33.704507] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:33.714591] [DEBUG] [LOCAL ] UNMA: Loaded 3599 existing records from primary storage. [2025-10-10T22:44:33.714774] [INFO ] [MAIN ] UNMA: Loaded 3599 primary data records. [2025-10-10T22:44:34.126233] [DEBUG] [LOCAL ] UNM: Loaded 48932 existing records from primary storage. [2025-10-10T22:44:34.127934] [INFO ] [MAIN ] UNM: Loaded 48932 primary data records. [2025-10-10T22:44:34.140197] [DEBUG] [LOCAL ] UNH: Loaded 54583 existing records from primary storage. [2025-10-10T22:44:34.197471] [INFO ] [MAIN ] UNH: Loaded 54583 primary data records. [2025-10-10T22:44:34.424553] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-10T22:44:34.564714] [INFO ] [MAIN ] UNMA: Generated 1818 derivative records from 3599 primary records. [2025-10-10T22:44:34.577197] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-10T22:44:34.773977] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1818 records). [2025-10-10T22:44:34.775054] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-10T22:44:34.777263] [INFO ] [MAIN ] Derivative Progress: 1651/1823 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 6s. Rate: 157.4 symbols/min [2025-10-10T22:44:34.777634] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:34.803625] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:34.804674] [INFO ] [MAIN ] UNM: Generated 1820 derivative records from 48932 primary records. [2025-10-10T22:44:34.804788] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-10T22:44:34.836627] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:34.837973] [DEBUG] [LOCAL ] UNM: Derivative data saved (1820 records). [2025-10-10T22:44:34.839064] [INFO ] [MAIN ] UNH: Generated 1820 derivative records from 54583 primary records. [2025-10-10T22:44:34.838198] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-10T22:44:34.841161] [INFO ] [MAIN ] Derivative Progress: 1652/1823 symbols completed. UNM took 1.1s. Estimated remaining: 1m 5s. Rate: 157.5 symbols/min [2025-10-10T22:44:34.841305] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-10T22:44:34.842820] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:34.860067] [DEBUG] [LOCAL ] UNH: Derivative data saved (1820 records). [2025-10-10T22:44:34.860211] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-10T22:44:34.862378] [INFO ] [MAIN ] Derivative Progress: 1653/1823 symbols completed. UNH took 1.2s. Estimated remaining: 1m 5s. Rate: 157.6 symbols/min [2025-10-10T22:44:34.862692] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:34.904241] [DEBUG] [LOCAL ] UNP: Loaded 54080 existing records from primary storage. [2025-10-10T22:44:34.913244] [INFO ] [MAIN ] UNP: Loaded 54080 primary data records. [2025-10-10T22:44:35.049104] [DEBUG] [LOCAL ] UP: Loaded 44474 existing records from primary storage. [2025-10-10T22:44:35.065052] [INFO ] [MAIN ] UP: Loaded 44474 primary data records. [2025-10-10T22:44:35.155185] [DEBUG] [LOCAL ] URI: Loaded 35626 existing records from primary storage. [2025-10-10T22:44:35.170951] [INFO ] [MAIN ] URI: Loaded 35626 primary data records. [2025-10-10T22:44:35.955330] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:35.958904] [INFO ] [MAIN ] UNP: Generated 1820 derivative records from 54080 primary records. [2025-10-10T22:44:35.959228] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-10T22:44:35.987000] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:35.991595] [INFO ] [MAIN ] UP: Generated 1820 derivative records from 44474 primary records. [2025-10-10T22:44:35.993449] [DEBUG] [LOCAL ] UNP: Derivative data saved (1820 records). [2025-10-10T22:44:35.991823] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-10T22:44:35.995894] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-10T22:44:35.998840] [INFO ] [MAIN ] Derivative Progress: 1654/1823 symbols completed. UNP took 1.2s. Estimated remaining: 1m 4s. Rate: 157.4 symbols/min [2025-10-10T22:44:35.999117] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:36.025588] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:36.029000] [INFO ] [MAIN ] URI: Generated 1820 derivative records from 35626 primary records. [2025-10-10T22:44:36.029097] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-10T22:44:36.030771] [DEBUG] [LOCAL ] UP: Derivative data saved (1820 records). [2025-10-10T22:44:36.031129] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-10T22:44:36.033345] [INFO ] [MAIN ] Derivative Progress: 1655/1823 symbols completed. UP took 1.2s. Estimated remaining: 1m 4s. Rate: 157.5 symbols/min [2025-10-10T22:44:36.040967] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:36.049700] [DEBUG] [LOCAL ] URI: Derivative data saved (1820 records). [2025-10-10T22:44:36.049782] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-10T22:44:36.052084] [INFO ] [MAIN ] Derivative Progress: 1656/1823 symbols completed. URI took 1.2s. Estimated remaining: 1m 4s. Rate: 157.6 symbols/min [2025-10-10T22:44:36.052228] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:36.134559] [DEBUG] [LOCAL ] USA: Loaded 36662 existing records from primary storage. [2025-10-10T22:44:36.134920] [INFO ] [MAIN ] USA: Loaded 36662 primary data records. [2025-10-10T22:44:36.178735] [DEBUG] [LOCAL ] USAC: Loaded 21905 existing records from primary storage. [2025-10-10T22:44:36.205627] [INFO ] [MAIN ] USAC: Loaded 21905 primary data records. [2025-10-10T22:44:36.626155] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-10-10T22:44:36.626534] [INFO ] [MAIN ] USB: Loaded 54468 primary data records. [2025-10-10T22:44:37.106272] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:37.107973] [INFO ] [MAIN ] USA: Generated 1820 derivative records from 36662 primary records. [2025-10-10T22:44:37.108088] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-10T22:44:37.135004] [DEBUG] [LOCAL ] USA: Derivative data saved (1820 records). [2025-10-10T22:44:37.140241] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-10T22:44:37.142404] [INFO ] [MAIN ] Derivative Progress: 1657/1823 symbols completed. USA took 1.1s. Estimated remaining: 1m 3s. Rate: 157.4 symbols/min [2025-10-10T22:44:37.142702] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:37.142846] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:37.143618] [INFO ] [MAIN ] USAC: Generated 1820 derivative records from 21905 primary records. [2025-10-10T22:44:37.144353] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-10T22:44:37.162230] [DEBUG] [LOCAL ] USAC: Derivative data saved (1820 records). [2025-10-10T22:44:37.163850] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-10T22:44:37.165982] [INFO ] [MAIN ] Derivative Progress: 1658/1823 symbols completed. USAC took 1.1s. Estimated remaining: 1m 3s. Rate: 157.5 symbols/min [2025-10-10T22:44:37.166132] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:37.179565] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:37.180592] [INFO ] [MAIN ] USB: Generated 1820 derivative records from 54468 primary records. [2025-10-10T22:44:37.180824] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-10T22:44:37.197415] [DEBUG] [LOCAL ] USB: Derivative data saved (1820 records). [2025-10-10T22:44:37.197890] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-10T22:44:37.200029] [INFO ] [MAIN ] Derivative Progress: 1659/1823 symbols completed. USB took 1.1s. Estimated remaining: 1m 2s. Rate: 157.6 symbols/min [2025-10-10T22:44:37.200202] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:37.214169] [DEBUG] [LOCAL ] USNA: Loaded 18076 existing records from primary storage. [2025-10-10T22:44:37.227041] [INFO ] [MAIN ] USNA: Loaded 18076 primary data records. [2025-10-10T22:44:37.355220] [DEBUG] [LOCAL ] USPH: Loaded 17233 existing records from primary storage. [2025-10-10T22:44:37.355761] [INFO ] [MAIN ] USPH: Loaded 17233 primary data records. [2025-10-10T22:44:37.424109] [DEBUG] [LOCAL ] USFD: Loaded 51896 existing records from primary storage. [2025-10-10T22:44:37.469298] [INFO ] [MAIN ] USFD: Loaded 51896 primary data records. [2025-10-10T22:44:38.229508] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:38.230826] [INFO ] [MAIN ] USNA: Generated 1820 derivative records from 18076 primary records. [2025-10-10T22:44:38.231082] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-10T22:44:38.252281] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:38.257512] [INFO ] [MAIN ] USPH: Generated 1820 derivative records from 17233 primary records. [2025-10-10T22:44:38.262089] [DEBUG] [LOCAL ] USNA: Derivative data saved (1820 records). [2025-10-10T22:44:38.260813] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-10T22:44:38.262528] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-10T22:44:38.266070] [INFO ] [MAIN ] Derivative Progress: 1660/1823 symbols completed. USNA took 1.1s. Estimated remaining: 1m 2s. Rate: 157.4 symbols/min [2025-10-10T22:44:38.277488] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:38.296666] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:38.298172] [INFO ] [MAIN ] USFD: Generated 1820 derivative records from 51896 primary records. [2025-10-10T22:44:38.298318] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-10T22:44:38.300887] [DEBUG] [LOCAL ] USPH: Derivative data saved (1820 records). [2025-10-10T22:44:38.308114] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-10T22:44:38.311715] [INFO ] [MAIN ] Derivative Progress: 1661/1823 symbols completed. USPH took 1.1s. Estimated remaining: 1m 2s. Rate: 157.5 symbols/min [2025-10-10T22:44:38.318961] [DEBUG] [LOCAL ] USFD: Derivative data saved (1820 records). [2025-10-10T22:44:38.319133] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-10T22:44:38.314634] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:38.321871] [INFO ] [MAIN ] Derivative Progress: 1662/1823 symbols completed. USFD took 1.2s. Estimated remaining: 1m 1s. Rate: 157.6 symbols/min [2025-10-10T22:44:38.322141] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:38.349324] [DEBUG] [LOCAL ] UTL: Loaded 11823 existing records from primary storage. [2025-10-10T22:44:38.349452] [INFO ] [MAIN ] UTL: Loaded 11823 primary data records. [2025-10-10T22:44:38.480136] [DEBUG] [LOCAL ] UTF: Loaded 30866 existing records from primary storage. [2025-10-10T22:44:38.489447] [INFO ] [MAIN ] UTF: Loaded 30866 primary data records. [2025-10-10T22:44:38.799435] [DEBUG] [LOCAL ] UTI: Loaded 41054 existing records from primary storage. [2025-10-10T22:44:38.800253] [INFO ] [MAIN ] UTI: Loaded 41054 primary data records. [2025-10-10T22:44:39.354636] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:39.356007] [INFO ] [MAIN ] UTL: Generated 1820 derivative records from 11823 primary records. [2025-10-10T22:44:39.356691] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-10T22:44:39.386447] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:39.389605] [INFO ] [MAIN ] UTF: Generated 1820 derivative records from 30866 primary records. [2025-10-10T22:44:39.390974] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-10T22:44:39.393132] [DEBUG] [LOCAL ] UTL: Derivative data saved (1820 records). [2025-10-10T22:44:39.393237] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-10T22:44:39.403526] [INFO ] [MAIN ] Derivative Progress: 1663/1823 symbols completed. UTL took 1.1s. Estimated remaining: 1m 1s. Rate: 157.4 symbols/min [2025-10-10T22:44:39.411248] [DEBUG] [LOCAL ] UTF: Derivative data saved (1820 records). [2025-10-10T22:44:39.411386] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-10T22:44:39.413542] [INFO ] [MAIN ] Derivative Progress: 1664/1823 symbols completed. UTF took 1.1s. Estimated remaining: 1m 1s. Rate: 157.5 symbols/min [2025-10-10T22:44:39.432118] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:39.432987] [INFO ] [MAIN ] UTI: Generated 1820 derivative records from 41054 primary records. [2025-10-10T22:44:39.433056] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-10T22:44:39.449747] [DEBUG] [LOCAL ] UTI: Derivative data saved (1820 records). [2025-10-10T22:44:39.449828] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-10T22:44:39.453177] [INFO ] [MAIN ] Derivative Progress: 1665/1823 symbols completed. UTI took 1.1s. Estimated remaining: 1m 0s. Rate: 157.6 symbols/min [2025-10-10T22:44:39.453956] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:39.454206] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:39.454126] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:39.506747] [DEBUG] [LOCAL ] UVE: Loaded 22150 existing records from primary storage. [2025-10-10T22:44:39.510301] [DEBUG] [LOCAL ] UVV: Loaded 22996 existing records from primary storage. [2025-10-10T22:44:39.510484] [INFO ] [MAIN ] UVV: Loaded 22996 primary data records. [2025-10-10T22:44:39.508567] [INFO ] [MAIN ] UVE: Loaded 22150 primary data records. [2025-10-10T22:44:39.805842] [DEBUG] [LOCAL ] UTZ: Loaded 45169 existing records from primary storage. [2025-10-10T22:44:39.842524] [INFO ] [MAIN ] UTZ: Loaded 45169 primary data records. [2025-10-10T22:44:40.565944] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:40.581578] [INFO ] [MAIN ] UVV: Generated 1820 derivative records from 22996 primary records. [2025-10-10T22:44:40.582181] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-10T22:44:40.583532] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:40.587790] [INFO ] [MAIN ] UVE: Generated 1820 derivative records from 22150 primary records. [2025-10-10T22:44:40.588122] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-10T22:44:40.618572] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:40.632454] [INFO ] [MAIN ] UTZ: Generated 1820 derivative records from 45169 primary records. [2025-10-10T22:44:40.632860] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-10T22:44:40.634344] [DEBUG] [LOCAL ] UVV: Derivative data saved (1820 records). [2025-10-10T22:44:40.645373] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-10T22:44:40.654786] [INFO ] [MAIN ] Derivative Progress: 1666/1823 symbols completed. UVV took 1.2s. Estimated remaining: 59.9s. Rate: 157.4 symbols/min [2025-10-10T22:44:40.660486] [DEBUG] [LOCAL ] UVE: Derivative data saved (1820 records). [2025-10-10T22:44:40.661127] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1820 records). [2025-10-10T22:44:40.660743] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:40.661429] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-10T22:44:40.661617] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-10T22:44:40.663992] [INFO ] [MAIN ] Derivative Progress: 1667/1823 symbols completed. UTZ took 1.2s. Estimated remaining: 59.4s. Rate: 157.5 symbols/min [2025-10-10T22:44:40.667578] [INFO ] [MAIN ] Derivative Progress: 1668/1823 symbols completed. UVE took 1.2s. Estimated remaining: 59.0s. Rate: 157.5 symbols/min [2025-10-10T22:44:40.664739] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:40.668096] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:40.690006] [DEBUG] [LOCAL ] UZD: Loaded 6451 existing records from primary storage. [2025-10-10T22:44:40.690369] [INFO ] [MAIN ] UZD: Loaded 6451 primary data records. [2025-10-10T22:44:40.689526] [DEBUG] [LOCAL ] UZE: Loaded 7576 existing records from primary storage. [2025-10-10T22:44:40.722709] [INFO ] [MAIN ] UZE: Loaded 7576 primary data records. [2025-10-10T22:44:41.333986] [DEBUG] [LOCAL ] UWMC: Loaded 53633 existing records from primary storage. [2025-10-10T22:44:41.347662] [INFO ] [MAIN ] UWMC: Loaded 53633 primary data records. [2025-10-10T22:44:41.704123] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:41.711279] [INFO ] [MAIN ] UZD: Generated 1820 derivative records from 6451 primary records. [2025-10-10T22:44:41.720292] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-10T22:44:41.722911] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:41.737670] [DEBUG] [LOCAL ] UZD: Derivative data saved (1820 records). [2025-10-10T22:44:41.739007] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-10T22:44:41.741343] [INFO ] [MAIN ] Derivative Progress: 1669/1823 symbols completed. UZD took 1.1s. Estimated remaining: 58.7s. Rate: 157.4 symbols/min [2025-10-10T22:44:41.741604] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:41.742977] [INFO ] [MAIN ] UZE: Generated 1820 derivative records from 7576 primary records. [2025-10-10T22:44:41.746053] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-10T22:44:41.762627] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:41.775395] [INFO ] [MAIN ] UWMC: Generated 1820 derivative records from 53633 primary records. [2025-10-10T22:44:41.776129] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-10T22:44:41.798509] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1820 records). [2025-10-10T22:44:41.804263] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-10T22:44:41.808255] [INFO ] [MAIN ] Derivative Progress: 1670/1823 symbols completed. UWMC took 1.1s. Estimated remaining: 58.3s. Rate: 157.5 symbols/min [2025-10-10T22:44:41.808496] [DEBUG] [LOCAL ] UZE: Derivative data saved (1820 records). [2025-10-10T22:44:41.808616] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:41.809036] [DEBUG] [LOCAL ] UZF: Loaded 6403 existing records from primary storage. [2025-10-10T22:44:41.809219] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-10T22:44:41.813080] [INFO ] [MAIN ] UZF: Loaded 6403 primary data records. [2025-10-10T22:44:41.812932] [INFO ] [MAIN ] Derivative Progress: 1671/1823 symbols completed. UZE took 1.1s. Estimated remaining: 57.9s. Rate: 157.5 symbols/min [2025-10-10T22:44:41.825155] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:42.199712] [DEBUG] [LOCAL ] VAC: Loaded 34670 existing records from primary storage. [2025-10-10T22:44:42.200367] [INFO ] [MAIN ] VAC: Loaded 34670 primary data records. [2025-10-10T22:44:42.290278] [DEBUG] [LOCAL ] V: Loaded 54532 existing records from primary storage. [2025-10-10T22:44:42.321501] [INFO ] [MAIN ] V: Loaded 54532 primary data records. [2025-10-10T22:44:42.520611] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:42.533044] [INFO ] [MAIN ] UZF: Generated 1820 derivative records from 6403 primary records. [2025-10-10T22:44:42.590314] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-10-10T22:44:42.877710] [DEBUG] [LOCAL ] UZF: Derivative data saved (1820 records). [2025-10-10T22:44:42.879568] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-10-10T22:44:42.883351] [INFO ] [MAIN ] Derivative Progress: 1672/1823 symbols completed. UZF took 1.1s. Estimated remaining: 57.6s. Rate: 157.4 symbols/min [2025-10-10T22:44:42.883628] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:42.911121] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:42.913450] [INFO ] [MAIN ] VAC: Generated 1820 derivative records from 34670 primary records. [2025-10-10T22:44:42.915406] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-10T22:44:42.938284] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:42.945467] [INFO ] [MAIN ] V: Generated 1820 derivative records from 54532 primary records. [2025-10-10T22:44:42.946789] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-10T22:44:42.982121] [DEBUG] [LOCAL ] V: Derivative data saved (1820 records). [2025-10-10T22:44:42.982458] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-10T22:44:42.982246] [DEBUG] [LOCAL ] VAC: Derivative data saved (1820 records). [2025-10-10T22:44:42.985014] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-10T22:44:42.984816] [INFO ] [MAIN ] Derivative Progress: 1673/1823 symbols completed. V took 1.2s. Estimated remaining: 57.2s. Rate: 157.4 symbols/min [2025-10-10T22:44:42.987448] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:42.987831] [INFO ] [MAIN ] Derivative Progress: 1674/1823 symbols completed. VAC took 1.2s. Estimated remaining: 56.7s. Rate: 157.5 symbols/min [2025-10-10T22:44:42.988313] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:43.018991] [DEBUG] [LOCAL ] VATE: Loaded 5369 existing records from primary storage. [2025-10-10T22:44:43.021318] [DEBUG] [LOCAL ] VAL: Loaded 50921 existing records from primary storage. [2025-10-10T22:44:43.021599] [INFO ] [MAIN ] VATE: Loaded 5369 primary data records. [2025-10-10T22:44:43.021792] [INFO ] [MAIN ] VAL: Loaded 50921 primary data records. [2025-10-10T22:44:43.478792] [DEBUG] [LOCAL ] VALE: Loaded 54473 existing records from primary storage. [2025-10-10T22:44:43.729007] [INFO ] [MAIN ] VALE: Loaded 54473 primary data records. [2025-10-10T22:44:44.069763] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:44.071468] [INFO ] [MAIN ] VATE: Generated 1820 derivative records from 5369 primary records. [2025-10-10T22:44:44.073492] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-10T22:44:44.100311] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:44.101993] [INFO ] [MAIN ] VAL: Generated 1820 derivative records from 50921 primary records. [2025-10-10T22:44:44.102190] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-10T22:44:44.113532] [DEBUG] [LOCAL ] VATE: Derivative data saved (1820 records). [2025-10-10T22:44:44.113630] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-10T22:44:44.119143] [INFO ] [MAIN ] Derivative Progress: 1675/1823 symbols completed. VATE took 1.1s. Estimated remaining: 56.4s. Rate: 157.4 symbols/min [2025-10-10T22:44:44.119977] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:44.127892] [DEBUG] [LOCAL ] VAL: Derivative data saved (1820 records). [2025-10-10T22:44:44.128931] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-10T22:44:44.131323] [INFO ] [MAIN ] Derivative Progress: 1676/1823 symbols completed. VAL took 1.2s. Estimated remaining: 56.0s. Rate: 157.4 symbols/min [2025-10-10T22:44:44.134331] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:44.148136] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:44.148975] [INFO ] [MAIN ] VALE: Generated 1820 derivative records from 54473 primary records. [2025-10-10T22:44:44.149215] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-10T22:44:44.155433] [DEBUG] [LOCAL ] VBF: Loaded 7204 existing records from primary storage. [2025-10-10T22:44:44.167341] [INFO ] [MAIN ] VBF: Loaded 7204 primary data records. [2025-10-10T22:44:44.194109] [DEBUG] [LOCAL ] VALE: Derivative data saved (1820 records). [2025-10-10T22:44:44.253614] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-10T22:44:44.268901] [DEBUG] [LOCAL ] VCV: Loaded 13672 existing records from primary storage. [2025-10-10T22:44:44.290491] [INFO ] [MAIN ] VCV: Loaded 13672 primary data records. [2025-10-10T22:44:44.307473] [INFO ] [MAIN ] Derivative Progress: 1677/1823 symbols completed. VALE took 1.3s. Estimated remaining: 55.6s. Rate: 157.5 symbols/min [2025-10-10T22:44:44.360989] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:44.916458] [DEBUG] [LOCAL ] VEEV: Loaded 47874 existing records from primary storage. [2025-10-10T22:44:44.917403] [INFO ] [MAIN ] VEEV: Loaded 47874 primary data records. [2025-10-10T22:44:45.035033] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:45.041544] [INFO ] [MAIN ] VBF: Generated 1820 derivative records from 7204 primary records. [2025-10-10T22:44:45.057282] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-10T22:44:45.248039] [DEBUG] [LOCAL ] VBF: Derivative data saved (1820 records). [2025-10-10T22:44:45.249064] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-10T22:44:45.252793] [INFO ] [MAIN ] Derivative Progress: 1678/1823 symbols completed. VBF took 1.1s. Estimated remaining: 55.3s. Rate: 157.4 symbols/min [2025-10-10T22:44:45.267803] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:45.269681] [INFO ] [MAIN ] VCV: Generated 1820 derivative records from 13672 primary records. [2025-10-10T22:44:45.269756] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-10T22:44:45.288090] [DEBUG] [LOCAL ] VCV: Derivative data saved (1820 records). [2025-10-10T22:44:45.288451] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-10T22:44:45.291424] [INFO ] [MAIN ] Derivative Progress: 1679/1823 symbols completed. VCV took 1.2s. Estimated remaining: 54.9s. Rate: 157.4 symbols/min [2025-10-10T22:44:45.315449] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:45.316337] [INFO ] [MAIN ] VEEV: Generated 1820 derivative records from 47874 primary records. [2025-10-10T22:44:45.316407] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-10T22:44:45.335718] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1820 records). [2025-10-10T22:44:45.335895] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-10T22:44:45.337982] [INFO ] [MAIN ] Derivative Progress: 1680/1823 symbols completed. VEEV took 1.0s. Estimated remaining: 54.5s. Rate: 157.5 symbols/min [2025-10-10T22:44:45.338566] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:45.338475] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:45.339182] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:45.362599] [DEBUG] [LOCAL ] VEL: Loaded 12608 existing records from primary storage. [2025-10-10T22:44:45.362903] [INFO ] [MAIN ] VEL: Loaded 12608 primary data records. [2025-10-10T22:44:45.620025] [DEBUG] [LOCAL ] VET: Loaded 44718 existing records from primary storage. [2025-10-10T22:44:45.744277] [INFO ] [MAIN ] VET: Loaded 44718 primary data records. [2025-10-10T22:44:45.766375] [DEBUG] [LOCAL ] VFC: Loaded 54387 existing records from primary storage. [2025-10-10T22:44:45.775853] [INFO ] [MAIN ] VFC: Loaded 54387 primary data records. [2025-10-10T22:44:46.495298] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:46.496980] [INFO ] [MAIN ] VEL: Generated 1820 derivative records from 12608 primary records. [2025-10-10T22:44:46.498300] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-10T22:44:46.522183] [DEBUG] [LOCAL ] VEL: Derivative data saved (1820 records). [2025-10-10T22:44:46.522321] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-10T22:44:46.524802] [INFO ] [MAIN ] Derivative Progress: 1681/1823 symbols completed. VEL took 1.2s. Estimated remaining: 54.2s. Rate: 157.3 symbols/min [2025-10-10T22:44:46.525126] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:46.552746] [DEBUG] [LOCAL ] VGI: Loaded 5267 existing records from primary storage. [2025-10-10T22:44:46.553462] [INFO ] [MAIN ] VGI: Loaded 5267 primary data records. [2025-10-10T22:44:46.553289] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:46.565588] [INFO ] [MAIN ] VET: Generated 1820 derivative records from 44718 primary records. [2025-10-10T22:44:46.632679] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-10T22:44:46.664471] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:46.680808] [INFO ] [MAIN ] VFC: Generated 1820 derivative records from 54387 primary records. [2025-10-10T22:44:46.705498] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-10T22:44:46.780994] [DEBUG] [LOCAL ] VET: Derivative data saved (1820 records). [2025-10-10T22:44:46.899877] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-10T22:44:46.916364] [INFO ] [MAIN ] Derivative Progress: 1682/1823 symbols completed. VET took 1.6s. Estimated remaining: 53.8s. Rate: 157.3 symbols/min [2025-10-10T22:44:46.917515] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:46.924616] [DEBUG] [LOCAL ] VFC: Derivative data saved (1820 records). [2025-10-10T22:44:46.925252] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-10T22:44:46.927818] [INFO ] [MAIN ] Derivative Progress: 1683/1823 symbols completed. VFC took 1.6s. Estimated remaining: 53.4s. Rate: 157.4 symbols/min [2025-10-10T22:44:46.928413] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:46.940221] [DEBUG] [LOCAL ] VHI: Loaded 2774 existing records from primary storage. [2025-10-10T22:44:46.940590] [INFO ] [MAIN ] VHI: Loaded 2774 primary data records. [2025-10-10T22:44:46.990181] [DEBUG] [LOCAL ] VGM: Loaded 18737 existing records from primary storage. [2025-10-10T22:44:47.037632] [INFO ] [MAIN ] VGM: Loaded 18737 primary data records. [2025-10-10T22:44:47.572962] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:47.574378] [INFO ] [MAIN ] VGI: Generated 1820 derivative records from 5267 primary records. [2025-10-10T22:44:47.574946] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-10T22:44:47.596208] [DEBUG] [LOCAL ] VGI: Derivative data saved (1820 records). [2025-10-10T22:44:47.596323] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-10T22:44:47.598819] [INFO ] [MAIN ] Derivative Progress: 1684/1823 symbols completed. VGI took 1.1s. Estimated remaining: 53.0s. Rate: 157.3 symbols/min [2025-10-10T22:44:47.599364] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:47.624810] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:47.626340] [INFO ] [MAIN ] VHI: Generated 1820 derivative records from 2774 primary records. [2025-10-10T22:44:47.626612] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-10T22:44:47.641317] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:47.653105] [INFO ] [MAIN ] VGM: Generated 1820 derivative records from 18737 primary records. [2025-10-10T22:44:47.653270] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-10T22:44:47.658102] [DEBUG] [LOCAL ] VHI: Derivative data saved (1820 records). [2025-10-10T22:44:47.658546] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-10T22:44:47.670095] [INFO ] [MAIN ] Derivative Progress: 1685/1823 symbols completed. VHI took 0.7s. Estimated remaining: 52.6s. Rate: 157.4 symbols/min [2025-10-10T22:44:47.673156] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:47.678081] [DEBUG] [LOCAL ] VGM: Derivative data saved (1820 records). [2025-10-10T22:44:47.678269] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-10T22:44:47.680708] [INFO ] [MAIN ] Derivative Progress: 1686/1823 symbols completed. VGM took 0.8s. Estimated remaining: 52.2s. Rate: 157.5 symbols/min [2025-10-10T22:44:47.680854] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:47.721350] [DEBUG] [LOCAL ] VICI: Loaded 54430 existing records from primary storage. [2025-10-10T22:44:47.721506] [INFO ] [MAIN ] VICI: Loaded 54430 primary data records. [2025-10-10T22:44:48.069467] [DEBUG] [LOCAL ] VIK: Loaded 53216 existing records from primary storage. [2025-10-10T22:44:48.074824] [INFO ] [MAIN ] VIK: Loaded 53216 primary data records. [2025-10-10T22:44:47.968414] [DEBUG] [LOCAL ] VIPS: Loaded 52000 existing records from primary storage. [2025-10-10T22:44:48.114323] [INFO ] [MAIN ] VIPS: Loaded 52000 primary data records. [2025-10-10T22:44:48.866456] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:48.868888] [INFO ] [MAIN ] VICI: Generated 1820 derivative records from 54430 primary records. [2025-10-10T22:44:48.869054] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-10T22:44:48.892185] [DEBUG] [LOCAL ] VICI: Derivative data saved (1820 records). [2025-10-10T22:44:48.892872] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-10T22:44:48.896149] [INFO ] [MAIN ] Derivative Progress: 1687/1823 symbols completed. VICI took 1.3s. Estimated remaining: 51.9s. Rate: 157.3 symbols/min [2025-10-10T22:44:48.896521] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:48.916192] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:48.917114] [INFO ] [MAIN ] VIPS: Generated 1820 derivative records from 52000 primary records. [2025-10-10T22:44:48.917535] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-10T22:44:48.938785] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1820 records). [2025-10-10T22:44:48.939082] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-10T22:44:48.941416] [INFO ] [MAIN ] Derivative Progress: 1688/1823 symbols completed. VIPS took 1.3s. Estimated remaining: 51.5s. Rate: 157.4 symbols/min [2025-10-10T22:44:48.941621] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:48.957604] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:48.958838] [INFO ] [MAIN ] VIK: Generated 1820 derivative records from 53216 primary records. [2025-10-10T22:44:48.959100] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-10T22:44:48.992361] [DEBUG] [LOCAL ] VIK: Derivative data saved (1820 records). [2025-10-10T22:44:48.992809] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-10T22:44:48.995533] [INFO ] [MAIN ] Derivative Progress: 1689/1823 symbols completed. VIK took 1.3s. Estimated remaining: 51.1s. Rate: 157.5 symbols/min [2025-10-10T22:44:48.996074] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:49.015151] [DEBUG] [LOCAL ] VIRT: Loaded 47459 existing records from primary storage. [2025-10-10T22:44:49.015372] [INFO ] [MAIN ] VIRT: Loaded 47459 primary data records. [2025-10-10T22:44:49.355579] [DEBUG] [LOCAL ] VIST: Loaded 46928 existing records from primary storage. [2025-10-10T22:44:49.364972] [INFO ] [MAIN ] VIST: Loaded 46928 primary data records. [2025-10-10T22:44:49.447030] [DEBUG] [LOCAL ] VIV: Loaded 45510 existing records from primary storage. [2025-10-10T22:44:49.452861] [INFO ] [MAIN ] VIV: Loaded 45510 primary data records. [2025-10-10T22:44:50.051958] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:50.054889] [INFO ] [MAIN ] VIRT: Generated 1820 derivative records from 47459 primary records. [2025-10-10T22:44:50.055470] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-10T22:44:50.074224] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1820 records). [2025-10-10T22:44:50.074519] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-10T22:44:50.076953] [INFO ] [MAIN ] Derivative Progress: 1690/1823 symbols completed. VIRT took 1.2s. Estimated remaining: 50.7s. Rate: 157.3 symbols/min [2025-10-10T22:44:50.077276] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:50.096117] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:50.096857] [INFO ] [MAIN ] VIST: Generated 1820 derivative records from 46928 primary records. [2025-10-10T22:44:50.097155] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-10T22:44:50.141242] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:50.140696] [DEBUG] [LOCAL ] VKQ: Loaded 17616 existing records from primary storage. [2025-10-10T22:44:50.142499] [INFO ] [MAIN ] VIV: Generated 1820 derivative records from 45510 primary records. [2025-10-10T22:44:50.142627] [INFO ] [MAIN ] VKQ: Loaded 17616 primary data records. [2025-10-10T22:44:50.142933] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-10T22:44:50.155187] [DEBUG] [LOCAL ] VIST: Derivative data saved (1820 records). [2025-10-10T22:44:50.163783] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-10T22:44:50.183419] [INFO ] [MAIN ] Derivative Progress: 1691/1823 symbols completed. VIST took 1.2s. Estimated remaining: 50.3s. Rate: 157.4 symbols/min [2025-10-10T22:44:50.190954] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:50.228901] [DEBUG] [LOCAL ] VIV: Derivative data saved (1820 records). [2025-10-10T22:44:50.235590] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-10T22:44:50.237985] [INFO ] [MAIN ] Derivative Progress: 1692/1823 symbols completed. VIV took 1.2s. Estimated remaining: 49.9s. Rate: 157.4 symbols/min [2025-10-10T22:44:50.243863] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:50.521232] [DEBUG] [LOCAL ] VLN: Loaded 30383 existing records from primary storage. [2025-10-10T22:44:50.521602] [INFO ] [MAIN ] VLN: Loaded 30383 primary data records. [2025-10-10T22:44:50.746984] [DEBUG] [LOCAL ] VLO: Loaded 53837 existing records from primary storage. [2025-10-10T22:44:50.747758] [INFO ] [MAIN ] VLO: Loaded 53837 primary data records. [2025-10-10T22:44:51.186668] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:51.189457] [INFO ] [MAIN ] VKQ: Generated 1820 derivative records from 17616 primary records. [2025-10-10T22:44:51.189988] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-10T22:44:51.208721] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1820 records). [2025-10-10T22:44:51.209533] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-10T22:44:51.212009] [INFO ] [MAIN ] Derivative Progress: 1693/1823 symbols completed. VKQ took 1.1s. Estimated remaining: 49.6s. Rate: 157.3 symbols/min [2025-10-10T22:44:51.230451] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:51.231254] [INFO ] [MAIN ] VLN: Generated 1820 derivative records from 30383 primary records. [2025-10-10T22:44:51.231461] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-10T22:44:51.251513] [DEBUG] [LOCAL ] VLN: Derivative data saved (1820 records). [2025-10-10T22:44:51.252250] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-10T22:44:51.254556] [INFO ] [MAIN ] Derivative Progress: 1694/1823 symbols completed. VLN took 1.1s. Estimated remaining: 49.2s. Rate: 157.4 symbols/min [2025-10-10T22:44:51.267674] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:51.268265] [INFO ] [MAIN ] VLO: Generated 1820 derivative records from 53837 primary records. [2025-10-10T22:44:51.268325] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-10T22:44:51.284287] [DEBUG] [LOCAL ] VLO: Derivative data saved (1820 records). [2025-10-10T22:44:51.284345] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-10T22:44:51.286954] [INFO ] [MAIN ] Derivative Progress: 1695/1823 symbols completed. VLO took 1.0s. Estimated remaining: 48.8s. Rate: 157.5 symbols/min [2025-10-10T22:44:51.287485] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:51.287439] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:51.287560] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:51.298340] [DEBUG] [LOCAL ] VLT: Loaded 4574 existing records from primary storage. [2025-10-10T22:44:51.298442] [INFO ] [MAIN ] VLT: Loaded 4574 primary data records. [2025-10-10T22:44:51.622397] [DEBUG] [LOCAL ] VLRS: Loaded 40669 existing records from primary storage. [2025-10-10T22:44:51.635632] [INFO ] [MAIN ] VLRS: Loaded 40669 primary data records. [2025-10-10T22:44:51.756061] [DEBUG] [LOCAL ] VLTO: Loaded 46814 existing records from primary storage. [2025-10-10T22:44:51.756626] [INFO ] [MAIN ] VLTO: Loaded 46814 primary data records. [2025-10-10T22:44:52.301979] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:52.303226] [INFO ] [MAIN ] VLT: Generated 1820 derivative records from 4574 primary records. [2025-10-10T22:44:52.303427] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-10T22:44:52.321316] [DEBUG] [LOCAL ] VLT: Derivative data saved (1820 records). [2025-10-10T22:44:52.321715] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-10T22:44:52.323992] [INFO ] [MAIN ] Derivative Progress: 1696/1823 symbols completed. VLT took 1.0s. Estimated remaining: 48.4s. Rate: 157.3 symbols/min [2025-10-10T22:44:52.324590] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:52.342873] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:52.343829] [INFO ] [MAIN ] VLRS: Generated 1820 derivative records from 40669 primary records. [2025-10-10T22:44:52.345792] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-10T22:44:52.372777] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:52.375782] [INFO ] [MAIN ] VLTO: Generated 1820 derivative records from 46814 primary records. [2025-10-10T22:44:52.376532] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-10T22:44:52.393851] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1820 records). [2025-10-10T22:44:52.403674] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-10T22:44:52.406061] [INFO ] [MAIN ] Derivative Progress: 1697/1823 symbols completed. VLRS took 1.1s. Estimated remaining: 48.0s. Rate: 157.4 symbols/min [2025-10-10T22:44:52.406524] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:52.409764] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1820 records). [2025-10-10T22:44:52.410095] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-10T22:44:52.412491] [INFO ] [MAIN ] Derivative Progress: 1698/1823 symbols completed. VLTO took 1.1s. Estimated remaining: 47.6s. Rate: 157.5 symbols/min [2025-10-10T22:44:52.412807] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:52.429252] [DEBUG] [LOCAL ] VMC: Loaded 43347 existing records from primary storage. [2025-10-10T22:44:52.429549] [INFO ] [MAIN ] VMC: Loaded 43347 primary data records. [2025-10-10T22:44:52.549518] [DEBUG] [LOCAL ] VMI: Loaded 15456 existing records from primary storage. [2025-10-10T22:44:52.552928] [INFO ] [MAIN ] VMI: Loaded 15456 primary data records. [2025-10-10T22:44:52.650867] [DEBUG] [LOCAL ] VMO: Loaded 21176 existing records from primary storage. [2025-10-10T22:44:52.663221] [INFO ] [MAIN ] VMO: Loaded 21176 primary data records. [2025-10-10T22:44:53.450235] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:53.452045] [INFO ] [MAIN ] VMC: Generated 1820 derivative records from 43347 primary records. [2025-10-10T22:44:53.452319] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-10T22:44:53.477010] [DEBUG] [LOCAL ] VMC: Derivative data saved (1820 records). [2025-10-10T22:44:53.477829] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-10T22:44:53.480180] [INFO ] [MAIN ] Derivative Progress: 1699/1823 symbols completed. VMC took 1.2s. Estimated remaining: 47.3s. Rate: 157.3 symbols/min [2025-10-10T22:44:53.481077] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:53.505400] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:44:53.507138] [INFO ] [MAIN ] VMI: Generated 1819 derivative records from 15456 primary records. [2025-10-10T22:44:53.507304] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-10T22:44:53.521216] [DEBUG] [LOCAL ] VNCE: Loaded 8751 existing records from primary storage. [2025-10-10T22:44:53.527577] [INFO ] [MAIN ] VNCE: Loaded 8751 primary data records. [2025-10-10T22:44:53.618297] [DEBUG] [LOCAL ] VMI: Derivative data saved (1819 records). [2025-10-10T22:44:53.625298] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:53.652535] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-10T22:44:53.656464] [INFO ] [MAIN ] Derivative Progress: 1700/1823 symbols completed. VMI took 1.2s. Estimated remaining: 46.9s. Rate: 157.4 symbols/min [2025-10-10T22:44:53.656745] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:53.654046] [INFO ] [MAIN ] VMO: Generated 1820 derivative records from 21176 primary records. [2025-10-10T22:44:53.657485] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-10T22:44:53.873812] [DEBUG] [LOCAL ] VMO: Derivative data saved (1820 records). [2025-10-10T22:44:53.874266] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-10T22:44:53.877484] [INFO ] [MAIN ] Derivative Progress: 1701/1823 symbols completed. VMO took 1.5s. Estimated remaining: 46.5s. Rate: 157.4 symbols/min [2025-10-10T22:44:53.878565] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:53.917270] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:53.918052] [INFO ] [MAIN ] VNCE: Generated 1820 derivative records from 8751 primary records. [2025-10-10T22:44:53.918119] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-10-10T22:44:53.958682] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1820 records). [2025-10-10T22:44:53.959020] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-10-10T22:44:53.961293] [INFO ] [MAIN ] Derivative Progress: 1702/1823 symbols completed. VNCE took 0.5s. Estimated remaining: 46.1s. Rate: 157.5 symbols/min [2025-10-10T22:44:53.961460] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:53.963537] [DEBUG] [LOCAL ] VNO: Loaded 49551 existing records from primary storage. [2025-10-10T22:44:53.964338] [INFO ] [MAIN ] VNO: Loaded 49551 primary data records. [2025-10-10T22:44:54.087004] [DEBUG] [LOCAL ] VOC: Loaded 9114 existing records from primary storage. [2025-10-10T22:44:54.105490] [INFO ] [MAIN ] VOC: Loaded 9114 primary data records. [2025-10-10T22:44:54.201842] [DEBUG] [LOCAL ] VNT: Loaded 44351 existing records from primary storage. [2025-10-10T22:44:54.212537] [INFO ] [MAIN ] VNT: Loaded 44351 primary data records. [2025-10-10T22:44:55.044578] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:55.048184] [INFO ] [MAIN ] VNO: Generated 1820 derivative records from 49551 primary records. [2025-10-10T22:44:55.048344] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-10T22:44:55.077092] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:55.079541] [DEBUG] [LOCAL ] VNO: Derivative data saved (1820 records). [2025-10-10T22:44:55.080429] [INFO ] [MAIN ] VOC: Generated 1820 derivative records from 9114 primary records. [2025-10-10T22:44:55.080797] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-10T22:44:55.080739] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-10T22:44:55.083032] [INFO ] [MAIN ] Derivative Progress: 1703/1823 symbols completed. VNO took 1.4s. Estimated remaining: 45.8s. Rate: 157.3 symbols/min [2025-10-10T22:44:55.083713] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:55.104151] [DEBUG] [LOCAL ] VOC: Derivative data saved (1820 records). [2025-10-10T22:44:55.104323] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-10T22:44:55.106595] [INFO ] [MAIN ] Derivative Progress: 1704/1823 symbols completed. VOC took 1.1s. Estimated remaining: 45.4s. Rate: 157.4 symbols/min [2025-10-10T22:44:55.106829] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:55.121274] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:55.122079] [INFO ] [MAIN ] VNT: Generated 1820 derivative records from 44351 primary records. [2025-10-10T22:44:55.122176] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-10T22:44:55.142058] [DEBUG] [LOCAL ] VNT: Derivative data saved (1820 records). [2025-10-10T22:44:55.142293] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-10T22:44:55.144757] [INFO ] [MAIN ] Derivative Progress: 1705/1823 symbols completed. VNT took 1.3s. Estimated remaining: 45.0s. Rate: 157.5 symbols/min [2025-10-10T22:44:55.149129] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:55.167290] [DEBUG] [LOCAL ] VPG: Loaded 17234 existing records from primary storage. [2025-10-10T22:44:55.167440] [INFO ] [MAIN ] VPG: Loaded 17234 primary data records. [2025-10-10T22:44:55.254342] [DEBUG] [LOCAL ] VPV: Loaded 5516 existing records from primary storage. [2025-10-10T22:44:55.261843] [INFO ] [MAIN ] VPV: Loaded 5516 primary data records. [2025-10-10T22:44:55.310502] [DEBUG] [LOCAL ] VOYA: Loaded 42862 existing records from primary storage. [2025-10-10T22:44:55.338212] [INFO ] [MAIN ] VOYA: Loaded 42862 primary data records. [2025-10-10T22:44:56.165356] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:56.167124] [INFO ] [MAIN ] VPG: Generated 1820 derivative records from 17234 primary records. [2025-10-10T22:44:56.167221] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-10T22:44:56.191472] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:56.198062] [INFO ] [MAIN ] VPV: Generated 1820 derivative records from 5516 primary records. [2025-10-10T22:44:56.198847] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-10T22:44:56.214731] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:56.225215] [INFO ] [MAIN ] VOYA: Generated 1820 derivative records from 42862 primary records. [2025-10-10T22:44:56.228529] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-10T22:44:56.228900] [DEBUG] [LOCAL ] VPG: Derivative data saved (1820 records). [2025-10-10T22:44:56.233401] [DEBUG] [LOCAL ] VPV: Derivative data saved (1820 records). [2025-10-10T22:44:56.233895] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-10T22:44:56.230696] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-10T22:44:56.237277] [INFO ] [MAIN ] Derivative Progress: 1706/1823 symbols completed. VPV took 1.1s. Estimated remaining: 44.6s. Rate: 157.3 symbols/min [2025-10-10T22:44:56.252045] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:56.252989] [INFO ] [MAIN ] Derivative Progress: 1707/1823 symbols completed. VPG took 1.1s. Estimated remaining: 44.2s. Rate: 157.4 symbols/min [2025-10-10T22:44:56.253158] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:56.257918] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1820 records). [2025-10-10T22:44:56.258046] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-10T22:44:56.260529] [INFO ] [MAIN ] Derivative Progress: 1708/1823 symbols completed. VOYA took 1.2s. Estimated remaining: 43.8s. Rate: 157.5 symbols/min [2025-10-10T22:44:56.307348] [DEBUG] [LOCAL ] VRE: Loaded 35549 existing records from primary storage. [2025-10-10T22:44:56.307548] [INFO ] [MAIN ] VRE: Loaded 35549 primary data records. [2025-10-10T22:44:56.665809] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-10-10T22:44:56.665985] [INFO ] [MAIN ] VRT: Loaded 54533 primary data records. [2025-10-10T22:44:56.984470] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:56.986520] [INFO ] [MAIN ] VRE: Generated 1820 derivative records from 35549 primary records. [2025-10-10T22:44:56.986616] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-10T22:44:57.005221] [DEBUG] [LOCAL ] VRE: Derivative data saved (1820 records). [2025-10-10T22:44:57.005509] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-10T22:44:57.008790] [INFO ] [MAIN ] Derivative Progress: 1709/1823 symbols completed. VRE took 0.8s. Estimated remaining: 43.5s. Rate: 157.4 symbols/min [2025-10-10T22:44:57.024930] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:57.025569] [INFO ] [MAIN ] VRT: Generated 1820 derivative records from 54533 primary records. [2025-10-10T22:44:57.025632] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-10T22:44:57.041980] [DEBUG] [LOCAL ] VRT: Derivative data saved (1820 records). [2025-10-10T22:44:57.042039] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-10T22:44:57.044896] [INFO ] [MAIN ] Derivative Progress: 1710/1823 symbols completed. VRT took 0.8s. Estimated remaining: 43.1s. Rate: 157.5 symbols/min [2025-10-10T22:44:57.045614] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:57.045528] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:57.046112] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:57.067488] [DEBUG] [LOCAL ] VRTS: Loaded 9421 existing records from primary storage. [2025-10-10T22:44:57.067668] [INFO ] [MAIN ] VRTS: Loaded 9421 primary data records. [2025-10-10T22:44:57.408411] [DEBUG] [LOCAL ] VSH: Loaded 48908 existing records from primary storage. [2025-10-10T22:44:57.408760] [INFO ] [MAIN ] VSH: Loaded 48908 primary data records. [2025-10-10T22:44:57.535619] [DEBUG] [LOCAL ] VSCO: Loaded 53514 existing records from primary storage. [2025-10-10T22:44:57.576854] [INFO ] [MAIN ] VSCO: Loaded 53514 primary data records. [2025-10-10T22:44:58.057356] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:58.060143] [INFO ] [MAIN ] VRTS: Generated 1820 derivative records from 9421 primary records. [2025-10-10T22:44:58.060668] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-10T22:44:58.078271] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1820 records). [2025-10-10T22:44:58.078579] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-10T22:44:58.081771] [INFO ] [MAIN ] Derivative Progress: 1711/1823 symbols completed. VRTS took 1.0s. Estimated remaining: 42.7s. Rate: 157.3 symbols/min [2025-10-10T22:44:58.081927] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:58.101340] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:58.102596] [INFO ] [MAIN ] VSH: Generated 1820 derivative records from 48908 primary records. [2025-10-10T22:44:58.102759] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-10T22:44:58.124859] [DEBUG] [LOCAL ] VSH: Derivative data saved (1820 records). [2025-10-10T22:44:58.125218] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-10T22:44:58.139536] [INFO ] [MAIN ] Derivative Progress: 1712/1823 symbols completed. VSH took 1.1s. Estimated remaining: 42.3s. Rate: 157.4 symbols/min [2025-10-10T22:44:58.139822] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:58.140383] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:58.141388] [INFO ] [MAIN ] VSCO: Generated 1820 derivative records from 53514 primary records. [2025-10-10T22:44:58.141451] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-10T22:44:58.182382] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1820 records). [2025-10-10T22:44:58.183481] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-10T22:44:58.185885] [INFO ] [MAIN ] Derivative Progress: 1713/1823 symbols completed. VSCO took 1.1s. Estimated remaining: 41.9s. Rate: 157.5 symbols/min [2025-10-10T22:44:58.186041] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:58.187478] [DEBUG] [LOCAL ] VSTS: Loaded 49658 existing records from primary storage. [2025-10-10T22:44:58.187705] [INFO ] [MAIN ] VSTS: Loaded 49658 primary data records. [2025-10-10T22:44:58.516565] [DEBUG] [LOCAL ] VTEX: Loaded 43617 existing records from primary storage. [2025-10-10T22:44:58.517818] [INFO ] [MAIN ] VTEX: Loaded 43617 primary data records. [2025-10-10T22:44:58.655705] [DEBUG] [LOCAL ] VTLE: Loaded 48858 existing records from primary storage. [2025-10-10T22:44:58.673769] [INFO ] [MAIN ] VTLE: Loaded 48858 primary data records. [2025-10-10T22:44:59.193968] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:59.195111] [INFO ] [MAIN ] VSTS: Generated 1820 derivative records from 49658 primary records. [2025-10-10T22:44:59.195281] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-10T22:44:59.217344] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1820 records). [2025-10-10T22:44:59.217791] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-10T22:44:59.221662] [INFO ] [MAIN ] Derivative Progress: 1714/1823 symbols completed. VSTS took 1.1s. Estimated remaining: 41.6s. Rate: 157.3 symbols/min [2025-10-10T22:44:59.223217] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:59.244954] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:59.246338] [INFO ] [MAIN ] VTEX: Generated 1820 derivative records from 43617 primary records. [2025-10-10T22:44:59.246695] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-10T22:44:59.276020] [DEBUG] [LOCAL ] VTMX: Loaded 17778 existing records from primary storage. [2025-10-10T22:44:59.277021] [INFO ] [MAIN ] VTMX: Loaded 17778 primary data records. [2025-10-10T22:44:59.301764] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1820 records). [2025-10-10T22:44:59.321593] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-10T22:44:59.321487] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:44:59.337675] [INFO ] [MAIN ] Derivative Progress: 1715/1823 symbols completed. VTEX took 1.2s. Estimated remaining: 41.2s. Rate: 157.4 symbols/min [2025-10-10T22:44:59.327683] [INFO ] [MAIN ] VTLE: Generated 1820 derivative records from 48858 primary records. [2025-10-10T22:44:59.337891] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:59.370171] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-10T22:44:59.466028] [DEBUG] [LOCAL ] VTN: Loaded 7080 existing records from primary storage. [2025-10-10T22:44:59.499945] [INFO ] [MAIN ] VTN: Loaded 7080 primary data records. [2025-10-10T22:44:59.577492] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1820 records). [2025-10-10T22:44:59.586228] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-10T22:44:59.593820] [INFO ] [MAIN ] Derivative Progress: 1716/1823 symbols completed. VTLE took 1.4s. Estimated remaining: 40.8s. Rate: 157.4 symbols/min [2025-10-10T22:44:59.713115] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:44:59.956196] [DEBUG] [LOCAL ] VTOL: Loaded 19730 existing records from primary storage. [2025-10-10T22:44:59.956726] [INFO ] [MAIN ] VTOL: Loaded 19730 primary data records. [2025-10-10T22:45:00.157478] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:00.280445] [INFO ] [MAIN ] VTMX: Generated 1820 derivative records from 17778 primary records. [2025-10-10T22:45:00.280890] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-10T22:45:00.302693] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1820 records). [2025-10-10T22:45:00.303505] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-10T22:45:00.306805] [INFO ] [MAIN ] Derivative Progress: 1717/1823 symbols completed. VTMX took 1.1s. Estimated remaining: 40.4s. Rate: 157.3 symbols/min [2025-10-10T22:45:00.307158] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:00.320667] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:00.321673] [INFO ] [MAIN ] VTN: Generated 1820 derivative records from 7080 primary records. [2025-10-10T22:45:00.321841] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-10T22:45:00.339053] [DEBUG] [LOCAL ] VTN: Derivative data saved (1820 records). [2025-10-10T22:45:00.339347] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-10T22:45:00.341603] [INFO ] [MAIN ] Derivative Progress: 1718/1823 symbols completed. VTN took 1.0s. Estimated remaining: 40.0s. Rate: 157.4 symbols/min [2025-10-10T22:45:00.341920] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:00.357969] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:00.358759] [INFO ] [MAIN ] VTOL: Generated 1820 derivative records from 19730 primary records. [2025-10-10T22:45:00.358890] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-10T22:45:00.375756] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1820 records). [2025-10-10T22:45:00.375892] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-10T22:45:00.378333] [INFO ] [MAIN ] Derivative Progress: 1719/1823 symbols completed. VTOL took 0.7s. Estimated remaining: 39.6s. Rate: 157.5 symbols/min [2025-10-10T22:45:00.378563] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:00.413978] [DEBUG] [LOCAL ] VTS: Loaded 30552 existing records from primary storage. [2025-10-10T22:45:00.414238] [INFO ] [MAIN ] VTS: Loaded 30552 primary data records. [2025-10-10T22:45:00.538317] [DEBUG] [LOCAL ] VTR: Loaded 53530 existing records from primary storage. [2025-10-10T22:45:00.558626] [INFO ] [MAIN ] VTR: Loaded 53530 primary data records. [2025-10-10T22:45:00.637062] [DEBUG] [LOCAL ] VVR: Loaded 32015 existing records from primary storage. [2025-10-10T22:45:00.653869] [INFO ] [MAIN ] VVR: Loaded 32015 primary data records. [2025-10-10T22:45:01.481449] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:01.483794] [INFO ] [MAIN ] VTS: Generated 1820 derivative records from 30552 primary records. [2025-10-10T22:45:01.484111] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-10T22:45:01.508091] [DEBUG] [LOCAL ] VTS: Derivative data saved (1820 records). [2025-10-10T22:45:01.509892] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-10T22:45:01.514279] [INFO ] [MAIN ] Derivative Progress: 1720/1823 symbols completed. VTS took 1.2s. Estimated remaining: 39.3s. Rate: 157.3 symbols/min [2025-10-10T22:45:01.514601] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:01.547745] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:01.548227] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:01.550006] [INFO ] [MAIN ] VTR: Generated 1820 derivative records from 53530 primary records. [2025-10-10T22:45:01.549220] [INFO ] [MAIN ] VVR: Generated 1820 derivative records from 32015 primary records. [2025-10-10T22:45:01.550357] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-10T22:45:01.550241] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-10T22:45:01.585981] [DEBUG] [LOCAL ] VTR: Derivative data saved (1820 records). [2025-10-10T22:45:01.586279] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-10T22:45:01.589477] [INFO ] [MAIN ] Derivative Progress: 1721/1823 symbols completed. VTR took 1.3s. Estimated remaining: 38.9s. Rate: 157.4 symbols/min [2025-10-10T22:45:01.589811] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:01.611473] [DEBUG] [LOCAL ] VVR: Derivative data saved (1820 records). [2025-10-10T22:45:01.611707] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-10T22:45:01.614669] [INFO ] [MAIN ] Derivative Progress: 1722/1823 symbols completed. VVR took 1.2s. Estimated remaining: 38.5s. Rate: 157.5 symbols/min [2025-10-10T22:45:01.615022] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:01.636176] [DEBUG] [LOCAL ] VVV: Loaded 51012 existing records from primary storage. [2025-10-10T22:45:01.636482] [INFO ] [MAIN ] VVV: Loaded 51012 primary data records. [2025-10-10T22:45:01.788350] [DEBUG] [LOCAL ] VVX: Loaded 23187 existing records from primary storage. [2025-10-10T22:45:01.810230] [INFO ] [MAIN ] VVX: Loaded 23187 primary data records. [2025-10-10T22:45:02.124957] [DEBUG] [LOCAL ] VYX: Loaded 49261 existing records from primary storage. [2025-10-10T22:45:02.135842] [INFO ] [MAIN ] VYX: Loaded 49261 primary data records. [2025-10-10T22:45:02.755265] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:02.756433] [INFO ] [MAIN ] VVV: Generated 1820 derivative records from 51012 primary records. [2025-10-10T22:45:02.756726] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-10T22:45:02.775124] [DEBUG] [LOCAL ] VVV: Derivative data saved (1820 records). [2025-10-10T22:45:02.775942] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-10T22:45:02.779317] [INFO ] [MAIN ] Derivative Progress: 1723/1823 symbols completed. VVV took 1.3s. Estimated remaining: 38.2s. Rate: 157.3 symbols/min [2025-10-10T22:45:02.793477] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:02.794347] [INFO ] [MAIN ] VVX: Generated 1820 derivative records from 23187 primary records. [2025-10-10T22:45:02.794446] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-10T22:45:02.822337] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:02.823394] [INFO ] [MAIN ] VYX: Generated 1820 derivative records from 49261 primary records. [2025-10-10T22:45:02.823897] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-10T22:45:02.834137] [DEBUG] [LOCAL ] VVX: Derivative data saved (1820 records). [2025-10-10T22:45:02.836699] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-10T22:45:02.839034] [INFO ] [MAIN ] Derivative Progress: 1724/1823 symbols completed. VVX took 1.2s. Estimated remaining: 37.8s. Rate: 157.3 symbols/min [2025-10-10T22:45:02.842980] [DEBUG] [LOCAL ] VYX: Derivative data saved (1820 records). [2025-10-10T22:45:02.843040] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-10T22:45:02.845155] [INFO ] [MAIN ] Derivative Progress: 1725/1823 symbols completed. VYX took 1.2s. Estimated remaining: 37.3s. Rate: 157.4 symbols/min [2025-10-10T22:45:02.845549] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:02.845498] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:02.845867] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:02.930873] [DEBUG] [LOCAL ] W: Loaded 54218 existing records from primary storage. [2025-10-10T22:45:02.957944] [INFO ] [MAIN ] W: Loaded 54218 primary data records. [2025-10-10T22:45:02.971309] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-10-10T22:45:02.998163] [INFO ] [MAIN ] VZ: Loaded 54571 primary data records. [2025-10-10T22:45:03.166803] [DEBUG] [LOCAL ] WAB: Loaded 44672 existing records from primary storage. [2025-10-10T22:45:03.188206] [INFO ] [MAIN ] WAB: Loaded 44672 primary data records. [2025-10-10T22:45:03.947579] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:03.953238] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:03.954058] [INFO ] [MAIN ] W: Generated 1820 derivative records from 54218 primary records. [2025-10-10T22:45:03.954286] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-10T22:45:03.955111] [INFO ] [MAIN ] VZ: Generated 1820 derivative records from 54571 primary records. [2025-10-10T22:45:03.955294] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-10T22:45:03.996122] [DEBUG] [LOCAL ] W: Derivative data saved (1820 records). [2025-10-10T22:45:04.002499] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-10T22:45:04.004696] [INFO ] [MAIN ] Derivative Progress: 1726/1823 symbols completed. W took 1.2s. Estimated remaining: 37.0s. Rate: 157.2 symbols/min [2025-10-10T22:45:04.005216] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:04.005084] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:04.007607] [INFO ] [MAIN ] WAB: Generated 1820 derivative records from 44672 primary records. [2025-10-10T22:45:04.008525] [DEBUG] [LOCAL ] VZ: Derivative data saved (1820 records). [2025-10-10T22:45:04.008774] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-10T22:45:04.008829] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-10T22:45:04.011219] [INFO ] [MAIN ] Derivative Progress: 1727/1823 symbols completed. VZ took 1.2s. Estimated remaining: 36.6s. Rate: 157.3 symbols/min [2025-10-10T22:45:04.011912] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:04.029093] [DEBUG] [LOCAL ] WAB: Derivative data saved (1820 records). [2025-10-10T22:45:04.029219] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-10T22:45:04.031401] [INFO ] [MAIN ] Derivative Progress: 1728/1823 symbols completed. WAB took 1.2s. Estimated remaining: 36.2s. Rate: 157.4 symbols/min [2025-10-10T22:45:04.031530] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:04.122457] [DEBUG] [LOCAL ] WAL: Loaded 45940 existing records from primary storage. [2025-10-10T22:45:04.122602] [INFO ] [MAIN ] WAL: Loaded 45940 primary data records. [2025-10-10T22:45:04.278497] [DEBUG] [LOCAL ] WAT: Loaded 36046 existing records from primary storage. [2025-10-10T22:45:04.294676] [INFO ] [MAIN ] WAT: Loaded 36046 primary data records. [2025-10-10T22:45:04.607517] [DEBUG] [LOCAL ] WBS: Loaded 49376 existing records from primary storage. [2025-10-10T22:45:04.624512] [INFO ] [MAIN ] WBS: Loaded 49376 primary data records. [2025-10-10T22:45:05.178998] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:05.180291] [INFO ] [MAIN ] WAL: Generated 1820 derivative records from 45940 primary records. [2025-10-10T22:45:05.181104] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-10T22:45:05.200123] [DEBUG] [LOCAL ] WAL: Derivative data saved (1820 records). [2025-10-10T22:45:05.201691] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-10T22:45:05.203948] [INFO ] [MAIN ] Derivative Progress: 1729/1823 symbols completed. WAL took 1.2s. Estimated remaining: 35.9s. Rate: 157.2 symbols/min [2025-10-10T22:45:05.204908] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:05.228537] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:05.229869] [INFO ] [MAIN ] WAT: Generated 1820 derivative records from 36046 primary records. [2025-10-10T22:45:05.229995] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-10T22:45:05.248856] [DEBUG] [LOCAL ] WAT: Derivative data saved (1820 records). [2025-10-10T22:45:05.249034] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-10T22:45:05.253766] [INFO ] [MAIN ] Derivative Progress: 1730/1823 symbols completed. WAT took 1.2s. Estimated remaining: 35.5s. Rate: 157.3 symbols/min [2025-10-10T22:45:05.254866] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:05.272266] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:05.273231] [INFO ] [MAIN ] WBS: Generated 1820 derivative records from 49376 primary records. [2025-10-10T22:45:05.273464] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-10T22:45:05.303668] [DEBUG] [LOCAL ] WBS: Derivative data saved (1820 records). [2025-10-10T22:45:05.303910] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-10T22:45:05.307214] [INFO ] [MAIN ] Derivative Progress: 1731/1823 symbols completed. WBS took 1.3s. Estimated remaining: 35.1s. Rate: 157.4 symbols/min [2025-10-10T22:45:05.307519] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:05.322075] [DEBUG] [LOCAL ] WCC: Loaded 39666 existing records from primary storage. [2025-10-10T22:45:05.322561] [INFO ] [MAIN ] WCC: Loaded 39666 primary data records. [2025-10-10T22:45:05.533136] [DEBUG] [LOCAL ] WD: Loaded 23365 existing records from primary storage. [2025-10-10T22:45:05.534039] [DEBUG] [LOCAL ] WCN: Loaded 48658 existing records from primary storage. [2025-10-10T22:45:05.534457] [INFO ] [MAIN ] WCN: Loaded 48658 primary data records. [2025-10-10T22:45:05.534371] [INFO ] [MAIN ] WD: Loaded 23365 primary data records. [2025-10-10T22:45:06.320634] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:06.322085] [INFO ] [MAIN ] WCC: Generated 1820 derivative records from 39666 primary records. [2025-10-10T22:45:06.322501] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-10T22:45:06.353688] [DEBUG] [LOCAL ] WCC: Derivative data saved (1820 records). [2025-10-10T22:45:06.359587] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-10T22:45:06.359368] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:06.360519] [INFO ] [MAIN ] WD: Generated 1820 derivative records from 23365 primary records. [2025-10-10T22:45:06.363973] [INFO ] [MAIN ] Derivative Progress: 1732/1823 symbols completed. WCC took 1.2s. Estimated remaining: 34.7s. Rate: 157.2 symbols/min [2025-10-10T22:45:06.360665] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-10T22:45:06.364301] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:06.383496] [DEBUG] [LOCAL ] WD: Derivative data saved (1820 records). [2025-10-10T22:45:06.383935] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-10T22:45:06.387999] [INFO ] [MAIN ] Derivative Progress: 1733/1823 symbols completed. WD took 1.1s. Estimated remaining: 34.3s. Rate: 157.3 symbols/min [2025-10-10T22:45:06.388513] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:06.408780] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:06.409781] [INFO ] [MAIN ] WCN: Generated 1820 derivative records from 48658 primary records. [2025-10-10T22:45:06.409894] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-10T22:45:06.432445] [DEBUG] [LOCAL ] WCN: Derivative data saved (1820 records). [2025-10-10T22:45:06.434062] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-10T22:45:06.436306] [INFO ] [MAIN ] Derivative Progress: 1734/1823 symbols completed. WCN took 1.2s. Estimated remaining: 33.9s. Rate: 157.4 symbols/min [2025-10-10T22:45:06.436596] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:06.437464] [DEBUG] [LOCAL ] WDH: Loaded 18268 existing records from primary storage. [2025-10-10T22:45:06.438132] [INFO ] [MAIN ] WDH: Loaded 18268 primary data records. [2025-10-10T22:45:06.529382] [DEBUG] [LOCAL ] WDI: Loaded 21388 existing records from primary storage. [2025-10-10T22:45:06.541216] [INFO ] [MAIN ] WDI: Loaded 21388 primary data records. [2025-10-10T22:45:07.151154] [DEBUG] [LOCAL ] WDS: Loaded 43729 existing records from primary storage. [2025-10-10T22:45:07.153412] [INFO ] [MAIN ] WDS: Loaded 43729 primary data records. [2025-10-10T22:45:07.496929] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:07.512313] [INFO ] [MAIN ] WDH: Generated 1820 derivative records from 18268 primary records. [2025-10-10T22:45:07.513030] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:07.513150] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-10T22:45:07.514336] [INFO ] [MAIN ] WDI: Generated 1820 derivative records from 21388 primary records. [2025-10-10T22:45:07.516804] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-10T22:45:07.547936] [DEBUG] [LOCAL ] WDH: Derivative data saved (1820 records). [2025-10-10T22:45:07.548291] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-10T22:45:07.550857] [INFO ] [MAIN ] Derivative Progress: 1735/1823 symbols completed. WDH took 1.2s. Estimated remaining: 33.6s. Rate: 157.2 symbols/min [2025-10-10T22:45:07.551639] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:07.555899] [DEBUG] [LOCAL ] WDI: Derivative data saved (1820 records). [2025-10-10T22:45:07.557035] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-10T22:45:07.560154] [INFO ] [MAIN ] Derivative Progress: 1736/1823 symbols completed. WDI took 1.2s. Estimated remaining: 33.2s. Rate: 157.3 symbols/min [2025-10-10T22:45:07.560695] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:07.574194] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:07.577149] [INFO ] [MAIN ] WDS: Generated 1820 derivative records from 43729 primary records. [2025-10-10T22:45:07.577301] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-10T22:45:07.594536] [DEBUG] [LOCAL ] WEA: Loaded 7639 existing records from primary storage. [2025-10-10T22:45:07.598275] [INFO ] [MAIN ] WEA: Loaded 7639 primary data records. [2025-10-10T22:45:07.599297] [DEBUG] [LOCAL ] WDS: Derivative data saved (1820 records). [2025-10-10T22:45:07.611267] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-10T22:45:07.640818] [INFO ] [MAIN ] Derivative Progress: 1737/1823 symbols completed. WDS took 1.2s. Estimated remaining: 32.8s. Rate: 157.4 symbols/min [2025-10-10T22:45:07.668740] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:07.952866] [DEBUG] [LOCAL ] WEAV: Loaded 42583 existing records from primary storage. [2025-10-10T22:45:07.953122] [INFO ] [MAIN ] WEAV: Loaded 42583 primary data records. [2025-10-10T22:45:08.179312] [DEBUG] [LOCAL ] WEC: Loaded 52920 existing records from primary storage. [2025-10-10T22:45:08.183270] [INFO ] [MAIN ] WEC: Loaded 52920 primary data records. [2025-10-10T22:45:08.504822] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:08.621052] [INFO ] [MAIN ] WEA: Generated 1820 derivative records from 7639 primary records. [2025-10-10T22:45:08.621471] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-10T22:45:08.644469] [DEBUG] [LOCAL ] WEA: Derivative data saved (1820 records). [2025-10-10T22:45:08.657485] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-10T22:45:08.661445] [INFO ] [MAIN ] Derivative Progress: 1738/1823 symbols completed. WEA took 1.1s. Estimated remaining: 32.4s. Rate: 157.2 symbols/min [2025-10-10T22:45:08.661836] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:08.663233] [INFO ] [MAIN ] WEAV: Generated 1820 derivative records from 42583 primary records. [2025-10-10T22:45:08.663451] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-10T22:45:08.687557] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1820 records). [2025-10-10T22:45:08.687922] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-10T22:45:08.690494] [INFO ] [MAIN ] Derivative Progress: 1739/1823 symbols completed. WEAV took 1.1s. Estimated remaining: 32.0s. Rate: 157.3 symbols/min [2025-10-10T22:45:08.703512] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:08.704447] [INFO ] [MAIN ] WEC: Generated 1820 derivative records from 52920 primary records. [2025-10-10T22:45:08.704513] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-10T22:45:08.723409] [DEBUG] [LOCAL ] WEC: Derivative data saved (1820 records). [2025-10-10T22:45:08.723537] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-10T22:45:08.725802] [INFO ] [MAIN ] Derivative Progress: 1740/1823 symbols completed. WEC took 1.1s. Estimated remaining: 31.6s. Rate: 157.4 symbols/min [2025-10-10T22:45:08.726273] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:08.726353] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:08.726917] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:08.826201] [DEBUG] [LOCAL ] WEX: Loaded 34207 existing records from primary storage. [2025-10-10T22:45:08.827005] [DEBUG] [LOCAL ] WES: Loaded 49050 existing records from primary storage. [2025-10-10T22:45:08.827120] [INFO ] [MAIN ] WEX: Loaded 34207 primary data records. [2025-10-10T22:45:08.828050] [DEBUG] [LOCAL ] WELL: Loaded 53103 existing records from primary storage. [2025-10-10T22:45:08.828478] [INFO ] [MAIN ] WELL: Loaded 53103 primary data records. [2025-10-10T22:45:08.828166] [INFO ] [MAIN ] WES: Loaded 49050 primary data records. [2025-10-10T22:45:09.815389] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:09.817218] [INFO ] [MAIN ] WEX: Generated 1820 derivative records from 34207 primary records. [2025-10-10T22:45:09.817374] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-10T22:45:09.847024] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:09.862325] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:09.847887] [DEBUG] [LOCAL ] WEX: Derivative data saved (1820 records). [2025-10-10T22:45:09.863207] [INFO ] [MAIN ] WELL: Generated 1820 derivative records from 53103 primary records. [2025-10-10T22:45:09.863352] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-10T22:45:09.865881] [INFO ] [MAIN ] Derivative Progress: 1741/1823 symbols completed. WEX took 1.1s. Estimated remaining: 31.3s. Rate: 157.2 symbols/min [2025-10-10T22:45:09.863992] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-10T22:45:09.863919] [INFO ] [MAIN ] WES: Generated 1820 derivative records from 49050 primary records. [2025-10-10T22:45:09.867174] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:09.867618] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-10T22:45:09.900961] [DEBUG] [LOCAL ] WES: Derivative data saved (1820 records). [2025-10-10T22:45:09.901299] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-10T22:45:09.907502] [INFO ] [MAIN ] Derivative Progress: 1742/1823 symbols completed. WES took 1.2s. Estimated remaining: 30.9s. Rate: 157.3 symbols/min [2025-10-10T22:45:09.908259] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:09.908020] [DEBUG] [LOCAL ] WELL: Derivative data saved (1820 records). [2025-10-10T22:45:09.908529] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-10T22:45:09.912009] [INFO ] [MAIN ] Derivative Progress: 1743/1823 symbols completed. WELL took 1.2s. Estimated remaining: 30.5s. Rate: 157.4 symbols/min [2025-10-10T22:45:09.912382] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:09.918460] [DEBUG] [LOCAL ] WF: Loaded 10888 existing records from primary storage. [2025-10-10T22:45:09.918603] [INFO ] [MAIN ] WF: Loaded 10888 primary data records. [2025-10-10T22:45:10.243673] [DEBUG] [LOCAL ] WFG: Loaded 25167 existing records from primary storage. [2025-10-10T22:45:10.243836] [INFO ] [MAIN ] WFG: Loaded 25167 primary data records. [2025-10-10T22:45:10.365113] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-10-10T22:45:10.366123] [INFO ] [MAIN ] WFC: Loaded 54528 primary data records. [2025-10-10T22:45:10.957739] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:10.959547] [INFO ] [MAIN ] WF: Generated 1820 derivative records from 10888 primary records. [2025-10-10T22:45:10.959811] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-10T22:45:10.991575] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:10.994895] [INFO ] [MAIN ] WFG: Generated 1820 derivative records from 25167 primary records. [2025-10-10T22:45:10.994128] [DEBUG] [LOCAL ] WF: Derivative data saved (1820 records). [2025-10-10T22:45:10.995218] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-10T22:45:10.995896] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-10T22:45:10.998132] [INFO ] [MAIN ] Derivative Progress: 1744/1823 symbols completed. WF took 1.1s. Estimated remaining: 30.1s. Rate: 157.2 symbols/min [2025-10-10T22:45:11.007370] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:11.017944] [DEBUG] [LOCAL ] WFG: Derivative data saved (1820 records). [2025-10-10T22:45:11.018076] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-10T22:45:11.020274] [INFO ] [MAIN ] Derivative Progress: 1745/1823 symbols completed. WFG took 1.1s. Estimated remaining: 29.8s. Rate: 157.3 symbols/min [2025-10-10T22:45:11.020475] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:11.034241] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:11.035018] [INFO ] [MAIN ] WFC: Generated 1820 derivative records from 54528 primary records. [2025-10-10T22:45:11.035191] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-10T22:45:11.051772] [DEBUG] [LOCAL ] WFC: Derivative data saved (1820 records). [2025-10-10T22:45:11.051946] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-10T22:45:11.054291] [INFO ] [MAIN ] Derivative Progress: 1746/1823 symbols completed. WFC took 1.1s. Estimated remaining: 29.4s. Rate: 157.4 symbols/min [2025-10-10T22:45:11.054602] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:11.090294] [DEBUG] [LOCAL ] WGO: Loaded 39034 existing records from primary storage. [2025-10-10T22:45:11.090438] [INFO ] [MAIN ] WGO: Loaded 39034 primary data records. [2025-10-10T22:45:11.201100] [DEBUG] [LOCAL ] WH: Loaded 45953 existing records from primary storage. [2025-10-10T22:45:11.204572] [INFO ] [MAIN ] WH: Loaded 45953 primary data records. [2025-10-10T22:45:11.399576] [DEBUG] [LOCAL ] WHD: Loaded 40649 existing records from primary storage. [2025-10-10T22:45:11.530403] [INFO ] [MAIN ] WHD: Loaded 40649 primary data records. [2025-10-10T22:45:12.130747] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:12.133685] [INFO ] [MAIN ] WGO: Generated 1820 derivative records from 39034 primary records. [2025-10-10T22:45:12.134133] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-10T22:45:12.160961] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:12.163184] [INFO ] [MAIN ] WH: Generated 1820 derivative records from 45953 primary records. [2025-10-10T22:45:12.163523] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-10T22:45:12.181674] [DEBUG] [LOCAL ] WGO: Derivative data saved (1820 records). [2025-10-10T22:45:12.182329] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-10T22:45:12.184802] [INFO ] [MAIN ] Derivative Progress: 1747/1823 symbols completed. WGO took 1.2s. Estimated remaining: 29.0s. Rate: 157.2 symbols/min [2025-10-10T22:45:12.185421] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:12.189326] [DEBUG] [LOCAL ] WH: Derivative data saved (1820 records). [2025-10-10T22:45:12.189437] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-10T22:45:12.191941] [INFO ] [MAIN ] Derivative Progress: 1748/1823 symbols completed. WH took 1.2s. Estimated remaining: 28.6s. Rate: 157.3 symbols/min [2025-10-10T22:45:12.192447] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:12.200968] [DEBUG] [LOCAL ] WHG: Loaded 3257 existing records from primary storage. [2025-10-10T22:45:12.201370] [INFO ] [MAIN ] WHG: Loaded 3257 primary data records. [2025-10-10T22:45:12.260676] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:12.299120] [INFO ] [MAIN ] WHD: Generated 1820 derivative records from 40649 primary records. [2025-10-10T22:45:12.323875] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-10T22:45:12.555577] [DEBUG] [LOCAL ] WHD: Derivative data saved (1820 records). [2025-10-10T22:45:12.555886] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-10T22:45:12.558001] [INFO ] [MAIN ] Derivative Progress: 1749/1823 symbols completed. WHD took 1.5s. Estimated remaining: 28.2s. Rate: 157.3 symbols/min [2025-10-10T22:45:12.558344] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:12.578400] [DEBUG] [LOCAL ] WHR: Loaded 49139 existing records from primary storage. [2025-10-10T22:45:12.578672] [INFO ] [MAIN ] WHR: Loaded 49139 primary data records. [2025-10-10T22:45:12.612476] [DEBUG] [LOCAL ] WIA: Loaded 5040 existing records from primary storage. [2025-10-10T22:45:12.618265] [INFO ] [MAIN ] WIA: Loaded 5040 primary data records. [2025-10-10T22:45:13.277161] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:13.278167] [INFO ] [MAIN ] WHG: Generated 1820 derivative records from 3257 primary records. [2025-10-10T22:45:13.278610] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-10T22:45:13.304914] [DEBUG] [LOCAL ] WHG: Derivative data saved (1820 records). [2025-10-10T22:45:13.305073] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-10T22:45:13.307363] [INFO ] [MAIN ] Derivative Progress: 1750/1823 symbols completed. WHG took 1.1s. Estimated remaining: 27.9s. Rate: 157.2 symbols/min [2025-10-10T22:45:13.315360] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:13.321592] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:13.322419] [INFO ] [MAIN ] WHR: Generated 1820 derivative records from 49139 primary records. [2025-10-10T22:45:13.323504] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-10T22:45:13.356139] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:13.362460] [DEBUG] [LOCAL ] WINN: Loaded 11739 existing records from primary storage. [2025-10-10T22:45:13.364208] [INFO ] [MAIN ] WINN: Loaded 11739 primary data records. [2025-10-10T22:45:13.363284] [INFO ] [MAIN ] WIA: Generated 1820 derivative records from 5040 primary records. [2025-10-10T22:45:13.364143] [DEBUG] [LOCAL ] WHR: Derivative data saved (1820 records). [2025-10-10T22:45:13.384741] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-10T22:45:13.384817] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-10T22:45:13.409339] [INFO ] [MAIN ] Derivative Progress: 1751/1823 symbols completed. WHR took 1.2s. Estimated remaining: 27.5s. Rate: 157.3 symbols/min [2025-10-10T22:45:13.421452] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:13.680227] [DEBUG] [LOCAL ] WIA: Derivative data saved (1820 records). [2025-10-10T22:45:13.680596] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-10T22:45:13.683532] [INFO ] [MAIN ] Derivative Progress: 1752/1823 symbols completed. WIA took 1.1s. Estimated remaining: 27.1s. Rate: 157.3 symbols/min [2025-10-10T22:45:13.683820] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:13.725245] [DEBUG] [LOCAL ] WIT: Loaded 53178 existing records from primary storage. [2025-10-10T22:45:13.725958] [INFO ] [MAIN ] WIT: Loaded 53178 primary data records. [2025-10-10T22:45:13.867621] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:45:13.868580] [DEBUG] [LOCAL ] WIW: Loaded 20672 existing records from primary storage. [2025-10-10T22:45:13.870010] [INFO ] [MAIN ] WINN: Generated 1819 derivative records from 11739 primary records. [2025-10-10T22:45:13.870274] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-10T22:45:13.870121] [INFO ] [MAIN ] WIW: Loaded 20672 primary data records. [2025-10-10T22:45:14.205979] [DEBUG] [LOCAL ] WINN: Derivative data saved (1819 records). [2025-10-10T22:45:14.212911] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-10T22:45:14.220828] [INFO ] [MAIN ] Derivative Progress: 1753/1823 symbols completed. WINN took 0.9s. Estimated remaining: 26.7s. Rate: 157.3 symbols/min [2025-10-10T22:45:14.442238] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:14.443020] [INFO ] [MAIN ] WIT: Generated 1820 derivative records from 53178 primary records. [2025-10-10T22:45:14.443212] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-10T22:45:14.475628] [DEBUG] [LOCAL ] WIT: Derivative data saved (1820 records). [2025-10-10T22:45:14.476006] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:14.476225] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-10T22:45:14.478441] [INFO ] [MAIN ] Derivative Progress: 1754/1823 symbols completed. WIT took 1.1s. Estimated remaining: 26.3s. Rate: 157.3 symbols/min [2025-10-10T22:45:14.479220] [INFO ] [MAIN ] WIW: Generated 1820 derivative records from 20672 primary records. [2025-10-10T22:45:14.479312] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-10T22:45:14.494961] [DEBUG] [LOCAL ] WIW: Derivative data saved (1820 records). [2025-10-10T22:45:14.495023] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-10T22:45:14.497323] [INFO ] [MAIN ] Derivative Progress: 1755/1823 symbols completed. WIW took 0.8s. Estimated remaining: 25.9s. Rate: 157.4 symbols/min [2025-10-10T22:45:14.497845] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:14.498077] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:14.497947] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:14.646694] [DEBUG] [LOCAL ] WKC: Loaded 35157 existing records from primary storage. [2025-10-10T22:45:14.646939] [INFO ] [MAIN ] WKC: Loaded 35157 primary data records. [2025-10-10T22:45:14.647451] [DEBUG] [LOCAL ] WK: Loaded 37775 existing records from primary storage. [2025-10-10T22:45:14.680789] [INFO ] [MAIN ] WK: Loaded 37775 primary data records. [2025-10-10T22:45:14.758470] [DEBUG] [LOCAL ] WLK: Loaded 46251 existing records from primary storage. [2025-10-10T22:45:14.791006] [INFO ] [MAIN ] WLK: Loaded 46251 primary data records. [2025-10-10T22:45:15.625839] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:15.626680] [INFO ] [MAIN ] WKC: Generated 1820 derivative records from 35157 primary records. [2025-10-10T22:45:15.626926] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-10T22:45:15.645055] [DEBUG] [LOCAL ] WKC: Derivative data saved (1820 records). [2025-10-10T22:45:15.646470] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-10T22:45:15.649812] [INFO ] [MAIN ] Derivative Progress: 1756/1823 symbols completed. WKC took 1.2s. Estimated remaining: 25.6s. Rate: 157.2 symbols/min [2025-10-10T22:45:15.650341] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:15.664128] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:15.672270] [INFO ] [MAIN ] WLK: Generated 1820 derivative records from 46251 primary records. [2025-10-10T22:45:15.672422] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-10T22:45:15.678257] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:15.688196] [INFO ] [MAIN ] WK: Generated 1820 derivative records from 37775 primary records. [2025-10-10T22:45:15.692001] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-10T22:45:15.696167] [DEBUG] [LOCAL ] WLK: Derivative data saved (1820 records). [2025-10-10T22:45:15.696538] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-10T22:45:15.698918] [INFO ] [MAIN ] Derivative Progress: 1757/1823 symbols completed. WLK took 1.2s. Estimated remaining: 25.2s. Rate: 157.3 symbols/min [2025-10-10T22:45:15.702793] [DEBUG] [LOCAL ] WLKP: Loaded 7020 existing records from primary storage. [2025-10-10T22:45:15.709920] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:15.713826] [INFO ] [MAIN ] WLKP: Loaded 7020 primary data records. [2025-10-10T22:45:15.754501] [DEBUG] [LOCAL ] WK: Derivative data saved (1820 records). [2025-10-10T22:45:15.783231] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-10T22:45:15.795932] [INFO ] [MAIN ] Derivative Progress: 1758/1823 symbols completed. WK took 1.3s. Estimated remaining: 24.8s. Rate: 157.3 symbols/min [2025-10-10T22:45:15.801234] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:16.082161] [DEBUG] [LOCAL ] WLY: Loaded 29980 existing records from primary storage. [2025-10-10T22:45:16.083065] [INFO ] [MAIN ] WLY: Loaded 29980 primary data records. [2025-10-10T22:45:16.417687] [DEBUG] [LOCAL ] WM: Loaded 51718 existing records from primary storage. [2025-10-10T22:45:16.418248] [INFO ] [MAIN ] WM: Loaded 51718 primary data records. [2025-10-10T22:45:16.570147] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:16.624303] [INFO ] [MAIN ] WLKP: Generated 1820 derivative records from 7020 primary records. [2025-10-10T22:45:16.734017] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-10T22:45:16.761346] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1820 records). [2025-10-10T22:45:16.761593] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-10T22:45:16.763736] [INFO ] [MAIN ] Derivative Progress: 1759/1823 symbols completed. WLKP took 1.1s. Estimated remaining: 24.4s. Rate: 157.2 symbols/min [2025-10-10T22:45:16.763965] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:16.783927] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:16.785138] [INFO ] [MAIN ] WLY: Generated 1820 derivative records from 29980 primary records. [2025-10-10T22:45:16.785259] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-10T22:45:16.803086] [DEBUG] [LOCAL ] WLY: Derivative data saved (1820 records). [2025-10-10T22:45:16.803477] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-10T22:45:16.805696] [INFO ] [MAIN ] Derivative Progress: 1760/1823 symbols completed. WLY took 1.1s. Estimated remaining: 24.0s. Rate: 157.3 symbols/min [2025-10-10T22:45:16.805868] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:16.827566] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:16.828295] [INFO ] [MAIN ] WM: Generated 1820 derivative records from 51718 primary records. [2025-10-10T22:45:16.828418] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-10T22:45:16.858558] [DEBUG] [LOCAL ] WM: Derivative data saved (1820 records). [2025-10-10T22:45:16.858757] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-10T22:45:16.860871] [INFO ] [MAIN ] Derivative Progress: 1761/1823 symbols completed. WM took 1.1s. Estimated remaining: 23.6s. Rate: 157.4 symbols/min [2025-10-10T22:45:16.865681] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:16.874158] [DEBUG] [LOCAL ] WMK: Loaded 14815 existing records from primary storage. [2025-10-10T22:45:16.888393] [INFO ] [MAIN ] WMK: Loaded 14815 primary data records. [2025-10-10T22:45:16.920490] [DEBUG] [LOCAL ] WMB: Loaded 54452 existing records from primary storage. [2025-10-10T22:45:16.953604] [INFO ] [MAIN ] WMB: Loaded 54452 primary data records. [2025-10-10T22:45:17.216472] [DEBUG] [LOCAL ] WMS: Loaded 40212 existing records from primary storage. [2025-10-10T22:45:17.216745] [INFO ] [MAIN ] WMS: Loaded 40212 primary data records. [2025-10-10T22:45:17.853365] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:17.854392] [INFO ] [MAIN ] WMK: Generated 1820 derivative records from 14815 primary records. [2025-10-10T22:45:17.854486] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-10T22:45:17.888284] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:17.889934] [INFO ] [MAIN ] WMB: Generated 1820 derivative records from 54452 primary records. [2025-10-10T22:45:17.890334] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-10T22:45:17.893476] [DEBUG] [LOCAL ] WMK: Derivative data saved (1820 records). [2025-10-10T22:45:17.904820] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-10T22:45:17.910541] [INFO ] [MAIN ] Derivative Progress: 1762/1823 symbols completed. WMK took 1.1s. Estimated remaining: 23.3s. Rate: 157.2 symbols/min [2025-10-10T22:45:17.912132] [DEBUG] [LOCAL ] WMB: Derivative data saved (1820 records). [2025-10-10T22:45:17.912282] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:17.913307] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-10T22:45:17.916016] [INFO ] [MAIN ] Derivative Progress: 1763/1823 symbols completed. WMB took 1.2s. Estimated remaining: 22.9s. Rate: 157.3 symbols/min [2025-10-10T22:45:17.916300] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:17.932675] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:17.933459] [INFO ] [MAIN ] WMS: Generated 1820 derivative records from 40212 primary records. [2025-10-10T22:45:17.933570] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-10T22:45:17.950905] [DEBUG] [LOCAL ] WMS: Derivative data saved (1820 records). [2025-10-10T22:45:17.951221] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-10T22:45:17.953373] [INFO ] [MAIN ] Derivative Progress: 1764/1823 symbols completed. WMS took 1.1s. Estimated remaining: 22.5s. Rate: 157.4 symbols/min [2025-10-10T22:45:17.953605] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:18.008484] [DEBUG] [LOCAL ] WNC: Loaded 39319 existing records from primary storage. [2025-10-10T22:45:18.017713] [INFO ] [MAIN ] WNC: Loaded 39319 primary data records. [2025-10-10T22:45:18.162464] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-10-10T22:45:18.163942] [DEBUG] [LOCAL ] WNS: Loaded 40459 existing records from primary storage. [2025-10-10T22:45:18.164254] [INFO ] [MAIN ] WMT: Loaded 54580 primary data records. [2025-10-10T22:45:18.164845] [INFO ] [MAIN ] WNS: Loaded 40459 primary data records. [2025-10-10T22:45:19.121405] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:19.123709] [INFO ] [MAIN ] WNC: Generated 1820 derivative records from 39319 primary records. [2025-10-10T22:45:19.123982] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-10T22:45:19.149331] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:19.151210] [INFO ] [MAIN ] WNS: Generated 1820 derivative records from 40459 primary records. [2025-10-10T22:45:19.151619] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-10-10T22:45:19.171993] [DEBUG] [LOCAL ] WNC: Derivative data saved (1820 records). [2025-10-10T22:45:19.172964] [DEBUG] [LOCAL ] WNS: Derivative data saved (1820 records). [2025-10-10T22:45:19.173769] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-10T22:45:19.173897] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-10-10T22:45:19.175824] [INFO ] [MAIN ] Derivative Progress: 1765/1823 symbols completed. WNC took 1.3s. Estimated remaining: 22.1s. Rate: 157.2 symbols/min [2025-10-10T22:45:19.178317] [INFO ] [MAIN ] Derivative Progress: 1766/1823 symbols completed. WNS took 1.2s. Estimated remaining: 21.7s. Rate: 157.3 symbols/min [2025-10-10T22:45:19.178563] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:19.178264] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:19.192140] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:19.192933] [INFO ] [MAIN ] WMT: Generated 1820 derivative records from 54580 primary records. [2025-10-10T22:45:19.192994] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-10T22:45:19.209366] [DEBUG] [LOCAL ] WMT: Derivative data saved (1820 records). [2025-10-10T22:45:19.209615] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-10T22:45:19.211905] [INFO ] [MAIN ] Derivative Progress: 1767/1823 symbols completed. WMT took 1.3s. Estimated remaining: 21.4s. Rate: 157.4 symbols/min [2025-10-10T22:45:19.212109] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:19.229667] [DEBUG] [LOCAL ] WOR: Loaded 24978 existing records from primary storage. [2025-10-10T22:45:19.229809] [INFO ] [MAIN ] WOR: Loaded 24978 primary data records. [2025-10-10T22:45:19.451046] [DEBUG] [LOCAL ] WOLF: Loaded 53950 existing records from primary storage. [2025-10-10T22:45:19.563887] [DEBUG] [LOCAL ] WOW: Loaded 31014 existing records from primary storage. [2025-10-10T22:45:19.558230] [INFO ] [MAIN ] WOLF: Loaded 53950 primary data records. [2025-10-10T22:45:19.564075] [INFO ] [MAIN ] WOW: Loaded 31014 primary data records. [2025-10-10T22:45:20.246979] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:20.249384] [INFO ] [MAIN ] WOR: Generated 1820 derivative records from 24978 primary records. [2025-10-10T22:45:20.249583] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-10T22:45:20.275964] [DEBUG] [LOCAL ] WOR: Derivative data saved (1820 records). [2025-10-10T22:45:20.278632] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-10T22:45:20.281147] [INFO ] [MAIN ] Derivative Progress: 1768/1823 symbols completed. WOR took 1.1s. Estimated remaining: 21.0s. Rate: 157.2 symbols/min [2025-10-10T22:45:20.314524] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:20.329776] [INFO ] [MAIN ] WOLF: Generated 1820 derivative records from 53950 primary records. [2025-10-10T22:45:20.331099] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:20.331212] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-10T22:45:20.333325] [INFO ] [MAIN ] WOW: Generated 1820 derivative records from 31014 primary records. [2025-10-10T22:45:20.333441] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-10T22:45:20.378256] [DEBUG] [LOCAL ] WOW: Derivative data saved (1820 records). [2025-10-10T22:45:20.379201] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-10T22:45:20.381891] [INFO ] [MAIN ] Derivative Progress: 1769/1823 symbols completed. WOW took 1.2s. Estimated remaining: 20.6s. Rate: 157.3 symbols/min [2025-10-10T22:45:20.387128] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1820 records). [2025-10-10T22:45:20.387374] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-10T22:45:20.391448] [INFO ] [MAIN ] Derivative Progress: 1770/1823 symbols completed. WOLF took 1.2s. Estimated remaining: 20.2s. Rate: 157.3 symbols/min [2025-10-10T22:45:20.392400] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:20.392512] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:20.392268] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:20.463455] [DEBUG] [LOCAL ] WPC: Loaded 48975 existing records from primary storage. [2025-10-10T22:45:20.464084] [INFO ] [MAIN ] WPC: Loaded 48975 primary data records. [2025-10-10T22:45:20.639491] [DEBUG] [LOCAL ] WPP: Loaded 34748 existing records from primary storage. [2025-10-10T22:45:20.658574] [INFO ] [MAIN ] WPP: Loaded 34748 primary data records. [2025-10-10T22:45:20.728842] [DEBUG] [LOCAL ] WPM: Loaded 53518 existing records from primary storage. [2025-10-10T22:45:20.760750] [INFO ] [MAIN ] WPM: Loaded 53518 primary data records. [2025-10-10T22:45:21.706039] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:21.707152] [INFO ] [MAIN ] WPC: Generated 1820 derivative records from 48975 primary records. [2025-10-10T22:45:21.707327] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-10T22:45:21.726847] [DEBUG] [LOCAL ] WPC: Derivative data saved (1820 records). [2025-10-10T22:45:21.727137] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-10T22:45:21.729251] [INFO ] [MAIN ] Derivative Progress: 1771/1823 symbols completed. WPC took 1.3s. Estimated remaining: 19.9s. Rate: 157.1 symbols/min [2025-10-10T22:45:21.731513] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:21.744865] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:21.746552] [INFO ] [MAIN ] WPM: Generated 1820 derivative records from 53518 primary records. [2025-10-10T22:45:21.747552] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-10T22:45:21.778351] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:21.780098] [INFO ] [MAIN ] WPP: Generated 1820 derivative records from 34748 primary records. [2025-10-10T22:45:21.780185] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-10T22:45:21.791771] [DEBUG] [LOCAL ] WPM: Derivative data saved (1820 records). [2025-10-10T22:45:21.796320] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-10T22:45:21.799293] [INFO ] [MAIN ] Derivative Progress: 1772/1823 symbols completed. WPM took 1.4s. Estimated remaining: 19.5s. Rate: 157.2 symbols/min [2025-10-10T22:45:21.799910] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:21.812032] [DEBUG] [LOCAL ] WPP: Derivative data saved (1820 records). [2025-10-10T22:45:21.812175] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-10T22:45:21.814839] [INFO ] [MAIN ] Derivative Progress: 1773/1823 symbols completed. WPP took 1.4s. Estimated remaining: 19.1s. Rate: 157.3 symbols/min [2025-10-10T22:45:21.829505] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:21.850124] [DEBUG] [LOCAL ] WRB: Loaded 51438 existing records from primary storage. [2025-10-10T22:45:21.850371] [INFO ] [MAIN ] WRB: Loaded 51438 primary data records. [2025-10-10T22:45:22.029234] [DEBUG] [LOCAL ] WS: Loaded 23878 existing records from primary storage. [2025-10-10T22:45:22.047367] [INFO ] [MAIN ] WS: Loaded 23878 primary data records. [2025-10-10T22:45:22.300571] [DEBUG] [LOCAL ] WRBY: Loaded 51446 existing records from primary storage. [2025-10-10T22:45:22.311956] [INFO ] [MAIN ] WRBY: Loaded 51446 primary data records. [2025-10-10T22:45:22.841693] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:22.842558] [INFO ] [MAIN ] WRB: Generated 1820 derivative records from 51438 primary records. [2025-10-10T22:45:22.843215] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-10T22:45:22.859815] [DEBUG] [LOCAL ] WRB: Derivative data saved (1820 records). [2025-10-10T22:45:22.859922] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-10T22:45:22.862311] [INFO ] [MAIN ] Derivative Progress: 1774/1823 symbols completed. WRB took 1.1s. Estimated remaining: 18.7s. Rate: 157.1 symbols/min [2025-10-10T22:45:22.865048] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:22.878994] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:22.879785] [INFO ] [MAIN ] WS: Generated 1820 derivative records from 23878 primary records. [2025-10-10T22:45:22.880050] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-10T22:45:22.898131] [DEBUG] [LOCAL ] WS: Derivative data saved (1820 records). [2025-10-10T22:45:22.898382] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-10T22:45:22.900515] [INFO ] [MAIN ] Derivative Progress: 1775/1823 symbols completed. WS took 1.1s. Estimated remaining: 18.3s. Rate: 157.2 symbols/min [2025-10-10T22:45:22.900758] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:22.914243] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:22.914998] [INFO ] [MAIN ] WRBY: Generated 1820 derivative records from 51446 primary records. [2025-10-10T22:45:22.915169] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-10T22:45:22.960639] [DEBUG] [LOCAL ] WSO: Loaded 25618 existing records from primary storage. [2025-10-10T22:45:22.961116] [INFO ] [MAIN ] WSO: Loaded 25618 primary data records. [2025-10-10T22:45:22.998978] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1820 records). [2025-10-10T22:45:23.056023] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-10T22:45:23.075540] [INFO ] [MAIN ] Derivative Progress: 1776/1823 symbols completed. WRBY took 1.3s. Estimated remaining: 17.9s. Rate: 157.3 symbols/min [2025-10-10T22:45:23.075737] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:23.073571] [DEBUG] [LOCAL ] WSM: Loaded 50013 existing records from primary storage. [2025-10-10T22:45:23.087843] [INFO ] [MAIN ] WSM: Loaded 50013 primary data records. [2025-10-10T22:45:23.511869] [DEBUG] [LOCAL ] WSR: Loaded 23191 existing records from primary storage. [2025-10-10T22:45:23.638173] [INFO ] [MAIN ] WSR: Loaded 23191 primary data records. [2025-10-10T22:45:23.973418] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:23.975473] [INFO ] [MAIN ] WSO: Generated 1820 derivative records from 25618 primary records. [2025-10-10T22:45:23.975880] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-10T22:45:24.009592] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:24.013331] [INFO ] [MAIN ] WSM: Generated 1820 derivative records from 50013 primary records. [2025-10-10T22:45:24.013916] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-10T22:45:24.025485] [DEBUG] [LOCAL ] WSO: Derivative data saved (1820 records). [2025-10-10T22:45:24.029731] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-10T22:45:24.032499] [INFO ] [MAIN ] Derivative Progress: 1777/1823 symbols completed. WSO took 1.1s. Estimated remaining: 17.6s. Rate: 157.1 symbols/min [2025-10-10T22:45:24.033114] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:24.047860] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:24.048815] [INFO ] [MAIN ] WSR: Generated 1820 derivative records from 23191 primary records. [2025-10-10T22:45:24.048989] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-10T22:45:24.068073] [DEBUG] [LOCAL ] WSM: Derivative data saved (1820 records). [2025-10-10T22:45:24.068727] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-10T22:45:24.075286] [DEBUG] [LOCAL ] WSR: Derivative data saved (1820 records). [2025-10-10T22:45:24.075409] [INFO ] [MAIN ] Derivative Progress: 1778/1823 symbols completed. WSM took 1.2s. Estimated remaining: 17.2s. Rate: 157.2 symbols/min [2025-10-10T22:45:24.075540] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-10T22:45:24.078115] [INFO ] [MAIN ] Derivative Progress: 1779/1823 symbols completed. WSR took 1.0s. Estimated remaining: 16.8s. Rate: 157.3 symbols/min [2025-10-10T22:45:24.077961] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:24.078339] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:24.113089] [DEBUG] [LOCAL ] WST: Loaded 37444 existing records from primary storage. [2025-10-10T22:45:24.113358] [INFO ] [MAIN ] WST: Loaded 37444 primary data records. [2025-10-10T22:45:24.480282] [DEBUG] [LOCAL ] WT: Loaded 48659 existing records from primary storage. [2025-10-10T22:45:24.482755] [DEBUG] [LOCAL ] WTI: Loaded 44879 existing records from primary storage. [2025-10-10T22:45:24.483410] [INFO ] [MAIN ] WTI: Loaded 44879 primary data records. [2025-10-10T22:45:24.483581] [INFO ] [MAIN ] WT: Loaded 48659 primary data records. [2025-10-10T22:45:25.113282] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:25.115280] [INFO ] [MAIN ] WST: Generated 1820 derivative records from 37444 primary records. [2025-10-10T22:45:25.115529] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-10T22:45:25.139348] [DEBUG] [LOCAL ] WST: Derivative data saved (1820 records). [2025-10-10T22:45:25.140888] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-10T22:45:25.143325] [INFO ] [MAIN ] Derivative Progress: 1780/1823 symbols completed. WST took 1.1s. Estimated remaining: 16.4s. Rate: 157.1 symbols/min [2025-10-10T22:45:25.143501] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:25.157802] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:25.158487] [INFO ] [MAIN ] WTI: Generated 1820 derivative records from 44879 primary records. [2025-10-10T22:45:25.158568] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-10T22:45:25.191158] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:25.191932] [INFO ] [MAIN ] WT: Generated 1820 derivative records from 48659 primary records. [2025-10-10T22:45:25.192306] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-10T22:45:25.209984] [DEBUG] [LOCAL ] WTI: Derivative data saved (1820 records). [2025-10-10T22:45:25.210378] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-10T22:45:25.212664] [INFO ] [MAIN ] Derivative Progress: 1781/1823 symbols completed. WTI took 1.1s. Estimated remaining: 16.0s. Rate: 157.2 symbols/min [2025-10-10T22:45:25.213112] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:25.231213] [DEBUG] [LOCAL ] WT: Derivative data saved (1820 records). [2025-10-10T22:45:25.231394] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-10T22:45:25.233765] [INFO ] [MAIN ] Derivative Progress: 1782/1823 symbols completed. WT took 1.2s. Estimated remaining: 15.6s. Rate: 157.3 symbols/min [2025-10-10T22:45:25.234054] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:25.263035] [DEBUG] [LOCAL ] WTRG: Loaded 51727 existing records from primary storage. [2025-10-10T22:45:25.262150] [DEBUG] [LOCAL ] WTS: Loaded 17923 existing records from primary storage. [2025-10-10T22:45:25.263249] [INFO ] [MAIN ] WTRG: Loaded 51727 primary data records. [2025-10-10T22:45:25.263429] [INFO ] [MAIN ] WTS: Loaded 17923 primary data records. [2025-10-10T22:45:25.926682] [DEBUG] [LOCAL ] WTTR: Loaded 45236 existing records from primary storage. [2025-10-10T22:45:25.928053] [INFO ] [MAIN ] WTTR: Loaded 45236 primary data records. [2025-10-10T22:45:26.302958] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:26.311894] [INFO ] [MAIN ] WTRG: Generated 1820 derivative records from 51727 primary records. [2025-10-10T22:45:26.318807] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-10T22:45:26.318725] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:26.319580] [INFO ] [MAIN ] WTS: Generated 1820 derivative records from 17923 primary records. [2025-10-10T22:45:26.319995] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-10T22:45:26.369106] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:26.372072] [DEBUG] [LOCAL ] WTS: Derivative data saved (1820 records). [2025-10-10T22:45:26.371992] [INFO ] [MAIN ] WTTR: Generated 1820 derivative records from 45236 primary records. [2025-10-10T22:45:26.370578] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1820 records). [2025-10-10T22:45:26.372379] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-10T22:45:26.372252] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-10T22:45:26.374659] [INFO ] [MAIN ] Derivative Progress: 1783/1823 symbols completed. WTS took 1.2s. Estimated remaining: 15.3s. Rate: 157.1 symbols/min [2025-10-10T22:45:26.375508] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-10T22:45:26.386823] [INFO ] [MAIN ] Derivative Progress: 1784/1823 symbols completed. WTRG took 1.2s. Estimated remaining: 14.9s. Rate: 157.2 symbols/min [2025-10-10T22:45:26.397405] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1820 records). [2025-10-10T22:45:26.397487] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-10T22:45:26.399543] [INFO ] [MAIN ] Derivative Progress: 1785/1823 symbols completed. WTTR took 1.2s. Estimated remaining: 14.5s. Rate: 157.3 symbols/min [2025-10-10T22:45:26.399940] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:26.400092] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:26.400190] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:26.467366] [DEBUG] [LOCAL ] WU: Loaded 54235 existing records from primary storage. [2025-10-10T22:45:26.467764] [INFO ] [MAIN ] WU: Loaded 54235 primary data records. [2025-10-10T22:45:26.620940] [DEBUG] [LOCAL ] WWW: Loaded 49946 existing records from primary storage. [2025-10-10T22:45:26.638623] [INFO ] [MAIN ] WWW: Loaded 49946 primary data records. [2025-10-10T22:45:26.767185] [DEBUG] [LOCAL ] WY: Loaded 53917 existing records from primary storage. [2025-10-10T22:45:26.956372] [INFO ] [MAIN ] WY: Loaded 53917 primary data records. [2025-10-10T22:45:27.598471] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:27.599741] [INFO ] [MAIN ] WU: Generated 1820 derivative records from 54235 primary records. [2025-10-10T22:45:27.601883] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-10T22:45:27.631105] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:27.633121] [INFO ] [MAIN ] WWW: Generated 1820 derivative records from 49946 primary records. [2025-10-10T22:45:27.634953] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-10T22:45:27.649282] [DEBUG] [LOCAL ] WU: Derivative data saved (1820 records). [2025-10-10T22:45:27.660327] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-10T22:45:27.670579] [INFO ] [MAIN ] Derivative Progress: 1786/1823 symbols completed. WU took 1.3s. Estimated remaining: 14.1s. Rate: 157.1 symbols/min [2025-10-10T22:45:27.671735] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:27.672224] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:27.673587] [INFO ] [MAIN ] WY: Generated 1820 derivative records from 53917 primary records. [2025-10-10T22:45:27.673805] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-10T22:45:27.694235] [DEBUG] [LOCAL ] WWW: Derivative data saved (1820 records). [2025-10-10T22:45:27.694376] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-10T22:45:27.708333] [INFO ] [MAIN ] Derivative Progress: 1787/1823 symbols completed. WWW took 1.3s. Estimated remaining: 13.7s. Rate: 157.2 symbols/min [2025-10-10T22:45:27.709129] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:27.718500] [DEBUG] [LOCAL ] WY: Derivative data saved (1820 records). [2025-10-10T22:45:27.718666] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-10T22:45:27.720835] [INFO ] [MAIN ] Derivative Progress: 1788/1823 symbols completed. WY took 1.3s. Estimated remaining: 13.4s. Rate: 157.2 symbols/min [2025-10-10T22:45:27.721034] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:27.733073] [DEBUG] [LOCAL ] XFLT: Loaded 30248 existing records from primary storage. [2025-10-10T22:45:27.733297] [INFO ] [MAIN ] XFLT: Loaded 30248 primary data records. [2025-10-10T22:45:28.066795] [DEBUG] [LOCAL ] XHR: Loaded 44269 existing records from primary storage. [2025-10-10T22:45:28.067089] [INFO ] [MAIN ] XHR: Loaded 44269 primary data records. [2025-10-10T22:45:28.172262] [DEBUG] [LOCAL ] XOM: Loaded 54573 existing records from primary storage. [2025-10-10T22:45:28.193957] [INFO ] [MAIN ] XOM: Loaded 54573 primary data records. [2025-10-10T22:45:28.601494] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:28.714803] [INFO ] [MAIN ] XFLT: Generated 1820 derivative records from 30248 primary records. [2025-10-10T22:45:28.715880] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-10T22:45:28.743510] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1820 records). [2025-10-10T22:45:28.756064] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-10T22:45:28.758547] [INFO ] [MAIN ] Derivative Progress: 1789/1823 symbols completed. XFLT took 1.1s. Estimated remaining: 13.0s. Rate: 157.1 symbols/min [2025-10-10T22:45:28.758763] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:28.759335] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:28.760516] [INFO ] [MAIN ] XHR: Generated 1820 derivative records from 44269 primary records. [2025-10-10T22:45:28.760851] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-10T22:45:28.777580] [DEBUG] [LOCAL ] XHR: Derivative data saved (1820 records). [2025-10-10T22:45:28.777934] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-10T22:45:28.780113] [INFO ] [MAIN ] Derivative Progress: 1790/1823 symbols completed. XHR took 1.1s. Estimated remaining: 12.6s. Rate: 157.2 symbols/min [2025-10-10T22:45:28.781292] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:28.804473] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:28.805261] [INFO ] [MAIN ] XOM: Generated 1820 derivative records from 54573 primary records. [2025-10-10T22:45:28.805382] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-10T22:45:28.830619] [DEBUG] [LOCAL ] XPER: Loaded 30589 existing records from primary storage. [2025-10-10T22:45:28.831290] [INFO ] [MAIN ] XPER: Loaded 30589 primary data records. [2025-10-10T22:45:28.896477] [DEBUG] [LOCAL ] XOM: Derivative data saved (1820 records). [2025-10-10T22:45:28.908357] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-10T22:45:28.915701] [INFO ] [MAIN ] Derivative Progress: 1791/1823 symbols completed. XOM took 1.2s. Estimated remaining: 12.2s. Rate: 157.2 symbols/min [2025-10-10T22:45:28.926806] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:29.174681] [DEBUG] [LOCAL ] XPEV: Loaded 54414 existing records from primary storage. [2025-10-10T22:45:29.175005] [INFO ] [MAIN ] XPEV: Loaded 54414 primary data records. [2025-10-10T22:45:29.567868] [DEBUG] [LOCAL ] XPO: Loaded 48522 existing records from primary storage. [2025-10-10T22:45:29.568285] [INFO ] [MAIN ] XPO: Loaded 48522 primary data records. [2025-10-10T22:45:29.746754] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:29.750196] [INFO ] [MAIN ] XPER: Generated 1820 derivative records from 30589 primary records. [2025-10-10T22:45:29.886764] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-10T22:45:29.925919] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:29.927834] [INFO ] [MAIN ] XPEV: Generated 1820 derivative records from 54414 primary records. [2025-10-10T22:45:29.927098] [DEBUG] [LOCAL ] XPER: Derivative data saved (1820 records). [2025-10-10T22:45:29.928136] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-10T22:45:29.928076] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-10T22:45:29.930798] [INFO ] [MAIN ] Derivative Progress: 1792/1823 symbols completed. XPER took 1.2s. Estimated remaining: 11.8s. Rate: 157.1 symbols/min [2025-10-10T22:45:29.931723] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:29.963294] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:29.964389] [INFO ] [MAIN ] XPO: Generated 1820 derivative records from 48522 primary records. [2025-10-10T22:45:29.964779] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-10T22:45:29.978618] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1820 records). [2025-10-10T22:45:29.978795] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-10T22:45:29.993829] [DEBUG] [LOCAL ] XPO: Derivative data saved (1820 records). [2025-10-10T22:45:29.993983] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-10T22:45:29.981379] [INFO ] [MAIN ] Derivative Progress: 1793/1823 symbols completed. XPEV took 1.2s. Estimated remaining: 11.5s. Rate: 157.2 symbols/min [2025-10-10T22:45:29.996428] [INFO ] [MAIN ] Derivative Progress: 1794/1823 symbols completed. XPO took 1.1s. Estimated remaining: 11.1s. Rate: 157.2 symbols/min [2025-10-10T22:45:29.996342] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:29.996765] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:30.012376] [DEBUG] [LOCAL ] XPOF: Loaded 38159 existing records from primary storage. [2025-10-10T22:45:30.012696] [INFO ] [MAIN ] XPOF: Loaded 38159 primary data records. [2025-10-10T22:45:30.199093] [DEBUG] [LOCAL ] XYF: Loaded 28704 existing records from primary storage. [2025-10-10T22:45:30.216606] [INFO ] [MAIN ] XYF: Loaded 28704 primary data records. [2025-10-10T22:45:30.414876] [DEBUG] [LOCAL ] XPRO: Loaded 46570 existing records from primary storage. [2025-10-10T22:45:30.426482] [INFO ] [MAIN ] XPRO: Loaded 46570 primary data records. [2025-10-10T22:45:30.985410] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:30.988601] [INFO ] [MAIN ] XPOF: Generated 1820 derivative records from 38159 primary records. [2025-10-10T22:45:30.989551] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-10T22:45:31.004944] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:31.006794] [INFO ] [MAIN ] XYF: Generated 1820 derivative records from 28704 primary records. [2025-10-10T22:45:31.014700] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-10T22:45:31.046582] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:31.048177] [INFO ] [MAIN ] XPRO: Generated 1820 derivative records from 46570 primary records. [2025-10-10T22:45:31.048895] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-10T22:45:31.070008] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1820 records). [2025-10-10T22:45:31.070124] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-10T22:45:31.073829] [INFO ] [MAIN ] Derivative Progress: 1795/1823 symbols completed. XPRO took 1.1s. Estimated remaining: 10.7s. Rate: 157.1 symbols/min [2025-10-10T22:45:31.074393] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:31.073997] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1820 records). [2025-10-10T22:45:31.075459] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-10T22:45:31.078574] [INFO ] [MAIN ] Derivative Progress: 1796/1823 symbols completed. XPOF took 1.1s. Estimated remaining: 10.3s. Rate: 157.2 symbols/min [2025-10-10T22:45:31.079124] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:31.080502] [DEBUG] [LOCAL ] XYF: Derivative data saved (1820 records). [2025-10-10T22:45:31.080585] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-10T22:45:31.082752] [INFO ] [MAIN ] Derivative Progress: 1797/1823 symbols completed. XYF took 1.1s. Estimated remaining: 9.9s. Rate: 157.3 symbols/min [2025-10-10T22:45:31.083178] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:31.153030] [DEBUG] [LOCAL ] YELP: Loaded 46061 existing records from primary storage. [2025-10-10T22:45:31.153311] [INFO ] [MAIN ] YELP: Loaded 46061 primary data records. [2025-10-10T22:45:31.154114] [DEBUG] [LOCAL ] YALA: Loaded 37416 existing records from primary storage. [2025-10-10T22:45:31.197436] [INFO ] [MAIN ] YALA: Loaded 37416 primary data records. [2025-10-10T22:45:31.353410] [DEBUG] [LOCAL ] XYL: Loaded 48625 existing records from primary storage. [2025-10-10T22:45:31.425296] [INFO ] [MAIN ] XYL: Loaded 48625 primary data records. [2025-10-10T22:45:32.175164] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:32.188840] [INFO ] [MAIN ] YALA: Generated 1820 derivative records from 37416 primary records. [2025-10-10T22:45:32.188936] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-10T22:45:32.188112] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:32.190442] [INFO ] [MAIN ] YELP: Generated 1820 derivative records from 46061 primary records. [2025-10-10T22:45:32.191055] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-10T22:45:32.207490] [DEBUG] [LOCAL ] YALA: Derivative data saved (1820 records). [2025-10-10T22:45:32.215081] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-10T22:45:32.221151] [INFO ] [MAIN ] Derivative Progress: 1798/1823 symbols completed. YALA took 1.1s. Estimated remaining: 9.5s. Rate: 157.1 symbols/min [2025-10-10T22:45:32.243534] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:32.244516] [INFO ] [MAIN ] XYL: Generated 1820 derivative records from 48625 primary records. [2025-10-10T22:45:32.244881] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-10T22:45:32.245594] [DEBUG] [LOCAL ] YELP: Derivative data saved (1820 records). [2025-10-10T22:45:32.245962] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-10T22:45:32.247880] [INFO ] [MAIN ] Derivative Progress: 1799/1823 symbols completed. YELP took 1.2s. Estimated remaining: 9.2s. Rate: 157.2 symbols/min [2025-10-10T22:45:32.265739] [DEBUG] [LOCAL ] XYL: Derivative data saved (1820 records). [2025-10-10T22:45:32.265800] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-10T22:45:32.268301] [INFO ] [MAIN ] Derivative Progress: 1800/1823 symbols completed. XYL took 1.2s. Estimated remaining: 8.8s. Rate: 157.2 symbols/min [2025-10-10T22:45:32.269039] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:32.268954] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:32.268889] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:32.340549] [DEBUG] [LOCAL ] YETI: Loaded 53210 existing records from primary storage. [2025-10-10T22:45:32.340791] [INFO ] [MAIN ] YETI: Loaded 53210 primary data records. [2025-10-10T22:45:32.469734] [DEBUG] [LOCAL ] YEXT: Loaded 43739 existing records from primary storage. [2025-10-10T22:45:32.474371] [INFO ] [MAIN ] YEXT: Loaded 43739 primary data records. [2025-10-10T22:45:32.611234] [DEBUG] [LOCAL ] YMM: Loaded 53367 existing records from primary storage. [2025-10-10T22:45:32.645409] [INFO ] [MAIN ] YMM: Loaded 53367 primary data records. [2025-10-10T22:45:33.311670] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:33.314161] [INFO ] [MAIN ] YETI: Generated 1820 derivative records from 53210 primary records. [2025-10-10T22:45:33.314258] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-10T22:45:33.336772] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:33.340117] [INFO ] [MAIN ] YEXT: Generated 1820 derivative records from 43739 primary records. [2025-10-10T22:45:33.341628] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-10T22:45:33.360812] [DEBUG] [LOCAL ] YETI: Derivative data saved (1820 records). [2025-10-10T22:45:33.361403] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-10T22:45:33.363270] [INFO ] [MAIN ] Derivative Progress: 1801/1823 symbols completed. YETI took 1.1s. Estimated remaining: 8.4s. Rate: 157.1 symbols/min [2025-10-10T22:45:33.363843] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:33.380151] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:33.381247] [INFO ] [MAIN ] YMM: Generated 1820 derivative records from 53367 primary records. [2025-10-10T22:45:33.381944] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1820 records). [2025-10-10T22:45:33.381868] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-10T22:45:33.382466] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-10T22:45:33.384980] [INFO ] [MAIN ] Derivative Progress: 1802/1823 symbols completed. YEXT took 1.1s. Estimated remaining: 8.0s. Rate: 157.2 symbols/min [2025-10-10T22:45:33.385476] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:33.405127] [DEBUG] [LOCAL ] YMM: Derivative data saved (1820 records). [2025-10-10T22:45:33.405331] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-10T22:45:33.407712] [INFO ] [MAIN ] Derivative Progress: 1803/1823 symbols completed. YMM took 1.1s. Estimated remaining: 7.6s. Rate: 157.2 symbols/min [2025-10-10T22:45:33.407890] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:33.452675] [DEBUG] [LOCAL ] YRD: Loaded 12135 existing records from primary storage. [2025-10-10T22:45:33.452964] [INFO ] [MAIN ] YRD: Loaded 12135 primary data records. [2025-10-10T22:45:33.559530] [DEBUG] [LOCAL ] YOU: Loaded 50448 existing records from primary storage. [2025-10-10T22:45:33.583367] [INFO ] [MAIN ] YOU: Loaded 50448 primary data records. [2025-10-10T22:45:33.933135] [DEBUG] [LOCAL ] YPF: Loaded 51292 existing records from primary storage. [2025-10-10T22:45:33.944301] [INFO ] [MAIN ] YPF: Loaded 51292 primary data records. [2025-10-10T22:45:34.443186] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:34.444081] [INFO ] [MAIN ] YRD: Generated 1820 derivative records from 12135 primary records. [2025-10-10T22:45:34.444167] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-10T22:45:34.471856] [DEBUG] [LOCAL ] YRD: Derivative data saved (1820 records). [2025-10-10T22:45:34.476992] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-10T22:45:34.479539] [INFO ] [MAIN ] Derivative Progress: 1804/1823 symbols completed. YRD took 1.1s. Estimated remaining: 7.3s. Rate: 157.1 symbols/min [2025-10-10T22:45:34.479710] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:34.477362] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:34.481160] [INFO ] [MAIN ] YOU: Generated 1820 derivative records from 50448 primary records. [2025-10-10T22:45:34.481443] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-10T22:45:34.511822] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:34.513973] [INFO ] [MAIN ] YPF: Generated 1820 derivative records from 51292 primary records. [2025-10-10T22:45:34.514058] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-10T22:45:34.539759] [DEBUG] [LOCAL ] YPF: Derivative data saved (1820 records). [2025-10-10T22:45:34.540298] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-10T22:45:34.542465] [INFO ] [MAIN ] Derivative Progress: 1805/1823 symbols completed. YPF took 1.2s. Estimated remaining: 6.9s. Rate: 157.2 symbols/min [2025-10-10T22:45:34.540180] [DEBUG] [LOCAL ] YOU: Derivative data saved (1820 records). [2025-10-10T22:45:34.542714] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:34.549607] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-10T22:45:34.553411] [INFO ] [MAIN ] Derivative Progress: 1806/1823 symbols completed. YOU took 1.2s. Estimated remaining: 6.5s. Rate: 157.2 symbols/min [2025-10-10T22:45:34.554458] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:34.554224] [DEBUG] [LOCAL ] YSG: Loaded 25646 existing records from primary storage. [2025-10-10T22:45:34.554950] [INFO ] [MAIN ] YSG: Loaded 25646 primary data records. [2025-10-10T22:45:34.903391] [DEBUG] [LOCAL ] YUMC: Loaded 53362 existing records from primary storage. [2025-10-10T22:45:34.904605] [INFO ] [MAIN ] YUMC: Loaded 53362 primary data records. [2025-10-10T22:45:34.983986] [DEBUG] [LOCAL ] YUM: Loaded 51941 existing records from primary storage. [2025-10-10T22:45:34.996597] [INFO ] [MAIN ] YUM: Loaded 51941 primary data records. [2025-10-10T22:45:35.583777] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:35.586242] [INFO ] [MAIN ] YSG: Generated 1820 derivative records from 25646 primary records. [2025-10-10T22:45:35.586585] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-10T22:45:35.604083] [DEBUG] [LOCAL ] YSG: Derivative data saved (1820 records). [2025-10-10T22:45:35.604309] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-10T22:45:35.606736] [INFO ] [MAIN ] Derivative Progress: 1807/1823 symbols completed. YSG took 1.1s. Estimated remaining: 6.1s. Rate: 157.1 symbols/min [2025-10-10T22:45:35.607071] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:35.626786] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:35.627812] [INFO ] [MAIN ] YUMC: Generated 1820 derivative records from 53362 primary records. [2025-10-10T22:45:35.628887] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-10T22:45:35.656424] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:35.657228] [INFO ] [MAIN ] YUM: Generated 1820 derivative records from 51941 primary records. [2025-10-10T22:45:35.657596] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-10T22:45:35.688712] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1820 records). [2025-10-10T22:45:35.688895] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-10T22:45:35.690852] [INFO ] [MAIN ] Derivative Progress: 1808/1823 symbols completed. YUMC took 1.1s. Estimated remaining: 5.7s. Rate: 157.2 symbols/min [2025-10-10T22:45:35.694369] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:35.694231] [DEBUG] [LOCAL ] YUM: Derivative data saved (1820 records). [2025-10-10T22:45:35.695116] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-10T22:45:35.697617] [INFO ] [MAIN ] Derivative Progress: 1809/1823 symbols completed. YUM took 1.2s. Estimated remaining: 5.3s. Rate: 157.2 symbols/min [2025-10-10T22:45:35.698054] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:35.714057] [DEBUG] [LOCAL ] ZBH: Loaded 51529 existing records from primary storage. [2025-10-10T22:45:35.714262] [INFO ] [MAIN ] ZBH: Loaded 51529 primary data records. [2025-10-10T22:45:35.821325] [DEBUG] [LOCAL ] ZEPP: Loaded 18685 existing records from primary storage. [2025-10-10T22:45:35.830268] [INFO ] [MAIN ] ZEPP: Loaded 18685 primary data records. [2025-10-10T22:45:36.230614] [DEBUG] [LOCAL ] ZETA: Loaded 54389 existing records from primary storage. [2025-10-10T22:45:36.343856] [INFO ] [MAIN ] ZETA: Loaded 54389 primary data records. [2025-10-10T22:45:36.660951] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:36.662690] [INFO ] [MAIN ] ZBH: Generated 1820 derivative records from 51529 primary records. [2025-10-10T22:45:36.662791] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-10T22:45:36.684442] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1820 records). [2025-10-10T22:45:36.684825] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-10T22:45:36.687148] [INFO ] [MAIN ] Derivative Progress: 1810/1823 symbols completed. ZBH took 1.1s. Estimated remaining: 5.0s. Rate: 157.1 symbols/min [2025-10-10T22:45:36.687581] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:36.702491] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:45:36.704085] [INFO ] [MAIN ] ZEPP: Generated 1819 derivative records from 18685 primary records. [2025-10-10T22:45:36.704296] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-10T22:45:36.722034] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1819 records). [2025-10-10T22:45:36.722253] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-10T22:45:36.725336] [INFO ] [MAIN ] Derivative Progress: 1811/1823 symbols completed. ZEPP took 1.0s. Estimated remaining: 4.6s. Rate: 157.2 symbols/min [2025-10-10T22:45:36.727247] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:36.742701] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:36.743712] [INFO ] [MAIN ] ZETA: Generated 1820 derivative records from 54389 primary records. [2025-10-10T22:45:36.743778] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-10T22:45:36.797751] [DEBUG] [LOCAL ] ZH: Loaded 26192 existing records from primary storage. [2025-10-10T22:45:36.798560] [INFO ] [MAIN ] ZH: Loaded 26192 primary data records. [2025-10-10T22:45:36.799251] [DEBUG] [LOCAL ] ZGN: Loaded 41436 existing records from primary storage. [2025-10-10T22:45:36.799973] [INFO ] [MAIN ] ZGN: Loaded 41436 primary data records. [2025-10-10T22:45:36.856545] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1820 records). [2025-10-10T22:45:36.905700] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-10T22:45:36.912976] [INFO ] [MAIN ] Derivative Progress: 1812/1823 symbols completed. ZETA took 1.2s. Estimated remaining: 4.2s. Rate: 157.2 symbols/min [2025-10-10T22:45:36.961371] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:37.483893] [DEBUG] [LOCAL ] ZIM: Loaded 54281 existing records from primary storage. [2025-10-10T22:45:37.484769] [INFO ] [MAIN ] ZIM: Loaded 54281 primary data records. [2025-10-10T22:45:37.605858] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:37.608429] [INFO ] [MAIN ] ZH: Generated 1820 derivative records from 26192 primary records. [2025-10-10T22:45:37.619981] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-10T22:45:37.712242] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:37.824153] [DEBUG] [LOCAL ] ZH: Derivative data saved (1820 records). [2025-10-10T22:45:37.834239] [INFO ] [MAIN ] ZGN: Generated 1820 derivative records from 41436 primary records. [2025-10-10T22:45:37.834535] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-10T22:45:37.834845] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-10T22:45:37.837773] [INFO ] [MAIN ] Derivative Progress: 1813/1823 symbols completed. ZH took 1.1s. Estimated remaining: 3.8s. Rate: 157.1 symbols/min [2025-10-10T22:45:37.862596] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1820 records). [2025-10-10T22:45:37.862984] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-10T22:45:37.865022] [INFO ] [MAIN ] Derivative Progress: 1814/1823 symbols completed. ZGN took 1.2s. Estimated remaining: 3.4s. Rate: 157.2 symbols/min [2025-10-10T22:45:37.881392] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:37.882006] [INFO ] [MAIN ] ZIM: Generated 1820 derivative records from 54281 primary records. [2025-10-10T22:45:37.882070] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-10T22:45:37.903062] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1820 records). [2025-10-10T22:45:37.903122] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-10T22:45:37.905312] [INFO ] [MAIN ] Derivative Progress: 1815/1823 symbols completed. ZIM took 0.9s. Estimated remaining: 3.1s. Rate: 157.3 symbols/min [2025-10-10T22:45:37.906017] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:37.905855] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:37.906181] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:37.918625] [DEBUG] [LOCAL ] ZKH: Loaded 7702 existing records from primary storage. [2025-10-10T22:45:37.918928] [INFO ] [MAIN ] ZKH: Loaded 7702 primary data records. [2025-10-10T22:45:38.268075] [DEBUG] [LOCAL ] ZK: Loaded 39847 existing records from primary storage. [2025-10-10T22:45:38.269023] [INFO ] [MAIN ] ZK: Loaded 39847 primary data records. [2025-10-10T22:45:38.291166] [DEBUG] [LOCAL ] ZIP: Loaded 44484 existing records from primary storage. [2025-10-10T22:45:38.326795] [INFO ] [MAIN ] ZIP: Loaded 44484 primary data records. [2025-10-10T22:45:38.937332] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:45:38.939341] [INFO ] [MAIN ] ZKH: Generated 1819 derivative records from 7702 primary records. [2025-10-10T22:45:38.939708] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-10T22:45:38.957233] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1819 records). [2025-10-10T22:45:38.957738] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-10T22:45:38.960046] [INFO ] [MAIN ] Derivative Progress: 1816/1823 symbols completed. ZKH took 1.1s. Estimated remaining: 2.7s. Rate: 157.1 symbols/min [2025-10-10T22:45:38.960429] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:38.977428] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:38.978224] [INFO ] [MAIN ] ZK: Generated 1820 derivative records from 39847 primary records. [2025-10-10T22:45:38.978373] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-10T22:45:38.997087] [DEBUG] [LOCAL ] ZK: Derivative data saved (1820 records). [2025-10-10T22:45:38.997342] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-10T22:45:38.999378] [INFO ] [MAIN ] Derivative Progress: 1817/1823 symbols completed. ZK took 1.1s. Estimated remaining: 2.3s. Rate: 157.2 symbols/min [2025-10-10T22:45:38.999582] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:39.013322] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:39.014006] [INFO ] [MAIN ] ZIP: Generated 1820 derivative records from 44484 primary records. [2025-10-10T22:45:39.014106] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-10T22:45:39.034499] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1820 records). [2025-10-10T22:45:39.034692] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-10T22:45:39.036748] [INFO ] [MAIN ] Derivative Progress: 1818/1823 symbols completed. ZIP took 1.1s. Estimated remaining: 1.9s. Rate: 157.3 symbols/min [2025-10-10T22:45:39.036988] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:39.045125] [DEBUG] [LOCAL ] ZTR: Loaded 16994 existing records from primary storage. [2025-10-10T22:45:39.045259] [INFO ] [MAIN ] ZTR: Loaded 16994 primary data records. [2025-10-10T22:45:39.220075] [DEBUG] [LOCAL ] ZTO: Loaded 50281 existing records from primary storage. [2025-10-10T22:45:39.244248] [INFO ] [MAIN ] ZTO: Loaded 50281 primary data records. [2025-10-10T22:45:39.705474] [DEBUG] [LOCAL ] ZTS: Loaded 53853 existing records from primary storage. [2025-10-10T22:45:39.718891] [INFO ] [MAIN ] ZTS: Loaded 53853 primary data records. [2025-10-10T22:45:40.043830] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:40.045746] [INFO ] [MAIN ] ZTR: Generated 1820 derivative records from 16994 primary records. [2025-10-10T22:45:40.046228] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-10T22:45:40.066835] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1820 records). [2025-10-10T22:45:40.067085] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-10T22:45:40.069147] [INFO ] [MAIN ] Derivative Progress: 1819/1823 symbols completed. ZTR took 1.1s. Estimated remaining: 1.5s. Rate: 157.1 symbols/min [2025-10-10T22:45:40.069696] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:40.084470] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:40.085790] [INFO ] [MAIN ] ZTO: Generated 1820 derivative records from 50281 primary records. [2025-10-10T22:45:40.086044] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-10T22:45:40.129028] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1820 records). [2025-10-10T22:45:40.129144] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-10T22:45:40.128940] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-10T22:45:40.129919] [INFO ] [MAIN ] ZTS: Generated 1819 derivative records from 53853 primary records. [2025-10-10T22:45:40.132400] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-10T22:45:40.132213] [INFO ] [MAIN ] Derivative Progress: 1820/1823 symbols completed. ZTO took 1.2s. Estimated remaining: 1.1s. Rate: 157.2 symbols/min [2025-10-10T22:45:40.133097] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-10T22:45:40.150285] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1819 records). [2025-10-10T22:45:40.160860] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-10T22:45:40.163039] [INFO ] [MAIN ] Derivative Progress: 1821/1823 symbols completed. ZTS took 1.1s. Estimated remaining: 0.8s. Rate: 157.3 symbols/min [2025-10-10T22:45:40.164093] [DEBUG] [LOCAL ] ZVIA: Loaded 35978 existing records from primary storage. [2025-10-10T22:45:40.164561] [INFO ] [MAIN ] ZVIA: Loaded 35978 primary data records. [2025-10-10T22:45:40.496304] [DEBUG] [LOCAL ] ZWS: Loaded 42839 existing records from primary storage. [2025-10-10T22:45:40.496538] [INFO ] [MAIN ] ZWS: Loaded 42839 primary data records. [2025-10-10T22:45:40.823999] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:40.825213] [INFO ] [MAIN ] ZVIA: Generated 1820 derivative records from 35978 primary records. [2025-10-10T22:45:40.825490] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-10T22:45:40.842908] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1820 records). [2025-10-10T22:45:40.843078] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-10T22:45:40.845291] [INFO ] [MAIN ] Derivative Progress: 1822/1823 symbols completed. ZVIA took 0.8s. Estimated remaining: 0.4s. Rate: 157.2 symbols/min [2025-10-10T22:45:40.861902] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-10T22:45:40.862523] [INFO ] [MAIN ] ZWS: Generated 1820 derivative records from 42839 primary records. [2025-10-10T22:45:40.862583] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-10T22:45:40.878057] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1820 records). [2025-10-10T22:45:40.878116] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-10T22:45:40.880215] [INFO ] [MAIN ] Derivative Progress: 1823/1823 symbols completed. ZWS took 0.7s. Estimated remaining: 0.0s. Rate: 157.3 symbols/min [2025-10-10T22:45:40.880957] [INFO ] [MAIN ] Parallel derivative generation completed in 11m 35s [2025-10-10T22:45:40.881046] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (1823/1823 symbols) [2025-10-10T22:45:41.519744] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (1823/1823 @ 100.00%)' [2025-10-10T22:45:41.520585] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-10T22:45:41.520948] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-10T22:45:41.521121] [INFO ] [STATE ] Last completion updated: 2025-10-10T22:45:41.521023